投稿時間:2021-04-09 21:44:03 RSSフィード2021-04-09 21:00 分まとめ(59件)

カテゴリー等 サイト名等 記事タイトル・トレンドワード等 リンクURL 頻出ワード・要約等/検索ボリューム 登録日
IT ITmedia 総合記事一覧 [ITmedia ビジネスオンライン] 「給与のデジタル払いに反対」40.9%、理由は https://www.itmedia.co.jp/business/articles/2104/09/news135.html itmedia 2021-04-09 20:25:00
IT MOONGIFT Chatwoot - カスタマーコミュニケーションを一手に管理 http://feedproxy.google.com/~r/moongift/~3/kAtLe8Z5kEU/ chatwoot 2021-04-09 21:00:00
python Pythonタグが付けられた新着投稿 - Qiita 活性化関数について https://qiita.com/toshi_machine/items/cdb5bee6cabfca3faab1 活性化関数についてはじめにDeeplearningでは活性化関数というものが用いられます基本的な活性化関数TanhSigmoidReluの特徴及びそれら関数のpythonコードをメモしましたTanh出力は、の間。 2021-04-09 20:55:46
js JavaScriptタグが付けられた新着投稿 - Qiita HTMLタグにdatasetを指定して進捗サークルチャートを表示させるスクリプト https://qiita.com/akebi_mh/items/0b6428636fcf71b03562 HTMLタグにdatasetを指定して進捗サークルチャートを表示させるスクリプトこちらの記事の続きです。 2021-04-09 20:31:34
Program [全てのタグ]の新着質問一覧|teratail(テラテイル) 【C#】JSON形式でPOST https://teratail.com/questions/332473?rss=all 【C】JSON形式でPOST実現したいことGmailで受信したメールの本文をnbspGoogleAppsScriptnbspでJSON形式に変換してとあるURLにPOSTして、受信した側で本文を加工してDBに登録するというシステムを作っています。 2021-04-09 20:58:42
Program [全てのタグ]の新着質問一覧|teratail(テラテイル) 「ASP.NET WebAPI」 PostgresDBで取得したデータを変数に代入する際の疑問点 https://teratail.com/questions/332472?rss=all 「ASPNETWebAPI」PostgresDBで取得したデータを変数に代入する際の疑問点ASPNETnbspC初学者です。 2021-04-09 20:58:26
Program [全てのタグ]の新着質問一覧|teratail(テラテイル) C# アルゴリズム基礎 https://teratail.com/questions/332471?rss=all A×Bの結果をCに求める。 2021-04-09 20:56:06
Program [全てのタグ]の新着質問一覧|teratail(テラテイル) GKEでuwsgiアプリケーションが起動されない問題 https://teratail.com/questions/332470?rss=all しかし、デプロイに失敗します。 2021-04-09 20:49:56
Program [全てのタグ]の新着質問一覧|teratail(テラテイル) 重ね書きしたグラフの画像出力ができない https://teratail.com/questions/332469?rss=all 重ね書きしたグラフの画像出力ができない前提・実現したいこと複数のデータを重ね書きしてグラフ化し、画像として出力したい。 2021-04-09 20:09:49
Program [全てのタグ]の新着質問一覧|teratail(テラテイル) EXEファイルのセキュリティ https://teratail.com/questions/332468?rss=all EXEファイルのセキュリティ前提・実現したいことseleniumで様々なサイトへ自動アクセスができ、外部へ漏れても問題ないようにしたいです。 2021-04-09 20:09:36
Program [全てのタグ]の新着質問一覧|teratail(テラテイル) C#の勉強法について https://teratail.com/questions/332467?rss=all 独学で効率の良い勉強方法を教えて下さい。 2021-04-09 20:09:07
Ruby Rubyタグが付けられた新着投稿 - Qiita クラスの依存関係を明確にする https://qiita.com/sho_a_igarashi/items/6f553ed4cb5d547f9f96 クラスの依存関係を明確にする某参考書を読んでいて参考になった箇所があったのでメモ。 2021-04-09 20:11:15
Docker dockerタグが付けられた新着投稿 - Qiita 【備忘録】DockerでLaravel + Vue環境構築(Nuxtなしver) https://qiita.com/kaba_farm/items/4e07dd14c4e3848d0658 【備忘録】DockerでLaravelVue環境構築Nuxtなしver目的Nuxtを使用しないプロジェクトに参画するため、vuerouterやvuexの設定等を復習したい。 2021-04-09 20:12:59
Git Gitタグが付けられた新着投稿 - Qiita 全てのブランチを最新コミットと共に表示 https://qiita.com/kke1229/items/20ee4251dc8aeb769c18 gitbranchvv 2021-04-09 20:59:54
技術ブログ Developers.IO WSP版WorkSpacesで作成したイメージ・バンドルでステータスが “UNHEALTHY” になったのでトラブルシューティングしてみた https://dev.classmethod.jp/articles/wsp-workspaces-image-unhealthy/ unhealthy 2021-04-09 11:45:08
技術ブログ Developers.IO QuickSight で日付ギャップとグループディメンションを組み合わせると null グループが作成されてしまう https://dev.classmethod.jp/articles/quicksight-group-null/ quicksight 2021-04-09 11:42:42
技術ブログ Developers.IO EC2インスタンスは正常なのになぜかPowerOffされていた。 https://dev.classmethod.jp/articles/ec2-instance-retirement-notification/ start 2021-04-09 11:09:02
海外TECH DEV Community Spice up your console logs with styling https://dev.to/dailydevtips1/spice-up-your-console-logs-with-styling-3moj Spice up your console logs with stylingSometimes normal console logs just don t cut it You might want to warn people to not paste random scripts they found online like Facebook Or maybe you want to hire them and shout in the console to potential devs Whatever your reasons might be you can spice up your console logs with some styling Adding some styles to our console logsTo get right in there are several specifiers we can use in the front of our console logs to state whatever it should render s Format as a string i d Format as integer f Format as a float o Format as expendable DOM element O Format as an expendable JavaScript element c Apply CSS rules taken from the second parameter Today we will be focussing on the last rule It looks something like this console log cI m blue da ba dee da ba daa color blue This will result in the following But that s not all You can write as many rules of CSS as you like console log cI m so super stylish color bcee font size rem background eddec text shadow px px ab px px dabcd px px px ab px px px dabcd px px px ab px px px dabcd px px px ab px px px dabcd px px px ab px px px dabcd px px px ab px px px dabcd px px px ab px px px dabcd px px px ab px px px dabcd And it will give us this result As you can see the possibilities are endless maybe even over the top But it might help you to make your console logs just a bit more appealing Thank you for reading and let s connect Thank you for reading my blog Feel free to subscribe to my email newsletter and connect on Facebook or Twitter 2021-04-09 11:46:30
海外TECH DEV Community How to deal with Missing Values in Machine Learning https://dev.to/atultyagi612/how-to-deal-with-missing-values-in-machine-learning-hjo How to deal with Missing Values in Machine LearningWhen you work on real world data it is often to have lots of missing values There is much cause of missing data may be People do not respond to specific questions in the survey Data entry errors The individual drops out before sampling or many more reasons The handling of data is very important during the preprocessing of the dataset because most machine learning algorithms do not support missing values In this article I try to cover many ways to handle missing values in the dataset Variable DeletionReplacing missing values with Mean Median ModeImpute missing values for continuous variableImpute missing values for categorical variableAssigning An Unique CategoryPredicting The Missing ValuesUsing Algorithms that Support missing values Variable DeletionThis method commonly used to handle the null values In this variable Deletion method we delete a whole column with missing values and it depends on case to case We use this method only when there are lots of missing values in a particular column than variables Let s see it with an exampleFor this example we are going to use the famous Kaggle dataset house price predictiondata pd read csv house price csv total data isnull sum sort values ascending False percent total len data pd concat total percent axis keys Total Percent head Here you can clearly see that columns have Null values higher than so it is good to drop those columns from our data data data data columns data isnull mean lt You can also drop specific rows with a higher number of missing values This may increase the accuracy of your model rather than filling these columns This is beneficial only when you have a large amount of data data isnull sum axis sort values ascending False head Complete removal of data with missing values results in a robust and highly accurate model if it does not have a high weightage But if the column has a high correlation with the output we recommend not to delete it because it may lead to less accuracy and Loss of a lot of information Replacing missing values with Mean Median Mode Impute missing values for continuous variableThis is another common technique use to handle missing data In this method we replace missing values of numerical data like age a salary of a person with the mean median of the column that s why it can prevent the loss of data compared to the previous method The missing values are replaced by the mean value data MSSubClass data MSSubClass fillna data MSSubClass mean Impute missing values for categorical variableThe above code is only for numerical values for catagirical values we replacing the missing values with the maximum occurred value in a feature The missing values are replaced by the median value data SaleCondition data SaleCondition fillna data SaleCondition mode Assigning An Unique CategoryIf the number of missing values is very large then it can be replaced with a new category Let s understand it with an exampleFor this example we are going to use the Titanic dataset from Kaggle Read data from CSVdata pd read csv titanic csv data Cabin Replace null values with New category U data Cabin data Cabin fillna U data Cabin This method is an approximation that may lead to variance in our data but it is better than dropping a whole column row that s why it Prevent data loss and work better with a small dataset this method works better on linear data but may cause data leakage Predicting The Missing ValuesIn this method we use the features which have not null values and train a model to predict missing values This method may give us better accuracy than replacing it with the mean mode median if the null values are less let see it with an example In this example we are going to Kaggle the Stroke dataset and train a RandomForestRegressor model using other available features to predict the missing values in bmi feature Load dataset data pd read csv healthcare dataset stroke data csv Find Column with null valuesdata isnull sum sort values ascending False head Predict null values and replace null values with predicted values in datadata data data bmi notnull data data data bmi isnull temp Y data bmi temp X data drop bmi axis temp X data drop bmi axis from sklearn ensemble import RandomForestRegressormod RandomForestRegressor mod fit temp X temp Y pred mod predict temp X k for i in range len data bmi if data bmi i data bmi i pred k k k It gives a better result than earlier methods Using Algorithms that Support missing valuesAll the machine learning algorithms don t support missing values but some may The k nearest neighbors KNN algorithm is a simple supervised machine learning algorithm that can be used to solve both classification and regression problems It works on the principle of a distance measure that s why it can ignore a column when a value is missing Naive Bayes can also support missing values when making a prediction But in python The sklearn implementations of naive Bayes and k Nearest Neighbors do not support missing values In these both algorithms you no need to handle missing values in each column as ML algorithms will handle them efficiently ConclusionIn this article I discuss many ways to deal with missing values and I try my best to explain these methods but there is no perfect method to handle missing data all the methods give the best performance on different conditions depend on data now let it stop here I hope you find this article useful and able to learn new things from it Thank you for reading 2021-04-09 11:15:48
海外TECH DEV Community Country Code to Flag Emoji https://dev.to/jorik/country-code-to-flag-emoji-a21 Country Code to Flag EmojiInstead of showing boring countrycodes like US CH NL it is much nicer to show the flag emojis and right This shouldn t be hard to do with some JavaScript function getFlagEmoji countryCode const codePoints countryCode toUpperCase split map char gt xFE char charCodeAt return String fromCodePoint codePoints The Flag emoji is a combination of the two characters starting at unicode position xFE for the letter A For CH Switzerland we want the output to be xFE xFED These are hexadecimal numbers which we can just compute with like decimal numbers Run down of what happens in this small little function First uppercase the country code input Split into an array to iterate over each character Receive the UTF index from the character using charCodeAt For the letter A this is We should substract the starting point from this number to get the index of the character in the alphabet Now simply add this to the flag starting index xFE and return this value The String fromCodePoint function will return the final emoji characters for the computed indexes Example getFlagEmoji US getFlagEmoji NL getFlagEmoji CH Instant flags with no load time or external resources 2021-04-09 11:03:21
海外TECH DEV Community The Superlative Guide to Data Structures in JavaScript https://dev.to/nielsenjared/the-superlative-guide-to-data-structures-in-javascript-5edj The Superlative Guide to Data Structures in JavaScriptAt some point in your career today you will want to learn data structures It s not just to ace the technical interview and land your dream job Learning data structures in JavaScript will help you understand how software works and improve your problem solving skills If you want to stay in the loop sign up for my newsletter The Solution Data Structures in JavaScriptThe following list is a table of contents of my articles about data structures in JavaScript If you think there s something missing let me know on Twitter jarednielsen And there s more on the way Data Structures in JavaScript ArrayData Structures in JavaScript StackData Structures in JavaScript QueueData Structures in JavaScript Linked ListData Structures in JavaScript TreeData Structures in JavaScript Tree TraversalData Structures in JavaScript Tree SearchData Structures in JavaScript Tree Node RemovalData Structures in JavaScript GraphData Structures in JavaScript Breadth First Search Graph TraversalData Structures in JavaScript Shortest Path Graph TraversalData Structures in JavaScript Depth First Search Graph TraversalData Structures in JavaScript Topological Sort with Depth First Search Graph TraversalData Structures in JavaScript Hash TableData Structures in JavaScript Separate Chaining Hash Table CollisionsData Structures in JavaScript Linear Probing Hash Table CollisionsIf you want all this and more in one package pick up a copy of The Data Structures of Highly Effective Developers 2021-04-09 11:03:02
Apple AppleInsider - Frontpage News Linux 5.13 update expected to add Apple Silicon M1 support https://appleinsider.com/articles/21/04/09/linux-513-update-expected-to-add-apple-silicon-m1-support Linux update expected to add Apple Silicon M supportPreliminary support for the Apple Silicon M processor is now expected in Linux though it may still be years before it s fully finished Linux running on Apple SiliconAlthough Linux has been already been run on Apple Silicon M it s been through a series of patches designed to make a version boot on the new machines Now Linux is expected to gain preliminary support in its kernel Read more 2021-04-09 11:29:17
Apple AppleInsider - Frontpage News Apple again said to be using 120Hz ProMotion displays in 'iPhone 13' lineup https://appleinsider.com/articles/21/04/09/apple-again-said-to-be-using-120hz-promotion-displays-in-iphone-13-lineup Apple again said to be using Hz ProMotion displays in x iPhone x lineupAnother supply chain report is giving more credence to previous claims that the iPhone Pro lineup will have a Hz refresh display Mockup of iPhone Pro Low temperature polycrystalline oxide LTPO displays have been rumored for the iPhone for about two years However Friday s report claims that the displays will finally arrive on the iPhone granting the device a Hz refresh display for the first time Read more 2021-04-09 11:12:12
海外TECH Engadget The Morning After: Netflix made a major movie deal with Sony Pictures https://www.engadget.com/netflix-sony-streaming-tma-114204692.html brain 2021-04-09 11:42:04
海外TECH Engadget Google's Nest Thermostat is the cheapest it's ever been https://www.engadget.com/google-nest-thermostat-amazon-deal-111504158.html original 2021-04-09 11:15:04
医療系 医療介護 CBnews 先行接種2回目で疼痛9割、倦怠感7割-コロナワクチン、健康観察の中間報告 https://www.cbnews.jp/news/entry/20210409195844 中間報告 2021-04-09 20:10:00
金融 金融庁ホームページ 金融安定理事会によるG20財務大臣・中央銀行総裁へのレターについて掲載しました。 https://www.fsa.go.jp/inter/fsf/20210409/chairsletter.html 中央銀行 2021-04-09 11:52:00
金融 金融庁ホームページ 金融安定理事会による「新型コロナウイルス感染症対応の支援措置-延長、修正、終了」について掲載しました。 https://www.fsa.go.jp/inter/fsf/20210409/covidreport.html 新型コロナウイルス 2021-04-09 11:52:00
金融 金融庁ホームページ 入札公告等を更新しました。 https://www.fsa.go.jp/choutatu/choutatu_j/nyusatu_menu.html 公告 2021-04-09 11:30:00
海外ニュース Japan Times latest articles Panel of Japan’s ruling LDP to seek early passage of law on LGBT understanding https://www.japantimes.co.jp/news/2021/04/09/national/lgbt-ldp-same-sex-marriage-discrimination/ Panel of Japan s ruling LDP to seek early passage of law on LGBT understandingA draft outline of the bill requires the government to set a basic plan for promoting understanding of sexual and gender minorities and review its 2021-04-09 21:42:43
海外ニュース Japan Times latest articles Biden sets out first attempt at tackling U.S. gun violence ‘epidemic’ https://www.japantimes.co.jp/news/2021/04/09/world/biden-guns-executive-order/ Biden sets out first attempt at tackling U S gun violence epidemic With Congress unable to agree on broad new gun regulations Biden has announced six executive measures that he said will help tamp down the crisis 2021-04-09 21:39:33
海外ニュース Japan Times latest articles Netflix gets ‘Spider-Man’ and ‘Jumanji’ franchises in multiyear Sony deal https://www.japantimes.co.jp/news/2021/04/09/business/corporate-business/netflix-sony-television-film/ dealfinancial 2021-04-09 21:15:51
海外ニュース Japan Times latest articles In world first, COVID-19 patient in Japan undergoes living donor lung transplant https://www.japantimes.co.jp/news/2021/04/09/national/science-health/covid-19-japan-kyoto-hospitals-transplants-health-kyoto-university-hospital/ In world first COVID patient in Japan undergoes living donor lung transplantThe operation which took around hours to perform transplanted part of healthy lungs from the patient s husband and son 2021-04-09 21:03:38
海外ニュース Japan Times latest articles Fast Retailing keeping eye on cotton supply amid Xinjiang controversy https://www.japantimes.co.jp/news/2021/04/09/business/corporate-business/uniqlo-xinjiang-cotton/ Fast Retailing keeping eye on cotton supply amid Xinjiang controversyCEO Tadashi Yanai said that his company which runs the Uniqlo casual clothing chain would immediately halt business with suppliers if forced labor is found 2021-04-09 20:47:15
海外ニュース Japan Times latest articles More countries restrict use of AstraZeneca shot as world scramble for vaccines https://www.japantimes.co.jp/news/2021/04/09/world/astrazeneca-setbacks-continue/ More countries restrict use of AstraZeneca shot as world scramble for vaccinesBritain sought Thursday to quell fears over the jab saying the potential side effects were extremely rare ーand the risk of getting seriously sick 2021-04-09 20:42:41
海外ニュース Japan Times latest articles Nadeshiko Japan routs Paraguay 7-0 in friendly https://www.japantimes.co.jp/sports/2021/04/09/soccer/japan-routs-paraguay/ march 2021-04-09 21:10:08
ニュース BBC News - Home Prince Philip has died aged 99, Buckingham Palace announces https://www.bbc.co.uk/news/uk-11437314 husband 2021-04-09 11:54:07
ニュース BBC News - Home Covid-19: People can start thinking about foreign travel - Shapps https://www.bbc.co.uk/news/business-56682226 secretary 2021-04-09 11:07:01
ニュース BBC News - Home Prince Philip: An extraordinary man who led an extraordinary life https://www.bbc.co.uk/news/uk-50589065 edinburgh 2021-04-09 11:15:29
ニュース BBC News - Home PM Boris Johnson pays tribute to Prince Philip https://www.bbc.co.uk/news/uk-56688242 downing 2021-04-09 11:46:32
ニュース BBC News - Home Obituary: HRH The Prince Philip, Duke of Edinburgh https://www.bbc.co.uk/news/uk-10224525 constant 2021-04-09 11:13:38
ニュース BBC News - Home Prince Philip: 99 years, 143 countries and one very famous wife https://www.bbc.co.uk/news/uk-42651950 husband 2021-04-09 11:25:54
ニュース BBC News - Home Prince Philip: A life in pictures https://www.bbc.co.uk/news/in-pictures-36417297 scotland 2021-04-09 11:18:10
ニュース BBC News - Home Sporting memories of Prince Philip https://www.bbc.co.uk/sport/42430153 philip 2021-04-09 11:23:04
ニュース BBC News - Home Covid: How are European countries tackling the pandemic? https://www.bbc.co.uk/news/explainers-53640249 countries 2021-04-09 11:28:27
ニュース BBC News - Home Covid vaccines: How fast is progress around the world? https://www.bbc.co.uk/news/world-56237778 programmes 2021-04-09 11:40:37
ビジネス ダイヤモンド・オンライン - 新着記事 来週(4/12~16)の日経平均株価の予想レンジは、 2万9500~3万500円! 日米で決算発表が本格化する 中では「業績面で安心感があるハイテク株」が狙い目! - 来週の日経平均株価の予想レンジを発表! https://diamond.jp/articles/-/268136 来週の日経平均株価の予想レンジは、万万円日米で決算発表が本格化する中では「業績面で安心感があるハイテク株」が狙い目来週の日経平均株価の予想レンジを発表来週の日経平均株価の予想レンジを発表投資情報サービス会社・ラカンリチェルカの村瀬智一さんが、今週の市況を振り返って分析。 2021-04-09 20:10:00
LifeHuck ライフハッカー[日本版] 1分間で全身に効く|運動後も脂肪燃焼効果が続く「HIIT」 https://www.lifehacker.jp/2021/04/232692mylohas-twitter-exercise58.html twitter 2021-04-09 21:00:00
GCP Google Cloud Platform Japan 公式ブログ 政府との連携による気候問題への取り組み https://cloud.google.com/blog/ja/topics/public-sector/working-with-governments-on-climate-goals/ Googleでは、年までに以上の都市に支援を提供し、年間炭素排出量を億トン減らすことを目標として設定していますこれは、日本の年分の炭素排出量に相当します。 2021-04-09 13:00:00
GCP Google Cloud Platform Japan 公式ブログ Auto Trader: Oracle から PostgreSQL への道のり https://cloud.google.com/blog/ja/products/databases/how-auto-trader-migrated-its-on-prem-databases-to-cloud-sql/ それ以来、このサービスのCloudSQLインスタンスのリソースを分以内で簡単にスケールできています。 2021-04-09 13:00:00
北海道 北海道新聞 円山公園で花見 宴会はNG 札幌市要請 平岡公園も https://www.hokkaido-np.co.jp/article/531558/ 円山公園 2021-04-09 20:09:40
北海道 北海道新聞 アイヌ不適切表現審議入り BPO、日テレ情報番組 https://www.hokkaido-np.co.jp/article/531578/ 情報番組 2021-04-09 20:02:00
北海道 北海道新聞 空手道連盟、強化委員長を解任 パワハラ問題で厳しい姿勢 https://www.hokkaido-np.co.jp/article/531577/ 強化委員 2021-04-09 20:02:00
IT 週刊アスキー Switch/PS4『新すばらしきこのせかい』7月27日に発売決定!Epic Games Storeでも2021年夏ごろに発売 https://weekly.ascii.jp/elem/000/004/050/4050986/ epicgamesstore 2021-04-09 20:25:00
IT 週刊アスキー 『ワンダーボーイ アーシャ・イン・モンスターワールド』でサードトレーラー「あの名作が帰ってきた!」編を公開! https://weekly.ascii.jp/elem/000/004/050/4050985/ nintendo 2021-04-09 20:15:00
海外TECH reddit Prince Philip, the Duke of Edinburgh and consort to Queen Elizabeth II, dies aged 99 https://www.reddit.com/r/worldnews/comments/mnerwn/prince_philip_the_duke_of_edinburgh_and_consort/ Prince Philip the Duke of Edinburgh and consort to Queen Elizabeth II dies aged submitted by u azog to r worldnews link comments 2021-04-09 11:04:40
GCP Cloud Blog Recovering global wildlife populations using ML https://cloud.google.com/blog/topics/developers-practitioners/recovering-global-wildlife-populations-using-ml/ Recovering global wildlife populations using MLWildlife provides critical benefits to support nature and people Unfortunately wildlife is slowly but surely disappearing from our planet and we lack reliable and up to date information to understand and prevent this loss By harnessing the power of technology and science we can unite millions of photos from motion sensored cameras around the world and reveal how wildlife is faring in near real time and make better decisions wildlifeinsights org aboutCase study backgroundGoogle partnered with several leading conservation organizations to build a project known as Wildlife Insights which is a web app that enables people to upload manage and identify images of wildlife from camera traps The intention is for anyone in the world who wishes to protect wildlife populations and take inventory of their health to do so in a non invasive way  The tricky part however is reviewing each of the millions of photos and identifying every species and so this is where Machine Learning is of great help with this big data problem Themodels built by the inter organizational collaboration presently classifies up to species and includes region based logic such as preventing a camera trap in Asiaーfor exampleーfrom classifying an African elephant using geo fencing These models have been in development for several years and are continuously being evolved to serve animals all over the globe You can learn more about it here This worldwide collaboration took a lot of work but much of the basic technology used isavailable to you at WildlifeLifeInsights org And for those interested in wanting to learn how to build a basic image classifier inspired from this wildlife project please continue reading You can also go deeper by trying out our sample tutorial at the end which contains the code we used and lets you run it interactively in a step by step notebook you can click the “play icon at each step to run each process How to build an image classification model to protect wildlifeWe re launching a Google Cloud series called “People and Planet AI to empower users to build amazing apps that can help solve complex social and environmental challenges inspired from real case studies such as the project above In this first episode we show you how to use Google Cloud s Big Data amp ML capabilities to automatically classify images of animals from camera traps You can check out the video here Requirements to get startedHardwareYou would require two hardware components Camera trap s →to take photos which we also strongly recommend you share by uploading on Wildlife Insights to help build a global observation network of wildlife  Micro controller s like a Raspberry Pi or Arduino → to serve as a small linux computer for each camera It hosts the ML model locally and does the heavy lifting of labeling images by species as well as omitting blank images that aren t helpful With these two tools the goal is to have the labeled images then uploaded via an internet connection This can be done over a cellular network However in remote areas you can carry the microcontroller to a wifi enabled area periodically to do the transfer Friendly tips  In order for the microcontroller to send the images it s classified over the internet we recommend using Cloud PubSub which publishes the images as messages to an endpoint in your cloud infrastructure PubSub helps send and receive messages between independent applications over the internet when managing dozens or hundreds of camera traps and their micro controllers you can leverage Cloud IoT core to upload your ML classification model on all these devices simultaneouslyーespecially as you update the model with new data from the field SoftwareThe model is trained and output via Google Cloud using a free camera trap dataset from lila science It costs less than each time to train the model as of the publishing of this article the granular breakdown is listed at the bottom of this article  TIP you can retrain once or twice a year depending on how many images of new species you collect and or how frequently you want to upgrade the image classification model Image selection for training and validation of an ML modelThe two products that perform most of the heavy lifting are Dataflow and AI Platform Unified Dataflow is a serverless data processing service that can process very large amounts of data needed for Machine Learning activities In this scenario we use it to run jobs Dataflow job creates a database in BigQuery from image metadata The columns of the metadata collected are used from the Camera Traps database mentioned above This is a one time setup category The species we want to predict this is our label file name The path where the image file is located We will also do some very basic data cleaning like discarding rows with categories that are note useful like   ref empty unidentifiable unidentified unknown Dataflow job makes a list of images that would be great for creating a balanced dataset This is informed by our requirements for selecting images that have a minimum and maximum amount of species per category  This is to ensure we train abias free model that doesn t include a species it has too little information about and is later unable to classify it correctly  In emoji examples the data looks skewed like this  When this dataset balancing act is completed Dataflow proceeds to download the actual images into Cloud Storage from lila science  This enables us to only store and process the images that are relevant and not the entire dataset keeping computation time and costs to a minimum Building the ML modelWe build a model with AI Platform Unified which uses AutoML and the images we stored in Cloud Storage This is the part where historically speaking when training a model it could take days now it takes hours Once the model is ready you can download it and import it into each micro controller to begin classifying the images locally To quickly show you how this looks we will enable the model to live in the cloud let s see what the model thinks about some of these images Export model for a microcontrollerThe prior example was for exporting the model as an online endpoint however in order to export your model and then download it into a microcontroller here are the instructions Try it outYou can use WildLifeInsights org s free webapp to upload and classify images today However if you would like to build your own classification model try out our sample or check out the code in GitHub It requires no prior knowledge and it contains all the code you need to train an image classification model and then run several predictions in an online notebook format simply scroll to the bottom and click “open in Colab per this screenshot As mentioned earlier what used to take days can now compute in hours And so all you will need for this project is to ️Set aside hours you click run for each step and the longest part just runs in the background you simply need to check back after hours to move onto the next and last step  Create a free Google Cloud project you will then delete that project when you are finished to ensure you do not incur additional costs since the online model has an hourly cost Optional information Pricing breakdown The total cost for running this sample in your own Cloud project lt will vary slightly on each run Please note rates are based from the date of the publishing of this article and could vary Cloud Storage is in free tier below GB Does not include Cloud IoT Core nor if you wanted a cloud server to be an endpoint to listen to it constantly hourly charge to have devices speak to it online anytime  This option is when you don t use a microcontroller It s a prediction web service Create images database minutes wall time Dataflow Total vCPU vCPU hr vCPU hr Total memory GB hr GB hr Total HDD PD GB hr GB hr Shuffle Data Processed unknown but probably negligibleTrain AutoML model hour wall time Dataflow Total vCPU vCPU hr vCPU hr Total memory GB hr GB hr Total HDD PD GB hr GB hr Shuffle Data Processed unknown but probably negligibleAutoML training Training node hrs node hr Getting predictions assuming hr of model deployed time must undeploy model to stop further charges AutoML predictions Deployment hr hr 2021-04-09 12:35:00
GCP Cloud Blog JA 政府との連携による気候問題への取り組み https://cloud.google.com/blog/ja/topics/public-sector/working-with-governments-on-climate-goals/ Googleでは、年までに以上の都市に支援を提供し、年間炭素排出量を億トン減らすことを目標として設定していますこれは、日本の年分の炭素排出量に相当します。 2021-04-09 13:00:00
GCP Cloud Blog JA Auto Trader: Oracle から PostgreSQL への道のり https://cloud.google.com/blog/ja/products/databases/how-auto-trader-migrated-its-on-prem-databases-to-cloud-sql/ それ以来、このサービスのCloudSQLインスタンスのリソースを分以内で簡単にスケールできています。 2021-04-09 13:00:00

コメント

このブログの人気の投稿

投稿時間:2021-06-17 05:05:34 RSSフィード2021-06-17 05:00 分まとめ(1274件)

投稿時間:2021-06-20 02:06:12 RSSフィード2021-06-20 02:00 分まとめ(3871件)

投稿時間:2020-12-01 09:41:49 RSSフィード2020-12-01 09:00 分まとめ(69件)