投稿時間:2020-07-17 01:43:35 RSSフィード2020-07-17 01:00 分まとめ(61件)

カテゴリー等	サイト名等	記事タイトル・トレンドワード等	リンクURL	頻出ワード・要約等/検索ボリューム	登録日
IT	気になる、記になる…	Apple、北欧3カ国でも車両を使った地図データの収集作業を開始へ	https://taisy0.com/2020/07/17/123529.html	apple	2020-07-16 15:51:23
IT	気になる、記になる…	Amazon、Kindleストアで｢幻冬舎 2020年上半期ベストフェア｣と｢夏の読書フェア｣のセールを開催 − 合計2,200冊以上が最大半額以下に	https://taisy0.com/2020/07/17/123527.html	amazon	2020-07-16 15:39:10
IT	気になる、記になる…	｢マインクラフト｣、2020年10月に一部のモバイルデバイスやプラットフォームのサポートを終了へ	https://taisy0.com/2020/07/17/123524.html	minecraft	2020-07-16 15:30:10
AWS	AWS Media Blog	Registration is open for the 4K 4Charity Virtual Run in Portland, Oregon	https://aws.amazon.com/blogs/media/registration-is-open-for-the-4k-4charity-virtual-run-in-portland-oregon/	Registration is open for the K Charity Virtual Run in Portland OregonAnnual event provides much needed support for local nonprofit organizations focused on increased diversity and inclusion This year may have us at a physical distance but it is also connecting us in ways we could have never imagined It has shown that we are resilient and innovative and able to accomplish amazing things when we come …	2020-07-16 15:49:54
AWS	AWS Government, Education, and Nonprofits Blog	Announcing Amazon Alexa India EdTech Skills Challenge 2020 finalists and competition date	https://aws.amazon.com/blogs/publicsector/announcing-amazon-alexa-edtech-skills-challenge-2020-india-finalists-competition-date/	Announcing Amazon Alexa India EdTech Skills Challenge finalists and competition dateAWS together with EdTechReview announced a voice technology in education contest at the EdTechReview conference The competition open to EdTechs in India aims to build skills that address education challenges and positively impact students faculty administrators and other educational stakeholders using Amazon Alexa in education We received over applications and selected five as finalists to compete for the title of “Best Amazon Alexa EdTech Skill India	2020-07-16 15:07:32
python	Pythonタグが付けられた新着投稿 - Qiita	コロナ　東京の潜在死者数 または危険度	https://qiita.com/facepolish/items/01bcf8bbf229970acb76	よって次のようなことが言えるPCR陽性者の増加傾向から隔離施設に関しては数週間以内にキャパシティが切迫する可能性が高いしかし、潜在推定死者数から深刻度は非常事態宣言したころよりは低い同様に重症者向け施設の不足は当面発生しない事が解る。	2020-07-17 00:51:38
python	Pythonタグが付けられた新着投稿 - Qiita	PyAutoItをちょっとだけ触ってみた	https://qiita.com/Y_MAGARI000/items/1ee35601858c3845c2fe	AuInfoexeの利用方法操作例AuInfoexeAuInfoexeを起動するとこのような画面が表示されます赤枠の部分をドラッグして、操作したいウインドウの場所までもっていきますControlタブを選択すると、ドラッグした箇所のウィンドウ情報を取得することができます。	2020-07-17 00:19:48
python	Pythonタグが付けられた新着投稿 - Qiita	Amazon SageMaker で TorchServeを使用して Pytorchのディープラーニングモデルをホストしてみた	https://qiita.com/ground0state/items/ace1c7058b695b64116e	AmazonWebServicesブログの「TorchServeを使用した大規模な推論のためのPyTorchモデルをデプロイする」を読んでAmazonSageMakerを使用してモデルをホストしてみました。	2020-07-17 00:11:44
js	JavaScriptタグが付けられた新着投稿 - Qiita	JS 配列内で重複しているものは削除して返す	https://qiita.com/toooy/items/783e120de96208381e8a		2020-07-17 00:53:15
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	Twitterのtimelineをpythonを使って取得したいのですが、エラーが出てしまいます。	https://teratail.com/questions/278289?rss=all	Twitterのtimelineをpythonを使って取得したいのですが、エラーが出てしまいます。	2020-07-17 00:59:37
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	SwiftUIで、NavigationViewの戻るボタンで戻って画面が表示された時に処理を実行する方法	https://teratail.com/questions/278288?rss=all	SwiftUIで、NavigationViewの戻るボタンで戻って画面が表示された時に処理を実行する方法SwiftUIで、NavigationViewの戻るボタンで戻って画面が表示された時に処理を実行する方法がわかりません。	2020-07-17 00:56:25
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	Ruby クラス名.new(:シンボル)がわかりません。	https://teratail.com/questions/278287?rss=all	Rubyクラス名newシンボルがわかりません。	2020-07-17 00:56:22
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	Nginxがfailureになります	https://teratail.com/questions/278286?rss=all	Nginxがfailureになります【環境】さくらVPSCentOSnbspNginx【課題】Nginxをインストール→右往左往しながら設定→systemctlnbspstartnbspnginx→Faithfullynbspyoursnbspnginx素人考えですが、設定ファイルについて、エラーがあると考えています。	2020-07-17 00:48:03
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	slimのincludeについて	https://teratail.com/questions/278285?rss=all	slimのincludeについて前提・実現したいことslimファイル内に別ファイルのslimをincludeさせたいのですが、原因不明のエラーに悩まされておりましてご存じの方がいらっしゃいましたら教えていただけますと幸いです。	2020-07-17 00:32:47
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	change to this file were not saved to file system	https://teratail.com/questions/278284?rss=all	changetothisfilewerenotsavedtofilesystem前提・実現したいこと入力フォームとボタンの枠線を表示したい発生している問題・エラーメッセージ入力フォームとボタンの枠線が表示されないのでデペロッパーツールでスタイルのチェックを外したら枠線が表示されるのですがressmincssの所にchangenbsptonbspthisnbspfilenbspwerenbspnotnbspsavednbsptonbspfilesystemとエラーがでて保存できません。	2020-07-17 00:32:39
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	『php artisan serve --host=$IP --port=$PORT』の「$IP」と「$PORT」とは？	https://teratail.com/questions/278283?rss=all	『phpartisanservehostIPportPORT』の「IP」と「PORT」とは前提・実現したいことAWSにてLaravelのアプリを開発しているのですが、サーバーを起動する時のコードで気になるところがあります。	2020-07-17 00:31:25
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	Ubuntu 18.04でのEvolution notify alarmの通知をなくす方法	https://teratail.com/questions/278282?rss=all		2020-07-17 00:08:58
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	No route matches [POST] "/mypages/1/edit"　エラーを解決しフォームの内容をデータに保存したい。	https://teratail.com/questions/278281?rss=all	NoroutematchesPOSTquotmypageseditquotエラーを解決しフォームの内容をデータに保存したい。	2020-07-17 00:07:05
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	Linuxのif文で変数の中身を確認し書き換えるコマンドを作成したいのですが	https://teratail.com/questions/278280?rss=all	Linuxのif文で変数の中身を確認し書き換えるコマンドを作成したいのですが始めまして。	2020-07-17 00:04:42
Ruby	Rubyタグが付けられた新着投稿 - Qiita	Railsにタグ機能をつける。acts-as-taggable-on使用	https://qiita.com/nakamura999/items/56c6426fc5dd640617ce	actsastaggableon使用概要Railsでgemactsastaggableonを使って、タグ機能を付けました。	2020-07-17 00:32:08
AWS	AWSタグが付けられた新着投稿 - Qiita	【初心者】Amazon QuickSight を使ってみる（自分のQiita記事のView数/LGTM数の集計と可視化)	https://qiita.com/mksamba/items/8e109628f4ed662ee2aa	やったことQiitaAPIにアクセスして、自分の記事のView数、LGTM数を取得して、結果をcsvにしてSに保存するLambda関数を作成し、定期的に実行する。	2020-07-17 00:48:44
AWS	AWSタグが付けられた新着投稿 - Qiita	Amazon SageMaker で TorchServeを使用して Pytorchのディープラーニングモデルをホストしてみた	https://qiita.com/ground0state/items/ace1c7058b695b64116e	AmazonWebServicesブログの「TorchServeを使用した大規模な推論のためのPyTorchモデルをデプロイする」を読んでAmazonSageMakerを使用してモデルをホストしてみました。	2020-07-17 00:11:44
Docker	dockerタグが付けられた新着投稿 - Qiita	Amazon SageMaker で TorchServeを使用して Pytorchのディープラーニングモデルをホストしてみた	https://qiita.com/ground0state/items/ace1c7058b695b64116e	AmazonWebServicesブログの「TorchServeを使用した大規模な推論のためのPyTorchモデルをデプロイする」を読んでAmazonSageMakerを使用してモデルをホストしてみました。	2020-07-17 00:11:44
golang	Goタグが付けられた新着投稿 - Qiita	Access-Control-Allow-Origin (CORS 関連) ヘッダーを付与するシンプルな Reverse Proxy (cors-reverse-proxy) を Go 言語で作りました	https://qiita.com/kaishuu0123/items/5ea782d24e6cd1219211	AccessControlAllowOriginCORS関連ヘッダーを付与するシンプルなReverseProxycorsreverseproxyをGo言語で作りました概要GithubDockerHubコンテナイメージもありますユースケースローカルの開発環境などにアプリケーションの連携をする際に、特定のアプリは信用して、リソース画像やJSなどの読み込みを行いたいときに具体例がちょっと微妙かもしれませんが、「GROWIとdrawioを連携する際に、drawioからの読み込みは信用したい」というケースがありました。	2020-07-17 00:20:31
Azure	Azureタグが付けられた新着投稿 - Qiita	~「クラウドAI開発講座」に挑戦してみたとある高専生の道のり#2~	https://qiita.com/CB_haruna/items/a0eeaf9f4b3c729cbabe	「クラウドAI開発講座」に挑戦してみたとある高専生の道のり目次この記事について進捗報告次回の目標この記事についてこれは前回の進捗報告の続きとなる記事です進捗報告stepAzureForStudentsに登録消化stepdecodに登録し視聴消化stepMicrosoftlearnforstudentsまだまだ学習不足stepちょまどさんのレッスン消化不良ちょまどさんのレッスン現在は自分の圧縮させたファイルをteamsに接続するところまでです。	2020-07-17 00:59:49
Ruby	Railsタグが付けられた新着投稿 - Qiita	Railsにタグ機能をつける。acts-as-taggable-on使用	https://qiita.com/nakamura999/items/56c6426fc5dd640617ce	actsastaggableon使用概要Railsでgemactsastaggableonを使って、タグ機能を付けました。	2020-07-17 00:32:08
海外TECH	Ars Technica	NASA’s inspector general report roasts Lockheed Martin for Orion fees	https://arstechnica.com/?p=1692237	orion	2020-07-16 15:15:45
Apple	AppleInsider - Frontpage News	Apple researching two-way wireless Qi charging cases with no Lightning	https://appleinsider.com/articles/20/07/16/apple-researching-two-way-wireless-qi-charging-cases-with-no-lightning	Apple researching two way wireless Qi charging cases with no LightningApple is working on two coil wireless charging technology for an iPhone battery case without using the Lightning connector something that would be necessary for a completely wireless iPhone Current Smart Battery Case models only charge wirelessly They transfer power to an iPhone via Lightning Current Smart Battery Case models can charge themselves wirelessly but use a built in Lightning connector to power the iPhone they re attached to That could prove to be a problem on a completely wireless iPhone Read more	2020-07-16 15:47:16
海外TECH	Engadget	NASA and ESA share the closest images ever taken of the Sun	https://www.engadget.com/esa-nasa-solar-orbiter-closest-sun-images-155421587.html	NASA and ESA share the closest images ever taken of the SunToday NASA and the European Space Agency ESA shared the closest pictures ever taken of the Sun These are the first images taken by the agencies Solar Orbiter which launched in February The pictures demonstrate the spacecraft s potential and t	2020-07-16 15:54:21
海外TECH	Engadget	Vivo X50 Pro’s micro gimbal camera outperforms the S20 Ultra at night	https://www.engadget.com/vivo-x50-pro-gimbal-camera-samsung-s20-ultra-review-comparison-153039220.html	Vivo X Pro s micro gimbal camera outperforms the S Ultra at nightEver since Vivo started preaching the virtues of its micro gimbal camera on its APEX concept phone I had been keen to try it out myself In a nutshell this is OIS optical image stabilization on steroids with the X and Y axis tilt angles be	2020-07-16 15:30:39
海外TECH	Engadget	Are the Galaxy S20 phones the flagships that fans deserve?	https://www.engadget.com/samsung-galaxy-s20-s20-plus-s20-ultra-user-reviews-wanted-151602562.html	Are the Galaxy S phones the flagships that fans deserve Back in February Samsung released the new crown jewels of its Galaxy line of phones the S the S and the S Ultra The two smaller models the S and S impressed reviews editor Cherlynn Low with their long battery life improved camera a	2020-07-16 15:16:02
海外TECH	Engadget	Telehealth got a huge boost from COVID-19. Now what?	https://www.engadget.com/telehealth-covid-19-coronavirus-policy-accessibility-150057795.html	Telehealth got a huge boost from COVID Now what During the height of the coronavirus pandemic venturing outside in New York felt like preparing for battle Germs were invisible bullets from which we tried to shield ourselves using masks and distancing Staying home was of course the safest course	2020-07-16 15:00:57
Cisco	Cisco Blog	AnnieCannons: Creating opportunities for survivors of human trafficking	https://blogs.cisco.com/csr/anniecannons-creating-opportunities-for-survivors-of-human-trafficking	AnnieCannons Creating opportunities for survivors of human traffickingBased in Oakland California AnnieCannons is on a mission to help women break the cycle of exploitation by providing skills training hands on work experience income opportunities and a supportive work environment We recently sat down with the CEO and co founder of AnnieCannons Jessica Hubley to learn more The post AnnieCannons Creating opportunities for survivors of human trafficking appeared first on Cisco Blogs	2020-07-16 15:07:32
Cisco	Cisco Blog	The Tactical Chameleon: Security Through Diverse Strategy	https://blogs.cisco.com/security/the-tactical-chameleon-security-through-diverse-strategy	The Tactical Chameleon Security Through Diverse StrategyIn order to effectively combat an increasingly strategic and varied set of threats security professionals need to take a page from Musashi Miyamoto and fighting game players The post The Tactical Chameleon Security Through Diverse Strategy appeared first on Cisco Blogs	2020-07-16 15:00:26
海外科学	NYT > Science	Closest Pictures Ever Taken of Sun Show Tiny Campfire Flares	https://www.nytimes.com/2020/07/16/science/solar-orbiter-sun-images.html	campfire	2020-07-16 15:25:33
海外科学	NYT > Science	How Novavax Won $1.6 Billion From Operation Warp Speed For Coronavirus Vaccine	https://www.nytimes.com/2020/07/16/health/coronavirus-vaccine-novavax.html	How Novavax Won Billion From Operation Warp Speed For Coronavirus VaccineNovavax just received the Trump administration s largest vaccine contract In the Maryland company s year history it has never brought a vaccine to market	2020-07-16 15:14:09
海外科学	NYT > Science	Coronavirus Live Updates: Dire Numbers Prompt Mask Orders in U.S.	https://www.nytimes.com/2020/07/16/world/coronavirus-updates.html	Coronavirus Live Updates Dire Numbers Prompt Mask Orders in U S The National Security Agency said a hacking group associated with Russian intelligence was targeting health care organizations to gain intelligence about vaccines	2020-07-16 15:36:54
海外科学	NYT > Science	A Record 5.4 Million Americans Have Lost Health Insurance, Study Finds	https://www.nytimes.com/2020/07/13/world/coronavirus-updates.html	A Record Million Americans Have Lost Health Insurance Study FindsCalifornia s governor announced a sweeping rollback of the state s reopening and Los Angeles and San Diego school districts will be online only in the fall Dr Anthony Fauci returned to the White House	2020-07-16 15:15:09
金融	RSS FILE - 日本証券業協会	株券等貸借取引状況（週間）	https://www.jsda.or.jp/shiryoshitsu/toukei/kabu-taiw/index.html	貸借	2020-07-16 15:30:00
金融	金融庁ホームページ	人事異動（令和２年７月16日発令）を掲載しました。	https://www.fsa.go.jp/common/about/jinji/index.html	人事異動	2020-07-16 16:00:00
金融	生命保険おすすめ比較ニュースアンテナ waiwainews	E様、お時間をいただきありがとうございます④	http://seiho.waiwainews.net/view/11451	newsallrightsreserved	2020-07-17 00:05:49
ニュース	ジェトロ ビジネスニュース（通商弘報）	自動車メーカーに新たな上場企業が誕生、電気自動車（EV）のフィスカー	https://www.jetro.go.jp/biznews/2020/07/ca8d08471a9ed4ff.html	自動車メーカー	2020-07-16 15:40:00
ニュース	ジェトロ ビジネスニュース（通商弘報）	世界人工知能大会が上海で開催、オンラインでライブ配信	https://www.jetro.go.jp/biznews/2020/07/7d90c9436d99e469.html	人工知能	2020-07-16 15:30:00
ニュース	ジェトロ ビジネスニュース（通商弘報）	湖北健康コードが中国30省・市でも有効に	https://www.jetro.go.jp/biznews/2020/07/a13feb133f680f0e.html	湖北	2020-07-16 15:20:00
ニュース	ジェトロ ビジネスニュース（通商弘報）	上半期の貿易、主要国・地域の中でASEANとの貿易は堅調	https://www.jetro.go.jp/biznews/2020/07/ab9f652fd8d02209.html	asean	2020-07-16 15:10:00
海外ニュース	Japan Times latest articles	Japan’s phaseout plan forces utilities to rethink reliance on coal	https://www.japantimes.co.jp/news/2020/07/16/business/corporate-business/japan-utilities-rethink-coal/	atomic	2020-07-17 01:48:30
海外ニュース	Japan Times latest articles	Tokyo residents voice concerns over surging coronavirus cases	https://www.japantimes.co.jp/news/2020/07/16/national/tokyo-residents-concerned-coronavirus-surge/	infections	2020-07-17 01:27:47
海外ニュース	Japan Times latest articles	Dak Prescott to play under franchise tag after failing to reach deal with Cowboys	https://www.japantimes.co.jp/sports/2020/07/16/more-sports/football/dak-prescott-play-franchise-tag-failing-reach-deal-cowboys/	Dak Prescott to play under franchise tag after failing to reach deal with CowboysDak Prescott will play whatever becomes of the season under the one year franchise tag after the Dallas Cowboys and their star quarterback couldn t agree	2020-07-17 00:29:39
海外ニュース	Japan Times latest articles	Japan’s women still fighting for equality in judo	https://www.japantimes.co.jp/sports/2020/07/16/more-sports/judo/japans-women-still-fighting-equality-judo/	Japan s women still fighting for equality in judoJudo s founder Jigoro Kano was decades ahead of his time by empowering women to take up a sport that prizes technique over brute force But Japan s	2020-07-17 00:00:30
海外ニュース	Japan Times latest articles	Good news: China is growing again; just don’t ask how	https://www.japantimes.co.jp/opinion/2020/07/16/commentary/world-commentary/good-news-china-growing-just-dont-ask/	drivers	2020-07-17 00:35:04
ニュース	BBC News - Home	Coronavirus: Russian spies target Covid-19 vaccine research	https://www.bbc.co.uk/news/technology-53429506	research	2020-07-16 15:35:56
ニュース	BBC News - Home	'Almost certain' Russians sought to interfere in 2019 UK election - Raab	https://www.bbc.co.uk/news/uk-politics-53433523	labour	2020-07-16 15:18:58
ニュース	BBC News - Home	British Gas workers told to sign new contracts or risk jobs	https://www.bbc.co.uk/news/business-53433452	fresh	2020-07-16 15:33:40
ニュース	BBC News - Home	Grenfell Tower inquiry: Main firm 'overlooked safety document'	https://www.bbc.co.uk/news/uk-53429808	document	2020-07-16 15:26:11
サブカルネタ	ラーブロ	中華ノ麺 Xing fu(シンフウ)（高円寺）／担担麺＋味玉＋半ライス	http://feedproxy.google.com/~r/rablo/~3/oKQaJTVv--M/single_feed.php	中華ノ麺Xingfuシンフウ高円寺担担麺味玉半ライスさて、、そろそろ梅雨明けしそうって話もありますが…私のブログはまだ春先笑そして、三寒四温とはよく言ったもので、この日の春は「寒」の方。	2020-07-16 16:29:31
サブカルネタ	ラーブロ	ラーメン二郎 めじろ台店＠めじろ台　「小ラーメン」	http://feedproxy.google.com/~r/rablo/~3/CrRRn9RKlqE/single_feed.php	法政大学	2020-07-16 16:01:23
北海道	北海道新聞	熊本で時事通信社員が感染　豪雨取材の３０代カメラマン	https://www.hokkaido-np.co.jp/article/441378/	報道関係者	2020-07-17 00:15:30
北海道	北海道新聞	殺人未遂の疑い　女性不起訴処分　函館地検	https://www.hokkaido-np.co.jp/article/441386/	不起訴処分	2020-07-17 00:28:00
GCP	Cloud Blog	Powering past limits with financial services in the cloud	https://cloud.google.com/blog/products/data-analytics/keybank-migrates-to-bigquery-cloud-data-warehouse/	Powering past limits with financial services in the cloudEditor s note We asked financial institution KeyBank to share their story of moving their data warehouse from Teradata to Google Cloud Here are details on why they moved to cloud how they did their research and what benefits cloud can bring At KeyBank we serve our million customers online and in person and managing and analyzing data is essential to providing great service We process more than four billion records every single day and move that data to more than downstream systems Our teams use that data in many ways we have about SaaS users and Tableau users exploring analytics results and running reports We introduced Hadoop four or five years ago as our data lake architecture using Teradata for high performance analytics We stored more than a petabyte of data in Hadoop on about servers and more than petabytes in our Teradata environment We decided to move operations to the cloud when we started hitting the limits of what an on premises data warehouse could do to meet our business needs We wanted to move to cloud quickly and open up new analytics capabilities for our teams  Considering and testing cloud platformsTeradata had worked well for us when we first deployed it Back then Teradata was a market leader in data warehousing with many of the leading banks invested in it We chose it for its high performance analytics capabilities and our marketing and risk management teams used it heavily It also worked well with other SaaS tools we were using and SaaS remains a good tool for accessing our mainframe Ten years into using Teradata we had a lot of product specific data stores It wasn t a fully formed data lake architecture We also maintain more than SaaS models In our Teradata appliances were nearing capacity and we knew they would need a refresh in We wanted to avoid that refresh and started doing proof of concept cloud testing with both Snowflake and Google Cloud When we did those trials we ran comparative benchmarks for load time ETL time performance and query time Snowflake looked just like Teradata but in the cloud With Google we looked at all the surrounding technology of the platform We couldn t be on a single cloud platform if we chose Snowflake We picked Google Cloud since it would let us simplify and offer us a lot more options to grow over time Adapting to a cloud platformAlong with changing technology our teams would have to learn some new skills with this cloud migration Our primary goal when moving to a cloud architecture was getting the performance of Teradata at the cost of Hadoop but on a single platform Managing a Hadoop data lake running on Teradata architecture is complicatedーit really takes two different skill sets  There are some big considerations that go into making these kinds of legacy vs modern enterprise technology decisions With an on premises data warehouse like Teradata you govern in capacity so performance varies based on the load on the hardware at any given time That led to analytics users hitting the limits during month end processing for example With Google Cloud there are options for virtually unlimited capacity  Cost savings was a big reason for our move to cloud Pricing models are very different with cloud but ultimately we re aiming not to pay for storage that s just sitting there not in use Cloud gives us the opportunity to scale up for a month if needed then back down after the peak managing costs better Figuring this out is a new skill we ve learned For example running a bad query in Teradata or Hadoop wouldn t change the on premises cost for that query but would consume horsepower Running that query on Google Cloud won t interfere with other users performance but would cost us money So we re running training to ensure people aren t making those types of mistakes that they re running the right types of queries Shifting to cloud computingThe actual cloud migration involved working closely with the security team to meet their requirements We also needed to align data formats For example we had to make sure our ETL processing could talk to Google Cloud Storage buckets and BigQuery data sets We re finding that for the most part the queries do port over seamlessly to BigQuery We ve had to tweak just a handful of data types  Since moving to cloud the early results are very promising we re seeing to x faster query performance and we can easily turn capacity up or down We have five data marts in testing to use real world data volumes to get comparison queries We re still making modifications to how we set up and configure services in the cloud That s all part of the change that comes when you re now owning and operating data assets securely in the cloud We had to make sure that any personally identifiable information PII was stored securely and tokenized We ll also continue to tune cost management over time as we onboard more production data  Managing change and planning for the futureThe change management of cloud is an important component of the migration process Even with our modern data architecture we re still shifting established patterns and use cases as we move workloads to Google Cloud It s a big change to go to a capacity based model where we can change capacity on demand to meet our needs vs needing more hardware with our old Teradata method Helping users migrate to newer tools requires some time and planning We hosted training sessions with help from Google and made sure business analysts were involved up front to give feedback We also invested in training and certifications for our analysts We re on our way to demonstrating that Google can give us better performance based on the cost per query than Teradata did And using BigQuery means we can do more analytics in place now rather than the previous process of copying storing and manipulating data then creating a report  As we think through how to organize our analytics resources we want to get the business focused on priorities and consumer relationships For example we want to know the top five or so areas where analytics can add value so we can all be focused there To make sure we would get the most out of these new analytics capabilities we set up a charter and included cross functional leaders so we know we re all keeping that focus and executing on it We re retraining with these new skills and even finding new roles that are developing We built a dedicated cloud native teamーreally an extension of our DevOps teamーfocused on setting up infrastructure and using infrastructure as code  The program we ve built is ready for the future With our people and technology working together we re well set up for a successful future	2020-07-16 16:00:00
GCP	Cloud Blog	What’s shaking? Earthquake detection with submarine cables	https://cloud.google.com/blog/products/infrastructure/using-subsea-cables-to-detect-earthquakes/	What s shaking Earthquake detection with submarine cablesIs it possible to detect earthquakes with submarine cables We think it might be A recent experiment using one of our subsea fiber optic cables showed that it could be useful for earthquake and tsunami warning systems around the globe  There s a long tradition of using optical fiber for sensing applications But whereas most of these techniques are effective over distances of up to km we ve developed a technique that works over tens of thousands of kilometers And while previous approaches require special sensing fiber and special equipment we use existing fiber to detect disturbances on the seafloor Better yet our technique relies on equipment that is present on the vast majority of the world s existing fiber optic systems so it is broadly applicable Fiber optic cables connect far flung continents along the ocean floor and much of the internet s international traffic travels over these cables Google s global network of undersea cables makes it possible to share search send and receive information around the world at the speed of light These cables are built using optical fibers that carry data as pulses of light traveling at kilometers per second The pulsing light encounters distortions as it travels thousands of kilometers across the cable At the receiving end the light pulses are detected and the distortions are corrected by digital signal processing One of the properties of light that is tracked as part of the optical transmission is the state of polarization SOP The SOP changes in response to mechanical disturbances along the cable and tracking these disturbances enables us to detect seismic activity   In we looked at how we might use SOP data to better understand deviations detected on a land based terrestrial cable but typical factors in the surrounding environment caused too much disruption to detect seismic signatures so we didn t pursue that project further Then in scientists published a paper about early success they had had detecting earthquakes on both terrestrial and subsea links looking at phase changes using a narrowband ultrastable laser But the links they used were short under km for terrestrial and km for subsea and in relatively shallow waters m deep limiting practical application of the idea To be useful they d need to try this out on links that were much deeper on the ocean floor and that ran along much greater distances  We read this paper with great interest and began thinking about how we might help detect seismic data using subsea cables Last October an idea came to us we could detect earthquakes based on spectral signaturesーperforming a spectral analysis of Stokes parameters to look at frequencies that are typical of earthquakes The author s notebook where he wrote down his early idea on how to implement the system Early testsIn late we began monitoring SOP on some of our global submarine cables During the initial field trial we observed that SOP was remarkably stable even after the signal traversed km The ocean floor is mostly a quiet place  Indeed for several weeks the ocean floor was perhaps too quiet showing no SOP changes that would indicate an earthquake Then on January we detected a magnitude  earthquake off of Jamaicaー km away from the closest point of one of our cables A plot of SOP over time showed a pronounced spike at a time stamp approximately five minutes after the earthquake occurred correlating to the travel time of the seismic wave from Jamaica to the cable and the duration of the spike was about minutes Stokes vectors S left S center S right generated by the M earthquake off Jamaica which provide quantitative analysis of SOP State of polarization X axis time Y axis frequency in Hertz with color code showing intensity of spectral components Green indicates higher spectral density compared to white and pink The M earthquake is barely visible green white spike below Hz The stronger Hz line is due to environmental oscillations We shared our results with Dr Zhongwen Zhan of the California Institute of Technology Seismological Laboratory who confirmed our observations and provided additional insight into travel times of different types of seismic waves and the expected frequency ranges of SOP excursions  In the months following the Jamaica earthquake we also detected multiple moderate size earthquakes both at shorter and longer distances On March there was a magnitude earthquake on the East Pacific Rise a mid oceanic ridge located along the floor of the Pacific Ocean about km away from one of our cables We observed clear SOP activity with timing consistent with observations made at a seismic monitoring station in Tlapa Mexico which was located at a similar distance Then on March a magnitude earthquake occurred off the shore near Valparaiso Chile only km away from one of our cables at the closest point The event produced a clear but short spike of SOP activityーthe short duration was likely to due to a rapid decay in the vibration intensity along the cable for this relatively small event  Augmenting the world s seismic detection systemWe re excited by the early success of detecting seismic events with subsea cables which can improve our ability to observe both the Earth s structure and earthquake dynamics But this is just the beginning  For example by analyzing our data Dr Zhan showed us that not only can we detect earthquakes emanating from tectonic plates but we can also detect pressure changes in the ocean itself which could help predict tsunamis This is particularly exciting because today most tsunami detection equipment is either on shore or scattered throughout the ocean The former doesn t give coastal communities enough time to evacuate and the latter is limited by the speed of the traveling waveーa maximum of km per hour for a deep sea wave On the other hand when a cable runs near the earthquake epicenter a tsunami warning system that transmits data at the speed of light could communicate a warning to potentially affected communities in milliseconds Image constructed by Dr Zhan based on Google s data shows ocean waves during storms from to X axis is frequency from to Hz Y axis time Ocean waves are seen as yellow angled brushed lines Further our approach relies on technology that is widespread on today s fiber optic networks Millions of kilometers of fibre optic networks already span the globe operated by governments telecommunications providers and technology companies such as ourselves By collaborating with the global subsea cable community we may be able to improve the world s ability to detect and research seismic activity around the world  Of course this is just a first demonstration not a working system and much work remains to be done First scientists will need to better understand the deluge of complex data that will be generated by monitoring SOP Seismic data is notoriously complexーthe waveforms produced by different kinds of earthquakes look very different from one another and those shapes change dramatically based on variables such as magnitude location and so on To create a robust earthquake monitoring system researchers need advanced mathematics and data analytics where advanced computing systems like Google Cloud can be instrumental In time scientists may decide that this is a job for machine learning which excels at making sense of large data sets in a way that is beyond the ability of the human brain  We see this approach not as a replacement of dedicated seismic sensors but as a source of complementary information to enable early warnings for earthquakes and tsunamis We re humbled and excited by the possibility of collaborating with the optical subsea and seismic research communities to use all of our cable infrastructure for greater societal benefits	2020-07-16 16:00:00
GCP	Cloud Blog	GKE best practices: Exposing GKE applications through Ingress and Services	https://cloud.google.com/blog/products/containers-kubernetes/exposing-services-on-gke/	GKE best practices Exposing GKE applications through Ingress and ServicesOne critical part of designing enterprise applications running on Google Kubernetes Engine GKE is considering how your application will be consumed by its clients This could be as simple as exposing your application outside the cluster to be consumed by other internal clients or might involve routing traffic to your application from public clients across the globe How you should do this depends on many factors Is the client from the internet or an internal network Which networking protocols does the application speak Is the application hosted in a single region or cluster or is it deployed globally Determining which solution to use to expose your application requires considering your application requirements in a few key areas These requirements shouldn t be assessed in isolationーyou should look at them holistically to determine the most appropriate networking solution to expose your application Let s walk through the different factors that should be considered when exposing applications on GKE explain how they impact application exposure and highlight which networking solutions each requirement will drive you toward Assuming you re familiar with Kubernetes concepts such as Deployments Services and Ingress resources we ll differentiate between different exposure methods from internal to external to multi cluster and more To learn more about Kubernetes fundamentals see our course on Getting Started with Google Kubernetes Engine Understanding application exposureExposing an application to external clients involves three key elements which together allow you to route traffic to your application  Frontend The load balancer frontend defines the scope in which clients can access and send traffic to the load balancer This is the network location that is listening for trafficーa network a specific region or subnet within the network one or more IPs in the network ports specific protocols and TLS certificates presented to establish secure connections  Routing and load balancing Routing and load balancing define how traffic is processed and routed Traffic can be routed to services based on parameters such as protocol HTTP headers and HTTP paths Depending on the load balancer you use it may balance traffic across multiple zones or regions to provide lower latency and increased resiliency to your customers  Backends Backends are defined by the type of endpoints application platform and backend service discovery integration Specific application environments such as GKE are aided by service discovery integration which updates load balancer backends dynamically as GKE endpoints come up and down  The following diagram illustrates these concepts for two very different types of traffic flowsーexternal and internal traffic The External HTTP S Load Balancer is listening for traffic on the public internet through hundreds of Google points of presence around the world This global frontend allows traffic to be terminated at the edge close to clients before it load balances it to its backends in a Google data center The Internal HTTP S load balancer depicted here listens within the scope of your VPC network allowing private communications to take place internally These load balancer properties make them suited for different kinds of application use cases GKE load balancing through Ingress and Service controllersTo expose applications outside of a GKE cluster GKE provides a built in GKE Ingress controller and GKE Service controller which deploy Google Cloud Load Balancers GCLBs on behalf of GKE users This is the same VM load balancing infrastructure except its lifecycle is fully automated and controlled by GKE The GKE network controllers provide container native Pod IP load balancing via opinionated higher level interfaces that conform to the Ingress and Service API standards  The following diagram illustrates how the GKE network controllers automate the creation of load balancers An infrastructure or app admin deploys a declarative manifest against their GKE cluster Ingress amp Service controllers watch for GKE networking resources such as Ingress or MultiClusterIngress objects and deploy Cloud load balancers plus IP addressing firewall rules etc based on the manifest The controller continues managing the LB and backends based on environmental and traffic changes Thus GKE load balancing becomes a dynamic and self sustaining load balancer with a simple and developer oriented interface Factors that influence application exposureThere are numerous factors that will influence choosing a method for exposing your application in GKE There are a few core factors that live at the base of your decision tree and will help narrow down the set of networking solutions These factors are client network protocol and application regionality Client network refers to the network from where your application clients are accessing the application This influences where the frontend of your load balancer should be listening For example clients could be within the same GKE cluster as the application In this case they would be accessing your application from within the cluster network allowing them to use Kubernetes native ClusterIP load balancing Clients could also be internal network clients accessing your application from within the Google Cloud VPC or from your on premises network across a Google Cloud Interconnect Clients could also be external accessing your application from across the public internet Each type of network dictates a different load balancing topology Protocol is the language your clients speak to the application Voice gaming and low latency applications commonly speak directly on top of TCP or UDP requiring load balancers that have granular control at L Other applications speak HTTP HTTPS gRPC or HTTP and require load balancers with explicit support of these protocols Protocol requirements further define which kinds of application exposure methods are the best fit  Application regionality refers to the degree that your application is distributed across more than one GCP region or GKE cluster Hosting a single instance of an application has different requirements than hosting an active passive application across two independent GKE clusters Hosting a geographically distributed application across five GKE clusters to place workloads closer to the end user for lower latency requires even more multi cluster and multi regional awareness for the load balancer There may be additional factors that will influence your networking design that aren t covered belowーthings like latency requirements source IP address preservation or high bandwidth This list is not intended to be exhaustive but should help you narrow down your solution options and increase your understanding of the trade offs between requirements Application exposure through Ingress and ServicesFortunately GKE s suite of native Ingress and Service controllers makes exposing applications seamless secure and production ready by default These network controllers are tightly integrated with GCLBs allowing Kubernetes native interfaces to deploy GCLBs that load balance natively to container IPs The following table breaks down all of the GKE Ingress and Service types and details their primary characteristics For a more detailed comparison of all the GKE and Anthos Ingress capabilities see Ingress Features There are many native options all with different capabilities from a protocol network access and regional perspective The following section categorizes these networking solutions by the factors discussed above  Client networkLoad balancers in GKE can broadly be categorized as internal and external load balancers Internal refers to the VPC network which is an internal private network not directly accessible from the internet External refers to the public internet Note that ClusterIP Services are internal to a single GKE cluster so they are scoped to an even smaller network than the VPC network Public GKE clusters provide public and private IPs to each GKE node and so NodePort Services can be accessible internally and externally ProtocolLoad balancers are often categorized as Layer which route traffic based on network information like port and protocol and Layer which have awareness of application information like client sessions GKE load balancers can also be categorized as L and L with specific protocol support in the table below Application regionalityThe regionality of GKE load balancing solutions can be broken down into two areas Backend scope or cluster scope refers to whether a load balancer can send traffic to backends across multiple GKE clusters Ingress for Anthos or multi cluster Ingress has the ability to expose a single VIP that directs traffic to pods from different clusters and different Google Cloud regions Frontend scope refers to whether a load balancer IP listens within a single region or across multiple regions All of the external load balancers listen on the internet which is inherently multi region but some internal load balancers listen within a single region only The table below breaks down the GKE load balancing solutions across these two dimensions While these don t cover every aspect of application networking working through each of the factors above can help triangulate which solutions are best for your applications Most GKE environments host many different types of applications all with unique requirements so it s likely that you ll be using more than one in any given cluster For detailed information about their capabilities check out some of the following resources Ingress FeaturesMulti Cluster Ingress Ingress for Anthos External IngressInternal IngressExternal LoadBalancer ServicesInternal LoadBalancer ServicesOther solutions for GKE application exposureThe Kubernetes ecosystem is vast and the above solutions are not the only ones available for exposing applications The solutions below may also be viable replacements or complements to the native GKE load balancers In cluster IngressIn cluster Ingress refers to software Ingress controllers which have their Ingress proxies hosted inside the Kubernetes cluster itself This is differentiated from Cloud Ingress controllers which host and manage their load balancing infrastructure separately from the Kubernetes cluster These third party solutions are commonly self deployed and self managed by the cluster operator istio ingressgateway and nginx ingress are two examples of commonly used and open source in cluster Ingress controllers The in cluster Ingress controllers typically conform to the Kubernetes Ingress specification and provide varying capabilities and ease of use The open source solutions are likely to require closer management and a higher level of technical expertise but may suit your needs if they provide specific features your applications require There is also a vast ecosystem of Enterprise Ingress solutions built around the open source community which provide advanced features and enterprise support Standalone NEGsGKE Ingress and Service controllers provide automated declarative and Kubernetes native methods of deploying Google Cloud Load Balancing There are also valid use cases for deploying load balancers manually for GKE backends for example having direct and more granular control over the load balancer or load balancing between container and VM backends Standalone NEGs provide this ability by updating Pod backend IPs dynamically for a Network Endpoint Group NEG but allowing the frontend of the load balancer to be deployed manually through the Google Cloud API This provides maximum and direct control of the load balancer while retaining dynamic backends controlled by the GKE cluster Service meshService meshes provide client side load balancing through a centralized control plane While the Istio project introduced L service meshes to Kubernetes for internal communications the service mesh ecosystem has rapidly expanded in scope and capabilities Traffic Director and Anthos Service Mesh power the ability to load balance internal traffic across GKE clusters across regions and also between containers and VMs This blurs the line between internal load balancing east west traffic and application exposure north south traffic With the flexibility and reach of modern service mesh control planes it s more likely than ever to have both the client and server within the same service mesh scope The above GKE Ingress and Service solutions generally deploy middle proxy load balancers for clients that do not have their own sidecar proxies However if a client and server are in the same mesh then traditional application exposure can be handled via the mesh rather than middle proxy load balancing GKE at your serviceDepending on your use case Google Cloud supports many different ways of exposing a GKE application as a service We hope that it s evident that GKE provides the most comprehensive support for all of your container use cases If this blog post has helped you better understand how to architect application access feel free to share it so that you can help others understand too	2020-07-16 16:00:00