投稿時間:2021-11-13 06:19:29 RSSフィード2021-11-13 06:00 分まとめ(25件)

カテゴリー等	サイト名等	記事タイトル・トレンドワード等	リンクURL	頻出ワード・要約等/検索ボリューム	登録日
TECH	Engadget Japanese	2015年11月13日、コンパクトでも高性能な「Xperia Z5 Compact SO-02H」が発売されました：今日は何の日？	https://japanese.engadget.com/today-203044775.html	xperiazcompactsoh	2021-11-12 20:30:44
Google	カグア！Google Analytics 活用塾:事例や使い方	安易な商品紹介には気をつけよう。Instagramで初の景表法違反で措置命令、無料サンプルもらって知らずに投稿してしまった人は、すぐに投稿を削除して対応したほうがいいかも。	https://www.kagua.biz/social/risk/20211113a1.html	Instagramで初の景表法違反で措置命令、無料サンプルもらって知らずに投稿してしまった人は、すぐに投稿を削除して対応したほうがいいかも。	2021-11-12 21:00:04
AWS	AWS Architecture Blog	Architecture Monthly Magazine: IoT for the Edge	https://aws.amazon.com/blogs/architecture/architecture-monthly-magazine-iot-for-the-edge/	Architecture Monthly Magazine IoT for the EdgeInternet of Things IoT for the Edge encompasses so many devices and industries that we couldn t pick just one photo for our cover We include IoT use cases from manufacturing fitness ocean research and agriculture And these represent only a fraction of what is possible By moving certain workloads to the edge your devices communicate …	2021-11-12 20:21:58
AWS	AWS Security Blog	Managing temporary elevated access to your AWS environment	https://aws.amazon.com/blogs/security/managing-temporary-elevated-access-to-your-aws-environment/	Managing temporary elevated access to your AWS environmentIn this post you ll learn about temporary elevated access and how it can mitigate risks relating to human access to your AWS environment You ll also be able to download a minimal reference implementation and use it as a starting point to build a temporary elevated access solution tailored for your organization Introduction While many modern …	2021-11-12 20:14:47
AWS	AWS Security Blog	Managing temporary elevated access to your AWS environment	https://aws.amazon.com/blogs/security/managing-temporary-elevated-access-to-your-aws-environment/	Managing temporary elevated access to your AWS environmentIn this post you ll learn about temporary elevated access and how it can mitigate risks relating to human access to your AWS environment You ll also be able to download a minimal reference implementation and use it as a starting point to build a temporary elevated access solution tailored for your organization Introduction While many modern …	2021-11-12 20:14:47
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	Python 配列について	https://teratail.com/questions/369076?rss=all	Python配列についてこんにちは今している文や単語のアクセント部分を使う課題の中で、とだけのリストmatrixがあるとき、cBnbspnbspAは、Bのアクセントの前にAのアクセントが付いた回数です。	2021-11-13 05:29:13
海外TECH	Ars Technica	An era of sports car racing will end with this year’s Petit Le Mans	https://arstechnica.com/?p=1812676	mansthe	2021-11-12 20:06:21
海外TECH	MakeUseOf	4 Risks of NFTs You Simply Cannot Ignore	https://www.makeuseof.com/nft-risks/	ignorethinking	2021-11-12 20:30:12
海外TECH	MakeUseOf	How to Sign Up and Subscribe to Twitter Blue	https://www.makeuseof.com/twitter-blue-how-to-subscribe/	twitter	2021-11-12 20:29:50
海外TECH	DEV Community	Learn Materialize by running streaming SQL on your nginx logs	https://dev.to/bobbyiliev/learn-materialize-by-running-streaming-sql-on-your-nginx-logs-3n32	Learn Materialize by running streaming SQL on your nginx logs IntroductionIn this tutorial I will show you how Materialize works by using it to run SQL queries on continuously produced nginx logs By the end of the tutorial you will have a better idea of what Materialize is how it s different than other SQL engines and how to use it PrerequisitesFor the sake of simplicity I will use a brand new Ubuntu server where I will install nginx Materialize and mzcli a CLI tool similar to psql used to connect to Materialize and execute SQL on it If you want to follow along you could spin up a new Ubuntu server on your favorite could provider If you prefer running Materialize on a different operating system you can follow the steps on how to install Materialize here How to install Materialize What is MaterializeMaterialize is a streaming database for real time analytics It is not a substitution for your transactional database instead it accepts input data from a variety of sources like Messages from streaming sources like KafkaArchived data from object stores like SChange feeds from databases like PostgreSQLData in Files CSV JSON and even unstructured files like logs what we ll be using today And it maintains the answers to your SQL queries over time keeping them up to date as new data flows in using materialized views instead of running them against a static snapshot at a point in time If you want to learn more about Materialize make sure to check out their official documentation here Materialize Documentation Installing MaterializeMaterialize runs as a single binary called materialized d for daemon following Unix conventions Since we re running on Linux we ll just install Materialize directly To install it run the following command sudo apt install materializedOnce it s installed start Materialize with sudo so it has access to nginx logs sudo materializedNow that we have the materialized running we need to open a new terminal to install and run a CLI tool that we use to interact with our Materialize instance There are other ways that you could use in order to run Materialize as described here For a production ready Materialize instance I would recommend giving Materialize Cloud a try Installing mzcliThe mzcli tool lets us connect to Materialize similar to how we would use a SQL client to connect to any other database Materialize is wire compatible with PostgreSQL so if you have psql already installed you could use it instead of mzcli but with mzcli you get nice syntax highlighting and autocomplete when writing your queries To learn the main differences between the two make sure to check out the official documentation here Materialize CLI ConnectionsThe easiest way to install mzcli is via pipx so first run apt install pipxand once pipx is installed install mzcli with pipx install mzcliNow that we have mzcli we can connect to materialized with mzcli U materialize h localhost p materializeFor this demo let s quickly install nginx and use Regex to parse the log and create Materialized Views Installing nginxIf you don t already have nginx installed install it with the following command sudo apt install nginxNext let s populate the access log with some entries with a Bash loop for i in do curl s localhost materialize gt dev null echo i doneIf you have an actual nginx access log you can skip the step above Now we ll have some entries in the var log nginx access log access log file that we would be able to able to feed into Materialize Adding a Materialize SourceBy creating a Source you are essentially telling Materialize to connect to some external data source As described in the introduction you could connect a wide variety of sources to Materialize For the full list of source types make sure to check out the official documentation here Materialize source typesLet s start by creating a text file source from our nginx access log First access the Materialize instance with the mzcli command mzcli U materialize h localhost p materializeThen run the following statement to create the source CREATE SOURCE nginx log FROM FILE var log nginx access log WITH tail true FORMAT REGEX P lt ipaddress gt P lt time gt P lt request gt P lt url gt P lt statuscode gt d A quick rundown CREATE SOURCE First we specify that we want to create a sourceFROM FILE Then we specify that this source will read from a local file and we provide the path to that fileWITH tail true Continually check the file for new contentFORMAT REGEX as this is an unstructured file we need to specify regex as the format so that we could get only the specific parts of the log that we need Let s quickly review the Regex itself as well The Materialize specific behavior to note here is the P lt NAME HERE gt pattern extracts the matched text into a column named NAME HERE To make this a bit more clear a standard entry in your nginx access log file would look like this Oct GET HTTP Mozilla zgrab x P lt ipaddress gt With this pattern we match the IP address for each line of the nginx log e g P lt time gt the timestamp string from inside square brackets e g Oct P lt request gt the type of request like GET POST etc P lt url gt the relative URL eg favicon ico P lt statuscode gt d the three digit HTTP status code Once you execute the create source statement you can confirm the source was created successfully by running the following mz gt SHOW SOURCES Output name nginx log SELECT Time sNow that we have our source in place let s go ahead and create a view Creating a Materialized ViewYou may be familiar with Materialized Views from the world of traditional databases like PostgreSQL which are essentially cached queries The unique feature here is the materialized view we are about to create is automatically kept up to date In order to create a materialized view we will use the following statement CREATE MATERIALIZED VIEW aggregated logs AS SELECT ipaddress request url statuscode int COUNT as count FROM nginx log GROUP BY The important things to note are Materialize will keep the results of the embedded query in memory so you ll always get a fast and up to date answerThe results are incrementally updated as new log events arrive Under the hood Materialize compiles your SQL query into a dataflow and then takes care of all the heavy lifting for you This is incredibly powerful as it allows you to process data in real time using just SQL A quick rundown of the statement itself First we start with the CREATE MATERIALIZED VIEW aggregated logs which identifies that we want to create a new Materialized view named aggregated logs Then we specify the SELECT statement that we are interested in keeping track of over time In this case we are aggregating the data in our log file by ipaddress request url and statuscode and we are counting the total instances of each combo with a COUNT When creating a Materialized View it could be based on multiple sources like a stream from Kafka a raw data file that you have on an S bucket or your PostgreSQL database This single statement will give you the power to analyze your data in real time We specified a simple SELECT that we want the view to be based on but this could include complex operations like JOINs however for the sake of this tutorial we are keeping things simple For more information about Materialized Views check out the official documentation here Creating Materialized viewsNow you could use this new view and interact with the data from the nginx log with pure SQL Reading from the viewIf we do a SELECT on this Materialized view we get a nice aggregated summary of stats SELECT FROM aggregated logs ipaddress request url statuscode count GET materialize As more requests come in to the nginx server the aggregated stats in the view are kept up to date We could also write queries that do further aggregation and filtering on top of the materialized view for example counting requests by route only SELECT url SUM count as total FROM aggregated logs GROUP BY ORDER BY DESC If we were re run the query over and over again we could see the numbers change instantly as soon as we get new data in the log as Materialize processes each line of the log and keeps listening for new lines url total materialize demo page materialize demo page materialize As another example let s use psql together with the watch command to see this in action If you don t have psql already isntalled you can install it with the following command sudo apt install postgresql clientAfter that let s run the SELECT FROM aggregated logs statement every second using the watch command watch n psql c select from aggregated logs U materialize h localhost p materialize In another terminal window you could run another for loop to generate some new nginx logs and see how the results change for i in do curl s localhost materialize demo page gt dev null echo i doneThe output of the watch command would look like this Feel free to experiment with more complex queries and analyze your nginx access log for suspicious activity using pure SQL and keep track of the results in real time ConclusionBy now hopefully you have a hands on understanding of how incrementally maintained materialized views work in Materialize In case that you like the project make sure to star it on GitHub If you are totally new to SQL make sure to check out this free eBook here Free introduction to SQL basics eBook	2021-11-12 20:32:35
Apple	AppleInsider - Frontpage News	Apple quietly buying app ads that funnel users to the App Store, developers claim	https://appleinsider.com/articles/21/11/12/apple-quietly-buying-app-ads-that-funnel-users-to-the-app-store-developers-claim?utm_medium=rss	Apple quietly buying app ads that funnel users to the App Store developers claimApple is said to be quietly buying Google search ads for high value apps on the App Store ーand some developers are concerned that it s hurting their revenue Credit Laurenz Heymann UnsplashMultiple app publishers have told Forbes that Apple is secretly buying Google ads that direct users to an app s App Store listing rather than the developer s website Read more	2021-11-12 20:43:57
海外TECH	Engadget	'Battlefield 2042' won't have voice chat when it debuts on November 19th	https://www.engadget.com/battlefield-2042-voice-chat-200235461.html?src=rss	x Battlefield x won x t have voice chat when it debuts on November thWhen Battlefield nbsp comes out in about a week on November th it won t ship with built in voice chat Series developer DICE told Polygon the feature won t be available until sometime after launch The studio didn t provide a reason for the decision Whatever the case the absence of voice chat will likely be keenly felt by Battlefield fans especially on PC Xbox Series X and S and PlayStation where matches will include as many as players For what it s worth you can still use Discord or the party chat feature on your console to communicate with friends but that won t help you when you re trying to play with strangers In those instances you ll need to rely on the ping system which is apparently on the cumbersome side According to Polygon you have to navigate through multiple menus before you can get to the right ping All told it sounds like Battlefield s already chaotic matches will be a tad more unpredictable in the first few weeks that is available	2021-11-12 20:02:35
海外TECH	Network World	Nvidia jumps into Zero Trust	https://www.networkworld.com/article/3640388/nvidia-jumps-into-zero-trust.html#tk.rss_all	Nvidia jumps into Zero Trust Nvidia has announced a Zero Trust platform built around its BlueField data processing units and Nvidia software Zero Trust is an architecture that verifies every user and device that tries to access the network and enforces strict access control and identity management that limits authorized users to accessing only those resources they need to do their jobs “You cannot just rely on the firewall on the outside you have to assume that any application or any user inside your data center is a bad actor said Manuvir Das head of enterprise computing at Nvidia “Zero Trust basically just refers to the fact that you can t trust any application or user because there are bad actors To read this article in full please click here	2021-11-12 20:28:00
海外科学	NYT > Science	Biden Chooses Robert Califf to Lead F.D.A., Despite Drug Industry Ties	https://www.nytimes.com/2021/11/12/us/politics/robert-califf-fda.html	Biden Chooses Robert Califf to Lead F D A Despite Drug Industry TiesDr Robert M Califf an academic and clinical trial researcher who ran the agency in has also consulted for pharmaceutical companies	2021-11-12 20:40:10
海外科学	NYT > Science	Pfizer Asks F.D.A. to Authorize Covid Booster Shots for All Adults	https://www.nytimes.com/2021/11/09/health/pfizer-booster-eligibility-adults.html	Pfizer Asks F D A to Authorize Covid Booster Shots for All AdultsIn a turnaround the agency is expected to grant the request before the winter holiday season giving access to all million fully vaccinated people	2021-11-12 20:50:13
ニュース	BBC News - Home	Protester climbs on top of train to Drax power station	https://www.bbc.co.uk/news/uk-england-york-north-yorkshire-59267244?at_medium=RSS&at_campaign=KARANGA	pellets	2021-11-12 20:55:49
ニュース	BBC News - Home	Hamilton tops Friday Sao Paulo qualifying but has grid penalty	https://www.bbc.co.uk/sport/formula1/59269846?at_medium=RSS&at_campaign=KARANGA	Hamilton tops Friday Sao Paulo qualifying but has grid penaltyLewis Hamilton romps to pole position for the sprint qualifying race at the Sao Paulo Grand Prix ahead of title rival Max Verstappen s Red Bull	2021-11-12 20:15:10
ビジネス	ダイヤモンド・オンライン - 新着記事	デロイト、PwC…4大コンサルが相談殺到で大儲け！グリーン電力調達狂騒曲の裏側 - 新・グリーンエネルギー戦争	https://diamond.jp/articles/-/286480	再生可能エネルギー	2021-11-13 05:25:00
ビジネス	ダイヤモンド・オンライン - 新着記事	ハウステンボス「猫も狂犬病ワクチンを」の仰天見解、獣医師が実名批判する深い理由 - 有料記事限定公開	https://diamond.jp/articles/-/286490	ハウステンボス「猫も狂犬病ワクチンを」の仰天見解、獣医師が実名批判する深い理由有料記事限定公開新型コロナウイルスワクチンの接種率が高まり、少なくとも国内は自由に移動できる状況になってきた。	2021-11-13 05:20:00
ビジネス	ダイヤモンド・オンライン - 新着記事	プリンターとウオーターサーバーに共通する「儲けの仕組み」とは？ - 事例で学ぶ「ビジネスモデルと戦略」講座	https://diamond.jp/articles/-/287461	価格設定	2021-11-13 05:15:00
ビジネス	ダイヤモンド・オンライン - 新着記事	「本当に信頼できる」動物病院ランキング【腫瘍科・循環器科】犬の心臓病“ゴッドハンド”が横浜に！ - 動物病院の最前線	https://diamond.jp/articles/-/286489	動物病院	2021-11-13 05:10:00
ビジネス	ダイヤモンド・オンライン - 新着記事	チャンスを生かせる経営者が大切にしている、2つのこと - 小宮一慶の週末経営塾	https://diamond.jp/articles/-/287281	小宮一慶	2021-11-13 05:05:00
ビジネス	ダイヤモンド・オンライン - 新着記事	難民が武器に、欧州が恐れる「新タイプ」の戦争 - WSJ発	https://diamond.jp/articles/-/287584	難民	2021-11-13 05:01:00
ビジネス	東洋経済オンライン	瀬戸内寂聴さんが､私たちに残してくれたもの 人が作った常識の枠からはみ出た情熱と自由さ | 日本人が知らない古典の読み方 | 東洋経済オンライン	https://toyokeizai.net/articles/-/468501?utm_source=rss&utm_medium=http&utm_campaign=link_back	日本人が知らない	2021-11-13 05:30:00
GCP	Cloud Blog	Live from COP26: A cloud’s eye view	https://cloud.google.com/blog/topics/sustainability/thoughts-on-cloud-and-climate-change-from-cop26/	Live from COP A cloud s eye viewAt Google we re keenly invested in preventing the worst effects of climate change and helping our customers use Google Cloud technology to build a more sustainable future We re watching with interest the goings on at the United Nations Climate Change Conference or COP when representatives from countries and organizations around the world including Google Cloud will gather for the first two weeks in November in Glasgow Scotland for the latest round of climate talks Bookmark this blog as Google sustainability experts bring their perspective on developments discussed there as they pertain to cloud computing Catch the event for yourself on Youtube and Google Arts amp Culture Invest in nature to win on climate Friday November  Jen Bennett Director Office of CTO Google Cloud and Nithya Sowrirajan Director Global Solutions Google Earth and Earth EngineIt was years ago at COP that we unveiled Google Earth Engine an earth observation platform that combines a multi petabyte catalog of satellite imagery and geospatial datasets with powerful analysis capabilities And for over a decade now scientists and researchers have used it to detect changes map trends and quantify differences on the Earth s surface  When you observe the Earth s surface over the past few decades in Google Earth s Timelapse the immensity of the change to our natural environment is arresting It s becoming increasingly clear that we not only need to adapt to protect vulnerable communities and natural habitats against this change but that we also need to look to nature as a regenerative solutionーnot just something that we need to protect but something that will protect us  During these past two weeks at COP world leaders committed to averting the worst consequences of climate change Day two of the World Leaders Summit focused on the role of nature in climate action with forests taking center stage countries signed an agreement to reaffirm commitments to sustainable land use and to the conservation protection sustainable management and restoration of forests as well as other terrestrial ecosystems  In our experience working with NGOs like World Resources Institute to develop tools such as Global Forest Watch technology is critical to monitoring changes to and protecting the forests that we re depending on to mitigate climate change A proliferation of satellites and sensors enable us to better understand different types of changes like land coverage or surface water with increasing resolution Increasing the frequency of imaging provides us with timely understanding of changes in the Earth s forests landscapes icescapes and coastal waters Together with technical partners who develop methodologies and share best practices this data and more insightful tools can help us make fasterーand betterーdecisions to manage these resources responsibly Global Forest Watch provides interactive maps to view and analyze forest change Protecting forests and natural resources isn t just a challenge for nation states Organizations across the public sector and industries such as agriculture financial services and consumer goods also need to better manage and mitigate climate risks and preserve natural resources impacted by their supply chainーand they re using technology to do so For example Google Cloud and Unilever partnered to help end deforestation in the supply chain for palm oil and other commodities by Unilever is analyzing forests biodiversity and water cycles that intersect their supply chain leading to greater accountability and enabling them to better detect deforestation and prioritize areas of forests or habitats in need of urgent protection  On Saturday Unilever premiered an IMAX video at COP In Our Nature In the session that followed We cannot win on climate without winning on nature Unilever Chief Supply Chain Officer Marc Engel spoke about the game changing ability of being able to see what is happening on the ground on farms and mills in almost real time and how that helps them make commodity sourcing decisions Google also participated on the panel explaining how the new datasets and methodologies that Unilever is using are widely applicable across industries and our work with the ecosystem to create trustworthy standards The science is clear nature based solutions must be an integral part of the fight against climate change All this is leading to bold commitments collaboration and collective action Last week USAID announced the Forest Data Partnership between the World Resources Institute Unilever Google NASA and the United Nations Food and Agriculture Organization to address a key barrier to private investment in forests and restoration the lack of reliable and accessible data on forests and lands The partnership will focus on key geographies including the Amazon Basin Southeast Asia and West Africa  No one can tackle climate action and nature preservation alone we are humbled to collaborate with our partners and the ecosystem Collaboration starts with rich data from both public and commercial providers and is enhanced by the presence of a collaborative platform With Google Earth Engine and Google Cloud we ll continue to bring together researchers scientists NGOs and commercial entities to establish best practices for a shared understanding By working in collaboration we can win on nature together A global data commons can empower local climate decisionsThursday November  Jason Hickey Software Engineer  Here at COP one thing is clear the race to global net zero in the next years will be one of the largest transitions humanity has ever faced and it will be an all hands on deck effort that includes governments the private sector academia as well as creative individuals This will be a Herculean effort for the planet The financial sector is mobilized and opportunity is knocking  As efforts to address climate change accelerate climate justice will be critical Climate impacts are not borne equally and we must work together to ensure a just transition to a better future for present and future generations In order to achieve that we ll need to focus on information equity ーthe equal access to environmental data ーand the development of the global data commons ーdata about climate and energy as well as a framework and governance principles for using it View from the GOES geosynchronous weather satellite using the NOAA NESDIS GOES image viewerI work in the atmospheric sciences weather and climate modeling fields that have an unprecedented amount of information gathered by advanced infrastructure Hundreds of satellites circle the globe collecting terabytes of observations every day Sophisticated weather and climate models make predictions and forecasts ranging over hours seasons or even centuries This infrastructure was created principally through publicly funded governmental organizations in the developed world like NOAA NASA ECMWF the Met Office and others This data is enormously valuable in making predictions for climate change such as the IPCC interactive atlas or the WMO climate dashboard that helps advise countries on specific actions to combat climate change WMO Climate Dashboard showing temperature change since For instance in my research team focused on weather and climate modeling we apply AI models to this data to make high resolution local weather forecasts This is an example of how public data can be used directly to inform local decisions  The natural extension of these ideas is toward the creation of a global data commons and Open Science where data methods and platforms are accessible and usable by all communities anywhere on Earth Of course this is not just for weather and climate data but also for the financial and accounting tools that can be used to manage and track carbon Open platforms open data open science empower local decision making and global consensus and empower the vast amount of human ingenuity and creativity worldwide Cloud platforms are a key part of this vision supporting globally available data and compute services Fortunately strong investments in sustainability by cloud platform providers including Google Cloud s zero carbon commitment mean that open science and information equity are environmentally sustainable allowing global collaborative communities to flourish As we enter the critical decade to address climate change COP demonstrates enormous alignment and commitment across sectors and a readiness to act It is time to leverage open platforms that provide the infrastructure for action and fully support information equity and global collaboration The role of the private sector in scaling clean energy solutions   Wednesday  November   Amanda Peterson Corio Head of Data Center Energy Development Google Yesterday I was honored to participate on a panel at the Bloomberg Green Summit at COP focused on overcoming hurdles to scaling clean energy technologies Earlier in the day U S Special Presidential Envoy for Climate John Kerry spoke to the audience about the negotiations at COP and why success at Glasgow is so critical to accelerating climate mitigation Among other key issues he pointed to how the private sector is driving clean energy solutions and is making ambitious commitments and investments to help scale nascent technologies across many different types of industries from maritime shipping to aviation and advanced carbon free electricity technologies  Making these kinds of advanced market commitments to purchase clean energy technologies can play an important role in signaling market demand that provides confidence to investors and suppliers to scale up new technologies That s a role that Google is actively seeking to play as part of our Carbon free Energy CFE goal As I described on my panel today we will continue to buy much higher volumes of mature clean energy technologies like wind and solar but we also need to look at how we can support other clean energy solutions ーsuch as energy storage carbon capture and storage technologies green hydrogen advanced nuclear and others ーto complement wind and solar as we seek to fully decarbonize our electricity consumption on every grid we operate by We re particularly excited about the promise of next generation geothermal technology which we are piloting with a technology partner in Nevada Another theme in the conversation was that in order to enable the private sector to play this role policy is critical I shared our experience in Taiwan where until it was not possible for any company to purchase renewable energy directly and add it to the grid We worked with other partners and the Taiwanese government to update their regulatory framework to make it possible to do so and shortly thereafter we signed the first corporate power purchase agreement PPA in Taiwan s history Later that enabled Taiwan Semiconductor Manufacturing Company to sign the largest PPA ever for a MW offshore wind farm in the country We know that Google alone can t solve these challenges Building coalitions for policy change will be key to driving clean energy adoption across the globe That s why we were thrilled to join the new Clean Energy Demand Initiative CEDI to open new opportunities for clean energy purchasing across the globe It s also why we helped launch the CFE Compact to make it possible for more companies organizations and governments to advance toward CFE and accelerate the decarbonization of electricity grids across the world  How climate scientists are using cloud computing to predict the future of our planet  Tuesday November  Tricia Davis Muffett Director Public Sector MarketingAs world leaders debate policy measures at COP leading scientists are harnessing the power of the cloud to better understand how the Earth s climate is changing  With cloud computing scientists run parallel computations on intuitive scalable and cost effective infrastructure which is crucial for analyzing the massive datasets of climate science The more data climate scientists can collect and analyze the better their predictions can be ーand the sooner we can develop solutions  With Google Cloud researchers around the world are developing new tools to do this collaboratively and sharing them so policy makers can access them too Here are some examples of these innovative projects At Columbia University researchers used Google Cloud to build Pangeo an open source data toolkit to store and analyze the three dimensional high resolution datasets of climate sciences They are now building Pangeo Forge to crowdsource and automate the creation of cloud optimized big science data and further facilitate sharing and collaboration At CalTech researchers at the Climate Modeling Alliance CliMA are developing ClimateMachine the first climate model to integrate the massive amounts of observational climate data collected from space and the ground with targeted high resolution simulations This is especially important for data that are not easy to measure and represent like low lying cloud strata By running the simulations on Compute Engine they improved the model s accuracy and reduced uncertainty in planning for extreme events like hurricanes At Natural Resources Canada NRCan researchers are supporting sustainable development in Canada s natural resource sector By partnering with Climate Engine a Canadian company using geospatial AI tools and using Google Earth s satellite data they are delivering actionable insights to the public sector Then by tracking changes in ecosystems disease vectors water availability and quality soil health growing seasons air pollution and more NRCan and Climate Engine can improve decision making on climate action policy and help support climate resilience These examples of climate scientists using Google Cloud to share data and improve their predictions are just the tip of the iceberg of how our technology can help fight climate change For more check out the resources below  Related resourcesRead this article about Pangeo and “the Case for Cloud in Science Listen to CliMA scientists explain how climate models workWatch this video introducing Climate EngineDeveloping apps that support our natural worldMonday November Alexandrina Garcia Verdin Cloud Developer Advocate At COP the focus thus far has largely been on reducing carbon emissions ーand rightfully so But today s theme of Adaptation Loss and Damage has particular meaning to me Working at Google Cloud I ve witnessed how technology and data can help us solve complex social and environmental challenges especially in two major areas   Assessing and quantifying changes caused by human activity on the Earth and course correct ex timelapses of satellite imagery or auto classifying images to detect carbon emissions Creating and adopting the next generation of Earth aligned solutions that improve systems of infrastructure and exchanging of goods ex sensors to support regenerative farming or supply chain apps that label the climate positive impact a good or service has promoting biodegradable materials or circular systems of reuse As a Developer Advocate I build and share how to technical content to show customers how to use our tools In that capacity for Earth Day I created a YouTube mini series called People and Planet AI that helps create paths for developers interested in using machine learning or big data to build meaningful apps via real life examples The first episode of this technical series is on WildlifeInsights org which is an amazing free web app that anyone with an internet connection can use to search or upload photos to a global wildlife database to train machine learning models that auto classify photos of animals taken by research cameras In this vein my peers and I designed a getting started sample for building an animal classifier on Google Cloud Our second episode was on GlobalFishingWatch org another beautiful machine learning project that helps track vessels from illegal unreported and unregulated fishing Our beginner sample teaches you the data transformations performed and the model creation process for building a time series classification It uses GPS vessel data and manually labeled data to predict whether or not a vessel is fishing based on their distance from shore direction lat long speed etc Thanks to Google s employee policy which enables employees to spend of their time on projects outside of their core job I also work co organizing a grass roots group called Anthropocene that matches Googlers with internal climate products research or hardware The goal is to accelerate the creation of climate solutions by connecting talented people to different problems This climate solutions startup community is intentionally a safe and positive space made up of passionate people with a wide spectrum of technical science environmental or organizational backgrounds They each choose the skills they wish to offer ranging from project management UX marketing partner management software engineering technical documentation analytics etc I believe open data and documentation is the way to scale climate solutions with urgency I turn to open source practices because they are at the end of the day contribution frameworks that enable perfect strangers to work together to solve complex issues And when it comes to climate solutions we benefit from global participation to design for regional needs As such documenting recording or summarizing how to build a solution as accessibly possible is key to enabling others It s also equally important for organizations to continuously share data to help build models that have sufficient information to train them  My next work will be focused on externalizing the program management learnings we have gathered from operating our climate startups program The goal is to share new frameworks for organizations in any industry to build internal climate solution programs by leveraging employee talent as well as the organization s strengths resources Thanks to data and machine learning today we can understand our natural world with far greater richness than ever before ーby orders of magnitude more I am personally very motivated to see climate solutions grow exponentially and look forward to inspiring technologists to apply their skills to our natural world Can t miss experiences from the Green Zone at COP Friday November  Camaryn McKenzie and Denna Nazem Associate Product Marketing Managers GoogleAs part of a generation that is deeply passionate about climate justice and protecting the planet we treat our role as Google marketers as an opportunity to amplify voices generate awareness for technology solutions and build influential and creative content around sustainability This week we ve been exploring COP through Google Arts and Culture s Green Zone ーa space for youth groups civil society academia artists and business to host events exhibitions cultural performances workshops and talks that are online and accessible to all We want to invite you to explore the Green Zone watch live streams straight out of Glasgow and even virtually walk through the exhibits in a space  There is a LOT of outstanding content available but we were especially drawn to some of the creative solutions presented by climate leaders to combat global warming Here are the top three sessions we think you can t miss  Reimagining Museums for Climate Action What if Indigenous lands were thought of as a kind of museum for climate action The UN launched the “Reimagining Museums for Climate Action design competition in May and is now showcasing eight of the proposals at COP This article allows you to explore the exhibits online showcasing ideas on how museums can become catalysts for climate action One project we found particularly interesting was the Natural Future Museum which celebrates and protects Indigenous communities who have historically lived in harmony with their natural environments The exhibit includes a short film highlighting one community that is doing just that “The relationship between museums and Indigenous groups is often problematic as museums have deprived them of their cultural heritage What if we thought of Indigenous territories themselves as a new kind of museum where forests and peoples ways of life can be sustained Natural Future Museums Reimagining Museums for Climate Action  Climate visuals Visualising Climate Change Climate Visuals in collaboration with TED Countdown is releasing photographs selected from a pool of unique submissions Each of the photos is a combination of illustrative and impactful showcasing climate solutions in tandem with the global impact of climate change This initiative is intended to produce an accessible collection of evidence based photos that document the reality of climate change across the globe “How we articulate the impact of climate can make or break public opinion and the ripple effect is seen throughout culture business education media and more Climate VisualsAerial view of systematic deforestation in a Bolivian national park bare strip of ground among forests Marcelo Perez del Carpio Climate Visuals Countdown Men working to drive in posts to retain soil embankment on the coast from erosion by high tides Debsuddha Banerjee Climate Visuals Countdown  The Frontlines Step into the Reality of Climate ChangeThe Biosphere Virtual Reality exhibit The Frontlines transports viewers to the frontlines and realities of the climate crisis and out of the comfort of Glasgow or their computer scenes We think the power of VR and immersive video really shines through this exhibit bringing in the voices of the most underrepresented populations who are being hit the hardest by climate change directly to the COP stage Through showcasing three moving case studies the exhibit clearly highlights how while it is important to work together towards solutions for the future the reality is devastation has already arrived   “Women and young people in the Global South are already being hardest hit by the climate crisis Extreme weather patterns ーcaused by rising global temperatures ーare destroying lives and livelihoods and displacing millions of people from their homes…step into the reality of climate change and be transported from the comfort of Glasgow to the places already being devastated by the effects of climate change Kiribati Morocco and Ethiopia The Frontlines Biosphere Virtual RealityWhat Green Zone content resonated most with you Join the climate conversation with GoogleSustainability and GoogleCloud New partnerships set a course for clean energy progressThursday November  Fabien Vieau Regional Director European Data Center Energy and SustainabilityWhile national pledges to reduce carbon emissions tend to make the most news at climate conferences like the one this week in Glasgow it s new policy and investment partnerships that will be key to making near term progress in transitioning the globe to cleaner energy sources And by that measure the first week of COP has already included a number of important announcements that will help move us faster toward a cleaner energy system  On Tuesday my colleague Devon Swezey wrote about the new Carbon free Energy Compact now with signatories to enable CFE and accelerate electricity grid decarbonization across the globe Today I was pleased to represent Google as it officially joined the Clean Energy Demand Initiative CEDI a new effort coordinated by the U S government and announced today by Special Presidential Envoy for Climate John Kerry The CEDI fosters collaboration between corporate clean energy buyers and governments across Asia Latin America and Africa to scale clean energy purchasing and support national climate goals Google has long been a leader in clean energy purchasing helping to found organizations like the Renewable Energy Buyers Alliance in the U S Re Source in Europe and working to open the market in Taiwan to direct clean energy purchasing The CEDI is an exciting new partnership to expand these successes to new geographies In addition to these initiatives a number of other notable efforts were launched to support the growth of clean energy across the globe These include  A new Green Grids Initiative launched by the UK and India which seeks to accelerate the development and deployment of interconnected electricity grids across continents countries and communities   The Global Energy Alliance a new fund to accelerate and scale equitable energy transitions in low and middle income countries which aims to raise billion in public and private capital to expand access to clean electricity for billion people  The First Movers Coalition which organizes commitments by companies to purchase low carbon products to create new markets for technologies that will be needed to reduce emissions across hard to abate sectors like aviation shipping and cement One important lesson coming out of COP is that partnerships and collaboration between the public private and NGO sectors will be key to driving the adoption of clean energy at the pace and scale necessary to mitigate the worst consequences of climate change It s also clear that policy in particular is critical to accelerating the current momentum Supporting the net zero agenda as technology leaders Wednesday November Paul Frost Chief Architect Wholesale Banking Technology HSBCAs COP gets into full swing I ve started reflecting on what we as technology leaders can do to support the sustainability and the net zero agenda Since the turn of the st century we as a society have become more and more dependent on technology both in our personal lives and at work and the push to digitise continues at pace especially in the financial sector Let s start by saying from a carbon footprint perspective this is a good thing for almost all processes in a digitised journey will always be more carbon efficient than the equivalent manual process Using paper and visiting a branch by example are evidently more carbon intensive Having said that we must also recognise that for us at HSBC and other banks technology is a sizeable part of our carbon footprint So what are the levers we have to influence the size of this footprint There are a number of choices we can make that have a positive impact ーfrom large decisions around hosting through to how we manage our day to day activities across technology One of the most impactful things we can do is to use the cloud Whilst we are moving to more sustainable internal data centres cloud providers are generally ahead of this curve as they have had to drive a high degree of efficiency to support their hyperscale demands That and their advances in use of green energy puts them ahead in the goals of net zero carbon But cloud isn t the only answer ーwe need to think about how we use the technology more broadly Here are just some of the things we as technology leaders should consider Are we rightsizing our applications Typically utilization figures of servers are low so would efficient use of containers and virtualization help We often “gold plate solutions does the solution warrant the size of infrastructure deployed to meet this business need Do systems need to be up and running of the time We typically leave infrastructure running when not in use Do those development and test environments need to be running of the time Can we scale on demand rather than pre provision to meet spikes in capacity demand This is another area where cloud helps What about data It too has a carbon footprint Do we always consider the data lifecycle and have efficient processes for data archiving and deletion or do we keep the data around just in case Duplication do we have duplicate solutions that meet a business need Do we really need this or would consolidation help reduce the carbon footprint The desktop are we thinking about carbon footprint in our desktop There is significant variation across desktop devices that needs to be considered Are we considering the whole life of a device through manufacture transport use and eventually decommission These are just some of the things we need to consider and I am sure many people are already aware and doing this There are more options out there but the most important thing we can do is start thinking about the various options we have at hand make sure we are having these conversations and challenge the carbon efficiency of our technology use At HSBC we are committed to achieving net zero in our own operations and supply chain by or sooner read more here Accelerating sustainable finance with technologyWednesday November Jeff Sternberg Director Office of the CTO Google CloudAs global leaders gather this week at COP in Glasgow one of their top goals is to mobilize finance to secure net zero emissions and keep degrees warming within reach To do this COP leaders are challenging all financial stakeholders to take climate into account in every financial decision  Technology is playing a vital role in this effort I have a background in financial services and fintech and work in Google Cloud s CTO Office with technology leaders across financial services and other industries to transform sustainability in their organizations Here are three technology areas that I think are vital for sustainable finance both to manage climate related risks and to enable new climate finance opportunities Understanding localized climate risksCOP leaders are calling on companies to be transparent about the risks inherent in climate change Every business will be affected by a warming planet and it s critical to understand precisely how these events will affect company operations employees lives and entire value chains As BlackRock s CEO Larry Fink has stated climate risk is investment risk However physical risks from climate change are not evenly distributed around the world Some areas will see increased floods and others will face droughts or wildfires Rising sea levels will affect coastal areas and severe winter storms will affect places with historically milder winters Geospatial analytics and modeling has the potential to give us a much more accurate view of these localized climate related physical risks The Task Force on Climate Related Financial Disclosures TCFD recommends factoring the geographic location of the organization s value chain both upstream and downstream as well as the organization s own assets into any climate change scenario analysis efforts Using tools like Google Earth Engine and BigQuery it s possible to create a localized precise understanding of climate related physical risks for each location in the value chain Using AI to improve climate disclosureAnother key finance priority for COP is improving the quantity quality and comparability of climate related disclosures by companies so that investors and regulators can better understand climate risks and opportunities To date most of this disclosure has been published as human readable documents One example is Google s Environmental Report These documents are very helpful if you re in a position to deeply study an individual company but what if you want a broad view of sustainability progress across markets This is where AI comes in Specifically natural language machine learning approaches can be applied to classifying and extracting structured information from sustainability disclosures The TCFD recently used an AI approach to quantify the level of sustainability disclosure across companies from countries A team of experts manually labeled text passages in a sample of documents assigning a “yes or “no value to each review question such as “does the company disclose Scope Scope and if appropriate Scope greenhouse gas emissions Then they trained a model with these labels and used it to predict yes no responses for the entire corpus The resulting analytics were used by the task force to assess the state of adoption and level of disclosures Investors regulators and companies can all benefit from adopting natural language AI techniques to better understand sustainability documents whether those are from suppliers investors customers or even competitors Tools like Google Document AI and Vertex AutoML can accelerate AI adoption in these organizations Collaborative sustainability data sharingCOP is demonstrating the power of collaboration to solve climate challenges It s clear that individual organizations cannot go at this alone everyone must work together In the financial world companies need to share information with investors suppliers need to share data with companies and everyone needs to share data with regulators and central banks In an enterprise setting sharing data can be difficult involving legacy tools slow cycle times and one way processes What if sharing climate and sustainability data were as simple as sharing photos or documents in the cloud Cloud native tools like Analytics Hub built on BigQuery can definitely help here As a bonus thanks to Google s renewable energy matching building these solutions on Google Cloud today means the net operational greenhouse gas emissions associated with your application is zero And over time the gross carbon footprint of these workloads will decrease as we make progress towards our goal of running on carbon free energy around the clock by New momentum for carbon free energyTuesday November Devon Swezey Global Energy Markets and Policy LeadWhen Google announced our goal to operate on carbon free energy CFE at all of our data centers cloud regions and office campuses across the world by we knew that reaching it would require new partnerships with governments companies our customers and the communities in which we operate That s why it s been so exciting to see so many companies governments and organizations join Google in committing to advance CFE including today at the COP conference in Glasgow  Earlier today I participated on a panel with leaders from X AES Clean Energy the government of Iceland and the city of Ithaca New York to discuss the CFE Compact a multi stakeholder effort organized by Sustainable Energy for All to accelerate decarbonization of electricity grids across the globe SEforAll announced that new companies governments and organizations for a total of have now joined the Compact which Google CFO Ruth Porat publicly launched in a speech at the September UN High Level Dialogue on Energy In addition to the organizations that participated on today s panel CFE Compact signatories include Clean Air Task Force EDP Engie Johnson Controls and Orsted you can find a full list here The CFE Compact is a vehicle to focus action to go beyond the “emit and compensate model of the past and target the complete decarbonization of electricity consumption This is important because rapid electricity decarbonization is key to creating net zero emissions economies electricity accounts for of global carbon emissions but is also key to decarbonizing other sectors of the economy like transport industry and buildings According to the International Energy Agency s landmark Net Zero by report published earlier this year to achieve a net zero global economy by we must create zero carbon grids even earlier by according to the IEA while “electricity becomes the core of the energy system  With the CFE Compact stakeholders across the energy ecosystem can help accelerate this transition by driving progress in key areas We ll need more energy consumers targeting CFE for their operations new market and product innovations to enable around the clock clean power advancements in carbon free energy and demand optimization technologies and major shifts in policy We re hopeful that COP proves to be a strong foundation to build upon as we work collectively to decarbonize the grids in the coming decades  To learn more about the growing movement for Carbon free Energy and how you can get involved check out www gocarbonfree com And as Google advances towards our own CFE by goal we ll continue to share our learnings and our progress and work to help our partners and customers achieve their own decarbonization objectives Stay tuned for more updates in this area in the weeks ahead At COP we ll be watching the world turn ambition into actionMonday November Chris Talbott Cloud Sustainability LeadIt s Day of COP where for the next two weeks the work of nations companies agencies and individuals fighting climate change across the globe will be on full display  At Google we believe that technology is a powerful tool in that fight and consider the environment with every product we build and every data center we stand up We re also partnering with governments to decarbonize their economies improving climate preparedness and increasing climate resilience  And at Google Cloud we ve been working with our customers to apply cloud technologies to the critical climate change challenges they need to meet for their business goals In these engagements we re focused on turning the overwhelming ambition we hear from everyone we talk to ーapp developers to city planners to CEOs ーinto real action Which is why I m looking forward to the next two weeks and I m super interested in learning how other companies are tackling climate change in their industries  For example one of the things we ll be on the lookout for is new ideas for using technology to help visualize and quantify climate challenges ーthings like this AI generated installation with artwork that explores climate issues like coral bleaching Visual representations are already helping our customers make more sustainable decisions such as how to source materials more responsibly I hope we can learn more from the creative COP community on how to use visuals to influence sustainability decisions  Each day of COP has a theme ーfrom finance to energy to cities ーwhich is sure to bring new commitments from the leading sustainable companies in each industry Whether its pricing climate risk into financial assets last mile efficiency in logistics or infrastructure decarbonization individual industries all face unique sustainability challenges have unique goals and require unique technology solutions to achieve them For our part Google shared a new net zero commitment across our value chain heading into COP and I m looking forward to seeing all the new targets being set and progress that companies are making  We ll also be listening to the experts on howwe can avert the worst consequences of climate change The challenge is immense but change can start with small decisions all of us make Keep us bookmarked and check back with us often to hear perspectives from onsite in Glasgow and from climate and industry experts across our teams who are working on making the sustainable choice the easy one Related resourcesGoogle Cloud sustainability overviewAnnouncing new tools to measureーand reduceーyour environmental impactSustainability at Google Cloud Next	2021-11-12 21:00:00