投稿時間:2022-04-07 02:34:10 RSSフィード2022-04-07 02:00 分まとめ(35件)

カテゴリー等	サイト名等	記事タイトル・トレンドワード等	リンクURL	頻出ワード・要約等/検索ボリューム	登録日
AWS	AWS Compute Blog	Getting Started with Event-Driven Architecture	https://aws.amazon.com/blogs/compute/getting-started-with-event-driven-architecture/	Getting Started with Event Driven ArchitectureIn modern application development event driven architecture is becoming more prominent because it can make building applications in the cloud easier Event driven architecture can allow you to decouple your services which increases developer velocity and can make it easier for you to debug applications It also can help remove the bottleneck that occurs when features expand …	2022-04-06 16:06:23
AWS	AWS Database Blog	Migrate self-managed MariaDB to Amazon Aurora MySQL	https://aws.amazon.com/blogs/database/migrate-self-managed-mariadb-to-amazon-aurora-mysql/	Migrate self managed MariaDB to Amazon Aurora MySQLAmazon Aurora is a fully managed MySQL and PostgreSQL compatible relational database offered as part of the Amazon Relational Database Service Amazon RDS With a managed service like Aurora customers can free their teams from time consuming database tasks like server provisioning patching and backups Amazon Aurora provide continuous monitoring self healing storage and automated scaling to help …	2022-04-06 16:33:02
AWS	AWS Machine Learning Blog	Receive notifications for image analysis with Amazon Rekognition Custom Labels and analyze predictions	https://aws.amazon.com/blogs/machine-learning/receive-notifications-for-image-analysis-with-amazon-rekognition-custom-labels-and-analyze-predictions/	Receive notifications for image analysis with Amazon Rekognition Custom Labels and analyze predictionsAmazon Rekognition Custom Labels is a fully managed computer vision service that allows developers to build custom models to classify and identify objects in images that are specific and unique to your business Rekognition Custom Labels doesn t require you to have any prior computer vision expertise You can get started by simply uploading tens of …	2022-04-06 16:46:32
AWS	AWS Networking and Content Delivery	Amazon CloudFront introduces Server Timing headers	https://aws.amazon.com/blogs/networking-and-content-delivery/amazon-cloudfront-introduces-server-timing-headers/	Amazon CloudFront introduces Server Timing headersIntroduction Amazon CloudFront has recently announced a new feature Server Timing headers which provides detailed performance information such as whether content was served from cache when a request was received how the request was routed to the CloudFront edge location and how much time elapsed during each stage of the connection and response process Server …	2022-04-06 16:41:17
AWS	AWS Government, Education, and Nonprofits Blog	Bias for Agile action speeds digital transformation in the public sector	https://aws.amazon.com/blogs/publicsector/bias-agile-action-speeds-digital-transformation-public-sector/	Bias for Agile action speeds digital transformation in the public sectorWhen I worked in the UK government I led the Government Digital Transformation Service GDS Transformation Program where we used an Agile approach to modernize a range of services from social care benefits to prison visit booking Now I work with the AWS Institute executive education program to teach public sector leaders how to accelerate and expand their impact for citizens with digital transformation In this blog post I share my experience using the Agile approach to transform government services and offer some best practices for organizations who want to adopt a bias for Agile action to deliver successful modernization faster and at scale	2022-04-06 16:17:01
AWS	AWS	Amazon Aurora I/O Cost Optimization Methodology | Amazon Web Services	https://www.youtube.com/watch?v=dpLRAlEX7Lo	Amazon Aurora I O Cost Optimization Methodology Amazon Web ServicesAmazon Aurora is a cloud native database built for speed and reliability Aurora offers you pay as you go pricing with no licensing cost Cost is always a key factor when running any application In this video I will take a top down approach and drill down on Aurora I O cost starting from the AWS monthly billing statement and using various AWS services features like AWS cost explorer AWS cost and usage reports Amazon Athena Amazon CloudWatch and RDS Performance Insights to find which Aurora cluster or queries running in a particular Aurora cluster might be contributing to your overall Aurora cost Typically you will take this approach while doing investigation to understand and manage your AWS cost over time Learn how to investigate and optimize your Amazon Aurora I O Cost read more here Chapters Agenda Amazon Aurora Cost Components Aurora I O Cost Monitoring Aurora I O Cost Demo AWS Billing Dashboard AWS Cost Explorer Cost Allocation Tags AWS Cost Usage Reports Amazon Athena Amazon CloudWatch RDS Performance Insights Aurora I O Cost Optimization best practicesSubscribe More AWS videos More AWS events videos ABOUT AWSAmazon Web Services AWS is the world s most comprehensive and broadly adopted cloud platform offering over fully featured services from data centers globally Millions of customers ーincluding the fastest growing startups largest enterprises and leading government agencies ーare using AWS to lower costs become more agile and innovate faster AWSDatabases AWSDemos AmazonAurora AWS AmazonWebServices CloudComputing	2022-04-06 16:18:36
AWS	AWS	Publish Products on AWS Data Exchange | Amazon Web Services	https://www.youtube.com/watch?v=6yrzgHPsEA8	Publish Products on AWS Data Exchange Amazon Web ServicesIn this video you ll see how you can publish products on AWS Data Exchange With AWS Data Exchange data providers can easily create data sets and revisions import assets from Amazon Simple Storage Service Amazon S Amazon API Gateway or Amazon Redshift and publish products publicly or privately to specific AWS accounts For more information on this topic please visit the resources below Publishing new products AWS Data Exchange terminology definitions Product description templates Updating Products Subscription verification Revision access rules Subscribe More AWS videos More AWS events videos ABOUT AWSAmazon Web Services AWS is the world s most comprehensive and broadly adopted cloud platform offering over fully featured services from data centers globally Millions of customers ーincluding the fastest growing startups largest enterprises and leading government agencies ーare using AWS to lower costs become more agile and innovate faster AWS AmazonWebServices CloudComputing AWSDataExchange AWSmarketplace	2022-04-06 16:07:00
AWS	AWS	Amazon Transcribe Video Snacks: Creating Video Subtitles Without Writing Any Code	https://www.youtube.com/watch?v=PZdfXGggcH4	Amazon Transcribe Video Snacks Creating Video Subtitles Without Writing Any CodeAmazon Transcribe is an Amazon Web Services service that makes it easy for customers to convert speech to text Using Automatic Speech Recognition ASR technology customers can use Amazon Transcribe for the generation of subtitles on video content Subtitle creation on video content poses challenges no matter how big or small the organization To address those challenges Amazon Transcribe has a helpful feature that enables subtitle creation directly within the service There is no machine learning or code writing required to get started This Amazon Transcribe video snack will walk you through setting up a no code workflow for creating video subtitles using Amazon Transcribe within your Amazon Web Services account The subtitles available within this YouTube video were generated by Amazon Transcribe reviewed and edited using the same workflow described in the video Learn more about Amazon Transcribe at this link here Subscribe More AWS videos More AWS events videos ABOUT AWSAmazon Web Services AWS is the world s most comprehensive and broadly adopted cloud platform offering over fully featured services from data centers globally Millions of customers ーincluding the fastest growing startups largest enterprises and leading government agencies ーare using AWS to lower costs become more agile and innovate faster AmazonTranscribe VideoSnacks Subtitles How to No Code Workflow Tutorial AWS AmazonWebServices CloudComputing	2022-04-06 16:02:54
Google	Official Google Blog	Take a step-by-step tour of your Chrome privacy settings	https://blog.google/products/chrome/take-step-step-guide-your-chrome-privacy-settings/	Take a step by step tour of your Chrome privacy settingsYour browser plays a big role in your online experience ーincluding protecting your privacy And in Chrome we don t take this responsibility for granted That s why we ve made your privacy and security controls easier to understand and today we re introducing our latest tool to help you continue to protect your privacy while you browse Developed at the Google Safety Engineering Center GSEC Privacy Guide is a step by step guided tour of some existing privacy and security controls in Chrome ーso you can make and manage the right selections for you in one spot When you navigate through Privacy Guide you ll learn about the benefits trade offs and privacy implications of each setting so you can easily understand what happens when a particular one is on or off To start Privacy Guide will include controls for cookies history sync Safe Browsing and Make Searches and Browsing Better As we receive feedback from the community we may add more settings to the guide over time Soon you ll see a new card for Privacy Guide in the “Privacy and security tab in your Chrome settings which you can find by clicking the three dots on the top right corner of your browser And don t worry if you don t have time to take the whole tour at once Your changes are saved along the way so you can pick it back up whenever works best for you Privacy Guide will start rolling out to all M Chrome desktop users in the coming weeks We hope it helps you learn more about Chrome s privacy settings and most importantly gives you the peace of mind to browse safely	2022-04-06 16:01:00
AWS	AWSタグが付けられた新着投稿 - Qiita	パーティションテーブルに新規のパーティション列を追加する	https://qiita.com/itsuki3/items/04473de0f010c20bef07	athena	2022-04-07 01:23:00
技術ブログ	Mercari Engineering Blog	Mercari ML&Search Talk #2 ~Customer Understanding~を開催しました #mercari_ai	https://engineering.mercari.com/blog/entry/20220406-8610fd8b44/	mercariai	2022-04-06 17:18:49
海外TECH	Ars Technica	It’s not just Glen Canyon—dams around the Southwest are taking a hit	https://arstechnica.com/?p=1845708	southwestern	2022-04-06 16:43:42
海外TECH	Ars Technica	AMD’s GPU drivers are overclocking some Ryzen processors without asking	https://arstechnica.com/?p=1846168	ryzen	2022-04-06 16:08:59
海外TECH	MakeUseOf	How to Spell Check in Google Sheets	https://www.makeuseof.com/spell-check-in-google-sheets/	google	2022-04-06 16:45:14
海外TECH	MakeUseOf	7 Best AI-Based Apps That You Should Be Using To Monitor Your Health	https://www.makeuseof.com/best-ai-apps-monitor-your-health/	Best AI Based Apps That You Should Be Using To Monitor Your HealthThere s a wealth of information at your fingertips and AI based apps are using that to revolutionize healthcare These are the AI health apps to try	2022-04-06 16:31:14
海外TECH	MakeUseOf	5 Recycle Bin Settings on Windows 11 You Should Know About	https://www.makeuseof.com/windows-11-recycle-bin-tips/	recycle	2022-04-06 16:15:14
海外TECH	MakeUseOf	How to Use EarTrumpet to Adjust Your Windows 11 Audio Volume	https://www.makeuseof.com/windows-11-eartrumpet-guide/	windows	2022-04-06 16:15:14
海外TECH	DEV Community	useImperativeHandle: the most unknown React hook	https://dev.to/romaintrotard/useimperativehandle-the-most-unknown-react-hook-3po6	useImperativeHandle the most unknown React hookAmong all the native React hooks that exist there are well known ones like useState useEffect and less known ones like useImperativeHandle This last hook is the subject of this article that I teased in my last article about React references At the end of this post you will know what problem is solved with it how to use it and a real use case where it s needed to be more concrete Buckle up let s go IntroductionIn React like in some other libraries the data flow is unidirectional going top down in the component tree It means that a parent component can configure a child component thanks to properties So in a sense a child can have access to an element of the parent when passed as property But a parent can t have access to an element of the child or so you think Note We can inverse the data flow by passing callback and value for example when controlling components If you want to expose a callback from the Child it can expose a register to register this callback function Child register useEffect gt const aFunction gt console log A function inside the FC register aFunction register return lt p gt Child lt p gt function Parent const childCallback useRef const register useCallback callback gt I use a ref but could be a state if needed to display JSX childCallback current callback return lt Child register register gt Well it works but it adds some boilerplate which is not the easiest to understand how it works It s time to go deep in the subject Warning You should not have to expose a state or variable from a child in this case you would have to change the API and put the state up Note If you want to know more about React state you can read my article Things you need to know about React state Some context with Class componentsFirstly I would like to talk about the behavior of ref with Class component Note If you want to know more about ref you can see my article Things you need to know about React ref When we pass a ref to a Class component then we get the React element instance class ClassComponent extends React Component aFunction gt console log A function inside the CC render return lt p gt A class component lt p gt function Parent const myRef useRef useEffect gt Will log the React element instance console log myRef current return lt ClassComponent ref myRef gt It will then log Thanks to that you can call imperatively any method of a Class component child from its parent thanks to the ref function Parent const myRef useRef return lt gt lt ClassComponent ref myRef gt lt button type button onClick gt myRef current aFunction gt Executes aFunction lt button gt lt gt Note Even if you have access to the render method do not call it Work with Functional componentsIf you try to do the same with a Functional child component you will get the log undefined function FunctionalComponent const aFunction gt console log A function inside the FC return lt p gt A functional component lt p gt const ForwardedRefFunctionalComponent React forwardRef FunctionalComponent function Parent const myRef useRef useEffect gt It will log undefined console log myRef current return lt ForwardedRefFunctionalComponent ref myRef gt Note We need to forwardRef with Functional component when customizing the reference named ref But you can pass a reference as an usual prop and customize it too without the need of forwardRef function FunctionalComponent aRef const aFunction gt console log A function inside the FC return lt p gt A functional component lt p gt function Parent const myRef useRef return lt ForwardedRefFunctionalComponent aRef myRef gt You probably have guessed it useImperativeHandle will help you to solve it The hook allows to expose some method of a child FC to its parent by customizing the passed reference How to use it Now that we have the purpose of this hook let s see how to use it It takes parameters the reference to customizethe APIs to expose as a callbackan optional array of dependencies when handler depends on state has the same behavior than useEffect array dependencyNote Like useEffect if you do not pass an array as third argument the API callback will be executed at each render useImperativeHandle ref createHandle deps For example with the the previous example it will be function FunctionalComponent props ref useImperativeHandle ref gt aFunction gt console log A function inside the FC return lt p gt A functional component lt p gt And now the log will be Amazing right Note You can also attach the ref to a DOM node not possible with Class component A use case exampleWell now that you know how to use the hook it s time to see a real use case where the component API is good and it s useful to use useImperativeHandle When displaying a list with a lot of elements for example like Twitter you can encounter some layout performances issues This is where virtualization comes in handy Basically only the elements displayed on the screen are present in the DOM with few element before and after which makes the DOM much lighter To do that you would make a component named VirtualizedList which will handle virtualization Behind the hood there are some calculations in function of the height of rows and handling position to know which rows need to be in the DOM and where they are displayed on the screen We would like to be able to scroll to a specific items in an imperative way It s the perfect use case for useImperativeHandle function VirtualizedList props ref useImperativeHandle ref gt scrollTo itemId gt Do some process return lt ul gt Right items to display lt ul gt ConclusionAlright now you have seen you can expose an API from a child to its parent but do not overused it Most of the time you will think you need it it s probably that the API of your component is not right It s possible to do it in Class components and in Functional components as well In FC do not forget to forwardRef otherwise it would not work Do not hesitate to comment and if you want to see more you can follow me on Twitter or go to my Website	2022-04-06 16:27:53
海外TECH	DEV Community	Ruby on Rails: Validation Errors	https://dev.to/opomeroy26/ruby-on-rails-validation-errors-3d3b	Ruby on Rails Validation Errors ValidationValidations are used in Rails to ensure the data saved to the database is valid It helps prevent any issues further further down the road Such as if a user were to fill out a form it s important they fill it out with valid data like confirming their phone number is digits long This will save a lot of debugging and headaches preventing that issue to persist until it s used There are a couple ways to check if the object is valid In rails validations are run before saving an active record object and if there are errors then it will not save If a user tries to input a phone number with digits the validation will recognize it is not valid and won t save the information in the data base giving the user an error message We can use valid or invalid to check this class Person lt ApplicationRecord validates phone presence true length minimum endWe can open an irb console session and test out the validity of our Person class by saving a new instance method irb gt Person create phone invalid gt trueirb gt Person create phone valid gt falseirb gt Person create phone valid gt truevalid will trigger the validations and return true if no errors were found and false if there are errors invalid is the opposite and will return true if there are errors and false if there aren t errors Validation ErrorsWe can run our own validations while writing our code to check the validity as we work After Active Record completes the validations any errors that may arise can be looked at through errors instance methods which will return the errors In order for an object to be valid the collection of errors must be empty after running the validation We ll go through errors collection to help us do this Errors Collectionerrors errors returns an instance of the class that contains the errors It allows us to further look into the different details of the error so we can attach other methods to the end of it Some common methods to pair with errors is message full messages to a alias and full messages for attribute irb gt person Person newirb gt person valid gt falseirb gt person errors message gt is too short minimum is characters irb gt person errors full messages gt Phone is too short minimum is characters irb gt person errors full messages for phone gt is too short minimum is characters irb gt person Person new phone irb gt person valid gt trueirb gt person errors full messages gt errors To verify a particular attribute of the object we can run errors attribute It will return an array of error message strings for that particular attribute and if there are no errors it will return empty irb gt person Person new phone irb gt person valid gt falseirb gt person errors phone gt is too short minimum is characters irb gt person Person new phone irb gt person valid gt trueirb gt person errors name gt errors where returns an array of error objects We use this compared to errors when we want more information than just the message From the objects you can then look further into it to get more information irb gt person Person newirb gt person valid gt falseirb gt person errors where phone gt all errors for phone attribute Both presence and length errorsirb gt person errors where phone too short gt too short errors for phone attributeirb gt person errors where phone first attribute gt nameirb gt person errors where phone first type gt too shortirb gt person errors where phone first options count gt errors add creates the error object by taking an attribute an error type and additional options hash These are helpful if you are creating your own validatorsclass Person lt ApplicationRecord validate do person errors add phone too long message has too many numbers endendirb gt person Person createirb gt person errors where phone first type gt too longirb gt person errors where phone first full message gt Phone has too many numberserrors base can add errors to the objects state as a whole instead of being related to a specific attribute as with errors add Also good for when you are writing your own validations class Person lt ApplicationRecord validate do person errors add base invalid message This phone number is invalid because endendirb gt person Person createirb gt person errors where base first full message gt This phone number is invalid because errors clear used when you intentionally want to clear the errors collection It doesn t actually make the object valid though the errors collection will be empty but next time you save or validate that method the validations will run again irb gt person Person newirb gt person valid gt falseirb gt person errors empty gt falseirb gt person errors clearirb gt person errors empty gt trueerrors size returns the total number of errors for the object irb gt person Person newirb gt person valid gt falseirb gt person errors size gt phone does not exist and is less than minimum length irb gt person Person new phone irb gt person valid gt falseirb gt person errors size gt phone exists but below minimum length Errors in relation to custom methodsWe can add errors to our collection when they are invalid We can conditionally render out errors validate phone cannot be more than numberdef phone cannot be more than number if phone present amp amp phone length gt errors add phone number is too long When added to custom methods it will run every time you call valid or save the object unless we give it an on option to validate the method with either create or update Sources custom methods method i messages working with validation errors	2022-04-06 16:27:27
海外TECH	DEV Community	Acra. Features: Security events automation	https://dev.to/cossacklabs/acra-features-security-events-automation-1bio	Acra Features Security events automationWe designed Acra to be a single tool that solves your data security vital needs Also we kept in mind that security requires not only monitoring and alerting but also reaction on possible incidents With Acra your security job can be easier Use Acra Community Edition for free Check out Acra Enterprise Edition tailored for solutions with high security requirements ️⃣Security events automationBeing a gateway for data protection Acra provides multiple ways to automate security reactions and decrease MTTD amp MTTR Observe monitor and automate one product instead of multiple ️Acra s security log is specifically pre configured to be helpful to SIEM SOC operators to build analytics and automation around security events ️Acra s cryptographically signed audit log is designed to be verifiable no one can simply change add or remove log messages without notice Automate log verification procedure and alert SOC engineers in case logs couldn t be verified ️Poison records raise security alarms once they go through Acra Generate poison records via Acra and put them into the database to the columns tables fields that authenticated apps shouldn t read If a malicious app or SQL injection reads these records Acra catches them and triggers a reaction Configure reactionsーerror response fake data response or even shutdown of the whole Acra cluster ️Configure Acra CensorーSQL firewallーto deny SQL queries reading specific tables columns or based on flexible rules Setup monitoring on Acra Censor s events to alert your engineers right away of someone knocking at your door As you see Acra features cover different risks and threats while supporting each other in their mission This multi layered design allows you to turn your databases into real strongholds See what other features work for your peace of mind in Acra	2022-04-06 16:14:29
Apple	AppleInsider - Frontpage News	GoPro Volta: The new must-have action cam accessory	https://appleinsider.com/articles/22/04/06/gopro-volta-the-new-must-have-action-cam-accessory?utm_medium=rss	GoPro Volta The new must have action cam accessoryThe new GoPro Volta packs a ton of functionality into this handheld GoPro grip ーincluding a tripod remote and extra battery life for your ultimate shooting setup The new GoPro VoltaGoPro s lineup of action cam accessories has continued to expand with plenty of mounts mods and attachments that can help tailor the filming experience for each user Its latest in house accessory is Volta which combines multiple accessories into one great piece of tech Read more	2022-04-06 16:35:11
Apple	AppleInsider - Frontpage News	Deals: Apple's 16-inch MacBook Pro is on sale for $2,299 and in stock, plus every upgraded model is up to $300 off	https://appleinsider.com/articles/22/04/06/deals-apples-16-inch-macbook-pro-is-on-sale-for-2299-and-in-stock-plus-every-upgraded-model-is-up-to-300-off?utm_medium=rss	Deals Apple x s inch MacBook Pro is on sale for and in stock plus every upgraded model is up to offForget a month long wait when ordering the standard inch MacBook Pro from Apple directly Apple Authorized Reseller Adorama has the M Pro model in stock right now for off Plus upgraded models are up to off and AppleCare is another off with coupon inch MacBook Pro models are in stock with deals in effect todayTo activate the MacBook Pro deals you must shop through this activation link and enter promo code APINSIDER during checkout We ve included step by step instructions below as well as on this help page Read more	2022-04-06 16:10:26
Cisco	Cisco Blog	The Launchpad 🚀 – Kickstart Your Learning Journey – Part 1	https://blogs.cisco.com/learning/the-launchpad-kickstart-your-learning-journey-part-1	The Launchpad Kickstart Your Learning Journey Part In the first part of the Launchpad Series learn how to demonstrate proficiency in Infrastructure as Code pertaining to the DevNet Expert certification blueprint domain	2022-04-06 16:01:00
Cisco	Cisco Blog	Securing digital manufacturing—from a vicious to a virtuous circle	https://blogs.cisco.com/internet-of-things/securing-digital-manufacturing-from-a-vicious-to-a-virtuous-circle	efficient	2022-04-06 16:00:42
海外TECH	WIRED	Elon Musk Is on Twitter's Board. What Could Go Wrong?	https://www.wired.com/story/elon-musk-twitter-board-future	appointment	2022-04-06 16:13:44
金融	金融庁ホームページ	中央銀行総裁・銀行監督当局長官グループの新議長選任に関するプレス・リリースついて掲載しました。	https://www.fsa.go.jp/inter/bis/20220406/20220406.html	中央銀行	2022-04-06 17:00:00
金融	金融庁ホームページ	鈴木財務大臣兼内閣府特命担当大臣閣議後記者会見の概要（令和４年４月５日）を公表しました。	https://www.fsa.go.jp/common/conference/minister/2022a/20220405-1.html	内閣府特命担当大臣	2022-04-06 17:00:00
ニュース	ジェトロ ビジネスニュース（通商弘報）	大統領選世論調査、決選投票については左派候補と中道右派候補が接戦	https://www.jetro.go.jp/biznews/2022/04/15ba45c277f36236.html	世論調査	2022-04-06 16:40:00
ニュース	ジェトロ ビジネスニュース（通商弘報）	チュニジア、サイード大統領が議会を解散	https://www.jetro.go.jp/biznews/2022/04/a2a784c600f452a0.html	議会	2022-04-06 16:30:00
ニュース	ジェトロ ビジネスニュース（通商弘報）	地場系EC企業「ロコマリ」、書籍販売・購入のオンライン化が進展	https://www.jetro.go.jp/biznews/2022/04/719654366033db45.html	購入	2022-04-06 16:20:00
ニュース	ジェトロ ビジネスニュース（通商弘報）	経済・気候保護省、全固体電池の実用化プロジェクトを助成	https://www.jetro.go.jp/biznews/2022/04/cc2b1b0ef08cc6d4.html	全固体電池	2022-04-06 16:10:00
ニュース	BBC News - Home	Ukraine war: Bucha deaths 'not far short of genocide' - PM	https://www.bbc.co.uk/news/uk-61011022?at_medium=RSS&at_campaign=KARANGA	bucha	2022-04-06 16:42:37
ニュース	BBC News - Home	British embassy guard charged with spying for Russia	https://www.bbc.co.uk/news/uk-61015772?at_medium=RSS&at_campaign=KARANGA	secrets	2022-04-06 16:38:53
ニュース	BBC News - Home	Families in Nottingham maternity inquiry hit out at review	https://www.bbc.co.uk/news/uk-england-nottinghamshire-61006743?at_medium=RSS&at_campaign=KARANGA	nottingham	2022-04-06 16:03:24
GCP	Cloud Blog	Google's subsea fiber optics, explained	https://cloud.google.com/blog/topics/developers-practitioners/googles-subsea-fiber-optics-explained/	Google x s subsea fiber optics explainedFiber optic networks are a foundation of the modern internet In fact subsea cables carry of international network traffic and yet we are barely aware that they exist What you might not know is that the first subsea cable was deployed in for telegraph messages between Europe and North America A message took over hours to deliver at minutes and seconds per letter by Morse code  Today a single cable can deliver a whopping Tbps capacity that s more than million times faster than the average home internet connection Over the years at Google we have worked with partners around the world to engineer more capacity into the fiber optics that can be underground or laid at the bottom of the ocean It takes an impressive combination of physics marine technology and engineering which is why I set out to make a video about what it takes to plan and implement a global network in a world of ballooning network demand When I started making this video there were a few questions that I wanted to answer After hours of researchーfrom interviewing optical network engineers to exploring our network design documentsーI finally started to scratch the surface of a sea of information so let s dive into my findings puns intended How does Google Cloud predict network traffic and plan for capacity Physical infrastructure permitting identifying power sources and installing cooling and hardware The entire process for one project can take multiple years to plan and implement As a result capacity planning must be done far in advance It s difficult to predict capacity needs a typical trend line analysis won t work Given these long lead times and a year typical life of a cable our forecasting and asset acquisition decision analysis looks at demand forecasts across a longer time horizon of multiple years rather than months  One factor is certain Cloud is a big growth driver of Google s network demand with Gartner predicting the world s cloud spending to increase to B by Google Cloud has pushed our need to increase the availability and speed of our network and services We need to handle traffic surges that can stem from Google Cloud customers We also need to plan for higher network capacity when we add new regions with redundant pathways to those new locations Because our Global Networking team wants to deliver capacity when Google Cloud customers need it we design our network with reliability in mind consider multiple points of failure and provide fast failover  Forecasting in partsTo forecast capacity needs we predict demand five years out three years out and months out using sensitivity analyses We then determine the size of the cable investment that meets an optimal point on the cost curve one that balances capacity and cost while meeting Google Cloud requirements like latency To help with forecasting we break our network down into three categories Inter metro network pathways connecting major metropolitan areas both within a continent and across continents  Regional pathways connecting data centers within a metropolitan regionEdge pathways connecting Google s network to internet service providers ISPs Engineering teams are obsessed with network resilience Dozens of engineering teams work to forecast and design the network They determine The bandwidth needs of individual Google services for example a Google Cloud service Search YouTube  The shape of the network topology to optimize for performance how various nodes devices and connections are physically or logically arranged in relation to each other  The number of routes that is the number of circuits to each location needed for high availability We look for routes that are fully disjointed and diverse to prevent any single points of failure  Testing optical fiber to improve capacity planningThe Optical Network Engineering team tests our fiber optic cables to understand how they will perform in the Google Cloud network These tests play a significant role in capacity planning because the results help us predict what we can deliver The goal is to achieve the highest signal to noise ratio As light travels through fiber over long distances the signal it carries gets distorted While we can t house an entire cable in a lab we do have dozens of spools of fiber that we daisy chain together to replicate the Google Cloud network Using an optical spectrum analyzer we check the quality of the signal as we pulse lasers pushing Tbps of s and s through the cable  But fiber is not just about lasers cables and the laws of physics Our response to changes and issues in hardware requires robust automation through software We build automation pipelines to enable us to deploy new fiber to connect our regions If there are disruptions in the fiber automation enables us to pinpoint the issue with an accuracy of a few meters and respond rapidly  What technology have we developed to increase the reliability and scale of the network Space Division MultiplexingThe Grace Hopper cable is breaking records by using space division multiplexing SDM to fit sixteen fiber pairs into the instead of the usual six or eight Once delivered that cable will be able to transmit Tbps enough to stream my video in K million times simultaneously SDM increases cable capacity in a cost effective manner with additional fiber pairs while taking advantage of power optimized repeater designs With the Topaz cable we are working with partners to use SDM technology and sixteen fiber pairs to give it a design capacity of  Tbps The th century electrochemical scientist Michael Faraday would be proud of us knowing that we could send over trillion bits every second across the Pacific Ocean in a single cable Wavelength Selective SwitchingTopaz will also use wavelength selective switching WSS WSS can be used to dynamically route signals between optical fibers based on wavelength This greatly simplifies the allocation of capacity giving the cable system the flexibility to add and reallocate it in different locations as needed Here s how it works Branching Units are used to split a portion of the cable to land at a different location Branching can be either at the fiber pair or wavelength level  WSS splits the signal between the main trunk and the branch path based on its wavelength This allows the signals from different paths to share the same fiber instead of installing dedicated fiber pairs for each link The cable system can then carve up the spectrum on an optical fiber pair and apply capacity to different locations using a single fiber pair giving us the ability to redirect traffic on the fly WSS for resilient and dynamic paths was first sketched on a Google whiteboard over four years ago Now this innovation is being adopted across the industry  Why is it so rare for Google Cloud customers to notice when a cable is affected  While fiber optic cables are protected they aren t immune to damage Fishing vessels and ships dragging anchors account for two thirds of all subsea cable faults  Though the risks are unavoidable it s important to remember that fiber optic cables are part of the network backbone of the internet that links data centers and thousands of computers together That s why Google maintains an intense focus on building and operating a resilient global network while we continue to advance its breadth reliability and availability For example it can sometimes take weeks to repair a cable that has been physically damaged So to ensure that services aren t affected in such a situation we design the network with extra capacity each cross section has multiple cables and no single point of failure  Our philosophy is to create enough concurrent network paths at the metro regional and global levelーcoupled with a scalable software control planeーto support traffic redistribution while minimizing network congestion When service disruptions occur we re still able to serve people around the world because other network paths exist to reroute traffic seamlessly When a link between the US and Chile becomes disrupted for example Google Cloud can reroute traffic for customers on our additional diverse paths  How can Google Cloud customers make the most of these advancements Network planning operations and monitoring are linchpins at Google Premium Tier network is the gateway to Google s high speed networkTo understand the Google Cloud network backbone it is useful to have an understanding of how the public internet works Dozens of large ISPs interconnect at network access points in various cities The typical agreement between providers involves something called hot potato routing An ISP hands off traffic to a downstream ISP as quickly as it can to minimize the amount of work that the ISP s network needs to do This can mean more hops between networks and routers before traffic arrives at its destination This kind of routing is available on Google Cloud with our Standard Tier network Click to enlargeGoogle Cloud s Premium Tier network in contrast uses cold potato routing It keeps traffic on its private network backbone requiring fewer hops between ISPs It offloads traffic to ISPs at the last possible moment when the data is closest to the end user  Click to enlargeLet s put this in perspective with an example If you re a company using traditional networks your traffic from your own private data center in the US to its destination in Chile will first traverse your local ISP That local ISP most likely uses a fiber supplier and passes that traffic off to another ISP Between the many hot potato hops you may face higher latency and limited bandwidth capacity  With Google Cloud you can use our Premium Tier network to achieve X higher throughput than the Standard Tier as well as Cloud CDN to cache content closest to your end users  The beauty of vertical integrationLet s not forget the software stack that sits on top of the physical network The network topology and software defined controller for traffic routing is built for fault tolerance Our data center network fabric is made up of a closed hierarchical switching fabric that we designed called Jupiter which connects hundreds of thousands of machines across data centers providing Pbps of bisection bandwidth Jupiter is able to provide such high bandwidth because it s nonblocking which means it can handle routing a request to any free output port without interfering with other traffic This means it can scale or burst with extremely low latency and is fault tolerant If something in the fabric breaks it is built to handle disruptions Google Cloud is underpinned by Andromeda a virtualized software defined network built on top of Jupiter giving you your very own slice of our massive global switching fabric Andromeda enables you to deploy a global virtual private cloud network with the aim of providing you both functional and performance isolation as well as a high degree of security With its global control plane high speed on host virtual switch and packet processors you can burst thousands of stateful machines online in minutes or deploy firewall rules across thousands of machines immediately without chokepoints Google Cloud s global Virtual Private Cloud VPC for example gives you the ability to have a single VPC that can span multiple regions without communicating across the public internet Because various microservices may be separated and talk to each other through the network they can scale independently so you get virtually unlimited storage and stateless resilient compute along with features like live migration Whether you re processing petabytes of data in seconds using BigQuery running consistent databases across regions using Spanner or autoscaling GKE clusters across zones Google s global network backbone provides the capacity to get the job done  It s been a great journey to deep dive into how Google plans and builds its fiber optic cable network Every engineer project manager and public policy expert I talked to exuded a passion to extend the global connectivity of the internet to the entire world with Google Cloud being a major catalyst in this endeavor  Be sure to check out more ways to catch a ride on the Google Cloud Premium Tier network Interested in championing Google Cloud technology with a chance to access exclusive events Join Google Cloud Innovators  Have thoughts about this article Give me a shout stephr wong Related ArticleIntroducing Topaz ーthe first subsea cable to connect Canada and AsiaThe Topaz subsea cable is the first fiber cable to connect Canada and Asia and will provide better resiliency and lower latency for Goog Read Article	2022-04-06 17:00:00