投稿時間:2022-08-20 04:24:34 RSSフィード2022-08-20 04:00 分まとめ(27件)

カテゴリー等 サイト名等 記事タイトル・トレンドワード等 リンクURL 頻出ワード・要約等/検索ボリューム 登録日
AWS AWS Architecture Blog Sequence Diagrams enrich your understanding of distributed architectures https://aws.amazon.com/blogs/architecture/sequence-diagrams-enrich-your-understanding-of-distributed-architectures/ Sequence Diagrams enrich your understanding of distributed architecturesArchitecture diagrams visually communicate and document the high level design of a solution As the level of detail increases so does the diagram s size density and layout complexity Using Sequence Diagrams you can explore additional usage scenarios and enrich your understanding of the distributed architecture while continuing to communicate visually This post takes a sample architecture … 2022-08-19 18:37:47
AWS AWS Machine Learning Blog Best practices for TensorFlow 1.x acceleration training on Amazon SageMaker https://aws.amazon.com/blogs/machine-learning/best-practices-for-tensorflow-1-x-acceleration-training-on-amazon-sagemaker/ Best practices for TensorFlow x acceleration training on Amazon SageMakerToday a lot of customers are using TensorFlow to train deep learning models for their clickthrough rate in advertising and personalization recommendations in ecommerce As the behavior of their clients change they can accumulate large amounts of new data every day Model iteration is one of a data scientist s daily jobs but they face the … 2022-08-19 18:08:36
海外TECH Ars Technica Botometer creator says Musk’s Twitter spam estimate “doesn’t mean anything” https://arstechnica.com/?p=1874991 botometer 2022-08-19 18:05:48
海外TECH MakeUseOf The 4 Best Memoji Apps on Android to Make Your Own Memoji https://www.makeuseof.com/tag/get-memoji-android/ android 2022-08-19 18:45:14
海外TECH MakeUseOf The 8 Best Linux Screen Recording Apps to Capture Your Screen https://www.makeuseof.com/best-linux-screen-recording-apps/ quality 2022-08-19 18:30:14
海外TECH MakeUseOf The 5 Best Clock Widgets for Windows https://www.makeuseof.com/windows-best-clock-widgets/ windows 2022-08-19 18:16:14
海外TECH DEV Community Building infrastructure for an open-source programmable zapier https://dev.to/tonyhb/building-infrastructure-for-an-open-source-programmable-zapier-36cf Building infrastructure for an open source programmable zapierHi community Looking forward to hearing your thoughts about this Inngest was started out of the pain of building products that required complex integrations and background jobs ーespecially those driven by user interactivity We ve built the infrastructure so many times that we decided to open source it for other people ーso that everyone can have access to world class tooling instead of just MANGA We ve created a single API that lets you record what s happening in your app then lets you run serverless functions in response to these events It s a developer s Zapier It s more than a job queue or serverlessFrom our past experience we know that building out reliable products requires more than a job queue Kafka or Lambda and off the shelf products don t cut it for the customization us developers need We believe that it should be accessible to everyone ーnot just B companies who have hundreds of people to configure and maintain infra Even for something as basic as reliably handling a webhook you ll need some sort of queue retries and logging which can take weeks to build even with off the shelf systems in clouds Here s our plan to give this to everyone from jamstack APIs all the way to realtime elixir webapps Event driven infrastructure foundationsUsing a single API to record what s happening in your app provides rich functionality like Running step functions in real time whenever specific things happen automatically This includes off the shelf repeatable functions like sending emails forwarding events to analytics or common APIs Historic replay and retries ー by saving events we allow you to replay and retry past data locally on your own machine if there are errors or retry your functions if there are errors Personalized debugging ー when your users do things in your app you can assign the events that are generated to that user This lets you see every function that ran for each of your users making debugging and insight super easyCoding best practices Sending an event describing what s happening then reacting to the event reduces coupling and makes your critical path faster No servers or job queues You can make everything serverless by scheduling functions to run in the future when an event comes in making your app entirely serverlessMonitoring and visibility allowing you to see what s happening in your app and the functions that are runningComplex coordinated functionality such as “on cart added wait hours for the checkout event ーand only run the next step if the user didn t check out This is annoying to build manually and usually requires complex cron jobs messy database state or external expensive services like braze com Local development firstWe also think that local development should be a first class part of the process without spending days installing and configuring services locally The open source CLI already does the following Makes it easy to create functions in any language either from a blank slate or using quick starts for common use casesLocally run functions with a single command ーusing the same execution engine deployed to your cloud with a single command This makes sure you have local lt gt production parityStart a fully functional local test environment in a single command ーwhich accepts events then runs functions locallyCI CD out of the box using things like github actionsReplay real production events locally for debugging amp testing We want everyone to have world class infrastructure to build the complex parts of their app ーthe stuff that s beyond basic API routes This includes things you d only dream of at fortune s serverless functions event schema generation event and function versioning blue green deploys throttling idempotency and local debugging Even for basic use cases like handling webhooks this makes your life far easier And we want this for everyone available locally with the source freely available to hack on Status amp next stepsWe ve already got our execution engine and CLI that does the above We re planning webassembly support step over debuggers and a ton more What would you like to see Do you have job queues or events in your system What would your ideal programmable zapier do Feel free to comment here or on Github at 2022-08-19 18:30:00
海外TECH DEV Community Build fast React Native apps with AWS Amplify https://dev.to/codebeast/build-fast-react-native-apps-with-aws-amplify-12ga Build fast React Native apps with AWS Amplify OverviewIn this article we will be building a mobile application with React Native using Expo SQLite adapter as a storage adapter for DataStore By the end of the of article you will be able to build a contact app using the SQLite adapter for storage as shown in the video below Expo enables developers to create hybrid JavaScript applications from the comfort of their terminals Expo has an adapter that gives your app access to a database that can be queried through a WebSQL like API called expo sqlite The database is persisted across restarts of your app Datastore allows you to interact with your data offline first and it has a sync engine behind the scenes to send data to the backend DataStore provides a model for using distributed or shared data without writing any additional code for implementing online and offline states This programming model ensures that working with distributed or shared data is as easy as working with local data DataStore provides data modeling using GraphQL and converts it to models that you can use in building JavaScript Android iOS and Flutter applications With DataStore at runtime models are passed into a Storage Engine that has a Storage Adapter Amplify ships with default Storage Adapter implementations such as SQLite and IndexedDB Pre requisitesNodejs ≥v installedKnowledge of JavaScript and ReactAWS Amplify CLI installednpm install g aws amplify cliAWS Amplify configuredamplify configureExpo CLI installednpm install g expo cliExpo Go installed from your mobile playstore Building the React Native app with Expo SQLite and DatastoreLet s get started by initializing a new Expo app Run this command on your terminalexpo init ReactAmplifyDataStoreExpoThis will create a new React Native application Change directory and initialize amplify on the directory with these commandscd AmplifyDataStoreExponpx amplify app latest Installing DependenciesNext install the following dependencies with expoexpo install aws amplify aws amplify datastore storage adapter expo sqlite expo file system react native community netinfo react native async storage async storageaws amplify this package will enable us to build our AWS cloud enabled mobile application aws amplify datastore storage adapter this is the SQLite storage adapter for Amplify Datastoreexpo sqlite this package gives the app access to a database that can be queried through a WebSQL like API expo file system This package provides access to the local file system on the device react native community netinfo this package is the React Native Network Info API for Android iOS macOS Windows amp Web It allows you to get information on Connection type and Connection quality react native async storage async storage This is an asynchronous unencrypted persistent key value storage system for React Native Next we go on to create the model for our application Generating model with AmplifyThe first step to building an app backed by datastore is by defining a schema The schema contains data types and relationships that represent the app s functionality In our app we will create a schema for a simple contact application Head over to amplify backend api schema graphql delete the content and add these lines of code type Contact model id ID name String phone String email String Here our Contact model has id name phone and email as properties Let s now go ahead to create the graphql generated schema and models Run this command on your terminalnpm run amplify modelgenThis will create an src models folder with the model and graphql schema We are making progress Next we initialize the amplify backend Run this command on your terminal amplify init Enter a name for the environment dev Choose your default editor Visual Studio CodeUsing default provider awscloudformation Select the authentication method you want to use AWS profileThis will also create an aws exports js in the src directory Awesome Next we go ahead to deploy the amplify backend to the cloud Run this command to do that amplify pushFor this option Do you want to generate code for your newly created GraphQL API No choose No We are choosing no here because we ll be using the datastore API This will take some time to deploy depending on your network speed Importing DependenciesNavigate to App js delete the content and add these lines of code import DataStore from aws amplify import ExpoSQLiteAdapter from aws amplify datastore storage adapter ExpoSQLiteAdapter import Amplify from aws amplify core import config from src aws exports import React useState useEffect from react import Text View TextInput Button from react native import Contact from src models Here we imported DataStore from amplify we also got the ExpoSQLiteAdapter from amplify datastore storage adapter package and the Contact model from models Configuring Amplify and DataStore with ExpoSQLiteAdapterNext add these lines of code to App js Amplify configure config DataStore configure storageAdapter ExpoSQLiteAdapter Here we configure Amplify with config from aws exports and then we set ExpoSQLiteAdapter as the storageAdapter for Datastore Let s move on Implementing UI Inputs App js const initialState name email phone function App return lt View style container gt lt Text style heading gt My Contacts lt Text gt lt TextInput onChangeText v gt onChangeText name v placeholder Contact name value formState name style input gt lt TextInput onChangeText v gt onChangeText email v placeholder Contact email value formState email style input gt lt TextInput onChangeText v gt onChangeText phone v placeholder Contact phone value formState phone style input gt lt Button onPress createContact title Create Contact gt lt View gt Here we start by setting the initial state of the input fields We also have TextInput fields and a Button that invokes the createContact function onPress Let s go ahead and create the createContact function Implementing Create Contact FunctionalityAdd these lines of code to App jsconst formState updateFormState useState initialState async function createContact if formState name amp amp formState email amp amp formState phone return await DataStore save new Contact formState updateFormState initialState Then we have two state variables the first formState will get the values of the input fields and updateFormState will update the state when the onChangeText event is triggered Next we have a createContact function First we have a condition that validates if the name email and phone fields are empty if they are the function returns false else we go on to save the field values to Datastore Implementing View Contact FunctionalityAdd these lines of code to App js const contacts updateContacts useState async function fetchContacts const contacts await DataStore query Contact updateContacts contacts The other variable is an array that holds the contacts we will be fetching from DataStore Next we have a fetchContacts function that queries the Contact model and then we update the contacts array contacts map contact gt lt View key contact id gt lt View style contactBg gt lt Text style contactText gt Name contact name lt Text gt lt Text style contactText gt Email contact email lt Text gt lt Text style contactText gt Phone contact phone lt Text gt lt View gt lt View gt Here we mapped through the contacts array to render the contact name email and phone Implementing onChangeText functionalityAdd these lines of code to App jsfunction onChangeText key value updateFormState formState key value When the onChangeText event is triggered the formState is updated with the field values Implementing Subscriptions with DataStoreAdd these lines of code to App jsuseEffect gt fetchContacts const subscription DataStore observe Contact subscribe gt fetchContacts return gt subscription unsubscribe Finally we have a useEffect where we call the fetchContacts and then we do something interesting We create a graphql subscription with Datastore So if you re updating the contacts on the web or iOS app or Android you can see those updates in real time Awesome Adding some StylesWe should go ahead to add the styles Add the lines of code to the bottom of the codebase in App jsconst container padding paddingTop const input marginBottom padding backgroundColor ddd const heading fontWeight normal fontSize const contactBg backgroundColor white const contactText margin padding fontSize export default AppAwesome Now let s go ahead and run the app Run this command on your terminal expo startYou should have something like this in the terminal➜ReactAmplifyDataStoreExpo git master ✗expo startThis command is being executed with the global Expo CLI To use the local CLI instead recommended in SDK and higher run ›npx expo startStarting project at Users mac Desktop sammy ReactAmplifyDataStoreExpoStarting Metro Bundler▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄█▄▄▄▄▄█▀▄█▀█▄▄▄▄▄█████▄▄██▀▀██████▄▄▄██▀█▀█▄▀███▄▄▄███▄▄▄▄▄▄▄█▀▄██▄▀█▄▄▄▄▄▄▄██▄▄▀█▀▄▄██▀▄▀██▀▄▀▄▄▀██▄▄▀▄▀▄▀▄▄▄█▄▀▄▄▀▀▀█▄▄██▄▄▄█▄▄██▀██▄█▀█▄███▀██▄▀██▀█▄█▄█▄▀██▄▄▀▀██▄██▄▄██▄▄▄▄▀▀██▄▄▄▄█▄██▄▄▄▄▄█▄▄▀▀▄▄▄█▄█▀▄█████▀▀▄█▀▀▄▄▄█▀▄████▄▄▄██▀▄██▄██▄▄█▄██▄▄▄▄▄▄▄█▄██▄█▄▄█▄███▄▄█▄▄█›Metro waiting on exp ›Scan the QR code above with Expo Go Android or the Camera app iOS ›Press a │open Android›Press i │open iOS simulator›Press w │open web›Press r │reload app›Press m │toggle menu›Press │show all commandsLogs for your project will appear below Press Ctrl C to exit Started Metro BundlerNow launch the Expo Go app on your mobile and scan the QR code You should have something like this Awesome you can go ahead to installnpm i react native web react domThis will enable viewing the app on your web browser ConclusionAmplify DataStore allows you to start persisting data locally to your device with DataStore even without an AWS account In this article we learned about Expo SQLite and we went on to build a React native app with Expo SQLite adapter and AWS Amplify DataStore 2022-08-19 18:20:11
Apple AppleInsider - Frontpage News Controversial Apple-1 said to be owned by Steve Jobs sells for small fortune https://appleinsider.com/articles/22/08/19/controversial-apple-1-said-to-be-owned-by-steve-jobs-sells-for-small-fortune?utm_medium=rss Controversial Apple said to be owned by Steve Jobs sells for small fortuneA rare Apple prototype said to be personally owned by Steve Jobs has sold at auction for big money according to auction house RR Auction Credit RR AuctionThe Apple computer hit the auction block in late July with bidding coming to a close on Aug It was expected to fetch at least Read more 2022-08-19 18:56:08
海外TECH Engadget Instagram is fixing an audio bug that happened when users exported their Reels https://www.engadget.com/meta-denies-trying-to-stop-users-from-sharing-reels-to-tik-tok-audio-glitch-184557837.html?src=rss Instagram is fixing an audio bug that happened when users exported their ReelsMeta is denying that it purposely muted the audio of downloaded Reels videos to keep users from exporting them to TikTok The Vergereported A company spokesperson blamed an “audio glitch for the incident and said it s in the process of being fixed The outlet reported earlier this week that users who wanted to export their Reels onto another app cough cough TikTok were forced to publish the video first ーor risk losing its audio Prior to this development Instagram users could film and edit a video using Reels tools and opt to download and publish it elsewhere Although Meta is hoping to position Reels as the future of Instagram and Facebook it has struggled to take the crown from the reigning short form video app TikTok Creators and brands often cross post Reels onto their TikTok accounts or vice versa meaning that Instagram and Facebook are no longer exclusive destinations for that content TikTok gives users the ability to easily cross post videos made on the platform to Facebook and Instagram Reels but doing the reverse on the Meta owned platforms requires manually downloading the video first Reels and TikTok have different editing tools so it s easy to see why a user may want to edit in one specific platform and cross post ーnot to mention that it simply saves time Meta is still working on fixing the audio glitch on Reels as of Friday afternoon a spokesperson told Engadget in an email The glitch appears to only impact iPhone users “Due to a bug the Reels download feature is not working as intended for iOS users and in some cases audio is missing in downloads ーwe re working to fix the issue as soon as possible quot the company said in its statement nbsp 2022-08-19 18:45:57
海外TECH Engadget HBO Max has yanked 200 episodes of 'Sesame Street' https://www.engadget.com/hbo-max-sesame-street-cost-cutting-183844638.html?src=rss HBO Max has yanked episodes of x Sesame Street x It s a little jarring to consider what s happening over at HBO Max a bloodbath in the context of Sesame Street but that s exactly what s going on at the streaming platform right now The platform has removed around old episodes of the classic preschooler show as Variety reports All episodes from seasons are still available along with a selection from the first fifth and seventh seasons There are Sesame Street episodes on HBO Max right now but it offered around episodes not too long ago HBO landed an exclusive deal back in to broadcast new episodes of the show before they aired on PBS HBO Max will be the place to catch new Sesame Street episodes through at least but good luck trying to find old episodes there The platform yanked the Sesame Street episodes in the same week it removed dozens of other shows including original series such as animated programs While it s common for titles to cycle in and out of streaming services it s rare to see exclusives going away That s becoming increasingly par for the course at HBO Max Parent company Warner Bros Discovery said it nixed those shows ahead of HBO Max merging with Discovery next year “As we work toward bringing our content catalogs together under one platform we will be making changes to the content offering available on both HBO Max and Discovery That will include the removal of some content from both platforms quot it said Since the merger of WarnerMedia and Discovery earlier this year Warner Bros Discovery has been on a brutal cost cutting drive It laid off dozens of HBO and HBO Max production staffers this week The company recently removed some other original films and shows from HBO Max ーincluding An American Pickle HBO show Vinyl and the remake of The Witches ーreportedly to avoid paying residuals on them nbsp It also canceled HBO Max exclusive movies Batgirl and Scoob Holiday Haunt which were almost completed Reports suggest it did so to claim tax write downs on the projects 2022-08-19 18:38:44
海外TECH The Apache Software Foundation Blog The Apache News Round-up: week ending 19 August 2022 https://blogs.apache.org/foundation/entry/the-apache-news-round-up268 The Apache News Round up week ending August Happy Friday everyone let s review the Apache community s activities from over the past week ApacheCon the ASF s official global conference series bringing Tomorrow s Technology Today since Registrations are open for ApacheCon North America ASF Board management and oversight of the business affairs of the corporation in accordance with the Foundation s bylaws Next Board Meeting September Running Board calendar and minutes are available ASF Infrastructure our distributed team on three continents keeps the ASF s infrastructure running around the clock M weekly checks yield uptime at Performance checks across different service components spread over more than machines in data centers around the world View the ASF s Infrastructure Uptime site to see the most recent averages Apache Code Snapshot Over the past week Apache Committers and contributors changed lines of code over commits Top five contributors in order are Robbie Gemmell Ephraim Anierobi Jean Baptiste Onofré Sebastian Rühl and Gary Gregory Apache Project Announcements the latest updates by category Content Apache Jackrabbit releasedApache OpenOffice releasedCVE Static Initialization Vector Allows to Recover Passwords for Web Connections Without Knowing the Master PasswordCVE Weak Master KeysIdentity Management Apache LDAP API releasedIntegration Apache Camel LTS releasedMessaging Apache Qpid proton dotnet M releasedServers Apache Tomcat releasedSearch Apache Solr Operator v releasedWorkflow Apache DolphinScheduler releasedNew Apache Airflow Providers releasedApache Community NoticesApache in By The Digits Video highlightsThe Apache Way to Sustainable Open Source SuccessFoundation Reports and StatementsPresentations from s ApacheCon Asia and ApacheCon Home are available on the ASF YouTube channel “Success at Apache focuses on the people and processes behind why the ASF “just works Follow the ASF on social media TheASF on Twitter and The ASF page LinkedIn Follow the Apache Community on Facebook and Twitter Are your software solutions Powered by Apache Download amp use our “Powered By logos Stay updated about The ASFFor real time updates sign up for Apache related news by sending mail to announce subscribe apache org and follow TheASF on Twitter For a broader spectrum from the Apache community Planet Apache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers Have an item Contact us We try to catch all the major announcements and goings on at The ASF but we re not all knowing Have an item you want to see in the weekly round up Send it to press apache org 2022-08-19 18:09:56
海外科学 NYT > Science Brain-Eating Amoeba Caused Nebraska Child’s Death, Health Officials Say https://www.nytimes.com/2022/08/18/science/brain-eating-amoeba-death-nebraska.html federal 2022-08-19 18:07:43
海外TECH WIRED Final Fantasy Is ‘Struggling.’ Where Does the Series Go From Here? https://www.wired.com/story/why-is-final-fantasy-bad-yoshida-struggling/ naoki 2022-08-19 18:16:17
ニュース BBC News - Home Elshafee El Sheikh: Ex-Briton 'Isis Beatle' sentenced to life in prison https://www.bbc.co.uk/news/world-us-canada-62609217?at_medium=RSS&at_campaign=KARANGA group 2022-08-19 18:13:34
ニュース BBC News - Home Mobility scooter death: Family's shock at 'horrendous' stabbing https://www.bbc.co.uk/news/uk-england-london-62605947?at_medium=RSS&at_campaign=KARANGA london 2022-08-19 18:27:40
ニュース BBC News - Home Al-Shabab: Islamist militants attack hotel in Somali capital https://www.bbc.co.uk/news/world-africa-62608531?at_medium=RSS&at_campaign=KARANGA mogadishu 2022-08-19 18:22:26
ニュース BBC News - Home Thomas Tuchel: Chelsea boss receives suspended one-match ban for Antonio Conte bust-up https://www.bbc.co.uk/sport/football/62611712?at_medium=RSS&at_campaign=KARANGA Thomas Tuchel Chelsea boss receives suspended one match ban for Antonio Conte bust upChelsea boss Thomas Tuchel receives a suspended one match touchline ban and is fined £ for his confrontation with Antonio Conte at the end of Sunday s derby against Tottenham 2022-08-19 18:06:22
ビジネス ダイヤモンド・オンライン - 新着記事 【ミリオンセラー会計士が明かす】 なぜ「お金の余裕は心の余裕」ですべてうまくいくのか? - 売上最小化、利益最大化の法則 https://diamond.jp/articles/-/306114 youtuber 2022-08-20 03:45:00
ビジネス ダイヤモンド・オンライン - 新着記事 【人気No.1風水師の教え】 開運のために便利家電をすすめる理由とは? - どんな運も、思いのまま! 李家幽竹の風水大全 https://diamond.jp/articles/-/306978 【人気No風水師の教え】開運のために便利家電をすすめる理由とはどんな運も、思いのまま李家幽竹の風水大全「どんな人でも運がよくなれる」、それが風水の持つ力です。 2022-08-20 03:40:00
ビジネス ダイヤモンド・オンライン - 新着記事 【出口学長・日本人が最も苦手とする哲学と宗教特別講義】 「600年の時間差」がキリスト教とイスラーム教に与えた影響 - 哲学と宗教全史 https://diamond.jp/articles/-/307038 2022-08-20 03:35:00
ビジネス ダイヤモンド・オンライン - 新着記事 「ひとり息子」自ら行動できない1つの原因 - ひとりっ子の学力の伸ばし方 https://diamond.jp/articles/-/306692 自己肯定感 2022-08-20 03:30:00
ビジネス ダイヤモンド・オンライン - 新着記事 料理を「おいしい」で終わらせたくない人のための言語化の方法 - 独学大全 https://diamond.jp/articles/-/301385 読書 2022-08-20 03:25:00
ビジネス ダイヤモンド・オンライン - 新着記事 【精神科医が教える】 絶対にこんな人のことを忘れてはいけない… 人間関係に苦しむ人に共通する“無意識の闇” - 精神科医Tomyが教える 心の荷物の手放し方 https://diamond.jp/articles/-/308100 【精神科医が教える】絶対にこんな人のことを忘れてはいけない…人間関係に苦しむ人に共通する“無意識の闇精神科医Tomyが教える心の荷物の手放し方不安や悩みが尽きない。 2022-08-20 03:20:00
ビジネス ダイヤモンド・オンライン - 新着記事 「信託財産留保額」はコストであってコストではない - 最新版つみたてNISAはこの9本から選びなさい https://diamond.jp/articles/-/307914 2022-08-20 03:15:00
ビジネス ダイヤモンド・オンライン - 新着記事 【漫画家・弘兼憲史が教える】 死んだら“お墓もいらない”と断言するワケ - 死ぬまで上機嫌。 https://diamond.jp/articles/-/306630 弘兼氏のさまざまな経験・知見をもとに、死ぬまで上機嫌に人生を謳歌するコツを説いている。 2022-08-20 03:10:00
GCP Cloud Blog Leveling up your data analysis skills as a student https://cloud.google.com/blog/topics/developers-practitioners/leveling-your-data-analysis-skills-student/ Leveling up your data analysis skills as a studentIf you re a college student like me and are gearing up to enter the “big kids job market as I like to call it then you ve probably been wondering or worrying about how to get ahead of the curve and stand out amongst your peers When I think about which high value fields to target for improving my technical skills and qualifications the one area I keep coming back to is data analysis  Why learn data analysis Data in all forms is becoming increasingly valuable in our technology driven society and that is because of the insights that it brings The amount of data being generated around us is growing exponentially in all fields This is great news for students because now you can benefit from learning data analysis to complement your existing skills whether you re majoring in computer science marketing or even music Having the skills necessary to manipulate process analyze and display data in a meaningful way will push you ahead regardless of your background  What I consider when learning a new skillLearning new tech skills and tools on top of coursework jobs and internships can seem daunting Trust me I know your pain That s why it s so important for us as students to be strategic and efficient in how we discern the best resources to use for learning Whenever I want to learn a new software or skill there are a few factors I take into account that I m sure are important to you too How much is this going to cost me How much time is this going to take How applicable is this to my job prospects CostI m not even going to pretend this isn t one of the first things I think about Knowing how to allocate your financial resources is a vital skill especially when it comes to career oriented self improvement TimeAnd time Well that is a cost as well Time is valuable for us students sometimes even more valuable than money itself We re juggling coursework and studying commute time extracurriculars career development and sometimes even a job to help pay for it all We re looking for skills that are relatively straightforward to learn and that we can learn on our own time on a flexible self paced schedule ApplicabilityLastly I want to be able to learn a skill or tool that is applicable to my job search something that I can list directly on my resume that will be attractive to the type of companies that I will be applying to After all furthering your career is one of the main drivers for this kind of self study That is why I always look for opportunities to learn directly using industry standard software and services Learning data analysis with Google CloudDuring my internship here at Google I ve been given ample opportunities to build my data analysis skills using Google Cloud services In this blog post I focus specifically on two of those services BigQuery and Data Studio What is BigQuery BigQuery is a cloud data warehouse that companies use for running analytics on large datasets It also happens to be a great place for learning and practicing SQL the language for analyzing data The “getting started experience with BigQuery is smooth and saves students tons of time Instead of downloading and installing database software sourcing data and loading it into tables you can login to the BigQuery sandbox and immediately start writing SQL queries or copying sample ones to analyze data provided as part of the Google Cloud public datasets program which you will see for yourself soon What is Data Studio Data Studio is an online business intelligence tool integrated with BigQuery for visualizing data in customizable and informative tables dashboards and reports You can use it to visualize the results of your SQL queries it s also great for analyzing data without SQL and for sharing insights with non technical users Because Data Studio is already part of Google Cloud there s no need to export queried processed data to an external tool Data visualization can be completed through direct connections to the BigQuery environment which saves you lots of time and headaches from having to worry about things like data file compatibility size and so on You can go from the BigQuery Console to visualizing your query results in Data Studio in one click Both BigQuery and Data Studio can be used for little to no cost within the free tier of Google Cloud This tier allocates users a starting amount of data storage if you want to upload your own and allows a certain amount of bytes processed for your queries each month You can even create a BigQuery “sandbox environment that stays within this free tier and doesn t require any credit card to set up I ll give you instructions on how to set one up later So you can get started quickly with BigQuery and Data Studio for free let s talk about applicability Both BigQuery and Data Studio are used across many industries in production workloads today Just search BigQuery or Data Studio on LinkedIn and you ll see what I mean Getting started with BigQuery and Data StudioNow let s get to the action I want to show you just how simple it is to get started with both of these tools so here s a quick tutorial on using BigQuery and Data Studio with a real public dataset Let s dive into an example scenario that BigQuery can help solve Congrats You re a new intern who recently got hired by Pistach io Pistach io is adamant that for the first couple of weeks new hires come into the office for training programs So you must make sure that you show up on time Pistach io is in New York City and the office does not have accessible parking nearby You know that New York City has reimplemented its public bike program so you ve decided to use bike sharing to get to work Because you must be at work on time you need answers to a few key questions  Which nearby stations have bikes you can use in the morning   Where is the drop off location that is closest to the office   What are the busiest stations that you should avoid It would be great to answer these questions using a public dataset Luckily for you BigQuery has tons of datasets available for you to use for no cost The data that you ll be analyzing for this example is in the New York Citi Bike public dataset  Getting set upFirst create a BigQuery sandbox which is essentially an environment for you to work in Follow these steps to set one up In the Google Cloud console go to the BigQuery page documentation In the Explorer pane click  Add Data gt Pin a project gt Enter project name Type “bigquery public data and click Pin This project contains all the datasets available in the public datasets program To see underlying datasets expand the bigquery public data project in the Explorer pane and scroll to find “new york citibike Click to highlight the dataset or expand to see the citibike stations and citibike trips tables You can then highlight the tables themselves to see more details like the schema and a preview of the data  Now time to queryOk on to the analysis Let s figure out which stations are closest to home For this tutorial you will be using the Port Authority Bus Terminal in NYC as your home This query calculates the distance between each Citi Bike station and your home and then returns the result with the closest station listed first The ST DISTANCE function calculates the shortest distance between two points So more like a bird flying than taking a bike to work but it ll work for this use case Next let s find the stations closest to the office Let s use the coordinates for the Google NYC Chelsea Market office since that is where I worked this summer You can use essentially the same query as the last Finally let s identify the most popular Citi Bike stations around the office so that we can avoid them This query uses a subquery to calculate the number of overall trips for each station and then joins it with a list of each station and its distance to the office to list the closest first Looks like I ll be avoiding the th and Greenwich station Query results showing the closest stations to my office and the total number of trips starting at each station Visualize the resultsOne of the great things about BigQuery is that you can visualize your results easily with Data Studio just press the Explore Data button in the query results page This will give you a better idea of what exactly you queried A quick visualization of the results from the final query If you want to try out Data Studio for yourself I recommend following this tutorial It s also about bike share trips but this time in Austin Texas Next steps​​It s really that simple Google Cloud is easy to learn and use so you spend less time “getting started and more time analyzing data and designing visualizations You can see the potential in using something like this in your personal and professional tech development and there are so many ways to boost your skills and early career in data science with Google Cloud tools such as BigQuery You can also supplement what you ve learned in this post by completing the From Data to Insights with Google Cloud specialization on Coursera  That s all I have to share for now If you found this blog post helpful be sure to share You can find more helpful content on the Google Cloud Platform blog 2022-08-19 18:24:00

コメント

このブログの人気の投稿

投稿時間:2021-06-17 05:05:34 RSSフィード2021-06-17 05:00 分まとめ(1274件)

投稿時間:2021-06-20 02:06:12 RSSフィード2021-06-20 02:00 分まとめ(3871件)

投稿時間:2020-12-01 09:41:49 RSSフィード2020-12-01 09:00 分まとめ(69件)