投稿時間:2021-09-18 02:30:29 RSSフィード2021-09-18 02:00 分まとめ(35件)

カテゴリー等	サイト名等	記事タイトル・トレンドワード等	リンクURL	頻出ワード・要約等/検索ボリューム	登録日
AWS	AWS Partner Network (APN) Blog	Secure Data and Analytics with Talend Data Fabric and AWS PrivateLink	https://aws.amazon.com/blogs/apn/secure-data-and-analytics-with-talend-data-fabric-and-aws-privatelink/	Secure Data and Analytics with Talend Data Fabric and AWS PrivateLinkThe most valuable data for many companies is often the most sensitive and most regulated such as electronic health records or financial data Talend Data Fabric nbsp combines data integration data integrity and data governance in a single unified platform that makes it easy to collect transform clean govern and share your data Learn about Talend s integration with AWS PrivateLink that allows customers to send data without using the public internet	2021-09-17 16:59:07
AWS	AWS Big Data Blog	Reduce costs and increase resource utilization of Apache Spark jobs on Kubernetes with Amazon EMR on Amazon EKS	https://aws.amazon.com/blogs/big-data/reduce-costs-and-increase-resource-utilization-of-apache-spark-jobs-on-kubernetes-with-amazon-emr-on-amazon-eks/	Reduce costs and increase resource utilization of Apache Spark jobs on Kubernetes with Amazon EMR on Amazon EKSAmazon EMR on Amazon EKS is a deployment option for Amazon EMR that allows you to run Apache Spark on Amazon Elastic Kubernetes Service Amazon EKS If you run open source Apache Spark on Amazon EKS you can now use Amazon EMR to automate provisioning and management and run Apache Spark up to three times faster …	2021-09-17 16:18:54
AWS	AWS Media Blog	AWS Artist Series: Creating an ocean of clouds	https://aws.amazon.com/blogs/media/aws-artist-series-creating-an-ocean-of-clouds/	AWS Artist Series Creating an ocean of cloudsThis is the th post in our AWS Artist series find the other five below AWS Artist Series Compositing Spanner­­AWS Artist Series Creating characters with nbsp dynamic wrinkles nbsp AWS Artist Series Animating Noa nbsp AWS Artist Series Rigging the bridge for “Spanner AWS Artist Series Laying out the opening shots of Spanner nbsp Spanner Noa s silhouette hanging from …	2021-09-17 16:51:57
AWS	AWS	AWS Innovators - S1E4 Izzy | Amazon Web Services	https://www.youtube.com/watch?v=QbT-LOn0QZo	AWS Innovators SE Izzy Amazon Web ServicesLearn more about AWS innovators Scale means many things for AWS Innovators For Izzy Varland it meant scaling an RC car to a full sized autonomous go kart Starting at age Izzy has partnered with their father and mentor Todd to work on go karts At Izzy suggested that they make their next kart electric Todd upped the ante Izzy should make it autonomous As Izzy put it the question they ask at the start of every project is Can I possibly do that followed by a stubborn I d better be able to do that At AWS we re inspired by inventors like Izzy Varland featured in this video ーwho pour their energy into passion projects solving problems other might not see And now we want to know Are you one of those people Have you used AWS tools to build a solution you couldn t find Share your story so we could feature you next AWS MachineLearning DeepRacer DeveloperSubscribe More AWS videos More AWS events videos ABOUT AWSAmazon Web Services AWS is the world s most comprehensive and broadly adopted cloud platform offering over fully featured services from data centers globally Millions of customers ーincluding the fastest growing startups largest enterprises and leading government agencies ーare using AWS to lower costs become more agile and innovate faster AWSInnovators AWS AmazonWebServices CloudComputing	2021-09-17 16:32:08
python	Pythonタグが付けられた新着投稿 - Qiita	【Python】unittestサンプル	https://qiita.com/koKekkoh/items/bdb7c15b8e22b93ea8fc	【Python】unittestサンプル次のsphinxjatermpyで定義されているHTMLTextNodeクラスのユニットテスト。	2021-09-18 01:20:22
python	Pythonタグが付けられた新着投稿 - Qiita	かの有名なFrog問題に奮闘する	https://qiita.com/EP7/items/705ac9d1364d3432267d		2021-09-18 01:18:28
python	Pythonタグが付けられた新着投稿 - Qiita	ABC186 C - Unlucky 7 から学んだ	https://qiita.com/AKpirion/items/a69fc9d4ff3aba07280b	ppendstrnprintnlensetlis	2021-09-18 01:07:56
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	なぜかjointが複製されてしまう	https://teratail.com/questions/360072?rss=all	なぜかjointが複製されてしまうMLagentsでボール投げのAIを作っています。	2021-09-18 01:43:03
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	カウントが１以上に増えません	https://teratail.com/questions/360071?rss=all	カウントが以上に増えません敵を倒したらカウントが増え、textで表示されるようにキルカウンターの様なものがつくりたいのですがカウントが以上増えないので困っています。	2021-09-18 01:14:53
Docker	dockerタグが付けられた新着投稿 - Qiita	【備忘録】GCE上の環境でgcloud docker -- pushを実行するとAccess deniedが出る	https://qiita.com/taka_baya/items/3dce7bb65029719a342e	【備忘録】GCE上の環境でgclouddockerpushを実行するとAccessdeniedが出るGCEに開発環境を作り、GCE環境内で作成したアプリケーションのコンテナイメージをCloudRunで実行させるために、ContainerRegistryにイメージをpushした際に「deniedAccessdenied」とエラーが表示されてpush出来なかった話。	2021-09-18 01:28:01
GCP	gcpタグが付けられた新着投稿 - Qiita	【備忘録】GCE上の環境でgcloud docker -- pushを実行するとAccess deniedが出る	https://qiita.com/taka_baya/items/3dce7bb65029719a342e	【備忘録】GCE上の環境でgclouddockerpushを実行するとAccessdeniedが出るGCEに開発環境を作り、GCE環境内で作成したアプリケーションのコンテナイメージをCloudRunで実行させるために、ContainerRegistryにイメージをpushした際に「deniedAccessdenied」とエラーが表示されてpush出来なかった話。	2021-09-18 01:28:01
海外TECH	DEV Community	Working In Open Source	https://dev.to/derekjxy/working-in-open-source-554l	Working In Open SourceIn order to make our code of Static Site Generator better we are required to share our code to a partner and try to find out some issues that can make their original code better And this is the main point that we have Lab in OSD The partner I found was Kunwarvir Dhillon I had never met my partner Kunwarvir Dhillon before And we just team up randomly However although we haven t met each other before we both treat this sharing code behavior seriously After communicated with Kunwarvir Dhillon we both started to check our each other s code Interesting StuffThis is the first time that I tried to improve other s code by my own knowledge I ve never thought that I can help people improve their code because I always think that what I known are limited and basic However through this Lab sharing code with my partner I learned something I learned that there are no perfect code ever even some beginners can help those experienced programers improve their code I can help people improve their code as well Honestly the first time I got my partner Kunwarvir Dhillon s code I was soooo confused I felt like there is no way I can help them to improve their code base on my knowledge even though we built the code in the same language JavaScript And then I just told myself just break it down step by step make it slow And then I just followed the instruction that our professor provided and check the code step by step And finally I found a few issues that can help my partner improve their code That was amazing to me And when it comes to the end of the checking I realized that there are a lot of similar code in our code And I shouldn t felt panic at the beginning There is one thing surprised me in my partner s code And that is they have a personal logo when the user access their code So whenever I run their code it will have a logo comes up like this Issues Here are some issues I found in my partner s code Issue There are some defined variables that never used in the code const yargs require yargs const path require path These two variables are never used in the code so I suggested my partner to remove them Issue There is a deletable statement in the code This statement can be deleted since the output path is set by default Issue I found that the code my partner shared to me would generate a weird html file What I mean weird is they are trying to divide the article sentences by sentences but not paragraphs by paragraphs And then I suggested they write the code with my new codeIssue Since I changed one line of code in my partner s code they need to update another line of code as well Here are some issues my partner found in my code Issue My Index Html is failed at X HTML validation There a space in the name of the HTML files that my code generated Issue My code would convert any type of files that the user input into a html file which is kind of a stupid feature of my code We re only supposed to convert txt file into a html file Issue My code would convert any type of files inside the folder that the user input into a html file This is a nonsense feature at all My code should only supposed to work when it comes to txt file Issue My code set that all the html files generated will place into dist folder by default And it doesn t allow any other save path Issue I didn t have a clear declaration in my README file And that made a misunderstanding for my partner to access my code UpdateAfter reviewing the issues that my partner found in my code I realized that those are simple and stupid mistakes For the Issue the main reason that my Index Html is failed at X HTML validation is my code generated some html files that with blank space in their name Therefore I update my code to generate html files that without spaces by using the code let validFname fname split join For the Issue I update my code to check the file type fileType argv input split pop if fileType txt before doing anything Same for the Issue I update my code to check the file type inside the folder fileType file split pop if fileType txt then convert the files to html files For Issue I m not going to fix it right now since it s an optional feature And there is no harm to force the user save the output html files into a specific folder And finally about issue I updated my README file so that any new users could run my code easily and correctly I know there are more issues in my code that need improvement And I will try my best to make it better LinksLink to my repo Link to Kunwarvir Dhillon repo	2021-09-17 16:15:11
海外TECH	DEV Community	Today I learned day 5	https://dev.to/suhcrates/today-i-learned-day-5-3mi6	Today I learned day Sparta Coding Club Camp Learning for Tomorrow Today I learned Day Fri Notes for Future References API GET readPOST create update delete AJAX ajax type GET url data success function response console log response Type refers to a type of HTTP method it s using url for the url where you want to request data data for data to SUBMIT In this case the function is only for requesting so no need for data success A callback function to be executed when Ajax request succeeds reference Today s EventA lecture from a backend developer about how to learn and improve as a programmer e g reflection and feedback from others and open source projects and git and github A code review with study mates An app making test with only one hour given Only completed about of it Learned a lot about what I need to learn and improve The test required some understanding of jquery ajax and flask Note I m an aspiring developer from South Korea who just started a boot camp I will be posting almost daily as a log to record my progress	2021-09-17 16:04:03
Apple	AppleInsider - Frontpage News	Best Deals Sept. 17 - $105 Beats Studio Buds, $100 off AMD Ryzen 9 5950X, more!	https://appleinsider.com/articles/21/09/17/best-deals-september-17---100-off-amd-ryzen-9-5950x-105-beats-studio-buds-and-more?utm_medium=rss	Best Deals Sept Beats Studio Buds off AMD Ryzen X more Friday s best deals include for a Microsoft Personal month subscription and Amazon com Gift Card Beats Studio Buds and more Deals Friday September Shopping online for the best discounts and deals can be an annoying and challenging task So rather than sifting through miles of advertisements check out this list of sales we ve hand picked just for the AppleInsider audience Read more	2021-09-17 16:22:29
海外TECH	Engadget	US will reportedly impose crypto sanctions amid ransomware attacks	https://www.engadget.com/us-treasury-department-crypto-sanctions-ransomware-165049611.html?src=rss	US will reportedly impose crypto sanctions amid ransomware attacksAccording to The Wall Street Journal the Biden administration plans to implement new measures to make it more difficult for hackers to profit from ransomware attacks using cryptocurrencies As early as next week the Treasury Department will reportedly impose sanctions and guidance designed to discourage organizations from using digital currencies to pay for ransoms Per The Journal among the measures the agency is considering are fines and other penalties aimed at businesses that cooperate with hackers Later in the year the Treasury Department is also expected to implement new anti money laundering and terror financing regulation to limit further the use of cryptocurrencies as a payment method for ransoms and other illegal activity The incoming sanctions will reportedly single out specific traders and exchanges instead of casting a wide net and attempting to disrupt the entire crypto ecosystem In addition to harming organizations that may have facilitated ransomware payments in the past the hope is that sanctions will scare most cryptocurrency platforms from processing those types of transactions in the future “An action of this kind would be an aggressive proactive approach to going after those who facilitate ransomware payments Ari Redbord a former Treasury Department official told The Journal The measures would be the latest attempt by the Biden administration to tackle the issue of ransomware attacks following a year in which they ve increased in frequency and severity After the Colonial Pipeline attack led to fuel shortages in parts of the US the president signed an executive order that called for among other things improved information sharing between federal agencies More recently the Department of Homeland Security laid out mandatory rules that call on pipeline operators to appoint cybersecurity coordinators and report incidents to the Cybersecurity and Infrastructure Security Agency	2021-09-17 16:50:49
海外TECH	Engadget	Netflix signs 'Schitt's Creek' co-creator Dan Levy to a TV and movie deal	https://www.engadget.com/netflix-dan-levy-schitts-creek-tv-movie-deal-160249995.html?src=rss	Netflix signs x Schitt x s Creek x co creator Dan Levy to a TV and movie dealNetflix has locked down several high profile creators to TV and movie deals over the last few years including Ryan Murphy Shonda Rhimes David Fincher and Game of Thrones duo David Benioff and Dan Weiss The latest talent to join Netflix s stable is Dan Levy the star and co creator of Schitt s Creek who won four Emmys for the hit Canadian sitcom last year Levy s first Netflix project is a romantic comedy movie that he ll write produce direct and star in according to Variety He can t work on any shows for Netflix until his TV deal with Disney studio ABC Signature expires next summer Netflix played an important role in Levy s rise to stardom after it started streaming Schitt s Creek in “Netflix offered Schitt s Creek a second home at just the right time and opened the doors to a whole new audience for us Levy said in a statement “Watching the show thrive there has only enhanced my excitement about continuing to tell specific meaningful stories with them in both TV and feature film Levy has some other projects in the works elsewhere including through his ABC deal Hulu ordered a pilot last month for an animated comedy called Standing By from Levy and fellow Schitt s Creek writer Ally Pankiw	2021-09-17 16:02:49
海外科学	NYT > Science	When Giraffes Fight, They Are Honorable	https://www.nytimes.com/2021/09/17/science/giraffes-fighting.html	similar	2021-09-17 16:34:17
海外科学	NYT > Science	SpaceX Inspiration4 Updates: The Crew Spends Their First Day in Orbit	https://www.nytimes.com/live/2021/09/16/science/spacex-inspiration4-updates/	earth	2021-09-17 16:54:29
海外TECH	WIRED	How to Preorder the iPhone 13—and Which One You Should Get	https://www.wired.com/story/apple-iphone-13-deals	apple	2021-09-17 16:18:00
金融	金融庁ホームページ	つみたてNISA Meetupについて更新しました。	https://www.fsa.go.jp/policy/nisa2/opinion/index.html	nisameetup	2021-09-17 17:00:00
金融	金融庁ホームページ	「金融商品取引業者等向けの総合的な監督指針」、「金融サービス仲介業者向けの総合的な監督指針」の一部改正（案）について公表しました。	https://www.fsa.go.jp/news/r3/shouken/20210917.html	仲介業者	2021-09-17 17:00:00
金融	金融庁ホームページ	「犯罪利用預金口座等に係る資金による被害回復分配金の支払等に関する法律第三十六条第一項の規定による立入検査をする職員の携帯する身分を示す証明書の様式を定める命令」及び「民間公益活動を促進するための休眠預金等に係る資金の活用に関する法律第四十四条第一項の規定による立入検査をする職員の携帯する身分を示す証明書の様式を定める命令」の一部改正（案）について公表しました。	https://www.fsa.go.jp/news/r3/ginkou/20210917-3/20210917-3.html	民間公益活動を促進するための休眠預金等に係る資金の活用に関する法律	2021-09-17 17:00:00
金融	金融庁ホームページ	藍澤證券株式会社の産業競争力強化法に基づく事業再編計画の認定について公表しました。	https://www.fsa.go.jp/news/r3/shouken/20210917-1/20210917-1.html	産業競争力強化法	2021-09-17 17:00:00
ニュース	BBC News - Home	UK travel update: Amber list scrapped in overhaul of travel rules in England	https://www.bbc.co.uk/news/uk-58602481?at_medium=RSS&at_campaign=KARANGA	secretary	2021-09-17 16:50:25
ニュース	BBC News - Home	Ruling limiting under-16s puberty blockers overturned	https://www.bbc.co.uk/news/uk-58598186?at_medium=RSS&at_campaign=KARANGA	court	2021-09-17 16:37:30
ニュース	BBC News - Home	David Gomoh murder: Gang members jailed for NHS worker stabbing	https://www.bbc.co.uk/news/uk-england-london-58603084?at_medium=RSS&at_campaign=KARANGA	gomoh	2021-09-17 16:56:01
ニュース	BBC News - Home	Covid vaccine and test passes to be introduced in Wales	https://www.bbc.co.uk/news/uk-wales-politics-58596128?at_medium=RSS&at_campaign=KARANGA	events	2021-09-17 16:29:54
ニュース	BBC News - Home	Gas shortage 'threatens food security' says meat industry	https://www.bbc.co.uk/news/business-58600583?at_medium=RSS&at_campaign=KARANGA	carbon	2021-09-17 16:48:25
ニュース	BBC News - Home	DeChambeau-Koepka rivalry could inspire US team - Europe captain Harrington	https://www.bbc.co.uk/sport/golf/58600560?at_medium=RSS&at_campaign=KARANGA	DeChambeau Koepka rivalry could inspire US team Europe captain HarringtonThe Bryson DeChambeau Brooks Koepka rivalry could inspire the US at the Ryder Cup rather than hinder them says Europe captain Padraig Harrington	2021-09-17 16:32:06
ニュース	BBC News - Home	What are the travel rules now?	https://www.bbc.co.uk/news/explainers-52544307?at_medium=RSS&at_campaign=KARANGA	light	2021-09-17 16:24:50
ニュース	BBC News - Home	Covid-19 in the UK: How many coronavirus cases are there in my area?	https://www.bbc.co.uk/news/uk-51768274?at_medium=RSS&at_campaign=KARANGA	cases	2021-09-17 16:22:33
北海道	北海道新聞	「安倍―菅」批判避ける　４氏、敵視恐れ消極的　自民総裁選	https://www.hokkaido-np.co.jp/article/590575/	安倍晋三	2021-09-18 01:13:00
北海道	北海道新聞	自民総裁選　「決選」で増す議員票の重み　３、４位の支持者カギ	https://www.hokkaido-np.co.jp/article/590574/	自民党総裁	2021-09-18 01:10:00
北海道	北海道新聞	党改革の覚悟は本物か　首相官邸キャップ・佐藤陽介	https://www.hokkaido-np.co.jp/article/590573/	佐藤陽介	2021-09-18 01:08:00
GCP	Cloud Blog	Recommendations AI data ingestion	https://cloud.google.com/blog/topics/developers-practitioners/recommendations-ai-data-ingestion/	Recommendations AI data ingestionIn our previous post we presented a high level picture of Recommendations AI showing how the product is typically used In this post we ll take a deep dive into the first step of getting started which is data ingestion This post will answer all your questions on getting your data into Recommendations AI so you can train models and get recommendations Recommendations AI uses your product catalog and user events to create machine learning models and deliver personalized product recommendations to your customers Essentially Recommendations AI uses a list of items available to be recommended product catalog and user s interactions with those products events allowing you to create various types of models algorithms specifically designed for your data to generate predictions based on business objectives conversion rate click through rate revenue Recommendations AI is now part of the Retail API which uses the same product catalog and event data for several Google Retail AI products like Retail Search Catalog dataTo get started with Recommendations AI you will first need to upload your data starting with your complete product catalog The Retail API catalog is made up of product entries Take a look at the full Retail Product schema to see what can be included in a product The schema is shared between all Retail Product Discovery products so once you upload a catalog it can be used for Recommendations AI and Retail Search While there are a lot of fields available in the schema you can start with a small amount of data per product the minimal required fields are id title categories We recommend submitting description and price as well as any custom attributes as well Catalog levelsBefore uploading any products you may also need to determine which product level to use By default all products are primary but if you have variants in your catalog you may need to change the default ingestion behavior If your catalog has multiple levels variants you need to determine if you want to get recommendations back at the primary group level or at the variant sku level and also if the events are sent using the primary id or the variant ids If you re using Google Merchant Center you can easily import your catalog directly see below  In Merchant Center the item grouping is done using item group id If you have variants and you re not ingesting the catalog from Merchant Center you just need to make sure your primaryProductId is set appropriately and you set ingestionProductType as needed before doing your initial catalog import Catalog importThere are several ways to import catalog data into Retail API a Merchant Center syncMany retailers use Google Merchant Center to upload their product catalogs in the form of product feeds These products can then be used for various types of Google Ads and for other services like Google Shopping and Buy on Google But another nice feature of Merchant Center is the ability to export your products for use with other services BigQuery for example The Merchant Center product schema is similar to the Retail product schema so the minimum requirements are met if you do want to use Merchant Center to feed your Retail API product catalog The easiest way to import your catalog from Merchant Center is to set up a Merchant Center Sync in the Retail Admin Console Simply go to the Data tab and select Import at the top of the screen Then as the Source of data select Merchant Center Sync Add your Merchant Center account and select a branch to sync to While this method is easy there are some limitations For example if your Merchant Center catalog is not complete you won t be able to add more products directly to the Recommendations catalog you would need to add them to the merchant center feed and they would then get synced to your Recommendations catalog This may be easier than maintaining a separate feed for Recommendations however as you can easily add products to your Merchant Center feed and simply leave them out of your Ads destinations if you don t want to use them for Ads amp Shopping Another limitation of using Merchant Center data is that you may not have all of the attributes that you need for Recommendations AI Size Brand Color are often submitted to Merchant Center but you may have other data you want to use for Recommendations model data Also you are only able to enable a sync to a catalog branch that has no items So if you have existing items in the catalog you would need to delete them all first  b Merchant Center import via BigQueryAnother option that provides a bit more flexibility is to export your Merchant Center catalog to BigQuery using the BigQuery Data Transfer Service You can then bulk import that data from BigQuery directly into the Retail API catalog You are still somewhat limited by the merchant center schema but it is possible to add additional products from other sources to your catalog unlike MC Sync which doesn t allow updating the branch outside of the sync The direct Merchant Center sync in a is usually the simplest option but if you already have a BigQuery DTS job or want to control exactly when items are imported then this method may be a good option You also have the flexibility to use a BigQuery view so you could limit the import to a subset of the Merchant Center data if necessary a single language or variant to avoid duplicate items for example Likewise you could also use unions or multiple tables to import from different sources as necessary c Google Cloud Storage importIf your catalog resides in a database or if you need to pull product details from multiple sources doing an import from GCS may be your easiest option For this option you simply need to create a text file with one product per line typically referred to as NDJSON format  in the Retail AI JSON Product Schema There are a lot of fields in the schema but you can usually just start with the basics So a very basic sample to import items from a GCS file might look like this d BigQuery importJust as you can import products from BQ in the merchant center schema you can also create a BigQuery table using the Retail product schema The product schema definition for BigQuery is available here The Merchant Center Big Query schema can be used whether or not you transfer the data from Merchant Center but it is not the full schema for retail It doesn t include custom attributes for example So using the Retail Schema allows you to import all possible fields Importing from BigQuery is useful if your product catalog is already in BigQuery You can also create a view that matches the Retail schema and import from the view pulling data from existing tables as necessary For Merchant Center Cloud Storage and BigQuery imports the import itself can be triggered through the Admin Console UI or via the import API call When using the API the schema needs to be specified with the dataSchema attribute as product or product merchant center accordingly e API import amp product managementYou can also import and modify catalog items directly via API This is useful to make changes to products in realtime for example or if you want to integrate with an existing catalog management system  The inline import method is very similar to GCS import you simply construct a list of products in the Retail Schema format and call the products import method API to submit the products Like with GCS existing products are overwritten and new products are created Currently the import method can import up to products per call There is also the option to manage products individually with the API using get create patch and delete methods All of the API calls can be done using HTTP REST or gRPC but using the retail client libraries for the language of your choice may be the easiest option The documentation currently has many examples using curl with the REST API but the client libraries are usually preferred for production use Live user eventsOnce your catalog is imported you ll need to start sending user events to the Retail API Since recommendations are personalized in real time based on recent activity user events should be sent in real time as they are occurring Typically you ll want to start sending live real time events and then optionally backfill historical events before training any models There are currently event types used by the Recommendations AI models detail page viewadd to cartpurchase completehome page viewNot all models require all of these events but it is recommended to send all of these if possible Note the “minimum required fields for each event As with the product schema the user event schema also has many fields but only a few are required A typical event might looks like this There are ways you can send live events to Recommendations a Google Tag ManagerIf you are already using Google Tag Manager and are integrated with Google Analytics with Enhanced Ecommerce then this will usually be the easiest way to get real time events into the Retail API  We have provided a Cloud Retail tag in Google Tag Manager that can easily be configured to use the Enhanced Ecommerce data layer but you can also populate the cloud retail data layer and use your own variables in GTM to populate the necessary fields Detailed instructions for setting up the cloud retail tag can be found here Set up is slightly different depending on if you are using GA or regular Google Analytics but essentially you just need to provide your Retail API key project number and then set up a few variable overrides to get visitorId userId and any other fields that aren t provided via Enhanced Ecommerce The Cloud Retail Tag doesn t require Google Analytics with Enhanced Ecommerce but you will need to populate a data layer with the required fields or be able to get the required data fields GTM variables or existing data layer variables A typical Cloud Retail tag configuration in GTM might look something like this b JavaScript pixelIf you re not currently using Google Tag Manager an easy alternative is to add our JavaScript pixel to the relevant pages on your site Usually this would be the home page product details pages and cart pages Configuring this will usually require adding the javascript code along with the correct data to a page template It may also require some server side code changes depending on your environment c API write methodAs an alternative to GTM or the tracking pixel which sends events directly from the user s browser to the Retail API you can also opt to send events server side using the userEvents write API method This is usually done by service providers that want to have an existing event handling infrastructure in their platform Historical eventsAI models tend to work best with large amounts of data There are minimum event requirements for training Recommendations models but it is usually advised to submit a year s worth of historical data if available This is especially useful for retailers with high seasonality For a high traffic site you may gather enough live events in a few days to start training a model even so it s usually a good idea to submit more historical data You ll get higher quality results without having to wait for events to stream in over weeks or months Just like the catalog data there are several ways to import historical event data a GA importIf you are using GA with Enhanced Ecommerce tracking you can easily export historical data into BigQuery and then import directly into the Retail API  Regular Google Analytics does not have an export functionality but GA does Using this export feature you can easily import historical events from GA into Retail API b Google Cloud Storage importIf you have historical events in a database or logs you can also write them out to files in NDJSON format and import those files from Cloud Storage This is usually the easiest method of importing large number of events since you simply have to write JSON to text files and then they can be imported directly from Google Cloud Storage Just as with catalog import the lines in each file simply need to be in the correct JSON format in this case the JSON event format The import can be done with the API or in the cloud console UI simply enter the GCS bucket path for your file c BigQuery importEvents can be read directly from BigQuery in the Retail Event Schema or in GA Event Schema This method is useful if you already have events in BigQuery or prefer to use BigQuery instead of GCS for storage Since each event type is slightly different it may be easiest to create a separate table for each event type As with the GCS import the BigQuery import can also be done using the API or in the cloud console UI by entering the BigQuery table name d API import amp writeThe userEvents write method used to do realtime event ingestion via API can also be used to write historical events But for importing large batches of events the userEvents import method is usually a better choice since it requires less API calls The import method should not be used for real time event ingestion since it may add additional processing latency Keep in mind that you should only have to import historical events once so the events in BigQuery or Cloud Storage can usually be deleted after importing The Retail API will de duplicate events that are exactly the same if you do accidentally import the same events Catalog amp event data qualityAll of the methods above will return errors if there are issues with the products or events in the request For the inline and write methods errors will be returned immediately in the API response For the BigQuery Merchant Center amp Cloud Storage imports error logs can be written to a GCS bucket and there will be some details in the Admin Console UI If you look at the Data section in the Retail Admin Console UI there are a number of places to see details about the Catalog data The main Catalog tab shows the overall catalog status If you click the VIEW link for Data quality you will see some more detailed metrics around key catalog fields You can also click the Import Activity or Merchant Center links on the top of the page to view the status of the past imports or change your Merchant Center linking if necessary Commonly seen errorsBy far the most important metric is Unjoined Rate An unjoined event is one in which we received an item id that was not in the catalog This can be caused by numerous factors outdated catalog errors in event ingestion implementation perhaps the events are for variant id s but the catalog only has primary id s etc To view the event metrics click on the Data gt Event tab Here you can see various errors over time Clicking on the error will take you into cloud logging where you can see the full error response and determine exactly why a specific error occurred Training modelsOnce your catalog amp events are imported you should be ready to train your first model Check the Data gt Catalog amp Data gt Event tabs as shown above If your catalog item count has the correct number of in stock items for your inventory the total number of events ingested unjoined rate and days with joined events are sufficient you should be ready to train a model Tune in for our next post for more details Related ArticleHow to get better retail recommendations with Recommendations AIRecommendations AI is a solution that uses machine learning to bring product recommendations to their shoppers across any catalog or clie Read Article	2021-09-17 16:30:00