投稿時間:2023-05-25 02:26:08 RSSフィード2023-05-25 02:00 分まとめ(26件)

カテゴリー等	サイト名等	記事タイトル・トレンドワード等	リンクURL	頻出ワード・要約等/検索ボリューム	登録日
AWS	AWS Machine Learning Blog	Dialogue-guided intelligent document processing with foundation models on Amazon SageMaker JumpStart	https://aws.amazon.com/blogs/machine-learning/dialogue-guided-intelligent-document-processing-with-foundation-models-on-amazon-sagemaker-jumpstart/	Dialogue guided intelligent document processing with foundation models on Amazon SageMaker JumpStartIntelligent document processing IDP is a technology that automates the processing of high volumes of unstructured data including text images and videos IDP offers a significant improvement over manual methods and legacy optical character recognition OCR systems by addressing challenges such as cost errors low accuracy and limited scalability ultimately leading to better outcomes for …	2023-05-24 16:50:32
AWS	AWS Machine Learning Blog	Automate document validation and fraud detection in the mortgage underwriting process using AWS AI services: Part 1	https://aws.amazon.com/blogs/machine-learning/automate-document-validation-and-fraud-detection-in-the-mortgage-underwriting-process-using-aws-ai-services-part-1/	Automate document validation and fraud detection in the mortgage underwriting process using AWS AI services Part In this three part series we present a solution that demonstrates how you can automate detecting document tampering and fraud at scale using AWS AI and machine learning ML services for a mortgage underwriting use case This solution rides on a more significant global wave of increasing mortgage fraud which is worsening as more people present …	2023-05-24 16:19:46
AWS	AWS Machine Learning Blog	Perform batch transforms with Amazon SageMaker Jumpstart Text2Text Generation large language models	https://aws.amazon.com/blogs/machine-learning/perform-batch-transforms-with-amazon-sagemaker-jumpstart-text2text-generation-large-language-models/	Perform batch transforms with Amazon SageMaker Jumpstart TextText Generation large language modelsToday we are excited to announce that you can now perform batch transforms with Amazon SageMaker JumpStart large language models LLMs for TextText Generation Batch transforms are useful in situations where the responses don t need to be real time and therefore you can do inference in batch for large datasets in bulk For batch transform …	2023-05-24 16:13:27
AWS	AWS Messaging and Targeting Blog	How to use managed dedicated IPs for email sending	https://aws.amazon.com/blogs/messaging-and-targeting/how-to-use-managed-dedicated-ips-for-email-sending/	How to use managed dedicated IPs for email sendingStarting to use dedicated IPs has always been a long complicated process driven by factors such as the large effort to monitor and maintain the IPs and the nbsp costs both in infrastructure and management of IP and Domain reputation The Dedicated IP Managed feature in Amazon SES eliminates much of the complexity of sending email via …	2023-05-24 16:17:52
Ruby	Rubyタグが付けられた新着投稿 - Qiita	Rubyのインスタンス変数とattr_accsessorの使い方	https://qiita.com/Muse_06/items/40382a7689c3a761e170	attraccsessor	2023-05-25 01:01:37
golang	Goタグが付けられた新着投稿 - Qiita	【個人開発】開発者のための新規プロダクトの投稿プラットフォーム「Dev Haunt」をリリースしました！	https://qiita.com/jscd/items/fb47091960786c156439	devhaunt	2023-05-25 01:16:27
Ruby	Railsタグが付けられた新着投稿 - Qiita	Rubyのインスタンス変数とattr_accsessorの使い方	https://qiita.com/Muse_06/items/40382a7689c3a761e170	attraccsessor	2023-05-25 01:01:37
海外TECH	Ars Technica	No one should be surprised Virgin Orbit failed—it had a terrible business plan	https://arstechnica.com/?p=1941760	business	2023-05-24 16:46:09
海外TECH	MakeUseOf	Microsoft Is Adding AI Copilot to the Windows 11 Taskbar to Help With Everything	https://www.makeuseof.com/microsoft-adds-ai-copilot-windows-11-taskbar/	windows	2023-05-24 16:30:19
海外TECH	MakeUseOf	The 11 Best Productivity Tools From Zoho	https://www.makeuseof.com/best-productivity-tools-zoho/	productivity	2023-05-24 16:30:19
海外TECH	MakeUseOf	How Long Does a Tesla Battery Last Before It Must Be Replaced?	https://www.makeuseof.com/tesla-battery-lifespan/	batteries	2023-05-24 16:22:50
海外TECH	MakeUseOf	Which Windows 11 Services Are Safe to Disable?	https://www.makeuseof.com/which-windows-11-services-disable/	windows	2023-05-24 16:15:18
海外TECH	DEV Community	🚀 Introducing ✨ Bose Framework - The Swiss Army Knife for Bot Developers 🤖	https://dev.to/chetanam/introducing-bose-framework-the-swiss-army-knife-for-bot-developers-10k9	Introducing Bose Framework The Swiss Army Knife for Bot Developers Bot Development is Tough Bot Detectors like Cloudflare are ready to defend websites from our Bots Configuring Selenium with ChromeOptions to specify the driver path profile user agent and window size is Cumbersome and a nightmare in windows Debugging Bot Crashes via logs is hard How do you solve these pain points without sacrificing speed and handy development Enter Bose Bose is the first bot development framework in the Developer Community that is specifically designed to provide the best developer experience for bot developers Powered by Selenium it offers a range of features and functionalities to simplify the process of bot development As far as our knowledge goes Bose is the first bot development framework of its kind in the town Getting StartedClone Starter Templategit clone my bose projectThen change into that directory install dependencies and start the project cd my bose projectpython m pip install r requirements txtpython main pyThe first run will take some time as it downloads the chrome driver executable subsequent runs will be fast Core featuresAdds Powerful Methods to make working with Selenium a lot easier Follows best practices to avoid Bot Detection by Cloudflare and PerimeterX Saves the HTML Screenshot and the run details for each task run to enable easy debugging Utility components to write scraped data as JSON CSV and Excel files Automatically downloads and initializes the correct Chrome driver Fast and Developer friendly UsageSay you want to start scraping a website If you were using bare Selenium you would have to handle the imperative tasks of opening and closing the driver like this from selenium import webdriverdriver path path to chromedriver driver webdriver Chrome executable path driver path driver get driver quit However with Bose Framework you can take a declarative and structured approach You only need to write the following code and Bose driver will take care of creating the driver passing it to the run method of the Task and closing the driver from bose import class Task BaseTask def run self driver driver get ConfigurationIn bare Selenium if you want to configure options such as the profile user agent or window size it requires writing a lot of code as shown below from selenium webdriver chrome options import Optionsfrom selenium import webdriverdriver path path to chromedriver exe options Options profile path options add argument f user data dir profile path user agent Mozilla X Linux x AppleWebKit KHTML like Gecko Chrome Safari options add argument f user agent user agent window width window height options add argument f window size window width window height driver webdriver Chrome executable path driver path options options On the other hand Bose Framework simplifies these complexities by encapsulating the browser configuration within the BrowserConfig property of the Task as shown below from bose import BaseTask BrowserConfig UserAgent WindowSizeclass Task BaseTask browser config BrowserConfig user agent UserAgent user agent window size WindowSize window size profile Exception handlingExceptions are common when using Selenium In bare Selenium if an exception occurs the driver automatically closes leaving you with only logs to debug In Bose when an exception occurs in a scraping task the browser remains open instead of immediately closing This allows you to see the live browser state at the moment the exception occurred which greatly helps in debugging DebuggingWeb scraping can often be fraught with errors such as incorrect selectors or pages that fail to load When debugging with raw Selenium you may have to sift through logs to identify the issue Fortunately Bose makes it simple for you to debug by storing information about each run After each run a directory is created in tasks which contains three files which are listed below task info jsonIt contains information about the task run such as duration for which the task run the ip details of task the user agent window size and profile which used to execute the task final pngThis is the screenshot captured before driver was closed page htmlThis is the html source captured before driver was closed Very useful to know in case your selectors failed to select elements error logIn case your task crashed due to exception we also store error log which contains the error due to which the task crashed This is very helful in debugging Outputting DataAfter performing web scraping we need to store the data in either JSON or CSV format Typically this process involves writing a significant amount of imperative code which looks like this import csvimport jsondef write json data filename with open filename w as fp json dump data fp indent def write csv data filename with open filename w newline encoding utf as csvfile fieldnames data keys get the fieldnames from the first dictionary writer csv DictWriter csvfile fieldnames fieldnames writer writeheader write the header row writer writerows data write each row of datadata text ucThe world as we have created it is a process of our thinking It cannot be changed without changing our thinking ud author Albert Einstein text ucIt is our choices Harry that show what we truly are far more than our abilities ud author J K Rowling write json data data json write csv data data csv Bose simplifies these complexities by encapsulating them in Output Module for reading and writing Data To use Output Method call the write method for the type of file you want to save All data will be saved in the output  folder See following Code for Referencefrom bose import Outputdata text ucThe world as we have created it is a process of our thinking It cannot be changed without changing our thinking ud author Albert Einstein text ucIt is our choices Harry that show what we truly are far more than our abilities ud author J K Rowling Output write json data data json Output write csv data data csv Undetected DriverUltrafunkamsterdam created a ChromeDriver that has excellent support for bypassing all major bot detection systems such as Distil Datadome Cloudflare and others Bose recognized the importance of bypassing bot detections and provides in built support for Ultrafunkamsterdam s Undetected Driver Using the Undetected Driver in Bose Framework is as simple as passing the use undetected driver option to the BrowserConfig like so from bose import BaseTask BrowserConfigclass Task BaseTask browser config BrowserConfig use undetected driver True LocalStorageJust like how modern browsers have a local storage module Bose has also incorporated the same concept in its framework You can import the LocalStorage object from Bose to persist data across browser runs which is extremely useful when scraping large amounts of data The data is stored in a file named local storage json in the root directory of your project Here s how you can use it from bose import LocalStorageLocalStorage set item pages print LocalStorage get item pages Boss DriverThe driver you receive in the run method of the Task is an extended version of Selenium that adds powerful methods to make working with Selenium much easier Some of the popular methods added to the Selenium driver by Bose Framework are METHODDESCRIPTIONget by current page referrer link wait None simulate a visit that appears as if you arrived at the page by clicking a link This approach creates a more natural and less detectable browsing behavior js click element enables you to click on an element using JavaScript bypassing any interceptions ElementClickInterceptedException from pop ups or alertsget cookies and local storage dict returns a dictionary containing cookies and local storage add cookies and local storage dict self site data adds both cookies and local storage data to the current web siteorganic get link wait None visits google and then visits the “link making it less detectablelocal storagereturns an instance of the LocalStorage module for interacting with the browser s local storage in an easy to use mannersave screenshot filename None save a screenshot of the current web page to a file in tasks  directoryshort random sleep  and long random sleep sleep for a random amount of time either between and seconds short or between and seconds long get element or eg get element or none get element or none by selector get element by id get element or none by text contains find web elements on the page based on different criteria They return the web element if it exists or None if it doesn t is in page target wait None raise exception False checks if the browser is in the specified pageBose is an excellent framework that simplifies the boring parts of Selenium and web scraping Wish you best of Luck and Happy Bot Development with Bose Framework Learn MoreTo learn about Bose Bot Development Framework in detail read the Bose docs at If Bose Framework helped in Bot Development please take a moment to star the repository Your act of starring will help developers in discovering our Repository and contribute towards helping fellow developers in Bot Development Dhanyawad Vande Mataram	2023-05-24 16:40:50
Apple	AppleInsider - Frontpage News	Logitech tries to fix hotdesking headaches with $699 Logi Dock Flex	https://appleinsider.com/articles/23/05/24/logitech-tries-to-fix-hotdesking-headaches-with-699-logi-dock-flex?utm_medium=rss	Logitech tries to fix hotdesking headaches with Logi Dock FlexLogitech s latest USB C docking station is designed to make hot desking even easier thanks to new built in desk booking software Logitech s Logi Dock FlexThe Logi Dock Flex is an all in one USB C docking station built specifically to alleviate some of the stresses of hybrid work environments The standout feature something not typically available on standard docking stations is the eight inch display that sits above the base with all the ports Read more	2023-05-24 16:43:58
Apple	AppleInsider - Frontpage News	Rode introduces the PodMic USB microphone for podcasters & streamers	https://appleinsider.com/articles/23/05/24/rode-introduces-the-podmic-usb-microphone-for-podcasters-streamers?utm_medium=rss	Rode introduces the PodMic USB microphone for podcasters amp streamersExplicitly designed for podcasters and streamers the PodMic USB by Rode is a versatile microphone that provides effortless plug and play functionality delivering exceptional audio quality New PodMic USB from RodeBuilding upon the original PodMic which has become a top choice for podcasters streamers and content creators the PodMic USB sets new benchmarks in versatility Read more	2023-05-24 16:03:31
海外TECH	CodeProject Latest Articles	Chat GPT in JavaScript	https://www.codeproject.com/Articles/5350454/Chat-GPT-in-JavaScript	javascriptweb	2023-05-24 16:40:00
金融	金融庁ホームページ	「保険会社の新たな健全性規制の導入に係る市場への影響度調査」の結果について公表しました。	https://www.fsa.go.jp/common/about/research/20230524-2/20230524-2.html	保険会社	2023-05-24 17:00:00
金融	金融庁ホームページ	「インパクト投資等に関する検討会」（第８回）を開催します。	https://www.fsa.go.jp/news/r4/singi/20230524.html	検討会	2023-05-24 17:00:00
ニュース	BBC News - Home	Penny Mordaunt's sword becomes Tower attraction	https://www.bbc.co.uk/news/uk-65700045?at_medium=RSS&at_campaign=KARANGA	coronation	2023-05-24 16:34:02
ニュース	BBC News - Home	Homeowners face huge interest rate shock, says Barclays boss	https://www.bbc.co.uk/news/business-65696265?at_medium=RSS&at_campaign=KARANGA	bossbarclays	2023-05-24 16:51:58
ニュース	BBC News - Home	King Charles holds private meeting with John Caldwell	https://www.bbc.co.uk/news/uk-northern-ireland-65697128?at_medium=RSS&at_campaign=KARANGA	castle	2023-05-24 16:23:51
ニュース	BBC News - Home	Miami zoo apologises for mistreatment of iconic kiwi bird	https://www.bbc.co.uk/news/world-us-canada-65694168?at_medium=RSS&at_campaign=KARANGA	outrage	2023-05-24 16:12:02
ニュース	BBC News - Home	Rachael Blackmore: Irish jockey given five-day ban for controversial Kilbeggan ride	https://www.bbc.co.uk/sport/horse-racing/65700419?at_medium=RSS&at_campaign=KARANGA	Rachael Blackmore Irish jockey given five day ban for controversial Kilbeggan rideRachael Blackmore is suspended for a ride at Kilbeggan where she was found to have mistaken the winning post a circuit too early having initially been cleared of breaching rules	2023-05-24 16:17:55
ニュース	BBC News - Home	Giro d'Italia: Alberto Dainese sprints to victory on stage 17 as Geraint Thomas retains overall lead	https://www.bbc.co.uk/sport/cycling/65701617?at_medium=RSS&at_campaign=KARANGA	Giro d x Italia Alberto Dainese sprints to victory on stage as Geraint Thomas retains overall leadItaly s Alberto Dainese sprints to victory in a photo finish to stage at the Giro d Italia as Britain s Geraint Thomas retains the overall race lead	2023-05-24 16:51:22
ビジネス	ダイヤモンド・オンライン - 新着記事	韓国、ウクライナ砲弾供与へ前進　米要請で方針転換 - WSJ発	https://diamond.jp/articles/-/323437	韓国	2023-05-25 01:10:00
Azure	Azure の更新情報	Azure Stream Analytics is Launching a New Competitive Pricing Model!	https://azure.microsoft.com/ja-jp/updates/azure-stream-analytics-is-launching-a-new-competitive-pricing-model/	analytics	2023-05-24 17:00:18