投稿時間:2023-08-29 15:24:08 RSSフィード2023-08-29 15:00 分まとめ(30件)

カテゴリー等	サイト名等	記事タイトル・トレンドワード等	リンクURL	頻出ワード・要約等/検索ボリューム	登録日
IT	ITmedia 総合記事一覧	[ITmedia ビジネスオンライン] 全国「住みここち」ランキング　3位「兵庫県芦屋市」、2位「愛知県長久手市」、1位は？	https://www.itmedia.co.jp/business/articles/2308/29/news077.html	itmedia	2023-08-29 14:48:00
IT	ITmedia 総合記事一覧	[ITmedia PC USER] アドビ、デザインツール「Adobe Express」とnoteの連携機能を告知	https://www.itmedia.co.jp/pcuser/articles/2308/29/news140.html	adobe	2023-08-29 14:38:00
IT	ITmedia 総合記事一覧	[ITmedia News] 「VIVANT」ドラムのLINEスタンプ発売　フルボイスで「超キケン！　超キケン！」　CV：林原めぐみ	https://www.itmedia.co.jp/news/articles/2308/29/news138.html	itmedia	2023-08-29 14:32:00
IT	ITmedia 総合記事一覧	[ITmedia エンタープライズ] PaLM 2が日本語対応　ソフトバンクやニトリらがプレビュー版を利用開始	https://www.itmedia.co.jp/enterprise/articles/2308/29/news110.html	codey	2023-08-29 14:10:00
IT	ITmedia 総合記事一覧	[ITmedia PC USER] レノボ、Ryzen Proを採用した14型/16型モバイルワークステーション	https://www.itmedia.co.jp/pcuser/articles/2308/29/news137.html	itmediapcuser	2023-08-29 14:10:00
IT	ITmedia 総合記事一覧	[ITmedia ビジネスオンライン] 池袋の「顔」どうなる？　セブンの売却計画に労組反発　交渉決裂なら長期化も	https://www.itmedia.co.jp/business/articles/2308/29/news136.html	itmedia	2023-08-29 14:05:00
python	Pythonタグが付けられた新着投稿 - Qiita	拡張ユークリッドの互除法を実装しよう	https://qiita.com/luuguas/items/1c0bc4fb7a5d8c7f3c07	競技プログラミング	2023-08-29 14:31:51
python	Pythonタグが付けられた新着投稿 - Qiita	Vertex AIのPython APIによる利用(Workbench/Colab)	https://qiita.com/khoshina/items/7f6bc91963a163a3a2c6	googlecolab	2023-08-29 14:00:15
js	JavaScriptタグが付けられた新着投稿 - Qiita	HuTime Web APIを使って和暦と西暦を変換する	https://qiita.com/kyoumikun4900/items/c105a9e35b395e697c85	hutimewebapi	2023-08-29 14:02:21
Ruby	Rubyタグが付けられた新着投稿 - Qiita	viewファイルのrenderメソッドについて【虎の巻】	https://qiita.com/iijima-naoya-45b/items/d51be3215c6f7e338865	rails	2023-08-29 14:19:34
AWS	AWSタグが付けられた新着投稿 - Qiita	プライベートサブネットでECS Fargateを利用する際のつまずきポイント	https://qiita.com/SF-28/items/e3e09dd7becf205884d1	ecsfarg	2023-08-29 14:51:04
Ruby	Railsタグが付けられた新着投稿 - Qiita	viewファイルのrenderメソッドについて【虎の巻】	https://qiita.com/iijima-naoya-45b/items/d51be3215c6f7e338865	rails	2023-08-29 14:19:34
技術ブログ	Developers.IO	2023年末にサポート終了となるprovidedランタイムを利用しているAWS Lambda関数をprovided.al2に移行しました	https://dev.classmethod.jp/articles/migrate-aws-lambda-function-provided-to-providedal2/	amazon	2023-08-29 05:30:55
技術ブログ	Developers.IO	VPC Lambdaをパブリックサブネットで構成してもパブリックIPが付与されずインターネットアクセスできない	https://dev.classmethod.jp/articles/20230829-vpc-lambda/	vpclambda	2023-08-29 05:06:40
海外TECH	DEV Community	Understanding DBT (Data Build Tool): An Introduction	https://dev.to/mage_ai/understanding-dbt-data-build-tool-an-introduction-1e43	Understanding DBT Data Build Tool An IntroductionGuest blog by Shashank Mishra Data Engineer Expedia TLDRDBT Data Build Tool is an open source software tool that enables data analysts and engineers to transform and model data in the data warehouse It simplifies the ETL process by focusing on the T ーtransformation ーand integrates seamlessly with modern cloud based data platforms OutlineOverview of DBTCore principles of DBTDBT architectureChallenges with DBTConclusion Overview of DBTDBT Data Build Tool is an open source tool that has revolutionized the way data analysts and engineers view and handle data transformation and modeling in the modern data stack Here s an overview of DBT Philosophy Focuses on the ELT Extract Load Transform approach leveraging modern cloud data warehouses Core Components Models SQL queries that define data transformations Tests Ensure data quality by validating models Snapshots Track historical changes in data Documentation Auto generates documentation for clarity on data processes Development Workflow Developer centric with version control typically Git branching and pull requests Execution Compiles models into SQL and runs them directly on data warehouses like Snowflake BigQuery and Redshift Adapters Makes DBT versatile by connecting to various databases and data platforms Source Giphy Core principles of DBTDBT Data Build Tool operates on a set of core principles that guide its philosophy and approach to data transformation and modeling Data Warehouse Centric Raw data is ingested into the data warehouse using its computational capabilities for in database transformations This principle capitalizes on modern warehouses like Snowflake BigQuery or Redshift for heavy computations ELT Workflow Instead of pre transforming data ETL DBT supports ELT where raw data is loaded into the data warehouse Extract Load and then transformed using SQL based models Transform SQL as the DSL DBT uses SQL as its domain specific language This eliminates the need for proprietary transformation languages or GUI based ETL tools providing direct and transparent transformation logic Git based Version Control DBT projects are typically version controlled using Git allowing for branch based development commit histories and collaboration through pull requests Model Dependencies Models written in SQL can reference other models ref function This creates a DAG Directed Acyclic Graph of dependencies which DBT uses to run models in the correct order Data Testing DBT s schema tests e g unique not null accepted values validate the integrity of the transformed data Custom data tests can also be written in SQL to enforce specific business rules or constraints Jinja Templating DBT uses the Jinja templating engine This allows for dynamic SQL code generation loops conditional logic and macro creation for reusable SQL snippets CLI and API Integration DBT s command line interface CLI supports operations like run test and docs generate It can also be integrated with CI CD tools and other platforms through APIs Configurations amp Hooks Technical configurations can be set at the project model or global level dbt project yml Pre and post hooks allow for operations like data quality checks or audit trails to be executed before or after a model runs Extensibility with Adapters DBT s architecture allows for custom adapters While it comes with adapters for popular data platforms the community or organizations can develop adapters for other platforms ensuring wide compatibility By emphasizing these technical principles and functionalities DBT provides a powerful and flexible framework for data engineers and analysts to manage data transformations with precision and efficiency Source Giphy DBT architectureDBT Data Build Tool employs a unique architecture that sets it apart from traditional ETL tools and frameworks At its core DBT is a command line tool that uses SQL and Jinja templating to transform and model data Let s break down its architecture Command Line Interface CLI Central Control DBT is primarily operated through its command line interface allowing users to run commands for transformations dbt run testing dbt test and documentation generation dbt docs generate SQL Jinja Templating Dynamic SQL Generation By combining SQL with the Jinja templating engine DBT allows for dynamic SQL code generation This lets users incorporate loops conditional logic and macros into their transformation logic Projects and Configuration DBT Project The foundational unit in DBT It contains models tests snapshots macros and the essential dbt project yml configuration file Configuration Files These YAML files dbt project yml profiles yml etc define project details model configurations and database connections Models amp Directed Acyclic Graph DAG Models SQL files that represent the transformation logic DAG DBT builds a DAG of model dependencies using the ref function in models The DAG determines the execution order when running transformations Adapters Database Compatibility DBT uses adapters to connect and interface with different data platforms like Snowflake BigQuery and Redshift Adapters translate DBT s generic SQL into database specific SQL Testing Framework Built in amp Custom Tests DBT supports both built in tests like unique or not null and custom tests defined in SQL ensuring data quality and conformity to business rules Version Control Integration Git Integration DBT projects are typically stored in Git repositories enabling collaboration versioning and branching Documentation Auto generation DBT automatically generates a web based documentation portal that visualizes model metadata lineage and descriptions Plugins and Extensibility Community Plugins DBT s architecture allows for extensions and the community has contributed various plugins adding functionality and compatibility with other tools Runtime Environment In database Computation Unlike ETL tools that may have their own computation engines DBT compiles and runs SQL directly in the target data warehouse leveraging its computational power for transformations Source Giphy Challenges with DBTWhile DBT Data Build Tool has gained substantial popularity due to its approach to data transformation it is not without its technical challenges especially when viewed in the context of the broader data pipeline design Initial Data Ingestion DBT focuses mainly on the transformation T part of the ELT process The extraction E and load L phases are out of its scope requiring other tools or manual setups to ingest data into the data warehouse Complex Dependency Management As DBT projects grow managing model dependencies DAG can become complex Ensuring models run in the right order without causing circular dependencies is crucial and can be challenging in large projects Performance Considerations Relying on the computational power of the data warehouse for transformations can lead to increased costs especially if not optimized Some transformations might be less efficient in SQL compared to other data processing languages or tools Concurrency and Parallelism Handling concurrent DBT runs or ensuring that parallel transformations don t interfere with each other can be challenging There s a need to fine tune data warehouse configurations and manage resource contention Incremental Processing While DBT supports incremental models designing them effectively requires careful consideration to ensure data integrity and avoid data duplication Real time Data Processing DBT is batch oriented by design Real time or near real time data processing pipelines might need additional tools or configurations outside of DBT s standard capabilities Integration with External Tools DBT s ecosystem is primarily SQL focused Integrating with non SQL tools or platforms might require additional effort or custom plugins Operational Monitoring and Alerting Out of the box DBT does not provide comprehensive monitoring or alerting mechanisms for transformations Integration with monitoring tools or building custom alert systems might be necessary Error Handling Granular error handling especially for non fatal issues can be complex DBT will fail a run if a model encounters an error requiring manual intervention or a robust orchestration tool to manage failures Security and Compliance Ensuring that DBT processes adhere to data governance security and compliance requirements might necessitate additional configurations especially when working with sensitive data Scalability As data volume grows some DBT models might need refactoring or optimization to maintain performance This requires ongoing maintenance and tuning Source Giphy ConclusionIn the ever evolving landscape of data processing and analytics DBT emerges as a powerful tool that merges software engineering best practices with data operations Its ELT centric approach modular design and emphasis on code and collaboration make it an attractive solution for modern data teams Yet like any tool it is not without its challenges Factors like dependency management real time processing and scalability require thoughtful consideration in the broader context of data pipeline design With proper planning and awareness of its intricacies DBT can be a pivotal element in a data team s toolkit driving efficiency transparency and reliability in data transformations As with all tools a balance of its strengths against its challenges is essential in leveraging its full potential effectively Link to the original blog	2023-08-29 05:39:29
海外TECH	Engadget	Max will stream 'Fear the Walking Dead,' 'Killing Eve' and other AMC+ shows	https://www.engadget.com/max-will-stream-fear-the-walking-dead-killing-eve-and-other-amc-shows-055138723.html?src=rss	Max will stream x Fear the Walking Dead x x Killing Eve x and other AMC showsMax formerly known as HBO Max will give subscribers access to several AMC shows at least for a limited time The streaming service has struck a deal with AMC to feature some of its more recent programming from September st to October st According to CNBC and Variety their deal encompasses over episodes from titles that include Fear the Walking Dead Anne Rice s Interview With the Vampire and Killing Eve AMC will even make more of its shows available through Max this fall nbsp While the network has its own streaming service called AMC it s been struggling to make money off it and to keep up with rival providers When company chairman James Dolan sent a memo to staff members in the midst of layoffs last year he wrote It was our belief that cord cutting losses would be offset by gains in streaming This has not been the case AMC s programs will be marked as such on the Max app and will be listed in a tab labeled as AMC Picks on Max They will be available to both ad free and ad supported Max subscribers though the AMC titles will reportedly not include commercials and ads HBO EVP Meredith Gertler said t he AMC collection pop up is an excellent example of how the company can use innovative strategies to add value to its content offering nbsp The parties have yet to announce the other titles arriving on Max this fall but CNBC says they will not include AMC s biggest shows such as Mad Men and The Walking Dead Breaking Bad and Better Call Saul which also won t be making their way to Max are already licensed to Netflix nbsp This article originally appeared on Engadget at	2023-08-29 05:51:38
医療系	医療介護 CBnews	サイバーセキュリティー対策の負担増を診療報酬で-行政の積極支援を提言、日医総研	https://www.cbnews.jp/news/entry/20230829135204	医療機関	2023-08-29 14:30:00
金融	ニッセイ基礎研究所	とかく性比はままならない－社会から兄が消える !?	https://www.nli-research.co.jp/topics_detail1/id=75931?site=nli	nbsp人口性比パズルある国では、「男児が生まれた家庭は、それ以上、子をなしてはならない」とする法律を制定した。	2023-08-29 14:57:50
ニュース	BBC News - Home	UK flights remain significantly disrupted after air traffic fault	https://www.bbc.co.uk/news/uk-66637156?at_medium=RSS&at_campaign=KARANGA	delays	2023-08-29 05:23:50
ニュース	BBC News - Home	Notting Hill Carnival celebrates Windrush legacy in blaze of colour	https://www.bbc.co.uk/news/uk-england-london-66641205?at_medium=RSS&at_campaign=KARANGA	caribbean	2023-08-29 05:23:30
ニュース	BBC News - Home	Anna Wintour: Vogue editor says 'art scene is so important' to UK	https://www.bbc.co.uk/news/entertainment-arts-66604603?at_medium=RSS&at_campaign=KARANGA	difficulties	2023-08-29 05:31:22
ニュース	BBC News - Home	Toyota halts all Japan assembly plants due to glitch	https://www.bbc.co.uk/news/business-66643936?at_medium=RSS&at_campaign=KARANGA	attack	2023-08-29 05:35:18
ニュース	BBC News - Home	The Papers: Air traffic 'chaos' in UK could last for days	https://www.bbc.co.uk/news/blogs-the-papers-66642863?at_medium=RSS&at_campaign=KARANGA	failure	2023-08-29 05:21:55
ニュース	BBC News - Home	Covid in Scotland: Families demand apology over care home ban	https://www.bbc.co.uk/news/uk-scotland-66617352?at_medium=RSS&at_campaign=KARANGA	pandemic	2023-08-29 05:14:50
ニュース	BBC News - Home	US Open 2023: Novak Djokovic to replace Carlos Alcaraz as world number one after win	https://www.bbc.co.uk/sport/tennis/66643632?at_medium=RSS&at_campaign=KARANGA	US Open Novak Djokovic to replace Carlos Alcaraz as world number one after winNovak Djokovic will replace young rival Carlos Alcaraz as the men s world number one after a routine win on his US Open return	2023-08-29 05:20:16
IT	週刊アスキー	横浜がふたたび光に包まれる！ 横浜都心臨海部で「夜にあらわれる光の横浜〈ヨルノヨ2023〉」開催決定	https://weekly.ascii.jp/elem/000/004/152/4152663/	開催決定	2023-08-29 14:45:00
IT	週刊アスキー	『ファーランドストーリー 白銀の翼（PC-9801版）』が「プロジェクトEGG」でリリース！	https://weekly.ascii.jp/elem/000/004/152/4152710/	配信サービス	2023-08-29 14:45:00
IT	週刊アスキー	横浜ハンマーヘッド内「鎌倉紅谷 Kurumicco Factory The Cafe」、マロンや紅はるかを使った秋季限定メニューを9月1日より販売	https://weekly.ascii.jp/elem/000/004/152/4152677/	kurumiccofactorythecafe	2023-08-29 14:30:00
IT	週刊アスキー	迷惑電話で困っているすべての人に知ってほしい、着信拒否のやり方まとめ	https://weekly.ascii.jp/elem/000/004/152/4152702/	固定電話	2023-08-29 14:30:00
IT	週刊アスキー	NTTPC、IoT向け閉域型SaaS「エッジマネジメントサービス」開始	https://weekly.ascii.jp/elem/000/004/152/4152661/	提供開始	2023-08-29 14:15:00