IT |
ITmedia 総合記事一覧 |
[ITmedia Mobile] ドコモ、6月1日失効分のdポイントを再進呈 「d払い」障害を受け |
https://www.itmedia.co.jp/mobile/articles/2106/02/news160.html
|
itmediamobile |
2021-06-02 20:43:00 |
IT |
ITmedia 総合記事一覧 |
[ITmedia ビジネスオンライン] 畳一枚分の仕事部屋 会社が支払って、自宅で「おひとりさま用」を |
https://www.itmedia.co.jp/business/articles/2106/02/news159.html
|
itmedia |
2021-06-02 20:30:00 |
IT |
MOONGIFT |
Slidev - 開発者のためのスライドツール |
http://feedproxy.google.com/~r/moongift/~3/kkZVgXOmUBA/
|
slidev |
2021-06-02 21:00:00 |
AWS |
AWS Japan Blog |
AWS WAF が大阪リージョンでご利用いただけるようになりました |
https://aws.amazon.com/jp/blogs/news/aws-waf-osaka/
|
AWSWAFが大阪リージョンでご利用いただけるようになりましたみなさん、こんにちは。 |
2021-06-02 11:41:14 |
python |
Pythonタグが付けられた新着投稿 - Qiita |
Ubuntu 18.04 で python の venv をインストールしたメモ |
https://qiita.com/blueskyarea/items/650bd9c9d7867b9f0540
|
pythonmvenvwithoutpipmyvenvcdmyvenv仮想環境を有効化します。 |
2021-06-02 20:28:29 |
python |
Pythonタグが付けられた新着投稿 - Qiita |
残人生60年のためのプログラミング 第21914回 |
https://qiita.com/R1nY1x1/items/7927df878b7d9ce05fdd
|
|
2021-06-02 20:27:25 |
Program |
[全てのタグ]の新着質問一覧|teratail(テラテイル) |
【GAS】日付①と日付②を合体してシート名にする方法 |
https://teratail.com/questions/341806?rss=all
|
【GAS】日付①と日付②を合体してシート名にする方法前提・実現したいこと基本的な質問でしたら申し訳ありません。 |
2021-06-02 20:47:15 |
Program |
[全てのタグ]の新着質問一覧|teratail(テラテイル) |
matplotlibの棒グラフでy軸が金額表示になりません。 |
https://teratail.com/questions/341805?rss=all
|
matplotlibの棒グラフでy軸が金額表示になりません。 |
2021-06-02 20:40:30 |
Program |
[全てのタグ]の新着質問一覧|teratail(テラテイル) |
正規表現を使用してリストから検索をかける |
https://teratail.com/questions/341804?rss=all
|
正規表現を使用してリストから検索をかける前提・実現したいこと正規表現を使用して大規模なリストの中から検索をかけて一致したもの全てを出力させたいです。 |
2021-06-02 20:39:44 |
Program |
[全てのタグ]の新着質問一覧|teratail(テラテイル) |
seabornで箱ひげ図を複数作成して表示したい |
https://teratail.com/questions/341803?rss=all
|
seabornで箱ひげ図を複数作成して表示したい問題以下のようなDataFrameがあるとします。 |
2021-06-02 20:35:04 |
Program |
[全てのタグ]の新着質問一覧|teratail(テラテイル) |
if文が表している内容と定義した値の意味 |
https://teratail.com/questions/341802?rss=all
|
|
2021-06-02 20:30:35 |
Program |
[全てのタグ]の新着質問一覧|teratail(テラテイル) |
内部表現から計算式の結果を求める |
https://teratail.com/questions/341801?rss=all
|
|
2021-06-02 20:25:05 |
Program |
[全てのタグ]の新着質問一覧|teratail(テラテイル) |
main関数内での配列の要素数とユーザー関数の要素数が一致しない。 |
https://teratail.com/questions/341800?rss=all
|
main関数内での配列の要素数とユーザー関数の要素数が一致しない。 |
2021-06-02 20:19:20 |
Program |
[全てのタグ]の新着質問一覧|teratail(テラテイル) |
enumを利用して、入力した値ごとに処理を分けたい |
https://teratail.com/questions/341799?rss=all
|
enumを利用して、入力した値ごとに処理を分けたいjava初心者です。 |
2021-06-02 20:16:12 |
Program |
[全てのタグ]の新着質問一覧|teratail(テラテイル) |
[Rails]中間テーブルを経由したデータ取得のエラー Unknown column |
https://teratail.com/questions/341798?rss=all
|
Rails中間テーブルを経由したデータ取得のエラーUnknowncolumn前提・実現したいことRubynbsponnbspRailsで、ねこ特化型のインスタグラムのようなアプリを作っています。 |
2021-06-02 20:02:28 |
Ruby |
Rubyタグが付けられた新着投稿 - Qiita |
Ruby 問題⑨ クラスとインスタンスの概念を用いたコードの作成 |
https://qiita.com/N396184501/items/17905fad2666b53c6b0e
|
Ruby問題⑨クラスとインスタンスの概念を用いたコードの作成はじめに月になりました。 |
2021-06-02 20:23:24 |
AWS |
AWSタグが付けられた新着投稿 - Qiita |
【AWS】S3の整合性モデルとアクセス管理 |
https://qiita.com/mzmz__02/items/0f39bd16c9e5f63a712c
|
ACLバケットと個々のオブジェクトへのアクセス権限をXMLで設定する。 |
2021-06-02 20:33:30 |
技術ブログ |
Developers.IO |
RedashのデータソースへMySQL(Amazon RDS)追加時にハマったことについて書いてみた |
https://dev.classmethod.jp/articles/trap-on-redash-connect-test/
|
amazon |
2021-06-02 11:42:59 |
海外TECH |
DEV Community |
Architecture options for building a basic Data Lake on AWS - Part 1 |
https://dev.to/aws-builders/architecture-options-for-building-a-basic-data-lake-on-aws-part-1-18hc
|
Architecture options for building a basic Data Lake on AWS Part This article is a result of a chat discussion with aditmodi Willian Bill Rocha Kevin Peng Rich Dudley Patrick Orwat and Welly Tambunan Any other contributors are welcome The data lake is the key foundation of data analytics The data lake is the central repository that can store both structured data such as tabular or relational data semi structured key value or document and unstructured data such as pictures or audio The data lake is scalable and provides the following functionalities all data stored in a single place with a low cost modelvariety of data formats can be storeda fast data ingestion and consumptionschema on read versus the traditional schema on writedecoupling between storage and computeBuilding a data lake implies to setup the right storage and the corresponding lifecycle management define the solution for data movementclean catalog and prepare the dataconfigure policies and a governance make data available for visualization The data lake is very powerful solution for big data but there are some limitations data management is challenging with data lakes because they store data as a “bunch of files of different formatmanaging ACID transactions or rollback requires to write a specific ETL ELT logicquery performance implies to select wisely the data format such as Parquet or ORC A first alternative is the lakehouse architecture which bring the best of worlds data lake low cost object store and datawarehouse transactions and data management The lakehouse provides a metadata layer on top of the data lake or object storage that defines which objects are part of a table version The lakehouse allows to manage ACID transactions through the metadata layer while keeping the data stored in the low cost data lake storage Another alternative that fits well in a complex and distributed environments is the data mesh architecture Unlike a “monolithic central data lake which handle in one place consumption storage and transformation a data mesh architecture supports distributed domain specific data consumers and views “data as a product with each domain handling their own data pipelines The domains are all connected through an interoperability layer that applies the same syntax and data standards The data mesh architecture is based on few principles Domain oriented data owners and pipelinesSelf serve functionalityInteroperability and standardization of communicationsThis decentralized architecture brings more autonomy and flexibility Each data architecture model has benefits and shortcomings there is no good and bad approach it depends on the context and the use cases Let s evaluate how these data architecture patterns can be applied using a concrete example Requirements for a data platformYour company needs a data repository with the following expectations ingest data manually or from data pipelinesproduce ML models QuickSight dashboard or external API with the output dataWhat is the best AWS architecture for these requirements Data Lake architectureThe diagram below presents a first solution for the requirements The AWS data lake architecture is based on several components The data ingestion collection enables to connect different data sources through batch or real time modes ServicesUsageAWS Data Migration Servicesone time migration of a database cloud or on premise and replicate on going changesAWS Transfer Familytransfer of data over SFTP ️article dev toKinesis Firehosefully managed delivering of real time streaming data to Amazon S ️article dev toAWS Lambdaserverless and event based data integration The data storage enables to hold massive amount of data in raw format That s the core of the data lake The best storage service for this purpose is Amazon S As highlighted in the diagram the best approach is to create specific buckets for landing zone raw data and cleaned data The data cleaning and preparation implies to partition index catalog and transform data especially into a columnar format for performance optimization The data catalog will be automatically created or updated through a crawler that extracts the schemas and adds metadata tags in the catalog The AWS options are AWS Glue or Glue DataBrew ServicesUsageAWS GlueETL ELT that can extract both data and metadata to build catalogs and perform transformations You can either use the UI or author your scripts in Python Spark and ScalaAWS Glue DataBrewis a visual data prep tool that enables to profile transform clean and normalize dataYou can also use other ETL tools such as Amundsen for an intuitive UI and business data cataloguing The solution Talend can be also an option The data processing and analytics is the process that creates insights from data following the rule « garbage in garbage out »it is recommended to use cleaned data to get the best insights The data will be structured and analyzed to identify information or to support decision making The data processing can be done through batch mode interactive analysis streaming or machine learning Batch modeServicesQuerying or processing large amount of data on a regular frequency daily weekly or monthly AWS Glue EMR RedshiftInteractive analysisServicesAd hoc querying for data exploration and analysisAthenaStreamingServicesIngest and analyze a sequence of data continuously generated in high volume and or high velocityKinesis Data AnalyticsMachine LearningServicesPerform on demand data computation using inference endpointsSagemaker Inferences ️article dev toBased on the data lake requirements the first approach for the data Analytics amp processing leverages the following AWS services Athena for interactive analysis Athena is a serverless querying service based on Apache Presto that enables to build SQL queries against relational or non relational data stored in Amazon S even outside S with Athena Federated Query Athena is adapted for use cases such as ad hoc queries data exploration or integration with BI tools Sagemaker Inferences for machine learning That service allows to execute ML models deployed through Sagemaker Endpoints This architecture provides also the possibility to expose some data through API Gateway using Lambda function and Athena Another option for the data lake architecture is to use Redshift as a curated datawarehouse This approach will be described in the part “the lakehouse architecture data visualization is the tool that provides a view of the data for your data consumers The purpose of Amazon QuickSight is to empower your data consumers especially the business users for building their visualization QuickSight is powered by SPICE Super Fast Parallel In Memory Calculation Engine and provides the possibility to build easily dashboards and share it with other users As highlighted in the proposed architecture QuickSight is integrated with Athena but it can be integrated with other data sources This article provides only an high level view of the topic for more information I recommend these very useful dev to posts Building a data lake with Terraform by valaug Presentation of the Big Data Portfolio by klescosia |
2021-06-02 11:21:53 |
Apple |
AppleInsider - Frontpage News |
New job ad suggests Apple launching 'homeOS' |
https://appleinsider.com/articles/21/06/02/new-job-ad-suggests-apple-launching-homeos?utm_medium=rss
|
New job ad suggests Apple launching x homeOS x An Apple Music job posting refers to a previously unknown homeOS in its listing of Apple s mobile platforms Apple may be about to reveal a new OSA previously unannounced additional homeOS platform has been mentioned in the job description for a software engineer working in Apple Music Originally spotted by Twitter users and now confirmed by AppleInsider the listing makes two references to the new OS Read more |
2021-06-02 11:40:18 |
Apple |
AppleInsider - Frontpage News |
Tim Cook to speak at Europe's VivaTech conference |
https://appleinsider.com/articles/21/06/02/tim-cook-to-speak-at-europes-vivatech-conference?utm_medium=rss
|
Tim Cook to speak at Europe x s VivaTech conferenceTim Cook has been announced as a guest speaker at Europe s biggest startup and tech event Viva Tech just after Apple s WWDC Tim CookThe fifth annual VivaTech conference postponed from because of the coronavirus is to headline Tim Cook The organizers have yet to confirm whether Cook will appear online or in person at its Paris event which runs from Wednesday June to Saturday June Read more |
2021-06-02 11:21:55 |
海外TECH |
Engadget |
Ikea and Sonos' next 'Symfonisk' could be a picture frame speaker |
https://www.engadget.com/ikea-sonos-symfonisk-speaker-photo-frame-113340658.html?src=rss_b2c
|
website |
2021-06-02 11:33:40 |
海外TECH |
Engadget |
The Morning After: AMD and Samsung will bring ray-tracing graphics to smartphones |
https://www.engadget.com/the-morning-after-amd-and-samsung-ray-tracing-smartphones-112506143.html?src=rss_b2c
|
The Morning After AMD and Samsung will bring ray tracing graphics to smartphonesSpaceX s first ocean spaceport could be ready by AMD and Samsung are collaborating on Exynos mobile chips capable of ray tracing andAmazon Prime Day kicks off on June st |
2021-06-02 11:25:06 |
海外TECH |
Engadget |
Garmin's latest premium running watch can automatically call for help |
https://www.engadget.com/garmin-smartwatch-forerunner-55-945-lte-110044116.html?src=rss_b2c
|
forerunner |
2021-06-02 11:00:44 |
海外科学 |
NYT > Science |
Here Are America’s Top Methane Emitters. Some Will Surprise You. |
https://www.nytimes.com/2021/06/02/climate/biggest-methane-emitters.html
|
public |
2021-06-02 11:46:52 |
医療系 |
医療介護 CBnews |
新型コロナの抗体量、がん患者は減少-国がん、積極的なワクチン接種呼び掛け |
https://www.cbnews.jp/news/entry/20210602202106
|
国立がん研究センター |
2021-06-02 20:30:00 |
医療系 |
医療介護 CBnews |
看護職員らの処遇改善など要望-日看協、さらなる経営支援も |
https://www.cbnews.jp/news/entry/20210602195119
|
厚生労働相 |
2021-06-02 20:20:00 |
ニュース |
BBC News - Home |
Covid-19: School catch-up plans in 'damp squib' funding row |
https://www.bbc.co.uk/news/education-57320450
|
england |
2021-06-02 11:43:07 |
ニュース |
BBC News - Home |
Fears as chemical-laden ship sinking off Sri Lanka |
https://www.bbc.co.uk/news/world-asia-57327300
|
marine |
2021-06-02 11:43:13 |
ニュース |
BBC News - Home |
Queen's Platinum Jubilee plans unveiled by Buckingham Palace |
https://www.bbc.co.uk/news/uk-57329680
|
reign |
2021-06-02 11:27:13 |
ニュース |
BBC News - Home |
Holby City: BBC medical drama to end in 2022 |
https://www.bbc.co.uk/news/entertainment-arts-57330559
|
casualty |
2021-06-02 11:28:29 |
ニュース |
BBC News - Home |
Member of banned group breached anti-terror order for sex, court hears |
https://www.bbc.co.uk/news/uk-57330519
|
prevention |
2021-06-02 11:47:52 |
ニュース |
BBC News - Home |
Malala on Vogue cover: ‘I know power in a young girl’s heart’ |
https://www.bbc.co.uk/news/world-57317225
|
mcdonald |
2021-06-02 11:44:20 |
ニュース |
BBC News - Home |
Kasatkina knocks out 10th seed Bencic on day four of French Open |
https://www.bbc.co.uk/sport/tennis/57331210
|
belinda |
2021-06-02 11:09:51 |
ニュース |
BBC News - Home |
England v New Zealand: England's Ollie Robinson bowls Tom Latham |
https://www.bbc.co.uk/sport/av/cricket/57329308
|
England v New Zealand England x s Ollie Robinson bowls Tom LathamEngland s Ollie Robinson takes the first wicket of the match and the first Test wicket of his career dismissing New Zealand s Tom Latham for at Lord s |
2021-06-02 11:55:23 |
ニュース |
BBC News - Home |
Covid: What's the roadmap for lifting lockdown? |
https://www.bbc.co.uk/news/explainers-52530518
|
covid |
2021-06-02 11:24:42 |
ビジネス |
ダイヤモンド・オンライン - 新着記事 |
配当が減らない“隠れ増配株”ランキング上位20銘柄を 紹介! 減配をせずに、配当を維持・増配し続けている 「非減配」期間が長い優良な安定配当株ランキング! - 配当【増配・減配】最新ニュース! |
https://diamond.jp/articles/-/239295
|
|
2021-06-02 20:50:00 |
ビジネス |
ダイヤモンド・オンライン - 新着記事 |
酒井重工業(6358)、「増配」を発表して、配当利回り 5.19%に! 年間配当は1年で1.5倍に急増し、2022年 3月期は前期比40円増の「1株あたり120円」に増額へ! - 配当【増配・減配】最新ニュース! |
https://diamond.jp/articles/-/273024
|
|
2021-06-02 20:30:00 |
GCP |
Google Cloud Platform Japan 公式ブログ |
Google Cloud で使用許可取得済みの市場データを検出、アクセス、分析する金融サービス向けの Datashare ソリューションのご紹介 |
https://cloud.google.com/blog/ja/topics/financial-services/announcing-the-general-availability-of-datashare/
|
このメカニズムにより、データパブリッシャーはBigQueryを介して参照データ、過去のティックデータ、代替市場データソースなどを配信でき、データコンシューマがデータから分析情報を抽出するための管理上の負担が軽減されます。 |
2021-06-02 13:00:00 |
北海道 |
北海道新聞 |
高齢者接種、「7月完了」98% 政府調査で自治体見込み |
https://www.hokkaido-np.co.jp/article/551055/
|
高齢者 |
2021-06-02 20:08:00 |
北海道 |
北海道新聞 |
旭川9人コロナ感染 医療現場なお逼迫 保健所「気を緩めないで」 |
https://www.hokkaido-np.co.jp/article/550944/
|
新型コロナウイルス |
2021-06-02 20:01:08 |
ビジネス |
東洋経済オンライン |
配車サービス「滴滴」自動運転車製造に参入の狙い 広州汽車集団傘下の新エネ車企業と戦略的提携 | 「財新」中国Biz&Tech | 東洋経済オンライン |
https://toyokeizai.net/articles/-/430727?utm_source=rss&utm_medium=http&utm_campaign=link_back
|
biztech |
2021-06-02 20:30:00 |
ニュース |
Newsweek |
中国の若者に広まる「喪文化」...やる気のないロシア人男性が大人気になった訳 |
https://www.newsweekjapan.jp/stories/world/2021/06/post-96430.php
|
造営 |
2021-06-02 20:29:00 |
GCP |
Cloud Blog JA |
Google Cloud で使用許可取得済みの市場データを検出、アクセス、分析する金融サービス向けの Datashare ソリューションのご紹介 |
https://cloud.google.com/blog/ja/topics/financial-services/announcing-the-general-availability-of-datashare/
|
このメカニズムにより、データパブリッシャーはBigQueryを介して参照データ、過去のティックデータ、代替市場データソースなどを配信でき、データコンシューマがデータから分析情報を抽出するための管理上の負担が軽減されます。 |
2021-06-02 13:00:00 |
コメント
コメントを投稿