投稿時間:2023-01-17 16:20:12 RSSフィード2023-01-17 16:00 分まとめ(26件)

カテゴリー等 サイト名等 記事タイトル・トレンドワード等 リンクURL 頻出ワード・要約等/検索ボリューム 登録日
IT 気になる、記になる… Googleの折りたたみ式スマホ「Pixel Fold」のモックアップのハンズオン動画が登場 https://taisy0.com/2023/01/17/167138.html google 2023-01-17 06:52:08
IT 気になる、記になる… 「メタルギア ソリッド」のリメイク版がPS5向けに開発中?? − 早ければ2〜3月に正式発表との噂 https://taisy0.com/2023/01/17/167134.html areajugones 2023-01-17 06:26:39
IT ITmedia 総合記事一覧 [ITmedia News] マイナカード「取得して良かった」が51.1% ただし38%は「使ったことない」 https://www.itmedia.co.jp/news/articles/2301/17/news122.html itmedia 2023-01-17 15:10:00
IT ITmedia 総合記事一覧 [ITmedia News] 文章をAIアバターが読み上げ動画に変換するサービス 商品紹介動画も簡単に作成 https://www.itmedia.co.jp/news/articles/2301/17/news126.html itmedia 2023-01-17 15:06:00
python Pythonタグが付けられた新着投稿 - Qiita noxで環境変数を消して実行 https://qiita.com/utkamioka/items/020bb19d486fc15c0506 sessionrunenvfoobar 2023-01-17 15:34:32
js JavaScriptタグが付けられた新着投稿 - Qiita モーダル機能 複数 レスポンシブル https://qiita.com/syatiking2Z/items/a1c354e51d972d044759 srcaltgtltdivclassmodalc 2023-01-17 15:08:51
Ruby Rubyタグが付けられた新着投稿 - Qiita [Rails]Railsアプリケーションの雛形作成 https://qiita.com/TACAMP/items/24da6cf2baa382d5e82c rails 2023-01-17 15:35:58
AWS AWSタグが付けられた新着投稿 - Qiita HULFT SquareでEC2インスタンス上のHULFTとファイル連携してみた(HULFT Square集信⇐HULFT配信) https://qiita.com/sugimon/items/7038422f2bc17d740abb hulft 2023-01-17 15:27:03
AWS AWSタグが付けられた新着投稿 - Qiita HULFT Squareでのファイル集配信におけるAWS環境構築をしてみた https://qiita.com/sugimon/items/6854f135b241f491c68b hulft 2023-01-17 15:25:37
AWS AWSタグが付けられた新着投稿 - Qiita HULFT Squareと外部通信する仕組みについて、AWS PrivateLinkなど含めて整理してみた https://qiita.com/sugimon/items/75263b34a8fa5943fd21 awsprivatelink 2023-01-17 15:24:10
Ruby Railsタグが付けられた新着投稿 - Qiita [Rails]Railsアプリケーションの雛形作成 https://qiita.com/TACAMP/items/24da6cf2baa382d5e82c rails 2023-01-17 15:35:58
技術ブログ Developers.IO 特定の時間帯のみ AWS Step Functions のタスクを実行するための Python コードを書いてみた https://dev.classmethod.jp/articles/aws-step-functions-execute-task-specific-time-with-python-code/ 組み合わせ 2023-01-17 06:51:59
技術ブログ Developers.IO [アップデート] AWS LambdaのAmazon SQSイベントソースで最大同時実行数を指定できるようになりました https://dev.classmethod.jp/articles/update-aws-lambda-event-source-amazon-sqs-concurrency/ amazonsqs 2023-01-17 06:01:45
海外TECH DEV Community Migrating Elasticsearch’s warm & cold data to object storage with JuiceFS https://dev.to/tonybarber2/migrating-elasticsearchs-warm-cold-data-to-object-storage-with-juicefs-3fjb Migrating Elasticsearch s warm amp cold data to object storage with JuiceFSWith the development of cloud computing object storage has gained favor with its low price and elastic scalable space More and more enterprises are migrating warm and cold data to object storage However migrating the index and analysis components directly to object storage will hinder query performance and cause compatibility issues This article will elaborate the fundamentals of hot and cold data tiering in Elasticsearch and introduce how to use JuiceFS to cope with the problems that occur on object storage Elasticsearch s data tier architectureThere are three concepts to be known before diving into how ES implements a hot and cold data tiering strategy Data Stream Index Lifecycle Management ILM and Node Role Data StreamData Stream is an important concept in ES which has the following characteristics Streaming writes Data Stream is a data set written in stream rather than in block Append only writes Data Stream updates data via append writes and does not require modifying existing data Timestamp A timestamp is given to each new piece of data to record when it was created Multiple indexes In ES every piece of data resides in an Index The data stream is a higher level concept one data stream may compose of many indexes which are generated according to different rules However only the latest index is writable while the historical indexes are read only Log data is a typical type of data steam It is append only and also has to be timestamped The user will generate new indexes by different dimensions such as day or others The scheme below is a simple example of index creation for a data stream In the process of using the data stream ES will write directly to the latest index As more data is generated this index will eventually become an old read only index The following graph illustrates writing data to the ES including two phases Stage the data is first written to the In memory buffer Stage The buffer will fall to the local disk according to certain rules and time which is shown as green in the graph persistent data known as segment in ES There may be some time lag in this process and the newly created segment cannot be searched if a query is triggered during the persistence process Once the segment is persisted it can be searched by the upper level query engine immediately Index Lifecycle ManagementIndex Lifecycle Management ILM is the lifecycle management of an index and ILM defines the lifecycle of an index as phases Hot data needs to be updated or queried frequently Warm data no longer updated but is still frequently queried Cold data no longer updated and is queried less frequently Frozen data no longer updated and hardly ever queried It is safe to put this kind of data in a relatively low speed and cheap storage medium Deleted data no longer needed and can be safely deleted All ES index data will eventually go through these stages users can manage their data by setting different ILM policies Node RoleIn ES each deployment node will have a Node Role Different roles such as master data ingest etc will be assigned to each ES node Users can combine the Node Roles and the different lifecycle phases mentioned above for data management The data node has different stages and it can be a node that stores hot data warm data cold data or even extremely cold data The node will be assigned different roles based on its tasks and different nodes are sometimes configured with different hardware depending on roles For example hot data nodes need to be configured with high performance CPUs or disks for nodes with warm and cold data as these data are queried less frequently the requirement for hardware is not necessarily high for some computing resources Node roles are defined based on different stages of the data lifecycle It is important to note that each ES node can have multiple roles and these roles do not need to have a one to one relationship Here s an example where node roles is configured in the ES YAML file You can also configure multiple roles for the node that it should have node roles data hot data content Lifecycle PolicyAfter understanding the concepts of Data Stream Index Lifecycle Management and Node Role you can customize lifecycle policies for your data Based on the different dimensions of index characteristics defined in the policy such as the size of the index the number of documents in the index and the time when the index was created ES can automatically help users roll over data from one lifecycle stage to another which is known as rollover in ES For example the user can define features based on the size of the index and roll over the hot data to the warm data or roll over the warm data to the cold data according to some other rules ES can do the job automatically while the lifecycle policy needs to be defined by the user The screenshot below shows Kibana s administration interface which allows users to graphically configure lifecycle policies You can see that there are three phases hot data warm data and cold data Expanding the advanced settings you can see more details about configuration policies based on different characteristics which is listed on the right side of the screenshot below Maximum index size Take an example of GB in the above screenshot It means that data will be rolled from the hot data phase to the warm data phase when the size of the index exceeds GB Maximum documents The basic storage unit of ES index is document and the user data is written to ES in the form of documents Thus the number of documents is a measurable indicator Maximum age As an example of days i e an index has been created for days it will trigger the rollover of the hot data to the warm data phase as mentioned previously However using Elasticsearch directly on object storage can cause poor write performance and compatibility and other issues Thus companies that also want to balance query performance are starting to look for solutions on the cloud Under this context JuiceFS is increasingly being used in data tiering architectures practice of ES JuiceFSStep Prepare multiple types of nodes and assign different roles Each ES node can be assigned different roles such as storing hot data warm data cold data etc Users need to prepare different types of nodes to match the needs of different roles Step Mount the JuiceFS file system Generally users use JuiceFS for warm and cold data storage users need to mount the JuiceFS file system locally on the ES warm data node or cold data node The user can configure the mount point into ES through symbolic links or other means to make ES think that its data is stored in a local directory but this directory is actually a JuiceFS file system Step Create a lifecycle policy This needs to be customized by each user either through the ES API or through Kibana which provides some relatively easy ways to create and manage lifecycle policies Step Set a lifecycle policy for the index After creating a lifecycle policy you need to apply the policy to the index that is you need to set the policy you just created for the index You can do this by using index templates which can be created in Kibana or explicitly configured through the API via index lifycycle name Here are a few tips Tip The number of copies replicas of Warm or Cold nodes can be set to All data is placed on JuiceFS eventually uploaded to the underlying object storage so the reliability of the data is high enough Accordingly the number of copies can be reduced on the ES side to save storage space Tip Turning on Force merge may cause constant CPU usage on nodes so turn it off if appropriate When moving from hot data to warm data ES will merge all the underlying segments corresponding to the hot data index If Force merge is enabled ES will first merge these segments and then store them in the underlying system of warm data However merging segments is a very CPU consuming process If the data node of warm data also needs to carry some query requests you can turn off this function as appropriate that is keep the data intact and write it to the underlying storage directly Tip The index of Warm or Cold phase can be set to read only When indexing warm and cold data phases we can basically assume that the data is read only and the indexes will not be modified Setting the index to read only can reduce some resource usage on the warm and cold data nodes you can then scale down these nodes and save some hardware resources From Juicedata JuiceFS ᴗ✿ 2023-01-17 06:18:14
海外TECH Engadget Microsoft will add ChatGPT to its cloud-based Azure OpenAI service 'soon' https://www.engadget.com/microsoft-add-chat-gpt-azure-openai-062845310.html?src=rss Microsoft will add ChatGPT to its cloud based Azure OpenAI service x soon x Microsoft is giving more people ーor at least more customers ーaccess to OpenAI s technologies including ChatGPT The tech giant has announced that it s now making the Azure OpenAI Service generally available after giving a limited number of enterprise customers access to it when it debuted in November As Bloomberg notes customers who have access to the service can use various OpenAI tools for their own cloud applications including the Dall E AI art generator and the GPT language system Microsoft says it s also adding access to ChatGPT which it describes as a fine tuned version of GPT to the service soon ChatGPT is coming soon to the Azure OpenAI Service which is now generally available as we help customers apply the world s most advanced AI models to their own business imperatives ーSatya Nadella satyanadella January The tech giant has been associated with OpenAI ever since it invested billion in the Elon Musk founded startup back in This announcement comes shortly after reports were published that Microsoft is in talks to invest an additional billion in the company These AI models are going to change the way that people interact with computers Microsoft s head of AI platforms Eric Boyd previously told The Financial Times in an interview While OpenAI has been around for a while it was recently thrust into the spotlight following ChatGPT s debut The program has the ability to return long coherent answers that aren t immediately recognizable as machine generated responses It was good enough to alarm educators who expressed concerns that it could be used for cheating Earlier this month New York City public schools banned ChatGPT from school devices and WiFi networks The Information also previously reported that Microsoft was planning to integrate the OpenAI software powering ChatGPT into Bing While it s still unclear what the software could do for the search engine sources said it could enable Bing to return results in a format that s friendlier and easier to digest ChatGPT is available for free at the moment but OpenAI intends to make money off it in the future and has already opened a waitlist for those interested in testing a paid version of the bot 2023-01-17 06:28:45
医療系 医療介護 CBnews 【感染症情報】インフルエンザが6週連続で増加-RSウイルス感染症は4週連続で減少 https://www.cbnews.jp/news/entry/20230117152831 医療機関 2023-01-17 15:40:00
医療系 医療介護 CBnews コロナ類型見直し感染状況から時期判断、厚労相-「準備一つ一つできている」 https://www.cbnews.jp/news/entry/20230117145652 一つ一つ 2023-01-17 15:10:00
金融 JPX マーケットニュース [東証]制限値幅の拡大:2銘柄 https://www.jpx.co.jp/news/1030/20230117-01.html 東証 2023-01-17 15:15:00
金融 JPX マーケットニュース [東証]上場廃止等の決定:タカラレーベン・インフラ投資法人 https://www.jpx.co.jp/news/1023/20230117-11.html 上場廃止 2023-01-17 15:10:00
海外ニュース Japan Times latest articles Kobe marks 28 years since deadly quake https://www.japantimes.co.jp/news/2023/01/17/national/kobe-anniversary/ earthquake 2023-01-17 15:38:26
海外ニュース Japan Times latest articles Dead whale in Osaka to be sunk offshore this week https://www.japantimes.co.jp/news/2023/01/17/national/osaka-whale-dead-followup/ mayor 2023-01-17 15:08:25
ニュース BBC News - Home China's population falls for first time since 1961 https://www.bbc.co.uk/news/world-asia-china-64300190?at_medium=RSS&at_campaign=KARANGA birth 2023-01-17 06:35:36
ニュース BBC News - Home Ukraine war: Bakhmut defenders plea for Western tanks https://www.bbc.co.uk/news/world-europe-64294653?at_medium=RSS&at_campaign=KARANGA deliveries 2023-01-17 06:00:50
ニュース BBC News - Home Chris Eubank Jr: Conor Benn has lost his 'credibility' after doping scandal, says rival https://www.bbc.co.uk/sport/boxing/64292534?at_medium=RSS&at_campaign=KARANGA Chris Eubank Jr Conor Benn has lost his x credibility x after doping scandal says rivalConor Benn lost his credibility after failing two drugs tests in the build up to their cancelled fight says Chris Eubank Jr 2023-01-17 06:31:51
IT 週刊アスキー 『Bright Memory: Infinite』で視点アシスト機能追加アップデートを配信! https://weekly.ascii.jp/elem/000/004/120/4120790/ 『BrightMemoryInfinite』で視点アシスト機能追加アップデートを配信PLAYISMは、PCSteamGOGXboxSeriesXSPlayStationNintendoSwitch向けゲーム『BrightMemoryInfinite』の視点アシスト機能の追加アップデートを年月日に実施した。 2023-01-17 15:45:00
IT 週刊アスキー 大勇者アバンが登場!『ダイの大冒険 -魂の絆-』新イベント「家庭教師の迷宮探索」が開催中 https://weekly.ascii.jp/elem/000/004/120/4120767/ 家庭教師 2023-01-17 15:15:00

コメント

このブログの人気の投稿

投稿時間:2021-06-17 05:05:34 RSSフィード2021-06-17 05:00 分まとめ(1274件)

投稿時間:2021-06-20 02:06:12 RSSフィード2021-06-20 02:00 分まとめ(3871件)

投稿時間:2020-12-01 09:41:49 RSSフィード2020-12-01 09:00 分まとめ(69件)