投稿時間:2021-10-07 23:33:01 RSSフィード2021-10-07 23:00 分まとめ(42件)

カテゴリー等	サイト名等	記事タイトル・トレンドワード等	リンクURL	頻出ワード・要約等/検索ボリューム	登録日
AWS	AWS Architecture Blog	Field Notes: How to Build an AWS Glue Workflow using the AWS Cloud Development Kit	https://aws.amazon.com/blogs/architecture/field-notes-how-to-build-an-aws-glue-workflow-using-the-aws-cloud-development-kit/	Field Notes How to Build an AWS Glue Workflow using the AWS Cloud Development KitMany customers use AWS Glue workflows to build and orchestrate their ETL extract transform load pipelines directly in the AWS Glue console using the visual tool to author workflows This can be time consuming harder to version control and error prone due to manual configurations when compared to managing your workflows as code To improve your operational …	2021-10-07 13:56:14
AWS	AWS Database Blog	Capture key source table headers data using AWS DMS and use it for Amazon S3 data lake operations	https://aws.amazon.com/blogs/database/capture-key-source-table-headers-data-using-aws-dms-and-use-it-for-amazon-s3-data-lake-operations/	Capture key source table headers data using AWS DMS and use it for Amazon S data lake operationsMigrating the raw data from source systems into a central repository is usually the first step in establishing a data lake Many systems store source data in relational database tables therefore a mechanism is required to ingest this data in the data lake and also get some relevant metadata about these tables so that data …	2021-10-07 13:21:59
python	Pythonタグが付けられた新着投稿 - Qiita	ABC63 C - Bugged を解いた	https://qiita.com/AKpirion/items/ba634e4a71e64d8779c8	よって、引いていきたいのはnotの倍数を一個ずつ引いて試したい。	2021-10-07 22:08:18
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	Googleカレンダー　カレンダーIDの取得	https://teratail.com/questions/363335?rss=all	GoogleカレンダーカレンダーIDの取得前提・実現したいことGoogleカレンダーAPIを使い、PHPにてGoogleカレンダーの予定取得・追加等の機能があるアプリを作成しています。	2021-10-07 22:52:37
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	GIT LABにVSCODEからPUSHを行おうとすると、エラーが出てしまう	https://teratail.com/questions/363334?rss=all	GITLABにVSCODEからPUSHを行おうとすると、エラーが出てしまうRPCnbspfailednbspcurlnbspnbspHTTPnbspstreamnbspnbspwasnbspnotnbspclosednbspcleanlynbspPROTOCOLERRORnbsperrnbspnbspとメッセージが出てきたが、以前は以下のコマンドを入力することで解決できましたが、今回はVSCODEでGITLABにPUSHすることができないので、教えていただけたら幸いです。	2021-10-07 22:47:49
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	S3を使用してユーザー別の投稿画像を表示したい	https://teratail.com/questions/363333?rss=all	Sを使用してユーザー別の投稿画像を表示したい実現したいことPHPを使用し掲示板を作成しています。	2021-10-07 22:45:37
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	djangoのhtml上で保存フォルダを指定し、csvデータを保存	https://teratail.com/questions/363332?rss=all	django	2021-10-07 22:44:45
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	ExcelVBAでのPowerPointファイル連続作成	https://teratail.com/questions/363331?rss=all	ExcelVBAでのPowerPointファイル連続作成前提・実現したいことExcelで作成した表やグラフをPowerPointへ反映させ、資料を更新したい。	2021-10-07 22:44:26
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	rails sをしたところエラーが発生しました。	https://teratail.com/questions/363330?rss=all	railssをしたところエラーが発生しました。	2021-10-07 22:40:08
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	ansible jinja2 空データの扱い方	https://teratail.com/questions/363329?rss=all	ansiblejinja空データの扱い方前提・実現したいことansibleにて、jinjaテンプレートとある変数を用い、ある変数locationが空もしくはnbspjinja側で偽と判定されるものである場合、jinjaテンプレートに書き込まないという処理をしたい。	2021-10-07 22:33:49
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	Ruby,非同期通信	https://teratail.com/questions/363328?rss=all	Ruby非同期通信前提・実現したいこと現在本のレビューSNSのようなシステムを作っています。	2021-10-07 22:24:46
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	[android,kotlin]コルーチンによる非同期処理の適用範囲がわからない	https://teratail.com/questions/363327?rss=all	android	2021-10-07 22:24:02
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	Pythonの配列記述にあるコロンの意味について	https://teratail.com/questions/363326?rss=all		2021-10-07 22:12:39
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	javascriptのテキストエリアを改行に合わせて自動拡大する処理についての説明が欲しいです。	https://teratail.com/questions/363325?rss=all	javascriptのテキストエリアを改行に合わせて自動拡大する処理についての説明が欲しいです。	2021-10-07 22:02:11
Linux	Ubuntuタグが付けられた新着投稿 - Qiita	SoftEther VPN ServerをUbuntuにインストール	https://qiita.com/fts-memo/items/90ed5bcac157fdef3a4f	nanoetcnetplanhogehogeyamlenpsのIPアドレスは明示的にを割り当てるbrにIPアドレスを設定するhogehogeyamlnetworkethernetsenpsdhcpfalseaddressesbridgesbraddressesgatewaynameserversaddressesversion設定を反映するnetplanapply※物理NICenps、仮想ブリッジbr物理NICとtapデバイスをブリッジaptinstallybridgeutilsbrctladdifbrenpsbrctladdifbrtapsevpniplinksetupdevbr以上でVPN接続時にもサーバー自身にアクセスすることが可能になる。	2021-10-07 22:11:46
Ruby	Railsタグが付けられた新着投稿 - Qiita	【超初心者向け】belongs_toとhas_many、アソシエーションってなに？	https://qiita.com/ShotaK15/items/d7f5c65ef9365298a128	すると、bookテーブルには新たに「蜘蛛と糸」という本が追加されるので、一人の著者に対して複数の本が関連付いていることになります。	2021-10-07 22:28:20
海外TECH	DEV Community	DataDog vs Jaeger - key features, differences and alternatives	https://dev.to/signoz/datadog-vs-jaeger-key-features-differences-and-alternatives-1590	DataDog vs Jaeger key features differences and alternativesBoth DataDog and Jaeger are tools used to monitor application performance The difference lies in what they monitor and terms of usage Jaeger is an open source tool focused on distributed tracing of requests in a microservice architecture While DataDog is a SaaS APM vendor covering most monitoring needs of an application Application performance monitoring is the process of keeping your app s health in check APM tools enable you to be proactive about meeting the demands of your customers If you re comparing DataDog and Jaeger distributed tracing capabilities of both tools is one of the important criterion Before we dive in let s first understand in brief what is distributed tracing What is distributed tracing In the world of microservices a user request travels through hundreds of services before serving a user what they need To make a business scalable engineering teams are responsible for particular services with no insight into how the system performs as a whole And that s where distributed tracing comes into the picture Microservice architecture of a fictional e commerce applicationDistributed tracing gives you insight into how a particular service is performing as part of the whole in a distributed software system There are two essential concepts involved in distributed tracing Spans and trace context User requests are broken down into spans What are spans Spans represent a single operation within a trace Thus it represents work done by a single service which can be broken down further depending on the use case A trace context is passed along when requests travel between services which tracks a user request across services Thus you can see how a user request performs across services and identify what exactly needs your attention without manually shifting through multiple dashboards A trace context is passed when user requests pass from one service to another Key Features of DataDogDataDog offers an array of services in the monitoring domain Some of the key areas in monitoring that it covers include Log ManagementApplication performance monitoringSecurity monitoringNetwork monitoringReal user monitoringLet s focus on the features of application performance monitoring provided by DataDog as it makes more sense when it comes to comparison with Jaeger Some of the key features of DataDog APM includes End to end application performance monitoringAs a full stack APM tool using DataDog you can connect distributed traces to infrastructure metrics network calls and live processes Collection of of tracesTrace data can be huge Still using DataDog you can collect of your traces generated in the last mins Then you can retain the traces showing high latency to investigate further Code level visibility for root cause analysisDataDog gives code level visibility to break down slow requests by time spent on CPU GC I O etc Covers wide range of technology stackDataDog provides extensive integrations and libraries to monitor Java NET PHP Node js Ruby Python Go or C applications DataDog APM tool showing infrastructure metrics logs errors processes network and code hotspots under a single dashboardFind code hotspots using DataDog APM tool Key features of JaegerJaeger was originally built by teams at Uber and then open sourced It is used for end to end distributed tracing for microservices Some of the key features of Jaeger includes Distributed context propagationOne of the challenges of distributed systems is to have a standard format for passing context across process boundaries and services Jaeger provides client libraries that support code instrumentation in multiple languages to propagate context across servicesDistributed transaction monitoringJaeger comes with a web UI written in Javascript The dashboard can be used to see traces and spans across services Root Cause AnalysisUsing traces you can drill down to services causing latency in particular user request Server dependency analysisUsing Jaeger s web UI you can see how requests flow through different services and different servers interact while serving user requests Performance latency optimizationOnce you have identified which service or query is creating latency you can use the information to optimize it Jaeger UI showing services and corresponding traces Comparing DataDog and JaegerDataDog is one of the major SaaS vendors in the APM space On the other hand Jaeger is a popular open source distributed tracing tool that graduated from Cloud Native Computing Foundation The differences between the tools arise from this genesis Some of the key differences between DataDog and Jaeger are Correlation of trace dataDataDog lets you connect your trace data to a lot of other performance metrics like infrastructure and host metrics as it is not limited to distributed tracing Jaeger collects trace data which can give you insights on latencies of requests You can t use Jaeger for collecting metrics for hosts networks etc Code InstrumentationInstrumentation is the process of generating telemetry data from your application Jaeger uses OpenTracing APIs for code instrumentation The data format of telemetry data generated is vendor neutral in the case of Jaeger and you can also use other back end analysis tools DataDog provides DataDog agents which run on your host to collect events and metrics In the case of proprietary instrumentation agents your monitoring stack gets locked into a vendor soon DataDog also supports ingestion from open source standards like OpenTelemetry but it s not a first class citizen Data StorageJaeger offers two popular open source databases for storing trace data Cassandra and Elasticsearch DataDog is a third party cloud vendor where your data gets stored in DataDog s servers Web UIDataDog is a SaaS tool that offers a much smoother and more elaborate dashboarding experience including many customizations Jaeger s web UI is limited although it can serve the purpose of distributed tracing The decision between DataDog and Jaeger comes down to whether your organization has the budget to go for a paid SaaS tool like DataDog or does your organization has got the engineering bandwidth to run an open source tool like Jaeger In addition as Jaeger is limited to just distributed tracing your decision also needs to account for whether you need to monitor other components of your application The lack of great user experience in open source tools has always been there Also what if there was an open source tool that could provide the scope of experience of a great SaaS tool like DataDog That s where SigNoz comes into the picture Alternative to DataDog and Jaeger SigNozSigNoz is a full stack open source application performance monitoring and observability tool which can be used in place of DataDog and Jaeger It provides advanced distributed tracing capabilities along with metrics under a single dashboard SigNoz is built to support OpenTelemetry natively OpenTelemetry is becoming the world standard for generating and managing telemetry data Logs metrics and traces It also provides users flexibility in terms of storage You can choose between ClickHouse or Kafka Druid as your backend storage while installing SigNoz Architecture of SigNoz with ClickHouse as storage backend and OpenTelemetry for code instrumentatiionSigNoz comes with out of box visualization of things like RED metrics SigNoz UI showing application overview metrics like RPS th th th Percentile latencies and Error RateYou can also use flamegraphs to visualize spans from your trace data All of this comes out of the box with SigNoz Flamegraphs showing exact duration taken by each spans a concept of distributed tracingSome of the things SigNoz can help you track Application overview metrics like RPS th th th Percentile latencies and Error RateSlowest endpoints in your applicationSee exact request trace to figure out issues in downstream services slow DB queries call to rd party services like payment gateways etcFilter traces by service name operation latency error tags annotations Run aggregates on trace dataUnified UI for both metrics and tracesYou can check out SigNoz s GitHub repo here	2021-10-07 13:23:26
海外TECH	DEV Community	Integrating Vercel with Doppler: Sync Secrets in Production	https://dev.to/umavictor6/integrating-vercel-with-doppler-sync-secrets-in-production-48bf	Integrating Vercel with Doppler Sync Secrets in Production SummaryOne of the great benefits of Doppler is keeping your project in sync We want to be able to sync our app wherever we develop and deploy It only takes a few minutes to integrate the Vercel marketplace with Doppler and that is what we will be doing in this tutorial GoalsIn this tutorial we will learn how to install the Doppler integration from Vercel s new marketplace Learn how to sync the secrets in your doppler project for deployment Add your Project to VercelThe first thing we want to do is to login to our doppler account I won t be touching the details of creating an account and login into doppler because I have already done an introduction to doppler in a previous post So once we have logged into Doppler we head over to Vercel and add our project we want to integerate doppler with Navigating to the account homepageWe have an e commerce site we want to integrate with Doppler so we can hide secrets even as we deploy on vercel Syncing Doppler with your projects is simple and quick Just enter the details and you ll be notified when new updates are available So let s get started Syncing secrets in doppler with vercelWe want to first authorize Doppler To do this we click on the project we want to integrate doppler with in my case it s an e commerce site called etsy ecommerce and then we click on the integrations tabIn our integeration page we select vercel Then click on add integeration and let Doppler know you want to select a personal account your vercel account When you click continue you will be prompted to choose the particular project you want to integrate with Doppler from your list of projects in Vercel Click on Add Integration and you will be taken to the setup integration page In the setup integration page we key in all our details choose the project we want to integrate and the vercel environment we will be deploying to which is production Click Setup Integration and your secret for that config will now be automatically synced to Vercel We can see all our environmental variables synced with vercel meaning we have successfully integerated doppler with vercel Also if we go to our doppler dashboard we can confirm by seeing that it is in sync with vercel Automatically trigger Vercel re deployIn this section we will look at how to automatically trigger a re deploy in vercel when a secret is changed in doppler To do this navigate to git in vercel and in our deploy hooks section we give our hook a name and click the create hook button Let s copy the webhook link and go back to our doppler dashboard To use the webhook you have to be part of a subscription with Doppler Luckily for us we can access this feature by doing a day subscription without adding our credit card Now when we head back to the etsy ecommerce project and click on webhooks we get a pop up to add a new webhook We paste in the link we copied and click on add webhook Now we can select through the input that a re deploy should be triggered when a change is made in production Now if we make a change to one of our secrets in production and save it the change will be instantly reflected in vercel and trigger a deploy ConclusionIn this tutorial we learned how to install the doppler integration from Vercel s new marketplace We also learned how to sync the secrets in our Doppler project for deployment	2021-10-07 13:13:58
海外TECH	DEV Community	CAST AI vs. Cloudability: Which one to pick for cloud cost optimization?	https://dev.to/castai/cast-ai-vs-cloudability-which-one-to-pick-for-cloud-cost-optimization-44le	CAST AI vs Cloudability Which one to pick for cloud cost optimization Controlling cloud costs is one of the biggest challenges facing teams across every organization that uses the public cloud Thankfully they can choose from a wide range of solutions that help in cost management and optimization Many such tools offer automation features that build more stable and cost effective cloud environments When picking a solution companies should consider the potential impact of automation on both cost savings and workflows in the cloud especially the more complex cloud native ones like Kubernetes Keep on reading to find out which cost optimization platform is a better choice for your business CAST AI or Apptio Cloudability CAST AI cloud native cost optimization Cloudability cloud cost managementCAST AI is cloud native platform for analyzing monitoring and automating the costs of Kubernetes environments Companies across e commerce and adtech are using CAST AI to cut their cloud bills by to even Cloudability provides financial management tools for monitoring and analyzing cloud computing costs Companies can use the software to track their public cloud spend and plan better informed budgets for cloud services CAST AI vs Cloudability quick feature comparisonDetailed feature comparison of Cloudability and CAST AICost visibilityCost optimization and automationSpot instance recommendations and automationFull multi cloud optimizationPricing Cost visibilityCost allocation and reporting Cloud expenses are divided into project cluster namespace and deployment levels in CAST AI Teams can track expenses down to individual microservices before calculating the total cost of their cluster CAST AI employs industry standard metrics that may be used with any cloud provider The cost allocation in CAST AI is done per cluster and per node Control plane network egress storage and other cost dimensions will be added soon A feature for continuous cloud cost reporting is also on its way Cloudability comes with a default dashboard as well as the option to create custom dashboards for various products departments or positions within your organization The solution s True Cost Explorer offers a way for users to visually explore their cloud cost and usage data Users may easily connect their use and spend to relevant data dimensions such as business units apps and teams without being aware of cloud billing nuances Cost view across multi cloudMany businesses today use more than one cloud platform so multi cloud support is an important element of cost optimization initiatives It s difficult to budget for multi cloud configurations but CAST AI s multi cloud capabilities make it a lot easier The platform works with any cloud service provider and offers cross cloud visibility thanks to universal metrics from Grafana and Kibana Cloudability stands up to this challenge as well Users can display multi cloud data together in a single pane of glass All data is continuously refreshed with each new update from service providers Cost optimization and automationCAST AI fully automated cost optimizationRightsizing with automated instance selection CAST AI picks the most cost effective instance types and sizes to fulfill the needs of your application while lowering the cloud spend When a cluster needs additional nodes the automation engine chooses the instances that provide the best performance at the lowest price Engineers don t have to do anything extra because everything happens automatically Using the same instance shape for every node in a cluster can quickly lead to overprovisioning so CAST AI offers multi shape cluster creation as well It provides the best combination of various instance types for the application Horizontal pod autoscaling and node autoscalingTo help organizations avoid cloud waste CAST AI automates pod scaling settings Based on business KPIs the Horizontal Pod Autoscaler estimates the right number of required pod instances If there s no work to be done the functionality reduces the replica count of pods until it reaches and then eliminates all pods CAST AI also guarantees that the number of nodes in use is always appropriate for the application s requirements dynamically scaling nodes up and down Cluster scheduling and terminationCAST AI automatically stops and restarts clusters created inside the platform saving teams money on resources teams aren t using Smart bin packing Since Kubernetes distributes programs equitably throughout a cluster regardless of how cost effective this design is it poses a financial challenge to companies CAST AI modifies the default pod scheduling approach and uses automated bin packing to maximize savings according to user preferences It s simple when there are fewer nodes the cost savings are greater Cloudability data insights combined with automationRightsizing recommendationsCloudability helps teams to detect and monitor cloud resource consumption so they can balance risk and cost and reduce waste The tool collects usage data and feeds it into its proprietary algorithms to generate a list of optimum rightsizing suggestions The algorithms take into account usage statistics from the previous and days Automation in CloudabilityRemoving idle EBS volumes Cloudability users can set up and schedule daily cleanups of detached EBS volumes All it takes is selecting accounts and tags to scan for unattached volumes together with the amount of time the unattached volume should sit before the tool creates a snapshot and deletes it Automated shutdown and restart of resources Cloudability can automatically shut down and startup operations during periods of low usage Users can schedule the scaling of ASGs or the stopping starting of EC and RDS instances checking how many resources this will affect Governance for cost managementTo make the most of the cloud s elastic on demand capabilities while continually optimizing expenses Cloudability uses automation to make sure that teams operate to the same standards Spot instance recommendations and automationWhen compared to On Demand instances spot instances offer significant cost reductions even up to However providers can reclaim these resources at any moment That s why teams looking to take advantage of spot instances need automation The replacement of interrupted spot instances in CAST AI is completely automated Teams no longer have to worry about their application s capacity running out To ensure high availability the platform continually searches for the best instance alternatives and spins up fresh instances in milliseconds Cloudability helps users to quantify the ROI of using spot instances and offers recommendations for creating a more consistent budget and forecasting baseline Full multi cloud optimizationAs we enter the multi cloud era the need to evaluate manage and optimize cloud expenses across providers is more critical than ever CAST AI addresses this requirement with a variety of multi cloud features Active Active Multi Cloud the platform replicates apps and data over several cloud services to ensure that if one fails others keep the applications running for guaranteed business continuity Global Server Load Balancing CAST AI distributes traffic across all cloud services in use and always selects up and healthy endpoints Multi cloud visibility the platform delivers cost allocation insights across cloud services thanks to data from Grafana and Kibana In Cloudability multi cloud data is displayed together in a single pane of glass and constantly refreshed to reflect changes applied by cloud service providers PricingUsers of CAST AI can start by examining their cloud services using the free Cluster Analyzer to determine if they can save money The read only agent assesses their infrastructure and provides concrete recommendations free of charge Users can then either manually apply these findings or employ automatic cost optimization features and select between two options with a free trial Growth and Enterprise CAST AI guarantees cost savings of at least Cloudability pricing starts at per feature per month with the option of a free trial at the beginning  Overall winner CAST AIBoth Cloudability and CAST AI are fantastic cloud cost management platforms that improve cost management and optimization   While Cloudability offers access to data dashboards and a limited degree of automation CAST AI provides teams with a rich selection of automation features that guarantee cost savings and streamline work with Kubernetes  CAST AI s automation features unique multi cloud functionality and cloud native architecture position it as the top cloud cost optimization platform P S If you d like to start with something more hands on run the free CAST AI Cost Analyzer to see how much you could save and how to get there	2021-10-07 13:12:50
海外TECH	DEV Community	Automating video analysis to cut your streaming bandwidth usage in half	https://dev.to/video/automating-video-analysis-to-cut-your-streaming-bandwidth-usage-in-half-5hk1	Automating video analysis to cut your streaming bandwidth usage in halfUsing an optimal bitrate ladder can make a big difference when it comes to the bandwidth usage of your video streams Some videos may require a high bitrate to deliver a high quality stream while some may require much less Comparing simple animated content to an action movie with a lot of smoke and moving shots this difference can be quite large In this article we will show you how to automatically generate an optimal bitrate ladder that reduces bitrate usage by compared with the standard ABR ladder from Apple without any video quality losses But first of all why is it important to not waste bandwidth The obvious reason is that users on low quality internet connections will be able to get a better experience However for you as a streaming provider you will also save money and energy usage thus lowering your total CO emissions Everybody wins Optimizing ABR ladders can be a lot of manual labour however The method developed by Netflix involves encoding your source material in a variety of different bitrates for each resolution Each variant also needs to be analyzed using a video quality metric which also takes time and manual labour To make this process easier we set out to automate it as much as possible All scripts and tools used in this blog post can be found in this GitHub repository Step Transcoding files to testTo determine the optimal bitrates we need to create a variety videos at different bitrates at each resolution we wish to support We created a script that can automatically generate bitrate resolution pairs to evaluate and transcode these using AWS MediaConvert Since we are transcoding many files running this in the cloud is especially useful since we can do it in parallel Running the transcoding process sequentially on your own machine will take many hours to complete while it will only take a few minutes in the cloud We select bitrates for each resolution but since higher resolutions need higher bitrates we need to pick bitrates depending on the pixel count Using the following code we can automatically generate the variants to analyze for resolution in resolutions w resolution h resolution bitrate floor int w h bitrate ceil int w h bitrate step int w h for bitrate in range bitrate floor bitrate ceil bitrate step Start transcoding on AWS MediaConvert Step Video quality analysisWe are looking to get the best possible video quality per bitrate which means we need a method to measure video quality Traditionally this has been done using PSNR but there are many flaws with this method Therefore Netflix has developed VMAF which is a video quality metric that accounts for human perception VMAF takes a reference file and compares this to a distorted variant and gives you a value between and that describes how similar they are the higher the better VMAF has many interesting properties which makes it a very interesting method to use For example a VMAF score of or higher means that the video is perceptually identical to the source material source This would suggest that it is unnecessary to provide variants which have a score above Netflix has also said that a difference of is a just noticeable difference in quality source Therefore spending lots of extra bandwidth to achieve an increase of less than may also be unnecessary We use a tool called easyVmaf which makes VMAF analysis very easy However just like with transcoding this process takes a lot of time to run sequentially on your own machine If you need to analyze hundreds of files this will take a very long time Running this in a container in the cloud means we can run all the processes at the same time in parallel We built a simple Docker container that runs easyVmaf on files in a S bucket This allows us to run the container on ECS and spin up as many tasks as we need This Dockerfile can be found in the GitHub repository The script will wait until the transcoding in the first step is finished by watching the destination directory in S like shown below while len variants gt res s list objects v Bucket bucket name Prefix directory if Contents in res objects in bucket list map lambda o str o Key res Contents else objects in bucket for variant in variants object name variant replace bucket mp if object name in objects in bucket Start VMAF analysis on variant and remove from list of variants if len variants gt time sleep Step Finding optimal bitrates for each resolutionUsing the script that we ve discussed we now have VMAF scores for different variants of bitrate resolution pairs How do we know which of these are the best Netflix describes this in detail in their blog but to summarize the method we should look at a plot of the values As you can see there comes a point where each resolution starts falling off and the next resolution because more optimal at that bitrate For example looking at the below figure we can clearly see that p is the best resolution around kbit s Providing an option for p at this bitrate will only make for a lower quality video experience At lower bitrates however we can also see that p starts plummeting in the other direction as well At around kbit s p is better since p has dramatically dropped off We can imagine a convex hull that covers the outside of the plotted values Ideally we want to select values as close to this hull as possible but in practice it will be hard to test all possible bitrate resolution pairs to find these points The points on the convex hull are at Pareto efficiency as they are in a equilibrium where you get the best video quality per bandwidth as well as the best bandwidth per video quality However simply selecting the optimal points might not work in practice Depending on the resolutions tested the convex hull might result in bitrates that are very close to each other or very far apart Therefore some manual work needs to be done to determine the final ladder Step Determining the final ladderWe set out some criteria that we use to determine if we have a reasonable ABR ladder These are Each rung should be between x to x the bitrate of the previous rung Each rung should have at least an increase of in VMAF Each rung should use the resolution with the best video quality for that bitrate No rung should have a VMAF score above To achieve these points we may need to have multiple rungs per resolution and select bitrates manually Example with Big Buck BunnyThe images above were generated from a clip of Big Buck Bunny Following the above steps we ve generated an ABR ladder that looks like the following ResolutionBitrateVMAFx kbit sx kbit sx kbit sx kbit sx kbit sx kbit sx kbit sx kbit sAs you can see the bitrates and VMAF scores are well spaced and we also manage to achieve a VMAF score of on the final rung This means that the p variant will have the same visual experience as the source material Let s compare this to the example ABR ladder the Apple provides in their HLS Authoring Specification ResolutionBitrateVMAFx kbit sx kbit sx kbit sx kbit sx kbit sx kbit sx kbit sx kbit sx kbit sThis ABR ladder violates many of the criteria that we set up As mentioned providing variants with a VMAF score above may be unnecessary but in this ladder both p rungs are above Generally we can see that this ABR ladder is very wasteful for this type of content Comparing the ladders we can see a decrease in bandwidth by using the optimized ladder when summarizing the average bitrates for each resolution Since the highest quality rung provides a VMAF score of we are able to do this while achieving a identical visual experience as the source material We ve managed to cut the bandwidth usage in half without affecting video quality and therefore also cut costs and energy usage by almost half as well Tailoring the ABR ladder to the content is evidently very effective in reducing bandwidth usage but the process of finding the best ladder can be difficult and time consuming The scripts we ve built to automate this process makes it much easier and faster to do and could be integrated in your existing ingest process to automatically determine the best ABR ladder without any human input The very small cost of transcoding and computing VMAF on the cloud can be insignificant to the cost savings you can get from optimizing your ABR ladder Eyevinn Technology is the European leading independent consultancy firm specializing in video technology and media distribution If you need assistance in the development and implementation of this our team of video developers are happy to help out If you have any questions or comments just drop us a line in the comments section to this post	2021-10-07 13:08:58
Apple	AppleInsider - Frontpage News	Adobe releases new versions of Photoshop Elements, Premiere Elements	https://appleinsider.com/articles/21/10/07/adobe-releases-new-versions-of-photoshop-elements-premiere-elements?utm_medium=rss	Adobe releases new versions of Photoshop Elements Premiere ElementsPremiere Elements and Photoshop Elements are now available from Adobe bringing more slideshow styles and new automated editing features to the standalone video and photo apps Adobe releases Photoshop Elements Premiere Elements For Adobe s annual update of its popular image and video editing concentrates on making the apps easier to use Aimed more at consumers than professionals both apps aim to automate common tasks and provide new tools for sharing work Read more	2021-10-07 13:40:18
Apple	AppleInsider - Frontpage News	Five key features missing from Apple's new iPad mini	https://appleinsider.com/articles/21/10/06/five-things-missing-from-the-ipad-mini-that-apple-couldve-added?utm_medium=rss	Five key features missing from Apple x s new iPad miniApple s new iPad mini is striking because of its redesign and refined features but there are still areas Apple could have worked on Here s where Apple could have made even more improvements to the compact tablet Apple updated the iPad mini with a new look but it could have done more Of all the iPads the iPad mini was arguably overdue a redesign This year Apple gave it just that and effectively turned their smallest tablet into a mini version of the iPad Air Read more	2021-10-07 13:41:46
海外TECH	Engadget	Your iPhone could eventually control your car's climate and seats	https://www.engadget.com/apple-ironheart-iphone-car-control-133752151.html?src=rss	Your iPhone could eventually control your car x s climate and seatsYour iPhone could soon be useful for more in a car than answering calls and spicing up the music selection Bloombergsources claim Apple is developing a technology codenamed quot IronHeart quot that would let you use your iPhone to control the climate system radio seats and even the instrument clusters You wouldn t have to switch between CarPlay and your car s likely clunky infotainment software just to turn up the heat IronHeart is still early in development according to the tipsters and would require partnerships with car brands Apple has declined to comment An initiative like this could extend Apple s presence in cars far beyond limited technologies like CarPlay or its more recent CarKey feature While it s not necessarily part of the company s long rumored electric car strategy it could give the company experience with more aspects of cars and help with any in house vehicle development Whether or not automakers embrace the concept is another matter Apple would effectively bypass a car s native interface for many common tasks It s easy to see manufacturers balking after pouring extensive work into their own car interfaces and companion apps particularly if they have any services that compete with Apple offerings If IronHeart ships it may be limited to a handful of makes and models unless there s an enthusiastic response from car buyers	2021-10-07 13:37:52
海外TECH	Engadget	Owlet Smart Sock Plus review: An update for the fans	https://www.engadget.com/owlet-smart-sock-plus-review-130525360.html?src=rss	Owlet Smart Sock Plus review An update for the fansHere s something I didn t know until I became a NICU parent In the United States one in babies are born prematurely Many preterm babies require a NICU stay with the average length being days Though I had little idea of what I was doing when I brought home my twins from the NICU I did know that I was going to continue to monitor their vitals stats using an Owlet sock My partner and I had become accustomed to checking their heart rate and pulse ox levels on a hospital monitor and being able to get that information at home helped us build confidence in our role as non professional caretakers to two very tiny humans In both the NICU and online parenting forums multiple people recommended the Owlet It s specifically these fans the brand was responding to with the recent release of Smart Sock Plus a larger sock with an updated algorithm that can be used on children up to five years old or pounds That s a decent leap from the previous month pound cut off that my kids just passed The company claims that percent of the parents it polled said they d like to use their Smart Socks for longer and that certainly included me HardwareThe third generation Owlet monitoring system featured a redesigned “butterfly style sensor that fit into an updated fabric sock and it s more of the same with the Plus You ll find the same removable sensor with a protruding button that attaches to the Base Station for wireless charging when not in use along with the same winged Velcro attachments for switching it between socks It s also still lightweight easy to remove and replace and fast charging Owlet says a full charge takes an hour and a half and you can get eight hours worth of use with only minutes of charging That bore out in testing when I was able to grab a full night s worth of battery life in the time it took to finish our bedtime routine with the kids The compact more subtle Base Station is also the same as the one found on the smaller smart sock model The new sock has a similar construction too including a soft flexible fabric strip that fastens around the ball of the foot to keep the sensor at the outside of the little toe And there s an ankle band to secure the whole thing in place The Smart Sock Plus comes with the same four initial sock sizes left and right for under pounds and left and right for to pounds plus an expansion pack of left and right socks for to pounds It s worth noting that currently the Smart Sock Plus is only available in the classic Mint Green shade and not the Deep Sea Green or Dusty Rose colors Amber Bouman EngadgetI had issues with the fit on the last sock and was pleased to find that the Plus version for larger kids plus pound seemed less prone to unintentional slippage I say unintentional because my kids have just learned to work Velcro so they can very purposefully take the sock off While they were proud of themselves for their accomplishment this underscores the challenge in offering a sock for older children It might be a fight to get them to keep it on One of the user reviews I read for the original Owlet sock recommended putting a regular sock on over the smart one to keep it from sliding around I tried that and found that it worked well for my son but less so with my daughter who has better dexterity That s unlikely to solve the issue for the length of the sensor s life though I d expect older children can be taught to wear the sock to sleep I asked Owlet what they recommend to keep the sock in place in these instances and they too suggest using a regular sock or footie pajamas They also claim some parents wait until their kids are asleep to put the Smart Sock on but those folks are braver than I Because the sock fits better I had fewer disconnection error alerts In fact the only time I received alerts due to a misaligned sock were times when my kids had actually removed it Given that frequent unexplained alerts were one of my pain points with the last version it was nice to see that had improved I got consistent readings when they were in fabric socks or footie pajamas and also when they were under a blanket What s more I had no problem keeping the Base Station in my office next door to my kid s room it was still easily able to keep everything connected Amber Bouman EngadgetI will say that the sock still seemed to run out of battery quicker than the second generation one did but it was comparable to the third gen While the sock could reliably make it through an evening of monitoring roughly pm to am I occasionally saw low battery warnings in the morning However these warnings indicated that I had less than four hours of runtime which seems like plenty of time SoftwareEvery time I set up an Owlet device I hit a snag This time instead of connecting to the Owlet in my WiFi settings I was instructed to go through the Privacy settings and toggle on the Local Network option But the Owlet app kept telling me to check the permissions even after I d turned them on And off And on again And closed and restarted the app Although this is the first time I had to call Owlet support for a resolution I was able to easily get through to a live person and resolve the problem in a little over five minutes thanks again Jill I haven t had any problems since As with the rest of the Plus experience the app remains largely unchanged The difference here are the updated algorithms that Owlet is using to calculate data for kids in the month to five year range Because the sock can now fit more kids the algorithm has to accommodate for physical changes over time Owlet says a good example is heart rate which changes as a child gets older OwletAside from that you still get a dashboard to access each child s profile which contains their live heart rate and pulse ox data the battery life of the sock and WiFi connection status If you re also using the Owlet Cam as a video monitor you ll see the feed here Previous days data can be found under History which includes an overview and info graphs This has always been one of the most useful portions of the app for me as it showed me the trends on when my twins were ーand were not ーdoing well sleeping As I mentioned I haven t yet had any false alerts though I m not sure what to chalk that up to ーfaster internet at my new house A better fit on the sock Upgraded algorithms Either way it s nice to report on a better experience especially given the price difference between the Plus and the third gen sock The competitionThere aren t a ton of products out there similar to Owlet s sock The company has seemingly cornered the market on baby wearables that measure pulse ox and heart rate but there are a few other noteworthy devices in this space One of them is the Nanit system which pairs a camera with an item of the company s Breathing Wear clothing to monitor respiration and sleep as well as provide a video feed The Complete Monitoring System which includes app subscription extras like two days of video history comes in at In testing the Breathing Wear worked as advertised and the camera offered an impressively clear p HD feed I ve also used the Pampers Lumi a solid camera slash wearable that only tracks diaper changes and sleep patterns However it looks like the sensor is hard to come by right now ーwe ve reached out to Pampers to see if the Lumi sensor and companion diapers are still widely available OwletWrap upThe Owlet Smart Sock Plus fills a need for people who are already on the Owlet bandwagon It allows parents to continue using a product they like and are comfortable with for a longer period of time Other than better algorithms and a larger sock there s not much difference between the Plus and the third gen device ーwhich was absolutely an improvement over the version that came before it I d expect the expansion pack to sell well as it provides what current customers will need to upgrade to the next sock level but is a high barrier to entry for a baby monitoring system that may not work for your sleep routine That said if you re an Owlet customer who is happy with your current smart sock it s unlikely you ll regret snagging an expansion pack when your kiddo has gotten big enough	2021-10-07 13:05:25
海外TECH	Engadget	‘Star Trek: Lower Decks’ is ready to let its ensign heroes rank up	https://www.engadget.com/star-trek-lower-decks-season-two-episode-nine-130037874.html?src=rss	Star Trek Lower Decks is ready to let its ensign heroes rank upThe following contains minor spoilers for season two episode nine of Star Trek Lower Decks Throughout the history of Star Trek it s generally accepted that a member of Starfleet will spend about three years as an ensign the lowest officer rank in the fleet It s the position given to new Starfleet Academy graduates and the status of the four protagonists on Lower Decks However as the show wraps up its second season and prepares for a third it does bring the character s status as “lowly ensigns into doubt This week s episode touches on though doesn t solve the problem by exploring the universal concept of a “lower decker In “wej Duj the first full Klingon language episode title in the entire franchise the USS Cerritos is in transit between missions giving the crew some much needed downtime Mariner Rutherford and Tendi use their day off to spend some personal time with senior officers which sends the bridge crew friendless Boimler into a panic since he notes that this will give them an edge when it comes to getting promoted He spends most of the episode trying and failing to get buddy buddy with various officers If this all feels like C plot level shenanigans well it is But as a result the show takes its biggest leap yet to fill out its narrative in this episode CBS“wej Duj is Klingon for “three ships and we get to see the crew of the Klingon vessel Che Ta where a very ambitious Boimler esque Klingon is trying to get in good with the current captain of his ship Old school fans will remember that authority on Klingon ships is assigned by force with an officer assuming command by killing the previous captain This young Klingon isn t quite that ambitious but he s perfectly happy to walk the captain s pet targ if it helps him become first officer The episode also shows us the happenings on a nearby Vulcan craft called Sh Vhal where a lower decker named T Lin there has been messing with the sensors and as a result notices some strange readings in the area that she takes to the captain to investigate The captain agrees to the search but he also reprimands her for undertaking such unnecessary adjustments to the ship CBSThe entire episode could have been played as a “slice of life with the three plot lines never intersecting and it still would have been a fairly successful installment of the series This isn t our first look at the internal life of a Klingon ship but it is our first look at a Vulcan crew and playing those distinct societies against Starfleet culture is a great bit of world building Star Trek has never been good about showing life outside Starfleet only lightly touching on the grander world in more recent shows like Picard and Prodigy And even those still have tenuous Starfleet connections Lower Decks has relished showing us the larger universe that the characters exist in and here we now get that same sense of expansion without the Starfleet worldview intruding That doesn t mean the storylines stand apart far from it All three ships and their plot lines come together in the end not only pulling the episode into one cohesive narrative but also continuing ーand starting to resolve ーa plot line that has lingered since the end of season one namely the Pakleds We finally find out why they suddenly became a huge threat in the Alpha Quadrant thanks to a series of machinations reminiscent of storylines on The Next Generation and Deep Space Nine Not everything is revolved by the end presumably leading into a big finale next week It s fair to say that seasons one and two basically comprise one full story arc with season three possibly presenting a fresh slate CBSAnd it s just in time too Each season has represented a year on the Cerritos Next season will mark three years on the Cerritos for Boimler Tendi and Rutherford placing them in line for a promotion And unlike Mariner s purposeful self sabotage her friends have all shown themselves to be competent trustworthy officers There s no reason they shouldn t be promoted ーand technically Brad Boimler already was at the end of last season having only been demoted and sent back to the Cerritos because of a transporter accident on the USS Titan While it s unlikely though not impossible that the characters will get promoted in the season finale it will have to happen some time next year for the show to maintain its verisimilitude in Star Trek canon The Cerritos doesn t have the luxury of being trapped in the Delta Quadrant as an excuse to keep its ensign an ensign poor Harry Kim But there s hope given what happens to our Klingon and Vulcan lower deckers by the end of “wej Duj Those outcomes alongside the episode wrapping on Brad giving sage advice to a young crewman seem to hint that the show is comfortable with letting our protagonists move on when it s time	2021-10-07 13:00:37
海外科学	NYT > Science	Pfizer Asks F.D.A. to Authorize Its Covid-19 Vaccine for Children 5 to 11	https://www.nytimes.com/2021/10/07/us/politics/pfizer-fda-authorization-children-5-11.html	Pfizer Asks F D A to Authorize Its Covid Vaccine for Children to The agency has promised to move quickly on the request and has tentatively scheduled a meeting at the end of the month to consider it	2021-10-07 13:24:18
海外科学	NYT > Science	Covid Vaccines and Children: Is One Dose Better Than Two?	https://www.nytimes.com/2021/10/06/health/covid-vaccine-children-dose.html	countries	2021-10-07 13:40:12
海外科学	NYT > Science	First Malaria Vaccine Approved by W.H.O.	https://www.nytimes.com/2021/10/06/health/malaria-vaccine-who.html	First Malaria Vaccine Approved by W H O Malaria kills about people each year about half of them children in Africa The new vaccine isn t perfect but it will help turn the tide experts said	2021-10-07 13:47:36
金融	金融庁ホームページ	信託業の免許について公表しました。	https://www.fsa.go.jp/news/r3/ginkou/20211007/20211007.html	免許	2021-10-07 15:00:00
ニュース	BBC News - Home	Back to school: How are pupils being kept Covid-safe?	https://www.bbc.co.uk/news/education-51643556?at_medium=RSS&at_campaign=KARANGA	disruption	2021-10-07 13:30:17
LifeHuck	ライフハッカー［日本版］	Apple Musicで試したい、iOS 15の4つの新機能	https://www.lifehacker.jp/2021/10/ios-15-apple-music-features.html	apple	2021-10-07 22:05:00
北海道	北海道新聞	未配達２５０万件にも印刷ミス　年金通知書、野党は攻勢強める	https://www.hokkaido-np.co.jp/article/597678/	個人情報	2021-10-07 22:04:53
北海道	北海道新聞	エネオス、再エネ大手の買収検討　石油依存からの脱却図る	https://www.hokkaido-np.co.jp/article/597718/	eneos	2021-10-07 22:13:00
北海道	北海道新聞	自民公約、経済安保推進法を明記　賃上げ企業に税制支援、原案判明	https://www.hokkaido-np.co.jp/article/597710/	政権公約	2021-10-07 22:20:07
北海道	北海道新聞	陸上女子で三つのドーピング違反　ナイジェリアのオカグバレ	https://www.hokkaido-np.co.jp/article/597684/	陸連	2021-10-07 22:18:17
北海道	北海道新聞	ポン監督が浜口監督を称賛　韓国の釜山国際映画祭で対談	https://www.hokkaido-np.co.jp/article/597686/	米アカデミー賞	2021-10-07 22:18:09
北海道	北海道新聞	北方領土「諸合意踏まえ交渉」　日ロ首脳、初の電話会談　５６年宣言触れず	https://www.hokkaido-np.co.jp/article/597711/	電話会談	2021-10-07 22:14:00
北海道	北海道新聞	ＮＹ円、１１１円前半	https://www.hokkaido-np.co.jp/article/597717/	外国為替市場	2021-10-07 22:08:00
北海道	北海道新聞	オ４―３日（７日）　日本ハム競り負け　伊藤８敗目	https://www.hokkaido-np.co.jp/article/597708/	取り合い	2021-10-07 22:03:17
海外TECH	reddit	Kanto Earthquake 10:41 PM	https://www.reddit.com/r/japanlife/comments/q39d3x/kanto_earthquake_1041_pm/	Kanto Earthquake PMEveryone fine submitted by u Disshidia to r japanlife link comments	2021-10-07 13:42:34
海外TECH	reddit	じしん	https://www.reddit.com/r/newsokunomoral/comments/q39csz/じしん/	じしんゆれゆれ submitted by u choconuts to r newsokunomoral link comments	2021-10-07 13:42:09
海外TECH	reddit	埼玉南部震度5強	https://www.reddit.com/r/newsokuexp/comments/q39e6u/埼玉南部震度5強/	tornewsokuexplinkcomments	2021-10-07 13:44:09