投稿時間:2022-06-20 23:37:43 RSSフィード2022-06-20 23:00 分まとめ(45件)

カテゴリー等 サイト名等 記事タイトル・トレンドワード等 リンクURL 頻出ワード・要約等/検索ボリューム 登録日
python Pythonタグが付けられた新着投稿 - Qiita numpy.stackのaxis=-1について https://qiita.com/yo314159265/items/59560508062ea25bbf43 numpy 2022-06-20 22:58:16
python Pythonタグが付けられた新着投稿 - Qiita 【超簡単】Pythonライブラリ「Pandas」の基本的な使い方 https://qiita.com/nakachan-ing/items/8a2620589ad8c6def868 pandas 2022-06-20 22:17:21
python Pythonタグが付けられた新着投稿 - Qiita 簡単にランダムデータを作れるpythonライブラリを作ってみた https://qiita.com/yowaimori/items/42798fff7ec69baaa363 作ってみた 2022-06-20 22:05:09
python Pythonタグが付けられた新着投稿 - Qiita [Python] [EXCEL] 結合セルをdataframeに読み込んで、欠損地の各行に値を入れる ☆便利☆ https://qiita.com/Kent-747/items/08c1f5c642d4e2c7324c pythonimp 2022-06-20 22:01:54
js JavaScriptタグが付けられた新着投稿 - Qiita Gatsby.jsのgatsby-starter-blogをDockerで動かす https://qiita.com/junkin_au/items/9614dda124066ed1814b docker 2022-06-20 22:39:34
js JavaScriptタグが付けられた新着投稿 - Qiita 【Nuxt.js】axiosをインストール https://qiita.com/misaki_soeda/items/091058a70c448f744dbd yarnyarnaddnu 2022-06-20 22:34:12
AWS AWSタグが付けられた新着投稿 - Qiita 会社Tech Blog書いた記事集め https://qiita.com/cheekykorkind/items/15e0a832cd766a796fe2 codebuild 2022-06-20 22:18:56
AWS AWSタグが付けられた新着投稿 - Qiita AWS CLI でS3バケットを扱う https://qiita.com/oichokabu/items/081c14b83e6622aa6a5d awscli 2022-06-20 22:02:40
Docker dockerタグが付けられた新着投稿 - Qiita Docker Composeでよく使うコマンドメモ https://qiita.com/junkin_au/items/6ac1c7a8ef44bcbf0c39 docker 2022-06-20 22:39:53
Docker dockerタグが付けられた新着投稿 - Qiita Zenn CLI環境をDockerで構築 https://qiita.com/junkin_au/items/be7f6e55c6aa592a7cd4 docker 2022-06-20 22:38:46
GCP gcpタグが付けられた新着投稿 - Qiita 【Cloud Run】 デプロイするために必要なパーミッション(GCP) https://qiita.com/piggydev/items/02b47511467444bd3724 cloudrun 2022-06-20 22:37:19
Azure Azureタグが付けられた新着投稿 - Qiita 会社Tech Blog書いた記事集め https://qiita.com/cheekykorkind/items/15e0a832cd766a796fe2 codebuild 2022-06-20 22:18:56
Git Gitタグが付けられた新着投稿 - Qiita GitHubにSSH接続する際に使用する秘密鍵を指定する https://qiita.com/junkin_au/items/32db55188af1f3a9df0d github 2022-06-20 22:39:25
Git Gitタグが付けられた新着投稿 - Qiita よく使うGitコマンド https://qiita.com/oichokabu/items/ac52a8cb09b599a01cbd force 2022-06-20 22:09:17
Ruby Railsタグが付けられた新着投稿 - Qiita はじめての環境構築 ~WindowsでRailsの開発環境を構築する~ https://qiita.com/ms461/items/a26a0bb93ba7cffd82b6 rails 2022-06-20 22:10:56
Ruby Railsタグが付けられた新着投稿 - Qiita 【Rails】【MySQL】Mysql2::Error: Specified key was too long; max key length is 767 bytes https://qiita.com/harukioo/items/74689243310c516cf61d devise 2022-06-20 22:08:44
技術ブログ Developers.IO [AWS Step Functions / AWS CDK] 任意のJavaScript表現を実行できるEvaluateExpressionタスクを使って文字列置換をしてみた https://dev.classmethod.jp/articles/aws-step-functionsaws-cdk-string-substitution-using-the-evaluateexpression-task-that-can-execute-arbitrary-javascript-expressions/ awsstepfucntions 2022-06-20 13:10:40
海外TECH MakeUseOf Discover Samsung Summer Deals Are Live: Save Hundreds on TVs, Smartphones, More https://www.makeuseof.com/discover-samsung-summer-deals/ samsung 2022-06-20 13:25:13
海外TECH DEV Community Is Cypress Easy to Learn? GET and FIND Command Hacks💻 | Cypress Tutorial | Part II https://dev.to/lambdatestteam/is-cypress-easy-to-learn-get-and-find-command-hacks-cypress-tutorial-part-ii-125g Is Cypress Easy to Learn GET and FIND Command Hacks Cypress Tutorial Part IIThis video showcases the “GET and “FIND commands in this Cypress Testing Tutorial Series Try LambdaTest nowGet Started with LambdaTest Cypress Automation Know more on LambdaTest Cypress Testing This video is a part of the Cypress Testing Tutorial series It showcases the usage of GET and FIND commands supported by the Cypress test automation framework By the end of this video you will learn How to write the first Cypress test Is Cypress easy to learn WebElements on the DOM Document Object Model using the GET command Where to use the FIND command When and how to use GET and FIND commands How to navigate around the DOM using Cypress 2022-06-20 13:52:41
海外TECH DEV Community Upgrading my AWS CDK stacks to AWS CDKv2 https://dev.to/aws/upgrading-my-aws-cdk-stacks-to-aws-cdkv2-2fa3 Upgrading my AWS CDK stacks to AWS CDKvThe CDK has been released in two major versions v and v This is the Developer Guide for AWS CDK v AWS CDK v entered maintenance on June As part of some recent talks and demos I was doing I wanted to update the CDK stacks for Managed Workflows for Apache Airflow MWAA and thought I would outline what I learned along the way Prepping for CDKvIn AWS CDKv the different CDK constructs were imported as discrete Python libraries for example aws cdk aws s deployment aws cdk aws mwaa aws cdk aws kms etc that were imported in the requirements txt file AWS CDKv has a different approach so I needed to clean up all the CDK construct modules that I had imported for the CDKv stacks I ended up using the following command to do this You can read more about the differences in this post Migrating to AWS CDK vpip list grep cdk xargs pip uninstall yI updated my requirements txt file as follows aws cdk lib constructs gt lt Finally I had to update the cdk json file as some of the values have changed app python app py context aws cdk aws apigateway usagePlanKeyOrderInsensitiveId false aws cdk aws cloudfront defaultSecurityPolicyTLSv false aws cdk aws rds lowercaseDbIdentifier false aws cdk core stackRelativeExports false Installing AWS CDKvTo install CDKv I did the following npm install g aws cdkYou can check that it has updated by running cdk version build d It should display x if it displays x then check your alias commands alternatives or try and uninstall and then reinstall If you need to keep both CDKv and v then consider using alias commands to help you alias cdk npx aws cdk x alias cdk npx aws cdk x Re bootstraping AWS CDK One of the first things once I fixed updated my CDK stacks was to re bootstrap CDK I did not know I had to do that but the first time I did a cdk deploy I was prompted with this message first current credentials could not be used to assume arn aws iam role cdk hnbfds lookup role eu central but are for the right account Proceeding anyway followed quickly by an error message mwaa hybrid backend failed Error mwaa hybrid backend SSM parameter cdk bootstrap hnbfds version not found Has the environment been bootstrapped Please run cdk bootstrap see at CloudFormationDeployments validateBootstrapStackVersion Users ricsue nvm versions node v lib node modules aws cdk lib api cloudformation deployments ts at processTicksAndRejections internal process task queues js at CloudFormationDeployments publishStackAssets Users ricsue nvm versions node v lib node modules aws cdk lib api cloudformation deployments ts at CloudFormationDeployments deployStack Users ricsue nvm versions node v lib node modules aws cdk lib api cloudformation deployments ts at CdkToolkit deploy Users ricsue nvm versions node v lib node modules aws cdk lib cdk toolkit ts at initCommandLine Users ricsue nvm versions node v lib node modules aws cdk lib cli ts mwaa hybrid backend SSM parameter cdk bootstrap hnbfds version not found Has the environment been bootstrapped Please run cdk bootstrap see I was able to fix this quickly by running the CDK Bootstrap command cdk bootstrap aws eu central Note I was doing this with an IAM user with AdminAccess Using default execution policy of arn aws iam aws policy AdministratorAccess Pass cloudformation execution policies to customize In the past when I have talked with builders who do not have Admin access but are using either an IAM user or a Role they have to following this doc and modify the bootstrap template with the role and permissions they have cloudformation execution policies also see this issueChanges to imports and other nigglesThe first thing I needed to do was get my head around the changes to the imports and libraries within my stacks For example I had to change fromfrom aws cdk import corefrom aws cdk core import Tagsimport aws cdk aws ec as ecimport aws cdk aws s as simport aws cdk aws s deployment as sdeployimport aws cdk aws mwaa as mwaaimport aws cdk aws iam as iamimport aws cdk aws kms as kmsto thisfrom aws cdk import aws iam as iam aws ec as ec aws s as s aws s deployment as sdeploy aws mwaa as mwaa aws kms as kms Stack CfnOutput Tags from constructs import ConstructWhich is actually nicer and cleaner I think I had to update references to the classes within my code but that was pretty straight forward and just took some time to go through to make sure I had not missed anything Fixing changes to the VPC private subnet constructsIn some of the constructs it looks like some of the values have changed between v and v In the VPC construct for example creating a Private subnet used to be done via self vpc ec Vpc self id MWAA Hybrid ApacheAirflow VPC cidr max azs nat gateways subnet configuration ec SubnetConfiguration name public cidr mask reserved False subnet type ec SubnetType PUBLIC ec SubnetConfiguration name private cidr mask reserved False subnet type ec SubnetType PRIVATE enable dns hostnames True enable dns support True and this had to be updated to self vpc ec Vpc self id MWAA Hybrid ApacheAirflow VPC cidr max azs nat gateways subnet configuration ec SubnetConfiguration name public cidr mask reserved False subnet type ec SubnetType PUBLIC ec SubnetConfiguration name private cidr mask reserved False subnet type ec SubnetType PRIVATE WITH NAT enable dns hostnames True enable dns support True This was the only one PRIVATE to PRIVATE WITH NAT that I needed to adjust but you may have others Fixing SSM ErrorsOnce the CDK stacks were validated and clear for deployment I encountered a feature when generating IAM policies and roles It was whilst fixing a different CDK stack Orchestrating Hybrid Workflows with Apache Airflow GitHub repo blogpost airflow hybrid that I found that even though the stack had synthesised ok during the deployment I got the following error Invalid principal in policy SERVICE ssm eu west amazonaws com Service AmazonIdentityManagement Status Code Error Code MalformedPolicyDocument Request ID d c ef bd eafee Proxy null This error appeared in both the command prompt where I ran the cdk deploy but also appeared in the CloudFormation console which is a good place to go when you are trying to figure out what is going wrong Upon looking at the synthesised CloudFormation template you could see that IAM Principal was regionalising the ssm amazonaws com so it was creating this as ssm eu west amazonaws com in my case which was a problem In my stack I defined the following role external task def policy document role iam Role self ExternalECSAnywhereRole role name f props ecsclustername ExternalECSAnywhereRole assumed by iam ServicePrincipal ssm amazonaws com and this was failing it worked fine in CDKv In the end after reading GitHub issues and I was able to fix this issue within my stack by adding this code ssmfix external task def policy document role node default child ssmfix add property override AssumeRolePolicyDocument Statement Principal Service ssm amazonaws com Deploying the updated stacksOnce I had made these changes I was then able to deploy the MWAA stack first the backend VPC and Networking and then the environment You can find the code for this in the GitHub repository blogpost cdk mwaaDeployment of the MWAA network backend Here is the output that you will see more or less Synthesis time smwaa hybrid backend deploying start Publishing cbafcfaccdecffefff eu central success Published cbafcfaccdecffefff eu central mwaa hybrid backend creating CloudFormation changeset mwaa hybrid backendDeployment time sOutputs mwaa hybrid backend ExportsOutputRefMWAAHybridApacheAirflowVPCBEFFF vpc bbdeeeefffmwaa hybrid backend ExportsOutputRefMWAAHybridApacheAirflowVPCprivateSubnetSubnetADFFD subnet edbefcfmwaa hybrid backend ExportsOutputRefMWAAHybridApacheAirflowVPCprivateSubnetSubnetACA subnet bfbdmwaa hybrid backend VPCId vpc bbdeeeefffStack ARN arn aws cloudformation eu central stack mwaa hybrid backend bd f ec bf dbfacaTotal time sDeployment of the MWAA environmentHere is the output that you will see more or less Including dependency stacks mwaa hybrid backend Warning at mwaa hybrid environment mwaa sg Ignoring Egress rule since allowAllOutbound is set to true To add customize rules set allowAllOutbound false on the SecurityGroupSynthesis time smwaa hybrid backendmwaa hybrid backend deploying start Publishing cbafcfaccdecffefff eu central success Published cbafcfaccdecffefff eu central mwaa hybrid backend no changes Deployment time sOutputs mwaa hybrid backend ExportsOutputRefMWAAHybridApacheAirflowVPCBEFFF vpc bbdeeeefffmwaa hybrid backend ExportsOutputRefMWAAHybridApacheAirflowVPCprivateSubnetSubnetADFFD subnet edbefcfmwaa hybrid backend ExportsOutputRefMWAAHybridApacheAirflowVPCprivateSubnetSubnetACA subnet bfbdmwaa hybrid backend VPCId vpc bbdeeeefffStack ARN arn aws cloudformation eu central stack mwaa hybrid backend bd f ec bf dbfacaTotal time smwaa hybrid environmentThis deployment will make potentially sensitive changes according to your current security approval level require approval broadening Please confirm you intend to make the following modifications IAM Statement Changes┌ー┬ー┬ー┬ー┬ー┬ー┐││Resource │Effect │Action │Principal │Condition │├ー┼ー┼ー┼ー┼ー┼ー┤│ │ Custom CDKBucketDeploymen │Allow │sts AssumeRole │Service lambda amazonaws com ││││tBBBAAFBCCEB │││││││C ServiceRole Arn │││││├ー┼ー┼ー┼ー┼ー┼ー┤│ │ mwaa dags Arn │Deny │s ListAllMyBuckets │AWS mwaa service role ││││ mwaa dags Arn ││││││ │ mwaa dags Arn │Allow │s │AWS mwaa service role ││││ mwaa dags Arn ││││││ │ mwaa dags Arn │Allow │s Abort │AWS Custom CDKBucketDeplo ││││ mwaa dags Arn ││s DeleteObject │ymentBBBAAFBC ││││││s GetBucket │CEBC ServiceRole ││││││s GetObject │││││││s List │││││││s PutObject │││├ー┼ー┼ー┼ー┼ー┼ー┤│ │ mwaa hybrid demoKey Arn │Allow │kms CancelKeyDeletion │AWS arn AWS Partition ia ││││││kms Create │m root ││││││kms Decrypt │││││││kms Delete │││││││kms Describe │││││││kms Disable │││││││kms Enable │││││││kms GenerateDataKey │││││││kms Get │││││││kms List │││││││kms Put │││││││kms Revoke │││││││kms ScheduleKeyDeletion │││││││kms Update ││││ │ mwaa hybrid demoKey Arn │Allow │kms Decrypt │Service logs eu central am │ ArnLike │││││kms Describe │azonaws com │ kms EncryptionContext aws lo │││││kms Encrypt ││gs arn arn aws logs eu centr │││││kms GenerateDataKey ││al │││││kms PutKeyPolicy ││ │││││kms ReEncrypt │││├ー┼ー┼ー┼ー┼ー┼ー┤│ │ mwaa service role Arn │Allow │sts AssumeRole │Service airflow env amazonaw │││││││s com │││││││Service airflow amazonaws co │││││││m │││││││Service ecs tasks amazonaws │││││││com ││├ー┼ー┼ー┼ー┼ー┼ー┤│ │ │Allow │logs DescribeLogGroups │AWS mwaa service role │││ │ │Allow │ecs DescribeTaskDefinition │AWS mwaa service role ││││││ecs DescribeTasks │││││││ecs ListTasks │││││││ecs RegisterTaskDefinition │││││││ecs RunTask ││││ │ │Allow │iam PassRole │AWS mwaa service role │ StringLike │││││││ iam PassedToService ecs t │││││││asks amazonaws com │││││││ ││ │ │Allow │kms Decrypt │AWS mwaa service role │ StringEquals │││││kms DescribeKey ││ kms ViaService │││││kms Encrypt ││ sqs eu central amazonaws │││││kms GenerateDataKey ││ com │││││kms PutKeyPolicy ││ s eu central amazonaws │││││││com │││││││ │││││││ │├ー┼ー┼ー┼ー┼ー┼ー┤│ │arn AWS Partition s c │Allow │s GetBucket │AWS Custom CDKBucketDeplo ││││dk hnbfds assets ││s GetObject │ymentBBBAAFBC ││││ eu central ││s List │CEBC ServiceRole ││││arn AWS Partition s c │││││││dk hnbfds assets │││││││ eu central │││││├ー┼ー┼ー┼ー┼ー┼ー┤│ │arn aws airflow eu central │Allow │airflow PublishMetrics │AWS mwaa service role ││││ environment mw │││││││aa hybrid demo │││││├ー┼ー┼ー┼ー┼ー┼ー┤│ │arn aws logs eu central │Allow │logs CreateLogGroup │AWS mwaa service role ││││ log group airflow ││logs CreateLogStream │││││ mwaa hybrid demo ││logs DescribeLogGroups │││││││logs GetLogEvents │││││││logs GetLogGroupFields │││││││logs GetLogRecord │││││││logs GetQueryResults │││││││logs PutLogEvents │││├ー┼ー┼ー┼ー┼ー┼ー┤│ │arn aws sqs eu central a │Allow │sqs ChangeMessageVisibility │AWS mwaa service role ││││irflow celery ││sqs DeleteMessage │││││││sqs GetQueueAttributes │││││││sqs GetQueueUrl │││││││sqs ReceiveMessage │││││││sqs SendMessage │││└ー┴ー┴ー┴ー┴ー┴ー┘IAM Policy Changes┌ー┬ー┬ー┐││Resource │Managed Policy ARN │├ー┼ー┼ー┤│ │ Custom CDKBucketDeploymentBBBAAFBCCEBC Ser │arn AWS Partition iam aws policy service role AWSLambdaBasic │││viceRole │ExecutionRole │└ー┴ー┴ー┘Security Group Changes┌ー┬ー┬ー┬ー┬ー┐││Group │Dir │Protocol │Peer │├ー┼ー┼ー┼ー┼ー┤│ │ mwaa sg GroupId │In │Everything │ mwaa sg GroupId ││ │ mwaa sg GroupId │Out │Everything │Everyone IPv │└ー┴ー┴ー┴ー┴ー┘ NOTE There may be security related changes not in this list See Do you wish to deploy these changes y n ymwaa hybrid environment deploying start Publishing eabfdadeffeecccebcbfedfed eu central start Publishing cafeabebbdaaedacbffcceaac eu central start Publishing abfccbcfbefeffbbabdeeebbfd eu central start Publishing faeedcabdbcfebbbbecbfaeffb eu central success Published cafeabebbdaaedacbffcceaac eu central success Published abfccbcfbefeffbbabdeeebbfd eu central success Published faeedcabdbcfebbbbecbfaeffb eu central success Published eabfdadeffeecccebcbfedfed eu central mwaa hybrid environment creating CloudFormation changeset mwaa hybrid environmentDeployment time sOutputs mwaa hybrid environment MWAASecurityGroup sg eaecadedbbStack ARN arn aws cloudformation eu central stack mwaa hybrid environment a f ec a babfdfbTotal time s ConclusionIt was pretty straight forward in the end to update my stacks but it did take me longer thanks to this being the first time and also encountering the SSM issue along the way As I have updated subsequent stacks it has definitely become much easier and quicker so I recommend that you begin on a simple stack to gain confidence and then apply that to your other stacks If you encounter any issues running my stacks on CDKv please raise an issue on the GitHub rep and I will take a look and fix 2022-06-20 13:36:11
海外TECH DEV Community Reducing distractions? Routines? Music? Automations? What's your favourite productivity hack? https://dev.to/postman/reducing-distractions-routines-music-automations-whats-your-favourite-productivity-hack-2hc0 Reducing distractions Routines Music Automations What x s your favourite productivity hack My family and I recently went on a vacation trip with our camper van and when burglars broke into it while we were having lunch among other things they took away my Surface headphones I didn t realise I do need them so much for my personal productivity until today I often listen to Lo Fi HipHop Radio on YouTube while working Not today obviously At least not through my favourite bluetooth headphones Being tied to a cable is just not the same I also get distracted easily Not only through stuff lying around on my desk but also digitally Opening a website like spiegel de German news outlet or home assistant home automation platform is pandora s box to me So I try to make it a habit to not visit these sites or do personal things at all from my work machine Sometimes it s also automated tasks that remind me of doing things A web crawler a Slack bot that mentions me on certain keywords or in my case URLs of events that are not yet on our database Sometimes it s a Postman Monitor that brings my focus back to an important task I rely on music good habits practices and automations bots to keep productivity at a reasonable level What s your hacks to stay productive throughout the day 2022-06-20 13:30:05
海外TECH DEV Community Meme Monday!?! https://dev.to/ben/meme-monday-3ji7 Meme Monday Welcome to another Meme Monday post Today s cover image comes from my favorite submission from last week s thread MongoDB shade all in good fun DEV is an inclusive space Humor in poor taste will be downvoted by mods 2022-06-20 13:15:42
海外TECH DEV Community Generating reports and KPIs with throw-away databases on AWS https://dev.to/aws-heroes/generating-reports-and-kpis-with-throw-away-databases-on-aws-5ano Generating reports and KPIs with throw away databases on AWSWe all love metrics We all need numbers And different stakeholders need different numbers Numbers that will drive key decisions inside your organization and for your customers Becoming a data driven organization requires having reliable data in the first place Whatever is daily weekly or monthly there is always a new report to be generated In Funambol most of these reports are generated running a proprietary Java application that queries the production MySQL databases Once created they are encrypted and delivered to the different internal and external stakeholders If it ain t broke don t fix it But how can you generate accurate reports optimize resources improve automation without querying and impacting the live deployment Let us first see what issues we faced while running the reports on the production database the execution time of these reports might vary between a few minutes and many hours according to the size of the deployment And can be affected by the existing load on the production environments Should we size the database for the peak load handling traffic and generating reports at the same time Should we dedicate a read replica to reporting activity only Your cloud provider will be happy you would be paying but giving away CPUs and storage the long running queries on the database make it very hard to achieve elasticity Either you scale your database or you keep the query running You cannot achieve both of them and a failure in the report can be costly reporting and users are different scenarios And require very different configuration and indexes at the database layer Compromising to cover both imply suboptimal performances of the database Running reporting on an isolated deployment is going to help the production database too as you can get rid of indexes you do not need anymore And you will save storage and a few write IOPS the results might not be accurate as data can change during the execution It is a live system If the number of users is you cannot report that there are active and idle users as someone signed up while you generated the report The difference might not be significant but what about the confidence level of your stakeholders What is a throw away database We are all familiar with the “Pets vs Cattle analogy in software development But here I define a throw away database our cattle database as one that we have running for the minimum time we need to take care of our reporting Let us see how it helps us in decoupling KPI generation and the users automating the process as well Funambol deploys its infrastructure on AWS so going forward in this post I will draw an AWS Architecture Diagram and use AWS names and examples But most of the steps can be achieved using the infrastructure and the services provided by any of the major cloud providers Let us assume you have a web application that connects to an Amazon RDS Multi AZ Deployment How can we decouple the report generation We can draw first a diagram with the new components on the right side A throw away workflow for our KPIsLet us describe the main steps that we have to put in place in our new workflow starting the process from a management server In all these we are using snippets that rely on the AWS CLI focusing only on the key steps but you can achieve the same using the AWS SDK in the language you like most snapshotting the database one of the first steps is to have the data frozen at the time when we want to generate the report We achieve that by creating a storage volume snapshot of the production DB instance For example if we want to generate the KPIs for a system at midnight that is the time when we trigger the creation of the snapshot aws rds create db snapshot db snapshot identifier lt my kpi snapshot gt db instance identifier lt my production db gt we can now create the cattle database from the snapshot once the snapshot is available we create a new RDS instance aws rds restore db instance from db snapshot db snapshot identifier lt my kpi snapshot gt db instance identifier lt my kpi db gt we can now configure a different parameter group that will be used for the KPIs only and will allow to tune the database to the specific queries we are going to run We introduce new indexes as well and we can optimize the instance class and type aws rds modify db instance db instance identifier lt my kpi db gt vpc security group ids my kpi environment backup retention period apply immediately we can now trigger our process to generate the KPIs on our new temporary environment Once the results are available and delivered to the stakeholders we can turn off the database and stop paying for it We will still have the snapshot we used and could easily reprocess the data if we have any issue aws rds delete db instance db instance identifier lt my kpi db gt skip final snapshot MonitoringAs any impact to the delivery of the reports could severely impact key stakeholders we need to have a process in place to monitor and react promptly if the process fail We can as well push the results to CloudWatch Logs and even rely on trend analysis forecasting implementing our own algorithms or using CloudWatch Anomaly Detection ConclusionsLet us see the benefits of adding a throw away database to our deployment elasticity and cost optimization the production database does not need to handle sporadic peaks to generate the reports and indexes instance sizes and configuration can be optimized both on the production and KPI databases to better handle the specific requests The extra temporary cost of the second single zone RDS was significantly less than the average cost saving on the production databases thanks to the scaling down possible in many of them reliable and on time results all the reports and KPIs are now generated on a database that represents the frozen status at the specific time no changing data anymore during the execution of the tools The delivery time of the reports is more predictable as it is not affected by the variable load of the production database Failures in generating the reports are spotted quickly and can easily and promptly be rectified as we have the frozen status of the database the snapshot automation a common automatic process is used across all the live deployments of Funambol to generate different reports and KPIs decoupling we can optimize database configuration and indexes according to the decoupled use case As the new solution is now independent of the production database it makes easier to plan further improvements as the size of the largest deployment increase we could process specific data and move and consolidate them in a common warehousing solution Thanks for making it this far I am always looking for feedback to make it better so please feel free to reach out to me via LinkedIn or email CreditsThis post originally appeared on the Funambol Tech Blog 2022-06-20 13:12:40
海外TECH DEV Community Introducing the Offen Consent Tool https://dev.to/hendr_ik/introducing-the-offen-consent-tool-5bal Introducing the Offen Consent ToolWe are building Offen a fair web analytics software that treats operators and users as equal parties Operators can gain insights into how users interact with their services while ensuring that they retain full control over their data Along the way we created the Offen Consent Tool A lightweight solution for managing user consent on websites Read the full version of this article on the Offen blog The Tool is using st Party Cookies to store user s consent decisions To enable this mechanism you need to deploy the respective server to a sibling domain i e if you plan to use the tool on www example com  it should be served on a domain like consent example com The tool can serve any number of domains at once so it s possible to use the same deployment for multiple domains at once Next deploy the application to a domain like consent example com On the host site www example com embed the client script lt script src gt which exposed window ConsentClient In your client side code construct a new client instance pointing at your deployment and request user consent for the desired scope s const client new window ConsentClient url client acquire analytics marketing then decisions gt if decisions analytics load analytics data if decisions marketing trigger marketing tools The Offen Consent Tool further allows you to create the binary yourself and provides a development setup It can also be used as a library and be integrated into any web server written in Golang Learn moreRead the Docs for further assistance with installation and use Open DocsIf you have any feedback comments or bug reports about this or other project we would love to hear from you  Open an issue on GitHub 2022-06-20 13:10:16
Apple AppleInsider - Frontpage News Apple Home versus HomeKit, new air purifier, and more on HomeKit Insider https://appleinsider.com/articles/22/06/20/apple-home-versus-homekit-new-air-purifier-and-more-on-homekit-insider?utm_medium=rss Apple Home versus HomeKit new air purifier and more on HomeKit InsiderYour Hosts discuss yet another new HomeKit air purifier talk about how Home may be the new name for HomeKit and answer a few listener questions on the latest episode of the HomeKit Insider podcast HomeKit InsiderApolnus has announced a new HomeKit enabled air purifier that is unique in that it doesn t require replacement filters The included filters are washable allowing them to be perpetually cleaned and reducing running costs Read more 2022-06-20 13:27:17
Apple AppleInsider - Frontpage News Daily deals June 20: $230 Apple Watch SE, $115 Beats Studio Buds $188 Level Lock Smart Lock, more https://appleinsider.com/articles/22/06/20/daily-deals-june-20-230-apple-watch-se-115-beats-studio-buds-188-level-lock-smart-lock-more?utm_medium=rss Daily deals June Apple Watch SE Beats Studio Buds Level Lock Smart Lock moreMonday s best deals include off a Dyson Pure Cool Purifying Fan off an LG inch OLED K Smart TV and much more Best deals for June Every day AppleInsider searches online stores every day to uncover discounts and offers on Apple hardware smart devices accessories toys and other products The best finds are collected together into our daily deals list Read more 2022-06-20 13:03:34
海外科学 NYT > Science Think All Viruses Get Milder With Time? Not This Rabbit-Killer. https://www.nytimes.com/2022/06/20/science/myxoma-virus-rabbits-covid.html Think All Viruses Get Milder With Time Not This Rabbit Killer The myxoma virus fatal to millions of Australian rabbits is a textbook example of the unexpected twists in the evolution of viruses and their hosts 2022-06-20 13:14:51
海外科学 NYT > Science Covid Vaccines for Children Under 5 Are Coming, but Many Parents Have Questions https://www.nytimes.com/2022/06/18/health/covid-vaccines-children.html Covid Vaccines for Children Under Are Coming but Many Parents Have QuestionsThe vaccines seem safe for children and are likely to protect against severe illness But data on efficacy are thin and most children have already been infected 2022-06-20 13:48:33
金融 金融庁ホームページ 金融教育の時代に必須の取組!若年層取引につなげる情報提供について更新しました。 https://www.fsa.go.jp/teach/kyouiku/01/01.html 情報提供 2022-06-20 15:00:00
金融 金融庁ホームページ 保険監督者国際機構(IAIS)による市中協議文書「合算手法(AM)の国際資本基準(ICS)との比較可能性評価 に係る基準案」について掲載しました。 https://www.fsa.go.jp/inter/iai/20220620.html 保険監督者国際機構 2022-06-20 15:00:00
ニュース BBC News - Home Rail strike: Travellers face 'misery' in biggest walkout in 30 years https://www.bbc.co.uk/news/uk-61861040?at_medium=RSS&at_campaign=KARANGA misery 2022-06-20 13:43:16
ニュース BBC News - Home Helicopter crashes in field near Burton in Lonsdale https://www.bbc.co.uk/news/uk-england-york-north-yorkshire-61869042?at_medium=RSS&at_campaign=KARANGA bentham 2022-06-20 13:12:34
ニュース BBC News - Home Five Britons released after arrest by Taliban https://www.bbc.co.uk/news/uk-61869012?at_medium=RSS&at_campaign=KARANGA afghanistan 2022-06-20 13:27:43
ニュース BBC News - Home Free school meals: Wales' rollout starts in September https://www.bbc.co.uk/news/uk-wales-61853137?at_medium=RSS&at_campaign=KARANGA primary 2022-06-20 13:50:06
ニュース BBC News - Home Rail strike: When is it and which trains are running? https://www.bbc.co.uk/news/business-61634959?at_medium=RSS&at_campaign=KARANGA railway 2022-06-20 13:45:36
北海道 北海道新聞 徴用工問題解決へ協議会、韓国 尹政権、具体的動きか https://www.hokkaido-np.co.jp/article/695915/ 徴用工問題 2022-06-20 22:24:08
北海道 北海道新聞 石川の地震、数カ月で終わらない 政府調査委、メカニズム結論出ず https://www.hokkaido-np.co.jp/article/695948/ 最大震度 2022-06-20 22:08:00
北海道 北海道新聞 中国、東シナ海のガス田施設完成 日本抗議「一方的開発は遺憾」 https://www.hokkaido-np.co.jp/article/695952/ 日中中間線 2022-06-20 22:20:00
北海道 北海道新聞 サッカー選手会、サンプドリア吉田が新会長に 権田と戸嶋、副会長に新任 https://www.hokkaido-np.co.jp/article/695951/ 定時総会 2022-06-20 22:18:00
北海道 北海道新聞 参院選道選挙区、与野党が身内でも神経戦 改選数3、2人当選は票分配が鍵 https://www.hokkaido-np.co.jp/article/695925/ 選挙区 2022-06-20 22:13:56
北海道 北海道新聞 G20接種アプリ相互使用で合意 渡航円滑化へ、保健相会合 https://www.hokkaido-np.co.jp/article/695947/ 相互 2022-06-20 22:05:00
北海道 北海道新聞 与党議員が芸能人の兵役免除主張 韓国、BTSの活動一時休止で https://www.hokkaido-np.co.jp/article/695946/ 兵役免除 2022-06-20 22:01:00
仮想通貨 BITPRESS(ビットプレス) クニエ、「分散型金融システムのトラストチェーンにおける技術リスク等に関する研究」(2022年6月16日公表) https://bitpress.jp/count2/3_9_13261 金融 2022-06-20 22:49:01
仮想通貨 BITPRESS(ビットプレス) 【金融庁】「デジタル・分散型金融への対応のあり方等に関する研究会」(第6回)議事次第 https://bitpress.jp/count2/3_17_13260 金融庁 2022-06-20 22:44:06
仮想通貨 BITPRESS(ビットプレス) カイカエクスチェンジ(Zaif)、7/3まで「自動売買おてがるトレードサービス提供開始記念キャンペーン」実施 https://bitpress.jp/count2/3_14_13259 自動売買 2022-06-20 22:35:00

コメント

このブログの人気の投稿

投稿時間:2021-06-17 05:05:34 RSSフィード2021-06-17 05:00 分まとめ(1274件)

投稿時間:2021-06-20 02:06:12 RSSフィード2021-06-20 02:00 分まとめ(3871件)

投稿時間:2020-12-01 09:41:49 RSSフィード2020-12-01 09:00 分まとめ(69件)