投稿時間:2022-04-02 08:32:11 RSSフィード2022-04-02 08:00 分まとめ(33件)

カテゴリー等	サイト名等	記事タイトル・トレンドワード等	リンクURL	頻出ワード・要約等/検索ボリューム	登録日
python	Pythonタグが付けられた新着投稿 - Qiita	mtg-sdk-pythonで四苦八苦する②	https://qiita.com/poslogithub/items/2c10ed32ab17ba82db88	その他アルケミーアルケミーで調整されたカードは、デッキリストでは以下の扱いとなる。	2022-04-02 07:03:27
AWS	AWSタグが付けられた新着投稿 - Qiita	GuardDuty有効化から無効化まで	https://qiita.com/emiki/items/17b4df4618798cacdac8	GuardDutyの画面に戻り、作成したKMSキーを設定して保存をクリックする。	2022-04-02 07:35:24
海外TECH	Ars Technica	NIH begins trial of COVID boosters to fight future variants	https://arstechnica.com/?p=1845343	booster	2022-04-01 22:28:18
海外TECH	DEV Community	Qué es y como crear ETL en AWS Glue Parte 3	https://dev.to/davidshaek/que-es-y-como-crear-etl-en-aws-glue-parte-3-4n6n	Quées y como crear ETL en AWS Glue Parte Continuando con la tercera y final parte del tutorial explicare el código de nuestro ejemplo Escribiendo el códigoEmpezaremos por incluir las siguienteslibrerias de Glue JsonOptions nos permitiráespecificar los paths dónde queremos que se cree nuestro archivo final DynamicFrame nos permitirácrear un frame de datos de tipo sparkGlueContext nos permitiráejecutar nuestro job ETL en el entorno serverlessGlueArgParser nos permitiráleer las variables de sysArgs que enviemos a nuestro jobimport com amazonaws services glue util JsonOptionsimport com amazonaws services glue DynamicFrame GlueContext import com amazonaws services glue util GlueArgParserDefiniremos nuestra GlueApp y nuestro main donde se realizarála primera ejecución de nuestro códigoobject GlueApp def main sysArgs Array String Ahora declararemos nuestras variables GlueContext es el punto de entrada para leer y escribir un DynamicFrame de un bucket de Amazon S un catálogo de datos de AWS JDBC etc Esta clase ofrece funciones de utilidades para crear objetos Característica DataSource y DataSink que a su vez se pueden usar para leer y escribir objetos DynamicFrame val glueContext GlueContext new GlueContext sc Punto de entrada principal para la funcionalidad Spark Un SparkContext representa la conexión a un clúster Spark y se puede usar para crear RDD acumuladores y variables de difusión en ese clúster val sc SparkContext new SparkContext Genera un identificador de la sesión Sparkval spark glueContext getSparkSessionobject GlueApp val glueContext GlueContext new GlueContext sc val sc SparkContext new SparkContext val spark glueContext getSparkSession def main sysArgs Array String Si deseamos leer una variable de ambiente que hemos enviado en los job parameters lo podemos leer de la siguiente forma Lee el valor del job parameter enviado ejemplo env key ci value el valor lo leerácomo ci val args GlueArgParser getResolvedOptions sysArgs Array env ejemplo val table s args env transactions se traduce como ci transactionsDentro de nuestro main comenzaremos por declarar nuestra base de datos junto a nuestras tablas esto nos permitirátransformar o ejecutar consultas Catálogo de datos bases de datos y tablasval dbName s db kushki ejemplo val tblCsv s transacciones El nombre de la tabla con la ubicación del Sval tblDynamo s transactions El nombre de la tabla con la ubicación de dynamoAhora declararemos nuestro output directory la carpeta final donde se guardaránuestro archivo generado Directorio final donde se guardaránuestro archivo dentro de un bucket Sval baseOutputDir s s args env trx ejemplo val transactionDir s baseOutputDir transaction Una de las principales abstracciones de Apache Spark es el DataFrame de SparkSQL que es similar a la construcción DataFrame que se encuentra en R y en Pandas Un elemento DataFrame es similar a una tabla y admite operaciones de estilo funcional map reduce filter etc y operaciones SQL select project aggregate En este caso de nuestro cátalogo de datos crearemos un DynamicFrame de cada tabla Read data into a dynamic frameval trx dyn DynamicFrame glueContext getCatalogSource database dbName tableName tblDYNAMO getDynamicFrame val trx csv DynamicFrame glueContext getCatalogSource database dbName tableName tblCSV getDynamicFrame ApplyMapping vs ResolveChoiceApplyMapping Aplica un mapeo declarativo a un DynamicFrame especificado ResolveChoice Proporciona información para resolver tipos ambiguos dentro de un elemento DynamicFrame ApplyMappingResolveChoiceTipos de datosEs incompatible si un tipo de dato es ambiguoSe define un solo tipo de datoMappingEl Dataframe devuelve solo lo que se mapeaDevuelve todos los campos incluyendo al campo que se le realizóel casting ApplyMappingval trx dyn mapping trx dyn applyMapping mappings Seq id string id string cliente string cliente string estado string estado string monto bigint monto double caseSensitive false transformationContext trx dyn mapping ResolveChoiceval trx dyn resolve trx dyn resolveChoice specs Seq monto cast double En nuestro ejemplo es necesario resolver el problema de los tipos de datos ambiguos debido a que en nuestro archivo csv se presenta datos de tipo bigint y en nuestra tabla de dynamo se presenta datos de tipo Number ambos tipos de datos deben ser del mismo tipo por lo que se necesita aplicar resolveChoice en este caso applyMapping nos devolveráun problema debido a que la columna monto devolveráun struct de los diferentes tipos de dato val trx dyn resolve trx dyn resolveChoice specs Seq monto cast double val trx csv resolve trx csv resolveChoice specs Seq monto cast double En la siguiente sección de código procederemos a crear nuestra pseudo tabla donde ejecutaremos sentencias SQL es importante darle un nombre simple pero distintivo Spark SQL on a Spark dataframeval dynDf trx dyn resolve toDF dynDf createOrReplaceTempView dynamoTable val csvDf trx csv resolve toDF csvDf createOrReplaceTempView csvTable A continuación realizaremos nuestra sentencia SQL con cualquier lógica de negocio que necesitemos para nuestro ejemplo realizaremos una sentencia simple en la cual obtenga todos los registros que hagan un match SQL Queryval dynSqlDf spark sql SELECT T id T monto T cliente T estado FROM dynamoTable T LEFT JOIN csvTable T ON T id T id WHERE T idIS NOT NULL AND T monto T monto AND T cliente T cliente AND T estado T estado El runtime por detrás de AWS Glue ejecuta un proceso de ApacheSpark por lo que los DynamicFrame que retornemos se crearán en multi partes por lo que utilizaremos coalesce para juntarlos en uno solo sin embargo esto puede ocasionar errores en grandes cantidades de datos retornados Compact al run part files into oneval dynFile DynamicFrame dynSqlDf glueContext withName dyn dyf coalesce Finalmente procederemos a guardar nuestro resultado especificando un path en un bucket de S Save file into SglueContext getSinkWithFormat connectionType s options JsonOptions Map path gt transactionDir format csv writeDynamicFrame dynFile Source CodeEl script completo lo puedes encontrar aquí GithubEspero este tutorial te haya sido de ayuda	2022-04-01 22:16:39
海外TECH	DEV Community	What are the features of NFT Drops Calendar?	https://dev.to/nftdropscalendar/what-are-the-features-of-nft-drops-calendar-5bof	What are the features of NFT Drops Calendar This website truly has it all You can follow upcoming NFT releases on the calendar and ongoing NFT releases You can also read about each NFT before you decide to purchase it This includes a description of the item as well as its specifications and price And if that s not enough you can also see the NFTs being released today There s also NFT news giveaways and whitelisting available on this website We ll discuss some features in more detail below Upcoming NFT Drops The first perk of the NFT Drops Calendar website is how it keeps you up to date on all upcoming NFT Drops As an avid fan of NFTs it can be hard to keep track of all the latest releases This website does all the hard work for you so you can easily see when new NFTs are being released There s nothing more frustrating than having to use the secondary market to try and pick up NFTs With the NFT Drops Calendar website you can buy NFTs directly from the primary source ensuring you get the best price and don t miss out on awesome NFTs The secondary NFT market is volatile and prices can get highly inflated By using the NFT Drops Calendar website you can avoid this and ensure you get the best deals on NFTs You can also improve your odds of making money as you can use the NFT Drops Calendar website to quickly flip NFTs for a profit Seriously if you re looking to cash in on brand new NFT releases then the NFT Drops Calendar is an absolute must use website Plus this website is the multichain NFT calendar and regularly tracks upcoming and newly minted NFTs You can see an overview of the NFT collection including its discord blockchain mint price and background directly from the site which makes it easy to compare upcoming NFT releases Active Drops This website also allows you to check out the NFTs that were released on the day that you access the website giving you the best possible chance to get your hands on new launches on Active Drops page You re also able to see ongoing drops which are currently minting NFTs that you may be interested in This page has the same set up as the others and is very user friendly and easy to use You re able to sort the releases via blockchains and this website covers all the blockchains that are compatible with NFTs Plus it s being constantly updated with NFT news and more meaning you ll always be in the know of any major changes in the NFT world NFT Giveaways Want a chance to win free NFTs NFT Drops Calendar allows you to see all the latest NFT giveaways in one place which means you can vastly improve your chances of winning Directly from the site you re able to see when the giveaway starts and ends what you can win and how to win This makes it easy for you to get your entries in From NFTs to whitelist spots and beta passes there are plenty of opportunities for you to win NFT giveaways are awesome because you can often get some fantastic items just for entering So what are you waiting for Check out NFT Drops Calendar and start entering giveaways today NFT News NFT Drops Calendar also offers all of the latest news in the NFT world meaning you can keep up to date on new releases This news means you can make insightful decisions on your investing journey and allows you to really connect with what s happening in this space NFT Influencers You can also keep up to date with all of your favorite NFT influencers using this website We keep the NFT world updated on all the latest news and can help you find the right influencers to effectively market your NFT collection NFT Whitelisting The first thing you ll want to do on the NFT Drops Calendar website is to get whitelisted for your favorite collections This ensures that you re taking part of the sale and that you re part of the community updated about the latest project news and sale date and also means that you ll be the first to know when the collection is minting	2022-04-01 22:16:16
海外TECH	DEV Community	Feature Flag Platform with FF4J, Spring, Postgres and Kubernetes	https://dev.to/lucasnscr/feature-flag-platform-with-ff4j-spring-postgres-and-kubernetes-21hc	Feature Flag Platform with FFJ Spring Postgres and KubernetesThis project implementing Feature Flags Platform with SpringBoot Spring Security Postgres and FFJ Here is the complete code of the project Installation and TechnologiesThe following technologies were used to carry out the project and it is necessary to install some items DockerJava MavenKubernetes MiniKube SpringBootSpring SecurityPostgresFFJAdminerFlyway Feature toggleFeature toggle also known as feature flipping feature flags or feature bits is the capacity for a program or an application to enable and disable features at runtime The toggle can be operate programmatically through web console through api through command line or even through JMX The source code includes several paths that will be executed or not depending on the values of flags features A Feature represents a business logic that can potentially crosses every layer of applications from user interfaces to data access Therefore to implement a feature toggle mechanism we must help you in each layer as shown with the picture on the right FFJFFJ standing for Feature Flipping for Java is a proposition of Feature Toggle written in Java The present guide will describe the different capabilities of the framework including some sample codes FFJ Use CasesFeature Toggle Enable and disable features at runtime no deployments In your code implement multiple paths protected by dynamic predicates Role based Toggling Enable features not only with flag values but also drive access with roles and groups Canary Release Different frameworks supported starting by Spring Security Features Monitoring For each features execution ffj evaluates the predicate therefore it s possible to collect and record events metrics to compute nice dashboards or draw curves for features usage over time Web Console Administrate FFj including features and properties with the web UI Packaged as a servlet in the library you will expose it in your backend applications Almost languages available Audit Trail Each action create update delete toggles can be traced and saved in the audit trail for troubleshooting With permissions management AuthorizationManager it s possible to identify users About ProjectThe project has a fabric plugin this plugin generate the docker image automatically and supporting ARM architecture The project have a Dockerfile To generate the service image you will need to run a command mvn clean installAfter generating the artifact you will need to install MiniKube and kubectl assuming that these two items are already configured correctly we select three commands one to start the kubernetes cluster enable the kubernetes dashboard that allows tracking the cluster with a visual interface and the other to stop it minikube startminikube dashboardminikube stopFor you to be able to deploy your pods with local docker images you will need to run the command below eval minikube p minikube docker env This command directs your minikube to use your local docker env address in that terminal instance so your pods will be uploaded using images that have already been built locally without necessarily being on DockerHub or some other image repository With the cluster initialized there are some commands that are important for us to see our pods deployments and services Below are two examples of commands to get what is operating in the cluster kubectl get deploymentskubectl get podskubectl get services Deploying Postgres on KubernetesOur application uses the Postgres database there is a directory deploy database within the project to make the database available on the cluster you need to run the commands below in sequence kubectl create f postgres yamlkubectl create f postgres service yamlkubectl port forward svc postgres kubectl create f config map yamlThe respective commands create a deployment a service perform a database port forwarding inside ks and create a configmap for the database Deploying Adminer on KubernetesAdminer formerly phpMinAdmin is a PHP based free open source database management tool It s super simple to deploy on your server To use it all you have to do is upload its single PHP file point your browser towards it and log in Using flyway library it already creates our schema and tables at the time of initialization of the application however we added the Adminer to facilitate the management of our database not only to monitor the tables but also to consult the data referring to the auditing part a functionality that we have in FFJ strongly recommended for monitoring the management of flags To install the Adminer you will need to go to the deploy adminer directory and run the following commands kubectl create f adminer deployment yamlkubectl create f adminer service yamlYou will need to open a new terminal instance to run a command that will redirect your container port to the specific port of the command kubectl port forward pod name Adminer created For consulting pod name the command is kubectl get podsEverything running perfect you access Adminer with credentials System PostgresSQLserver postgresusername postgrespassword postgresdatabase dev Deploying the application on KubernetesAfter preparing our dependencies we will deploy our ffj security service that make up the application Each service will have a deploy directory with the files related to deployments and services kubectl create f deployment yamlkubectl create f service yamlYou will need to open a new terminal instance to run a command that will redirect your container port to the specific port of the command kubectl port forward pod name ffj security created After executing the redirect command you will be able to access the ffj console but as we implement spring security you will need to authenticate yourself in advance You can use the following username and password user superuserpassword superuser Delete pods on KubernetesRunning everything in this sequence will successfully run the services in Kubernetes In case something fails here follow some commands to kill the pod the deployment and the service kubectl delete deployment deployment name kubectl delete service service name Finally to follow the logs of your application you need to run the command Consulting pod log on KubernetesExecute this command kubectl logs pod name	2022-04-01 22:09:53
海外TECH	DEV Community	Resource Override	https://dev.to/vadimfilimonov/resource-override-6o8	Resource OverrideIn this post I will try to give a short overview of the browser extension Resource Override What is it for To substitute the styles of the specified site with your own Why Debug css and js on a prod site Installation Click on the link and click on the install button DetailsThere are four actions available on the settings page Replace a file with another one via a URL Replace a file with another one via a file Insert your own file Replace headers I did not use the last one so I will tell you about the first three Via a URLLet s say you are developing on a local You have a builder set up that picks up the server The URL ends up looking something like this localhost The styles are compiled into one bundle styles min css which is also used on the battle site This means that we can see what the new styles will look like on the prod To do this just add a new rule to the group URL →URLIn the from field we specify on which site we want to replace the styles and in the to field we specify the location of our styles →localhost styles min css Via a fileSimilar to the previous method only instead of locahost styles min css you must insert the code in the built in text editor of the extension This is only handy for small files Insert your fileAlready without URL binding If you re too lazy to write Chrome extensions you can just paste a piece of JS code If this interests you and you want to know more about the extension I advise to watch video by Kyle Paulsen	2022-04-01 22:06:24
金融	金融総合：経済レポート一覧	FX Daily（3月31日）～ドル円、121円台半ばに下落	http://www3.keizaireport.com/report.php/RID/490606/?rss	fxdaily	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	みずほリサーチ 2022年4月号～2022年の春闘賃上げ率は2％弱にとどまる見通し / 舵取り困難な米金融政策 / 2022年の中国は「安定第一」の経済運営...	http://www3.keizaireport.com/report.php/RID/490609/?rss	金融政策	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	CBDCによるクロスボーダー決済改善に向けた国際的な取り組みについて：国際金融トピックスNo.10	http://www3.keizaireport.com/report.php/RID/490611/?rss	取り組み	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	世界各国の市場動向・金融政策（2022年3月）～急変動から安定化、資源国は株・通貨高：経済・金融フラッシュ	http://www3.keizaireport.com/report.php/RID/490615/?rss	世界各国	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	DC一時金受取時の必要書類～前年以前の退職所得の源泉徴収票は要る？要らない？どっち？：研究員の眼	http://www3.keizaireport.com/report.php/RID/490616/?rss	源泉徴収票	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	コロナ禍とキャッシュレス決済：家計簿アプリデータの活用：新型コロナウイルス－課題と分析	http://www3.keizaireport.com/report.php/RID/490617/?rss	新型コロナウイルス	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	欧州大手保険グループの2021年末SCR比率の状況について（１）～ソルベンシーIIに基づく数値結果報告(全体的な状況)：保険・年金フォーカス	http://www3.keizaireport.com/report.php/RID/490622/?rss	結果	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	円安と日銀短観と企業収益：Market Flash	http://www3.keizaireport.com/report.php/RID/490623/?rss	marketflash	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	DXの視点『暗号資産プラットフォーム「DEX」の登場』	http://www3.keizaireport.com/report.php/RID/490626/?rss	第一生命経済研究所	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	QOL向上の視点『金融リテラシーの現状と資産形成・投資』	http://www3.keizaireport.com/report.php/RID/490627/?rss	第一生命経済研究所	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	内外経済ウォッチ『アジア・新興国～ロシアに国際金融市場からの「退出」懸念～』(2022年4月号)	http://www3.keizaireport.com/report.php/RID/490629/?rss	国際金融市場	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	時評『VUCAの時代こそ自社変革の歴史から学ぶ～「羅針盤」を持って、微修正の「Quality Journey」は続く～』	http://www3.keizaireport.com/report.php/RID/490632/?rss	qualityjourney	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	マーケット見通し『向こう1年間の市場見通し』(2022年4月号)（3月8日時点）	http://www3.keizaireport.com/report.php/RID/490634/?rss	第一生命経済研究所	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	内外経済ウォッチ『日本～安いニッポンと実質実効為替レートの読み方～』(2022年4月号)	http://www3.keizaireport.com/report.php/RID/490636/?rss	実質実効為替レート	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	内外経済ウォッチ『米国～ウクライナ危機もＦＲＢは連続利上げ実施へ～』(2022年4月号)	http://www3.keizaireport.com/report.php/RID/490637/?rss	第一生命経済研究所	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	FX Monthly（2022年4月号）～為替相場の見通し ドル円相場～125円台が厚い天井になるか	http://www3.keizaireport.com/report.php/RID/490645/?rss	fxmonthly	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	信金中金月報 2022年4月号～絶望死のアメリカ：資本主義がめざすべきもの / 地域金融機関による補助金申請支援の取組事例 / 三島信用金庫の共同店舗化への取組み...	http://www3.keizaireport.com/report.php/RID/490651/?rss	三島信用金庫	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	デフォルト瀬戸際の状態が続くロシア：4月4日の次は5月27日がXデーか：木内登英のGlobal Economy ＆ Policy Insight	http://www3.keizaireport.com/report.php/RID/490654/?rss	lobaleconomypolicyinsight	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	サステナブル金融商品に関するフランス消費者調査の示唆するもの：開示、アドバイザーの役割、認証ラベル：データで読み解く金融ビジネスの潮流	http://www3.keizaireport.com/report.php/RID/490655/?rss	野村総合研究所	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	中銀デジタル通貨のインパクトとデジタル円への期待：講演会資料	http://www3.keizaireport.com/report.php/RID/490666/?rss	財務総合政策研究所	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	【注目検索キーワード】週休3日制	http://search.keizaireport.com/search.php/-/keyword=週休3日制/?rss	検索キーワード	2022-04-02 00:00:00
金融	金融総合：経済レポート一覧	【お薦め書籍】5秒でチェック、すぐに使える! 2行でわかるサクサク仕事ノート	https://www.amazon.co.jp/exec/obidos/ASIN/4046053631/keizaireport-22/	結集	2022-04-02 00:00:00
ニュース	BBC News - Home	Ghislaine Maxwell bid for retrial denied	https://www.bbc.co.uk/news/world-us-canada-60962777?at_medium=RSS&at_campaign=KARANGA	trial	2022-04-01 22:19:09
北海道	北海道新聞	米アマゾンで初の労組結成　ニューヨーク市の物流拠点	https://www.hokkaido-np.co.jp/article/664569/	結成	2022-04-02 07:29:00
北海道	北海道新聞	Ｗ杯、日本はスペインや独と同組　サッカー組み合わせ抽選会	https://www.hokkaido-np.co.jp/article/664550/	組み合わせ抽選会	2022-04-02 07:03:59
ビジネス	東洋経済オンライン	これまでとまったく違うヤバい円安が起きている デフレマインドに支配されているのは日銀だけ | 新競馬好きエコノミストの市場深読み劇場 | 東洋経済オンライン	https://toyokeizai.net/articles/-/578849?utm_source=rss&utm_medium=http&utm_campaign=link_back	日本経済	2022-04-02 07:30:00