IT |
気になる、記になる… |
ブラックの本体にシルバーのボタンを搭載したツートンカラーの初代「Apple Watch」の試作機 |
https://taisy0.com/2022/04/10/155592.html
|
apple |
2022-04-10 01:34:55 |
python |
Pythonタグが付けられた新着投稿 - Qiita |
「テキストアナリティクスの基礎と実践」をpythonで読む4 トピック分析 |
https://qiita.com/tanaka_benkyo/items/a0a0df0c703b45498678
|
形態素解析 |
2022-04-10 10:25:33 |
js |
JavaScriptタグが付けられた新着投稿 - Qiita |
SKT豆腐屋と「Screeps: Arena」 のチュートリアル#1「Loop and import」を進めよう |
https://qiita.com/Yumenoshima/items/054e82f5fa1fab6006b0
|
httpsstor |
2022-04-10 10:09:29 |
AWS |
AWSタグが付けられた新着投稿 - Qiita |
CloudFormationでQuickSightにAthenaのデータセットを作成する |
https://qiita.com/a_b_/items/f9e7588348547c952d55
|
athena |
2022-04-10 10:22:47 |
海外TECH |
DEV Community |
How to become a Machine Learning Engineer? |
https://dev.to/codewithsom/how-to-become-a-machine-learning-engineer-k4l
|
How to become a Machine Learning Engineer Learn a Programming Language Popular Programming Languages for Machine LearningRMatlabSASPythonWEKAExcelIf you go with Python you must learn sklearn for Machine Learning Sklearn is a modern machine learning library written in Python Learn Mathematics for Machine Learning Importance of Mathematics topics needed for Machine LearningLinear Algebra Probability and Statistics Algorithm and Complexity Calculus Others Having a basic understanding of probability and statistics is important when it comes to mastering Machine Learning Learn Core Machine Learning Algorithms Supervised Machine Learning Regression Linear RegressionPolynomial RegressionDecision TreeRandom Forest ModelClassification KNNTreesLogistic RegressionNaive BayesSVMUnsupervised Machine Learning Clustering SVDPCAK MeansAssociation Analysis AprioriFP GrowthHidden Markev ModelReinforcement Machine Learning Learn the basics Libraries for Mathematical and Data Handling SparkPytorchScikit learnKerasPandasmxnetNumpyNLTKTensorFlow Learn Deep Learning |
2022-04-10 01:26:37 |
海外TECH |
DEV Community |
Tips and How to name you API endpoint? |
https://dev.to/harithzainudin/tips-and-how-to-name-you-api-endpoint-1jin
|
Tips and How to name you API endpoint Sometimes it can be very confusing on how to name your api endpoint This is the tips and guideline for you on how to name your API endpoint Use only nouns rather than adding verbsExample users get usersIt will be funny if you put action in the endpoint We will directly straight know it use a GET request Use singular or plural nouns It depends If get more user preferably use users If one user then user is the answer Short Clear and IntuitiveExample id identification number id fnFor example this would be misleading It s not clear What is fn As for me I would think it a function Build hierarchy and grouping into logical groupsExample departments managers product variation Use only lowercaseExample kyc form application KYCFormApplicationURIs are case sensitive try to avoid upper case unless it is necessary And also avoid unnecessary confusion and inconsistency in naming your endpoint Avoid special characters in the endpointExample store storeYou can refer here for list of special character Use hyphen to separate words rather than underscore or camelCaseExample generate s presigned url generateSPresignedUrlYour endpoint will looks more cleaner clearer and user friendly Google recommend us to use hyphens as it is good for Google search it make its web crawling job easier thus creating more consistent results Use camelCase for parametersExample user userId user user id Do versioning for your user to use the endpointExample Our API will keep changing over the time the implementation the request body the response etc hence versioning is important to avoid the endpoint from breaking when the user use it For me the easiest way to do versioning is the st way Avoid doing silly mistake like me when I create my endpoint before this But hey we learn from our mistakes right That s all for the tips and how to naming your endpoint Thank you for reading DPsstt pstt pDo consider to love this article ️and follow me Why not right It s FREE I would really appreciate it Will be posting more on things related to AWS Javascript Python Serverless and more |
2022-04-10 01:21:02 |
海外TECH |
DEV Community |
CQRS - Implementing SQS, DynamoDB and MongoDB with Spring and AWSLocalstack |
https://dev.to/lucasnscr/cqrs-implementing-sqs-dynamodb-and-mongodb-with-spring-and-localstack-29j4
|
CQRS Implementing SQS DynamoDB and MongoDB with Spring and AWSLocalstackCQRS stands for Command and Query Responsibility Segregation a pattern that separates read and update operations for a data store Implementing CQRS in your application can maximize its performance scalability and security The flexibility created by migrating to CQRS allows a system to better evolve over time and prevents update commands from causing merge conflicts at the domain level In a scalable environment having several services consuming a single database that serves as a read and write can cause many locks on the data and with that cause several performance problems as well as the whole process of the business rule that will get the data from display takes extra processing time In the end we still have to consider that the displayed data may already be out of date This is the starting point of CQRS Since the displayed information is not necessarily the current information so obtaining this data for the display does not need to have its performance affected due to recording possible locks or bank availability The division of responsibility for recording and writing conceptually and physically This means that in addition to having separate ways to record and retrieve data the databases are also different Queries are done synchronously on a separate denormalized basis and writes asynchronously on a normalized database Expoloring CQRSBeginning the explanations the first moment you need to separate the application responsibility Command Every operation requires change of data in the application Query Every operation requires information about the data application Query OperationWithin the concept Query has the main function of retrieving application data Often its characteristic is to be synchronous and connected with NoSQL databases The use of these databases allows faster queries as we do not have Joins that can burden our performance With this solution for the data we assume that we will work with duplicate records Command OperationFollowing an asynchronous operation the command has as an operation everything that writes and changes records A good way is to work with the concept of events where messages are sent and we have the return of success or failure in the processing of the message Synchronization Data synchronization can happen in several ways Automatic update Every change in the state of a data in the writing database triggers a synchronous process to update in the read database Eventual update Every change in the state of a data in the writing database triggers an asynchronous process to update in the read database offering an eventual consistency of the data Controlled Update A periodic scheduled process is triggered to synchronize the databases Update on demand Each query checks the consistency of the read versus the write base and forces an update if it is out of date In our implementation we use the eventual update AdvantagesFaster reading of data in Event driven Microservices High availability of the data Read and write systems can scale independently DisadvantagesRead data store is weakly consistent eventual consistency The overall complexity of the system increases Cargo culting CQRS can significantly jeopardize the complete project When to use CQRSIn highly scalable Microservice Architecture where event sourcing is used In a complex domain model where reading data needs query into multiple Data Store In systems where read and write operations have a different load When not to use CQRSIn Microservice Architecture where the volume of events is insignificant taking the Event Store snapshot to compute the Entity state is a better choice In systems where read and write operations have a similar load Implementing SolutionHere is the complete code of the projectThe following technologies were used to carry out the project and it is necessary to install some items DockerJava MavenSpringBootAmazon SQSAmazon DynamoDBLocalstackSwagger LocalstackLocalStack is a project open sourced by Atlassian that provides an easy way to develop AWS cloud applications directly from your localhost It spins up a testing environment on your local machine that provides almost the same parity functionality and APIs as the real AWS cloud environment minus the scaling and robustness and a whole lot of magic For this solution I made the choice to bring an implementation Amazon SQS will be used for our event and data synchronization Amazon DynamoDB to be just our recording database and MongoDB as our NoSQL database Could also be DocumentDB but not the same was used Localstack does not support that database in their services Confuguring Localstack environmentTo run our stack we will upload our services in the project there is the MongoDb directory in it there is a file docker compose yaml this file will upload our Read only Database version services mongo image mongo container name mongo environment ME CONFIG BASICAUTH USERNAME admin ME CONFIG BASICAUTH PASSWORD admin ME CONFIG MONGODB PORT ME CONFIG MONGODB ADMINUSERNAME admin ME CONFIG MONGODB ADMINPASSWORD admin restart unless stopped ports volumes database db data db database dev archive Databases dev archive database production Databases production mongo express image mongo express container name mexpress environment ME CONFIG MONGODB ADMINUSERNAME root ME CONFIG MONGODB ADMINPASSWORD password ME CONFIG MONGODB URL mongodb root password mongo authSource admin ME CONFIG BASICAUTH USERNAME mexpress ME CONFIG BASICAUTH PASSWORD mexpress links mongo restart unless stopped ports Run the following command docker compose up dNow with MongoDB running we are going to raise our AWS stack for that we will go to the localstack directory in the directory we have the docker compose yaml file which has a similar structure to the previous file With this docker compose we will upload our Message Broker Amazon SQS and our Write Only database DynamoDB version services localstack container name LOCALSTACK DOCKER NAME localstack main image localstack localstack ports PORT WEB UI PORT WEB UI environment SERVICES sqs dynamodb DEBUG DATA DIR tmp localstack data DOCKER HOST unix var run docker sock volumes var run docker sock var run docker sock localstack data tmp localstack data networks localstack command gt Needed so all localstack components will startup correctly i m sure there s a better way to do this sleep aws sqs create queue endpoint url http localstack queue name user service event you can go on and put initial items in tables volumes localstack data networks localstack Within the framework of the environment in docker compose we specify which services we want to make available To do this we run the following command docker compose up dNow that we have our infrastructure available we will show our technical drawing for our application Configuring AWS SQS and DynamoDB environmentAfter we have our services all available We will configure our local AWS stack For this you will need to enter the terminal of your localstack container for this execute the following command docker exec localstack bashOnce you access the localstack container terminal you will need to configure accessKey secretKey region and the output format Our configuration looked like this aws configureAWS Access Key ID None anythingAWS Secret Access Key None anythingDefault region name None us east Default output format None jsonafter configuration we will create our queue inside SQS and our table in Dynamo DB SQS Create Queueaws sqs create queue endpoint url http localstack queue name user service event DynamoDB Create Tableaws dynamodb endpoint url http localhost create table table name user attribute definitions AttributeName id AttributeType S AttributeName email AttributeType S key schema AttributeName id KeyType HASH AttributeName email KeyType RANGE provisioned throughput ReadCapacityUnits WriteCapacityUnits After configuration we can run our application and check our CQRS implementation with Aws localstack |
2022-04-10 01:15:20 |
海外TECH |
DEV Community |
How to import csv data in mongoDB |
https://dev.to/prog585/import-csv-in-mongodb-37oo
|
How to import csv data in mongoDBQuestion How to add CSV data in mongoDB Atlas or local mongoDB Answer MongoDB command line utility mongoimport is used to import csv json data in mongoDB It is bundled in MongoDB Database Tools package which can be downloaded by vising Tools section on mongoDB official website Here is the link to download this After installing to your machine to the install folder and run the following command mongoimport uri mongodb srv username password cluster xxxxx mongodb net database name retryWrites true amp w majority collection collection name mode insert type csv headerline file d data userlist csvReplace username password database name collection name and file with your own values Also replace cluster xxxxx mongodb net with your own cluster address Full database connect string including cluster address can be found on Database page by pressing Connect button mode insert will append data into your collection headerline will tell mongo that first line contains field names For full mongoimport options please visit official documentation at csv importFor local mongoDB instance instead of uri hostname can be used Syntax will be like host lt port gt |
2022-04-10 01:10:01 |
ニュース |
BBC News - Home |
Australia election: PM Scott Morrison calls poll for 21 May |
https://www.bbc.co.uk/news/world-australia-61055915?at_medium=RSS&at_campaign=KARANGA
|
canberra |
2022-04-10 01:39:01 |
ニュース |
BBC News - Home |
Masters: Scottie Scheffler leads at Augusta, Cameron Smith & Shane Lowry chasing |
https://www.bbc.co.uk/sport/golf/61055709?at_medium=RSS&at_campaign=KARANGA
|
Masters Scottie Scheffler leads at Augusta Cameron Smith amp Shane Lowry chasingAmerican Scottie Scheffler remains in a good position to win his first major at the Masters but sees his lead reduced late in Saturday s third round |
2022-04-10 01:20:13 |
北海道 |
北海道新聞 |
伝統の赤毛種、酒で未来へ 北広島で150年前から栽培続くコメ 商工会、生産者ら開発 BP開業追い風に |
https://www.hokkaido-np.co.jp/article/667623/
|
開発 |
2022-04-10 10:30:00 |
北海道 |
北海道新聞 |
<アングル>ホタテ汚水 処理に苦慮 豊浦、前副町長ら書類送検 付着物急増、環境変化も影響か |
https://www.hokkaido-np.co.jp/article/667761/
|
書類送検 |
2022-04-10 10:26:03 |
北海道 |
北海道新聞 |
古橋亨梧が3カ月半ぶり復帰 スコットランドプレミア |
https://www.hokkaido-np.co.jp/article/667788/
|
古橋亨梧 |
2022-04-10 10:20:00 |
北海道 |
北海道新聞 |
松山英樹77、14位に後退 首位と11打差、マスターズ |
https://www.hokkaido-np.co.jp/article/667784/
|
松山英樹 |
2022-04-10 10:07:00 |
コメント
コメントを投稿