AWS |
lambdaタグが付けられた新着投稿 - Qiita |
Terraform管理のLambdaに、ユニットテストを実装してみた(CI/CD) |
https://qiita.com/HayaP/items/282b9fd309a33d640eee
|
hayap |
2023-02-26 16:20:11 |
python |
Pythonタグが付けられた新着投稿 - Qiita |
TypescriptとPythonでWebスクレイピング(ログイン必須) |
https://qiita.com/_takayan_/items/11a7a41ba8089fd59dc3
|
pythonflaskgo |
2023-02-26 16:54:30 |
python |
Pythonタグが付けられた新着投稿 - Qiita |
pandas にて SettingWithCopyWarning が起こった |
https://qiita.com/dossy/items/4eb930dd459e5f2d18b0
|
tobesetonacopyofaslicefr |
2023-02-26 16:22:13 |
python |
Pythonタグが付けられた新着投稿 - Qiita |
Pythonで生存時間解析(Cox比例ハザードモデル, DeepSurv) |
https://qiita.com/I_T_1210/items/9e109ec225eea57d3d1e
|
deepsurv |
2023-02-26 16:14:01 |
js |
JavaScriptタグが付けられた新着投稿 - Qiita |
『リーダブルコード』を実践的に活用するための問題集[Typescript](第2部 ループとロジックの単純化、第3部 コードの再構成) |
https://qiita.com/kyok01_japan/items/e75a002fdfda0eca31d6
|
typescript |
2023-02-26 16:21:50 |
AWS |
AWSタグが付けられた新着投稿 - Qiita |
App Runner に VPN 経由でオンプレミスからアクセスしてみた |
https://qiita.com/sugimount-a/items/3fe590da2072c07da887
|
amazonvpc |
2023-02-26 16:57:28 |
AWS |
AWSタグが付けられた新着投稿 - Qiita |
Terraform管理のLambdaに、ユニットテストを実装してみた(CI/CD) |
https://qiita.com/HayaP/items/282b9fd309a33d640eee
|
hayap |
2023-02-26 16:20:11 |
AWS |
AWSタグが付けられた新着投稿 - Qiita |
MySQL WorkbenchでRDS for MySQLに接続する際の設定方法 |
https://qiita.com/YuukiYoshida/items/632ce8d14133a0d5337d
|
mysqlworkbench |
2023-02-26 16:01:32 |
Git |
Gitタグが付けられた新着投稿 - Qiita |
Git解剖録 |
https://qiita.com/SoraY677/items/72dd69de8c3d5d482c99
|
解剖 |
2023-02-26 16:16:48 |
海外TECH |
DEV Community |
Quick Guide for AWS |
https://dev.to/shaheem_mpm/quick-guide-for-aws-11mo
|
Quick Guide for AWS Deploy to EC Security GroupSetup the following security group configuration Connect with SSHUpdate the permission of downloaded certificate filechmod lt file name gt pemConnect to the distant server with the commandssh i lt certificate gt pem ec user lt Public IPv DNS gt Install node with nvmDownload nvm using curlcurl o bashActivate nvm with nvm nvm shInstall node withnvm install nodeTest node installation withnode e console log Running Node js process version Checkout the official documentation on how to setup node in ec linux Port Forwarding from to Use the following command for port forwardingsudo iptables t nat I PREROUTING p tcp dport j REDIRECT to ports Install MongoDB community editionVerify Linux Distribution withgrep NAME etc releaseThe result should be Amazon Linux or Amazon Linux AMICreate a etc yum repos d mongodb org repo file so that you can install MongoDB directly using yum cd etc yum repos dsudo touch mongodb org repoAdd the following Configuration to created file with nano or vim mongodb org name MongoDB Repositorybaseurl gpgcheck enabled gpgkey Install MongoDB packages withsudo yum install y mongodb orgSetup storage directory for MongoDbcd sudo mkdir datacd datasudo mkdir dbcd cd home ec userStart mongodb servicesudo service mongod startCheckout common errors faced during thisCheckout the offficial Documentation Install PostgreSQLFollow this article for installing PostgreSQLafter install use this command to open db shellsudo su postgres Transfer node project to ecYou can use programs like filezilla to transfer project files the method I use personally is to send zipped file using scp commandDelete node modules directory from projectZip the project directoryzip r server zip lt project directory gt Transfer zipped file using scpscp i lt certificate gt pem server zip ec user lt Public IPv DNS gt Now connect back to instance with SSH and unzip the fileunzip server zip Run Application with screeninstall the node modules and run the app with screenscreen npm startyou can detach the screen without terminating byi ctrl Aii D Bucket Policy for SUse the following bucket policy in S Bucket for public read access Version Statement Sid AllowPublicRead Effect Allow Principal AWS Action s GetObject Resource arn aws s lt bucket name gt CloudFront GuideUse this tutorial for setting up cloudfront Steps to get SSL Certificate to EC instancemove nameserver to Route request certificate from ACMcreate load balancer targeting to ec instancecreate a record pointing to load balancer in route |
2023-02-26 07:40:59 |
海外TECH |
DEV Community |
Exploratory Data Analysis Ultimate Guide |
https://dev.to/webs254/exploratory-data-analysis-ultimate-guide-4666
|
Exploratory Data Analysis Ultimate GuideExploratory Data Analysis EDA is a crucial process in any data analysis project It involves examining cleaning and visualizing data to discover patterns relationships and anomalies that mau not be evident when looking at raw data Python has become a popular tool for EDA because of its versatility and powerful data manipulation libraries such as NumPy Pandas and Matplotlib In this article we will explore the steps involved in performing EDA using Python including data cleaning summary statistics and visualization Before we dive into EDA let s first look at the tools and libraries we need Python has many powerful libraries for data analysis and visualization Some of the most popular ones include NumPy Pandas Matplotlib and Seaborn NumPy is a library for scientific computing with support for arrays and matrices Pandas is a library for data manipulation and analysis that provides easy to use data structures and data analysis tools Matplotlib is a plotting library for creating static animated and interactive visualizations in Python Seaborn is a data visualization library based on Matplotlib that provides a high level interface for creating informative and attractive statistical graphics Before getting to the analysis we can start by installing these libraries using pip a Python package installer To install these libraries open the command prompt or terminal and type the following commands pip install numpypip install pandaspip install matplotlibpip install seabornThe first step in any EDA project is to load the data Python has many libraries that can read data from various sources such as CSV files Excel spreadsheets and databases We have installed some of the libraries in the example above For our example on loading a file we will use a CSV file containing information on fitness diet and obesity To load the data we can use Pandas read csv function Here s an example import pandas as pddata pd read csv fitness data csv This will load the data into a Pandas DataFrame which is a two dimensional table like data structure with rows and columns Once we have loaded the data we need to clean and preprocess it Data cleaning involves identifying and handling inconsistent data removing duplicates and converting data types For instance we can use the dropna function to remove rows with missing data and the drop duplicates function to remove duplicate rows We can also use the astype function to convert columns to their appropriate data types Here s an example Remove duplicate rowsdata data drop duplicates Convert data typesdata age data age astype int data weight data weight astype float data height data height astype float We also need to check its structure the type of data and any missing values We can do this using various functions provided by Pandas For example the head function displays the first few rows of the data and the info function shows information about the data such as column names data types and the number of non null values print data head print data info Once we have cleaned the data we can also start exploring it with summary statistics Summary statistics are descriptive measures that provide a quick overview of the data They include measures such as the mean median mode variance standard deviation and quartiles Pandas provides several functions for calculating summary statistics such as mean median std min and max Here s an example of how to calculate summary statistics for a dataset Calculate summary statistics for numeric columnssummary stats data describe Print the summary statisticsprint summary stats After inspecting the data we can proceed with the analysis One of the most important tasks in EDA is to explore the relationships between variables We can use scatter plots line plots and histograms to visualize the distribution of the data and the relationships between variables import matplotlib pyplot as plt Scatter plotplt scatter data fitness data obesity plt xlabel Fitness plt ylabel Obesity plt show Line plotplt plot data age data diet plt xlabel Age plt ylabel Diet plt show Histogramplt hist data weight bins plt xlabel Weight plt ylabel Count plt show The scatter plot shows the relationship between fitness and obesity where we can see a negative correlation between the two variables The line plot shows the trend between age and diet where we can see an increase in the diet score as the age increases The histogram shows the distribution of weight where we can see that most people have a weight between and kg Another important aspect of EDA is to deal with missing values and outliers Pandas provides functions to handle missing values such as dropna and fillna We can also use statistical methods to detect outliers and remove them or replace them with appropriate values Remove rows with missing valuesdata data dropna Replace missing values with meandata income data income fillna data income mean Detect and remove outliersQ data height quantile Q data height quantile IQR Q Qdata data data height gt Q IQR amp data height lt Q IQR In conclusion EDA is an essential step in any data analysis project Python provides powerful libraries to handle data manipulation and visualization making it a popular tool for EDA In this article we have covered some basic concepts of EDA and provided examples of code to perform various tasks By applying EDA techniques to your data you can discover insights and patterns that can lead to better decision making |
2023-02-26 07:26:51 |
海外ニュース |
Japan Times latest articles |
Tempered in a crucible of violence, Zelenskyy rises to the moment |
https://www.japantimes.co.jp/news/2023/02/26/world/politics-diplomacy-world/volodymyr-zelenskyy-rises/
|
Tempered in a crucible of violence Zelenskyy rises to the momentIn much of the world the Ukrainian leader has become a household name representing his country s tenacity and underdog victories against Russia |
2023-02-26 16:03:33 |
ニュース |
BBC News - Home |
Sunak 'giving it everything' to get NI Brexit deal done |
https://www.bbc.co.uk/news/uk-politics-64773214?at_medium=RSS&at_campaign=KARANGA
|
outcome |
2023-02-26 07:30:47 |
ニュース |
BBC News - Home |
Nigeria election 2023: Votes are counted but final results may take days |
https://www.bbc.co.uk/news/world-africa-64772763?at_medium=RSS&at_campaign=KARANGA
|
final |
2023-02-26 07:56:15 |
ニュース |
BBC News - Home |
Mystery over lost pen pal who fled Rwandan genocide |
https://www.bbc.co.uk/news/uk-wales-64735373?at_medium=RSS&at_campaign=KARANGA
|
buchaillard |
2023-02-26 07:13:08 |
ビジネス |
プレジデントオンライン |
「終活」という言葉ほどバカなものはない…定年本や老後本にある「豊かな老後」を信じると後悔するワケ - 人生に「こうすればこうなる」なんてことはない |
https://president.jp/articles/-/66747
|
一人ひとり |
2023-02-26 17:00:00 |
コメント
コメントを投稿