投稿時間:2022-09-15 23:43:41 RSSフィード2022-09-15 23:00 分まとめ(61件)

カテゴリー等	サイト名等	記事タイトル・トレンドワード等	リンクURL	頻出ワード・要約等/検索ボリューム	登録日
IT	気になる、記になる…	｢iPhone 14/14 Plus｣、分解する際はリアパネル側からアクセスする構造に	https://taisy0.com/2022/09/15/162149.html	iphone	2022-09-15 13:33:36
AWS	AWS Management Tools Blog	Introducing the ACK controller for Amazon Managed Service for Prometheus	https://aws.amazon.com/blogs/mt/introducing-the-ack-controller-for-amazon-managed-service-for-prometheus/	Introducing the ACK controller for Amazon Managed Service for PrometheusWe re excited to announce that the Amazon Managed Service for Prometheus ACK controller is now generally available for the Workspace Alert Manager and Ruler resources The Amazon Managed Service for Prometheus ACK controller lets you take advantage of Managed Prometheus using custom resource definitions CRDs and native Kubernetes objects without having to define any resources …	2022-09-15 13:56:19
AWS	AWS Management Tools Blog	Implementing an alarm to automatically detect drift in AWS CloudFormation stacks	https://aws.amazon.com/blogs/mt/implementing-an-alarm-to-automatically-detect-drift-in-aws-cloudformation-stacks/	Implementing an alarm to automatically detect drift in AWS CloudFormation stacksAWS CloudFormation is a service that helps you model and implement your Infrastructure as Code IaC It provisions and configures cloud resources as described in template files that are written in JSON or YAML After resources have been created with CloudFormation it is possible for users to alter those resources via the AWS Management Console …	2022-09-15 13:40:09
python	Pythonタグが付けられた新着投稿 - Qiita	[習作]猫の種類判別アプリを作成してみた。	https://qiita.com/hsgw512deploy/items/83190b573333cc32c9e8	aidemy	2022-09-15 22:54:22
python	Pythonタグが付けられた新着投稿 - Qiita	plotlyで軸の数値が省略される(1000=K)問題の解決	https://qiita.com/mizomizo/items/63655a34f5eba098d01b	plotly	2022-09-15 22:45:09
python	Pythonタグが付けられた新着投稿 - Qiita	【Django】prefetch_related の挙動を理解する	https://qiita.com/rkiyose/items/4bb1f31e43bad763e573	django	2022-09-15 22:21:17
Ruby	Rubyタグが付けられた新着投稿 - Qiita	さくっとベンチマーク取る時のメモ	https://qiita.com/tommy_1592/items/8a621d9cfff0df49181c	bytes	2022-09-15 22:44:15
Ruby	Rubyタグが付けられた新着投稿 - Qiita	include?メソッドとGemのCode Runnerで文字入力した備忘録	https://qiita.com/mrshouuge/items/7612a957c5ee4834ab23	coderunner	2022-09-15 22:15:03
海外TECH	MakeUseOf	How to Turn Off iCloud Music Library on Any Device	https://www.makeuseof.com/turn-off-icloud-music-library/	How to Turn Off iCloud Music Library on Any DeviceiCloud Music Library is a handy feature included with your Apple Music subscription but it s not everyone s cup of tea So learn how to disable it	2022-09-15 13:45:14
海外TECH	MakeUseOf	How to Use Discord Voice Chat on Your Xbox Console	https://www.makeuseof.com/use-discord-voice-chat-xbox-console/	console	2022-09-15 13:30:14
海外TECH	MakeUseOf	How to Use the UPPER Formula in Google Sheets	https://www.makeuseof.com/upper-formula-google-sheets/	upper	2022-09-15 13:16:13
海外TECH	DEV Community	What do u neeeeed? 🤔	https://dev.to/vikasmaur13/what-do-u-neeeeed-1l06	What do u neeeeed Hey Fellow programmers Namaste In this post i would like to ask you all what problems do u face in our beloved VS Code if there are any Or what is that thing u feel is ur need but that thing lacks in VS Code again if there is any I would love to know your answers below thanks in advance	2022-09-15 13:48:57
海外TECH	DEV Community	NextJS Material Kit - Free TypeScript Template	https://dev.to/sm0ke/nextjs-material-kit-free-typescript-template-55gd	NextJS Material Kit Free TypeScript TemplateHello Coders This article presents an open source NextJS Template recently updated to TypeScript and up to date dependencies React v NextJS v The product based on the permissive MIT license can be used in commercial project or eLearning activities For newcomers NextJS is a powerful React Framework used to code blazing fast full stack apps with speed Thanks for reading NextJS Material Kit LIVE demoNextJS Material Kit source code How to use itBeing an open source project NextJS Material Kit can be downloaded from Github and compiled locally using classic tools like NPM or Yarn As stated on the project README the sources were tested with Node v x v x and might be a good idea to use them in order to avoid runtime or compilation surprises Step Clone the repo git clone cd nextjs material kitStep Install modules yarn OR npm iStep Start the app yarn start OR npm run startStep Static Export yarn export OR npm run exportThe static site is generate in the out directory Product HighlightsThe UI is built with over individual frontend elements giving you the freedom of choosing and combining All components can take variations in color which developers can easily modify using SASS and JSS inside JS files files and classes Modern stack React NextJSTypeScriptOne Click Deploy for Vercel amp NetlifyActive versioningExample Pages If you want to get inspiration or just show something directly to your clients you can jump start your development with our pre built example pages Thanks for reading For more resources and support please access More Free Dashboards crafted in Django Flask and ReactMore Admin Dashboards a huge index with products	2022-09-15 13:47:06
海外TECH	DEV Community	How to render 3D model in a React JS application	https://dev.to/codebucks/how-to-render-3d-model-in-a-react-js-application-2bi	How to render D model in a React JS applicationHey there Nowadays the browsers are becoming more powerful then in the past and now they can render different complex animations with ease You might have seen lot of websites rendering D model without any performance issues In this article we are going to use Three js to render an iPhone model in a React application Before we start this tutorial let me show you a demo website which renders this model Here is the demo link For this website I have used Three JS along with the GSAP to add smooth scrolling animations If you want to learn to make this responsive D landing page you can watch the following tutorial Let s render an awesome D model in our React application Setup and InstallationFor this tutorial we will be using CRA create react app template Open your project folder and use the following command to install CRA template npx create react app d model in reactjsYou can name your application as you wish for this tutorial I have kept it as d mode in reactjs Here the npx is a utility that comes when you install the npm It helps us to run any npm package available on npm registry without installing that package Let s install required libraries to render D model Change the directory to d mode in reactjs using the following command cd d mode in reactjsUse the following command to install two libraries the react three fiber and react three drei npm install react three fiber react three drei react three fiber It is a React renderer for threejs react three drei It is a collection of useful helpers and fully functional ready made abstractions for react three fiber For this tutorial we are going to use a D model of Apple iPhone Pro Max You can get this model from the following link Apple iPhone Pro Max by DatSketch is licensed under Creative Commons Attribution Before you use this model in any project make sure to check it s license Open the given link and download the model in gltf format Why GLTF As per the threejs documentation glTF is focused on runtime asset delivery it is compact to transmit and fast to load Once you download the file create one folder called assets inside the src folder and extract all the model file under folder called D Model Open the App css file and replace all code with the following css App width vw height vh display flex justify content center align items center Now we are ready to render the model Let s understand the basics of rendering a D modelNow there are things that you have to keep in mind while rendering a model scene Here you can setup all objects lights and cameras camera It is used to view the D model through different angels renderer It is used to display render a scene on an HTML element called canvas If you are directly using threejs in a plain JavaScript project then you might have to setup all these things from the basics but in this tutorial we are using react three fiber and react three drei so we don t have to do all the things from scratch Open the App js file clean up the default code and let s import the canvas element from react three fiber Checkout the following code snippet import App css import Canvas from react three fiber function App return lt div className App gt lt Canvas gt Here we will render out model lt Canvas gt lt div gt export default App Here the Canvas component sets up the scene and the camera and renders scene every frame Now copy the following code inside the lt Canvas gt component lt Canvas gt lt mesh gt lt boxGeometry gt lt meshStandardMaterial gt lt mesh gt lt Canvas gt Let s understand each of these elements lt mesh gt A mesh is a class that inherits from Objectd and it represents polygon objects In the mesh you can instantiate the polygon object by using Geometry and Material lt boxGeometry gt It is a geometry class for a rectangular cuboid with a given width height and depth lt meshStandardMaterial gt It is a standard physically based material For now you might see one black square in the middle that does not look like a D object Let s add controls so that we can move the camera angle around this D object Import the lt OrbitControls gt from the react three drei by using the following line import OrbitControls from react three drei Now render this lt OrbitControls gt inside the lt Canvas gt components and after the lt mesh gt Refresh the development server page and try to grab the object Now you might be able to see this square as an D object This lt OrbitControls gt allow the camera to orbit around a target Now the object is total black because there is no source of light So let s add lights in our scene Inside the lt Canvas gt component add the following line before the lt mesh gt lt ambientLight gt Here this ambientLight globally illuminates all objects in the scene equally Now you are able see the off white color of the mesh material We can also change the intensity of ambient light through props as shown in the following code lt ambientLight intensity gt You can also change the color of D object by using color prop in the lt meshStandardMaterial gt checkout the following line lt meshStandardMaterial color green gt Now the color of the D object is green There are lot of different lights and elements are available which you can use to create whole model For that you can refer the documentation of threejs That s it for the basics not let s render our iPhone Converting model to JSX componentOpen the model files and you will see different files like textures scene gltf scene bin etc We will convert scene gltf into a JSX component so that we can easily render it in our React application Now to convert any GLTF files to JSX component we will use one simple command line tool called as gltfjsx As per the documetation the gltfjsx is a small command line tool that turns GLTF assets into declarative and re usable react three fiber JSX components Now open the terminal cmd and go to the directory where you have stored all the model files in my case it is inside the D Model folder which is in the assets folder So I will use the following command to change the directory cd src assets D ModelNow use the following command npx gltfjsx scene gltfThis command will take few seconds and returns the Scene js file which is the JSX component NOTE This gltfjsx command might give you an error if you are using latest NodeJS version I m currently using and this command is working fine If you face any error please downgrade your NodeJs version and try this code again You can use tools like nvm to use different versions of the NodeJs Important Before we render the model from Scene js file we have to copy the model files into public directory since if you look in the Scene js file it uses useGLTF hook which loads nodes and materials from scene gltf file So copy textures scene bin and scene gltf into public folder of your project Rendering the D modelOpen the App js file and remove the lt mesh gt Let s import the Model from Scene js file import Model from assets D Model Scene Now render the lt Model gt inside the lt Canvas gt component before the lt OrbitControls gt lt Canvas gt lt ambientLight intensity gt lt Model gt lt OrbitControls gt lt Canvas gt Refresh the output page Now you should be able to see the iphone rendering on the screen you can zoom in and zoom out and move the model Let s increase the view of the model You can directly access the camera from the canvas element Add the camera inside canvas as the following code snippet lt Canvas camera fov gt Here the fov stands for the field of view After setting the fov refresh the page to see the output For now we have set the fov to You can try different numbers and see the output For now there is no reflection on the model To add reflection on the model you have to set images around this model so that these images can reflect on the surface of this model Instead of adding these images let s use lt Environment gt component from the react three drei library Let s import the lt Environment gt import Environment OrbitControls from react three drei Now after the model let s add the Environment lt Environment preset sunset gt Here the preset sets different types of environment surrounding the model For now we have set it to sunset You can check the different presets available from here After adding this environment you should see the beautiful reflection on our iPhone Let s render out model inside the Suspense component of the React so that it can load asynchronously lt Suspense fallback null gt lt Model gt lt Suspense gt Here is the final code Final ThoughtsThat s the end of this tutorial You can use to read the documentation of the react three fiber and react three drei and try different elements If you want to create full fledge website using the D model and animate it s colors then you can follow the video tutorial given at the start of this lesson If you like this tutorial then you should checkout awesome tutorials I have on my YouTube channel called CodeBucks You can check it from here You might also like these website templates A beautiful portfolio template in ReactJS gt hereNFT collection landing page in ReactJS gt hereThank you for reading this tutorial Have a great day	2022-09-15 13:31:33
海外TECH	DEV Community	Create and Deploy a Discord bot in Rust, for free	https://dev.to/ivancernja/create-and-deploy-a-discord-bot-in-rust-for-free-3203	Create and Deploy a Discord bot in Rust for freeIn this post we will look at a simple way to add custom functionality to a Discord server using a bot written in Rust We will first register a bot with Discord then go about how to create a Serenity application that will later run on shuttle Finally we will make the bot do something useful writing some Rust code to get information from an external service The full code can be found in this repository Registering our botBefore we start making our bot we need to register it for Discord We do that by going to and creating a new application The application process is also used for adding functionality to Discord but we will be only using the bot offering Fill in the basic details and you should get to the following screen You want to copy the Application ID and have it handy because we will use it to add our bot to a test server Next we want to create a bot You can set its public username here You want to click the reset token and copy this value we will use it in a later step This value represents the username and password as a single value that Discord uses to authenticate that our server is the one controlling the bot You want to keep this value secret You also want to tick the MESSAGE CONTENT INTENT setting so it can read the commands input To add the bot to the server we will test on we can use the following URL replace application id in the URL with the ID you copied beforehand https discord com oauth authorize client id application id amp scope bot amp permissions Here we create it with permissions so that it can do everything on the server If you are adding to another server select only the permissions it needs We now have a bot on our server Oh they re offline Getting a bot onlineAt this moment our bot is not running because there is no code We will have to write it and run it before we can start interacting with it SerenitySerenity is a library for writing Discord bots and communicating with the Discord API We can create a new Serenity project which is readily deployable on shuttle with cargo shuttle init serenityIf you don t have shuttle yet you can install it with cargo install cargo shuttle Afterwards run the following in an empty directory cargo shuttle init serenityAfter running it you should see the following generated in src lib rs use log error info use serenity async trait use serenity model channel Message use serenity model gateway Ready use serenity prelude use shuttle service error CustomError use shuttle service SecretStore use sqlx PgPool struct Bot async trait impl EventHandler for Bot async fn message amp self ctx Context msg Message if msg content hello if let Err e msg channel id say amp ctx http world await error Error sending message e async fn ready amp self Context ready Ready info is connected ready user name shuttle service main async fn serenity shared Postgres pool PgPool gt shuttle service ShuttleSerenity Get the discord token set in Secrets toml from the shared Postgres database let token pool get secret DISCORD TOKEN await map err CustomError new Set gateway intents which decides what events the bot will be notified about let intents GatewayIntents GUILD MESSAGES GatewayIntents MESSAGE CONTENT let client Client builder amp token intents event handler Bot await expect Err creating client Ok client Building an interaction for our botWe want to call our bot when chatting in a text channel Discord enables this with slash commands Slash commands can be server specific servers are named as guilds in Discords API documentation or application specific across all servers the bot is in For testing we will only enable it on a single guild server This is because the application wide commands can take an hour to fully register whereas the guild server specific ones are instant so we can test the new commands immediately You can copy the guild ID by right clicking here on the server name and click copy ID you will need developer mode enabled to do this Now that we have the information for setup we can start writing our bot and its commands We will first get rid of the async fn message hook as we won t be using it in this example In the ready hook we will call set application commands with a GuildId to register a command with Discord Here we register a hello command with a description and no parameters Discord refers to these as options async trait impl EventHandler for Bot async fn ready amp self ctx Context ready Ready info is connected ready user name let guild id GuildId your guild id let commands GuildId set application commands amp guild id amp ctx http commands commands create application command command command name hello description Say hello await unwrap info commands Serenity has a bit of a different way of registering commands using a callback If you are working on a larger command application poise which builds on Serenity might be better suited With our command registered we will now add a hook for when these commands are called using interaction create async trait impl EventHandler for Bot async fn ready amp self ctx Context ready Ready async fn interaction create amp self ctx Context interaction Interaction if let Interaction ApplicationCommand command interaction let response content match command data name as str hello gt hello to owned command gt unreachable Unknown command command let create interaction response command create interaction response amp ctx http response response kind InteractionResponseType ChannelMessageWithSource interaction response data message message content response content if let Err why create interaction response await eprintln Cannot respond to slash command why Trying it outNow with the code written we can test it locally Before we do that we have to authenticate the bot with Discord We do this with the value we got from Reset Token on the bot screen in one of the previous steps To register a secret with shuttle we create a Secrets toml file with a key value pair This pair is read by the pool get secret DISCORD TOKEN call in the ready hook Secrets tomlDISCORD TOKEN your discord token DISCORD GUILD ID the guild we are testing on Currently secrets are stored using shuttle s database Postgres offering thus why the parameter on main is PgPool Therefore during local testing you need access to a Postgres database Shuttle s local runner does this using Docker which will require Docker desktop being locally installed to use the Secrets locally This is is subject to change in the future so that it doesn t require Docker for local secrets There is also a known issue with deploying Secrets on Windows so if you have problems consult the Discord cargo shuttle runWe should see that our bot now displays as online When typing we should see our command come up with its description Our bot should respond with hello to our command Wow Let s make our bot do something a little more useful Making the bot do somethingThere is plenty of free APIs that can be used for getting information on a variety of topics For this demo we are going to build a bot that gives a forecast for a location I used the AccuWeather API for this demo If you are following this tutorial you can go and register an application to get an access key If you are using a different API this is still the sort of process you would follow To get a forecast using the API requires two requests Get a location ID for a named locationGet the forecast at the location IDThe API requires making network requests and it returns a JSON response We can make the requests with cargo add reqwest F json and deserialize the results to structures using serde with cargo add serde We will then have a function that chains the two requests together and deserializes the forecast to a readable result You can skip some of the boilerplate by using direct access on untyped values But we will opt for the better strongly typed structured approach Here we type some of the structures returned by the API and add derive Deserialize so they can be decoded from JSON All the keys are in PascalCase so we use the serde rename all PascalCase helper attribute to stay aligned with Rust standards Some are completely different from the Rust field name so we use serde alias on the field to set its matching JSON representation In weather rsuse serde Deserialize derive Deserialize Debug serde rename all PascalCase pub struct Location key String localized name String country Country impl Display for Location fn fmt amp self f amp mut std fmt Formatter lt gt gt std fmt Result write f self localized name self country id derive Deserialize Debug pub struct Country serde alias ID pub id String derive Deserialize Debug serde rename all PascalCase pub struct Forecast pub headline Headline derive Deserialize Debug pub struct Headline serde alias Text pub overview String The above skips a lot of the fields returned by the API only opting for the ones we will use in this demo If you wanted to type all the fields you could try the new type from JSON feature in rust analyzer to avoid having to write as much Our location request call also fails if the search we put in returns no places We will create an intermediate type that represents this case and implements std error Error Again in weather rsuse std fmt Display derive Debug pub struct CouldNotFindLocation place String impl Display for CouldNotFindLocation fn fmt amp self f amp mut std fmt Formatter lt gt gt std fmt Result write f Could not find location self place impl std error Error for CouldNotFindLocation Now with all the types written we create a new async function that given a place and a client will return the forecast along with the location Again in weather rspub async fn get forecast place amp str api key amp str client amp Client gt Result lt Location Forecast Box lt dyn std error Error gt gt Endpoints we will use const LOCATION REQUEST amp str const DAY REQUEST amp str The URL to call combined with our API KEY and the place via the q search parameter let url format apikey amp q LOCATION REQUEST api key place Make the request we will call let request client get url build unwrap Execute the request and await a JSON result that will be converted to a vector of locations let resp client execute request await json lt Vec lt Location gt gt await Get the first location If empty respond with the above declared CouldNotFindLocation error type let first location resp into iter next ok or else CouldNotFindLocation place place to owned Now have the location combine the key identifier with the URL let url format apikey DAY REQUEST first location key api key let request client get url build unwrap let forecast client execute request await json lt Forecast gt await Combine the location with the foreact Ok first location forecast Now we have a function to get the weather given a reqwest client and a place we can wire that into the bots logic Setting up the reqwest clientOur get forecast requires a reqwest Client and the weather API key We will add some fields to our bot for holding this data and initialize this in the shuttle service main function Using the secrets feature we can get our weather API key In lib rsstruct Bot weather api key String client reqwest Client discord guild id GuildId shuttle service main async fn serenity shared Postgres pool PgPool gt shuttle service ShuttleSerenity Get the discord token set in Secrets toml from the shared Postgres database let token pool get secret DISCORD TOKEN await map err CustomError new let weather api key pool get secret WEATHER API KEY await map err CustomError new let discord guild id pool get secret DISCORD GUILD ID await map err CustomError new Set gateway intents which decides what events the bot will be notified about let intents GatewayIntents GUILD MESSAGES GatewayIntents MESSAGE CONTENT let client Client builder amp token intents event handler Bot weather api key client reqwest Client new discord guild id GuildId discord guild id parse unwrap await expect Err creating client Ok client Registering a weather commandWe will add our new command with a place option parameter Back in the ready hook we can add an additional command alongside the existing hello command let commands GuildId set application commands amp guild id amp ctx http commands commands create application command command command name hello description Say hello create application command command command name weather description Display the weather create option option option name place description City to lookup forecast kind CommandOptionType String required true await unwrap Discord allows us to set the expected type and whether it is required Here the place needs to be a string and is required Now in the interaction handler we can add a new branch to the match tree We pull out the option argument corresponding to place and extract its value Because of the restrictions made when setting the option we can assume that it is well formed unless Discord sends a bad request and thus the unwraps here After we have the arguments of the command we call the get forecast function and format the results into a string to return weather gt let argument command data options iter find opt opt name place cloned let value argument unwrap value unwrap let place value as str unwrap let result weather get forecast place await match result Ok location forecast gt format Forecast in forecast headline overview location Err err gt format Err err RunningNow we have these additional secrets we are using and we will add them to the Secrets toml file In Secrets toml Existing secrets DISCORD TOKEN DISCORD GUILD ID New secretWEATHER API KEY With the secrets added we can run the server cargo shuttle runWhile typing we should see our command come up with the options parameters Entering “Paris as the place we get a result with a forecast And entering a location that isn t registered returns an error thanks to the error handling we added to the get forecast function Deploying on shuttleWith all of that setup it is really easy to get your bot hosted and running without having to run your PC Just write cargo shuttle deployAnd you are good to go Easy pease right You could now take this idea even further Use a different API to create a bot that can return funny facts or return new spaceflightsMaybe you could use one of shuttle s provided databases to remember certain information about a userExpand on the weather forecast idea by adding more advanced options and follow ups to command optionsUse the localization information to return information in other languagesThis blog post is powered by shuttle If you have any questions or want to provide feedback join our Discord server Shuttle The Rust native open source cloud development platform Deploying and managing your Rust web apps can be an expensive anxious and time consuming process If you want a batteries included and ops free experience try out Shuttle	2022-09-15 13:28:29
海外TECH	DEV Community	INTERMEDIATE DATA ENGINEERING CONCEPTS.	https://dev.to/violakithinji/intermediate-data-engineering-concepts-3i6k	INTERMEDIATE DATA ENGINEERING CONCEPTS In this article am going to discuss a number of key data engineering concepts that will help understand data engineering career path Big data is a term used to describe large complex datasets that are difficult to process using traditional computing techniques Big data often includes data sets Business intelligence BI is defined as the collection of processes and strategies for analyzing data to generate insights used to make business decisions Data architecture involves the process of designing constructing and maintaining data systems Data architecture includes the design of data models database management systems and data warehouses Data engineers often work with data architects to design and implement data systems but they can also work independently Data lakes in data architecture Data architecture in data marts and Olap cubes Containerization is the process of packaging an application so that it can run in isolated environments known as containers Containerization allows for better resource utilization and portability of applications A containerized application encapsulates all of its dependencies libraries binaries and configuration files into containers This allows an application to run in the cloud or on a virtual machine without needing to be refactored Docker has become synonymous with containers and is a suite of tools that can be used to create run and share containerized applications Docker for data engineering courtesy of google picsKubernetes or ks is a portable open source platform for managing containerized applications Kubernetes for data engineering courtesy of google pictures Cloud computing is a model for delivering IT services over the internet Data engineers often use cloud based services like Amazon S and Google Cloud Storage to store and process data Databases are collections of data that can be queried Relational databases such as MySQL Oracle and Microsoft SQL Server store data in tables and have existed for over four decades Now there are many different types of databases including Wide column stores such as Cassandra and HBaseKey value stores such as DynamoDB and memcachedbDocument databases such as MongoDB and CouchbaseGraph databases such as NeojData accessibility is the ability of users to access data stored in a system Data compliance and privacy is the act of following laws and regulations related to data Data privacy is the act of protecting data from unauthorized access Data governance is the process of managing and governing data within an organization Data governance includes policies and procedures for managing data Data marts are subsets of data warehouses that contain only the data needed by a specific group or department images courtesy of google pictures Data integration platforms are tools that help organizations combine data from multiple sources These typically include features for data cleaning and transformation eg iPaaS is a set of automated tools that integrate software applications that are deployed in different environments Data infrastructure components can include virtual machines cloud services networking storage and software These components are necessary for data systems to function Data pipelines encompass the process of extracting data from one or more sources transforming the data into a format that can be used by applications further down the line and loading the data into a target system Data pipelines essentially automate the process of moving data from one system to another Data repositories or data stores are systems that are used to store data as discussed earlier Examples include relational databases NoSQL databases and traditional file systems Data sources are the systems or devices from which data is extracted Examples of data sources include Global mental health data Data warehouses are centralized systems that store all the data organizations collect Data warehousing involves extracting data from multiple sources transforming the data into a format that can be used for analysis and loading the data into the warehouse Data lakes are repositories that store all the data organizations collect in their rawest form Data lakes are often used for storing data that has not been transformed or processed in any way ETL and ELT processes are used for moving data from one system to another ETL extract transform load processes involve extracting data from one or more sources transforming the data into a format that can be used by the target system and loading the data into the target system ELT extract load transform processes involve extracting data from one or more sources loading the data into the target system and then transforming the data into the desired format ETL processes are useful for data that needs cleaning in order to be used by the target system On the other hand ELT processes are useful when the target system can handle the data in its raw form so ELT processes tend to be faster than ETL processes Data formats for storage include text files CSV files JSON files and XML files Data can also be stored in binary formats such as Parquet and Avro Data visualization is the process of creating visual representations of data These can be used to examine data find patterns and make decisions They are most often used to communicate data to non technical audiences Data engineering dashboards are web based applications that allow data engineers to monitor the status of their data pipelines These typically display the status of data pipelines the number of errors in a pipeline and the time it took to run a pipeline SQL and NoSQL databases are two types of databases that are used to store data SQL structured query language databases are relational databases which means that data is stored in tables and can be queried using SQL NoSQL not only SQL databases are non relational databases which means that data is stored in a format other than tables and can be queried using a variety of methods You would use SQL databases for structured data such as data from a financial system while NoSQL databases are best suited for unstructured data such as data from social media For semi structured data such as data from a weblog you could use either SQL or NoSQL databases	2022-09-15 13:15:29
海外TECH	DEV Community	How to generate Sitemap for your Next JS project	https://dev.to/pfedprog/how-to-generate-sitemap-for-your-next-js-project-cl5	How to generate Sitemap for your Next JS projectIn the following video we generate sitemap and robots txt for our web badminton open source Next Js project We generate nextjs sitemap with next sitemap npm package About Web Badminton Decentralized badminton centered dapp on IPFS and Polygon Blockchain The project is built with react components and nextjs Web Badminton GitHub Demo We built the application using JavaScript NextJS React Tailwind Css and Wagmi library IPFS nft storage and web storage The application is hosted on vercel The newsletter list data is stored on ipfs with web storage We implemented smart contract with solidity hardhat and polygon blockchain mumbai testnet Meanwhile the Ipfs data is stored using nft storage About Dspyt Channel We are Data Science with Python DAOHomepage GitHub DAO Page	2022-09-15 13:10:57
海外TECH	DEV Community	Excel to Html Table	https://dev.to/canerdemirci/excel-to-html-table-11p3	Excel to Html TableWe print tickets for fabrics to be cut in our workplace Such as customer name fabric code meters company to be delivered columns that exists in the ticket We have an excel work file and we copy these pieces of information and we paste it to an excel page that is simply designed and has titles and borders then we print it I coded a web page to take the output of the ticket There are small things too except those like bots that I wrote with use my software knowledge When I think about how possible to transfer cells from excel to HTML table I pasted rows that I ve copied from excel to the notepad then I saw that the cells separating from each other by t character So If I firstly fill an array with the text that I pasted to the textarea element according to n characters in javascript then I would have got all rows and if I put column array into row array I would have uploaded the excel data to a two dimensional array so I do whatever I want from now on Holey Here is the piece of code that does it function excelToArray text let data const tab t const yenisatir n text split yenisatir forEach s gt data push s split tab return data Thanks to js split function we easily partition the string Now I m leaving the codes of the page here You can try copying cells from an excel page lt DOCTYPE html gt lt html lang en gt lt head gt lt meta charset UTF gt lt meta http equiv X UA Compatible content IE edge gt lt meta name viewport content width device width initial scale gt lt title gt Excel den HTML Tablosuna lt title gt lt style gt import url lt display swap gt box sizing border box padding margin body font family Roboto sans serif pasteBtn outline none background royalblue padding rem font weight bold font size rem color fff cursor pointer display block width vw height vh border table border collapse collapse margin rem td padding rem border px solid fff tr nth child odd td background lightblue tr hover td background lightcoral lt style gt lt head gt lt body gt lt textarea gt lt textarea gt lt table gt lt table gt lt button id pasteBtn gt YAPIŞTIRMAK İÇİN TIKLA lt button gt lt script gt const tableEL document querySelector table const textareaEL document querySelector textarea const pasteBtn document querySelector pasteBtn initElements pasteBtn addEventListener click async gt pasteBtn style display none textareaEL value await navigator clipboard readText tableEL innerHTML excelToTable textareaEL value tableEL style display block function initElements tableEL style display none textareaEL style display none function excelToArray text let data const tab t const yenisatir n text split yenisatir forEach s gt data push s split tab return data function excelToTable text const data excelToArray text let tableHTML lt tbody gt data forEach d gt tableHTML lt tr gt d forEach c gt tableHTML lt td gt c lt td gt tableHTML lt tr gt tableHTML lt tbody gt return tableHTML lt script gt lt body gt lt html gt	2022-09-15 13:01:05
海外TECH	DEV Community	How to Make a Creative Website Using HTML, CSS, and JavaScript	https://dev.to/codewithsadee/how-to-make-a-creative-website-using-html-css-and-javascript-b4a	How to Make a Creative Website Using HTML CSS and JavaScriptHow to make a Creative Website Using HTML CSS JavaScriptThis video will show you how to make a creative website using html css javascriptGithub RepoHI I m Sadee webdev In this channel I make videos about Complete Responsive website You can checkout my channel My Channel codewithsadeeSubscribe subscribe now Essential linksDownload the starter file to practice ️Timestamps Demo File structure Project initial Header Hero section Service section About section Feature section Offer section Flight section Newsletter Footer Media queries	2022-09-15 13:00:45
Apple	AppleInsider - Frontpage News	Apple Watch Series 8 & SE review roundup: Few reasons to upgrade	https://appleinsider.com/articles/22/09/15/apple-watch-series-8-se-review-roundup-few-reasons-to-upgrade?utm_medium=rss	Apple Watch Series amp SE review roundup Few reasons to upgradeApple Watch Series and Apple Watch SE reviews are in and while the new Crash Detection and temperature sensing features are useful most say upgrades aren t necessary unless buyers are coming from very old models Apple Watch Series has a temperature sensorApple announced the updated Apple Watch SE and Apple Watch Series on September during its Far Out event These new wearables ship to customers Friday September Read more	2022-09-15 13:55:31
Apple	AppleInsider - Frontpage News	Apple Card credit chief exits for startup	https://appleinsider.com/articles/22/09/15/apple-card-credit-chief-exits-for-startup?utm_medium=rss	Apple Card credit chief exits for startupAs Apple is gearing up for new financial services Apple Card s head of credit Abhi Pabba has left the companyAbhi Pabba chief of credit for Apple Card Credit XPabba will join a credit card startup called X to be its chief risk officer a job he is well familiar with Before Apple Pabba worked at Capital One on credit card authorizations analyzing metrics from card holders such as consumer spending how many credit accounts end up delinquent and the average of approved credit scores Read more	2022-09-15 13:44:12
Apple	AppleInsider - Frontpage News	Adobe buys XD rival Figma for $20 billion	https://appleinsider.com/articles/22/09/15/adobe-buys-xd-rival-figma-for-20-billion?utm_medium=rss	Adobe buys XD rival Figma for billionDigital UI and UX design firm Figma is being acquired by Adobe which has competed in the same space with its Adobe XD software Adobe has announced that it is begun what it calls a definitive merger agreement to acquire Figma for approximately billion in stock and cash The creators of the year old Figma will join Adobe and the deal is expected to clear the regulatory approval process in This has been in the works over the past few months and I m so excited to finally share this news with the world said Figma co founder Dylan Field in a blog post Ten years ago Evan Wallace and I set out on a journey to make design accessible to all Read more	2022-09-15 13:36:32
海外TECH	Engadget	Adobe acquires collaborative design platform Figma for $20 billion	https://www.engadget.com/adobe-figma-acquisition-130937415.html?src=rss	Adobe acquires collaborative design platform Figma for billionAdobe just made a big move into team based creative work The company is acquiring the online collaborative design platform Figma for roughly billion in cash and shares That s the largest buyout of a private software company to date according to Bloomberg s Katie Roof Adobe hopes the deal will quot accelerate quot web creativity and put more of the Creative Cloud suite s technology on the internet You can expect to see Adobe s visual editing features find their way into Figma s platform The two firms expect the purchase to close sometime in if it receives approval from regulators and shareholders Figma co founder and chief Dylan Field will continue to lead his company if and when the takeover finalizes but will report to Adobe s digital media lead David Wadhwani THREAD This morning we re announcing that Figma has entered into an agreement to be acquired by Adobe More information here ーDylan Field zoink September Don t worry that Adobe will completely revamp Figma at least not at first Field stressed in a blog post that Adobe was quot deeply committed quot to keeping Figma an autonomous company There s quot no plan quot at the moment to change Figma s pricing and it will remain free for education users While the executive hoped to draw on Adobe s know how for upgrades he also expected to keep running Figma as he did before While the acquisition is huge it s not surprising given Adobe s past moves It bought the video collaboration platform Frame io in and has been making moves into web based tools with offerings like Creative Cloud Express Figma is a logical if major extension of that strategy ーit could help make online teamwork a staple of the creative process in companies that regularly use software like Photoshop and Premiere	2022-09-15 13:09:37
海外TECH	Engadget	Snapchat for Web is now available for everyone	https://www.engadget.com/snapchat-for-web-is-now-available-for-everyone-130052210.html?src=rss	Snapchat for Web is now available for everyoneSnapchat s messaging and video chat features first made their way to browsers back in July but only in select markets and for Snapchat subscribers Now Snapchat for Web is finally available for all the messaging app s users worldwide It could be the better choice for users who have a lot of typing to do and messages to send since they ll be looking at a bigger screen and have access to a real keyboard nbsp The web interface is pretty basic but it can also be used to send photos and to make audio and video calls A company spokesperson previously told us that video calling has become more popular among its users recently Giving users access to the feature on the web could lead to longer video calls The spokesperson also told us that Snap could bring more of its core features to the web interface if there s enough demand for them nbsp In addition Snap has launched lock screen widgets for the iPhone now that iOS has come out The widgets allow users to create shortcuts for the conversations they want ーperhaps for people they frequently talk to ーso they can fire up chats from their screen in one tap nbsp Speaking of shortcuts the Snapchat app will feature new shortcuts at the top of its chat page They ll make it easy for users to get to unread Snaps chats from friend and replies to stories They will also show reminders for birthdays or for conversations that users haven t replied to yet Finally Snap has introduced Question Stickers that users can post to their stories and Snaps The company said these features will roll out to users soon if they haven t yet	2022-09-15 13:00:52
Cisco	Cisco Blog	Salveo Innovations: How an mHealth application gives patients a greater sense of self-agency	https://blogs.cisco.com/csr/salveo-innovations-how-an-mhealth-application-gives-patients-a-greater-sense-of-self-agency	Salveo Innovations How an mHealth application gives patients a greater sense of self agencySalveo Innovations is the winner of the Cisco Global Problem Solver Challenge USD HBCU Startup Prize	2022-09-15 13:00:48
海外科学	NYT > Science	Solar Energy Is Helping Schools Make Ends Meet	https://www.nytimes.com/2022/09/15/climate/solar-energy-school-funding.html	Solar Energy Is Helping Schools Make Ends MeetPublic schools are increasingly using savings from solar energy to upgrade facilities help their communities and give teachers raises ーoften with no cost to taxpayers	2022-09-15 13:20:20
金融	金融庁ホームページ	株式会社伊予銀行の産業競争力強化法に基づく事業再編計画の認定について公表しました。	https://www.fsa.go.jp/news/r4/ginkou/20220915/20220915-1-1.html	株式会社伊予銀行	2022-09-15 15:00:00
金融	金融庁ホームページ	銀行持株会社の設立認可（株式会社いよぎんホールディングス）について公表しました。	https://www.fsa.go.jp/news/r4/ginkou/20220915/20220915-1-2.html	株式会社	2022-09-15 15:00:00
金融	金融庁ホームページ	銀行持ち株会社の設立認可（株式会社ちゅうぎんフィナンシャルグループ）について公表しました。	https://www.fsa.go.jp/news/r4/ginkou/20220915/20220915-2-1.html	持ち株会社	2022-09-15 15:00:00
金融	金融庁ホームページ	銀行持株会社の設立認可（株式会社しずおかフィナンシャルグループ）について公表しました。	https://www.fsa.go.jp/news/r4/ginkou/20220915/20220915-3-1.html	株式会社	2022-09-15 15:00:00
金融	金融庁ホームページ	株式会社中国銀行の産業競争力強化法に基づく事業再編計画の認定について公表しました。	https://www.fsa.go.jp/news/r4/ginkou/20220915/20220915-2-2.html	株式会社中国銀行	2022-09-15 15:00:00
金融	金融庁ホームページ	株式会社静岡銀行の産業競争力強化法に基づく事業再編計画の認定について公表しました。	https://www.fsa.go.jp/news/r4/ginkou/20220915/20220915-3-2.html	株式会社静岡銀行	2022-09-15 15:00:00
金融	金融庁ホームページ	ユアサイド少額短期保険株式会社に対する行政処分について公表しました。	https://www.fsa.go.jp/news/r4/hoken/20220915.html	少額短期保険	2022-09-15 15:00:00
金融	金融庁ホームページ	入札公告等を更新しました。	https://www.fsa.go.jp/choutatu/choutatu_j/nyusatu_menu.html	公告	2022-09-15 13:15:00
ニュース	@日本経済新聞 電子版	中国・ロシアが対面首脳会談　侵攻後初、対米国で結束 https://t.co/pZwRE9dcRd	https://twitter.com/nikkei/statuses/1570401985710665728	首脳会談	2022-09-15 13:19:44
海外ニュース	Japan Times latest articles	Xi has concerns over Ukraine, Putin says	https://www.japantimes.co.jp/news/2022/09/15/world/vladimir-putin-xi-jinping-uzbekistan/	group	2022-09-15 22:48:46
ニュース	BBC News - Home	William and Kate meet wellwishers at Sandringham	https://www.bbc.co.uk/news/uk-62914640?at_medium=RSS&at_campaign=KARANGA	norfolk	2022-09-15 13:53:35
ニュース	BBC News - Home	Queen's funeral: 'Extraordinary' to invite China, senior Tories say	https://www.bbc.co.uk/news/uk-politics-62913220?at_medium=RSS&at_campaign=KARANGA	uyghurs	2022-09-15 13:44:53
ニュース	BBC News - Home	Roger Federer to retire after Laver Cup in September	https://www.bbc.co.uk/sport/tennis/62911876?at_medium=RSS&at_campaign=KARANGA	london	2022-09-15 13:51:29
ニュース	BBC News - Home	Olivia Pratt-Korbel's mum says heartfelt 'goodnight' at funeral	https://www.bbc.co.uk/news/uk-england-merseyside-62893496?at_medium=RSS&at_campaign=KARANGA	cheryl	2022-09-15 13:14:13
ニュース	BBC News - Home	Tax-cutting mini Budget on Friday next week	https://www.bbc.co.uk/news/uk-politics-62917548?at_medium=RSS&at_campaign=KARANGA	event	2022-09-15 13:43:47
ニュース	BBC News - Home	Queen's lying-in-state: How long is the queue?	https://www.bbc.co.uk/news/uk-62872323?at_medium=RSS&at_campaign=KARANGA	queen	2022-09-15 13:41:58
ニュース	BBC News - Home	Queen Elizabeth II: A day-by-day guide from now to the funeral	https://www.bbc.co.uk/news/uk-62861617?at_medium=RSS&at_campaign=KARANGA	charles	2022-09-15 13:05:52
ニュース	BBC News - Home	England squad: Ivan Toney called up for Italy & Germany Nations League games	https://www.bbc.co.uk/sport/football/62913520?at_medium=RSS&at_campaign=KARANGA	England squad Ivan Toney called up for Italy amp Germany Nations League gamesEngland manager Gareth Southgate calls up the uncapped Ivan Toney for the Nations League games with Italy and Germany this month	2022-09-15 13:49:45
ニュース	BBC News - Home	Queen's funeral plans: What we know so far	https://www.bbc.co.uk/news/uk-60617519?at_medium=RSS&at_campaign=KARANGA	state	2022-09-15 13:26:49
ニュース	BBC News - Home	People in tears at sight of Queen's coffin	https://www.bbc.co.uk/news/uk-62907358?at_medium=RSS&at_campaign=KARANGA	hairs	2022-09-15 13:42:42
ニュース	BBC News - Home	What time is the Queen's funeral? Who will wear military uniform? And other questions	https://www.bbc.co.uk/news/uk-62844663?at_medium=RSS&at_campaign=KARANGA	daily	2022-09-15 13:09:58
北海道	北海道新聞	オ３―２日（１５日）　日本ハムが延長サヨナラ負け	https://www.hokkaido-np.co.jp/article/731806/	日本ハム	2022-09-15 22:26:00
北海道	北海道新聞	中ロ首脳、侵攻後初めて会談　習氏、協力深化の意向示す	https://www.hokkaido-np.co.jp/article/731804/	国家主席	2022-09-15 22:26:00
北海道	北海道新聞	札幌ドームにクマ痕跡　南側山間部から進入か　専門家指摘	https://www.hokkaido-np.co.jp/article/731784/	札幌ドーム	2022-09-15 22:24:11
北海道	北海道新聞	空知管内１６４人感染　新型コロナ	https://www.hokkaido-np.co.jp/article/731799/	空知管内	2022-09-15 22:23:00
北海道	北海道新聞	上川管内で３５４人感染、旭川は２４８人　新型コロナ	https://www.hokkaido-np.co.jp/article/731607/	上川管内	2022-09-15 22:22:04
北海道	北海道新聞	往年の名作、特別上映　１６日から「鉄道員」など３作品　ディノス旭川、１９日閉館	https://www.hokkaido-np.co.jp/article/731796/	旭川市内	2022-09-15 22:19:00
北海道	北海道新聞	楽３―７ソ（１５日）　ソフトバンクが５連勝	https://www.hokkaido-np.co.jp/article/731795/	連勝	2022-09-15 22:16:00
北海道	北海道新聞	外国人の対米投資規制を強化　バイデン政権、供給網やサイバー	https://www.hokkaido-np.co.jp/article/731794/	対米投資	2022-09-15 22:15:00
北海道	北海道新聞	デジタル駆使　稼ぐ小樽へ　地方創生カレッジ、役割と展望は　札学院大・太田名誉教授に聞く	https://www.hokkaido-np.co.jp/article/731793/	名誉教授	2022-09-15 22:14:00
北海道	北海道新聞	ニセコの飲食楽しもう　１８日までオータムフードフェス	https://www.hokkaido-np.co.jp/article/731789/	飲食店	2022-09-15 22:12:00
北海道	北海道新聞	ソフトバンク優勝マジック初点灯　２年ぶりのリーグ制覇へ	https://www.hokkaido-np.co.jp/article/731788/	首位	2022-09-15 22:11:00
IT	週刊アスキー	新品価格の6分の1ほどの価格からゲーミングデバイスがレンタルできるサービス「Device Me」などの新事業をMSYが発表！【TGS2022】	https://weekly.ascii.jp/elem/000/004/105/4105807/	basegrapht	2022-09-15 22:35:00
海外TECH	reddit	Roger Federer retirement announcement on Instagram	https://www.reddit.com/r/tennis/comments/xewl7n/roger_federer_retirement_announcement_on_instagram/	Roger Federer retirement announcement on Instagram submitted by u falafel pants to r tennis link comments	2022-09-15 13:15:29
海外TECH	reddit	One night stand with soon to be ex-husband	https://www.reddit.com/r/relationship_advice/comments/xewgnm/one_night_stand_with_soon_to_be_exhusband/	One night stand with soon to be ex husbandHello I m feeling so frisky that it s actually painful to the point where I m thinking of asking my husband to get down and dirty one last time before the divorce We re muslims so no marriage no sex for either of us We re getting a divorce because he s a narcissist and I can t deal with him anymore Do you think it s a bad idea Would it miss everything up submitted by u throwaway to r relationship advice link comments	2022-09-15 13:09:47