投稿時間:2023-08-17 21:16:42 RSSフィード2023-08-17 21:00 分まとめ(25件)

カテゴリー等	サイト名等	記事タイトル・トレンドワード等	リンクURL	頻出ワード・要約等/検索ボリューム	登録日
IT	気になる、記になる…	Microsoft、｢Surface Pro X｣向けに2023年8月度のアップデートをリリース − サードパーティ製アプリのパフォーマンス改善	https://taisy0.com/2023/08/17/175455.html	microsoft	2023-08-17 11:58:44
IT	気になる、記になる…	｢iPhone 15｣シリーズでは純正レザーケースは用意されないかも	https://taisy0.com/2023/08/17/175452.html	apple	2023-08-17 11:44:08
IT	InfoQ	A Ruthless Approach for Better Security by Identifying Key Risks and Ignoring Others	https://www.infoq.com/news/2023/08/better-security-key-risks/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=global	A Ruthless Approach for Better Security by Identifying Key Risks and Ignoring OthersRisk management techniques can be used to decide which security and privacy aspects are important You can simplify the risk impact calculations by identifying low medium and high and critical losses and by taking likelihoods from the industry to do likelihood calculations This helps you to identify a few key risks and ruthlessly ignore the rest By Ben Linders	2023-08-17 11:32:00
TECH	Techable（テッカブル）	生体認証・画像処理で“顔認証の自動判定精度の高さ”実現。手続き中の離脱を抑える本人確認サービス	https://techable.jp/archives/217327	liquidekyc	2023-08-17 11:00:51
AWS	AWS Startups Blog	Building generative AI applications for your startup, part 2	https://aws.amazon.com/blogs/startups/building-generative-ai-applications-for-your-startup-part-2/	Building generative AI applications for your startup part Learn which AWS services can help you to build a generative AI application The approaches discussed here can help your startup get its product to market as quickly as possible while maintaining cost efficiency and high performance	2023-08-17 11:56:11
python	Pythonタグが付けられた新着投稿 - Qiita	tkcalendarからの指定日付を使ったデータの振り分け	https://qiita.com/blueman/items/609e5a4be741ffa4983f	tkcalendar	2023-08-17 20:41:30
Docker	dockerタグが付けられた新着投稿 - Qiita	Next.jsのstand alone buildを利用したdocker imageのbuild	https://qiita.com/ryuseiyarou/items/ed9209cce81906903baf	buildnextjs	2023-08-17 20:46:42
技術ブログ	Developers.IO	AWS Copilot CLIで作成したAWS App Runnerに、既存のAWS WAFをサクッとアタッチしてみる	https://dev.classmethod.jp/articles/awscopilotcli-attach-awswaf-to-apprunner/	awsapprunner	2023-08-17 11:35:05
海外TECH	MakeUseOf	What Is Xbox’s Enforcement Strike System?	https://www.makeuseof.com/what-is-xbox-enforcement-strike-system/	community	2023-08-17 11:32:23
海外TECH	DEV Community	Building Machine Learning Models with PySpark's pyspark.ml Library: A Comprehensive Guide.	https://dev.to/grayhat/building-machine-learning-models-with-pysparks-pysparkml-library-a-comprehensive-guide-4g5h	Building Machine Learning Models with PySpark x s pyspark ml Library A Comprehensive Guide Welcome to the comprehensive guide on building machine learning models using PySpark s pyspark ml library In this tutorial we will explore the powerful capabilities that PySpark offers for creating and deploying machine learning solutions in a distributed computing environment Apache Spark has revolutionized big data processing by providing a fast and flexible framework for distributed data processing PySpark the Python interface to Apache Spark brings this power to Python developers enabling them to harness the capabilities of Spark for building scalable and efficient machine learning pipelines Throughout this guide we will cover the fundamental concepts of the pyspark ml library including data preprocessing feature engineering model selection hyperparameter tuning and model evaluation We will delve into various machine learning algorithms available in PySpark demonstrating how to apply them to different types of tasks such as classification regression clustering and recommendation Whether you are new to machine learning or an experienced practitioner this tutorial will provide you with the knowledge and tools you need to leverage PySpark s pyspark ml library to develop powerful and scalable machine learning models for your data driven projects Let s get started on our journey to mastering machine learning with PySpark As i have already said earlier pyspark ml is the machine learning library within PySpark which is the Python interface to Apache Spark It provides a high level API for building and working with machine learning pipelines algorithms and models in a distributed computing environment The pyspark ml library is designed to simplify the process of creating and deploying machine learning solutions on large datasets using the parallel processing capabilities of Spark Key components and concepts within pyspark ml include DataFrame DataFrame is a core concept in PySpark It s a distributed collection of data organized into named columns DataFrames are similar to tables in relational databases or dataframes in libraries like pandas They provide a structured way to represent and manipulate data making it suitable for machine learning tasks Transformer A Transformer is an abstraction that represents a transformation applied to a DataFrame It can be used to convert one DataFrame into another through a defined transformation process Examples of transformers include VectorAssembler combining features into a vector and StringIndexer converting categorical strings to numerical indices Estimator An Estimator is an algorithm or model that can be trained on data to generate a Transformer It s a machine learning algorithm that has an internal state and can be fit to data to learn a model Examples of estimators include classification models like LogisticRegression and clustering models like KMeans Pipeline A Pipeline is a sequence of stages where each stage can be either a Transformer or an Estimator Pipelines allow you to assemble a sequence of data processing steps making it easy to ensure that data transformations are consistent across training and testing sets This is particularly useful for avoiding data leakage and maintaining code organization Parameter Grid and Hyperparameter Tuning The ParamGridBuilder class allows you to specify hyperparameter grids for hyperparameter tuning Hyperparameter tuning involves searching through various combinations of hyperparameters to find the best performing model Model Persistence PySpark s pyspark ml library allows you to save and load trained models to from disk This is crucial for deploying and using trained models in production environments without having to retrain them Model Evaluation The pyspark ml evaluation module provides classes for evaluating model performance using various metrics such as classification accuracy F score and regression metrics like RMSE Root Mean Squared Error Feature Engineering pyspark ml feature contains classes for feature extraction transformation and selection It includes tools for converting raw data into suitable formats for machine learning algorithms Algorithms PySpark s pyspark ml classification pyspark ml regression pyspark ml clustering and other sub packages contain various algorithms and models for different machine learning tasks pyspark ml provides a wide range of machine learning algorithms and models for various tasks such as classification regression clustering recommendation and more Here are some of the commonly used algorithms available in pyspark ml Classification Algorithms Logistic Regression A linear algorithm used for binary or multi class classification Decision Trees Tree based algorithm that splits data into branches based on feature values to make predictions Random Forest Ensemble of decision trees that combines multiple trees to improve predictive accuracy Gradient Boosted Trees GBT An ensemble algorithm that builds multiple decision trees in a sequential manner with each tree correcting the errors of the previous ones Support Vector Machines SVM Algorithms that find a hyperplane that best separates classes in a high dimensional space Naive Bayes A probabilistic algorithm based on Bayes theorem used for classification tasks Multilayer Perceptron MLP A feedforward neural network for classification tasks Regression Algorithms Linear Regression A linear algorithm used for regression tasks Decision Trees for Regression Similar to classification trees but used for predicting continuous values Random Forest for Regression An ensemble algorithm for regression tasks Gradient Boosted Trees GBT for Regression An ensemble algorithm for regression tasks Clustering Algorithms K Means An algorithm that divides data into clusters by minimizing the variance within each cluster Bisecting K Means A hierarchical clustering algorithm that repeatedly bisects clusters to form a tree Recommendation Algorithms Alternating Least Squares ALS A matrix factorization technique used for collaborative filtering in recommendation systems Dimensionality Reduction Principal Component Analysis PCA A technique used to reduce the dimensionality of data while preserving its variance Feature Selection Chi Square Selector A method for selecting important features based on the chi squared statistic Feature Hasher A technique for transforming categorical features into numerical features Vector Slicer A tool for selecting and slicing elements from a feature vector These are just some of the algorithms available in pyspark ml Each algorithm comes with its own set of hyperparameters that you can tune to optimize the model s performance Additionally PySpark s ParamGridBuilder allows you to create grids of hyperparameters to perform systematic hyperparameter tuning When using these algorithms you typically construct a machine learning pipeline that includes data preprocessing model training and evaluation stages This pipeline ensures consistent application of transformations and models to both training and testing datasets helping to prevent data leakage and ensure reproducibility Example Logistic Regressionfrom pyspark sql import SparkSessionfrom pyspark ml feature import VectorAssemblerfrom pyspark ml classification import LogisticRegressionfrom pyspark ml import Pipeline Create a Spark sessionspark SparkSession builder appName LogisticRegressionExample getOrCreate Load your data into a DataFramedata spark read csv data csv header True inferSchema True Define feature columnsfeature columns feature feature feature Create a VectorAssembler for feature transformationassembler VectorAssembler inputCols feature columns outputCol features Create a LogisticRegression modellr LogisticRegression featuresCol features labelCol label maxIter regParam Create a pipelinepipeline Pipeline stages assembler lr Split data into training and test setstrain data test data data randomSplit Fit the pipeline on the training datamodel pipeline fit train data Make predictions on the test datapredictions model transform test data Close the Spark sessionspark stop	2023-08-17 11:30:42
海外TECH	Engadget	Chrome will soon explain exactly why your extensions were removed	https://www.engadget.com/chrome-will-soon-explain-exactly-why-your-extensions-were-removed-114519317.html?src=rss	Chrome will soon explain exactly why your extensions were removedHave you ever gone to use an extension and suddenly been unable to access it without warning Google is attempting to make this a little less of a surprise by notifying you when it removes an extension from the Chrome Web Store Of course this will only be for ones you currently have installed not just anytime the store s offerings change With this new update you should receive a notification if one of three things occurs A developer unpublished an extension you use if it s marked as malware or if it s removed from the Chrome Web Store due to policy violations ーsuch as hate speech or spyware You won t receive a notification if Google has given a developer time to fix or appeal a possible violation Google already had steps in place to protect users if the company found an extension to be malware As before once marked as such the extension should be automatically disabled and unable to cause harm These new notifications will appear in the quot privacy and security quot tab of Chrome s settings under a section called quot safety check quot You ll be told how many extensions Google removed from the store and have the option to review more details The new feature will be available in Chrome which is set to come out in early September Other updates will accompany it such as a tune icon replacing the current lock symbol next to the search bar This article originally appeared on Engadget at	2023-08-17 11:45:19
海外TECH	Engadget	The Morning After: Twitter hands over Trump’s DMs	https://www.engadget.com/the-morning-after-twitter-hands-over-trumps-dms-111513694.html?src=rss	The Morning After Twitter hands over Trump s DMsNewly unsealed court filings reveal how much data Xwitter has handed over to the January investigation This includes all tweets sent drafted liked and retweeted even if they were subsequently deleted by Donald Trump s official account This cache also included DMs sent received or stored in draft form as well as linked accounts used on the same device Even more interesting is the company handed over records of all searches made by the account too We already knew Xwitter had fought the order tooth and nail leading to a court battle and a hefty fine But the list of what was available should also serve as a warning to everyone else that the platform stores a lot more data on its users than you might expect The fact it could serve up location history deleted DMs and a list of searches might make you wonder what else it has on you Dan CooperYou can get these reports delivered daily direct to your inbox Subscribe right here ​​​​The biggest stories you might have missedWith some tech savvy you can disconnect your robot vacuum from the cloudThe best soundbars for BitDo stuffed buttons into its hand crampingly small Micro controller Amazon Music Unlimited raises subscription prices againSolo Stove introduces a gas only version of its Pi pizza ovenNetflix s Scott Pilgrim Takes Off teaser hits all the right notes Scientists recreate an iconic Pink Floyd song by scanning listeners brainsIt could eventually help people with speech challenges Researchers claim to have found a way to extract a song from a person s brain by analyzing their neural activity A group of test subjects with drug resistant epilepsy who already have implants in their brains were played Pink Floyd s Another Brick in the Wall Part Using the implants the team monitored how the brains responded to the stimulus and used AI to recreate what they heard The result is a bit like listening to a Pink Floyd cover band playing down the street while you re swimming but it s recognizable enough It s hoped the discovery could be used as a jumping off point to develop tech to help people with atrophied speech communicate Continue Reading Intel walks away from its billion takeover of Tower SemiconductorRumors suggest Chinese regulators were slow to agree to the deal Intel CorporationIntel has withdrawn its billion offer to buy Israeli chip fabricator Tower Semiconductor after failing to get regulatory approval Tower is not a bleeding edge manufacturer it makes chips for industrial and automotive applications using older processes Intel wanted it as part of its plan not to just make its own chips but to manufacture third party designs in its facilities It s thought the major roadblock was China which refused to give its blessing in a “timely manner It s not clear if China s inaction was part of the current geopolitical brouhaha over the future of chip making but it probably hasn t helped Continue Reading GM s latest investment could speed development of cheaper EV batteriesIt is putting million into a US based battery company Karl Nielsen for General MotorsGM has a vested interest in making batteries both cheaper and more efficient which is why it just dropped million into Mitra Chem s pocket Mitra Chem is working on a US made battery using cheaper more common metals than are presently employed It s also looking to speed up research into new battery technologies using software that could eliminate much of the early gruntwork Continue Reading Google is working to improve Bard s soulless life adviceBut not everyone on the project thinks it s a good idea A Google contractor developing Bard the search giant s AI chatbot has enlisted a score of experts to improve the system s ability to dole out life advice It s in response to users asking the platform for help with intimate issues like how to back out of a destination wedding The work has caused alarm in some parts of the company where workers feel people shouldn t be asking an AI those sorts of questions Continue Reading Snapchat s My AI chatbot glitched so hard it started posting StoriesIt shouldn t be able to do that Snapchat s in app digital assistant experienced a malfunction so great it started posting its own stories My AI is a chatbot you can access if you subscribe to Snapchat Plus for a month but it shouldn t have access to your stories at all In a statement the company explained the system had a “temporary outage and there s nothing to worry about For now at least Continue Reading This article originally appeared on Engadget at	2023-08-17 11:15:13
海外科学	NYT > Science	Appeals Court Upholds Legality of Abortion Pill but With Significant Restrictions	https://www.nytimes.com/2023/08/16/health/abortion-pill-ruling.html	Appeals Court Upholds Legality of Abortion Pill but With Significant RestrictionsThe restrictions which would prevent mifepristone from being mailed to patients and would require in person doctor visits are on hold until the Supreme Court weighs in	2023-08-17 11:16:50
海外TECH	WIRED	10 Facts That Prove the World Is in a Climate Emergency	https://www.wired.com/story/climate-change-facts/	cases	2023-08-17 11:13:48
ニュース	BBC News - Home	Sir Michael Parkinson: Chat show host dies aged 88	https://www.bbc.co.uk/news/entertainment-arts-66411604?at_medium=RSS&at_campaign=KARANGA	british	2023-08-17 11:01:13
ニュース	BBC News - Home	World Cup final: Pubs call for relaxed alcohol laws on Sunday	https://www.bbc.co.uk/news/business-66532694?at_medium=RSS&at_campaign=KARANGA	trade	2023-08-17 11:46:21
ニュース	BBC News - Home	More than 60 migrants feared dead at sea off Cape Verde coast	https://www.bbc.co.uk/news/world-africa-66528273?at_medium=RSS&at_campaign=KARANGA	senegal	2023-08-17 11:49:11
ニュース	BBC News - Home	Pakistan: More than 100 arrested after churches burned	https://www.bbc.co.uk/news/world-asia-66517901?at_medium=RSS&at_campaign=KARANGA	jaranwala	2023-08-17 11:16:05
ニュース	BBC News - Home	Saudi crown prince Mohammed bin Salman invited to visit UK	https://www.bbc.co.uk/news/uk-politics-66531007?at_medium=RSS&at_campaign=KARANGA	jamal	2023-08-17 11:31:06
ニュース	BBC News - Home	Germany: Flood waters surge in Frankfurt underground station	https://www.bbc.co.uk/news/world-europe-66533844?at_medium=RSS&at_campaign=KARANGA	airport	2023-08-17 11:32:03
ニュース	BBC News - Home	Rugby World Cup 2023: Owen Farrell red card appealed by World Rugby	https://www.bbc.co.uk/sport/rugby-union/66531764?at_medium=RSS&at_campaign=KARANGA	Rugby World Cup Owen Farrell red card appealed by World RugbyEngland captain Owen Farrell is once again a doubt for the start of the World Cup after World Rugby appealed a decision to overturn a red card received by the fly half	2023-08-17 11:53:56
ニュース	BBC News - Home	Women's World Cup: Ella Toone praised by England team-mate Keira Walsh	https://www.bbc.co.uk/sport/football/66531864?at_medium=RSS&at_campaign=KARANGA	Women x s World Cup Ella Toone praised by England team mate Keira WalshEngland midfielder Keira Walsh says Ella Toone needs to be given more respect for helping the Lionesses reach the Women s World Cup final	2023-08-17 11:00:34
ニュース	BBC News - Home	World Athletics Championships 2023: Eilish McColgan ruled out by injury	https://www.bbc.co.uk/sport/athletics/66534019?at_medium=RSS&at_campaign=KARANGA	World Athletics Championships Eilish McColgan ruled out by injuryCommonwealth Games m champion Eilish McColgan pulls out of the World Athletics Championships starting on Saturday because of a knee injury	2023-08-17 11:30:18
ニュース	Newsweek	集落奪還はゼレンスキーが待ちに待ったブレイクスルー、ウクライナは内部崩壊寸前だった	https://www.newsweekjapan.jp/stories/world/2023/08/post-102439.php	集落奪還はゼレンスキーが待ちに待ったブレイクスルー、ウクライナは内部崩壊寸前だったウクライナ軍が奪還した村から蟻のように逃げ出すロシア兵ウクライナ政府はロシア軍が占領していた東部の村ウロジャイノエを奪還したと発表した。	2023-08-17 20:08:24
IT	週刊アスキー	休日は大人コーデ♪『白猫GOLF』で「ノア（CV：水瀬いのりさん）」の新ウェアが登場	https://weekly.ascii.jp/elem/000/004/150/4150365/	水瀬いのり	2023-08-17 20:10:00