投稿時間:2023-07-04 05:27:14 RSSフィード2023-07-04 05:00 分まとめ(31件)

カテゴリー等	サイト名等	記事タイトル・トレンドワード等	リンクURL	頻出ワード・要約等/検索ボリューム	登録日
python	Pythonタグが付けられた新着投稿 - Qiita	ランダムフォレストの簡単な実装	https://qiita.com/ameshikou/items/a41e11974d0dc245496e	機械学習	2023-07-04 04:28:54
海外TECH	MakeUseOf	Why the New Arduino Uno R4 Is a Game-Changer for Makers	https://www.makeuseof.com/arduino-uno-r4-game-changer-for-makers/	complex	2023-07-03 19:30:18
海外TECH	DEV Community	Data Engineering Role Trends & Requirements for 2023	https://dev.to/mkhalid12/data-engineering-role-trends-requirements-for-2023-23he	Data Engineering Role Trends amp Requirements for If you are a new reader I am Madiha Khalid Senior Data Engineer I am working as a Professional Data Engineer and Solution Architect for the past six years I bring here my passion to start writing about Modern Data Engineering Tools Stack along with Modern Data Architectures The purpose of this article is to convey my perspective and reflections on what I have observed during the preceding five months as well as how the expectations for Data Engineering responsibilities trends vary from one company to the next in current times What Is the Data Engineering DE Role We saw that Data Engineer including myself works most of the time building reliable and scalable ETL pipelines We spent an enroumous amount of time on data integration and making the pipeline reliable providing refreshed data every day to our stakeholders Building one source of a truth data warehouse is always a big challenge However In the last couple of years the Data Engineering position evolved a lot There are countless tools available in the market The data engineering role it became first and high demand job in the data world Why has DE become a high demand job I want to fuel up my data engineering capabilities and start analyzing various Job posts with their requirements I conclude that as Data Engineering position is in very high demand and highly paid job Hence the expectation towards this role also increases These days this is not enough if you write only Data Pipelines maybe in small Python scripts for data integration and Schedule these pipelines via some Orchestration tools like Airflow Dagster etc ButData Engineering Tasks become extended Software Engineer Responsibilities skills with Data Integration DevOps and Analytics Engineer sometimes I will try to elaborate more on this statement Data Engineer with Software Engineering Skills Very strong Software Engineering Principles now become the first compulsory point for Data Engineers Some companies required strong OOP programming with unit testing while others want emphasis on Functional Programming concepts for specially for Apache Spark and Big Data Technologie Pipeline Development Data Engineer with DevOps Skills The Engineer should be responsible for all DevOps Tasks maintaining scalable infrastructure like Airflow Kubernetes Spark Cluster etc Even though you could use Cloud Managed service there are still many things you need to optimize on daily ETL Pipeline optimization Infrastructure as a code expertise AWS Cloudformation or Terrafoam or Terragrunt will add value to your profile Data Engineer with Data Integration Skills Should be responsible for building Data Integration for a Data warehouse or data lake with modern Cloud Datawarehouse AWS Redshift Snowflake Databricks etc and Modern Data Lake concepts like Delta Lake Data Engineer with Analytics Engineer Skills The Data Engineer should be responsible for building a Data Model for the Analyst if your team has no Analytics Engineer Then the responsibility to create either a traditional datawarehouse using the Kimball Dimensional model or Databrick Medallion Architecture Layers technique to build Aggregated table This could also be possible to write famous DBT data build tool jobs on Data Engineer s shoulders Considering these skills and expertise I believe this makes the Data Engineering position most challenging and high in demand There are mixed requirements for these skills combination or all in one Future of Data Engineering Role The future of data engineering is proposing a no ETL ELT approach As AWS announced for Zero ETL I am not sure how much we can able to achieve this is a reality due to many reasons like extensive data transformation and data quality checks on the datawarehouse I believe there are many self service tools coming in the market which can help with the burden of Data Integration like Airbyte Mage Fivetran and Portable and so on The tools are unlimited to help us out But I believe No ETL is still a bit far to achieve Conclusion The requirements are going crazy for Data Engineer s responsibilities from company to company Considering all these requirements Data Engineer position became in high demand but it comes with extra responsibilities PS These thoughts are my own personal and the experience I observed during multiple interview processes This article is originally published at Medium	2023-07-03 19:54:46
海外TECH	DEV Community	FLaNK Stack for 4th of July	https://dev.to/tspannhw/flank-stack-for-4th-of-july-4hf4	FLaNK Stack for th of July July HOLIDAY FLiPN FLaNK Stack WeeklyTim Spann PaaSDevMy friend wrote an awesome new book on streaming I highly recommend picking up a copy CODE COMMUNITYPlease join my meetup group NJ NYC Philly Virtual This is Issue Videos ab channel PlainSchwarz Talks Articles george vetticaden accelerating ai data pipelines building an evernote chatbot with apache nifi and generative ai dffc tspann cdc not cat data capture ec tspann functions anywhere faas eeecedb Documentation EventsJuly Hours to Data Innovation Data FlowOctober Hours to Data Innovation Data FlowCloudera EventsMore Events Code NiFi Code Tools Tim Spann	2023-07-03 19:25:40
海外TECH	DEV Community	What's the difference between a library and a framework?	https://dev.to/codenewbieteam/whats-the-difference-between-a-library-and-a-framework-34oj	What x s the difference between a library and a framework Just like the title says I d like help understanding the difference between a library and a framework I m a non techie so simple explanations and analogies are most definitely welcome explainlikeimfive Bonus points if you can provide examples of each	2023-07-03 19:19:25
海外TECH	DEV Community	Connect ChatGPT to your SQL Database	https://dev.to/polterguy/connect-chatgpt-to-your-sql-database-3289	Connect ChatGPT to your SQL DatabaseWith our latest real time information release we re now able to connect ChatGPT to any SQL database you have and transmit the result of your SQL to ChatGPT for then to have it analyse your data answer your question and return an answer accordingly However before I start explaining the process let s first enjoy a screenshot What you re looking atThe above ChatGPT answer was created by executing the following SQLselect f title as Film count fa actor id as Actors from film as f join film actor as fa on f film id fa film id group by f title order by Actors desc limit The above SQL of course is a part of a Hyperlambda snippet that looks as follows data connect generic sakila data select select f title as Film count fa actor id as Actors from film as f join film actor as fa on f film id fa film id group by f title order by Actors desc limit result for each x data select set value x result strings concat get value x result Film get value x dp Film Actor count get value x dp Actors r n return x resultThe above Hyperlambda snippet again is using the Hyperlambda strings mixin slot which combines natural language text with the result of executing Hyperlambda code Below is a screenshot of the complete training snippet if you re interested Once the context is semantically matched towards the query being e g How many actors played in the movie MUMMY CREATURES The SQL extracts the following data Film MUMMY CREATURES Actor count Film BOONDOCK BALLROOM Actor count Film LAMBS CINCINATTI Actor count Film HELLFIGHTERS SIERRA Actor count Film ARABIA DOGMA Actor count Film WIZARD COLDBLOODED Actor count Film SUBMARINE BED Actor count Film RANDOM GO Actor count Film LESSON CLEOPATRA Actor count Film IMAGE PRINCESS Actor count Then our OpenAI machine learning functions submits the above data to OpenAI s APIs which then uses the above as its real time data foundation for answering the question the end result being something such as follows There was actora playing in the movie MUMMY CREATURESIn the video below I am walking you through the entire processPretty kick ass if you ask me	2023-07-03 19:06:43
海外TECH	DEV Community	Join Virtual Coffee for the Build in Public: The Power of Daily Standup and Demo Challenge	https://dev.to/virtualcoffee/join-virtual-coffee-for-the-build-in-public-the-power-of-daily-standup-and-demo-challenge-35kb	Join Virtual Coffee for the Build in Public The Power of Daily Standup and Demo ChallengeHey friends At Virtual Coffee we re excited to announce our latest monthly challenge Build in Public Challenge For a lot of us building in public has been a significant part of our journey In fact every job I ve had since moving to tech has a direct connection to building in public Building in public allows us to share our progress become a part of supportive communities and gain valuable feedback Whether you re a Virtual Coffee community member or part of the wider Dev community we invite you to join us on this journey of building in public The Build in Public ConceptThe Build in Public movement popularized by Shawn Wang emphasizes the idea of sharing your work transparently throughout the development process By opening up about your progress challenges and insights you create an opportunity for collaboration learning and community engagement Benefits of Building in PublicAccountability Publicly sharing your goals and progress creates a sense of accountability Knowing that others are aware of your commitments is a powerful motivator driving you to stay focused and make consistent progress Feedback and Support When you build in public you invite feedback and support from a community of like minded individuals This can lead to valuable insights suggestions and encouragement that can help refine your work and boost your confidence Networking and Collaboration Building in public allows you to connect with others who share similar interests You can collaborate on projects exchange ideas and establish meaningful professional relationships that can open doors to new opportunities Ways to Build in Public Coding ProjectsShare what you re working on ask for help or collaboration opportunities and talk about the work you ve done You might even check out some open source opportunities Non Coding ProjectsSometimes we need a break from coding or contributing to tech projects If you want to enrich other parts of your life consider doing it in public Maybe you re writing a book creating artwork or on a health journey Leverage social media personal blogs or forums to share your journey challenges and milestones How it works Daily Standup and DemoThe Daily Standup and Demo approach is an effective way to embrace the Build in Public philosophy It involves communicating regularly about your work sharing progress and preparing for a final demo to showcase your achievements If you re not a part of the Virtual Coffee community we ll do weekly check ins where you can post what you ve done all week Or you can post to social media and tag us in the post The ProcessDefine Goals Start by clearly defining the project you want to share and the scope of your work Set achievable goals and outline what you aim to accomplish by the end of the month Share Progress Regularly communicate your progress in designated channels Whether it s a detailed blog post or a short tweet sharing your milestones challenges and learnings encourages engagement and demonstrates your dedication Seek Support If you encounter roadblocks or need assistance don t hesitate to ask for help Engage with the community ask for help on social medai or participate in coffee table groups to find support and solutions Prepare for Demo As the challenge progresses prepare for the final demo Decide whether you want to pre record your demo or present it live Test your workflow ensure you have the necessary environments and prepare talking points to deliver an engaging presentation Resources and Further ReadingShawn Wang s original Build in Public conceptAgile Sprint Reviews Three steps for better sprint reviews with your agile teamHow to prepare a demoHow to give a great Agile sprint demo How to Get InvolvedGetting involved is as easy as grabbing your favorite cup of coffee or tea and joining us here Here s how you can participate Follow our Virtual Coffee org on Dev and introduce yourself in this thread Look for the Build in Public challenge posts and engage in discussions Share your reflections updates and insights with the community Connect with others and find an accountability partner to support each other Celebrate your progress and encourage others by participating in the progress celebration thread If you want to share your progress and tag us VirtualCoffeeIO on Twitter By embracing transparency seeking feedback and celebrating small wins we foster a culture of continuous improvement and create opportunities for collaboration and growth So let s embark on this journey together build in public and showcase our work at the end of the month Remember building in public is not only about the end result but also about the relationships and knowledge gained along the way Let s support each other share our progress and make a positive impact in the developer and creator community	2023-07-03 19:02:36
Apple	AppleInsider - Frontpage News	Light the fireworks to celebrate these incredible Apple deals on Amazon for the 4th of July week	https://appleinsider.com/articles/23/07/03/light-the-fireworks-to-celebrate-these-incredible-apple-deals-on-amazon-for-the-4th-of-july-week?utm_medium=rss	Light the fireworks to celebrate these incredible Apple deals on Amazon for the th of July weekAmazon is already slashing prices on the latest M inch MacBook Air bringing the price down by to a new low of This model joins other great computer deals like a discount on an M Max MacBook Pro Amazon s th of July deals on Apple gearOther great deals include discounts on Apple Watch Series with multiple sizes and case materials available Plus save on the AirPods Max in any color bringing the price down to the lowest we ve seen Read more	2023-07-03 19:48:37
Apple	AppleInsider - Frontpage News	Apple petitions Supreme Court to over-rule 'Fortnite' lawsuit	https://appleinsider.com/articles/23/07/03/apple-petitions-supreme-court-to-over-rule-fortnite-lawsuit?utm_medium=rss	Apple petitions Supreme Court to over rule x Fortnite x lawsuitApple is taking its battle with Epic Games to the U S Supreme Court with the intention to reverse a ruling from the Court of Appeals that affects the App Store policies The long running lawsuit between the Fortnite game maker and the App Store owner is close to reaching the highest court in the United States In this case it is because Apple wants to revisit an antitrust appeal that didn t go entirely the company s way In a filing to the Supreme Court on Monday Apple s legal team motions for a reconsideration of an April ruling by the U S Ninth Circuit Court of Appeals on the matter While in April the court upheld most of a previous decision in the case it rejected attempts by Epic and Apple to revisit the decision on Friday Read more	2023-07-03 19:19:40
海外科学	NYT > Science	A New Kind of Disaster Aid: Pay People Cash, Before Disaster Strikes	https://www.nytimes.com/2023/07/03/climate/cash-disaster-relief.html	A New Kind of Disaster Aid Pay People Cash Before Disaster StrikesExperiments suggest that sums as low as can help the world s poorest protect themselves and their property in ways they couldn t otherwise	2023-07-03 19:08:22
ニュース	BBC News - Home	Buck Moon: July supermoon to appear brighter than usual in the sky this week	https://www.bbc.co.uk/news/world-66091619?at_medium=RSS&at_campaign=KARANGA	earth	2023-07-03 19:23:02
ニュース	BBC News - Home	France riots ease as mayors hold anti-violence rally	https://www.bbc.co.uk/news/world-europe-66084677?at_medium=RSS&at_campaign=KARANGA	violence	2023-07-03 19:01:02
ニュース	BBC News - Home	Million pound appeal for 20-month-old Hallie who has leukaemia	https://www.bbc.co.uk/news/uk-england-coventry-warwickshire-66088141?at_medium=RSS&at_campaign=KARANGA	coventry	2023-07-03 19:01:55
ニュース	BBC News - Home	Wimbledon 2023: Lauren Davis takes best shot of day one	https://www.bbc.co.uk/sport/av/tennis/66035959?at_medium=RSS&at_campaign=KARANGA	Wimbledon Lauren Davis takes best shot of day oneWatch the best shots from day one of Wimbledon including a phenomenal winner by Lauren Davis and epic rallies with Britain s Liam Broady and Harriet Dart	2023-07-03 19:13:12
ニュース	BBC News - Home	Wimbledon 2023 results: Venus Williams loses to Elina Svitolina	https://www.bbc.co.uk/sport/tennis/66092149?at_medium=RSS&at_campaign=KARANGA	wimbledon	2023-07-03 19:07:39
ビジネス	ダイヤモンド・オンライン - 新着記事	キーエンスが「世界初・業界初」商品を大量に作れる理由、企画は絶対“1案件1人”で担当せよ【動画】 - キーエンス流 営業・企画・戦略の強化書	https://diamond.jp/articles/-/324493	キーエンスが「世界初・業界初」商品を大量に作れる理由、企画は絶対“案件人で担当せよ【動画】キーエンス流営業・企画・戦略の強化書売れる新商品が日本企業から生まれない構造的理由とは特集『キーエンス流営業・企画・戦略の強化書』は、付加価値が生まれる本質的構造を解説します。	2023-07-04 04:50:00
ビジネス	ダイヤモンド・オンライン - 新着記事	米大手行、ストレスはテストで終わらず - WSJ PickUp	https://diamond.jp/articles/-/325526	wsjpickup	2023-07-04 04:45:00
ビジネス	ダイヤモンド・オンライン - 新着記事	【野沢北高校】華麗なる卒業生人脈！新海誠、青木理、ZHD出沢剛…作家や宇宙飛行士も輩出 - 日本を動かす名門高校人脈	https://diamond.jp/articles/-/325145	宇宙飛行士	2023-07-04 04:40:00
ビジネス	ダイヤモンド・オンライン - 新着記事	シリコンバレーの幻覚剤使用、企業文化に - WSJ PickUp	https://diamond.jp/articles/-/325525	wsjpickup	2023-07-04 04:35:00
ビジネス	ダイヤモンド・オンライン - 新着記事	米オフィス物件の苦境、思ったよりマシなのか - WSJ PickUp	https://diamond.jp/articles/-/325524	wsjpickupsl	2023-07-04 04:30:00
ビジネス	ダイヤモンド・オンライン - 新着記事	【日本軍の敗因】「悲惨な結果を生むリーダー」7つの共通点 - 定番読書	https://diamond.jp/articles/-/324847	連載	2023-07-04 04:25:00
ビジネス	ダイヤモンド・オンライン - 新着記事	【精神科医が教える】 「締め切りが守れない人」の残念な共通点・ワースト1 - 精神科医Tomyが教える 40代を後悔せず生きる言葉	https://diamond.jp/articles/-/325329	【精神科医が教える】「締め切りが守れない人」の残念な共通点・ワースト精神科医Tomyが教える代を後悔せず生きる言葉【大好評シリーズ万部突破】誰しも悩みや不安は尽きない。	2023-07-04 04:22:00
ビジネス	ダイヤモンド・オンライン - 新着記事	【お金を増やす】200万円台の元手を1代で44兆円にまで増やした“驚異の投資家” - 10万円から始める! 小型株集中投資で１億円 【１問１答】株ドリル	https://diamond.jp/articles/-/324307	【お金を増やす】万円台の元手を代で兆円にまで増やした“驚異の投資家万円から始める小型株集中投資で億円【問答】株ドリル【大好評シリーズ万部突破】東京理科大学の大学生だったとき、夏休みの暇つぶしで突如「そうだ、投資をしよう」と思い立った。	2023-07-04 04:19:00
ビジネス	ダイヤモンド・オンライン - 新着記事	「目の前の利益」に飛びつく人が気づきたい「損得」以外のもう1つの視点 - メンタリング・マネジメント	https://diamond.jp/articles/-/324865	「メンタリング」とは、他者を本気にさせ、どんな困難にも挑戦する勇気を与える手法のことで、本書にはメンタリングによる人材育成の手法が書かれている。	2023-07-04 04:16:00
ビジネス	ダイヤモンド・オンライン - 新着記事	「進路に悩む子ども」に親ができるアドバイス・ベスト1 - 世界標準の子育て	https://diamond.jp/articles/-/324868	「進路に悩む子ども」に親ができるアドバイス・ベスト世界標準の子育て子どもたちが生きる数十年後は、いったいどんな未来になっているのでしょうか。	2023-07-04 04:13:00
ビジネス	ダイヤモンド・オンライン - 新着記事	大阪公立大学のキャンパスはどんな雰囲気？【キャンパスミニレビュー付き】 - 大学図鑑！2024 有名大学82校のすべてがわかる！	https://diamond.jp/articles/-/325518		2023-07-04 04:10:00
ビジネス	ダイヤモンド・オンライン - 新着記事	職場にいる「深く考えている人」と「浅はかな人」の決定的な差とは - 1秒で答えをつくる力 お笑い芸人が学ぶ「切り返し」のプロになる48の技術	https://diamond.jp/articles/-/325516		2023-07-04 04:07:00
ビジネス	ダイヤモンド・オンライン - 新着記事	精神科医が語る「うつっぽさを1年以上放置するとヤバイ理由」【書籍オンライン編集部セレクション】 - ストレスフリー超大全	https://diamond.jp/articles/-/325379	精神科医が語る「うつっぽさを年以上放置するとヤバイ理由」【書籍オンライン編集部セレクション】ストレスフリー超大全さまざまな「環境の変化」により、いま、多くの人が将来への不安を抱え、「大きなストレス」を感じています。	2023-07-04 04:04:00
ビジネス	ダイヤモンド・オンライン - 新着記事	親がなんでもしてあげる「動物園型子育て」のメリットデメリット - 勉強しない子に勉強しなさいと言っても、ぜんぜん勉強しないんですけどの処方箋	https://diamond.jp/articles/-/325533	親がなんでもしてあげる「動物園型子育て」のメリットデメリット勉強しない子に勉強しなさいと言っても、ぜんぜん勉強しないんですけどの処方箋万件を超える「幼児から高校生までの保護者の悩み相談」を受け、人以上の小中高校生に勉強を教えてきた教育者・石田勝紀が、子どもを勉強嫌いにしないための『勉強しない子に勉強しなさいと言っても、ぜんぜん勉強しないんですけどの処方箋』を刊行。	2023-07-04 04:01:00
ビジネス	東洋経済オンライン	｢キャリアアップを気にする新人｣に伝えたいこと 転職よりもまずは｢優秀な2年生｣を目指そう | リーダーシップ・教養・資格・スキル | 東洋経済オンライン	https://toyokeizai.net/articles/-/681825?utm_source=rss&utm_medium=http&utm_campaign=link_back	pampg	2023-07-04 04:50:00
ビジネス	東洋経済オンライン	鉄道車両と自動車､意外に多い｢技術的な共通点｣ お互いに影響を及ぼしながら発展してきた | 経営 | 東洋経済オンライン	https://toyokeizai.net/articles/-/682148?utm_source=rss&utm_medium=http&utm_campaign=link_back	東洋経済オンライン	2023-07-04 04:30:00