投稿時間:2021-12-29 16:34:29 RSSフィード2021-12-29 16:00 分まとめ(36件)

カテゴリー等	サイト名等	記事タイトル・トレンドワード等	リンクURL	頻出ワード・要約等/検索ボリューム	登録日
TECH	Engadget Japanese	コロナ接触通知API開発のアップル幹部、各国政府を説得した苦労話を語る	https://japanese.engadget.com/apple-exposure-notification-leader-065001258.html	google	2021-12-29 06:50:01
TECH	Engadget Japanese	読書に集中したいなら「Kindle Paperwhite シグニチャー エディション」だ!｜ガジェットレビュー2021	https://japanese.engadget.com/new-kindle-paperwhite-review-063502774-063007804.html	amazon	2021-12-29 06:30:07
TECH	Engadget Japanese	2021年もっとも読まれた「新製品の記事」はどれ？ 10位〜1位を振り返り	https://japanese.engadget.com/engadget-2021-062035352.html	記事	2021-12-29 06:20:35
IT	ITmedia 総合記事一覧	[ITmedia ビジネスオンライン] ワタミ「早期退職はしない」　「SDGs経営で1兆円企業」を目指す	https://www.itmedia.co.jp/business/articles/2112/29/news057.html	itmedia	2021-12-29 15:41:00
IT	ITmedia 総合記事一覧	[ITmedia ビジネスオンライン] 年間目標を達成したフリーランスは46.3％、達成した人の特徴は？	https://www.itmedia.co.jp/business/articles/2112/29/news054.html	itmedia	2021-12-29 15:25:00
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	AttributeError: 'str' object has no attribute 'backward'の解消方法について教えて下さい	https://teratail.com/questions/375965?rss=all	AttributeErrorxstrxobjecthasnoattributexbackwardxの解消方法について教えて下さいをGoogleColabを利用して学習していましたが、順番に処理を実行したところエラーが発生して先に進めません。	2021-12-29 15:48:24
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	MySQLのデータベースをSQL Serverのデータベースにレプリケーションしたい	https://teratail.com/questions/375964?rss=all	MySQLのデータベースをSQLServerのデータベースにレプリケーションしたい前提・実現したいことMySQLのデータベースをSQLnbspServerのデータベースにレプリケーションしたいです。	2021-12-29 15:47:44
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	Python エラー	https://teratail.com/questions/375963?rss=all	Python エラー Python の プログラム について です 。	2021-12-29 15:31:51
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	Google Coraboratory と　コマンドプロンプトのpythonの結果の違いについて	https://teratail.com/questions/375962?rss=all	GoogleCoraboratoryとコマンドプロンプトのpythonの結果の違いについてGooglenbspCoraboratorynbspとコマンドプロンプトのpythonの結果の違いについて以下のコードを入力したのですが、結果が異なります。	2021-12-29 15:30:08
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	webdriver_managerが使えない	https://teratail.com/questions/375961?rss=all	webdrivermanagerが使えない前提・実現したいことこのサイトを参考にコードを作成しましたがnonbspmoduleエラーになります。	2021-12-29 15:29:49
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	laravelで作ったアプリがherokuにデプロイできない	https://teratail.com/questions/375960?rss=all	laravelで作ったアプリがherokuにデプロイできない前提・実現したいことnbsp現在Laravelにてポートフォリオを作成しており、ようやくデプロイの段階まで来ました。	2021-12-29 15:27:18
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	sscanf_s()関数を使って.mtlファイルの文字を取り出す方法	https://teratail.com/questions/375959?rss=all	sscanfs関数を使ってmtlファイルの文字を取り出す方法提示コードですがコメント部のコードでmapkd文字列の次にる画像ファイルを名を読み込みたのですがprintfquotstrnbspsnquotstrで何も表示されませんこれは何が原因なのでしょうか下記のサンプルコードを参考に実装しました。	2021-12-29 15:25:41
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	pythonのディクショナリの中に二重構造でセットをネストし、出力したい。	https://teratail.com/questions/375958?rss=all	pythonのディクショナリの中に二重構造でセットをネストし、出力したい。	2021-12-29 15:17:08
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	MACアドレスだけではだめですか？	https://teratail.com/questions/375957?rss=all	通信	2021-12-29 15:11:42
Program	[全てのタグ]の新着質問一覧｜teratail（テラテイル）	humburgerをクリック時に、drawer-navが閉じない	https://teratail.com/questions/375956?rss=all	humburgerをクリック時に、drawernavが閉じない前提・実現したいこと表題の通り、閉じようとすると、navopenとhumburgerのline線がもとに戻らない発生している問題・エラーメッセージhumburgerをhumburgerをクリックすると、navopenにより、drawernavが開くのですが再度humburgerをクリックし、閉じようとすると、閉じないです試したことまず、現状の把握してほしい点をお伝えします。	2021-12-29 15:09:08
Linux	Ubuntuタグが付けられた新着投稿 - Qiita	Ubuntu上のEmacsにrbenvを認識させる設定	https://qiita.com/asobitone/items/147cc292188551c100b0	Ubuntu上のEmacsにrbenvを認識させる設定情報が古かったり断片的だったりするので、簡易的にまとめる。	2021-12-29 15:01:50
AWS	AWSタグが付けられた新着投稿 - Qiita	WEB家計簿アプリ構築[備忘録]	https://qiita.com/whalewhale/items/a56366c99f8556782575	家計簿	2021-12-29 15:03:57
Git	Gitタグが付けられた新着投稿 - Qiita	clocでgithub organizationの全てのリポジトリコード行をカウントする	https://qiita.com/uji_/items/dd8f99121a894539643f		2021-12-29 15:43:04
技術ブログ	Developers.IO	【初心者向け】AWS SAM を使ったら、ライブラリを含む Lambda 関数が2コマンドでデプロイできて便利だった	https://dev.classmethod.jp/articles/sam-lambda-with-library/	awssam	2021-12-29 06:49:12
海外TECH	DEV Community	How to choose a MongoDB shard key	https://dev.to/lazypro/how-to-choose-a-mongodb-shard-key-3c7d	How to choose a MongoDB shard keyIn this article I will show you what is the ideal pattern of a MongoDB shard key Although there is a good page on the MongoDB official manual it still not provides a formula to choose a shard key TL DRThe formula is coarselyAscending search I will explain the reason in the following sections User ScenarioIn order to well describe the formula I will use an example to illustrate the scenario There is a collection within application logs and the format is like id dfcf f ae cabcde type app level high ts msg Database crash Each log has the same template id is a UUID ts is an epoch and both type and level are a finite enumeration I will leverage the terminologies in the official manual to explain some incorrect designs Low Cardinality Shard KeyFrom the mentioned example we usually choose type at first sight Because we always use type to identify the logging scope However if we choose the type as the shard key it must encounter a hot spot problem Hot spot problem means there is a shard size much larger than others For example there are shards corresponding to types of logs app web and admin the most popular user is on app Therefore the shard size with app log will be very large Furthermore due to the low cardinality shard key the shards cannot be rebalanced anymore Ascending Shard KeyAlright if type cannot be the shard key how about ts We always search for the most recently logs and ts are fully uniform distributed it should be a proper choice Actually no When the shard key is an ascending data it works at the very first time Nevertheless it will result in a performance impact soon The reason is ts is always ascending so the data will always insert into the last shard The last shard will be rebalanced frequently Worst of all the query pattern used to search from the last shard as well i e the search will often be the rebalance period Random Shard KeyBased on the previous sections we know type level and ts all are not good shard key candidates Thus we can use id as the shard key so that we can spread the data evenly without frequent changes This approach will work fine when the data set is limited After the data set becomes huge the overhead of rebalance will be very high Because the data is random MongoDB has to random access the data while rebalancing On the other hand if the data is ascending MongoDB can retrieve the data chunks via the sequential access SolutionA good MongoDB shard key should be like coarselyAscending search In order to prevent the random access we choose the coarsely ascending data be the former This pick also won t meet the problem of frequently rebalancing And we put a search pattern on the latter to ensure the related data can be located at the same shard as much as possible In our example I will not only choose the shard key but also redesign our search pattern The ts is fine to address the log at the specific time however it is a bit inefficient for a time range query like from month ago til now Hence I will add one more key month in the document so we therefore can leverage the MongoDB date type and make a proper shard key The collection will be id dfcf f ae cabcde type app level high ts msg Database crash month new Date only month And the shard key is month type The key point here is we use month instead of ts to avoid frequently rebalaning The month is not made just for the shard key on the contrary we also use it for our search pattern Instead of calculating the relationship between timestamp and the date we can use getMonth to find results faster For instance var d new Date d setMonth d getMonth month agodb data find month gte d To sum up this article provides the concepts of designing MongoDB shard key You might not have a coarsely ascending data so but you can refer to the concepts and find out a proper key design for your applications	2021-12-29 06:40:36
海外TECH	DEV Community	Stop using Array.map() everywhere 🥵	https://dev.to/suprabhasupi/stop-using-arraymap-everywhere-57lf	Stop using Array map everywhere Most of the time I used to see the snippet like this const fruits apple orange cherry let text document getElementById main innerHTML text fruits map i gt text i In the above snippet we are adding fruits text to the DOM in main ID It seems there is no issue in the above snippet Though there is one major issue which we will be going see today Let s understand the issue by definition of map map method creates a new array populated with the results of calling a provided function on every element in the calling array example let n let add n map i gt i console log add NOTE Using map method means returning a new collection of an array As discussed map method always returns a new array so if you don t have any use of a new array then never use map method When you just need to iterate through an array I will always recommend using other array methods like forEach or for of example const fruits apple orange cherry let text fruits forEach myFunction document getElementById main innerHTML text function myFunction item index text index item lt br gt Why do we care about it As we know map method always returns an array If you just need to update DOM then storing those elements into memory form doesn t add any point Of course for a small chunk of numbers nothing is going to happen however if we take a larger number here then it affects the performance side as it will store the value in memory which will be redundant Summary ⅀Stop using map method if you just need to iterate through an array Start using forEach or for of method if you want to iterate through an array Thanks for reading the article ️Hope this post will be useful Twitter Ebooks Instagram	2021-12-29 06:38:59
海外TECH	DEV Community	Pardus 21'de tümü-rakam kullanıcı sorunu çözümü	https://dev.to/aciklab/pardus-21de-tumu-rakam-kullanici-sorunu-cozumu-4n4d	Pardus x de tümü rakam kullanıcısorunu çözümüGüncel GNU Linux işletim sistemlerinde Örneğin Pardus x veya RHEL x all numeric tümü rakam kullanıcıadlarında oluşan problemlerden dolayıözellikle systemd servisindeki güncelleştirmeler sonucunda tümü rakam kullanıcıoluşturulmasıengellenmiştir ve bir şekilde oluşturulmasıdurumunda çeşitli işlevselliklerde hatalar oluşmaktadır Sorunun belirlenmesiSorun en temel olarak sistemde kullanıcıeklenirken oluşmaktadır force badname olarak kullanıcıeklense bile systemd üzerindeki bazıservislerde problem oluşmaya devam etmektedir adduser Please enter a username matching the regular expression configuredvia the NAME REGEX configuration variable Use the force badname option to relax this check or reconfigure NAME REGEX Domain ortamlarında sorunun çözümüSorun tümü rakam kullanıcıisminden dolayıolduğu için sistemin sağlıklıçalışabilmesi için kullanıcıismi manipülasyonu gerekmektedir Kurumsal ortamda kullanıcıismi olarak aciklab lab şeklinde bir isim ile problem çözülmektedir Tabi ki bu süreçiçin daha öncesinde sistemin SSSD ile entegre olacak şekilde domaine alınmışolmasıgerekmektedir sssd conf kullanımıile kullanıcıadımanipülasyonuGirişyapacak kullanıcıisimleri için domain aciklab lab sekmesi altında aşağıdaki parametrenin eklenmesi gerekmektedir use fully qualified names TrueBu satırın eklenmesi sonrasında servisin yenilenmesi gerekecektir sudo systemctl restart sssd lightdm üzerinden kullanıcıadıile girişyapmakVarsayılan lightdm ayarlarında daha önce girişyapılmamışbilgisayarlarda kullanıcıgirişi sırasında sadece kullanıcıadıyerine aciklab lab kullanıcıadıile girişyapılmasıgerekmektedir İlk girişyaptıktan sonra tekrardan uzun isim yazmak gerekmemektedir Bunun için etc lightdm lightdm conf içerisinde aşağıdaki satırın true olmadığınetleşmelidir greeter hide users false	2021-12-29 06:30:36
海外TECH	DEV Community	10 Small Projects To Practice Html And CSS	https://dev.to/the_webdev_guy/10-small-projects-to-practice-html-and-css-42km	Small Projects To Practice Html And CSSHtml and CSS are the basic building blocks in front end development Having a good command in both of them can help to be a great front end developer Practicing different Project can help you to learn and grow These are Projects with attached tutorial Build Animated and Creative Our Teams SectionTutorial Link About Us SectionTutorial Link Accordion Create FAQ SectionTutorial Link Course Enrollment CardTutorial Link Newsletter Subscription FormTutorial Link Portfolio CardTutorial Link Preview ComponentsTutorial Link Pricing Cards For WebsiteTutorial Link Our Skills SectionTutorial Link Event RegistrationTutorial Link	2021-12-29 06:22:26
海外TECH	DEV Community	Blockchain Fundamentals, Cryptocurrencies and Open Source	https://dev.to/siddharth2016/blockchain-fundamentals-cryptocurrencies-and-open-source-2235	Blockchain Fundamentals Cryptocurrencies and Open Source OverviewThis article is divided into sections st section is about blockchain fundamentals nd section deals with the key features of building a blockchain mobile app rd section dives into cryptocurrency wallets available for us to use and th section outlines how the opensource is driving the blockchain revolution You can jump onto any section you like to read the order of reading these sections are not related Blockchain FundamentalsBlockchain technology is a constantly evolving secure and shared record keeping system in which each user has a copy of the data which can only be modified if all parties involved in a transaction agree This section examines the fundamentals of blockchain technology A Blockchain TransactionTo understand the fundamentals of the blockchain we need to understand how a transaction can be added to the existing blockchain This can be done by going through a few important steps as illustrated in the below figure Assume that user wants to send X amount of digital bitcoins to user User then initiates the transaction A transaction is initiated by user s node by first making it and then digitally signing it with its private key A transaction in a blockchain can reflect a range of actions A peer to peer PP network broadcasts the desired transaction to each individual computer or node Individual nodes receive the request and attempt to validate the transaction using cryptographic techniques The miner node is the final node in the validation chain These miner nodes are compensated in Bitcoin The verified blocks are now added to the blockchain network Hashing is used to connect these nodes The approved transactions are then recorded in a public ledger Transactions are completed and the ledger is updated after the block is added to an existing chain Cryptography Techniques Used in BlockchainHashing public private key mechanisms and digital signatures are the key cryptographic techniques used by the blockchain community In this case a hash feature is implemented to offer each user the opportunity to view the blockchain in its entirety Blockchain characteristically uses the SHA hashing algorithm Public private key pairs are used to gain access to the information and allow transactions Digital signatures are also used for multi signature contracts and digital wallets on the blockchain as well as to ratify transactions by signing them securely offline Working of A Blockchain NetworkIn a blockchain network each node holds a complete copy of the distributed ledger The four fields of a block in this network are the block number the data field the hash value and the nonce Miners adjust the value of nonce to make it a suitable number for hashing the value of a block A nonce is a random whole number that is a bit byte field that is changed by miners to make it an acceptable number for hashing the value of a block In addition the chain of blocks is generated by applying the hash of the previous block to the current block The previous block s hash is stored in the field prior Four zeros are used to begin the hash value This determines whether or not a block is valid Each new hash value is created by combining the old hash value the new transaction block and a nonce The hash cash difficulty factor is determined by the number of leading zeroes required in the hash output The difficulty is tweaked so that block production stays consistent at about one block per ten minutes The more difficult it is to alter the blockchain the tougher it is to overwrite the blockchain and double spend coins Winding UpBlockchain technology is widely accepted by a variety of businesses It has opened up a plethora of opportunities in the areas of healthcare finance accountancy and the online marketplace The adoption of blockchain technology is expected to grow manifold in the coming years offering quite a wide range of jobs for young aspirants Basics of Building a Blockchain AppA blockchain stores data in such a way that it is almost impossible to alter or hack it In this section we will go through the key features of the blockchain look at blockchain development platforms and view the steps in the blockchain mobile app development process Some Blockchain AppsWhile blockchain development began with cryptocurrencies it is no longer limited to them Blockchain applications have now gone beyond cryptocurrency and into a variety of other sectors As we all know the main benefit of blockchain technology is that it ensures maximum data transparency and security helping businesses and organisations save a significant amount of money on standard security methods The following are some useful blockchain apps Filament This is an excellent example of a blockchain based IoT app that uses blockchain data ledger systems to manage data processed by software and microchip hardware Several linked devices can communicate information over the blockchain and keep in sync with the help of the app KYC chain For many firms completing Know Your Customer KYC documentation is a must This simple and effective blockchain based program streamlines the entire process of handling client documentation across administrative and criminal databases in many nations BurstIQ BurstIQ is healthcare software that uses Big Data and blockchain technology to allow patients and doctors to share and collaborate on vital medical information Development PlatformsThere are more than two dozen blockchain development platforms A few of them are described below Multichain With this powerful platform developers can create and deploy private blockchains that can be used by a variety of businesses Hyperledger This distributed ledger technology is used to govern the connected ecosystem of things and supply chains This advanced blockchain platform has received a lot of acclaims Ethereum A versatile opensource blockchain technology Ethereum is commonly used for decentralised apps smart contracts and initial coin offerings ICOs EOS The EOS platform s goal is to create a reliable smart contract function It s also appropriate for modern businesses need for highly scalable and decentralised storage and hosting Blockchain systems are available in a wide range of sizes and shapes Determining which platform is better and more suitable for one s application needs might be confusing The solution is contingent on the desired capabilities and use cases Choosing the most appropriate platform The key to your project s success lies in determining the platform s character Platforms based on cryptocurrencies as well as those based on smart contracts are available Decide whether you need smart contracts or not You need to determine if your app needs smart contracts or not Selecting the consensus protocol The consensus protocol ensures that every new block added to the blockchain is the only version of the truth that all nodes in the blockchain agree on such as proof of stake proof of work proof of elapsed time and so on Choosing the cryptocurrency Another challenge is determining whether or not a cryptocurrency is required Selecting between a public and private network Based on the requirement you need to decide whether a public or a private network is needed Process of Blockchain Mobile App DevelopmentThere are mainly five stages in the blockchain app development process Identify the problem that the blockchain is required to solve To begin thoroughly examine the problem description and create a full report on it Consider whether you need to create a new app from scratch or if you can just integrate the blockchain into an existing one Select the best platform for the app Select the most appropriate platform for your project Determine if you need a smart contract app or a crypto transaction app as well as the type of network and consensus protocol you ll need Requirement analysis Begin by doing the requirement analysis and evaluating the app idea s requirements Do more brainstorming around the idea and if possible fine tune it Create a blueprint of the idea Try to develop the proof of concept that will put the entire app concept into a visual structure Development of the application Develop the application employing best practices Ensure to build a robust blockchain app Winding UpWe ve covered the basics of blockchain in this essay ーits main characteristics as well as several development platforms and stages for developing blockchain applications If you find the subject interesting you can delve deeper into it There are a variety of resources available on the Internet Cryptocurrency WalletsCryptocurrencies are getting entrenched in the global financial system slowly and steadily with certain companies using these to pay their employees too Hesitancy with respect to their use is slowly ebbing and you may run the risk of being behind the times if you don t stay updated on the latest trends in this domain This section lists the exchanges and wallets you should be aware of in case you want to buy or trade in cryptocurrencies Trends in CryptocurrenciesDue to the high potential for profit cryptocurrency trading is considered extremely lucrative particularly among the younger population Traditional stock market trading has a lot of restrictions and rules There are no such limitations in the case of cryptocurrencies and big profits can be produced immediately The crypto market in which crypto users trade various types of cryptocurrencies is also known as the cryptocurrency industry The price of a BitCoin BTC was less than one US dollar around years back when it was launched Today its price is more than US A few months ago its price touched around US proving it is a very attractive form of investment The market capitalisation of cryptocurrencies is around million US dollars with BitCoin ATMs located in different parts of the world as per a report from Statista Wallets and ExchangesCurrently there are a number of exchanges in the world that offer platforms and wallets for buying and trading cryptocurrencies These include Web based environments as well as apps for Android iPhone and other mobile phone platforms Crypto users can buy and sell different currencies that are legal tender around the world with ease on these sites The major worldwide crypto exchanges in the world that provide wallets and Web platforms for cryptocurrency trading are listed in the below figure In crypto exchanges pairings refer to the pairs of cryptocurrencies that are used to buy and sell such coins In the crypto world there are two types of exchanges and wallets ーcentralised and decentralised Centralized ExchangesThe centralised exchanges and wallets are owned by companies or corporate giants which record the complete Know Your Customer KYC details either through video KYC or paper based KYC Users can open accounts in these centralised exchanges and then trade in any cryptocurrency The below figure lists some centralized exchanges Decentralized ExchangesDecentralised exchanges are platforms on which the account is opened directly without any intermediate company and trading is done directly by the crypto users The below figure lists some decentralized exchanges Winding UpThe jury is out on the use of cryptocurrencies because these are sometimes used to circumvent the national money transfer system Some governments prohibit their use in order to prevent money laundering In order to incorporate the maximum benefits and features into a real world scenario the use of cryptocurrencies in any country demands legislation and procedures The benefits to society and the corporate sector might be substantial if cryptocurrencies are used for real time applications and e governance Open Source Blockchain RevolutionBlockchain is a disruptive technology that is changing the world in a variety of ways Cryptocurrencies are the most obvious example This section compares and contrasts this technique with opensource another revolutionary technology that has transformed software development Blockchain CharacteristicsImmutability A hallmark feature of blockchain is that it is incorruptible Data once saved in a block cannot be changed without breaking the chain Decentralisation Blockchain does not require a central authority to maintain the ledger All nodes in the network have a copy of the ledger that gets updated with every transaction Enhanced security Decentralisation and consensus mechanisms built into blockchain make it highly secure as every transaction has to be verified with proof of work Distributed The blockchain ledger is not a singular entity in the hands of a few instead it is a shared entity that is accessible and maintained by everyone in the network Transparency Every addition to the blockchain requires consensus from all nodes in the peer to peer network This makes every transaction transparent and public Open Source CharacteristicsTransparency The founding principle of open source is to make the source code of the project public This enhances the transparency of the project as every detail that goes into its development can be freely accessed by anyone Enhanced security Finding security loopholes in the software is way easier when the code is non proprietary and is publicly available This naturally enhances the security of the software or at the very least can help raise public awareness about the potential security related pitfalls Collaboration The primary purpose of open source software is to encourage other developers to collaborate and contribute to the development of the software This makes open source development by nature a community experience Modifiability Open source software can be modified and re distributed to solve different problems This is the case with Linux as its modified distributions are used in various different gadgets and computers Decentralisation One can argue that open source software is not inherently decentralised as making changes to the main project still requires the approval of the project moderator s and the owner s But if perceived from a different angle given that the source code can be modified and re distributed under proper licensing this gives the developer the autonomy to use the software as and how desired thus making the process decentralised Convergent EvolutionOpensource software and blockchain are two independent technologies with different themes and strategies for addressing different problems When we compare the attributes of blockchain to open source however we discover certain similarities In evolutionary biology the term convergent evolution refers to the occurrence in which animals from distinct time periods or epochs acquire similar characteristics This can be seen in molecular biology animal morphology and even plant morphology This holds true for technical breakthroughs as well We produce new technologies every day to address a wide range of problems nonetheless there are underlying patterns in the motivations that drive the creation of these technologies Winding UpBlockchain is new but open source technology has been around for a long time In my perspective the rise of open source technology has had a direct impact on the birth of blockchain Both technologies are focused on transferring power from a small number of people to a big number of people Both strive to increase product security and transparency while also promoting fairness and collaboration While the applications of open source and blockchain are diverse the motives for their creation are similar It is safe to assume that open source and blockchain share many characteristics in common and are hence the product of technological convergence Make sure to follow me to get regular updates or subscribe so that you never miss my upcoming articles ranging from Python to Computer Vision to Scala Just starting your Open Source Journey Don t forget to check Hello Open SourceWant to showcase your Python project or just out there to explore Check Awesome Python ReposWant to make a simple and awesome game from scratch Check out PongPongWant to your GitHub Profile README Check out Quote READMETill next time Namaste	2021-12-29 06:09:57
海外TECH	DEV Community	Big Data Open Source Frameworks	https://dev.to/siddharth2016/big-data-open-source-frameworks-3app	Big Data Open Source FrameworksBig Data is a term used to define large scale data sets that are too complex to be manipulated with basic DBMS Handling Big Data requires sophisticated hardware and software technologies Just as open source has been the primary reason for the Big Data revolution so has it been at the forefront of developing tools to counter the challenges that we face with the data And while there are hundreds of popular open source projects that are focused on Big Data management in this article we shall focus on the top three that caught my attention We shall discuss the Hadoop framework the Spark analytics engine and the Kafka framework Is Big Data Hard To Handle Almost of the Big Data we produce today is unstructured and there are no predefined models that it adheres to And there is no quick and easy way to access and analyse unstructured data Not only is Big Data unstructured but it is also extremely complex This means traversing through it requires advanced algorithms that are being run on top of grade A machinery and not everyone can afford that We have multiple sources from which we accrue data and there are no clean ways to integrate disparate data from so many sources With Big Data comes big mistakes Storing massive and complex data in a secure manner is a really daunting challenge It is also the need of the hour Since the beginning of the pandemic more people are stuck at home with their computers than ever before and cybercrime and data theft have gone up by Open Source Softwares HadoopDeveloped by the Apache Foundation Hadoop is a framework for Big Data management It uses distributed systems architecture which has the ability to store and easily access vast amounts of data While there are many different types of Big Data management solution software what makes Hadoop stands out are components HDFS MapReduce and YARN HDFS Hadoop Distributed File System The Hadoop Distributed File System HDFS is a powerful and dynamic tool that is efficient at handling Big Data HDFS breaks down Big Data into blocks and the default size of each block is MB This makes accessing data simple as the HDFS only has to access the specific block of data that the user is searching for HDFS is a resilient framework thanks to its replication methodology To maintain the accessibility of the data even when one of the distributed system blocks is down HDFS replicates that block data in a three fold fashion making it robust to avoid failures or inconsistency MapReduceStoring and accessing Big Data with all its complications and difficulties is still the easy part The real fun begins when we try to process Big Data MapReduce is exactly what it sounds like it maps the data followed by reducing it MapReduce takes the data as input and splits it into different parts It then maps each individual component within each part Then the data is shuffled and sorted into clusters of homogenous data The data is then reduced by integrating homogenous data and assigning IDs which give the smaller final output YARN Yet Another Resource Negotiator A Hadoop environment is constrained to the number of resources it has namely CPUs memory units storage space etc But since Hadoop is designed to be able to run multiple processes at the same time a mechanism for allocating resources is necessary to make sure there are no deadlocks and every task is accomplished in its desired time period Now YARN comes into play when a job requires the resources to run the application manager sends a request to the node manager to allocate the physical resources The node manager then sends the resources to the resource manager which assigns the physical resource to the client process SparkWhile HDFS MapReduce and YARN are the three major defining components of Hadoop the Hadoop ecosystem has more tools to offer when it comes to Big Data processing one such tool is Apache Spark Spark is one of the few tools in the industry that combines Big Data analytics tools with Machine Learning and AI Spark is times faster than MapReduce in processing data Spark computations are done in memory itself it has the ability to perform both batch processing real time processing of data Spark is also comparatively lightweight as most of it is written in Scala Following are the Spark components Spark CoreSpark SQLSpark StreamingSpark MLibSpark GraphX KafkaApache Kafka is a framework implementation of a software bus using stream processing If you break down an information transaction on the Internet it s essentially nothing but an exchange of information between systems which we sometimes call producers and consumers Each transaction can be thought of as integration between producer and consumer In order to simplify complex integrations Kafka acts as a broker between producer and consumer which can be well integrated with Hadoop and Spark Kafka consists of Brokers and a Zookeeper BrokerA broker is a Kafka server that runs in a Kafka cluster Each broker divides a unique transaction between the producer and consumer into a topic Now these topics within the broker are used to consume and broadcast the messages in an asynchronous fashion ZookeeperIn order to define topics and keep a metadata record of all the topics defined in the cluster Kafka uses Zookeeper which is a replicated distributed log with a file system API built on top It keeps a record of all the topics within all the nodes and also keeps track of which nodes are down and which are up and running Where To Go From Here The tools and frameworks discussed in this article are a high level overview of the innovation and efforts taking place in the Big Data management industry There are many more open source tools and frameworks that can be learned and used for Big Data management Google all the available resources and check which fits your Big Data management need to the point and become a Big Data Engineer one step at a time Books to check out more on Big Data Engineering Big Data SimplifiedBig Data Analytics Introduction to Hadoop Spark and Machine LearningBig Data and AnalyticsMake sure to follow me to get regular updates or subscribe so that you never miss my upcoming articles ranging from Python to Computer Vision to Scala Just starting your Open Source Journey Don t forget to check Hello Open SourceWant to showcase your Python project or just out there to explore Check Awesome Python ReposWant to make a simple and awesome game from scratch Check out PongPongWant to your GitHub Profile README Check out Quote READMETill next time Namaste	2021-12-29 06:08:46
海外TECH	DEV Community	Scala Vs Python Syntax Cheat Sheet	https://dev.to/siddharth2016/scala-vs-python-syntax-cheat-sheet-3d26	Scala Vs Python Syntax Cheat SheetThere are about million Python developers around the world and it s also the top programming language people want to learn but why is that Why not any other language but Python Let me tell you Python offers a lean learning curve with just days of hands on Python anyone can start developing applications they might not be technically sound software initially it s syntax is one of the easiest to learn due to its plain english like code it offers flexibility from both domains either object oriented or functional programming not so much FP but it has its benefits and it is used in almost every field of software engineering The only drawback people face when working with Python is related to its speed of executing programs But is there any other programming language as easy to understand and to get started to work with Yep there is Scala comes to the rescue Python faces speed issues mainly due to its interpreted nature whereas Scala is a compiled language that offers dynamic typing as well close to many new features in Python like pattern matching are already present in Scala since the beginning there are awesome syntactic sugars in Scala that allows us to write even less code when compared to Python and also Scala being a functional programming language does not shy away from object oriented programming as it is run over JVM When it comes to the syntax of these programming languages there are a lot of similar patterns and some differences as well but overall they both offer a lean learning curve with endless opportunities in the software engineering world So let s discuss those similarities and differences in the form of a cheat sheet which not only helps in refreshing some concepts from Python Scala but also acts as a guide to learn Python or Scala for someone coming from the Scala or Python background respectively This will be a to the point kind of article with little to no explanation but with necessary links wherever needed So let s get started How To Import In Python importing a library can look like this import math ORimport math pow ORfrom math import pow sqrt ORfrom math import sqrt as squareRootIn Scala importing a library can look like this import scala math ORimport scala math BigInt ORimport scala math BigInt BigDecimal ORimport scala math BigInt gt BInt How To Declare Variables Python offers dynamic typing so you don t need to declare variables beforehand like in C C but you can just type out the variables and use them some variable Scala also offers dynamic typing to some extent and infer that type during compile time val some variable infers it as Int type How To Define Conditionals In Python and Scala defining conditionals are more or less similar v if v print Odd elif v print Zero else print Even In Scala val v if v println Odd else if v println Zero else println Even The important thing to note in conditionals is that in Python conditionals are referred to as statements whereas in Scala these are expressions that evaluates to something or nothing How To Define Loops In Python a simple for loop would look like this for i in range do something hereThe same for loop in Scala would look like this for i lt until do something here The difference in their respective working behind the scenes in Scala is the use of conjunction of map and flatMap methods whereas in Python it is simple iteration There is a while loop in Scala but let s not discuss that while coding in Scala it is not encouraged to use while loops Why are while loops not recommended in Scala How To Write Methods In Python we can simply use the def keyword to define functions which are similar to methods in Scala def some method do something hereIn Scala we can define a method like def someMethod do something here To define functions in Scala we can use Function objects or their respective syntactic sugars To know more about functions and functional programming in Scala do check this How To Define Classes and Objects In Python we can define a class using the class keyword the same keyword can be used to define a class in Scala Whereas objects in Scala are singleton instances and similar to what we call static class in other programming languages A class however in Scala can be instantiated using the new keyword whereas in Python calling the class directly creates an instance for that In Python class Student def init self do something herestudent Student creates an instance of class StudentIn Scala class Studentval student new Student creates an instance of class Student use Object keyword for singleton objectsObject Studentval aParticularStudent StudentTo know more about classes and objects in Scala I recommend checking out this article MiscellaneousScala offers more advantages over Python namely traits and tail recursion Python does not offer tail recursive capabilities to its functions and suffers from stack overflow errors whenever functional programming goes wrong To know more about why python does not offer tail recursion you can read this article However there is a work around as described in this article using decorators Similarly Python does not have concepts like traits A trait is used to describe the quality of a class whereas in Python you would have to do multiple inheritances to get certain qualities or have to define certain methods within the class definition Trait allows loose coupling How to define a trait in Scala trait SomeQualityclass Student extends SomeQuality Wrap UpWell that wraps up this simple Scala Vs Python syntax cheat sheet What else would you add to this cheat sheet Please let me know in the comments If you are looking to sharpen your coding skills in Python or Scala then do consider buying these awesome books that go in depth to let you understand the semantics of the language For Python Python The BiblePython The Complete ReferenceAutomate The Boring Stuff With PythonPython BasicsFor Scala Scala For The ImpatientScala Programming ProjectsFunctional Programming in ScalaProgramming ScalaMake sure to follow me to get regular updates or subscribe so that you never miss my upcoming articles ranging from Python to Computer Vision to Scala Just starting your Open Source Journey Don t forget to check Hello Open SourceWant to showcase your Python project or just out there to explore Check Awesome Python ReposWant to make a simple and awesome game from scratch Check out PongPongWant to your GitHub Profile README Check out Quote READMETill next time Namaste	2021-12-29 06:06:48
海外TECH	DEV Community	Scala For Beginners - Crash Course - Part 5	https://dev.to/siddharth2016/scala-for-beginners-crash-course-part-5-4j4o	Scala For Beginners Crash Course Part Welcome to the th and last part of the Scala beginners crash course here we will go through the concepts like collections sequences and map flatmap filter in the Scala programming language This will be a short article so if you need much more in depth information you can check out the recommended books at the end of this article It will be a no nonsense to the point kind of article like part part part and part with all the necessary links wherever needed Without any further ado let s get started Before We StartBefore we start coding out first create a new object in the crashcourse package please go through part for more information on creating packages and objects Let s name it Collections like below Now we can start coding out the examples on this Scala application CollectionsScala offers sets of collections one is mutable and the other one is immutable Scala by default works with immutable collection objects But we can import mutable collection objects whenever needed like import scala collection mutableAlso if we want we can see all immutable collection objects in package scala collections immutable Following are some of the immutable collection objects provided in scala HashSetSortedSetVectorStringLikeRangeListStreamStackQueueHasMapSortedMapSimilar collection objects are available in the mutable set This link has all the mutable collection objects set The commonality between mutable and immutable collection objects is that both extends trait Traversable It is a base trait for all collections and offers a great variety of methods Some of these collection objects are often sequenced in nature Let s discuss sequences now SequencesSequences in scala are a general interface for data structures that have a well defined order and can be indexed These support various operations like apply iterator length reverse for indexing and iterating Concatenation appending prepending A lot of others grouping sorting zipping searching and slicing Let s see how to define a sequence Output Range is one of the sequences available we can define a Range like this Output There is another type of sequence LinearSeq which is an immutable linked list with the following properties Accessing head tail and using methods like isEmpty are fast and takes O time Most other operations like length or reverse takes O n time Arrays in scala are equivalent to java arrays these can be manually constructed with predefined lengths These can be mutated have fast indexing and are interoperable with java s arrays Vectors are also present in scala these are the default implementation for immutable sequences taking constant time for indexed based read write with fast append prepend shows good performance for large size vectors and are implemented using a fixed branched trie data structure Tuples are finite ordered kinds of lists that can contain a maximum of elements A tuple value data type is defined similarly to a function like TupleN There is one more collection object Map which is a key gt value pair data structure present in scala Following are some ways to manipulate a map Output More on Scala collections can be found here or you can check the books provided in the last section for the more detailed in depth working of collections map flatMap filter and forFinally on the most important part of functional programming that would become the daily need of a Scala programmer I wanted to include these in the previous part but to show how these work I needed to show collections in scala first now that we know enough about collections let s move on to these functions Note For the sake of examples I will be showing these operations on the List sequence you can try these on other collections as well First define our list collection like this What is the map method It allows a certain function to be applied to all the elements present in the given sequence and evaluates to a sequence of updated values What is the filter method It filters out the elements which do not meet a certain criterion defined as another function and evaluates to a sequence of filtered values What is the flatMap method This is identical to the map method but the only difference is that in flatMap the inner grouping of an item is removed and a sequence is generated So if flatMap is applied to a list then the generated output will be a list of lists changing the inner grouping of integer elements to a list and later flattening it What is the for loop in scala Yeah you read it right What is and not How to in scala writing a for loop is just a fancy way of writing a coupled map and flatMap methods A for loop in scala can be written as Output These are some important methods to remember while coding out in scala Wrap UpWell that wraps up part and the end of this crash course I hope it was something worth it for you as a reader and made you a scala enthusiast at the end of this course You can pick up any of the below books to master the art of programming in scala Scala For The ImpatientScala Programming ProjectsFunctional Programming in ScalaProgramming ScalaTo keep in touch you can follow me on here or subscribe to get the updates of the new blogs that I will write in the future or follow me on Twitter where I share my thoughts not only on programming but also on personal finance Make sure to follow me to get regular updates or subscribe so that you never miss my upcoming articles ranging from Python to Computer Vision to Scala Just starting your Open Source Journey Don t forget to check Hello Open SourceWant to showcase your Python project or just out there to explore Check Awesome Python ReposWant to make a simple and awesome game from scratch Check out PongPongWant to your GitHub Profile README Check out Quote READMETill next time Namaste	2021-12-29 06:04:32
海外TECH	DEV Community	Scala For Beginners - Crash Course - Part 4	https://dev.to/siddharth2016/scala-for-beginners-crash-course-part-4-1a9b	Scala For Beginners Crash Course Part Welcome to the th part of the scala beginners crash course here we will go through the concepts like options exception handling and pattern matching in the scala programming language This will be a short article so if you need much more in depth information you can check out the recommended books at the end of this article It will be a no nonsense to the point kind of article like part part and part with all the necessary links wherever needed Without further ado let s get started Before We StartBefore we start coding out first create a new object in the crashcourse package please go through part for more information on creating packages and objects Let s name it OptionErrorPattern like below Now we can start coding out examples on this scala application OptionsAn option is a wrapper for a value that might be present or not As the name suggests it evaluates to an option of values either Some or None when given an expression In this way when we are dealing with some unsafe APIs we can always wrap that API calls within an Option object to keep our program safe and error free that might otherwise result in a Null pointer kind of exception For example Output Some wraps a concrete value None is a singleton for absent values It is better to use Option in APIs that we are creating Handling ExceptionsIn scala exceptions are handled inside try catch blocks like below Output But it comes with its drawbacks Multiple Nested try catch blocks make the code hard to read follow We can not chain multiple operations prone to failure To overcome these limitations scala introduced a Try object that can act as a wrapper to wrap an error prone expression and evaluates to either a Success or a Failure as a result A Try is a wrapper for a computation that might fail or not It wraps failed computations as Failure and successful computations as Success To use Try Success and Failure objects we have to import these first import scala util Try Success Failure So the above method someErrorProneFunc can be used with Try as follows Output We can check if a Try is a Success or Failure using isSuccess or isFailure methods respectively We can use Try to handle exceptions for avoiding runtime crashes due to uncaught exceptions or just to avoid an endless amount of try catch blocks Pattern MatchingPattern matching is a mechanism for checking a value against a pattern A successful match can also deconstruct a value into its constituent parts It is a more powerful version of the switch statement in Java and it can likewise be used in place of a series of if else statements A match expression has a value the match keyword and at least one case clause For example Output Some important points to note on pattern matching It is used to decompose values Cases are matched in the order given What if there was no case that matched the pattern then it would result in MatchError Pattern matching works really well with case classes Wrap UpWell that wraps up part of this crash course I know it was a very short read my motivation was to keep it short and simple and be able to provide ample impetus to you to explore it further Take it as a challenge or homework explore advanced pattern matching how you can use Option in conjunction with Try it can do wonders to the API you are working on and in the comments mention what you know about on these concepts You can check these books to get more insights on these topics Scala For The ImpatientScala Programming ProjectsFunctional Programming in ScalaProgramming ScalaIn the next and last part of this crash course we will discuss the collections available in scala and most important of all the map flatmap and filter methods in scala Make sure to follow me to get regular updates or subscribe so that you never miss my upcoming articles ranging from Python to Computer Vision to Scala Just starting your Open Source Journey Don t forget to check Hello Open SourceWant to showcase your Python project or just out there to explore Check Awesome Python ReposWant to make a simple and awesome game from scratch Check out PongPongWant to your GitHub Profile README Check out Quote READMETill next time Namaste	2021-12-29 06:01:37
金融	JPX マーケットニュース	[東証]新規上場日の基準値段等：藤久ホールディングス（株）等2銘柄	https://www.jpx.co.jp/news/1030/20211229-01.html	新規上場	2021-12-29 16:00:00
海外ニュース	Japan Times latest articles	PCR testing centers in Tokyo busy with people returning home for New Year’s	https://www.japantimes.co.jp/news/2021/12/29/national/tokyo-pcr-testing-centers-busy/	PCR testing centers in Tokyo busy with people returning home for New Year sThe discovery of community acquired cases of the omicron variant in some parts of Japan have prompted many to undergo a PCR test before returning home	2021-12-29 15:40:02
海外ニュース	Japan Times latest articles	Hong Kong police raid pro-democracy media outlet and arrest six	https://www.japantimes.co.jp/news/2021/12/29/asia-pacific/hong-kong-police-raid-prodemocracy-media/	Hong Kong police raid pro democracy media outlet and arrest sixThe raid further raises concerns about the freedom of speech in the former British colony which returned to Chinese rule in with the promise	2021-12-29 15:29:28
海外ニュース	Japan Times latest articles	Can ‘miso drops’ save Japan’s small-scale miso breweries?	https://www.japantimes.co.jp/life/2021/12/29/food/can-miso-drops-save-japans-small-scale-miso-breweries/	Can miso drops save Japan s small scale miso breweries Consumption of miso has been on the decline with shoppers opting for mass produced versions of the traditional food Entrepreneur Motomi Takahashi wants to fix that	2021-12-29 15:10:08
北海道	北海道新聞	道内で２６人コロナ感染、札幌は１４人　１人死亡	https://www.hokkaido-np.co.jp/article/628675/	新型コロナウイルス	2021-12-29 15:15:00
ビジネス	東洋経済オンライン	USJが低迷→驚異的復活を遂げた最も重要な本質 最も困難なのは計画の策定や商圏の分析ではない | 企業経営･会計･制度 | 東洋経済オンライン	https://toyokeizai.net/articles/-/477045?utm_source=rss&utm_medium=http&utm_campaign=link_back	東洋経済オンライン	2021-12-29 15:30:00
海外TECH	reddit	Company is asking us to buy CEO's book-2	https://www.reddit.com/r/japanlife/comments/rr1bmf/company_is_asking_us_to_buy_ceos_book2/	Company is asking us to buy CEO x s book It s happened again The CEO has now another book that he wants us to buy We received an email with a link to an excel on the company s network It s a list of all employees names and we are told to put a tick next to our name and the money will come off our next paycheck This time there s no mention of being able to purchase it off Amazon Aaaaand guess what s worse This time we need to give a reason if we cannot purchase the book This is borderline power harassment right This has got to be a compliance issue right Does anyone have any creative ideas as to what I should write as a reason Because hell I m not buying it submitted by u Waterlemon Pug to r japanlife link comments	2021-12-29 06:26:55
ニュース	THE BRIDGE	ナッジ：ミレニアル向け次世代型提携クレジットカードを発行【BRIDGE Tokyoノミネート企業紹介】	https://thebridge.jp/2021/12/bridge-tokyo-2022-intro-showcase-nominee-nudge	ナッジミレニアル向け次世代型提携クレジットカードを発行【BRIDGETokyoノミネート企業紹介】本稿はBRIDGETokyoの企画をご紹介いたします。	2021-12-29 06:00:46