python |
Pythonタグが付けられた新着投稿 - Qiita |
英日翻訳器を環境構築なしで10分程度で作ってみた |
https://qiita.com/nymwa/items/2f39a34982aa9d71f10d
|
英日翻訳器を環境構築なしで分程度で作ってみたやること英日翻訳器を作りますところでデータを頑張って集めていろいろな処理をして学習するというのを全部自分で作ろうとするととても大変ですしかもニューラルネットを使った機械翻訳システムの学習には一般に十分な計算リソースや計算時間が必要となります今回はそういう面倒な思いをしなくても英日翻訳器を作れる方法を紹介しますこの記事で用いるコードはGitHubGistでも公開しましたこのリンクを開いてOpeninColabを押せば実際に翻訳器を学習して実行することができますぜひどうぞ環境GoogleColaboratory上であれば環境構築をする必要はありません実行する際にはランタイムgtランタイムのタイプを変更のハードウェアアクセラレータがGPUになるように気をつけてください自分で環境構築をする場合はPythonとCUDAが動くようにしてくださいデータの入手と前処理データにはtatoebaorgにある英語と日本語の並行コーパスを用いますデータはすぐに使えるように予めフィルタリングトークン化小文字化の前処理を施したものを用います用意したデータはこちらから見れます英文のトークン化にはSacremoses日本語はGiNZAを用いていますさらにトークン数がでない文英文日本語文トークン数比率がでない文重複する文低頻度な語彙を含む文を取り除いています前処理をしたデータは以下のようになっていますiwasbusybutihelpedmother私は忙しかったが母の手伝いをしました。 |
2021-07-18 01:31:01 |
Program |
[全てのタグ]の新着質問一覧|teratail(テラテイル) |
SliderからToggleを連動 |
https://teratail.com/questions/350022?rss=all
|
SliderからToggleを連動前提・実現したいこと空調をつけるためのアプリを開発しようと考えています。 |
2021-07-18 01:52:09 |
海外TECH |
DEV Community |
What are Cookies? |
https://dev.to/amanchourasia/what-are-cookies-4064
|
What are Cookies What are Cookies this question has become ubiquitous ever since GDPR came into effect Cookies have been of great importance in the tech industry since the advent of the digital world However now the scenario is changing and the reliance upon cookie based information is about to fade as Google s decision to phase out cookies will take effect in less than a year But before publishers start to look for other solutions it is equally important for them to understand how cookies have been functioning What are Cookies Cookies are small text files sent from the website to the person s terminal usually the browser where they are stored before being transmitted again on the same website visited by the same user A cookie cannot retrieve any other data from the user s hard drive nor pass on computer viruses or capture email addresses Each single cookie is unique to the user s web browser Some of the cookies functions can be transferred to other technologies In this document the term cookie refers to both cookies as such as well as all similar technologies What are Cookies Different Types of Web CookiesRead More |
2021-07-17 16:44:23 |
海外TECH |
DEV Community |
5 ultimate resources for git #1 |
https://dev.to/codeozz/5-ultimate-resources-for-git-1-20al
|
ultimate resources for git Welcome my friend I will share with you some important resource that will improve your skill in git or teach you about git If you don t know git it s very important for every developer to control it At least know the basic Basic git Check the basic command of git with this If you want to learn git very fast with animation I recommend you this To be honest this is thanks to this that I learn git if you need only one resource take this Commands cheatlist When you have the basic you will need to learn a lot of command be happy with this clean list of common amp important git commands Available in a lot of language For people that use oh my zsh you can easily use git command alias that can be very useful For exemple you can use gcmsg instead of git commit m Make good and correct git commit message It s important to make correct git commit message if you work in other dev you should have some convention name if it s not the case i recommend you to read the article bellow and use convention name ASAP |
2021-07-17 16:27:42 |
海外TECH |
DEV Community |
Discovering JavaScript: The JavaScript Engine & Runtime |
https://dev.to/bhattpawan/discovering-javascript-the-javascript-engine-runtime-5hia
|
Discovering JavaScript The JavaScript Engine amp RuntimeHey fellow developers so as I started learning JavaScript I came across some really important topics that every JavaScript developer must know So in the Discovering JavaScript series I will be covering these important topics So without any further delay let s jump right in What is a JavaScript Engine JavaScript Engine is nothing but a program that executes JavaScript code Every browser has its own JavaScript engine Some of the well known JavaScript engines are V SpiderMonkey Chakra etc Components of a JavaScript EngineEvery JavaScript Engine has two components The Call Stack It is the portion of JavaScript Engine where our code is actually executed The Heap The heap section of JavaScript Engine is a memory pool that stores all the objects which out application needs Below is a diagram to depict the same How is the code compiled to Machine Code JavaScript uses Just in time compilation technique to execute the code which mainly consists of converting all of the code into machine code at once and then executing the code immediately So it is a hybrid between compilation and interpretation both the concepts are explained in detail later For now just note that in compilation all the code is converted into machine code at once and is then executed later when needed However in interpretation the interpreter converts and executes each line of code simultaneously Below diagram illustrates the just in time execution procedure Steps involved in Just In Time Compilation of JavaScriptFollowing are the steps involved in JavaScript s JIT compilation when any piece of JS code executes in JavaScript Engine Parsing Parsing means reading the code During this process the code is parsed and converted to a AST Abstract Syntax Tree This is done by splitting the code into small meaningful pieces and then saving them all in the form of a tree This is the step where syntactical errors are checked This AST is later used to generate the machine code Compilation In this step the generated AST is compiled to a machine code Execution The generated machine code is executed immediately Below figure depicts the process Bonus What is the difference between Compilation and Interpretation Both Compilation and Interpretation convert our source code to machine code however the way in which they do it differs So here goes the detailed explanation for the same Compilation In compilation the entire source code is converted into machine code at once and is written into a file that can be executed by the computer After the file is created there is no need of the source code to run the code the file created after compilation is used for running the code In case of compilation the code execution can take place way after the code has been compiled For instance when we run any application on our system the file we run is actually an executable file that is made after compiling the source code required to perform the operation which our application is performing Also you don t even know when the file say the exe file was actually compiled It may have been compiled an year ago but still can be executed after such a long time The below diagram explains compilation process Interpretation An Interpreter works differently as compared to a compiler Instead of compiling all the code at once it executes the source code line by line So that means we do not have any concept of intermediate file creation here Simply put forward it just takes the source code one line at a time and executes the code i e performs the function that the code is suppose to perform So in interpretation we will require the source code every time we need to run our code Following is the diagram of how a interpretation works So that s pretty much it about the JavaScript Engine amp Runtime We will cover more such interesting topics in upcoming blogs Stay Safe amp Happy Learning |
2021-07-17 16:25:33 |
ニュース |
BBC News - Home |
Health Secretary Sajid Javid tests positive for Covid |
https://www.bbc.co.uk/news/uk-57874744
|
covidhe |
2021-07-17 16:06:19 |
ニュース |
BBC News - Home |
Hottest NI day ever as temperatures soar above 30C |
https://www.bbc.co.uk/news/uk-northern-ireland-57875732
|
degrees |
2021-07-17 16:28:56 |
ニュース |
BBC News - Home |
Covid: Sunshine in Wales puts indoor meet-ups on hold |
https://www.bbc.co.uk/news/uk-wales-57875082
|
indoor |
2021-07-17 16:19:56 |
ニュース |
BBC News - Home |
Trains cancelled as firefighters tackle Troon station blaze |
https://www.bbc.co.uk/news/uk-scotland-glasgow-west-57874972
|
scotrail |
2021-07-17 16:41:56 |
ニュース |
BBC News - Home |
British Grand Prix: Max Verstappen wins sprint qualifying to claim pole position for race |
https://www.bbc.co.uk/sport/formula1/57875745
|
British Grand Prix Max Verstappen wins sprint qualifying to claim pole position for raceRed Bull s Max Verstappen will start the British Grand Prix from pole position after winning Formula s new trial sprint race |
2021-07-17 16:08:24 |
ニュース |
BBC News - Home |
St Helens beat Castleford to win Challenge Cup for first time in 13 years |
https://www.bbc.co.uk/sport/rugby-league/57828390
|
challenge |
2021-07-17 16:32:04 |
ニュース |
BBC News - Home |
Van Aert wins penultimate stage as Pogacar set for Tour de France victory |
https://www.bbc.co.uk/sport/cycling/57855539
|
Van Aert wins penultimate stage as Pogacar set for Tour de France victoryTadej Pogacar is set to win the Tour de France after finishing seventh in the time trial on the penultimate stage which was win by Wout van Aert |
2021-07-17 16:50:37 |
ニュース |
BBC News - Home |
Covid-19 in the UK: How many coronavirus cases are there in my area? |
https://www.bbc.co.uk/news/uk-51768274
|
cases |
2021-07-17 16:24:41 |
ビジネス |
ダイヤモンド・オンライン - 新着記事 |
なぜ名門ブラウン大学卒のブリタニーは、レンタフレンドの仕事をすることになったのか? - THE LONELY CENTURY なぜ私たちは「孤独」なのか |
https://diamond.jp/articles/-/277017
|
thelonelycentury |
2021-07-18 01:55:00 |
北海道 |
北海道新聞 |
英の新規感染、2日連続5万人超 政府発表 |
https://www.hokkaido-np.co.jp/article/568366/
|
新型コロナウイルス |
2021-07-18 01:02:00 |
IT |
週刊アスキー |
エキシビジョンマッチも公開!新作ガンダムFPS「GUNDAM EVOLUTION」発表会がアツかった |
https://weekly.ascii.jp/elem/000/004/063/4063046/
|
gundamevolution |
2021-07-18 01:40:00 |
コメント
コメントを投稿