| Part of a serieson |
| Translation |
|---|
 |
| Types |
| Theory |
| Technologies |
| Localization |
| Institutional |
| Related topics |
|
|
|
Google Neural Machine Translation (GNMT) was a neural machine translation (NMT) system developed by Google and introduced in November 2016 that used an artificial neural network to increase fluency and accuracy in Google Translate.[1][2][3][4] The neural network consisted of two main blocks, an encoder and a decoder, both of LSTM architecture with 8 1024-wide layers each and a simple 1-layer 1024-wide feedforward attention mechanism connecting them.[4][5] The total number of parameters has been variously described as over 160 million,[6] approximately 210 million,[7] 278 million[8] or 380 million.[9] By 2020, the system had been replaced by another deep learning system based on transformers.[10]
GNMT improved on the quality of translation by applying an example-based (EBMT) machine translation method in which the system learns from millions of examples of language translation.[2] GNMT's proposed architecture of system learning was first tested on over a hundred languages supported by Google Translate.[2] With the large end-to-end framework, the system learns over time to create better, more natural translations.[1] GNMT attempts to translate whole sentences at a time, rather than just piece by piece.[1] The GNMT network can undertake interlingual machine translation by encoding the semantics of the sentence, rather than by memorizing phrase-to-phrase translations.[2][11]
The Google Brain project was established in 2011 in the "secretive Google X research lab"[12] by Google Fellow Jeff Dean, Google Researcher Greg Corrado, and Stanford University Computer Science professor Andrew Ng.[13][14][15] Ng's work has led to some of the biggest breakthroughs at Google and Stanford.[12]
In November 2016, Google Neural Machine Translation system (GNMT) was introduced. Since then, Google Translate began using neural machine translation (NMT) in preference to its previous statistical methods (SMT)[1][16][17][18] which had been used since October 2007, with its proprietary, in-house SMT technology.[19][20]
Training GNMT was a big effort at the time and took, by a 2021 OpenAI estimate, on the order of 100 PFLOP/s*day (up to 1022 FLOPs) of compute which was 1.5 orders of magnitude larger than Seq2seq model of 2014[21] (but about 2x smaller than GPT-J-6B in 2021[22]).
Google Translate's NMT system uses a large artificial neural network capable of deep learning.[1][2][3] By using millions of examples, GNMT improves the quality of translation,[2] using broader context to deduce the most relevant translation. The result is then rearranged and adapted to approach grammatically based human language.[1] GNMT's proposed architecture of system learning was first tested on over a hundred languages supported by Google Translate.[2] GNMT did not create its own universal interlingua but rather aimed at finding the commonality between many languages using insights from psychology and linguistics.[23] The new translation engine was first enabled for eight languages: to and from English and French, German, Spanish, Portuguese, Chinese, Japanese, Korean and Turkish in November 2016.[24] In March 2017, three additional languages were enabled: Russian, Hindi and Vietnamese along with Thai for which support was added later.[25][26] Support for Hebrew and Arabic was also added with help from the Google Translate Community in the same month.[27] In mid April 2017 Google Netherlands announced support for Dutch and other European languages related to English.[28] Further support was added for nine Indian languages: Hindi, Bengali, Marathi, Gujarati, Punjabi, Tamil, Telugu, Malayalam and Kannada at the end of April 2017.[29]
By 2020, Google had changed methodology to use a different neural network system based on transformers, and had phased out NMT.[30]
The GNMT system was said to represent an improvement over the former Google Translate in that it will be able to handle "zero-shot translation", that is it directly translates one language into another (for example, Japanese to Korean).[2] Google Translate previously first translated the source language into English and then translated the English into the target language rather than translating directly from one language to another.[11]
A July 2019 study in Annals of Internal Medicine found that "Google Translate is a viable, accurate tool for translating non–English-language trials". Only one disagreement between reviewers reading machine-translated trials was due to a translation error. Since many medical studies are excluded from systematic reviews because the reviewers do not understand the language, GNMT has the potential to reduce bias and improve accuracy in such reviews.[31]
As of December 2021, all of the languages of Google Translate support GNMT, with Latin being the most recent addition.
{{cite journal}}: Cite journal requires |journal= (help)
|
Approaches to machine translation
| |
|---|---|
|
|
| |||
|---|---|---|---|
| Fields |
| ||
| Topics |
| ||
| |||
|
| |||||
|---|---|---|---|---|---|
| General terms |
| ||||
| Text analysis |
| ||||
| Automatic summarization |
| ||||
| Machine translation |
| ||||
| Distributional semantics models |
| ||||
| Language resources, datasets and corpora |
| ||||
| Automatic identification and data capture |
| ||||
| Topic model |
| ||||
| Computer-assisted reviewing |
| ||||
| Natural language user interface |
| ||||
| Related |
| ||||
