The Wayback Machine - http://web.archive.org/web/20200824223404/https://github.com/topics/transformer

#

transformer

Here are 748 public repositories matching this topic...

graykode / nlp-tutorial

Star

Natural Language Processing Tutorial for Deep Learning Researchers

nlp natural-language-processing tutorial tensorflow paper pytorch transformer attention bert

Updated Aug 15, 2020
Jupyter Notebook

google / trax

Star

Trax — Deep Learning with Clear Code and Speed

machine-learning reinforcement-learning deep-learning numpy deep-reinforcement-learning transformer jax

Updated Aug 24, 2020
Python

codertimo / BERT-pytorch

Star

Open

chooses 15% of token

1

makcedward commented Feb 22, 2019

From paper, it mentioned

Instead, the training data generator chooses 15% of tokens at random, e.g., in the sentence my
dog is hairy it chooses hairy.

It means that 15% of token will be choose for sure.

From https://github.com/codertimo/BERT-pytorch/blob/master/bert_pytorch/dataset/dataset.py#L68,
for every single token, it has 15% of chance that go though the followup procedure.

Read more

good first issue

Open

PositionalEmbedding

2

Open

Question about the loss of Masked LM

4

Kyubyong / transformer

Star

A TensorFlow Implementation of the Transformer: Attention Is All You Need

translation transformer implementation attention-mechanism attention-is-all-you-need

Updated Feb 14, 2020
Python

openai / jukebox

Star

Code for the paper "Jukebox: A Generative Model for Music"

audio music paper pytorch transformer generative-model vq-vae

Updated Jul 4, 2020
Python

xmuSistone / ViewpagerTransition

Star

viewpager with parallax pages, together with vertical sliding (or click) and activity transition

parallax transition viewpager transformer

Updated May 3, 2017
Java

Morizeyao / GPT2-Chinese

Star

Chinese version of GPT2 training code, using BERT tokenizer.

nlp text-generation transformer chinese gpt-2

Updated Aug 17, 2020
Python

posthtml / posthtml

Star

PostHTML is a tool to transform HTML/XML with JS plugins

html parser xml transformer html-parser xml-parser posthtml

Updated Aug 22, 2020
JavaScript

bentrevett / pytorch-seq2seq

Star

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

tutorial pytorch transformer lstm gru rnn seq2seq attention neural-machine-translation sequence-to-sequence encoder-decoder pytorch-tutorial pytorch-tutorials encoder-decoder-model pytorch-implmention pytorch-nlp torchtext pytorch-implementation pytorch-seq2seq cnn-seq2seq

Updated Jun 1, 2020
Jupyter Notebook

huggingface / pytorch-openai-transformer-lm

Star

🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI

pytorch transformer openai neural-networks language-model

Updated Feb 7, 2019
Python

awslabs / sockeye

Star

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

machine-learning deep-neural-networks translation deep-learning mxnet machine-translation transformer seq2seq neural-machine-translation sequence-to-sequence gluon attention-mechanism encoder-decoder attention-model sequence-to-sequence-models attention-alignment-visualization attention-is-all-you-need sockeye transformer-architecture transformer-network

Updated Aug 24, 2020
Python

microsoft / DialoGPT

Star

Large-scale pretraining for dialogue

machine-learning dialogue text-generation pytorch transformer data-processing text-data gpt-2 dialogpt

Updated Jul 29, 2020
Python

yangjianxin1 / GPT2-chitchat

Star

GPT2 for Chinese chitchat/用于中文闲聊的GPT2模型(实现了DialoGPT的MMI思想)

nlp text-generation transformer gpt-2 gpt2 dialogpt chichat dialogue-model

Updated May 16, 2020
Python

MikaelZero / mojito

Star

微信、bilibili大图、长图、gif、视频、自定义view的转场效果

android video drag gif transformer longimage photoview bigimageviewer dragimageview dragvideo

Updated Jul 15, 2020
Java

Separius / BERT-keras

Star

Keras implementation of BERT with pre-trained weights

nlp theano tensorflow keras language-modeling transformer transfer-learning pretrained-models

Updated Jul 26, 2019
Python

wajahatkarim3 / EasyFlipViewPager

Star

📖 The library for creating book and card flip animations in ViewPager in Android

android animation transformations android-library viewpager transformer flip pagetransformer page-transformer pageflip flip-animation viewpager-transformer viewpagertransformer

Updated May 12, 2020
Java

flugger / laravel-responder

Star

A Laravel Fractal package for building API responses, giving you the power of Fractal with Laravel's elegancy.

api laravel lumen fractal transformer responder

Updated Aug 10, 2020
PHP

GaoQ1 / rasa_chatbot_cn

Star

building a chinese dialogue system based on the newest version of rasa(基于最新版本rasa搭建的对话系统)

python demo tensorflow policy rasa-nlu transformer chinese rasa bert slot-filling intent-classification rasa-core rasa-nlu-gao rasa-chatbot train-dialogue rasa-x

Updated Jun 21, 2020
Python

kpe / bert-for-tf2

Star

A Keras TensorFlow 2.0 implementation of BERT, ALBERT and adapter-BERT.

tensorflow keras transformer bert

Updated Jul 30, 2020
Python

Tencent / TurboTransformers

Star

Open

How can I participate in this project?

3

lsy641 commented May 15, 2020

Hi, I am so interesting in your project, and wonder if you need contributor and how could I make my own contribution?

Read more

good first issue

Open

只支持huggingface训练的tensorflow模型载入么？

4

yuanxiaosc / BERT_Paper_Chinese_Translation

Star

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 论文的中文翻译 Chinese Translation!

paper transformer chinese-translation paper-translate bert

Updated Jun 1, 2020

geftimov / android-viewpager-transformers

Star

A collection of view pager transformers

android animation viewpager transformer android-viewpager-transformers pager-transformers

Updated May 30, 2017
Java

qiaoguan / deep-ctr-prediction

Star

CTR prediction models based on deep learning(基于深度学习的广告推荐CTR预估模型)

afm transformer resnet recommendation recommendation-algorithms ctr-prediction ctr recommendation-algorithm factorization-machine deepfm xdeepfm deep-ctr ad-algorithm esmm deep-cross deep-interest-network fibinet

Updated Nov 15, 2019
Python

woutervh- / typescript-is

Star

typescript runtime transformer type-check

Updated Jul 16, 2020
TypeScript

lvapeab / nmt-keras

Star

Neural Machine Translation with Keras

machine-learning theano deep-learning tensorflow machine-translation keras decoding transformer gru neural-machine-translation sequence-to-sequence score nmt newer attention-mechanism web-demo attention-model lstm-networks attention-is-all-you-need attention-seq2seq nmt-keras

Updated Jul 3, 2020
Python

kaituoxu / Speech-Transformer

Star

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

end-to-end pytorch transformer attention asr attention-is-all-you-need self-attention

Updated May 7, 2020
Python

cedrickchee / awesome-bert-nlp

Star

A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.

nlp natural-language-processing transformer neural-networks awesome-list transfer-learning language-model attention-mechanism bert gpt-2 xlnet pre-trained-language-models gpt-3

Updated Jul 29, 2020

ricsinaruto / Seq2seqChatbots

Star

A wrapper around tensor2tensor to flexibly train, interact, and generate data for neural chatbots.

wrapper tensorflow chatbot dialog dataset transformer conversation neural-networks seq2seq tensor2tensor

Updated May 13, 2020
Python

kristerkari / react-native-svg-transformer

Star

Import SVG files in your React Native project the same way that you would in a Web application.

svg react-native loader transformer react-native-svg

Updated Jul 23, 2020
JavaScript

subho406 / OmniNet

Star

Official Pytorch implementation of "OmniNet: A unified architecture for multi-modal multi-task learning" | Authors: Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain

nlp machine-learning deep-learning neural-network artificial-intelligence transformer image-captioning video-recognition multimodal-learning multitask-learning

Updated Jul 24, 2019
Python

Improve this page

Add a description, image, and links to the transformer topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the transformer topic, visit your repo's landing page and select "manage topics."

You can’t perform that action at this time.