natural-language-processing

Natural language processing (NLP) is a field of computer science that studies how computers and humans interact. In the 1950s, Alan Turing published an article that proposed a measure of intelligence, now called the Turing test. More modern techniques, such as deep learning, have produced results in the fields of language modeling, parsing, and natural-language tasks.

huggingface/transformers#12276 introduced a new --log_level feature, which now allows users to set their desired log level via CLI or TrainingArguments.

run_translation.py was used as a "model" for other examples.

Now we need to replicate this to all other Trainer-based examples under examples/pytorch/, the 3 changes are

importing datasets
using `training

Change tensor.data to tensor.detach() due to
pytorch/pytorch#6990 (comment)
tensor.detach() is more robust than tensor.data.

In gensim/models/fasttext.py:

    model = FastText(
        vector_size=m.dim,
        vector_size=m.dim,
        window=m.ws,
        window=m.ws,
        epochs=m.epoch,
        epochs=m.epoch,
        negative=m.neg,
        negative=m.neg,
        # FIXME: these next 2 lines read in unsupported FB FT modes (loss=3 softmax or loss=4 onevsall,
        # or model=3 supervi

Is your feature request related to a problem? Please describe.
I typically used compressed datasets (e.g. gzipped) to save disk space. This works fine with AllenNLP during training because I can write my dataset reader to load the compressed data. However, the predict command opens the file and reads lines for the Predictor. This fails when it tries to load data from my compressed files.

@lhoestq

Hi
Wikiann dataset needs to have "spans" columns, which is necessary to be able to use this dataset, but this column is missing from huggingface datasets, could you please have a look? thank you @lhoestq

Hello spoooopyyy hackers 🎃

This is a Hacktoberfest only issue! 👻

This is also data-sciency!

The Problem

Our English dictionary contains words that aren't English, and does not contain common English words.

Examples of non-common words in the dictionary:

"hlithskjalf",
  "hlorrithi",
  "hlqn",
  "hm",
  "hny",
  "ho",
  "hoactzin",
  "hoactzine

May	JUN	Jul
	23
2020	2021	2022

natural-language-processing

Here are 7,838 public repositories matching this topic...

huggingface / transformers

google-research / bert

GokuMohandas / MadeWithML

d2l-ai / d2l-zh

hankcs / HanLP

explosion / spaCy

sebastianruder / NLP-progress

oxford-cs-deepnlp-2017 / lectures

ShusenTang / Dive-into-DL-PyTorch

RaRe-Technologies / gensim

keon / awesome-nlp

bharathgs / Awesome-pytorch-list

RasaHQ / rasa

flairNLP / flair

eugeneyan / applied-ml

allenai / allennlp

d2l-ai / d2l-en

chiphuyen / stanford-tensorflow-tutorials

nltk / nltk

kmario23 / deep-learning-drizzle

hanxiao / bert-as-service

graykode / nlp-tutorial

huggingface / datasets

stanfordnlp / CoreNLP

clips / pattern

ludwig-ai / ludwig

sloria / TextBlob

Ciphey / Ciphey

The Problem

lazyprogrammer / machine_learning_examples

PaddlePaddle / models