Natural language processing

Natural language processing (NLP) is a field of computer science that studies how computers and humans interact. In the 1950s, Alan Turing published an article that proposed a measure of intelligence, now called the Turing test. More modern techniques, such as deep learning, have produced results in the fields of language modeling, parsing, and natural-language tasks.

What does this PR do?

Adding a Dataset

Name: Stanford dog dataset
Description: The dataset is about 120 classes for a total of 20.580 images. You can find the dataset here http://vision.stanford.edu/aditya86/ImageNetDogs/
Paper: http://vision.stanford.edu/aditya86/ImageNetDogs/
Data: *[link to the Github repository or current dataset location](http://vision.stanford.edu/aditya86/Ima

In gensim/models/fasttext.py:

    model = FastText(
        vector_size=m.dim,
        vector_size=m.dim,
        window=m.ws,
        window=m.ws,
        epochs=m.epoch,
        epochs=m.epoch,
        negative=m.neg,
        negative=m.neg,
        # FIXME: these next 2 lines read in unsupported FB FT modes (loss=3 softmax or loss=4 onevsall,
        # or model=3 supervi

Is your feature request related to a problem? Please describe.
I typically used compressed datasets (e.g. gzipped) to save disk space. This works fine with AllenNLP during training because I can write my dataset reader to load the compressed data. However, the predict command opens the file and reads lines for the Predictor. This fails when it tries to load data from my compressed files.

Checking the Python files in NLTK with "python -m doctest" reveals that many tests are failing. In many cases, the failures are just cosmetic discrepancies between the expected and the actual output, such as missing a blank line, or unescaped linebreaks. Other cases may be real bugs.

If these failures could be avoided, it would become possible to improve CI by running "python -m doctest" each t

Jun	JUL	Aug
	07
2021	2022	2023

Natural language processing

Here are 19,460 public repositories matching this topic...

huggingface / transformers

What does this PR do?

apachecn / ailearning

google-research / bert

hankcs / HanLP

explosion / spaCy

oxford-cs-deepnlp-2017 / lectures

RasaHQ / rasa

huggingface / datasets

Adding a Dataset

keon / awesome-nlp

virgili0 / Virgilio

RaRe-Technologies / gensim

bharathgs / Awesome-pytorch-list

NLP-LOVE / ML-NLP

flairNLP / flair

graykode / nlp-tutorial

allenai / allennlp

ml-tooling / best-of-ml-python

nltk / nltk

spencermountain / compromise

chiphuyen / stanford-tensorflow-tutorials

botpress / botpress

ashishpatel26 / 500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code

stanfordnlp / CoreNLP

sloria / TextBlob

PaddlePaddle / PaddleHub

brightmart / text_classification

ymcui / Chinese-BERT-wwm

brightmart / nlp_chinese_corpus

crownpku / Awesome-Chinese-NLP

dair-ai / ML-YouTube-Courses