Skip to content Skip to sidebar Skip to footer
Showing posts with the label Nlp

Query Data Dimension Must Match Training Data Dimension

I'm developing a tweet classifier. I trained a knn clasiffier with a a tfidf dataset in which e… Read more Query Data Dimension Must Match Training Data Dimension

How Do I Count All Occurrences Of A Phrase In A Text File Using Regular Expressions?

I am reading in multiple files from a directory and attempting to find how many times a specific ph… Read more How Do I Count All Occurrences Of A Phrase In A Text File Using Regular Expressions?

How To Do Text Pre-processing Using Spacy?

How to do preprocessing steps like Stopword removal , punctuation removal , stemming and lemmatizat… Read more How To Do Text Pre-processing Using Spacy?

Fine-tune Bert For Specific Domain (unsupervised)

I want to fine-tune BERT on texts that are related to a specific domain (in my case related to engi… Read more Fine-tune Bert For Specific Domain (unsupervised)

Ignore Out-of-vocabulary Words When Averaging Vectors In Spacy

I would like to use a pre-trained word2vec model in Spacy to encode titles by (1) mapping words to … Read more Ignore Out-of-vocabulary Words When Averaging Vectors In Spacy

Doc2vec Get Most Similar Documents

I am trying to build a document retrieval model that returns most documents ordered by their releva… Read more Doc2vec Get Most Similar Documents

How To Get The Span Of A Conjunct In Spacy?

I use spacy, token.conjuncts to get the conjuncts of each token. However, the return type of the to… Read more How To Get The Span Of A Conjunct In Spacy?

How Can I Create My Own Corpus In The Python Natural Language Toolkit?

I have recently expanded the names corpus in nltk and would like to know how I can turn the two fil… Read more How Can I Create My Own Corpus In The Python Natural Language Toolkit?