Top "Word-embedding" questions

For questions about word embedding, a language modelling technique in natural language processing.

What does tf.nn.embedding_lookup function do?

tf.nn.embedding_lookup(params, ids, partition_strategy='mod', name=None) I cannot understand the duty of this function. Is …

python tensorflow deep-learning word-embedding natural-language-processing
Embedding in pytorch

I have checked the PyTorch tutorial and questions similar to this one on Stackoverflow. I get confused; does the embedding …

pytorch word-embedding
CBOW v.s. skip-gram: why invert context and target words?

In this page, it is said that: [...] skip-gram inverts contexts and targets, and tries to predict each context word from …

nlp tensorflow deep-learning word2vec word-embedding
How to use GloVe word-embeddings file on Google colaboratory

I have downloaded the data with wget !wget http://nlp.stanford.edu/data/glove.6B.zip - ‘glove.6B.zip’ …

python google-colaboratory word-embedding
what is dimensionality in word embeddings?

I want to understand what is meant by "dimensionality" in word embeddings. When I embed a word in the form …

nlp terminology dimensionality-reduction word-embedding
Is it possible to use Google BERT to calculate similarity between two textual documents?

Is it possible to use Google BERT for calculating similarity between two textual documents? As I understand BERT's input is …

python text scikit-learn nlp word-embedding
How to cluster similar sentences using BERT

For ElMo, FastText and Word2Vec, I'm averaging the word embeddings within a sentence and using HDBSCAN/KMeans clustering to …

python nlp artificial-intelligence word-embedding bert-language-model
Tensorflow embedding_lookup

I am trying to learn the word representation of the imdb dataset "from scratch" through the TensorFlow tf.nn.embedding_…

python python-2.7 machine-learning tensorflow word-embedding
word2vec - what is best? add, concatenate or average word vectors?

I am working on a recurrent language model. To learn word embeddings that can be used to initialize my language …

python word2vec gensim word-embedding language-model