Does Gensim library support GPU acceleration?

optimization gpu gensim deeplearning4j
Irene Li picture Irene Li · Sep 18, 2016 · Viewed 12.7k times · Source

Using Word2vec and Doc2vec methods provided by Gensim, they have a distributed version which uses BLAS, ATLAS, etc to speedup (details here). However, is it supporting GPU mode? Is it possible to get GPU working if using Gensim?

Answer

Lev Konst picture Lev Konst · Sep 29, 2016

Thank you for your question. Using GPU is on the Gensim roadmap. Will appreciate any input that you have about it.

There is a version of word2vec running on keras by @niitsuma called word2veckeras. The code that runs on latest Keras version is in this fork and branch https://github.com/SimonPavlik/word2vec-keras-in-gensim/tree/keras106

@SimonPavlik has run performance test on this code. He found that a single gpu is slower than multiple CPUs for word2vec.

Regards Lev

Related questions

How do I choose grid and block dimensions for CUDA kernels?

This is a question about how to determine the CUDA grid, block and thread sizes. This is an additional question to the one posted here. Following this link, the answer from talonmies contains a code snippet (see below). I don't …

Read More
why are draw calls expensive?

assuming the texture, vertex, and shader data are already on the graphics card, you don't need to send much data to the card. there's a few bytes to identify the data, and presumably a 4x4 matrix, and some assorted other …

Read More
Once upon a time, when > was faster than < ... Wait, what?

I am reading an awesome OpenGL tutorial. It's really great, trust me. The topic I am currently at is Z-buffer. Aside from explaining what's it all about, the author mentions that we can perform custom depth tests, such as GL_…

Read More