What is the difference and relation among 'cuda' 'cudnn' 'cunn' and 'cutorch' in torch?

cuda torch cudnn
hunter picture hunter · Jul 5, 2016 · Viewed 10.9k times · Source

I see many torch codes use:

require cudnn
require cunn
require cutorch

What are these package used for? What is their relation with Cuda?

Answer

SeanNaren picture SeanNaren · Jul 5, 2016

All 3 are used for CUDA GPU implementations for torch7.

cutorch is the cuda backend for torch7, offering various support for CUDA implementations in torch, such as a CudaTensor for tensors in GPU memory. Also adds some helpful features when interacting with the GPU.

cunn provides additional modules over the nn library, mainly converting those nn modules to GPU CUDA versions transparently. This makes it easy to switch neural networks to the GPU and vice versa via cuda!

cuDNN is a wrapper of NVIDIA's cuDNN library, which is an optimized library for CUDA containing various fast GPU implementations, such as for convolutional networks and RNN modules.

Related questions

nvcc fatal : Value 'sm_20' is not defined for option 'gpu-architecture'

I've looked at many pages and either could not follow what they were saying because they were unclear and/or my knowledge is just not sufficient enough. I am trying to run: luarocks install https://raw.githubusercontent.com/qassemoquab/stnbhwd/…

Read More
How to get the cuda version?

Is there any quick command or script to check for the version of CUDA installed? I found the manual of 4.0 under the installation directory but I'm not sure whether it is of the actual installed version or not.

Read More
How to verify CuDNN installation?

I have searched many places but ALL I get is HOW to install it, not how to verify that it is installed. I can verify my NVIDIA driver is installed, and that CUDA is installed, but I don't know how …

Read More