I've been trying this for a couple of days and can't get it to work. Whenever I try to compile ffmpeg with --enable-cuvid and --enable-cuda I get CUDA NOT FOUND.
I'm running Ubuntu 16.04 LTS Server 64-Bit.
I've installed the nvidia driver OK (NVIDIA-Linux-x86_64-367.57) and also the latest Cuda8 (NVIDIA-Linux-x86_64-367.57)
I'm cloning the latest version of ffmpeg (https://github.com/FFmpeg/FFmpeg.git)
I think a path maybe wrong for ffmpeg to find the nvida libraries.
Can anyone help me?