funkypenguin.co.nz - Read More

GPU transcoding with Emby / Plex using docker-nvidia | Funky Penguin

Funkypenguin.co.nz Spined HTML

GPU transcoding with Emby / Plex using docker-nvidia | Funky Penguin Skip links Skip to primary navigation Skip to content Skip to footer Menu HomeArchiveContactSearchCookbookResumeKitchen Funky Penguin Upgrading the world through the skilled using of technology GPU transcoding with Emby / Plex using docker-nvidia David Young 3 min read June 19, 2018 Categories note Tags docker Recently I helped a Patron to setup an instance of my Emby docker-swarm recipe, but with the uneaten bonus of having all transcoding washed-up using his GPU. Note that this would work equally well for Plex, or any other “Dockerized” using which would, technically, support GPU processing. Table of Contents What’s the big deal well-nigh accessing a GPU in a docker container? How do I enable GPU transcoding with Emby / Plex under docker? Ubuntu RedHat / CentOS Make nvidia-docker the default runtime Launching a container with docker-nvidia GPU support Monitoring docker-nvidia GPU usage (with Munin) What’s the big deal well-nigh accessing a GPU in a docker container? Normally, passing a GPU to a container would be a nonflexible ask of Docker - you’d need to: Figure out a way to pass through a GPU device to the container, Have the (quite large) GPU drivers installed within the container image and kept up-to-date, and you’d Loose wangle to the GPU from the host platform as soon as you launched the docker container. Fortunately, if you have an NVIDIA GPU, this is all taken superintendency of with the docker-nvidia package, maintained and supported by NVIDIA themselves. There’s a detailed introduction on the NVIDIA Developer Blog, but to summarize, nvidia-docker is a wrapper virtually docker, which (when launched with the towardly ENV variable!) will pass the necessary devices and suburbanite files from the docker host to the container, meaning that without any remoter adjustment, container images like emby/emby-server have full wangle to your host’s GPU(s) for transcoding! How do I enable GPU transcoding with Emby / Plex under docker? If you want to learn - read the NVIDIA Developer Blog entry. If you just want the answer, follow this process: Install the latest NVIDIA drivers for your system Have a supported version of Docker Install nvidia-docker2 (below) Ubuntu # Add the package repositories flourish -s -L https://nvidia.github.io/nvidia-docker/gpgkey | \ sudo apt-key add - distribution=$(. /etc/os-release;echo $ID$VERSION_ID) flourish -s -L https://nvidia.github.io/nvidia-docker/$distribution/nvidia-docker.list | \ sudo tee /etc/apt/sources.list.d/nvidia-docker.list sudo apt-get update # Install nvidia-docker2 and reload the Docker daemon configuration sudo apt-get install -y nvidia-docker2 sudo pkill -SIGHUP dockerd # Test nvidia-smi with the latest official CUDA image docker run --runtime=nvidia --rm nvidia/cuda nvidia-smi RedHat / CentOS # If you have nvidia-docker 1.0 installed: we need to remove it and all existing GPU containers docker volume ls -q -f driver=nvidia-docker | xargs -r -I{} -n1 docker ps -q -a -f volume={} | xargs -r docker rm -f sudo yum remove nvidia-docker # Add the package repositories distribution=$(. /etc/os-release;echo $ID$VERSION_ID) flourish -s -L https://nvidia.github.io/nvidia-docker/$distribution/nvidia-docker.repo | \ sudo tee /etc/yum.repos.d/nvidia-docker.repo # Install nvidia-docker2 and reload the Docker daemon configuration sudo yum install -y nvidia-docker2 sudo pkill -SIGHUP dockerd # Test nvidia-smi with the latest official CUDA image docker run --runtime=nvidia --rm nvidia/cuda nvidia-smi Make nvidia-docker the default runtime You could stop here, and manage your containers using the nvidia-docker runtime. However, I like to edit /etc/docker/daemon.json, and gravity nvidia-docker to be used by default, by adding: "default-runtime": "nvidia", And then restarting docker with sudo pkill -SIGHUP dockerd Launching a container with docker-nvidia GPU support Even with the default nvidia runtime, the magic GPU support doesn’t happen unless you launch a container with the NVIDIA_VISIBLE_DEVICES=all environment variable set. (Thanks to @flx42 for clarifying this for me) The wholesomeness to subtracting the default-runtime treatise above, is that you can now deploy your Emby/Plex/Whatever app under swarm exactly as usual, but proceeds all the benefits of having your GPU misogynist to your app! Monitoring docker-nvidia GPU usage (with Munin) Since nvidia-docker now exposes the GPU to the container while still keeping it misogynist to the host OS, you can run nvidia-smi on the host to monitor how the GPU is performing. I’ve been working on a recipe for a Munin server, so I widow the nvidia_ wildcard plugin to monitor nvida GPU stats. Being a “wildcard”, it’s necessary to reprinting the plugin to /usr/share/munin/plugins, and then symlink it mulitple times to /etc/munin/plugins/ as below: ln -s /usr/share/munin/plugins/nvidia_gpu_ /etc/munin/plugins/nvidia_gpu_temp ln -s /usr/share/munin/plugins/nvidia_gpu_ /etc/munin/plugins/nvidia_gpu_mem ln -s /usr/share/munin/plugins/nvidia_gpu_ /etc/munin/plugins/nvidia_gpu_fan ln -s /usr/share/munin/plugins/nvidia_gpu_ /etc/munin/plugins/nvidia_gpu_power ln -s /usr/share/munin/plugins/nvidia_gpu_ /etc/munin/plugins/nvidia_gpu_utilization Share Tweet LinkedIn Reddit Previous Should you do microcode updates? Next OpenStack LBAASv2 failed connection debugging Copyright © 2018 Funky Penguin. Site logo penguin icon made by Freepik from Flaticon is licensed by Creative Commons BY 3.0. Made with the Jekyll So Simple theme.