drm and dri exposed but no hardware acceleration

[gmsotavio]

Hello guys,

I would like to share my situation. I've been trying to enable hardware acceleration for my Jellyfin server using the instructions provided in this file Installation_TrueNAS_GUI.md. While I can see the dri and drm nodes inside my jails, videos requiring transcoding simply do not load. Below are the configurations of my system and the procedures I've followed:

System Configuration

• Jellyfin installed in a Jail (with VNET), created and managed with iocage.
• FreeBSD 13.2-RELEASE amd64
• CPU: Intel i3-10105 (8) @ 3.700GHz
• Intel iGPU: CometLake-S GT2 [UHD Graphics 630]
• pciconf -vl returns:

vgapci0@pci0:0:2:0:     class=0x030000 rev=0x03 hdr=0x00 vendor=0x8086 device=0x9bc8 subvendor=0x1462 subdevice=0x7d20
    vendor     = 'Intel Corporation'
    device     = 'CometLake-S GT2 [UHD Graphics 630]'
    class      = display
    subclass   = VGA

Procedures Performed (Host)

Jail Creation and Jellyfin Installation

1. Created the Jail with vnet=on and allow_mlock=1:

   iocage create -n jellyfin vnet=on allow_mlock=1 \
   ip4_addr="vnet0|192.168.31.131/24" \
   defaultrouter="192.168.31.1" \
   interfaces="vnet0:vm-public" \
   --release 13.2-RELEASE
   

2. Installed Jellyfin inside the Jail:

   iocage pkg jellyfin update
   iocage pkg jellyfin install -y jellyfin
   iocage exec jellyfin mkdir /mnt/media
   iocage fstab --add jellyfin /tank2/media /mnt/media nullfs rw 0 0
   iocage exec jellyfin sysrc jellyfin_enable=TRUE
   iocage exec jellyfin service jellyfin start
   

drm-kmod Installation and Module Loading

3. Installed the drm-kmod package:

   pkg install drm-kmod
   

4. Added i915kms to the kld_list in /etc/rc.conf:

   sysrc kld_list+=i915kms
   

5. Rebooted the system to load the new modules.

Verification of Loaded Modules and Device Nodes

6. Confirmed that the modules i915kms and drm were loaded using kldstat:

# kldstat
Id Refs Address                Size Name
 1   86 0xffffffff80200000  1f3e2d0 kernel
 2    1 0xffffffff8213f000   579de0 vmm.ko
 3    1 0xffffffff826ba000     a4a0 cryptodev.ko
 4    1 0xffffffff826c5000   59dfa8 zfs.ko
 5    1 0xffffffff83210000   1858b8 i915kms.ko
 6    1 0xffffffff83396000    739e0 drm.ko
 7    2 0xffffffff8340a000     5220 linuxkpi_gplv2.ko
 8    3 0xffffffff83410000     62d8 dmabuf.ko
 9    1 0xffffffff83417000     3378 acpi_wmi.ko
10    1 0xffffffff8341b000     3250 ichsmb.ko
11    1 0xffffffff8341f000     2180 smbus.ko
12    1 0xffffffff83422000    31a80 linux.ko
13    4 0xffffffff83454000     be88 linux_common.ko
14    1 0xffffffff83460000    14b98 netlink.ko
15    1 0xffffffff83475000    2dca0 linux64.ko
16    1 0xffffffff834a3000     2260 pty.ko
17    1 0xffffffff834a6000     3530 fdescfs.ko
18    1 0xffffffff834aa000     73b0 linprocfs.ko
19    1 0xffffffff834b2000     3284 linsysfs.ko
20    1 0xffffffff834b6000     21cc nmdm.ko
21    1 0xffffffff834b9000     7638 if_bridge.ko
22    1 0xffffffff834c1000     60d8 bridgestp.ko
23    1 0xffffffff834c8000     2a08 mac_ntpd.ko
24    1 0xffffffff834cb000     4700 nullfs.ko

7. Verified the creation of the nodes /dev/drm and /dev/dri:

   # ls -la /dev/dr
   dri/ drm/
   

   # ls -la /dev/dr*
   /dev/dri:
   total 1
   dr-xr-xr-x   2 root  wheel  512 Jul 30 23:33 .
   dr-xr-xr-x  13 root  wheel  512 Jul 30 20:33 ..
   lrwxr-xr-x   1 root  wheel    8 Jul 30 23:33 card0 -> ../drm/0
   lrwxr-xr-x   1 root  wheel   10 Jul 30 23:33 renderD128 -> ../drm/128
   

Devfs Rules Configuration

8. Created the file /etc/devfs.rules with the following content:

   # cat /etc/devfs.rules
   [devfsrules_bpfjail=101]
   add path 'bpf*' unhide
   
   [plex_drm=10]
   add include $devfsrules_hide_all
   add include $devfsrules_unhide_basic
   add include $devfsrules_unhide_login
   add include $devfsrules_jail
   add include $devfsrules_bpfjail
   add path 'dri*' unhide
   add path 'dri/*' unhide
   add path 'drm*' unhide
   add path 'drm/*' unhide
   

9. Restarted the devfs service:

   service devfs restart
   

10. Applied the ruleset 10 to the Jellyfin Jail:

iocage set devfs_ruleset=10 jellyfin

Inside the Jellyfin Jail

Properties of the Jellyfin jail:

# iocage get all jellyfin
********************************************************************************
fdescfs(5) is not mounted, performance may suffer. Please run:
mount -t fdescfs null /dev/fd
You can also permanently mount it in /etc/fstab with the following entry:
fdescfs /dev/fd  fdescfs  rw  0  0
********************************************************************************

CONFIG_VERSION:27
allow_chflags:0
allow_mlock:1
allow_mount:0
allow_mount_devfs:0
allow_mount_fusefs:0
allow_mount_nullfs:0
allow_mount_procfs:0
allow_mount_tmpfs:0
allow_mount_zfs:0
allow_quotas:0
allow_raw_sockets:0
allow_set_hostname:1
allow_socket_af:0
allow_sysvipc:0
allow_tun:0
allow_vmm:0
assign_localhost:0
available:readonly
basejail:0
boot:0
bpf:0
children_max:0
cloned_release:13.2-RELEASE
comment:none
compression:lz4
compressratio:readonly
coredumpsize:off
count:1
cpuset:off
cputime:off
datasize:off
dedup:off
defaultrouter:192.168.31.1
defaultrouter6:auto
depends:none
devfs_ruleset:1006
dhcp:0
enforce_statfs:2
exec_clean:1
exec_created:/usr/bin/true
exec_fib:0
exec_jail_user:root
exec_poststart:/usr/bin/true
exec_poststop:/usr/bin/true
exec_prestart:/usr/bin/true
exec_prestop:/usr/bin/true
exec_start:/bin/sh /etc/rc
exec_stop:/bin/sh /etc/rc.shutdown
exec_system_jail_user:0
exec_system_user:root
exec_timeout:60
host_domainname:none
host_hostname:jellyfin
host_hostuuid:jellyfin
host_time:1
hostid:611573d9-2402-ce1d-a84a-d8bbc1509368
hostid_strict_check:0
interfaces:vnet0:vm-public
ip4:new
ip4_addr:vnet0|192.168.31.131/24
ip4_saddrsel:1
ip6:new
ip6_addr:none
ip6_saddrsel:1
ip_hostname:0
jail_zfs:0
jail_zfs_dataset:iocage/jails/jellyfin/data
jail_zfs_mountpoint:none
last_started:2023-07-31 22:24:02
localhost_ip:none
login_flags:-f root
mac_prefix:1cfd08
maxproc:off
memorylocked:off
memoryuse:off
min_dyn_devfs_ruleset:1000
mount_devfs:1
mount_fdescfs:1
mount_linprocfs:0
mount_procfs:0
mountpoint:readonly
msgqqueued:off
msgqsize:off
nat:0
nat_backend:ipfw
nat_forwards:none
nat_interface:none
nat_prefix:172.16
nmsgq:off
notes:none
nsem:off
nsemop:off
nshm:off
nthr:off
openfiles:off
origin:readonly
owner:root
pcpu:off
plugin_name:none
plugin_repository:none
priority:99
pseudoterminals:off
quota:none
readbps:off
readiops:off
release:13.2-RELEASE
reservation:none
resolver:/etc/resolv.conf
rlimits:off
rtsold:0
securelevel:2
shmsize:off
stacksize:off
state:up
stop_timeout:30
swapuse:off
sync_state:none
sync_target:none
sync_tgt_zpool:none
sysvmsg:new
sysvsem:new
sysvshm:new
template:0
type:jail
used:readonly
vmemoryuse:off
vnet:1
vnet0_mac:1cfd0829d59a 1cfd0829d59b
vnet1_mac:none
vnet2_mac:none
vnet3_mac:none
vnet_default_interface:auto
vnet_interfaces:none
wallclock:off
writebps:off
writeiops:off

Starting the Jellyfin jail:

# iocage start jellyfin
********************************************************************************
fdescfs(5) is not mounted, performance may suffer. Please run:
mount -t fdescfs null /dev/fd
You can also permanently mount it in /etc/fstab with the following entry:
fdescfs /dev/fd  fdescfs  rw  0  0
********************************************************************************

No default gateway found for ipv6.
* Starting jellyfin
  + Started OK
  + Using devfs_ruleset: 1006 (cloned from devfs_ruleset 10)
  + Configuring VNET OK
  + Using IP options: vnet
  + Starting services OK
  + Executing poststart OK

Installing the packages:

pkg install ffmpeg
pkg install libva-utils
pkg install libva-intel-media-driver

Versions of the installed packages:

root@jellyfin:/dev # pkg info libva-utils ffmpeg libva-intel-media-driver jellyfin
libva-utils-2.18.1
ffmpeg-6.0,1
libva-intel-media-driver-22.4.3_1
jellyfin-10.8.10_1

FFmpeg config:

root@jellyfin:~ # ffmpeg 
ffmpeg version 6.0 Copyright (c) 2000-2023 the FFmpeg developers
  built with FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git llvmorg-13.0.0-0-gd7b669b3a303)
  configuration: --prefix=/usr/local --mandir=/usr/local/man --datadir=/usr/local/share/ffmpeg --docdir=/usr/local/share/doc/ffmpeg --pkgconfigdir=/usr/local/libdata/pkgconfig --disable-static --disable-libcelt --enable-shared --enable-pic --enable-gpl --cc=cc --cxx=c++ --disable-alsa --disable-libopencore-amrnb --disable-libopencore-amrwb --enable-libaom --disable-libaribb24 --enable-asm --enable-libass --disable-libbs2b --disable-libcaca --disable-libcdio --disable-libcodec2 --enable-libdav1d --disable-libdavs2 --disable-libdc1394 --disable-debug --enable-htmlpages --enable-libdrm --disable-libfdk-aac --disable-libflite --enable-fontconfig --enable-libfreetype --enable-frei0r --disable-libfribidi --disable-gcrypt --disable-libglslang --disable-libgme --enable-gmp --enable-gnutls --enable-version3 --disable-libgsm --enable-iconv --disable-libilbc --disable-libjack --enable-libjxl --disable-libklvanc --disable-libkvazaar --disable-ladspa --enable-libmp3lame --enable-lcms2 --disable-liblensfun --disable-libbluray --enable-libplacebo --disable-librsvg --disable-librtmp --enable-libxml2 --disable-lto --disable-lv2 --disable-mbedtls --disable-libmfx --disable-libmodplug --disable-libmysofa --enable-network --disable-nonfree --enable-nvenc --disable-openal --disable-opencl --disable-opengl --disable-libopenh264 --disable-libopenjpeg --disable-libopenmpt --disable-openssl --disable-libopenvino --enable-optimizations --enable-libopus --disable-pocketsphinx --disable-libpulse --disable-librabbitmq --disable-librav1e --disable-librist --enable-runtime-cpudetect --disable-librubberband --disable-sdl2 --enable-libshaderc --disable-libsmbclient --disable-libsnappy --disable-sndio --disable-libsoxr --disable-libspeex --disable-libsrt --disable-libssh --enable-libsvtav1 --disable-libtensorflow --disable-libtesseract --disable-libtheora --disable-libtwolame --disable-libuavs3d --enable-libv4l2 --enable-vaapi --disable-vapoursynth --enable-vdpau --disable-libvidstab --enable-libvmaf --enable-libvorbis --disable-libvo-amrwbenc --disable-libvpl --enable-libvpx --enable-vulkan --enable-libwebp --enable-libx264 --enable-libx265 --disable-libxavs2 --enable-libxcb --disable-libxvid --disable-outdev=xv --disable-libzimg --disable-libzmq --disable-libzvbi
  libavutil      58.  2.100 / 58.  2.100
  libavcodec     60.  3.100 / 60.  3.100
  libavformat    60.  3.100 / 60.  3.100
  libavdevice    60.  1.100 / 60.  1.100
  libavfilter     9.  3.100 /  9.  3.100
  libswscale      7.  1.100 /  7.  1.100
  libswresample   4. 10.100 /  4. 10.100
  libpostproc    57.  1.100 / 57.  1.100
Hyper fast Audio and Video encoder
usage: ffmpeg [options] [[infile options] -i infile]... {[outfile options] outfile}...

Confirming that the jail can see the drm and dri nodes:

root@jellyfin:/dev # ls -la
total 11
dr-xr-xr-x  13 root  wheel       512 Jul 31 19:23 .
drwxr-xr-x  18 root  wheel        22 Jun 20 20:57 ..
crw-------   1 root  wheel      0x1f Jul 31 19:24 bpf
lrwxr-xr-x   1 root  wheel         3 Jul 31 19:23 bpf0 -> bpf
crw-rw-rw-   1 root  wheel      0x50 Jul 31 19:17 crypto
dr-xr-xr-x   2 root  wheel       512 Jul 31 19:23 dri
dr-xr-xr-x   2 root  wheel       512 Jul 31 19:23 drm
dr-xr-xr-x   2 root  wheel       512 Jul 31 19:17 fd
crw-rw-rw-   1 root  wheel      0x23 Jul 31 19:33 null
crw-rw-rw-   1 root  wheel     0x1e6 Jul 31 19:17 ptmx
dr-xr-xr-x   2 root  wheel       512 Jul 31 19:23 pts
crw-r--r--   1 root  wheel       0x7 Jul 31 16:17 random
lrwxr-xr-x   1 root  wheel         4 Jul 31 19:23 stderr -> fd/2
lrwxr-xr-x   1 root  wheel         4 Jul 31 19:23 stdin -> fd/0
lrwxr-xr-x   1 root  wheel         4 Jul 31 19:23 stdout -> fd/1
lrwxr-xr-x   1 root  wheel         6 Jul 31 19:23 urandom -> random
crw-rw-rw-   1 root  wheel      0x24 Jul 31 19:17 zero
crw-rw-rw-   1 root  operator   0x4d Jul 31 19:17 zfs

root@jellyfin:~ # ls -la /dev/dri
total 1
dr-xr-xr-x   2 root  wheel  512 Jul 31 19:23 .
dr-xr-xr-x  13 root  wheel  512 Jul 31 19:23 ..
lrwxr-xr-x   1 root  wheel    8 Jul 31 19:23 card0 -> ../drm/0
lrwxr-xr-x   1 root  wheel   10 Jul 31 19:23 renderD128 -> ../drm/128

Result of the command vainfo:

root@jellyfin:~ # vainfo 
Trying display: wayland
error: XDG_RUNTIME_DIR is invalid or not set in the environment.
Trying display: x11
error: can't connect to X server!
Trying display: drm
libva info: VA-API version 1.18.0
libva info: Trying to open /usr/local/lib/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_18
libva info: va_openDriver() returns 0
vainfo: VA-API version: 1.18 (libva 2.18.1)
vainfo: Driver version: Intel iHD driver for Intel(R) Gen Graphics - 22.4.3 (intel-media-22.4.3)
vainfo: Supported profiles and entrypoints
      VAProfileNone                   : VAEntrypointVideoProc
      VAProfileNone                   : VAEntrypointStats
      VAProfileMPEG2Simple            : VAEntrypointVLD
      VAProfileMPEG2Simple            : VAEntrypointEncSlice
      VAProfileMPEG2Main              : VAEntrypointVLD
      VAProfileMPEG2Main              : VAEntrypointEncSlice
      VAProfileH264Main               : VAEntrypointVLD
      VAProfileH264Main               : VAEntrypointEncSlice
      VAProfileH264Main               : VAEntrypointFEI
      VAProfileH264Main               : VAEntrypointEncSliceLP
      VAProfileH264High               : VAEntrypointVLD
      VAProfileH264High               : VAEntrypointEncSlice
      VAProfileH264High               : VAEntrypointFEI
      VAProfileH264High               : VAEntrypointEncSliceLP
      VAProfileVC1Simple              : VAEntrypointVLD
      VAProfileVC1Main                : VAEntrypointVLD
      VAProfileVC1Advanced            : VAEntrypointVLD
      VAProfileJPEGBaseline           : VAEntrypointVLD
      VAProfileJPEGBaseline           : VAEntrypointEncPicture
      VAProfileH264ConstrainedBaseline: VAEntrypointVLD
      VAProfileH264ConstrainedBaseline: VAEntrypointEncSlice
      VAProfileH264ConstrainedBaseline: VAEntrypointFEI
      VAProfileH264ConstrainedBaseline: VAEntrypointEncSliceLP
      VAProfileVP8Version0_3          : VAEntrypointVLD
      VAProfileVP8Version0_3          : VAEntrypointEncSlice
      VAProfileHEVCMain               : VAEntrypointVLD
      VAProfileHEVCMain               : VAEntrypointEncSlice
      VAProfileHEVCMain               : VAEntrypointFEI
      VAProfileHEVCMain10             : VAEntrypointVLD
      VAProfileHEVCMain10             : VAEntrypointEncSlice
      VAProfileVP9Profile0            : VAEntrypointVLD
      VAProfileVP9Profile2            : VAEntrypointVLD

Added the user jellyfin to the group video:

pw groupmod -n video -m jellyfin

Created the file /usr/local/bin/lffmpeg with the following content:

root@jellyfin:~ # cat /usr/local/bin/lffmpeg

#!/bin/sh
echo "$@" > /tmp/params
ffmpeg -hwaccel vaapi "$@"

Added execute permission to the file /usr/local/bin/lffmpeg:

chmod +x /usr/local/bin/lffmpeg

root@jellyfin:~ # ls -la /usr/local/bin/lffmpeg:

-rwxr-xr-x  1 root  wheel  201 Jul 30 23:19 /usr/local/bin/lffmpeg

Playback settings on Jellyfin web:

When trying to load a movie, I notice that it never leaves the loading screen (it keeps spinning indefinitely with the loading circle):

The transcode log:

[2023-07-31 19:44:38.289 -03:00] [INF] [115] Jellyfin.Api.Helpers.MediaInfoHelper: StreamBuilder.BuildVideoItem( Profile="Anonymous Profile", Path="/mnt/downloads/1917 (2019) [2160p] [4K] [BluRay] [7.1] [YTS.MX]/1917.2019.2160p.4K.BluRay.x265.10bit.AAC7.1-[YTS.MX].mkv", AudioStreamIndex=1, SubtitleStreamIndex=2 ) => ( PlayMethod=Transcode, TranscodeReason=VideoCodecNotSupported, AudioCodecNotSupported ) "media:/videos/f4601d32-8b44-0985-a3d4-ab66e93459b5/master.m3u8?MediaSourceId=f4601d328b440985a3d4ab66e93459b5&VideoCodec=h264&AudioCodec=aac&AudioStreamIndex=1&VideoBitrate=139616000&AudioBitrate=384000&AudioSampleRate=48000&MaxFramerate=23.976025&api_key=<token>&TranscodingMaxAudioChannels=2&RequireAvc=false&Tag=c5b1f3b099e2d7d1a2f27b9476348e46&SegmentContainer=ts&MinSegments=1&BreakOnNonKeyFrames=True&hevc-level=150&hevc-videobitdepth=10&hevc-profile=main10&hevc-audiochannels=8&aac-profile=lc&TranscodeReasons=VideoCodecNotSupported,%20AudioCodecNotSupported"
[2023-07-31 19:44:38.775 -03:00] [INF] [111] Jellyfin.Api.Controllers.DynamicHlsController: Current HLS implementation doesn't support non-keyframe breaks but one is requested, ignoring that request
[2023-07-31 19:44:38.776 -03:00] [INF] [111] Jellyfin.Api.Helpers.TranscodingJobHelper: "/usr/local/bin/lffmpeg" "-analyzeduration 200M  -i file:\"/mnt/downloads/1917 (2019) [2160p] [4K] [BluRay] [7.1] [YTS.MX]/1917.2019.2160p.4K.BluRay.x265.10bit.AAC7.1-[YTS.MX].mkv\" -map_metadata -1 -map_chapters -1 -threads 0 -map 0:0 -map 0:1 -map -0:s -codec:v:0 h264_vaapi -rc_mode VBR -b:v 6584206 -maxrate 6584206 -bufsize 13168412 -force_key_frames:0 \"expr:gte(t,0+n_forced*3)\" -vf \"setparams=color_primaries=bt709:color_trc=bt709:colorspace=bt709,scale=trunc(min(max(iw\,ih*a)\,min(3840\,1606*a))/2)*2:trunc(min(max(iw/a\,ih)\,min(3840/a\,1606))/2)*2,format=nv12,hwupload=derive_device=vaapi\" -codec:a:0 aac -ac 2 -ab 384000 -ar 48000 -af \"volume=2\" -copyts -avoid_negative_ts disabled -max_muxing_queue_size 2048 -f hls -max_delay 5000000 -hls_time 3 -hls_segment_type mpegts -start_number 0 -hls_segment_filename \"/var/db/jellyfin/transcodes/983a1407df13114b421e601e7585edcb%d.ts\" -hls_playlist_type vod -hls_list_size 0 -y \"/var/db/jellyfin/transcodes/983a1407df13114b421e601e7585edcb.m3u8\""

More logs:

/usr/local/bin/lffmpeg -analyzeduration 200M  -i file:"/mnt/downloads/1917 (2019) [2160p] [4K] [BluRay] [7.1] [YTS.MX]/1917.2019.2160p.4K.BluRay.x265.10bit.AAC7.1-[YTS.MX].mkv" -map_metadata -1 -map_chapters -1 -threads 0 -map 0:0 -map 0:1 -map -0:s -codec:v:0 h264_vaapi -rc_mode VBR -b:v 6584206 -maxrate 6584206 -bufsize 13168412 -force_key_frames:0 "expr:gte(t,0+n_forced*3)" -vf "setparams=color_primaries=bt709:color_trc=bt709:colorspace=bt709,scale=trunc(min(max(iw\,ih*a)\,min(3840\,1606*a))/2)*2:trunc(min(max(iw/a\,ih)\,min(3840/a\,1606))/2)*2,format=nv12,hwupload=derive_device=vaapi" -codec:a:0 aac -ac 2 -ab 384000 -ar 48000 -af "volume=2" -copyts -avoid_negative_ts disabled -max_muxing_queue_size 2048 -f hls -max_delay 5000000 -hls_time 3 -hls_segment_type mpegts -start_number 0 -hls_segment_filename "/var/db/jellyfin/transcodes/983a1407df13114b421e601e7585edcb%d.ts" -hls_playlist_type vod -hls_list_size 0 -y "/var/db/jellyfin/transcodes/983a1407df13114b421e601e7585edcb.m3u8"


ffmpeg version 6.0 Copyright (c) 2000-2023 the FFmpeg developers
  built with FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git llvmorg-13.0.0-0-gd7b669b3a303)
  configuration: --prefix=/usr/local --mandir=/usr/local/man --datadir=/usr/local/share/ffmpeg --docdir=/usr/local/share/doc/ffmpeg --pkgconfigdir=/usr/local/libdata/pkgconfig --disable-static --disable-libcelt --enable-shared --enable-pic --enable-gpl --cc=cc --cxx=c++ --disable-alsa --disable-libopencore-amrnb --disable-libopencore-amrwb --enable-libaom --disable-libaribb24 --enable-asm --enable-libass --disable-libbs2b --disable-libcaca --disable-libcdio --disable-libcodec2 --enable-libdav1d --disable-libdavs2 --disable-libdc1394 --disable-debug --enable-htmlpages --enable-libdrm --disable-libfdk-aac --disable-libflite --enable-fontconfig --enable-libfreetype --enable-frei0r --disable-libfribidi --disable-gcrypt --disable-libglslang --disable-libgme --enable-gmp --enable-gnutls --enable-version3 --disable-libgsm --enable-iconv --disable-libilbc --disable-libjack --enable-libjxl --disable-libklvanc --disable-libkvazaar --disable-ladspa --enable-libmp3lame --enable-lcms2 --disable-liblensfun --disable-libbluray --enable-libplacebo --disable-librsvg --disable-librtmp --enable-libxml2 --disable-lto --disable-lv2 --disable-mbedtls --disable-libmfx --disable-libmodplug --disable-libmysofa --enable-network --disable-nonfree --enable-nvenc --disable-openal --disable-opencl --disable-opengl --disable-libopenh264 --disable-libopenjpeg --disable-libopenmpt --disable-openssl --disable-libopenvino --enable-optimizations --enable-libopus --disable-pocketsphinx --disable-libpulse --disable-librabbitmq --disable-librav1e --disable-librist --enable-runtime-cpudetect --disable-librubberband --disable-sdl2 --enable-libshaderc --disable-libsmbclient --disable-libsnappy --disable-sndio --disable-libsoxr --disable-libspeex --disable-libsrt --disable-libssh --enable-libsvtav1 --disable-libtensorflow --disable-libtesseract --disable-libtheora --disable-libtwolame --disable-libuavs3d --enable-libv4l2 --enable-vaapi --disable-vapoursynth --enable-vdpau --disable-libvidstab --enable-libvmaf --enable-libvorbis --disable-libvo-amrwbenc --disable-libvpl --enable-libvpx --enable-vulkan --enable-libwebp --enable-libx264 --enable-libx265 --disable-libxavs2 --enable-libxcb --disable-libxvid --disable-outdev=xv --disable-libzimg --disable-libzmq --disable-libzvbi
  libavutil      58.  2.100 / 58.  2.100
  libavcodec     60.  3.100 / 60.  3.100
  libavformat    60.  3.100 / 60.  3.100
  libavdevice    60.  1.100 / 60.  1.100
  libavfilter     9.  3.100 /  9.  3.100
  libswscale      7.  1.100 /  7.  1.100
  libswresample   4. 10.100 /  4. 10.100
  libpostproc    57.  1.100 / 57.  1.100
[matroska,webm @ 0x85ad3a280] Could not find codec parameters for stream 3 (Subtitle: hdmv_pgs_subtitle (pgssub)): unspecified size
Consider increasing the value for the 'analyzeduration' (200000000) and 'probesize' (5000000) options
[matroska,webm @ 0x85ad3a280] Could not find codec parameters for stream 4 (Subtitle: hdmv_pgs_subtitle (pgssub)): unspecified size
Consider increasing the value for the 'analyzeduration' (200000000) and 'probesize' (5000000) options
[matroska,webm @ 0x85ad3a280] Could not find codec parameters for stream 5 (Subtitle: hdmv_pgs_subtitle (pgssub)): unspecified size
Consider increasing the value for the 'analyzeduration' (200000000) and 'probesize' (5000000) options
Input #0, matroska,webm, from 'file:/mnt/downloads/1917 (2019) [2160p] [4K] [BluRay] [7.1] [YTS.MX]/1917.2019.2160p.4K.BluRay.x265.10bit.AAC7.1-[YTS.MX].mkv':
  Metadata:
    ENCODER         : Lavf58.41.100
  Duration: 01:58:59.51, start: 0.000000, bitrate: 6584 kb/s
  Stream #0:0: Video: hevc (Main 10), yuv420p10le(tv), 3840x1606 [SAR 1:1 DAR 1920:803], 23.98 fps, 23.98 tbr, 1k tbn (default)
    Metadata:
      ENCODER         : Lavc58.75.100 libx265
      DURATION        : 01:58:59.509000000
  Stream #0:1: Audio: aac (LC), 48000 Hz, 7.1, fltp (default)
    Metadata:
      ENCODER         : Lavc58.75.100 libfdk_aac
      DURATION        : 01:58:59.509000000
  Stream #0:2(eng): Subtitle: subrip (default)
    Metadata:
      title           : English-SRT
      BPS-eng         : 34
      DURATION-eng    : 01:45:44.619000000
      NUMBER_OF_FRAMES-eng: 934
      NUMBER_OF_BYTES-eng: 27417
      _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
      DURATION        : 01:47:15.419000000
  Stream #0:3(eng): Subtitle: hdmv_pgs_subtitle
    Metadata:
      title           : English-SDH-PGS
      BPS-eng         : 27959
      DURATION-eng    : 01:45:49.468000000
      NUMBER_OF_FRAMES-eng: 2202
      NUMBER_OF_BYTES-eng: 22191030
      _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
      DURATION        : 01:47:15.431000000
  Stream #0:4(fre): Subtitle: hdmv_pgs_subtitle
    Metadata:
      title           : French-PGS
      BPS-eng         : 22671
      DURATION-eng    : 01:57:50.856000000
      NUMBER_OF_FRAMES-eng: 1888
      NUMBER_OF_BYTES-eng: 20038011
      _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
      DURATION        : 01:58:39.448000000
  Stream #0:5(spa): Subtitle: hdmv_pgs_subtitle
    Metadata:
      title           : Spanish-PGS
      BPS-eng         : 21293
      DURATION-eng    : 01:57:50.856000000
      NUMBER_OF_FRAMES-eng: 2022
      NUMBER_OF_BYTES-eng: 18820204
      _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
      DURATION        : 01:58:39.448000000
Stream mapping:
  Stream #0:0 -> #0:0 (hevc (native) -> h264 (h264_vaapi))
  Stream #0:1 -> #0:1 (aac (native) -> aac (native))
Press [q] to stop, [?] for help

I appreciate any tips you may have to offer. Thank you in advance.

[Thefrank]

Everything looks like it SHOULD be working.
try using the default path for FFmpeg instead of the one created by lffmpeg. does it use -hwaccel vaapi when being invoked?

[gmsotavio]

Hi @Thefrank

When attempting to use the default FFmpeg (6.0) on FreeBSD, an error occurs

The log displays the following command invocations:

ffmpeg -analyzeduration 200M -i file:"/mnt/downloads/Noah (2014) [2160p] [4K] [WEB] [5.1] [YTS.MX]/Noah.2014.2160p.4K.WEB.x265.10bit.AAC5.1-[YTS.MX].mkv" -map_metadata -1 -map_chapters -1 -threads 0 -map 0:0 -map 0:1 -map -0:s -codec:v:0 h264_vaapi -rc_mode VBR -b:v 6388419 -maxrate 6388419 -bufsize 12776838 -force_key_frames:0 "expr:gte(t,0+n_forced*3)" -vf "setparams=color_primaries=bt709:color_trc=bt709:colorspace=bt709,scale=trunc(min(max(iw\,ih*a)\,min(3658\,2074*a))/2)*2:trunc(min(max(iw/a\,ih)\,min(3658/a\,2074))/2)*2,format=nv12,hwupload=derive_device=vaapi" -codec:a:0 aac -ac 2 -ab 384000 -ar 48000 -af "volume=2" -copyts -avoid_negative_ts disabled -max_muxing_queue_size 2048 -f hls -max_delay 5000000 -hls_time 3 -hls_segment_type mpegts -start_number 0 -hls_segment_filename "/var/db/jellyfin/transcodes/d84f765d6274cffe000f265bd429c904%d.ts" -hls_playlist_type vod -hls_list_size 0 -y "/var/db/jellyfin/transcodes/d84f765d6274cffe000f265bd429c904.m3u8"

As we can see, -hwaccel vaapi is missing and the following error is printed int the log

Stream mapping:
  Stream #0:0 -> #0:0 (hevc (native) -> h264 (h264_vaapi))
  Stream #0:1 -> #0:1 (aac (native) -> aac (native))
Press [q] to stop, [?] for help
[hwupload @ 0x867e07c00] A hardware device reference is required to upload frames to.
[Parsed_hwupload_3 @ 0x860829e00] Query format failed for 'Parsed_hwupload_3': Invalid argument
Error reinitializing filters!
Failed to inject frame into filter network: Invalid argument
Error while processing the decoded data for stream #0:0
[aac @ 0x860963c00] Qavg: 65536.000
[aac @ 0x860963c00] 2 frames left in the queue on closing
Conversion failed!

[gmsotavio]

It appears that the following configuration is not being passed to FFmpeg. I am unsure how the device node path is handled by Jellyfin.

[Thefrank]

@gmsotavio hwupload=derive_device=vaapi. that line should be handling it but it does not appear to be
but it also should do -init_hw_device at some point too.
You can try changing the last line in lffmpeg to ffmpeg -init_hw_device vaapi=va:/dev/dri/renderD128 -filter_hw_device va -hwaccel vaapi -hwaccel_output_format vaapi "$@" and see if that is the nudge it needs

[Thefrank]

One final thing to try:
pkg remove libva-intel-media-driver
pkg install libva-intel-driver

[gmsotavio]

@gmsotavio hwupload=derive_device=vaapi. that line should be handling it but it does not appear to be but it also should do -init_hw_device at some point too. You can try changing the last line in lffmpeg to ffmpeg -init_hw_device vaapi=va:/dev/dri/renderD128 -filter_hw_device va -hwaccel vaapi -hwaccel_output_format vaapi "$@" and see if that is the nudge it needs

@Thefrank, thank you for your patience and support.

As you have suggested, I have been trying to use FFmpeg with the following command to utilize VA-API for hardware acceleration:

ffmpeg -init_hw_device vaapi=va:/dev/dri/renderD128 -filter_hw_device va -hwaccel vaapi -hwaccel_output_format vaapi "$@"

However, I encountered the following error message during the process:

Stream mapping:
  Stream #0:0 -> #0:0 (hevc (native) -> h264 (h264_vaapi))
  Stream #0:1 -> #0:1 (aac (native) -> aac (native))
Press [q] to stop, [?] for help
Impossible to convert between the formats supported by the filter 'Parsed_setparams_0' and the filter 'auto_scale_0'
Error reinitializing filters!
Failed to inject frame into filter network: Function not implemented
Error while processing the decoded data for stream #0:0
[aac @ 0x862899400] Qavg: 65536.000
[aac @ 0x862899400] 2 frames left in the queue on closing
Conversion failed!

[gmsotavio]

One final thing to try: pkg remove libva-intel-media-driver pkg install libva-intel-driver

For that test, I encountered the following error message:

root@jellyfin:~ # vainfo
Trying display: wayland
error: XDG_RUNTIME_DIR is invalid or not set in the environment.
Trying display: x11
error: can't connect to X server!
Trying display: drm
libva info: VA-API version 1.18.0
libva info: Trying to open /usr/local/lib/dri/iHD_drv_video.so
libva info: va_openDriver() returns -1
libva info: Trying to open /usr/local/lib/dri/i965_drv_video.so
libva info: Found init function __vaDriverInit_1_18
libva error: /usr/local/lib/dri/i965_drv_video.so init failed
libva info: va_openDriver() returns -1
vaInitialize failed with error code -1 (unknown libva error),exit

and

[AVHWDeviceContext @ 0x85c9b11c0] libva: /usr/local/lib/dri/i965_drv_video.so init failed
[AVHWDeviceContext @ 0x85c9b11c0] Failed to initialise VAAPI connection: -1 (unknown libva error).
Device creation failed: -5.
No device available for decoder: device type vaapi needed for codec hevc.
Stream mapping:
  Stream #0:0 -> #0:0 (hevc (native) -> h264 (h264_vaapi))
  Stream #0:1 -> #0:1 (aac (native) -> aac (native))
Device setup failed for decoder on input stream #0:0 : Input/output error

[gmsotavio]

I believe there might be an issue with FFmpeg. Jellyfin provides a package called ffmpeg-jellyfin, and I'm not sure how much it differs from the vanilla FFmpeg, but I'll need to research it. Have you had success with this process using any Intel iGPU?

[Thefrank]

@gmsotavio I don't have any hardware to test it on sadly. If you want to try a different (but not jellyfin's version) of FFmpeg, I make a static binary for it: https://github.com/Thefrank/ffmpeg-static-freebsd . I doubt it will work with hwaccel as that is very difficult to do via static linking

[gmsotavio]

@Thefrank, I conducted some additional tests tonight. I attempted to isolate Jellyfin from FFmpeg. I took one of the movie files I was trying to play and manually performed an HEVC -> H.264 conversion using only FFmpeg with options for decoding using hwaccel@vaapi.

The command below worked:

ffmpeg -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -i input.mkv -filter:v "scale_vaapi=w=3840:h=2160:format=nv12" -c:v h264_vaapi -profile:v main output.mkv

root@jellyfin:/tmp # ffmpeg -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -i input.mkv -filter:v "scale_vaapi=w=3840:h=2160:format=nv12" -c:v h264_vaapi -profile:v main output.mkv
ffmpeg version 6.0 Copyright (c) 2000-2023 the FFmpeg developers
  built with FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git llvmorg-13.0.0-0-gd7b669b3a303)
  configuration: --prefix=/usr/local --mandir=/usr/local/man --datadir=/usr/local/share/ffmpeg --docdir=/usr/local/share/doc/ffmpeg --pkgconfigdir=/usr/local/libdata/pkgconfig --disable-static --disable-libcelt --enable-shared --enable-pic --enable-gpl --cc=cc --cxx=c++ --disable-alsa --disable-libopencore-amrnb --disable-libopencore-amrwb --enable-libaom --disable-libaribb24 --enable-asm --enable-libass --disable-libbs2b --disable-libcaca --disable-libcdio --disable-libcodec2 --enable-libdav1d --disable-libdavs2 --disable-libdc1394 --disable-debug --enable-htmlpages --enable-libdrm --disable-libfdk-aac --disable-libflite --enable-fontconfig --enable-libfreetype --enable-frei0r --disable-libfribidi --disable-gcrypt --disable-libglslang --disable-libgme --enable-gmp --enable-gnutls --enable-version3 --disable-libgsm --enable-iconv --disable-libilbc --disable-libjack --enable-libjxl --disable-libklvanc --disable-libkvazaar --disable-ladspa --enable-libmp3lame --enable-lcms2 --disable-liblensfun --disable-libbluray --enable-libplacebo --disable-librsvg --disable-librtmp --enable-libxml2 --disable-lto --disable-lv2 --disable-mbedtls --disable-libmfx --disable-libmodplug --disable-libmysofa --enable-network --disable-nonfree --enable-nvenc --disable-openal --disable-opencl --disable-opengl --disable-libopenh264 --disable-libopenjpeg --disable-libopenmpt --disable-openssl --disable-libopenvino --enable-optimizations --enable-libopus --disable-pocketsphinx --disable-libpulse --disable-librabbitmq --disable-librav1e --disable-librist --enable-runtime-cpudetect --disable-librubberband --disable-sdl2 --enable-libshaderc --disable-libsmbclient --disable-libsnappy --disable-sndio --disable-libsoxr --disable-libspeex --disable-libsrt --disable-libssh --enable-libsvtav1 --disable-libtensorflow --disable-libtesseract --disable-libtheora --disable-libtwolame --disable-libuavs3d --enable-libv4l2 --enable-vaapi --disable-vapoursynth --enable-vdpau --disable-libvidstab --enable-libvmaf --enable-libvorbis --disable-libvo-amrwbenc --disable-libvpl --enable-libvpx --enable-vulkan --enable-libwebp --enable-libx264 --enable-libx265 --disable-libxavs2 --enable-libxcb --disable-libxvid --disable-outdev=xv --disable-libzimg --disable-libzmq --disable-libzvbi
  libavutil      58.  2.100 / 58.  2.100
  libavcodec     60.  3.100 / 60.  3.100
  libavformat    60.  3.100 / 60.  3.100
  libavdevice    60.  1.100 / 60.  1.100
  libavfilter     9.  3.100 /  9.  3.100
  libswscale      7.  1.100 /  7.  1.100
  libswresample   4. 10.100 /  4. 10.100
  libpostproc    57.  1.100 / 57.  1.100
Input #0, matroska,webm, from 'input.mkv':
  Metadata:
    ENCODER         : Lavf59.33.100
  Duration: 02:17:53.18, start: -0.043000, bitrate: 6388 kb/s
  Chapters:
    Chapter #0:0: start 0.000000, end 9.000000
    Chapter #0:1: start 9.000000, end 42.000000
    Chapter #0:2: start 42.000000, end 132.000000
    Chapter #0:3: start 132.000000, end 289.000000
    Chapter #0:4: start 289.000000, end 297.000000
    Chapter #0:5: start 297.000000, end 477.000000
    Chapter #0:6: start 477.000000, end 525.000000
    Chapter #0:7: start 525.000000, end 636.000000
    Chapter #0:8: start 636.000000, end 750.000000
    Chapter #0:9: start 750.000000, end 803.000000
    Chapter #0:10: start 803.000000, end 831.000000
    Chapter #0:11: start 831.000000, end 1029.000000
    Chapter #0:12: start 1029.000000, end 1131.000000
    Chapter #0:13: start 1131.000000, end 1253.000000
    Chapter #0:14: start 1253.000000, end 1413.000000
    Chapter #0:15: start 1413.000000, end 1807.000000
    Chapter #0:16: start 1807.000000, end 1935.000000
    Chapter #0:17: start 1935.000000, end 2081.000000
    Chapter #0:18: start 2081.000000, end 2180.000000
    Chapter #0:19: start 2180.000000, end 2255.000000
    Chapter #0:20: start 2255.000000, end 2469.000000
    Chapter #0:21: start 2469.000000, end 2571.000000
    Chapter #0:22: start 2571.000000, end 2968.000000
    Chapter #0:23: start 2968.000000, end 2998.000000
    Chapter #0:24: start 2998.000000, end 3081.000000
    Chapter #0:25: start 3081.000000, end 3117.000000
    Chapter #0:26: start 3117.000000, end 3284.000000
    Chapter #0:27: start 3284.000000, end 3430.000000
    Chapter #0:28: start 3430.000000, end 3655.000000
    Chapter #0:29: start 3655.000000, end 3817.000000
    Chapter #0:30: start 3817.000000, end 3961.000000
    Chapter #0:31: start 3961.000000, end 4142.000000
    Chapter #0:32: start 4142.000000, end 4327.000000
    Chapter #0:33: start 4327.000000, end 4923.000000
    Chapter #0:34: start 4923.000000, end 5086.000000
    Chapter #0:35: start 5086.000000, end 5267.000000
    Chapter #0:36: start 5267.000000, end 5446.000000
    Chapter #0:37: start 5446.000000, end 5551.000000
    Chapter #0:38: start 5551.000000, end 5650.000000
    Chapter #0:39: start 5650.000000, end 5745.000000
    Chapter #0:40: start 5745.000000, end 5913.000000
    Chapter #0:41: start 5913.000000, end 6162.000000
    Chapter #0:42: start 6162.000000, end 6344.000000
    Chapter #0:43: start 6344.000000, end 6966.000000
    Chapter #0:44: start 6966.000000, end 7244.000000
    Chapter #0:45: start 7244.000000, end 7327.000000
    Chapter #0:46: start 7327.000000, end 7449.000000
    Chapter #0:47: start 7449.000000, end 7496.000000
    Chapter #0:48: start 7496.000000, end 7643.000000
    Chapter #0:49: start 7643.000000, end 7764.000000
    Chapter #0:50: start 7764.000000, end 7900.000000
    Chapter #0:51: start 7900.000000, end 8273.152000
  Stream #0:0: Video: hevc (Main 10), yuv420p10le(tv, bt709, progressive), 3658x2074 [SAR 1:1 DAR 1829:1037], 23.98 fps, 23.98 tbr, 1k tbn (default) (original)
    Metadata:
      ENCODER         : Lavc59.48.100 libx265
      DURATION        : 02:17:52.640000000
  Stream #0:1: Audio: aac (LC), 48000 Hz, 5.1, fltp (default) (original)
    Metadata:
      ENCODER         : Lavc59.48.100 libfdk_aac
      DURATION        : 02:17:53.184000000
  Stream #0:2(eng): Subtitle: subrip (default) (original)
    Metadata:
      DURATION        : 02:10:31.323000000
  Stream #0:3(eng): Subtitle: subrip (original) (hearing impaired)
    Metadata:
      title           : SDH
      DURATION        : 02:10:31.323000000
  Stream #0:4(ara): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.378000000
  Stream #0:5(dan): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.462000000
  Stream #0:6(ger): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.577000000
  Stream #0:7(spa): Subtitle: subrip
    Metadata:
      DURATION        : 02:13:02.971000000
  Stream #0:8(spa): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.592000000
  Stream #0:9(fin): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.637000000
  Stream #0:10(fil): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:41.750000000
  Stream #0:11(fre): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.542000000
  Stream #0:12(hin): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.652000000
  Stream #0:13(ita): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.584000000
  Stream #0:14(jpn): Subtitle: subrip
    Metadata:
      DURATION        : 02:10:31.329000000
  Stream #0:15(kor): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.693000000
  Stream #0:16(may): Subtitle: subrip
    Metadata:
      DURATION        : 02:10:31.576000000
  Stream #0:17(dut): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.612000000
  Stream #0:18(nor): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.543000000
  Stream #0:19(pol): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.577000000
  Stream #0:20(por): Subtitle: subrip
    Metadata:
      DURATION        : 02:13:02.993000000
  Stream #0:21(por): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.533000000
  Stream #0:22(rum): Subtitle: subrip
    Metadata:
      DURATION        : 02:10:31.780000000
  Stream #0:23(rus): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.615000000
  Stream #0:24(swe): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.585000000
  Stream #0:25(tur): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.519000000
  Stream #0:26(chi): Subtitle: subrip
    Metadata:
      DURATION        : 02:10:31.510000000
  Stream #0:27(chi): Subtitle: subrip
    Metadata:
      DURATION        : 02:17:51.767000000
File 'output.mkv' already exists. Overwrite? [y/N] y
Stream mapping:
  Stream #0:0 -> #0:0 (hevc (native) -> h264 (h264_vaapi))
  Stream #0:1 -> #0:1 (aac (native) -> vorbis (libvorbis))
  Stream #0:2 -> #0:2 (subrip (srt) -> ass (ssa))
Press [q] to stop, [?] for help
[h264_vaapi @ 0x85bf5d400] No quality level set; using default (20).
Output #0, matroska, to 'output.mkv':
  Metadata:
    encoder         : Lavf60.3.100
  Chapters:
    Chapter #0:0: start 0.043000, end 9.043000
    Chapter #0:1: start 9.043000, end 42.043000
    Chapter #0:2: start 42.043000, end 132.043000
    Chapter #0:3: start 132.043000, end 289.043000
    Chapter #0:4: start 289.043000, end 297.043000
    Chapter #0:5: start 297.043000, end 477.043000
    Chapter #0:6: start 477.043000, end 525.043000
    Chapter #0:7: start 525.043000, end 636.043000
    Chapter #0:8: start 636.043000, end 750.043000
    Chapter #0:9: start 750.043000, end 803.043000
    Chapter #0:10: start 803.043000, end 831.043000
    Chapter #0:11: start 831.043000, end 1029.043000
    Chapter #0:12: start 1029.043000, end 1131.043000
    Chapter #0:13: start 1131.043000, end 1253.043000
    Chapter #0:14: start 1253.043000, end 1413.043000
    Chapter #0:15: start 1413.043000, end 1807.043000
    Chapter #0:16: start 1807.043000, end 1935.043000
    Chapter #0:17: start 1935.043000, end 2081.043000
    Chapter #0:18: start 2081.043000, end 2180.043000
    Chapter #0:19: start 2180.043000, end 2255.043000
    Chapter #0:20: start 2255.043000, end 2469.043000
    Chapter #0:21: start 2469.043000, end 2571.043000
    Chapter #0:22: start 2571.043000, end 2968.043000
    Chapter #0:23: start 2968.043000, end 2998.043000
    Chapter #0:24: start 2998.043000, end 3081.043000
    Chapter #0:25: start 3081.043000, end 3117.043000
    Chapter #0:26: start 3117.043000, end 3284.043000
    Chapter #0:27: start 3284.043000, end 3430.043000
    Chapter #0:28: start 3430.043000, end 3655.043000
    Chapter #0:29: start 3655.043000, end 3817.043000
    Chapter #0:30: start 3817.043000, end 3961.043000
    Chapter #0:31: start 3961.043000, end 4142.043000
    Chapter #0:32: start 4142.043000, end 4327.043000
    Chapter #0:33: start 4327.043000, end 4923.043000
    Chapter #0:34: start 4923.043000, end 5086.043000
    Chapter #0:35: start 5086.043000, end 5267.043000
    Chapter #0:36: start 5267.043000, end 5446.043000
    Chapter #0:37: start 5446.043000, end 5551.043000
    Chapter #0:38: start 5551.043000, end 5650.043000
    Chapter #0:39: start 5650.043000, end 5745.043000
    Chapter #0:40: start 5745.043000, end 5913.043000
    Chapter #0:41: start 5913.043000, end 6162.043000
    Chapter #0:42: start 6162.043000, end 6344.043000
    Chapter #0:43: start 6344.043000, end 6966.043000
    Chapter #0:44: start 6966.043000, end 7244.043000
    Chapter #0:45: start 7244.043000, end 7327.043000
    Chapter #0:46: start 7327.043000, end 7449.043000
    Chapter #0:47: start 7449.043000, end 7496.043000
    Chapter #0:48: start 7496.043000, end 7643.043000
    Chapter #0:49: start 7643.043000, end 7764.043000
    Chapter #0:50: start 7764.043000, end 7900.043000
    Chapter #0:51: start 7900.043000, end 8273.195000
  Stream #0:0: Video: h264 (Main) (H264 / 0x34363248), vaapi(tv, bt709, progressive), 3840x2160 [SAR 16461:16592 DAR 1829:1037], q=2-31, 23.98 fps, 1k tbn (default) (original)
    Metadata:
      DURATION        : 02:17:52.640000000
      encoder         : Lavc60.3.100 h264_vaapi
  Stream #0:1: Audio: vorbis (oV[0][0] / 0x566F), 48000 Hz, 5.1, fltp (default) (original)
    Metadata:
      DURATION        : 02:17:53.184000000
      encoder         : Lavc60.3.100 libvorbis
  Stream #0:2(eng): Subtitle: ass (default) (original)
    Metadata:
      DURATION        : 02:10:31.323000000
      encoder         : Lavc60.3.100 ssa
[libvorbis @ 0x85bf5dc00] Queue input is backward in time60 bitrate=   6.1kbits/s speed=2.96x    
frame=  364 fps= 67 q=-0.0 Lsize=   23179kB time=00:00:15.56 bitrate=12199.1kbits/s speed=2.88x  

As you can see in the image, the processor load is very low during the transcode, confirming the use of the iGPU:

Possibly, some of the filter parameters passed by Jellyfin are causing the issue. The thing is, it's not about problems with drivers or even issues with FFmpeg. Everything should be working. I'll be investigating further the parameters that Jellyfin passes to FFmpeg.

For instance, if I attempt to remove the parameter -filter:v "scale_vaapi=w=3840:h=2160:format=nv12" from the command mentioned above, the conversion will fail. So, a minor change in the filter parameters can lead to a total transcoding failure.

As we can see in the Jellyfin command issued to FFmepg, the filter selection is a bit complex and harder to grasp:

ffmpeg -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -analyzeduration 200M -i "file:/mnt/downloads/Noah (2014) [2160p] [4K] [WEB] [5.1] [YTS.MX]/Noah.2014.2160p.4K.WEB.x265.10bit.AAC5.1-[YTS.MX].mkv" -map_metadata -1 -map_chapters -1 -threads 0 -map 0:0 -map 0:1 -map -0:s -codec:v:0 h264_vaapi -rc_mode VBR -b:v 6388419 -maxrate 6388419 -bufsize 12776838 -force_key_frames:0 "expr:gte(t,0+n_forced*3)" -vf "setparams=color_primaries=bt709:color_trc=bt709:colorspace=bt709,scale=trunc(min(max(iw\,ih*a)\,min(3658\,2074*a))/2)*2:trunc(min(max(iw/a\,ih)\,min(3658/a\,2074))/2)*2,format=nv12,hwupload=derive_device=vaapi" -codec:a:0 aac -ac 2 -ab 384000 -ar 48000 -af "volume=2" -copyts -avoid_negative_ts disabled -max_muxing_queue_size 2048 -f hls -max_delay 5000000 -hls_time 3 -hls_segment_type mpegts -start_number 0 -hls_segment_filename "/var/db/jellyfin/transcodes/6165c611a2803daab963a55b0fe28af3%d.ts" -hls_playlist_type vod -hls_list_size 0 -y "/var/db/jellyfin/transcodes/6165c611a2803daab963a55b0fe28af3.m3u8"

For now, I appreciate the help and time dedicated to assist me.

[gmsotavio]

@Thefrank I managed to make it work (manually). I'm almost there.

Params that Jellyfin passes to lffmpeg:

-analyzeduration 200M -i "file:/mnt/downloads/Noah (2014) [2160p] [4K] [WEB] [5.1] [YTS.MX]/Noah.2014.2160p.4K.WEB.x265.10bit.AAC5.1-[YTS.MX].mkv" -map_metadata -1 -map_chapters -1 -threads 0 -map 0:0 -map 0:1 -map -0:s -codec:v:0 h264_vaapi -rc_mode VBR -b:v 6388419 -maxrate 6388419 -bufsize 12776838 -force_key_frames:0 "expr:gte(t,0+n_forced*3)" -vf "setparams=color_primaries=bt709:color_trc=bt709:colorspace=bt709,scale=trunc(min(max(iw\,ih*a)\,min(3658\,2074*a))/2)*2:trunc(min(max(iw/a\,ih)\,min(3658/a\,2074))/2)*2,format=nv12,hwupload=derive_device=vaapi" -codec:a:0 aac -ac 2 -ab 384000 -ar 48000 -af "volume=2" -copyts -avoid_negative_ts disabled -max_muxing_queue_size 2048 -f hls -max_delay 5000000 -hls_time 3 -hls_segment_type mpegts -start_number 0 -hls_segment_filename "/var/db/jellyfin/transcodes/6165c611a2803daab963a55b0fe28af3%d.ts" -hls_playlist_type vod -hls_list_size 0 -y "/var/db/jellyfin/transcodes/6165c611a2803daab963a55b0fe28af3.m3u8"

After making several modifications, the results are as follows:

-analyzeduration 200M -i "file:/mnt/downloads/Noah (2014) [2160p] [4K] [WEB] [5.1] [YTS.MX]/Noah.2014.2160p.4K.WEB.x265.10bit.AAC5.1-[YTS.MX].mkv" -map_metadata -1 -map_chapters -1 -threads 8 -map 0:0 -map 0:1 -map -0:s -codec:v:0 h264_vaapi -rc_mode VBR -b:v 6388419 -maxrate 6388419 -bufsize 12776838 -force_key_frames:0 "expr:gte(t,0+n_forced*3)" -vf "setparams=color_primaries=bt709:color_trc=bt709:colorspace=bt709,scale_vaapi=trunc(min(max(iw\,ih*a)\,min(3658\,2074*a))/2)*2:trunc(min(max(iw/a\,ih)\,min(3658/a\,2074))/2)*2:format=nv12" -codec:a:0 aac -ac 2 -ab 384000 -ar 48000 -af "volume=2" -copyts -avoid_negative_ts disabled -max_muxing_queue_size 2048 -f hls -max_delay 5000000 -hls_time 3 -hls_segment_type mpegts -start_number 0 -hls_segment_filename "/var/db/jellyfin/transcodes/6165c611a2803daab963a55b0fe28af3%d.ts" -hls_playlist_type vod -hls_list_size 0 -y "/var/db/jellyfin/transcodes/6165c611a2803daab963a55b0fe28af3.m3u8"
Et voilà!

What I have changed

Aditionally, It will be necessary to add -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -analyzeduration to lffmpeg:

# cat /usr/local/bin/lffmpeg 
#!/bin/sh
echo "$@" > /tmp/params
ffmpeg -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi "$@"

Now, I need to find a way to modify the parameters passed to lffmpeg before they are fed to the ffmpeg executable. I'm unsure if this is possible.

[Thefrank]

If jellyfin assumes that you are using FFmpeg v5 instead of v6 it might explain some of the args being passed oddly. The API between 4->5->6 are all slightly different

[johndodigie]

Hi @gmsotavio,
currently having the same problem with the same hardware. Where you able to find a fix and make transcoding work?

[gmsotavio]

Hello @johndodigie,

I am still investigating the cause of the problem. Here are some clarifications:

• Yes, hardware transcoding using the GPU integrated into the processor (Intel UHD 630) works perfectly on FreeBSD and even better within a FreeBSD jail. This was proven in my previous comments, where I manually passed the transcoding parameters to ffmpeg. Therefore, it doesn't seem to be a problem with drivers or FreeBSD support.
• It seems that the way Jellyfin constructs the command to pass to ffmpeg, including all flags and options, is incorrect and prevents hardware transcoding from being enabled, resulting in a fallback to software transcoding.

My two assumptions when analyzing the Jellyfin source code are:

• Examining the Jellyfin source code, I noticed that at various points to initiate transcoding, checks like "if (operating_system == Linux) or Windows" are made. Clearly, FreeBSD is not supported at the source code level, which usually leads to an "else" block that generates different processing. I don't know what the impact on FreeBSD would be, as ffmpeg on Linux and FreeBSD is the same. Perhaps @Thefrank, the project's author, can help us understand how FreeBSD is treated in Jellyfin.
• It's possible that the incorrect parameters Jellyfin passed to ffmpeg (as observed in my last comment) are due to Jellyfin on Linux using a modified version of ffmpeg jellyfin-ffmpeg. However, it's hard to believe that they changed something in the command line; most likely, the modification is internal to ffmpeg. As I'm not aware of the differences between the upstream ffmpeg and jellyfin-ffmpeg, this remains only a hypothesis.
• @Thefrank made a comment about the possibility that the ffmpeg version 6 I was using might not be supported by Jellyfin. However, upon checking the Jellyfin source code, I found that it supports all versions and checks the installed ffmpeg version on the system to create the command correctly before passing it to ffmpeg.

Currently, I am using software transcoding, but I would very much like to enable hardware transcoding, as I have already proven that it works perfectly in FreeBSD jails and would significantly alleviate the load on my processor.

[Thefrank]

I should have some free time after the holidays to deep-dive this issue. A quick glance seems to point at requiring some source changes to support VAAPI. As pointed out, it already does a good job of determine which version of FFmpeg is being used; it should be able to use .git builds or even builds with mangled versions.

https://github.com/jellyfin/jellyfin/blob/660165cd2ff6288061a90c968381eb014ec3b7fd/MediaBrowser.MediaEncoding/Encoder/EncoderValidator.cs#L352-#L357

https://github.com/jellyfin/jellyfin/blob/660165cd2ff6288061a90c968381eb014ec3b7fd/MediaBrowser.MediaEncoding/Encoder/MediaEncoder.cs#L200-#L207

This (hopefully) is just an || away from working. dotNET has understood what OperatingSystem.IsFreeBSD() is since NET5 https://learn.microsoft.com/en-us/dotnet/api/system.operatingsystem.isfreebsd?view=net-8.0 and OSPlatform.FreeBSD since Core 3.0 https://learn.microsoft.com/en-us/dotnet/api/system.runtime.interopservices.osplatform.freebsd?view=net-8.0