audio transcoding not working

[BotBlake]

Description of the bug

I have a few .wma files that cannot be played by jellyfin-vue.
I assume that this is caused by it having to transcode that but the server failing to do so.

Trying to start playback on finamp results in either "playback starting" but a non moving progress bar, or a never ending loading circle on the progress bar.
It always tells the server we would Direct Play and doesnt tell it that Playback has not actually started yet.

In Jellyfin-Vue it looks like so:

Whilst in the jf-server Admin UI, it looks like its just playing:

From looking at that, it seems like the Client is trying to DirectPlay.
Note that playing back the same file on jf-web and jf-androidtv (even on the same device) results in a Transcode + Transcode log.

This could be caused by two things:

1. Audio transcoding is simply not (yet) supported, and therefore the Client just Direct Plays and doesnt know how to handle unsupported Codecs.
2. Audio transcoding was working previously but broke due to a Server side change in 10.10.x

In case it it option two, you will find more detailed information about this HERE:
jellyfin/jellyfin#12926

Main change is that the "AudioCodec" Parameter must now be send.

Steps to reproduce

1. Get a file that will result in transcoding - e.g. .wma
   For me a ``WMAv2 asf` - File did the trick.

2. Try to start Playback in the Jellyfin-Vue Client

Expected behavior

I would have expected playback to work - Or at the very minimum get an Error message explaining how transcoding is not working.
Generaly having a handler for "unsupported file".

Logs

⚠ An AudioContext was blocked from automatic playback. It must be created or resumed after user interaction with the page.

⚠ Swiper Loop Warning: The number of slides is not enough for loop mode, it will be disabled and not function properly. You need to add more slides (or make duplicates) or lower the values of slidesPerView and slidesPerGroup parameters.

⚠ HTTP-Content-Type "video/x-ms-asf" is not supported. Loading media resource https://<domain>/Audio/<itemid1>/stream.asf?Static=true&mediaSourceId=<itemid1>&DeviceId=<sessionid1>&api_key=<sessionid4>&Tag=<sessionid5>&liveStreamId= failed.

⚠ HTTP-Content-Type "application/vnd.apple.mpegurl" is not supported. Loading media resource https://<domain>/Audio/<itemid1>/master.m3u8?DeviceId=<sessionid1>&MediaSourceId=<itemid1>&AudioCodec=aac&AudioBitrate=192000&PlaySessionId=<sessionid2>&api_key=<sessionid4>&TranscodingMaxAudioChannels=2&RequireAvc=false&EnableAudioVbrEncoding=true&Tag=<sessionid5>&SegmentContainer=ts&MinSegments=1&BreakOnNonKeyFrames=True&TranscodeReasons=ContainerNotSupported,%20VideoCodecNotSupported,%20AudioCodecNotSupported failed.

⚠ Media could not be played. No decoders available for requested formats: video/x-ms-asf, application/vnd.apple.mpegurl.

⚠ HTTP-Content-Type "video/x-ms-asf" is not supported. Loading media resource https://<domain>/Audio/<itemid2>/stream.asf?Static=true&mediaSourceId=<itemid2>&DeviceId=<sessionid1>&api_key=<sessionid4>&Tag=<sessionid6>&liveStreamId= failed.

⚠ HTTP-Content-Type "application/vnd.apple.mpegurl" is not supported. Loading media resource https://<domain>/audio/<itemid2>/master.m3u8?DeviceId=<sessionid1>&MediaSourceId=<itemid2>&AudioCodec=aac&AudioBitrate=192000&PlaySessionId=<sessionid3>&api_key=<sessionid4>&TranscodingMaxAudioChannels=2&RequireAvc=false&EnableAudioVbrEncoding=true&Tag=<sessionid6>&SegmentContainer=ts&MinSegments=1&BreakOnNonKeyFrames=True&TranscodeReasons=ContainerNotSupported,%20VideoCodecNotSupported,%20AudioCodecNotSupported failed.

⚠ Media could not be played. No decoders available for requested formats: video/x-ms-asf, application/vnd.apple.mpegurl.

❌ Uncaught (in promise) DOMException: The media resource indicated by the src attribute or assigned media provider object was not suitable.
    <anonymous> https://<domain>/assets/vendor/vueuse-CYC-mAbS.js:1
    t https://<domain>/assets/vendor/vueuse-CYC-mAbS.js:1
    ve https://<domain>/assets/vendor/vueuse-CYC-mAbS.js:1
    t https://<domain>/assets/vendor/vueuse-CYC-mAbS.js:1
    n https://<domain>/assets/vendor/vueuse-CYC-mAbS.js:1
    ye https://<domain>/assets/vendor/vueuse-CYC-mAbS.js:1
    Kt https://<domain>/assets/vendor/vue-CkZpI52D.js:13
    me https://<domain>/assets/vendor/vue-CkZpI52D.js:9
    Ve https://<domain>/assets/vendor/vue-CkZpI52D.js:9
    K https://<domain>/assets/vendor/vue-CkZpI52D.js:13
    V https://<domain>/assets/vendor/vue-CkZpI52D.js:13
    Kt https://<domain>/assets/vendor/vue-CkZpI52D.js:13

⚠ HTTP-Content-Type "video/x-ms-asf" is not supported. Loading media resource https://<domain>/Audio/<itemid2>/stream.asf?Static=true&mediaSourceId=<itemid2>&DeviceId=<sessionid1>&api_key=<sessionid4>&Tag=<sessionid6>&liveStreamId= failed.

⚠ HTTP-Content-Type "application/vnd.apple.mpegurl" is not supported. Loading media resource https://<domain>/audio/<itemid2>/master.m3u8?DeviceId=<sessionid1>&MediaSourceId=<itemid2>&AudioCodec=aac&AudioBitrate=192000&PlaySessionId=<sessionid3>&api_key=<sessionid4>&TranscodingMaxAudioChannels=2&RequireAvc=false&EnableAudioVbrEncoding=true&Tag=<sessionid6>&SegmentContainer=ts&MinSegments=1&BreakOnNonKeyFrames=True&TranscodeReasons=ContainerNotSupported,%20VideoCodecNotSupported,%20AudioCodecNotSupported failed.

⚠ Media could not be played. No decoders available for requested formats: video/x-ms-asf, application/vnd.apple.mpegurl.

Screenshots

Already present in the main description.

Platform

Windows

Browser

Firefox

Jellyfin server version

10.10.6

Additional context

[Surf6ce]

Im having the same issue with my ALAC albums on arc 1.85.1 (chromium 134.0.6998.45)

[ferferga]

@BotBlake @Surf6ce Can you guys try the deployment at #2607 ?

[BotBlake]

For me trying to play there results in the same behaviour.
Allthough the stack trace in the Console looks different:

❌ Uncaught (in promise)
    Object { stack: "nhttps://97fe01f3.jf-vue.pages.dev/assets/vendor/axios-DxAkJIUI.js:1:525\nu\n<h.onabort@https://97fe01f3.jf-vue.pages.dev/assets/vendor/axios-DxAkJIUI.js:3:588\nnEventHandlerNonNull*unx/</h.onabort@https://97fe01f3.jf-vue.pages.dev/assets/vendor/axios-DxAkJIUI.js:3:586\nnunx@https://97fe01f3.jf-vue.pages.dev/assets/vendor/axios-DxAkJIUI.js:5:190\nAe/<@https://97fe01f3.jf-vue.pages.dev/assets/vendor/axios-DxAkJIUI.js:6:1448\nrequest@https://97fe01f3.jf-vue.pages.dev/assets/vendor/axios-DxAkJIUI.js:5:1596\nAe@https://97fe01f3.jf-vue.pages.dev/assets/vendor/axios-DxAkJIUI.js:6:1124\nnareportPlaybackStopped@https://97fe01f3.jf-vue.pages.dev/assets/vendor/jellyfin-DE1JfPx.js:1:178343\nreportPlaybackStopped@https://97fe01f3.jf-vue.pages.dev/assets/vendor/jellyfin-DE1JfPx.js:1:179687\npromise callback*reportPlaybackStopped@https://97fe01f3.jf-vue.pages.dev/assets/main-BZfLXzoZ.js:1:102599\n", message: "Request aborted", name: "AxiosError", code: "ECONNABORTED", config: {…}, request: XMLHttpRequest }

⚠ A AudioContext was prevented from autoplaying. It must be created or resumed after the user interacts with the page.

⚠ HTTP content type "application/vnd.apple.mpegurl" is not supported. Loading the media resource https://<sourceURL>/audio/b6c34e08-0bb5-aac0-a38e-54058acfc1c9/master.m3u8?DeviceId=<deviceid>.jf-vue.pages.dev&enableAudioVbrEncoding=true&tag=<tag>&SegmentContainer=ts&nSegments=18breakOnNonKeyFrames=true&TranscodeReasons=ContainerNotSupported,%20videoCodecNotSupported,%20AudioCodecNotSupported failed.

⚠ A media could not be played. No decoders for requested formats: application/vnd.apple.mpegurl

Generaly it still looks like its trying to direct play (there is no transcoding log nor any references in the main log that transcoding has started.)

If you need any additional information, please let me know.
I can also DM you the source file with which I am having the issue, so that you can reproduce it localy.

Kind Regards

[ferferga]

To properly fix this, some further refactors are needed: URLs are currently manually constructed, while the SDK already provides methods for constructing the URLs (which are the ones we should be using, since takes into account cases like this automatically).

I currently can't tackle this refactor because I lost my library and I'm in the middle of the reconstruction.

PRs from someone else are of course welcome in the meantime!