I've got whisper working in unraid using the whisper-asr-webservice container, but I've noticed there is another whisper model 'faster-whisper', that's supposedly 4x faster than the original.. but, I can't seem to get bazarr to talk to it.

Anyone had any luck using bazarr with linuxserver/faster-whisper?

Is it any good?

I've noticed Bazarr now includes Whisper to generate AI subtitles. I haven't tested it yet but it seems promising. They say the subs are vastly superiour to e.g. Youtube subs.

Did anyone test it?

Hello, I’m configuring Whisperai as a provider on bazarr and I cannot get it to connect. I can type in the local ip address with port 9000 and I can see the interface. How can I fix the error “ConnectionError” on bazarr?

I have a lot of files with no subs that I'm not getting via any of my configured providers. So whisper sounds like it will take care of everything until something better does show up. But the only way I can get transcribed subs from whisper is to search manually and select whisper. Is there something that I need to enable to make this work automatically?

I would like to share my Bazarr Whisper AI setup on Synology. Hope it helps you.

Make sure Bazarr setup is correct

Before we begin, one of the reason you want AI subtitles is because you are not getting subtitles from your providers such as opensubtitles.com. Bazarr works in funny ways and may be buggy at times, but what we can do is make sure we are configuring correctly.

From Bazarr logs, I am only getting subtitles from opensubtitlescom and Gestdown, so I would recommend these two. I only use English ones so if you use other languages you would need to check your logs.

Opensubtitles.com

To use opensubtitles.com in Bazarr you would need VIP. It's mentioned in numerous forums. If you say it works without VIP or login, that's fine. I am not going to argue. It's $20/year I am ok to pay to support them. Just remember to check your Bazarr logs.

For opensubtitle provider configuration, make sure you use your username not email, your password not your token, do not use hash and enable ai subtitles.

For your language settings keep it simple, I only have English, you can have other languages. Deep analyze media, enable default settings for series and movies.

For Subtitle settings use Embedded subtitles, ffprobe, important: enable Upgrading subtitles and set 30 days to go back in history to upgrade and enable upgrade manually downloaded or translated subtitles. Most common mistake is setting days too low and Bazarr gives up before good subtitles are available. Do not enable Adaptive Searching.

For Sonarr and Radarr keep the minimum Score to 0. sometimes opensubtitles may return 0 even when the true score is 90+.

For Scheduler, Upgrade Previously Downloaded Subtitles to every 6 hours. Same for missing series and movies. Sometimes opensubtitles timeout. keeping it 6 hours will retry and also picking up latest subtitles faster.

Lastly, go to Wanted and search all, to download any missing subtitles from OpenSubtitles.

Now we have all the possible subtitles from opensubtitles. the rest we need Whisper AI.

subgen

subgen is Whisper AI but many generations ahead. First of all, it's using faster-whisper, not just whisper, and on top it uses stable-ts, third it support GPU acceleration, and fourth, but not least, it just works with Bazarr. So far this is the best Whisper AI I found.

I recommend to use Nvidia card on Synology to make use of Nvidia AI. with my T400 4GB I get 24-27sec/s transcribe performance. If you are interested check out my post https://www.reddit.com/r/synology/comments/16vl38e/guide_how_to_add_a_gpu_to_synology_ds1820/

If you want to use your NVidia GPU then you need to run the container from command line, here is my run.sh.

#!/bin/bash
docker run --runtime=nvidia --gpus all -e NVIDIA_DRIVER_CAPABILITIES=all -e TRANSCRIBE_DEVICE=gpu -e WHISPER_MODEL="base" -e UPDATE=True -e DEBUG=False -d --name=subgen -p 9000:9000 -v /volume1/nas/Media:/media --restart unless-stopped mccloud/subgen

After running, open your plex address and port 9000 to see the GUI, don't change anything, because Bazarr will send queries to it, the settings in GUI is only for if you want to run something standalone. If you want to know all the options, check out https://github.com/McCloudS/subgen

Whisper AI can only translate to English, it has many models: tiny, base, small, medium and large. From my experience, base is good enough. Also you can choose transcribe only (base.en) or translate and transcribe (base). I choose base because I also watch Anime and Korean shows. For more information check out https://github.com/openai/whisper

To monitor subgen, run the docker logs in terminal

docker logs -f subgen

Go back to Bazarr, add the Whisper AI provider, use subgen endpoint, for me it's http://192.168.2.56:9000 connection timout 3600, transctiption timeout 3600, logging level DEBUG, click Test Connection, you should see subgen version number, click save.

Now go to Wanted and click on any, it should trigger subgen. You can check from the docker log if it's running. Once confirmed, you may just search all and go to bed, with T400 you are looking at 2-3 mins per episode. Eventually all wanted will be cleared. If good you can press ctrl-c in terminal to stop seeing the docker logs. (or you can keep staring and admiring the speed :) ).