Hey,

So I am playing around with voice assistant, and wanted to set it up locally. I set up whisper and piper as below:

  whisper:
    container_name: whisper
    image: rhasspy/wyoming-whisper
    #command: --model base-int8 --language fr
    command: --model tiny-int8 --language en
    privileged: true
    restart: unless-stopped
    environment:
      - TZ=Europe/London
    volumes:
      - /home/pi/docker/home-automation/whisper/data:/data
    ports:
      - 10300:10300

  piper:
    container_name: piper
    image: rhasspy/wyoming-piper
    command: --voice en-gb-southern_english_female-low
    privileged: true
    restart: unless-stopped
    environment:
      - TZ=Europe/London
    volumes:
      - /home/pi/docker/home-automation/piper/data:/data
    ports:
      - 10200:10200

I added assist_pipeline: to my config file.

When I try to add a voice assistant, faster-whisper is greyed out and piper isnt an option,

I have read that you need to configure the addon, but with docker installs there is no configure.

What am I missing?

Hi,

I want to use Home Assistant with Whisper as Docker Container with the following Docker Compose:

version: "3.9"
services:
    Home_Assistant:
        image: homeassistant/home-assistant:latest
        container_name: Home-Assistant
        restart: always
        volumes:
            - ./config:/config
            - ./config/custom_components:/config/custom_components
            - /etc/localtime:/etc/localtime:ro
            - /var/run/docker.sock:/var/run/docker.sock
        network_mode: host

    whisper:
        image: rhasspy/wyoming-whisper
        container_name: whisper
        restart: always
        command: --model tiny-int8 --language en
        volumes:
            - ./data:/data
            - /etc/localtime:/etc/localtime:ro
        ports:
            - 10300:10300

    piper:
        image: rhasspy/wyoming-piper
        container_name: piper
        restart: always
        command: --voice en_US-lessac-medium
        volumes:
            - ./data:/data
            - /etc/localtime:/etc/localtime:ro
        ports:
            - 10200:10200

The container are created successfully and they also start and I can add the Whisper Container via the Wyoming Protocol integration to Home Assistant

but the Integration shows an "Unknown" state all the time

Does anybody know this issue and can help me to fix it?

Thanks!

Not sure where to ask this question, HA github is for bugs only and I feel like community forums are for more of a general advice and this is more of a technical question in unsupported path, but maybe someone here will know.

Just tested the new whisper add-on and it lags pretty badly on my RPi4 and the only sensible model option that actually runs, tiny-int8, has about 40% WER (word error rate) in my language (Polish) which is basically unusable for anything. I wanted to run whisper on an external, beefier server, I made this docker-compose:

services:
  whisper:
    image: homeassistant/amd64-addon-whisper:latest
    container_name: whisper
    ports:
      - 10300:10300
    restart: unless-stopped
    volumes:
      - whisper-data:/data
    entrypoint: python3
    command: -m wyoming_faster_whisper --uri tcp://0.0.0.0:10300 --model tiny-int8 --beam-size 1 --language pl --data-dir /data --download-dir /data
volumes:
  whisper-data:

which in theory runs the same command as the official add-on does. Then I add the wyoming integration in HA with the IP of my docker host 192.168.10.22 and 10300 port. It adds successfully, I can select it as the speech to text option, but when I try to use it in the conversation window it just hangs on listening indefinitely and never do anything.

Nothing in HA logs, whisper docker logs says it's running fine:

INFO:__main__:Downloading FasterWhisperModel.TINY_INT8 to /data
INFO:__main__:Ready

and doesn't output anything when I try to dictate commands. When I run the whisper server health check command:

echo '{ "type": "describe" }' | nc -w 1 192.168.10.22 10300

from the homeassistant container I get this response from the whisper server:

{"type": "info", "data": {"asr": [{"name": "faster-whisper", "attribution": {"name": "Guillaume Klein", "url": "https://github.com/guillaumekln/faster-whisper/"}, "installed": true, "models": [{"name": "tiny-int8", "attribution": {"name": "rhasspy", "url": "https://github.com/rhasspy/models/"}, "installed": true, "languages": ["pl"]}]}], "tts": [], "handle": []}}

which indicates that HA conatiner communicates with whisper server just fine.

Debug assistant unfortunately time outs: https://imgur.com/4RUe1bx

So what am I missing? Can I run whisper server on a different machine somehow at all?