The /usr/bin/java and other related tools are macOS shims that run a specific version of Java, as defined by the JAVA_HOME variable.

This variable is usually set in your ~/.bashrc file:

export JAVA_HOME=$(/usr/libexec/java_home -v1.8)`

You can check the current value:

$ echo $JAVA_HOME
/usr/local/Cellar/openjdk@8/1.8.0-392/libexec/openjdk.jdk/Contents/Home

You may have multiple versions of Java installed, to list them all:

$ /usr/libexec/java_home -V
Matching Java Virtual Machines (3):
    21.0.1 (x86_64) "Homebrew" - "OpenJDK 21.0.1" /usr/local/Cellar/openjdk/21.0.1/libexec/openjdk.jdk/Contents/Home
    17.0.9 (x86_64) "Homebrew" - "OpenJDK 17.0.9" /usr/local/Cellar/openjdk@17/17.0.9/libexec/openjdk.jdk/Contents/Home
    1.8.0_392 (x86_64) "Homebrew" - "OpenJDK 8" /usr/local/Cellar/openjdk@8/1.8.0-392/libexec/openjdk.jdk/Contents/Home
/usr/local/Cellar/openjdk/21.0.1/libexec/openjdk.jdk/Contents/Home

In my case, you can see there are three versions of OpenJDK installed via homebrew. I can look them up in the list of installed packages:

$ brew list | grep -iE 'java|jdk|temurin'
openjdk
openjdk@17
openjdk@8

If I wanted to remove all of them, I could do brew uninstall them one by one, or:

(brew list | grep -iE 'java|jdk|temurin'); do brew uninstall $pkg; done

You just need to use these commands

sudo rm -rf /Library/Java/*
sudo rm -rf /Library/PreferencePanes/Java*
sudo rm -rf /Library/Internet\ Plug-Ins/Java*

sudo rm -rf /Library/Java/JavaVirtualMachines/jdk-11.0.5.jdk

Works for me