I use it for generating subtitles. It figures out context, it ignores stuttering, it does punctuation etc. It’s really is just better. With clean audio it transcribes like a human does.
It does better than other techniques with dirty audio, but when it fails it fails weird, which is the big issue here.
Whisper really is a lot better when it works, and it’s free. The problem is that it refuses to produce gibberish or give up when it doesn’t work. You’ll always need an editor.
The architecture changed, there is still progress to be made there. But LLMs will forever be stuck in 2021, all data afterwards is tainted. Not a lot has been added.
In fact, Whisper was developed to transcribe videos for more training data, because they ran out of text data. These bad transcriptions are in newer models.
It’s actually extremely good at figuring out confusing text. It gets weird when the audio quality is bad.
I use it for generating subs for obscure movies.
You need an editor for traditional transcription tools too :) and it’s A LOT more work. They don’t even do punctuation or names.