🗣️How to use ASR?
A simple guide on how to use Automatic Speech Recognition
Last updated
A simple guide on how to use Automatic Speech Recognition
Last updated
@Dara.network / Gooey.AI / support@gooey.ai
We find speech recognition and translations important when we create AI workflows for frontline workers, traders, and impact organizations.
In AI copilot scenarios, we found that users prefer to send queries by voice rather than text. This could mean:
voice notes to Whatsapp and web copilots
Voice-based IVR in low internet coverage areas
So as part of our AI Workflow Standards, we now host over 15 ASR models, that can be chained into the AI Copilot workflows.
Here is a simple guide to use the ASR Workflow
Head to the Gooey.AI Speech Recognition and Translation Workflow: https://gooey.ai/speech/
Click on the "Clear all" Button and upload your audio file via a local folder or a link
If you are using a link you can use:
a hosted media link
a google drive link of the audio file
youtube video link
Select the language in "Speech-to-Text Provider" from the dropdown provided.
Use the "Filter by Language" dropdown, if you are unsure which models will work with your source language
Click on the "Translate" checkbox
Select the translation model of your choice
Click on the "Run" button
Q: How do I test the ASR models that can transcribe Swahili?
A: Use the "Filter by Language" dropdown, if you are unsure which models will work with your source language.
Q: In the translate section I can see "Google Translate" and "GhanaNLP", which model should I use?
A: If you are translating an African Language you can test if GhanaNLP is a better choice. GhanaNLP Machine Translation supports: Twi, Ewe, Ga, Fanti, Yoruba, Dagbani, Kikuyu, Fra fra, Luo (Kenya, Tanzania), Meru, Kusaal
Q: I have tested a few models, but I want to evaluate a larger dataset without using the API, is that possible?
A: Yes! It is very easy to set up large-scale ASR evaluations in Gooey! Here is the guide for:
Q: What is the "Prompt" section when I choose GPT4o-Audio?
A: GPT4o-Audio is an LLM-based transcription model, the prompt section will allow you to output the transcribed audio in more specific ways. For example, if you input a Hindi audio sample, you can say "Translate the Hindi recording as accurately as possible". This will use the LLM directly to translate the audio. You could also use it in other innovative ways like "Summarize the Hindi recording to English in bullet points" which could give you the salient points of the recording directly. Like the example here:
How to create language evaluation for ASR?
