March 2023 Roadmap its Speech-to-Text API: Speaker Diarization, Word-Level Timestamps and more

Published on Jun 2, 2023
March 2023 Roadmap its Speech-to-Text API: Speaker Diarization, Word-Level Timestamps and more

A glimpse into Gladia's roadmap for its Speech-to-Text API, starting with speaker diarization. We’re incredibly excited to be building our Audio Intelligence product in a community-led way, delivering a holistic final product adapted to the many needs and use cases brought to our attention.

Following Gladia’s Speech-to-Text AI alpha release two weeks ago, we’ve received dozens of new feature requests from the alpha users, to make our core real-time audio transcription API even more exciting and versatile.

We heard you and are happy to announce that the API is growing more robust by the minute and is now available with more capabilities — on top of its blazing speed and top-tier output quality.

We’re incredibly excited to be building our Audio Intelligence product in a community-led way, delivering a holistic final product adapted to the many needs and use cases brought to our attention.

Here’s what we have in store already

Speech-to-Text (STT) Transcription

Setting a new standard for the industry, our STT API is build on OpenAI’s Whisper and can transcribe audio in 10s/h at 3.52%WER. Tested and approved by thousands of alpha users across a range of use cases (e.g. call center, virtual meetings, YouTube videos, podcasts).

Speech-to-Text Translation

Upload your file, select an output language of your choice, and enjoy the final translated transcript free of errors. Currently available in 99 languages, and counting. If your language is not supported yet, drop us a message in this Twitter thread.

Transcription from YouTube URL

Drop a video URL and enjoy a highly accurate output file (.srt or JSON) that can be used as an alternative to YouTube’s auto-captions to improve the viewer’s experience on your channel. Transcription as subtitles file (.srt) will become available shortly too.

And here is the list of new most anticipated features we’re planning to release in March.

Speaker Diarization

You will now be able to automatically identify and recognize all speakers mixed in a single audio or video stream, including when multiple languages are used.

Word-Level Timestamps

A feature enabling Gladia users to produce a highly accurate JSON transcript with time stamps at every word.

Live-Streaming Transcription

We’re adding the ability to transcribe speech in real-time, using your microphone.

We’re preparing a series of deep dives on some of these new features to showcase how our tech works behind the scenes. Stay tuned!

As always, feel free to test the API and give us your feedback  Discord. We truly love iterating with the community.

Contact us

280
Your request has been registered
A problem occurred while submitting the form.

Read more

Speech-To-Text

ASR vs. LLMs – Why voice is among the biggest challenges for AI

When people talk about recent AI advancements, Large Language Models (LLMs) like ChatGPT often steal the limelight. They summarize, write, and generate text with impressive fluency, making them the poster child of generative AI.

Product News

Ultimate guide to using LLMs with speech recognition is here!

Large Language Models (LLMs) have enabled businesses to build advanced AI-driven features, but navigating the many available models and optimization techniques isn't always easy.

Speech-To-Text

What startups should look for in a speech-to-text API

The revolution in both LLMs and voice technology in recent years has opened up unprecedented opportunities for startups. From virtual meeting assistants to AI voice agents, speech-to-text (STT) capabilities are becoming central to modern applications. However, choosing the right STT API provider involves navigating a complex landscape of technical specifications, features, and trade-offs that can significantly impact your product's success.

Read more