Last Updated on: 7th July 2023, 06:51 am
Google’s New AI is Great At Listening, Speaking, And Translating Languages
Google has been dedicated to harnessing the limitless possibilities of AI for years, and its latest breakthrough is called AudioPaLM. This innovative language model has remarkable listening, speaking, and translation skills and sets a new standard for accuracy.
AudioPaLM represents a multimodal architecture that effectively combines the strengths of two established models: PaLM-2 and AudioLM. PaLM-2 excels at understanding text-specific language knowledge, making it a strong textual language model. Meanwhile, AudioLM demonstrates an exceptional ability to preserve paralinguistic details such as speaker identity and intonation.
By combining these two models, AudioPaLM leverages PaLM-2’s linguistic expertise and AudioLM’s paralinguistic information preservation capabilities, resulting in full text and speech understanding and generation.
To facilitate this integration, AudioPaLM uses a common vocabulary that efficiently represents both speech and text using a finite set of discrete tokens. This unification enables the seamless integration of various tasks, including speech recognition, text-to-speech synthesis, and speech-to-speech translation, within a single architecture and training process.
Extensive research has shown that AudioPaLM outperforms current systems in the field of speech translation and has superior performance. Amazingly, it has the ability to do instant speech-to-text translations for language combinations that you have never encountered before.
In addition, AudioPaLM exhibits the remarkable ability to transfer voices from one language to another using concise voice prompts, making it easy to reproduce different voices in different linguistic contexts.
It’s unclear when this technology will be implemented in final products, but it’s possible that Google Translate and other apps will receive major updates as a result of this development.
Also Read: LinkedIn’s AI Automatically Writes Messages For You
