Meta develops a universal AI language translation system for the Metaverse

Metaverse is a concept that is rapidly gaining popularity, and Meta (formerly Facebook) is spearheading the industry, bringing various technological developments to support the future of the internet. We recently learned that Meta is developing a pair of special Metaverse gloves that allow users to touch and feel virtual objects. Now, the company has confirmed that it’s building an AI-powered universal language translation system to allow metaverse users to better communicate with each other.

In a recent Inside the Lab: Building for the metaverse with AI live stream, Meta CEO Mark Zuckerberg detailed a variety of new AI-based technologies his company is currently developing for the metaverse. Among other things, Zuckerberg mentioned that Meta aims to build a universal language translation system to allow users to interact with others in the metaverse without worrying about language barriers.

“The big goal here is to build a universal model that can integrate knowledge across all modalities,” Zuckerberg said. “This will enable a vast scale of predictions, decisions and generation as well as whole new methods of training architectures and algorithms that can learn from a wide and diverse range of different inputs,” he added again.

Now, coming to its plan for developing such a model, the company says it is currently working on two separate AI language translation models. The first, “No language left out“, will be able to learn all languages, even when there is little text available to learn.

“We create a single model capable of translating hundreds of languages ​​with cutting-edge results and most language pairs – from Austrian to Ugandan to Urdu,” Zuckerberg said.

The second model will leverage the company’s M2M-100 modelwhich was unveiled in 2020, to create an AI Babelfish. “The goal here is instant speech-to-speech translation in all languages, even the most widely spoken ones; the ability to communicate with anyone in any language,” Zuckerberg said, further adding to his statements.

Now, these are some important claims that Meta makes. Although the Facebook AI Research team is constantly working on many AI technologies, the company still faces data shortage issues.

Machine translation (MT) systems for text translations typically rely on learning from millions of annotated data sentences. For this reason, machine translation systems capable of high-quality translations have only been developed for the handful of languages ​​that dominate the web,” Meta’s FAIR team wrote in a recent blog post.

So what do you think of Meta’s goal of creating a universal AI-based language translation system for the Metaverse? Let us know your thoughts in the comments below.

Comments are closed.