OUR PARTNERS

Veon, Beeline, BSC, GSMA Partner to Address AI Language Gap


21 June, 2024

Title: Bridging the AI Language Gap: A Multinational Effort to Include Under-Represented Languages

The digital universe is dominated by a linguistic oligarchy; just a handful of languages out of thousands spoken worldwide are deemed resource-rich in the realm of artificial intelligence. In a striking illustration we recently encountered, a group of figurines was juxtaposed against the backdrop of the term ‘Artificial Intelligence AI’, capturing the essence of a crucial conversation in the tech community. The visual underscores the compelling focus of a notable initiative taken by a consortium that includes telecom giant Veon, mobile operator Beeline Kazakhstan, the esteemed Barcelona Supercomputing Center, and the influential GSMA lobby group. These entities have pledged a collaborative commitment to close the “AI language gap” plaguing under-represented languages.

Within the expansive terrain of AI, large language models serve as the intellectual backbone of ‘bots’ such as those that power ai text generator tools and AI images generator applications. They learn to mimic the complexity of human interaction by absorbing vast amounts of digital content. Consequently, the AI video generator technology and other latest ai news & ai tools often reflect this learning process. Yet, there’s an inherent limitation: not all languages have equal access to these technological advancements due to the scarcity of digital data in certain vernaculars.

The digital prowess of languages is currently monopolized by the likes of English, Spanish, French, Mandarin, Arabic, German, and Japanese. These seven languages are the titans amidst the roughly 7,000 global tongues, known as high-resource languages due to their extensive digital footprint. “This language discrepancy not only impairs the user experience in AI-driven interfaces but also perpetuates biases within AI models and potentially exacerbates the digital divide concerning AI technologies,” the partnership stated.

The recently announced collaboration is poised to tackle this disparity by focusing on the development of essential tools and fostering language model documentation for neglected languages. This includes dialects spoken across countries where Veon serves — Pakistan, Ukraine, Bangladesh, Kazakhstan, Uzbekistan, and Kyrgyzstan — and substantial yet marginalized languages such as Catalan, which boasts around 10 million speakers.

The profound implications of resolving the AI language gap extend beyond user experience. By ensuring that AI understands and communicates in a broader array of languages, the technology becomes more inclusive and equitable. This initiative aims to democratize the AI landscape, ensuring that AI-generated images and texts are reflective of the world’s rich linguistic diversity. As we pursue capabilities like the AI text generator and explore the potential of the artificial intelligence generated images, embracing linguistic plurality becomes integral to progress.

Efforts to bridge the AI language gap will also address the deep-seated biases that currently exist within AI systems. When only dominant languages are taught to AI, it inadvertently creates models that lack cultural and linguistic sensitivity, potentially impacting global users who interact with these technologies daily.

The initiative is an encouraging sign for the future as the collaboration underscores the significance of a multifaceted approach to technological advancement. By coupling the resources and expertise of telecom operators, computing centers, and industry groups, the project could become a gold standard for addressing language disparity in technology.

Beyond the news, this partnership reminds us of the pivotal role collaboration plays in advancing technology for the common good. As AI continues to shape the modern world, efforts like these are crucial for ensuring that its benefits are enjoyed by all, regardless of language. With the continued support of the tech community, we can look forward to a future where the “AI language gap” is a relic of the past, and artificial intelligence tools understand and serve the global population in its intoxicating diversity.