Disclaimer: We may earn a commission if you make any purchase by clicking our links. Please see our detailed guide here.

Follow us on:

Google News
Whatsapp

Our AI Supercomputer Will Be the World’s Fastest This Year: Meta

IANS
IANS
Meet the voice behind Indo-Asian News Service (IANS), a storyteller navigating the currents of global events with precision and depth. Crafting narratives that bridge cultures, IANS brings you the pulse of the world in every word

Join the Opinion Leaders Network

Join the Techgenyz Opinion Leaders Network today and become part of a vibrant community of change-makers. Together, we can create a brighter future by shaping opinions, driving conversations, and transforming ideas into reality.

Meta (formerly Facebook) has built an AI supercomputer that, it claims, will be the fastest in the world when it’s fully ready in mid-2022.

The AI Research SuperCluster (RSC) is already being used by Meta researchers to train large models in natural language processing (NLP) and computer vision for research, with the aim of training models with trillions of parameters in the near future.

RSC will help Meta’s AI researchers build new and better AI models that can learn from trillions of examples; work across hundreds of different languages; seamlessly analyse text, images, and video together; develop new augmented reality tools; and much more, – Meta engineers Kevin Lee and Shubho Sengupta said in a statement late on Monday.

The first generation of this infrastructure, designed in 2017, has 22,000 NVIDIA V100 Tensor Core GPUs in a single cluster that performs 35,000 training jobs a day.

“We wanted this infrastructure to be able to train models with more than a trillion parameters on data sets as large as an exabyte — which, to provide a sense of scale, is the equivalent of 36,000 years of high-quality video,” said Meta researchers.

Compared with Meta’s legacy production and research infrastructure, early benchmarks on RSC have shown that it runs computer vision workflows up to 20 times faster and trains large-scale NLP models three times faster.

That means a model with tens of billions of parameters can finish training in three weeks, compared with nine weeks before.

RSC is up and running today, but its development is ongoing. Once we complete phase two of building out RSC, we believe it will be the fastest AI supercomputer in the world, performing at nearly 5 exaflops of mixed precision compute, – said Meta.

By 2022, Meta will work to increase the number of GPUs from 6,080 to 16,000, which will increase AI training performance by more than 2.5x.

The storage system will have a target delivery bandwidth of 16 TB/s and exabyte-scale capacity to meet increased demand, the company added.

Recomended

Partner With Us

Digital advertising offers a way for your business to reach out and make much-needed connections with your audience in a meaningful way. Advertising on Techgenyz will help you build brand awareness, increase website traffic, generate qualified leads, and grow your business.

Power Your Business

Solutions you need to super charge your business and drive growth

More from this topic