Giant Step from Google: Introduced its New Artificial Intelligence Accelerator!

45oJ...4Pub
4 Jan 2024
30

By introducing its new AI model, Gemini, Google also unveiled the most effective, extensible and flexible AI accelerator and revolutionary AI hypercomputer it has ever worked on.

Google took a giant step in the field of artificial intelligence and announced its new artificial intelligence accelerator and AI hypercomputer. This innovation puts Google in an important position among the companies that are rapidly advancing in the artificial intelligence market. Following products such as Microsoft's Maia 100 and Amazon's Trainium2, this initiative by Google creates a new competitive area in the industry.

AI accelerator Cloud TPU v5p stands out as the most capable and cost-effective solution Google has offered to date. Each TPU v5p pod contains 8,960 chips, and the connection between these chips occurs at an incredible speed of 4,800 Gbps per chip. This technology means a huge leap in speed and efficiency in the field of artificial intelligence.

Speed ​​​​Increase in Big Language Model Training


One of the most notable features of TPU v5p is that it is 2.8 times faster in training large language models. The new v5p offers twice the FLOPS and three times the memory bandwidth compared to the TPU v4. This allows the training processes of large language models to accelerate and become more efficient.


What are the Features of Google Cloud TPU v5p?


Here are the features of Google Cloud TPU v5p:

  1. 2x more Flops (459 TFLOPs Bf16 / 918 TOPs INT8)
  2. 3 times more memory capacity (95 GB HBM)
  3. 2.8x faster large language model training
  4. 1.9x faster embedded model training
  5. 2.25 times more bandwidth (2765 GB/s vs 1228 GB/s)
  6. 2X inter-chip link speed (4800 Gbps vs 2400 Gbps)

The development of this advanced AI accelerator and AI hypercomputer from Google enables the company to process modern AI workloads more efficiently. The ability of the hypercomputer to optimize its performance according to the processing load makes the adaptation and use of this technology even more valuable.

Write & Read to Earn with BULB

Learn More

Enjoy this blog? Subscribe to tolgasert

1 Comment

B
No comments yet.
Most relevant comments are displayed, so some may have been filtered out.