Google TPU v6e (Trillium)

Google TPU v6e, also called Trillium, is Google’s sixth-generation Cloud TPU, offered in pods of up to 256 chips.

Vendor
Google
Architecture
Trillium (6th-gen TPU)
Memory
32 GB HBM
Memory bandwidth (TB/s)
1.638 TB/s
Form factor
Cloud TPU (8 chips per host, pods up to 256 chips)
Status
Shipping

Google’s Cloud TPU v6e documentation lists 32 GB of HBM per chip at 1,638 GBps, peak compute of 918 TFLOPS in BF16 and 1,836 TOPS in INT8 per chip, 800 GBps of bidirectional inter-chip interconnect bandwidth over four ICI ports, eight chips per host and a 256-chip pod in a 2D torus with 234.9 PFLOPS of BF16 peak compute. Google does not list an FP8 or FP4 figure for v6e, so those fields are blank. Later generations are TPU7x (Ironwood) and the eighth-generation TPU 8t and TPU 8i.

Memory (GB)
32 GB
Precision note (sparse or dense)
Google lists BF16 918 TFLOPS and INT8 1,836 TOPS peak per chip, with no sparse/dense label; no FP8 or FP4 figure is published for v6e. Bandwidth given as 1,638 GBps.
Launch
Offered as Cloud TPU v6e in Google Cloud
Vendor source
cloud.google.com
Checked

Questions

What is Trillium?
Google’s name for TPU v6e, its sixth-generation Cloud TPU.
How much memory does TPU v6e have?
32 GB of HBM per chip, at 1,638 GBps.
What is TPU v6e’s peak compute?
918 TFLOPS in BF16 and 1,836 TOPS in INT8 per chip, per Google’s documentation.
How large is a TPU v6e pod?
256 chips.

Source

Every figure is taken from the vendor’s own datasheet, product page, technical documentation or announcement, linked on each chip with the date it was last checked. How we pick and check sources: editorial standards.

The Model Press

What are you looking for?

Search by headline, topic or keyword.