Radar

Chips & infrastructure

AI chips, data centers and cloud computing power. Newest first.

Importance 2 of 5Google Developers Blog

Integrating TorchTPU into TorchTitan and Optimizing Models for TPU

TorchTPU integrates a native torch.device("tpu") backend directly into PyTorch, allowing developers to train large-scale models on Google Cloud TPUs without rewriting code in JAX. The TorchTitan TPU fork enhances this with production-grade scaling primitives like SimpleFSDP, Graph Trainer, and custom Pallas kernels…

Only want news that affects your AI projects?
Track them in Radar and get an alert when a vendor changes something. Free to start.
Start free
Importance 2 of 5Google Developers Blog

Smaller apps and faster GPU inference with LiteRT in Google Play services

LiteRT in Google Play services now offers GPU inference powered by ML Drift, delivering about 1.4x faster performance alongside the new CompiledModel API. Switching from bundled binaries reduces app size by approximately 8 MB while enabling seamless, automatic runtime updates across billions of devices. Developers can…

Importance 2 of 5r/LocalLLaMA

Update: tandem.cpp — DeepSeek-V4.1 on a 64 GB PC with a 16 GB card, and AMD (ROCm) support

Quick update on tandem.cpp, my patch set for llama.cpp that runs MoE models too big for your VRAM faster. It keeps the hot experts on the GPU and lets the CPU help with the rest. Repo: https://github.com/ewhacc/tandem.cpp DeepSeek-V4.1-Flash IQ2_XS (ISTA GSQ-RCO, 139 GiB of experts) on normal PCs Decode tok/s, one…

Importance 2 of 5The Decoder

Anthropic CEO Amodei admits "there's a huge uncertainty in what's going to happen next year" days before a record IPO

Days before what could be the largest IPO in history, Anthropic CEO Dario Amodei called buying compute 'the deepest business dilemma' his company faces. Anthropic's commitments now total nearly $901 billion, and it's still far from clear whether future revenue will justify those costs. The planned IPO is largely meant…

Importance 2 of 5The Decoder

Anthropic can already retrain Mythos with "a fraction of the compute originally needed," says former researcher Coxon

Former OpenAI and Anthropic researcher Jacob Coxon points to a slide from Anthropic's IPO roadshow as a reason he left, saying it shows the company's algorithms are improving not just quickly but at an accelerating rate. Coxon continues to call for a pause on frontier model development so competitors can catch up and…

Importance 2 of 5The Decoder

Jensen Huang's ouster likely traces back to Nvidia's risky business practices more than his personal life

Jensen Huang likely left Nvidia more because of risky business practices than anything else, a Wall Street Journal report suggests. At the very least, those practices made him enemies internally. The company offered cloud providers billions in financial guarantees for chip purchases, including a planned $250 billion…

Importance 2 of 5AWS Machine Learning Blog

Cost-optimizing AssemblyAI speech-to-text inference on AWS with Amazon EC2 Spot

Speech-to-text inference is computationally intensive. Each audio file triggers a pipeline of deep learning models (acoustic models, language models, and post-processing stages) running on NVIDIA GPUs to meet latency requirements. At scale, this means thousands of GPU instances running continuously. AssemblyAI needed…