All stories tagged inference on The Silicon Valley News.
AMD's new Threadripper Halo Station pushes the boundaries of local compute, integrating dual MI350P accelerators and massive memory bandwidth to enable trillion-parameter model inference on a workstation.
OpenAI has introduced its custom Jalapeño AI chip, aiming to slash inference latency and costs as the company restructures its infrastructure team to handle physical hardware scaling.
New research from Nvidia demonstrates that structuring AI agents with guardrails, verification loops, and targeted fine-tuning is far more effective for task execution than relying solely on larger, more expensive foundational models.
AMD and Cerebras collaborate to integrate EPYC processors with Cerebras' wafer-scale AI engines in the Helios platform, targeting low-latency, high-throughput AI inference workloads for data centers.