All stories tagged inference on The Silicon Valley News.
Intel's new GPU D-Series family, powered by the Crescent Island AI inference accelerator, promises substantial FP8 compute and high memory bandwidth, targeting AI workloads with specific performance metrics.
TypeSafe has secured a $7.5 billion valuation shortly after debuting Jev, a non-text foundation model designed to bypass tokenization bottlenecks and cut inference costs.
EV charging firm Xeal is set to deploy 100,000 Nvidia GPUs across its U.S. network, transforming idle charging infrastructure into a distributed edge inference compute platform.
AMD's new Threadripper Halo Station pushes the boundaries of local compute, integrating dual MI350P accelerators and massive memory bandwidth to enable trillion-parameter model inference on a workstation.
OpenAI has introduced its custom Jalapeño AI chip, aiming to slash inference latency and costs as the company restructures its infrastructure team to handle physical hardware scaling.
New research from Nvidia demonstrates that structuring AI agents with guardrails, verification loops, and targeted fine-tuning is far more effective for task execution than relying solely on larger, more expensive foundational models.
AMD and Cerebras collaborate to integrate EPYC processors with Cerebras' wafer-scale AI engines in the Helios platform, targeting low-latency, high-throughput AI inference workloads for data centers.