Train-to-Test scaling explained: How to optimize your end-to-end AI compute budget for inference

AI reasoning does not necessarily require spending huge amounts on frontier models. Instead, smaller models can yield ...
VentureBeat

What's a NIM? Nvidia Inference Microservices is new approach to gen AI model deployment that could change the industry

Nvidia is aiming to dramatically accelerate and optimize the deployment of generative AI large language models (LLMs) with a new approach to delivering models for rapid inference. At Nvidia GTC today, ...
SiliconANGLE

Fireworks AI raises $250M at $4B valuation to help enterprises with AI inference workloads

Artificial intelligence inference startup Fireworks AI Inc. said today it has raised $250 million in a Series C funding round that brings its valuation to $4 billion. Lightspeed Venture Partners, ...
Seeking Alpha

Oracle and NVIDIA Collaborate to Help Enterprises Accelerate Agentic AI Inference

AUSTIN, Texas, and SAN JOSE, Calif., March 18, 2025 /PRNewswire/ -- GTC -- Oracle and NVIDIA today announced a first-of-its-kind integration between NVIDIA accelerated computing and inference software ...