AI inference startup Modal Labs in talks to raise at $2.5B valuation, sources say
General Catalyst is in talks to lead the round for the four-year-old startup, according to our sources.
inference
Inference startup Inferact lands $150M to commercialize vLLM
The seed round values the newly formed startup at $800 million.
Luminal raises $5.3 million to build a better GPU code framework
Inference optimization startup Luminal has announced $5.3 million in a seed funding round led by Felicis Ventures, with angel investment from Paul Graham, Guillermo Rauch and Ben Porterfield.
Tensormesh raises $4.5M to squeeze more inference out of AI server loads
Tensormesh uses an expanded form of KV Caching to make inference loads as much as ten times more efficient.
Anthropic hires new CTO with focus on AI infrastructure
As part of the change, Anthropic is updating the structure of its core technical group, bringing the company’s product-engineering team into closer contact with the infrastructure and inference teams.
Nvidia unveils new GPU designed for long-context inference
Nvidia’s relentless development cycle has resulted in enormous profits for the company, which brought in $41.1 billion in data center sales in its most recent quarter.