Browsing: Inference

AI inference infrastructure provider Modal Labs is nearing a $750 million funding round led by Accel at a $15.75 billion…

The Model Fits, the Requests Don’tVRAM used to be a training-time worry. You sized your cluster for the weights, the…

An Adaptive Model Router in front of your LLM pipeline can cut inference costs by up to 90%, without updating…

Today, we release DSpark draft model checkpoints for three models from our LFM2.5 family: LFM2.5-1.2B-Instruct, LFM2.5-2.6B, and LFM2.5-8B-A1B. These add…

The race for faster AI inference is on, and markets gave Cerebras and its purpose-built chips a warm welcome in…

Ukraine-based app developer MacPaw has partnered up with Liquid AI to power its products with locally hosted AI models, and…

Today, we release two new encoder models on Hugging Face: LFM2.5-Encoder-230M and LFM2.5-Encoder-350M. They match the quality of larger models…

🌍 Learn more about OlmoEarth Platform: https://allenai.org/olmoearth The OlmoEarth models are our family of Earth observation foundation models, pretrained on…

I remember watching the Hollywood mystery thriller Knives Out, leaning towards the screen, as if the case were mine to…

I’ve seen a lot when I’m working with enterprise AI teams: they nearly always blame the model when something goes…