#inference

1 tool tagged inference, 2 news items

Groq logo

Groq

4.5

Ultra-fast AI inference platform with blazing speed LLM API

freemium closed-source development
#api #inference #speed +3 more
Learn more → Visit site

News tagged #inference

  1. Microsoft

    Microsoft unveils Maia 300, an inference-first chip

    Microsoft says Maia 300 will deliver 40% more tokens per megawatt than leading GPUs, with Maia 200 now in production and Maia the primary inference system from 2027.

  2. Liquid AI

    Liquid AI ships a DSpark drafter for vision models

    Liquid AI's experimental speculative-decoding draft model for LFM2.5-VL-3B claims up to 3.13x faster decoding on edge devices for an 8.9% parameter increase.