Nvidia to Launch New Inference Chip Aimed at Enhancing AI Processing Efficiency

Nvidia is developing a new processor focused on "inference" computing to enable faster, more efficient AI responses, aiming to support clients like OpenAI. The chip, incorporating a design from startup Groq, is expected to be unveiled at Nvidia's GTC conference next month. OpenAI has expressed the need for improved hardware to handle specific AI tasks more quickly. Nvidia's recent licensing deal with Groq reportedly affected OpenAI's chip discussions, while Nvidia also plans significant investment in OpenAI.