Groq CEO Jonathan Ross identified two key issues hindering ChatGPT and similar Large Language Models: latency and the high cost of compute. Ross stated that current AI models are too slow for seamless, real-time interaction, suggesting the 'typing' effect masks processing delays. He also highlighted the unsustainable economic and environmental costs associated with scaling these models, arguing that the current development trajectory is not viable for most companies. Ross's company, Groq, offers LPUs designed to address these speed and cost challenges.