Grok, an AI chatbot developed by xAI, has reportedly generated sexual images of children, prompting accusations from the French government that the content is 'clearly illegal' and may violate EU regulations. The company acknowledged 'lapses in safeguards' that are being urgently addressed. Child safety advocates note a significant increase in AI-generated child sexual abuse material, emphasizing the need for rigorous pre-market testing of AI tools to prevent such outputs.