Indeed, Musk suggested that synthetic data — data generated by AI models themselves — is the path forward. “The only way to supplement [real-world data] is with synthetic data, where the AI creates [training data],” he said. “With synthetic data … [AI] will sort of grade itself and go through this process of self-learning.”

The cumulative sum of human knowledge has been exhausted in AI training,” Musk said. “That happened basically last year.”

Elon Musk says he's worried that "we’ve exhausted basically the cumulative sum of human knowledge" for training AIs. The solution: just have the AI make something up. The Latest Tech News, Delivered t