In a new paper, researchers at Cohere have systematically investigated the impact of code data in LLM pre-training on general performance beyond coding tasks. “While there has been consensus ...