Bittensor Subnet Templar Completes Pretraining for Covenant-72B Decentralized LLM
The 72 billion-parameter model reached a 67.1 MMLU zero-shot score, with more than 70 nodes supplying compute and the weights and checkpoints released under the Apache license.