Prune, Don't Merge: Expert Compression of Mixture-of-Experts LLMs on Multilingual Production Tasks
Prune, Don't Merge: Expert Compression of Mixture-of-Experts LLMs on Multilingual Production Tasks. It centres on Benchmarks, and also names Perplexity. Reported by arXiv. Bharat Hunt files it under AI Hardware and AI Models — the section covering chips, accelerators, data centres, on-device inference and supply.
Written by Bharat Hunt from the headline and the coverage below. The original reporting is the source of truth.