Output-aware Residual Stream Pruning for Large Language Models. It centres on Inference, and also names Perplexity. Reported by arXiv. Bharat Hunt files it under AI Models — the section covering a new or updated model, its capabilities, benchmarks or availability.
Written by Bharat Hunt from the headline and the coverage below. The original reporting is the source of truth.
NVIDIA Vera Rubin NVL72 Delivers Leading Performance in MLPerf Inference v6.1 Debut. It centres on NVIDIA, and also names Inference. Reported by NVIDIA. Bharat Hunt files it under AI Hardware — the section covering chips, accelerators, data centres, on-device inference and supply.
EnterpriseVal: Quantifying the Efficacy, Reliability and Value of Generative AI in the Enterprise. It centres on Benchmarks, and also names Inference. Reported by arXiv. Bharat Hunt files it under Enterprise AI and Generative AI — the section covering deployment inside businesses — platforms, adoption, cost, integration.
Omni Demand Understanding: A Benchmark for Contextual User-Intent Inference in Multimodal Interaction. It centres on Benchmarks, and also names Inference and Multimodal. Reported by arXiv. Bharat Hunt files it under AI Models and AI Agents — the section covering a new or updated model, its capabilities, benchmarks or availability.
AutoViewMem: Self-Configuring Orthogonal Views for Conversational Long-Term Memory. It centres on Benchmarks, and also names Inference. Reported by arXiv. Bharat Hunt files it under AI Models — the section covering a new or updated model, its capabilities, benchmarks or availability.