Efficient Expert-Parallel Communication on PCIe-Connected Consumer GPUs

30 Sept 2026Reported by arXiv21

Efficient Expert-Parallel Communication on PCIe-Connected Consumer GPUs. It centres on Inference, and also names vLLM. Reported by arXiv. Bharat Hunt files it under AI Hardware — the section covering chips, accelerators, data centres, on-device inference and supply. Open the original report for the full detail.

Written by Bharat Hunt from the headline and the coverage below. The original reporting is the source of truth.

Read original coverage

Companies, models and people in this story

Reported by arXiv

First seen 30 sept 2026

arXivEfficient Expert-Parallel Communication on PCIe-Connected Consumer GPUs30 Sept 2026Jaehwan Lee

AI Tools24

Measuring the Serving Stack Instead of the Model: Hidden Confounds in Local Tool-Use Evaluation

Measuring the Serving Stack Instead of the Model: Hidden Confounds in Local Tool-Use Evaluation. It centres on Benchmarks, and also names Ollama and Phi. Reported by arXiv. Bharat Hunt files it under AI Tools and AI Models — the section covering applications people use — assistants, editors, search, productivity.

arXiv22 Sept 2026

AI Hardware24

Flide: Accelerating Decision Inference with Exact State Forking

Flide: Accelerating Decision Inference with Exact State Forking. It centres on Inference, and also names vLLM. Reported by arXiv. Bharat Hunt files it under AI Hardware — the section covering chips, accelerators, data centres, on-device inference and supply.

← All AI stories

Efficient Expert-Parallel Communication on PCIe-Connected Consumer GPUs

Companies, models and people in this story

Reported by arXiv

Measuring the Serving Stack Instead of the Model: Hidden Confounds in Local Tool-Use Evaluation

Flide: Accelerating Decision Inference with Exact State Forking

Push-based KV transfer to improve TTFT and TPOT for disaggregated inference in vLLM

Improve TTFT for multi-turn agentic workloads with bi-directional KV transfer in vLLM

Companies, models and people in this story

Reported by arXiv

Related AI coverage

Measuring the Serving Stack Instead of the Model: Hidden Confounds in Local Tool-Use Evaluation

Flide: Accelerating Decision Inference with Exact State Forking

Push-based KV transfer to improve TTFT and TPOT for disaggregated inference in vLLM

Improve TTFT for multi-turn agentic workloads with bi-directional KV transfer in vLLM