xBridges

Summary

Checkpoint conversion, serving, and evaluation toolkit for xLLM. Converts tensor-parallel xLLM checkpoints to Hugging Face format (K2HorizonForCausalLM, BF16 safetensors) and back, with multi-node Slurm support; validates conversions by comparing per-token logprobs between xLLM and HF on the same document; registers K2 Horizon with vLLM 0.24, launches multi-node Ray+vLLM servers on Slurm, and runs lm-eval against them.

Keywords

checkpoint conversion · HuggingFace · vLLM · serving · evaluation · K2 Horizon

Topics

checkpoint conversion, model serving, evaluation

Research notes

• Discovery: open-sourced by Xuezhe "Max" Ma (@MaxMa1987, Research Lead @ USC ISI / Asst. Prof. @ USC CS; PhD CMU) on 2026-09-28, quoting an @IFM_AI post on LLM pre-training/fine-tuning rework costs: https://x.com/MaxMa1987/status/2104650088610156753
• Method: checkpoint bridging/serving infra.
• Apache 2.0.
• Created 2026-09-21; 5 stars at research time.