Quantifying FusedMoE for HPC-Ops: Expert Weighting Engineering Details for FP8

HPC-Ops Open Source Interpretation: How Tencent's Hunyuan Production-Grade LLM Inference Operator Library Squeezes Out the Performance of Inference Cards Like H20

1. Abstract HPC-Ops is an open-source, production-grade LLM inference operator library from Tencent's Hunyuan AI Infra team, with the goal of bringing...