Access & ServingClosest to model workloads17Model API gateways6LiteLLM92.2OpenRankRISINGOmniRoute31.9OpenRankMCP Context Forge30.4OpenRankAgentGateway17.5OpenRankNew API11OpenRankHigress5.3OpenRankServing / Deploy3Ollama167OpenRankNVIDIA Dynamo115.9OpenRankllm-d19.7OpenRankServing / Inference8SGLang215OpenRankvLLM189.1OpenRankTensorRT-LLM145.8OpenRankllama.cpp90.5OpenRankvLLM Omni54.3OpenRankONNX Runtime46.9OpenRankOpenVINO27.3OpenRankLMCache18OpenRank
Model TrainingPost-train and pre-train systems25Post-Train / Reinforcement learning4Verl22.9OpenRankTRL22.8OpenRankRLinf10.1OpenRankAReaL6.5OpenRankPost-Train / Supervised fine-tuning3Unsloth28.5OpenRankms-swift13.7OpenRankLLaMA Factory—OpenRankPre-Train / Framework & parallel6PyTorch333.3OpenRankJAX121.5OpenRankMegatron-LM32.4OpenRankPaddlePaddle23.9OpenRankTensorflow9.6OpenRankDeepSpeed5.7OpenRankPre-Train / Compiler & accelerator8Flashinfer147.8OpenRankTriton42OpenRankNVIDIA Model Optimizer36.9OpenRankTransformer Engine17.7OpenRankOpenXLA11.5OpenRankCUTLASS6OpenRankFlashAttention5.4OpenRankDeepEP—OpenRankPre-Train / Evaluation & observability2Weights & Biases33.9OpenRankMLflow31.5OpenRankPre-Train / Robotics infra2LeRobot9.8OpenRankOpenMind OM1—OpenRank
Data & ComputeFoundation for model development16Data / Labeling2CVAT6.3OpenRankLabel Studio2OpenRankData / Integration3Apache Airflow98.3OpenRankRISINGDocling40.2OpenRankAirbyte20.6OpenRankData / Governance7OpenMetadata47.5OpenRankDataHub39OpenRankApache Iceberg34.9OpenRankApache Hudi24.4OpenRankApache Gravitino22OpenRankApache Paimon16.4OpenRankDelta Lake15.7OpenRankCompute & scheduling4Ray71.5OpenRankApache Spark68.2OpenRankVolcano9.7OpenRankKserve9.6OpenRank