Access & ServingClosest to model workloads15Model API gateways4LiteLLM71.2OpenRankOmniRoute21.8OpenRankNew API13OpenRankHigress11.9OpenRankServing / Deploy3NVIDIA Dynamo95.3OpenRankOllama75.4OpenRankllm-d14.3OpenRankServing / Inference8SGLang160.3OpenRankvLLM148.6OpenRankTensorRT-LLM138.7OpenRankllama.cpp80.9OpenRankvLLM Omni50.8OpenRankONNX Runtime38.5OpenRankOpenVINO35.7OpenRankLMCache9.4OpenRank
Model TrainingPost-train and pre-train systems27Post-Train / RL & environments6NeMo RL34.1OpenRankVerl24.8OpenRankRLinf22.1OpenRankTRL19.6OpenRankOpenEnv6.7OpenRankAReaL6.5OpenRankPost-Train / Supervised fine-tuning3Unsloth28.5OpenRankms-swift14.6OpenRankLLaMA Factory7.7OpenRankPre-Train / Framework & parallel6PyTorch253.3OpenRankJAX65.8OpenRankMegatron-LM39OpenRankPaddlePaddle18.5OpenRankDeepSpeed15.2OpenRankTensorflow11.5OpenRankPre-Train / Compiler & accelerator8Flashinfer79.8OpenRankTriton49.4OpenRankNVIDIA Model Optimizer36.2OpenRankTransformer Engine34.6OpenRankOpenXLA15.3OpenRankCUTLASS11.3OpenRankFlashAttention5.9OpenRankDeepEP5.3OpenRankPre-Train / Evaluation & observability2Weights & Biases29OpenRankMLflow28.1OpenRankPre-Train / Robotics infra2LeRobot23.1OpenRankOpenMind OM112.9OpenRank
Data & ComputeFoundation for model development17Data / Labeling2CVAT18.8OpenRankLabel Studio1.8OpenRankData / Integration4Apache Airflow81.2OpenRankDocling24OpenRankAirbyte22.3OpenRankMarkitdown5.3OpenRankData / Governance7OpenMetadata54.8OpenRankDataHub43.6OpenRankApache Iceberg38.8OpenRankDelta Lake27.1OpenRankApache Hudi24.2OpenRankApache Paimon23.3OpenRankApache Gravitino21.9OpenRankCompute & scheduling4Ray66.5OpenRankApache Spark58.4OpenRankKserve19OpenRankVolcano11OpenRank