{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/4"}],"enrichment":{"capability":"Provides gRPC servicer implementations that expose LLM inference engines (vLLM, MLX, TokenSpeed, SGLang) as gRPC services for remote model serving.","skillfed_tags":["llm-inference","grpc-bridge","model-serving"],"use_cases":["Serve a vLLM model over gRPC to multiple remote clients without exposing HTTP endpoints.","Run MLX inference on macOS and expose it as a gRPC service for distributed workloads.","Build a microservice architecture where LLM inference is decoupled from application logic via gRPC.","Load-balance inference requests across multiple backend instances using gRPC service discovery.","Integrate TokenSpeed or SGLang inference into a polyglot system using language-agnostic gRPC clients."],"what_it_does":"smg-grpc-servicer is a bridge library that wraps four popular open-source LLM inference engines\u2014vLLM, MLX, TokenSpeed, and SGLang\u2014behind a unified gRPC interface. Instead of calling each engine's native Python API directly, you run one of the supported backends with gRPC enabled (or via the servicer's CLI modules), and clients connect over gRPC to send inference requests and receive responses.\n\nThe package isolates backend dependencies using optional extras ([vllm], [mlx], [sglang]) so you only install what you need; TokenSpeed integrates via an external runtime. It depends on grpcio, grpcio-reflection, and grpcio-health-checking for service discovery and health checks. The library is actively maintained, supports Python 3.10\u20133.13, and carries no known vulnerabilities.","worth_installing":"Yes. The package solves a real problem\u2014exposing LLM inference engines as gRPC services\u2014with low install friction, active maintenance, permissive licensing, and no known vulnerabilities. Install it if you need to serve LLM inference over gRPC to remote clients or integrate multiple inference backends into a distributed system."},"id":"smg-grpc-servicer","links":{"html":"https://skillfed.io/packages/smg-grpc-servicer","md":"https://skillfed.io/packages/smg-grpc-servicer.md","pypi":"https://pypi.org/project/smg-grpc-servicer/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-07-30","license_spdx":"Apache-2.0","license_treatment":"permissive","name":"smg-grpc-servicer","python_support":"supports_current","summary":"SMG gRPC servicer implementations for LLM inference engines (vLLM, MLX, TokenSpeed, SGLang)"},"popularity":{"monthly_downloads":1118607,"position":4344,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"0.8.0"}