{"categories":[{"label":"Software Development","url":"https://skillfed.io/packages/category/software-development/9"},{"label":"Libraries","url":"https://skillfed.io/packages/category/software-development-libraries/6"},{"label":"Scientific/Engineering","url":"https://skillfed.io/packages/category/scientific-engineering/5"},{"label":"Python Modules","url":"https://skillfed.io/packages/category/software-development-libraries-python-modules/13"},{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/6"}],"enrichment":{"capability":"A Python SDK for discovering, downloading, loading, and running local AI models with OpenAI-compatible chat, embeddings, and audio transcription APIs \u2014 no cloud required.","skillfed_tags":["local-inference","llm-sdk","offline-ai"],"use_cases":["Run private LLM inference on-device without sending data to cloud APIs or paying per-token fees","Build chat applications with streaming responses using OpenAI-compatible client code","Generate text embeddings locally for semantic search or RAG workflows","Transcribe audio files or streams using Whisper models without external services","Prototype and test LLM-powered features before deploying to production infrastructure","Call functions/tools from LLM responses in a local environment with full control"],"what_it_does":"Foundry Local SDK is a Python control plane for running large language models, embeddings, and speech-to-text inference entirely on your local machine. It wraps a native Foundry Local Core library (via ctypes FFI) and provides a model catalog, download/cache management, and OpenAI-compatible APIs for chat completions (streaming and non-streaming), tool calling, embeddings, and Whisper-based audio transcription. The package selects the appropriate ONNX Runtime variant per platform (CUDA on Linux x86_64, CPU/WebGPU elsewhere) and publishes a separate WinML variant for Windows.\n\nYou initialize a singleton manager with a configuration, discover models from the catalog, download and load them into memory, then interact via chat or embedding clients. The SDK handles model lifecycle (load, unload, cache), execution provider discovery and registration, and optional HTTP endpoints for multi-process scenarios. It is actively maintained, recently released, and has no known security vulnerabilities.","worth_installing":"Yes, if you need local LLM inference with OpenAI-compatible APIs and don't require production-grade stability. The package is actively maintained, has low install friction, permissive licensing, and zero known vulnerabilities. It is in Alpha status (Development Status :: 3), so expect API changes and incomplete documentation; verify that the model catalog and hardware support match your target deployment before committing to it."},"id":"foundry-local-sdk","links":{"html":"https://skillfed.io/packages/foundry-local-sdk","md":"https://skillfed.io/packages/foundry-local-sdk.md","pypi":"https://pypi.org/project/foundry-local-sdk/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-07-30","license_spdx":"MIT","license_treatment":"permissive","name":"foundry-local-sdk","python_support":"supports_current","summary":"Foundry Local Manager Python SDK: Control-plane SDK for Foundry Local."},"popularity":{"monthly_downloads":298878,"position":7867,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.2.4"}