{"categories":[{"label":"WWW/HTTP","url":"https://skillfed.io/packages/category/internet-www-http/4"}],"enrichment":{"capability":"A high-performance Python HTTP client for concurrent requests to Baseten embeddings, reranking, and classification endpoints, built with Rust and Tokio to release the GIL during I/O.","skillfed_tags":["rust-backed","concurrent-http","embeddings-client"],"use_cases":["Batch embedding generation for large document corpora using Baseten, OpenAI, or Mixedbread APIs with minimal latency.","Concurrent reranking of search results or document lists with configurable batch sizes and timeouts.","Generic high-throughput POST request batching to any JSON API endpoint outside Baseten.","Async/await integration in event-driven applications needing non-blocking embedding or classification calls.","Performance-critical pipelines where GIL release and connection pooling reduce end-to-end latency."],"what_it_does":"baseten-performance-client is a Python wrapper around a Rust-based HTTP client designed to send high-volume concurrent requests to Baseten's embedding, reranking, and classification APIs. It releases Python's GIL during network I/O, enabling true parallelism for batch operations. The library supports both synchronous and asynchronous usage patterns, with configurable batching, concurrency limits, request timeouts, and connection pooling via HTTP/1.1 or HTTP/2.\n\nThe package is built on pyo3, reqwest, and tokio, and works not only with Baseten endpoints but with any HTTP API accepting JSON POST requests. It offers a RequestProcessingPreference object to tune batch size, concurrent request limits, character limits per request, hedge delays, and total operation timeouts. The library includes response objects for embeddings, reranking, and classification, with optional NumPy integration for embeddings.","worth_installing":"Yes, if you need high-throughput concurrent HTTP requests to embeddings or classification APIs and can tolerate medium install friction. The Rust backend and active maintenance (recent release, 1188 stars) suggest reliability. Verify the license claim before use in proprietary code, and confirm the >1200 rps benchmark applies to your workload. The single runtime dependency (requests) is a plus."},"id":"baseten-performance-client","links":{"html":"https://skillfed.io/packages/baseten-performance-client","md":"https://skillfed.io/packages/baseten-performance-client.md","pypi":"https://pypi.org/project/baseten-performance-client/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-06","license_spdx":null,"license_treatment":"unclear","name":"baseten-performance-client","python_support":"supports_current","summary":"A ultra-high performance package for sending requests to Baseten Embedding Inference'"},"popularity":{"monthly_downloads":461585,"position":6531,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.1.13"}