queuelib
Collection of persistent (disk-based) and non-persistent (memory-based) queues
What it is and what it does
Queuelib is a collection library that implements standard queue data structures—FIFO queues, LIFO stacks, priority queues, and round-robin queues—with the option to store them in memory or persist them to disk. Each collection type exposes a simple push/pop API and is designed for speed. The library has no external dependencies and supports modern Python versions from 3.10 onward.
It is typically used in scenarios where you need a durable work queue that survives process restarts, or where you want to manage items with priority or fair distribution across multiple sources. The disk-based variants allow you to queue large numbers of items without keeping them all in RAM, making it useful for batch processing, task scheduling, and buffering workloads.
Use it for:
- Persist task queues to disk in web scrapers or background job systems to survive restarts
- Implement priority-based work distribution where higher-priority tasks are processed first
- Fair-share scheduling across multiple data sources using round-robin dequeuing
- Buffer large datasets on disk when processing streams that exceed available memory
- Build durable message queues for offline-first or resilient data pipelines
Worth the install?
AI-flagged interpretation of the facts on this page — verify before relying
Queuelib provides in-memory and disk-persisted queue, stack, priority queue, and round-robin collection implementations with a simple API.
Yes. Queuelib is actively maintained, has no dependencies, supports current Python versions, carries no known vulnerabilities, and offers a straightforward solution for persistent and in-memory queuing. Install it if you need disk-backed queues or priority/round-robin scheduling; skip it if you require thread-safety or distributed queue semantics.
Install
queuelib on PyPI
pip
pip install queuelibuv
uv add queuelibpoetry
poetry add queuelibInstalling queuelib
Before you install
Low friction: pure Python, no runtime dependencies, and actively maintained with recent releases. Supports Python 3.10 through 3.14 and PyPy.
License in practice
BSD-3-Clause permissive license allows use in commercial and proprietary projects with minimal restrictions.
Quickstart
pip install queuelib
from queuelib import FifoDiskQueue
q = FifoDiskQueue('queuefile')
q.push(b'item')
item = q.pop()
q.close()
Requires Python 3.10 or later. Collections are not thread-safe.
Verify before relying
- Whether disk-persisted queues survive process crashes or only graceful shutdown
- Performance characteristics at scale (queue size, throughput limits)
- Thread-safety workarounds or recommended patterns for concurrent access
Package facts
| License | BSD-3-Clause (permissive) |
| Python support | supports the current Python release (>=3.10) |
| Install friction | low — pure-Python wheel |
| Runtime dependencies | none |
| Maintenance | actively maintained — 197 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 3,117,427/month — #2,746 on PyPI (30-day window, as of 2026-08-14) |
| Known vulnerabilities | none known (OSV.dev, checked 2026-08-14) |
Evidence: queuelib-1.9.0-py3-none-any.whl
Tags
More Software Development packages
Provides backported and experimental type hints…
permissive · top 100 on PyPI
numpyNumPy provides an N-dimensional array object…
permissive · top 100 on PyPI
fastapiFastAPI is a Python web framework for building…
permissive · top 100 on PyPI
annotated-docProvides a way to document function parameters,…
permissive · top 100 on PyPI
typerTyper builds command-line applications from…
permissive · top 1,000 on PyPI
distlibDistlib provides low-level packaging utilities…
permissive · top 1,000 on PyPI
HeapDictHeapDict is a mutable mapping that acts as a…
permissive · top 15,000 on PyPI
persist-queueProvides thread-safe, disk-based queue…
permissive · top 15,000 on PyPI
azure-storage-queueClient library for interacting with Azure Queue…
permissive · top 1,000 on PyPI
redis-simple-mqA lightweight message queue built on Redis that…
permissive · top 15,000 on PyPI
cacheoutCacheout provides in-memory caching with…
permissive · top 5,000 on PyPI
bullmqBullMQ for Python is a Redis-backed job queue…
permissive · top 5,000 on PyPI
arqarq provides a job queue system for Python that…
permissive · top 5,000 on PyPI
janusProvides a thread-safe queue with both…
permissive · top 5,000 on PyPI
roundrobinProvides four round-robin selection algorithms:…
permissive · top 15,000 on PyPI
sortedcontainersProvides sorted list, dict, and set data…
permissive · top 1,000 on PyPI