skillfed

queuelib

Collection of persistent (disk-based) and non-persistent (memory-based) queues

queuelib v1.9.0 3.1M downloads/30d#2,746 on PyPI299
Permissive license BSD-3-Clause Active released

What it is and what it does

Queuelib is a collection library that implements standard queue data structures—FIFO queues, LIFO stacks, priority queues, and round-robin queues—with the option to store them in memory or persist them to disk. Each collection type exposes a simple push/pop API and is designed for speed. The library has no external dependencies and supports modern Python versions from 3.10 onward.

It is typically used in scenarios where you need a durable work queue that survives process restarts, or where you want to manage items with priority or fair distribution across multiple sources. The disk-based variants allow you to queue large numbers of items without keeping them all in RAM, making it useful for batch processing, task scheduling, and buffering workloads.

Use it for:

  • Persist task queues to disk in web scrapers or background job systems to survive restarts
  • Implement priority-based work distribution where higher-priority tasks are processed first
  • Fair-share scheduling across multiple data sources using round-robin dequeuing
  • Buffer large datasets on disk when processing streams that exceed available memory
  • Build durable message queues for offline-first or resilient data pipelines

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Queuelib provides in-memory and disk-persisted queue, stack, priority queue, and round-robin collection implementations with a simple API.

Yes. Queuelib is actively maintained, has no dependencies, supports current Python versions, carries no known vulnerabilities, and offers a straightforward solution for persistent and in-memory queuing. Install it if you need disk-backed queues or priority/round-robin scheduling; skip it if you require thread-safety or distributed queue semantics.

Install

queuelib on PyPI

pip

pip install queuelib

uv

uv add queuelib

poetry

poetry add queuelib

Installing queuelib

Before you install

Low friction: pure Python, no runtime dependencies, and actively maintained with recent releases. Supports Python 3.10 through 3.14 and PyPy.

License in practice

BSD-3-Clause permissive license allows use in commercial and proprietary projects with minimal restrictions.

Quickstart

pip install queuelib

from queuelib import FifoDiskQueue
q = FifoDiskQueue('queuefile')
q.push(b'item')
item = q.pop()
q.close()

Requires Python 3.10 or later. Collections are not thread-safe.

Verify before relying

  • Whether disk-persisted queues survive process crashes or only graceful shutdown
  • Performance characteristics at scale (queue size, throughput limits)
  • Thread-safety workarounds or recommended patterns for concurrent access

Package facts

License BSD-3-Clause (permissive)
Python support supports the current Python release (>=3.10)
Install friction low — pure-Python wheel
Runtime dependencies none
Maintenance actively maintained — 197 days since the last release
Last repo commit
First released
Downloads 3,117,427/month — #2,746 on PyPI (30-day window, as of 2026-08-14)
Known vulnerabilities none known (OSV.dev, checked 2026-08-14)

Evidence: queuelib-1.9.0-py3-none-any.whl

Development Status :: 5 - Production/StableOperating System :: OS IndependentProgramming Language :: PythonProgramming Language :: Python :: 3Programming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Programming Language :: Python :: 3.14Programming Language :: Python :: Implementation :: CPythonProgramming Language :: Python :: Implementation :: PyPy

Tags

disk-based queue implementationpersistent FIFO LIFO queuepriority queue libraryround-robin queuein-memory queue storagequeue data structurepersistent collections
data-structurespersistencetask-queue

More Software Development packages