aioprocessing

What it is and what it does

aioprocessing wraps the standard library's multiprocessing module to make its blocking methods awaitable in asyncio code. Instead of reimplementing multiprocessing with async I/O, it delegates blocking calls to a ThreadPoolExecutor, allowing you to use familiar multiprocessing APIs (Queue, Lock, Process, Pool, Semaphore, Barrier, etc.) inside async coroutines without blocking the event loop.

The library adds a coroutine version of each blocking method—for example, `Lock.acquire()` becomes `AioLock.coro_acquire()`—and provides Aio-prefixed classes that drop into existing multiprocessing code. It also supports optional universal pickling via dill for cases where the standard pickle module is insufficient. This is useful when you need inter-process communication or worker pools within an asyncio application, though it introduces thread overhead and inherits the thread-fork mixing risks of the underlying multiprocessing module.

Use it for

• Running CPU-bound worker processes from an async web framework without blocking the event loop.
• Coordinating multiple processes using asyncio-compatible locks, events, and queues in a single async application.
• Building async task queues that dispatch work to separate processes while maintaining async/await syntax.
• Mixing asyncio coroutines with multiprocessing Pool callbacks in a unified async control flow.
• Implementing inter-process synchronization primitives (Barrier, Condition) in async code.

Worth the install?

AI-flagged interpretation of the facts on this page. Verify before relying on it.

Install

aioprocessing on PyPI

Before you install

Installation is straightforward with no runtime dependencies. However, the package is in abandoned maintenance status with the last commit in September 2022. It remains functional for its stated purpose but will not receive bug fixes or updates.

Requires Python 3.5 or later. Thread-fork mixing caveats apply when combining with multiprocessing; coroutines cannot be cancelled since work in executor threads cannot be interrupted.

License in practice

Licensed under BSD (permissive), which allows free use, modification, and distribution with minimal restrictions—suitable for both open-source and commercial projects.

Quickstart

pip install aioprocessing

import asyncio
import aioprocessing

async def main():
    queue = aioprocessing.AioQueue()
    lock = aioprocessing.AioLock()
    result = await queue.coro_get()
    async with lock:
        await queue.coro_put(None)

asyncio.run(main())

Package facts

Evidence: aioprocessing-2.0.1-py3-none-any.whl

Tags

More Python Modules packages

See also aiomultiprocess · asyncio · asyncio-pool · mode-streaming · molotov · threaded · bounded-pool-executor · blockbuster · aioshutil · mpire