{"categories":[{"label":"Scientific/Engineering","url":"https://skillfed.io/packages/category/scientific-engineering"},{"label":"Distributed Computing","url":"https://skillfed.io/packages/category/system-distributed-computing"}],"enrichment":{"capability":"Dask Expressions provides query optimization for Dask DataFrames by encoding operations as an expression tree that is optimized before execution, replacing the earlier Dask DataFrame implementation.","skillfed_tags":["query-optimization","distributed-computing","dataframe"],"use_cases":["Optimize large distributed dataframe queries by leveraging automatic expression tree optimization before execution.","Migrate from standard Dask DataFrame to a more efficient backend without changing existing code.","Process time-series and grouped data with better performance through query planning.","Build data pipelines where query optimization can reduce computation time and memory usage.","Work with pandas-like APIs on distributed datasets while benefiting from automatic optimization."],"what_it_does":"Dask Expressions is a rewrite of Dask DataFrame that adds query optimization by representing user operations as an expression tree before execution. Instead of executing operations immediately, the library builds a tree structure encoding the computation, optimizes it (e.g., fusing operations, reordering steps), and then executes the optimized plan. It is designed as a drop-in replacement and has been the default backend for dask.DataFrame since version 2024.3.0.\n\nThe package depends only on dask and installs with low friction. It covers nearly the full Dask DataFrame API, with the exception of named GroupBy Aggregations. It supports modern Python versions (3.10 through 3.13) and is intended for developers and researchers working with distributed data processing at scale.","worth_installing":"Yes. Dask Expressions is the default backend for dask.DataFrame as of version 2024.3.0, making it the standard choice for new Dask DataFrame work. It offers query optimization with low install friction and permissive licensing. Maintenance is dormant but the package is stable and widely used. Install it if you are using Dask DataFrames; it is the recommended path forward."},"id":"dask-expr","links":{"html":"https://skillfed.io/packages/dask-expr","md":"https://skillfed.io/packages/dask-expr.md","pypi":"https://pypi.org/project/dask-expr/"},"maintenance":{"status":"dormant"},"meta":{"latest_release":"2025-01-21","license_spdx":null,"license_treatment":"permissive","name":"dask-expr","python_support":"supports_current","summary":"High Level Expressions for Dask"},"popularity":{"monthly_downloads":10958153,"position":1422,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"2.0.0"}