graphframes-py
GraphFrames: Graph Processing Framework for Apache Spark
Decision gist · record as of 2026-08-14
Yes, if you have a Spark cluster or Spark-Connect server and need distributed graph processing. The package is actively maintained, permissively licensed, and has no known vulnerabilities. The main gotcha is the external JVM dependency—you cannot use this package standalone; it requires a working Spark environment. If you already have Spark and need graph algorithms at scale, it's a solid choice.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Apache Spark cluster or Spark-Connect server with JVM-core dependency installed; Python 3.10 or later; separate GraphX dependency may need manual setup when installing from local repository.
- Low install friction with a pure Python wheel.
- Actively maintained as of 2026-06-17 with recent commits.
License · maintenance · safety
Apache 2.0 (permissive) — Licensed under Apache 2.0 (permissive). You can use, modify, and distribute this package freely in commercial and private projects, provided you include the license notice.
last release 2026-06-17 (58 days) · last repo commit 2026-08-12 · 1,201 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 1,283,535 downloads/mo, #4,114 on PyPI
Alternatives
Verify before relying
pip install graphframes-py
from graphframes import GraphFrame
# Requires a Spark session and graph data (vertices, edges DataFrames)
graph = GraphFrame(vertices, edges)- Whether the package auto-resolves GraphX and other JVM dependencies when installed from PyPI (description notes manual setup may be needed for local installs).
- Specific Spark version compatibility matrix beyond the general reference in documentation.
- Whether Spark-Connect mode is the recommended path for new projects or if classic mode remains the default.
What it is and what it does
GraphFrames is a Python wrapper for the Scala GraphFrames library, enabling distributed graph processing on Apache Spark. It lets you build and analyze graphs at scale using familiar DataFrame-like APIs, supporting operations such as centrality calculations (PageRank), motif discovery, community detection, and graph traversals. The package works with both classic Spark and Spark-Connect, choosing the implementation automatically based on your session type.
The package itself is a thin Python layer—the heavy lifting happens in the JVM via Spark and GraphX. You need to supply your own Spark cluster or Spark-Connect server and ensure the JVM-core and GraphX dependencies are available. It's designed for developers working with network data, social graphs, knowledge graphs, or any large-scale graph problem that benefits from distributed computation.
Use it for
- Compute PageRank and other centrality metrics on large social networks or web graphs in a distributed setting.
- Discover motifs and structural patterns in biological networks, citation graphs, or knowledge graphs.
- Detect communities and clusters in large graphs to identify groups or sub-networks.
- Perform graph traversals and connectivity analysis to find paths, reachability, or connected components.
- Build recommendation systems or link-prediction models using graph algorithms on Spark.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you have a Spark cluster or Spark-Connect server and need distributed graph processing.
The package is actively maintained, permissively licensed, and has no known vulnerabilities. The main gotcha is the external JVM dependency—you cannot use this package standalone; it requires a working Spark environment. If you already have Spark and need graph algorithms at scale, it's a solid choice.
Install
graphframes-py on PyPI
Before you install
Low install friction with a pure Python wheel. Actively maintained as of 2026-06-17 with recent commits. However, the package requires a separate JVM-core dependency and Apache Spark cluster or Spark-Connect server to function—this is a runtime requirement, not a packaging issue.
Requires Apache Spark cluster or Spark-Connect server with JVM-core dependency installed; Python 3.10 or later; separate GraphX dependency may need manual setup when installing from local repository.
License in practice
Licensed under Apache 2.0 (permissive). You can use, modify, and distribute this package freely in commercial and private projects, provided you include the license notice.
Quickstart
pip install graphframes-py
from graphframes import GraphFrame
# Requires a Spark session and graph data (vertices, edges DataFrames)
graph = GraphFrame(vertices, edges)Verify before relying
- Whether the package auto-resolves GraphX and other JVM dependencies when installed from PyPI (description notes manual setup may be needed for local installs).
- Specific Spark version compatibility matrix beyond the general reference in documentation.
- Whether Spark-Connect mode is the recommended path for new projects or if classic mode remains the default.
Package facts
| License | Apache 2.0 permissive |
| Python support | Supports the current Python release >=3.10 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | None |
| Maintenance | Actively maintained 58 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 1,283,535 / month, #4,114 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 4 - BetaIntended Audience :: DevelopersIntended Audience :: Science/ResearchLicense :: OSI Approved :: Apache Software LicenseOperating System :: OS IndependentProgramming Language :: Python :: 3Programming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Topic :: Database :: Front-EndsTopic :: Scientific/Engineering |
Evidence: graphframes_py-0.12.1-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “network analysis pyspark”
- graphframes-pyGraphFrames Python wrapper provides graph processing and analysis on…
- h3-pysparkProvides PySpark bindings for H3, enabling hexagonal geospatial…
- pyspark-stubsProvides type stubs for PySpark to enable static type checking and…
Give your agent the search over MCP, or paste the wish link into any chat.
More Scientific/Engineering packages
NumPy provides an N-dimensional array object and a comprehensive suite of mathematical, linear algebra, Fourier transform, and random number functions for scientific computing in Python.
pandas provides fast, flexible data structures (Series and DataFrame) for loading, cleaning, transforming, and analyzing labeled or relational data in Python.
scipy provides numerical algorithms for mathematics, science, and engineering—including optimization, integration, linear algebra, Fourier transforms, signal and image processing, and ODE solvers—built on numpy arrays.
scikit-learn provides a comprehensive Python library for supervised and unsupervised machine learning, including classification, regression, clustering, dimensionality reduction, and model evaluation tools built on NumPy and SciPy.
Install it if you need to train, evaluate, or deploy supervised or unsupervised learning models.
dill extends Python's pickle module to serialize and deserialize a much wider range of Python objects, including functions, lambdas, classes, and interpreter sessions, to byte streams for storage or network transmission.
Multiprocess is an enhanced fork of Python's standard multiprocessing library that uses dill for better serialization, allowing you to spawn processes with a threading-like API and share complex objects between them.
Install it if you use multiprocessing and encounter pickle serialization limits with lambdas or complex objects.
See also graphframes · sparkmeasure · pyspark-pandas · pyspark · pyspark-client · pyspark-extension · autovizwidget · spark-sklearn · repartipy · graphdatascience