{"categories":[{"label":"Scientific/Engineering","url":"https://skillfed.io/packages/category/scientific-engineering/5"},{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/6"}],"enrichment":{"capability":"Integrates pretrained transformer models (BERT, RoBERTa, XLNet, GPT-2) into spaCy pipelines via Hugging Face's transformers library, enabling state-of-the-art neural NLP components with automatic tokenization alignment.","skillfed_tags":["transformer-models","spacy-extension","nlp-pipeline"],"use_cases":["Train named entity recognition or text classification on top of BERT embeddings using spaCy's standard training pipeline","Build multi-task NLP systems where one transformer model feeds features to multiple downstream components","Align transformer token outputs to spaCy's linguistic tokenization for languages with complex morphology","Serialize and package transformer-based spaCy models for production deployment with built-in model versioning","Customize which transformer layers and outputs are stored in the Doc object to balance memory and performance"],"what_it_does":"spacy-transformers is a spaCy extension that wraps Hugging Face's transformer models to use them as feature extractors within spaCy pipelines. It handles the integration layer between transformer token outputs and spaCy's tokenization, allowing you to build NLP systems that combine transformer embeddings with spaCy's task-specific components (named entity recognition, text classification, dependency parsing, etc.). The package supports multi-task learning, where a single transformer backbone can backpropagate gradients from multiple downstream components simultaneously.\n\nThe package is designed for developers building production NLP systems who want to leverage state-of-the-art pretrained models without abandoning spaCy's configuration, training, and serialization workflows. It requires PyTorch and spaCy v3.0+, and comes with prebuilt wheels for modern Python versions and common platforms. The main constraint is the size and memory footprint of transformer models themselves\u2014BERT-scale models require significant RAM and benefit from GPU acceleration.","worth_installing":"Yes, if you need transformer models in spaCy. The package is actively maintained, has no known vulnerabilities, and integrates cleanly into spaCy's v3+ ecosystem. Install friction is moderate due to PyTorch and transformers dependencies, but prebuilt wheels cover standard platforms. Not necessary if you only need transformer predictions without spaCy's downstream components\u2014use Hugging Face transformers directly in that case."},"id":"spacy-transformers","links":{"html":"https://skillfed.io/packages/spacy-transformers","md":"https://skillfed.io/packages/spacy-transformers.md","pypi":"https://pypi.org/project/spacy-transformers/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-03-17","license_spdx":null,"license_treatment":"permissive","name":"spacy-transformers","python_support":"supports_current","summary":"spaCy pipelines for pre-trained BERT and other transformers"},"popularity":{"monthly_downloads":271076,"position":8224,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.4.0"}