{"categories":[{"label":"Linguistic","url":"https://skillfed.io/packages/category/text-processing-linguistic/2"}],"enrichment":{"capability":"torchtext provides text datasets, preprocessing transforms, and pre-trained models for natural language processing tasks in PyTorch, including tokenizers, vocabulary management, and example workflows.","skillfed_tags":["nlp-datasets","pytorch-ecosystem","archived"],"use_cases":["Loading and preprocessing standard NLP benchmarks like AG_NEWS or SST-2 for text classification experiments.","Building machine translation pipelines using Multi30k or IWSLT datasets with transformer models.","Language modeling tasks with WikiText2 or WikiText103 datasets for pretraining or fine-tuning.","Applying scriptable tokenizers (SentencePiece, GPT-2 BPE, BERT) to raw text in production workflows.","Accessing pre-trained RoBERTa or T5 models for transfer learning on downstream NLP tasks."],"what_it_does":"torchtext is a PyTorch utility library for text processing and NLP workflows. It bundles raw text dataset iterators for common benchmarks (WikiText, SQuAD, AG_NEWS, etc.), basic NLP building blocks (tokenization, vocabulary), text transformations, and pre-trained models (RoBERTa, T5, XLM-R). The library depends on torch, numpy, requests, and tqdm.\n\nAs of September 2023, active development has been paused and the repository is archived. The project will receive maintenance releases but no new features. This means the library is stable for existing use cases but will not evolve to support emerging NLP techniques or datasets.","worth_installing":"Yes, but with caution. torchtext remains useful for standard NLP tasks and dataset loading, with no known security vulnerabilities and permissive licensing. However, the abandoned maintenance status (paused since September 2023, archived repository) means no new features or dataset support will be added. Install it if you need its specific datasets or models for existing workflows, but do not expect updates for modern NLP techniques or emerging benchmarks. For new projects, consider actively maintained alternatives."},"id":"torchtext","links":{"html":"https://skillfed.io/packages/torchtext","md":"https://skillfed.io/packages/torchtext.md","pypi":"https://pypi.org/project/torchtext/"},"maintenance":{"status":"abandoned"},"meta":{"latest_release":"2024-04-24","license_spdx":null,"license_treatment":"permissive","name":"torchtext","python_support":"supports_current","summary":"Text utilities, models, transforms, and datasets for PyTorch."},"popularity":{"monthly_downloads":279941,"position":8116,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.18.0"}