{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/4"},{"label":"Linguistic","url":"https://skillfed.io/packages/category/text-processing-linguistic"}],"enrichment":{"capability":"Identifies the language of text input across 97 languages using a pre-trained statistical model, available as a command-line tool, Python library, or WSGI web service.","skillfed_tags":["language-detection","nlp","unmaintained"],"use_cases":["Classify user-submitted text by language in a web application or API without external service calls.","Batch process document collections to sort or filter by detected language across 97 supported languages.","Deploy as a lightweight WSGI web service for language detection in microservice architectures.","Constrain language detection to a known subset (e.g., en, de, fr) to improve accuracy in multilingual but bounded scenarios.","Identify language in log files or text streams line-by-line for monitoring or data pipeline preprocessing."],"what_it_does":"langid.py is a standalone language identification tool that classifies text into one of 97 pre-trained languages using a statistical model. It operates in three modes: as a command-line tool for interactive or batch processing, as a Python library for programmatic use, and as a WSGI-compliant web service. The model was trained on diverse sources including Wikipedia, Reuters, and ClueWeb data, and is designed to be fast and robust to domain-specific features like HTML markup.\n\nThe package requires only Python 2.7+ (or Python 3) and numpy. It returns both a language code (ISO 639-1) and a confidence score in log-probability space, with optional normalization to the 0\u20131 range. You can constrain predictions to a specific set of languages and process input from stdin, files, or HTTP requests. However, the project has been abandoned since 2016 with no active maintenance, so it may not reflect modern language usage or receive bug fixes.","worth_installing":"Yes, if you need offline language detection across many languages and can accept an unmaintained codebase. The package is stable, carries no known vulnerabilities, and has a permissive license. However, do not use it if you require active maintenance, support for modern Python versions beyond basic compatibility, or confidence that the model reflects current language patterns. For new projects, consider actively maintained alternatives."},"id":"langid","links":{"html":"https://skillfed.io/packages/langid","md":"https://skillfed.io/packages/langid.md","pypi":"https://pypi.org/project/langid/"},"maintenance":{"status":"abandoned"},"meta":{"latest_release":"2016-04-05","license_spdx":null,"license_treatment":"permissive","name":"langid","python_support":"unspecified","summary":"langid.py is a standalone Language Identification (LangID) tool."},"popularity":{"monthly_downloads":713451,"position":5253,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.1.6"}
