{"categories":[{"label":"HTML","url":"https://skillfed.io/packages/category/text-processing-markup-html"}],"enrichment":{"capability":"Newspaper3k downloads and extracts article text, metadata, images, and keywords from web pages and news sites, with support for multiple languages and multi-threaded processing.","skillfed_tags":["web-scraping","nlp","multilingual"],"use_cases":["Build a news aggregator that discovers and extracts articles from multiple news sites automatically.","Extract article text and metadata from URLs for content curation or archival systems.","Perform bulk text analysis on news articles across multiple languages for research or trend detection.","Automate extraction of article images and videos for content republishing or media analysis.","Generate article summaries and keyword extraction for search indexing or content recommendation."],"what_it_does":"Newspaper3k is a Python library for discovering, downloading, and extracting structured content from web articles and news sites. It automates the process of fetching HTML from a URL, parsing the DOM to isolate article text, and extracting metadata like title, author, publish date, top image, and embedded videos. The library also performs natural language processing to identify keywords and generate summaries.\n\nThe package is designed around simplicity and speed, relying on lxml for fast HTML parsing and requests for HTTP operations. It supports multi-threaded article downloads and can work with news sources in multiple languages. Core use cases include building news aggregators, content curation pipelines, and automated article analysis workflows. Installation requires several system-level dependencies on Linux, and NLP features require downloading language corpora.","worth_installing":"Yes, if you need reliable article extraction from web pages and news sites. The package is actively maintained, has low install friction, carries no security vulnerabilities, and is widely used (top 5000 on PyPI). The MIT license poses no restrictions. Install it if you're building a news aggregator, content pipeline, or article analysis tool; skip it if you only need simple HTML parsing without article-specific extraction logic."},"id":"newspaper3k","links":{"html":"https://skillfed.io/packages/newspaper3k","md":"https://skillfed.io/packages/newspaper3k.md","pypi":"https://pypi.org/project/newspaper3k/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2018-09-28","license_spdx":null,"license_treatment":"permissive","name":"newspaper3k","python_support":"unspecified","summary":"Simplified python article discovery & extraction."},"popularity":{"monthly_downloads":845877,"position":4918,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"0.2.8"}