{"categories":[{"label":"Python Modules","url":"https://skillfed.io/packages/category/software-development-libraries-python-modules/13"},{"label":"Text Processing","url":"https://skillfed.io/packages/category/text-processing/2"},{"label":"HTML","url":"https://skillfed.io/packages/category/text-processing-markup-html"}],"enrichment":{"capability":"Extracts article text, metadata, and images from web pages and news sources, with support for multiple languages and automatic summarization.","skillfed_tags":["web-scraping","nlp","news-aggregation"],"use_cases":["Extract article text and metadata from a single URL for content aggregation or archival","Build a news source crawler to discover and download all articles from a website's homepage and category pages","Automatically summarize and extract keywords from articles for content curation dashboards","Parse multilingual news sites by auto-detecting language from meta tags or specifying it explicitly","Integrate Google News as a source to fetch recent articles by country and topic"],"what_it_does":"Newspaper4k is a continuation of the unmaintained newspaper3k library, designed to extract structured article data from web pages and news websites. It downloads and parses HTML to recover article text, authors, publish dates, top images, and embedded media, then applies NLP techniques to extract keywords and generate summaries. The library supports multiple languages through automatic meta-tag detection or explicit configuration, and can build a Source object to discover and download all articles from a news website's front page and RSS feeds using multithreaded downloads.\n\nThe package maintains backward compatibility with newspaper3k's API, so existing code continues to work. It includes a command-line interface for one-off article extraction and special integration with Google News via an optional extra. Core dependencies are standard web-scraping and parsing libraries: beautifulsoup4, lxml, requests, pillow for image handling, feedparser for RSS, and python-dateutil for timestamp parsing.","worth_installing":"Yes. The package is actively maintained, has low install friction, carries no known vulnerabilities, and uses a permissive MIT license. It is well-suited for article scraping and curation tasks where you need structured extraction from HTML. The main gotcha is that bulk scraping can be slow and may trigger IP blocks on news sites; start with small batches and respect robots.txt."},"id":"newspaper4k","links":{"html":"https://skillfed.io/packages/newspaper4k","md":"https://skillfed.io/packages/newspaper4k.md","pypi":"https://pypi.org/project/newspaper4k/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-07-19","license_spdx":"MIT","license_treatment":"permissive","name":"newspaper4k","python_support":"supports_current","summary":"Simplified python article discovery & extraction."},"popularity":{"monthly_downloads":355703,"position":7288,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.9.6"}