{"categories":[{"label":"Software Development","url":"https://skillfed.io/packages/category/software-development/9"},{"label":"Application Frameworks","url":"https://skillfed.io/packages/category/software-development-libraries-application-frameworks/3"},{"label":"Dynamic Content","url":"https://skillfed.io/packages/category/internet-www-http-dynamic-content/2"}],"enrichment":{"capability":"A Django application that manages robots.txt files according to the robots exclusion protocol, allowing you to configure which web crawlers can access which parts of your site.","skillfed_tags":["django-plugin","seo","web-standards"],"use_cases":["Prevent search engines from crawling private or duplicate content areas of your site.","Allow or disallow specific bots (like Googlebot or Bingbot) from accessing certain URL patterns.","Manage crawler traffic to reduce server load by blocking aggressive or unnecessary bots.","Coordinate with your Sitemap to guide search engines to important pages while blocking others.","Enforce SEO policies by controlling which pages are indexed by different search engines."],"what_it_does":"Django-robots is a Django application that handles the generation and management of robots.txt files, the standard mechanism web servers use to communicate crawler access policies to search engines and other bots. It implements the robots exclusion protocol and complements Django's built-in Sitemap contrib app, allowing you to define which crawlers can access which URL patterns on your site.\n\nThe package has been maintained since 2008 and is production-stable. It integrates directly into Django's admin interface for rule management and works with Django versions 2.2 through 4.2. With no external runtime dependencies and a straightforward installation process, it's designed to be a lightweight addition to existing Django projects that need fine-grained crawler access control.","worth_installing":"Yes. This is a stable, actively maintained package with zero security vulnerabilities, low install friction, and permissive licensing. It solves a real SEO and crawler-management need for Django sites with no external dependencies. Install it if your site needs to manage robots.txt rules beyond a static file."},"id":"django-robots","links":{"html":"https://skillfed.io/packages/django-robots","md":"https://skillfed.io/packages/django-robots.md","pypi":"https://pypi.org/project/django-robots/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2023-09-07","license_spdx":null,"license_treatment":"permissive","name":"django-robots","python_support":"supports_current","summary":"Robots exclusion application for Django, complementing Sitemaps."},"popularity":{"monthly_downloads":320496,"position":7636,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"6.1"}
