{"enrichment":{"faq":[{"a":"streaming-data is a comprehensive skill for mastering real-time data pipelines and event streaming architectures. It covers modern message brokers including Kafka, Pulsar, and Redpanda, plus stream processors like Flink and Spark. You'll learn producer/consumer patterns, delivery guarantees, event sourcing, change data capture, and implementation across TypeScript, Python, Go, and Java.","q":"What is streaming-data and what does it cover?"},{"a":"streaming-data teaches producer/consumer coordination as a core pattern for event-driven systems. Producers publish messages to topics; consumers subscribe and process them. The skill covers delivery guarantees (at-least-once, exactly-once), offset management, consumer lag monitoring, and error handling strategies including dead letter queues to ensure reliable message processing.","q":"How do kafka producer consumer patterns work in streaming-data?"},{"a":"streaming-data provides guidance on choosing between Kafka, Pulsar, Redpanda, and other message brokers. It helps you evaluate trade-offs in performance, latency, partitioning, and operational complexity. The skill includes setup, configuration, validation, and performance tuning for each platform so you can select the right broker for your architecture.","q":"What message brokers does streaming-data compare?"},{"a":"Yes. streaming-data focuses on implementing real-time data pipelines for analytics and microservices communication. It covers event-driven architecture patterns, microservices coordination via event streaming, IoT real-time analytics, log aggregation, metrics monitoring, and high-frequency trading systems\u2014all using modern stream processors and brokers.","q":"Can streaming-data help with real-time analytics and microservices?"},{"a":"streaming-data covers advanced patterns like change data capture (CDC) with Debezium, event sourcing for microservices, exactly-once processing with transactions, and error handling strategies. These patterns enable you to build robust, auditable systems with strong delivery semantics and recovery capabilities.","q":"What advanced patterns does streaming-data include?"},{"a":"Yes. streaming-data provides examples and patterns across TypeScript, Python, Go, and Java. It includes KafkaJS for Node.js, Confluent Kafka Python libraries, and language-specific implementations so you can apply streaming concepts regardless of your primary language.","q":"Is streaming-data suitable for TypeScript and Python developers?"}],"shadow_tags":["event-broker","stream-processor","message-queue","real-time-pipeline","distributed-system","data-integration","fault-tolerance","scalable-architecture","async-messaging","cdc-integration"],"summary_rewrite":"Master real-time data pipelines and event streaming architectures using modern message brokers and processors. This skill covers Kafka, Pulsar, Redpanda, Flink, and Spark across TypeScript, Python, Go, and Java, with patterns for producer/consumer coordination, delivery guarantees, event sourcing, and change data capture."},"files":[{"bytes":11553,"path":"skills/streaming-data/SKILL.md","sha256":"a932e0b4be68917249b59753b3b047c2042ea2340ea6c54306b02573eca8b2c3","url":"https://skillfed.io/files/ancoleman/ai-design-components/streaming-data/1ddf627c/SKILL.md"}],"id":"ancoleman/ai-design-components/streaming-data","links":{"html":"https://skillfed.io/ancoleman/ai-design-components/streaming-data","md":"https://skillfed.io/ancoleman/ai-design-components/streaming-data.md","repo":"https://github.com/ancoleman/ai-design-components"},"meta":{"agents_supported":[],"first_seen":"2026-07-28","forks":59,"language":"Python","last_updated":"2025-12-11","license":"MIT","name":"streaming-data","publisher":"ancoleman","stars":390},"relations":{"similar":[{"id":"ancoleman/ai-design-components/using-message-queues"},{"id":"manutej/luxor-claude-marketplace/kafka-stream-processing"},{"id":"Mindrally/skills/kafka-development"},{"id":"personamanagmentlayer/pcl/kafka-expert"},{"id":"aws/agent-toolkit-for-aws/aws-messaging-and-streaming"},{"id":"fengshao1227/ccg-workflow/data-engineering"},{"id":"dawiddutoit/custom-claude/kafka-consumer-implementation"},{"id":"nWave-ai/nWave/nw-data-architecture-patterns"},{"id":"dawiddutoit/custom-claude/kafka-integration-testing"},{"id":"telagod/code-abyss/engineering-data-pipelines"}]},"slug":{"owner":"ancoleman","repo":"ai-design-components","skill":"streaming-data"},"version":"1ddf627c"}