Open source resources for building real-time event-driven services and data pipelines on Kubernetes.
There is a rich ecosystem of open source projects providing event-driven and real-time data infrastructure, including Apache Kafka, Flink, Spark, Pulsar, and many more. Navigating this ecosystem is often difficult, and knowing how to deploy, run, and combine these projects can be daunting.
The goal of StreamsHub is to provide a curated set of projects, templates, tools, and documentation to help infrastructure engineers build services that support event-driven architectures (EDA) on Kubernetes. Where a gap exists in the current open source offering, StreamsHub aims to host a project to fill it, with the goal of contributing solutions upstream where appropriate.
- Console -- A web UI for managing Strimzi-managed Apache Kafka clusters on Kubernetes.
- Flink SQL Runner -- A wrapper for deploying Flink SQL jobs using the Flink Kubernetes Operator.
- Flink SQL Examples -- Tutorials for running Flink SQL on Kubernetes.
- Propose a new project or change: Submit a proposal via the proposals repository.
- Contribute documentation and tutorials: Help improve best-practice guides and tutorials on the StreamsHub website (source).
- Report issues and contribute code: Each project repository welcomes issues and pull requests.
- Governance: Community Governance (code of conduct, voting rules, etc.) is covered in the Governance Repository