User Guide

Getting Started

• Installing
• Simple Example
• Collecting and Windowing Example
• Join Example
• Wordcount Example
• Polling Input Example
• Recovery Example
• Execution
• Debugging

Concepts

• Workers and Parallelization
• Dataflow Programming
• Joins
• Kafka
• Windowing
• Recovery
• Pub/Sub and Polling
• Rescaling

Advanced Concepts

• Custom Operators
• Custom IO Connectors
• Performance
• Batching large-overhead operations

Deployment

• Deployment Overview
• Containers
• Using waxctl to Run your Dataflow on Kubernetes
• Using waxctl to Run your Dataflow on AWS
• Using waxctl to Run your Dataflow on GCP
• Helm Chart
• Metrics

Reference

• Glossary
• Migration Guide

Contributing

• Contribution Guide
• Local Development
• Architecture History
• Profiling Bytewax
• Library Release Checklist
• Connector Hub
• Writing Documentation