Session Outline
This session explores why traditional batch data quality approaches fail in streaming environments, using real-world examples from Netflix’s impressions. It will focus on several practical techniques, including inline validation patterns, schema evolution management, and real-time quality monitoring that enable reliable data quality at streaming scale.
Key Takeaways
- – Understanding of why batch data quality methods don’t work in streaming systems
- Discuss trade-offs between strict validation and throughput
- Discuss monitoring and alerting strategies
