Real-World Projects

Build an end-to-end streaming ingestion pipeline collecting tower call health metrics, identifying dropped call rates, and alerting downstream logs.

Assemble a batch analytics processing pipeline generating financial purchase metrics. Reads transaction and profile logs, joins them using CoGroupByKey, and creates customer lifetime value metrics.

Build an advanced batch compliance audit pipeline that reads transaction logs, filters them against a blacklisted merchant side input, and routes errors to a failed table while writing clean data to a good table.