Data Engineering Labs

Learn basic transformations by filtering and aggregating employee records.

Parse student grades and compute the average score per subject.

Filter products by price range and list catalog summaries.

Summarize transactions to calculate total sales revenue.

Analyze retail transactions and generate total customer spending aggregations.

Calculate total stock valuation and identify low stock items.

Audit accounts by summing deposits and withdrawals.

Compute average salary by department and identify the highest earner.

Process real-time streaming cellular events using Fixed Windows.

Aggregate device temperature readings using sliding windows.

Count real-time webpage pageviews using streaming windows.

Detect rapid successive banking transactions to flag potential fraud.

Group website click logs into user session windows to measure engagement.

Consume from an Apache Kafka topic stream and output parsed JSON payloads.

Design a streaming ingestion pipeline from Google Cloud Pub/Sub to Google BigQuery.

Calculate continuous dashboard aggregations with dynamic triggers.