Advanced developers looking to learn event-time tracking, custom timestamp assignments, and fixed time windows.
Process real-time streaming cellular events using Fixed Windows.
Save the following raw rows locally as \`dataset.csv\` to test your pipeline:
timestamp,call_id,caller,receiver,duration_sec
1719830400,call1,userA,userB,45
1719830420,call2,userC,userD,120
1719830480,call3,userA,userE,30
1719830540,call4,userF,userB,60
1719830600,call5,userC,userA,90Create a local file named \`starter.py\` and copy the following skeleton. Complete the missing transformations:
# starter.py - Telecom Monitoring
import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
def run_pipeline():
options = PipelineOptions()
with beam.Pipeline(options=options) as p:
# TODO: Assign event-time timestamps
# TODO: Apply Fixed Windows of 2 minutes (120 seconds)
# TODO: Calculate duration sums per window frame
pass
if __name__ == "__main__":
run_pipeline()