SpecsModelExplore
Overview
Actors
Device OwnerFleet OperatorData EngineerPlatform Operator
External Systems
IoT Platform
Data Engineer
Goals
Where they work
A pipeline they own
SpecsModelExplore
Data Engineer
OverviewGuideLinks and Communications

Data Engineer

The Data Engineer turns the firehose of device telemetry into useful, queryable data. They build and own the stream and batch pipelines, and the exports that downstream analytics teams depend on.

What success looks like

Reliable, well-shaped data: clean topics, correct enrichment, and exports that land in object storage on schedule and without gaps.

Goals

  • Author stream-processing jobs that enrich and route telemetry.
  • Define windowed aggregations and alert thresholds.
  • Ship batch exports to the data lake.

Where they work

They build inside Processing and land results in Object Storage.

A pipeline they own

The alert pipeline is a canonical example of the stream work they build and maintain — from raw telemetry to a routed, deduplicated alert: