| ID | product.processing.batch_processor.job_scheduler |
|---|---|
| Description | Schedules and tracks batch jobs. |
| Key | job_scheduler |
| Type | component |
| Team | Stream Processing |
| Owner | stream-processing@iotgateway.example |
| Status | active |
| Technologies | Go |
| Attributes | cadence: daily, max_concurrent_jobs: 8 |
| Tags |
Table of contents
Guide
Job Scheduler
The Job Scheduler decides when batch work runs and keeps an authoritative record of every job’s lifecycle. It backs the Batch Jobs API and hands accepted work to the Spark Runner.
Idempotent by date
Each daily job is keyed by its target date. Re-submitting the same date is a no-op if a successful run already exists, which makes retries and backfills safe to trigger repeatedly.