| ID | product.platform.observability.log_pipeline |
|---|---|
| Description | Loki + Vector log aggregation. |
| Key | log_pipeline |
| Type | component |
| Team | Platform Engineering |
| Owner | platform@iotgateway.example |
| Status | active |
| Technologies | Grafana Loki, OpenTelemetry Collector |
| Attributes | ingest_rate: 200k lines/s, retention: 30d |
| Tags |
Table of contents
Guide
Log Pipeline
The Log Pipeline collects structured logs from every service, ships them through Vector for parsing and enrichment, and stores them in Grafana Loki for fast, label-indexed search.
Index labels, not lines
Loki indexes only a small set of labels (service, level, region) and stores the log body compressed. That keeps ingest cheap at 200k lines/s while still letting you grep within a label stream.