Manufacturing IoT Sensor Data & OEE Calculation Pipelines
A practitioner-focused resource for industrial engineers, IIoT developers, manufacturing data analysts and Python automation builders shipping production-grade telemetry pipelines.
Concrete patterns for PLC and MQTT ingestion, deterministic state resolution, downtime classification, OEE math (Availability × Performance × Quality), shift aggregation, alert routing, dashboard sync and batch automation — distilled from real factory-floor experience and written so you can copy, adapt and deploy.
The site is organised into three working tracks. Start with the one closest to where your pipeline is hurting today.
Core Architecture & Data Mapping
Edge gateways, canonical tag dictionaries, MQTT topic schemas, time-series persistence, precision and fallback routing.
Open the trackIngestion & Cleaning Workflows
Protocol normalization, clock-drift correction, outlier detection, gap filling, and async idempotent persistence.
Open the trackDowntime Classification & OEE Calculation
State machines, microstop thresholds, shift boundary logic, OEE math validation, and resilient fallback routing.
Open the trackStart here
New to the site? These three foundational guides — one from each track — are where most production pipelines either hold together or quietly break.
- PLC Tag Standardization Map opaque vendor addresses to one canonical, ISA-95-aligned tag contract before data ever enters the pipeline.
- Outlier Detection Methods Catch sensor spikes, frozen values and physically impossible readings before they corrupt downstream OEE math.
- OEE Formula Validation Validate Availability x Performance x Quality so your headline OEE number survives audit and reconciliation.
What you'll find inside
Each track is broken into focused sub-topics, with deep dives on the edge cases that consistently break production pipelines.
MQTT Topic Hierarchies for Manufacturing Telemetry and OEE Workflows
Deterministic MQTT topic design is the foundational contract between edge telemetry sources and the analytics platforms that compute Overall Equipment Effectiveness (OEE). This page is part of Core Architecture & Data…
PLC Tag Standardization for Manufacturing Telemetry and OEE Workflows
Programmable logic controllers expose process data through opaque, vendor-specific addresses — DB10.DBD20 on a Siemens S7, N7:0 on an Allen-Bradley SLC — that carry no engineering meaning, no units, and no topology. P…
Precision & Rounding Limits for Manufacturing Telemetry Pipelines
Precision and rounding limits define the mathematical boundary between actionable operational intelligence and systemic noise, and getting them wrong is one of the most common ways an otherwise sound telemetry stack s…
Time-Series Database Sync for Manufacturing Telemetry and OEE Workflows
Time-series database synchronization is the stage where volatile edge measurements become durable, time-aligned, queryable history — and it is the persistence concern within Core Architecture & Data Mapping. Get the s…
Async Batch Processing for Manufacturing Telemetry and OEE Pipelines
Async batch processing is the stage of Ingestion & Cleaning Workflows that accumulates discrete telemetry payloads into deterministic, time- or event-bound windows, cleans them in place, and computes Overall Equipment…
Clock Drift Correction for Manufacturing Telemetry and OEE Pipelines
Clock drift correction is the stage of Ingestion & Cleaning Workflows that re-aligns every sensor timestamp to a single trusted reference epoch before any metric is computed. This page focuses on one narrow concern: h…
Gap-Filling Algorithms for Manufacturing Telemetry and OEE Pipelines
Gap filling is the stage of Ingestion & Cleaning Workflows that reconstructs missing samples in a telemetry stream deterministically, so that downstream Overall Equipment Effectiveness (OEE) math is computed over a co…
Outlier Detection Methods in Manufacturing Telemetry Pipelines
Outlier detection is the deterministic gatekeeping stage that decides which raw sensor samples are admitted into the analytics-grade time series. This subsystem is part of Ingestion & Cleaning Workflows, and it sits i…
Event-to-Downtime Mapping for OEE-Accurate Machine State Pipelines
Event-to-downtime mapping is the deterministic translation layer that turns raw machine-state transitions into the structured availability intervals that OEE math depends on, and it is one of the core subsystems of Do…
OEE Formula Validation for Manufacturing Telemetry Pipelines
Validating the Overall Equipment Effectiveness (OEE) formula is the reconciliation step that turns raw machine telemetry into a number an operations team can trust — and it belongs to the broader Downtime Classificati…
Shift Boundary Logic for OEE Availability Windows and Downtime Attribution
Shift boundary logic is the temporal contract that decides which crew, which day, and which planned-production window every machine-state interval belongs to, and it is one of the core subsystems of Downtime Classific…
Threshold Tuning for Microstops in Manufacturing Telemetry and OEE Workflows
Microstops — transient production interruptions that typically last between 3 and 60 seconds — are the most under-counted source of hidden capacity loss, and tuning the duration boundary that separates them from norma…