Process optimisation when every run is expensive
Each lab trial or plant run costs money, so the history of a process often runs to tens or hundreds of them, too few for deep learning. We model a process at that size with a Gaussian process, a statistical model that learns from few examples and has your engineers’ knowledge written into it. An optimiser on top finds the cheapest recipe that still meets your specification.
A Gaussian process gives a range with every prediction, like a weather forecast that gives a likely high and low as well as a temperature. The range is narrow where you have run the process and widens where you have not. This range matters more than a small gain in accuracy, because the optimiser uses it to tell a promising setting from a blind spot. A model that gives one number everywhere sends the optimiser towards settings outside your data, where that number is a guess.
The same range chooses the next experiments. A design drawn up in one go grows quickly: in one engagement, a design of experiments we proposed would have taken the client’s lab more than a month to run. The model instead ranks candidate runs by how much they would teach it and how likely they are to beat your current recipe. Your lab runs a small batch, we refit the model, and the loop repeats. This is Bayesian optimisation.
Reinforcement learning for process control
Reinforcement learning learns a control policy: given the state of the plant, which action to take to serve a long-run goal such as throughput or cost. It suits a continuous process where the same decision repeats many times a day and early actions have long-range effects. The price is data, so it needs a simulator of the process or a long plant history to learn from.
Phil Winder wrote the O’Reilly book on reinforcement learning, and has written about its use in job scheduling and assembly and inventory control.
AI agents for production operations
We have built autonomous systems for over a decade, and our first agents in manufacturing were the reinforcement learning agents that suggested settings to operators at CMPC’s paper mill. The language-model agents we build today take on the knowledge work around production: triaging a maintenance alert against the asset’s history, reworking a production schedule around a late delivery, finding another supplier for a part, or checking a batch record against its specification. Each agent connects to your MES, ERP and OT systems, with a human approval step on high-stakes actions.
We build agents on Helix, our own platform for running agents inside an organisation, or on the framework you already run. Every agent ships with evaluation, guardrails and tracing, and can run on your cloud or on-premises, including air-gapped networks, so plant data stays on site. Our AI agent development page covers the engineering, and the legal research assistant we built for Temple University is one we have shipped.
Documents are the narrowest case. Purchase orders, bills of materials, quality certificates and engineering specifications can be extracted and checked automatically, and document automation for manufacturing covers that work in detail.