~/rewind/copia/copilot

Copia (opens in a new tab)Case study · 2024 – today · 5 min read

Almost like magic.

Designing an AI assistant that factory engineers can question, correct and trust. The AI does the heavy reading. The engineer always has the last word.

Screens and names use dummy data, to protect Copia and its customers.

★ The futureAI that lives where engineers already work, and spots problems before they stop a line
⏪ Rewound toOne assistant for one vendor's files, easy to question and easy to correct
▶ Built forwardRung-level asks and copy, AI change summaries, and a feedback loop on every answer
My role
Senior product designer on Copia Copilot and the AI features around it
When
2024 – today. Copilot was introduced in Nov 2024 ↗
Humans
Product, engineering and customer success, with our customers in the loop
My part
Research and observation, rung-level asks and copy, AI change summaries, and the feedback loop
What changed
Copilot launched on one vendor's files and grew once the answers earned good feedback. Rung-level asks and copy came straight from watching users.
4ways to answer back: accept, edit, reject, regenerate
1vendor to start, then grow
1small habit that became a feature

01Meet Copilot

Factory code is often drawn, not written

Factory code is often drawn, not written. Copilot reads it for you: it summarizes a file, explains what changed, drafts the commit message, and helps write better code.

The machines on a factory floor run on graphical languages like ladder logic: rows of contacts and coils, read rung by rung. Big programs are hard to read and harder to review.

What Copilot does

Summarizes a file, explains what changed, drafts the commit message, and helps write and improve code.

Who it's for

Controls engineers who know their machines deeply, and are new to having an AI read their code.

Copia Copilot: pickers for repository, branch and file, a tree of the program's tasks and routines, a prompt asking for code for a second pump, and the reply drawn as ladder logic rungs, with a Ladder Logic or L5X toggle and a download button.
Pick the code, ask in plain words, get an answer in the engineer's own language: ladder logic.

02A bold bet, rewound

Dream big, then start with one file

The dream: AI that lives where engineers work and catches problems early. We rewound it to one assistant for one kind of file.

Copilot began as our co-founder's idea. I thought it through, and stretched it into where AI could go across Copia: AI that lives where engineers already work and catches problems before they happen. We rewound it to one assistant, for one kind of file, that engineers could poke at and correct.

Why start small

In a factory, a wrong answer can cost a shift. Trust had to be earned one answer at a time, so the first version had to be easy to question, easy to correct, and easy to walk away from.

03Start small

One vendor first, then earn the next

We launched with one vendor's files, Rockwell Studio 5000, and grew only once the feedback was good.

We launched with Rockwell Studio 5000 files, the kind most of our customers' code is written in. We grew to more file types only once the feedback on answers was good.

  • ReadSummarize a file, or explain what changed between two versions
  • WriteDraft a commit message, or new code from existing code
  • ImproveSpot what could be cleaner, safer or easier to maintain

04Trust

Trust starts before the first answer

Before Copilot opens, people choose whether we may learn from their data. Saying no still lets them use it.

A factory's code is its secret recipe. So before Copilot opens, people choose whether we may learn from their data, in plain words. Saying no still lets them use Copilot.

A real choice

Yes and no carry the same weight, and no doesn't lock anything away. Most customers said yes.

Early doubts

The early worries were about the quality of answers, not the design around them. That told us where to focus.

05Question everything

The engineer always has the last word

Every answer can be accepted, edited, rejected or regenerated. And one engineer copying a rung ID by hand became rung-level asks and copy.

People summarize a file, then keep asking. Every answer can be accepted, edited, rejected or regenerated. Try it on a drafted commit message.

Copilot drafted a commit message draft 1 of 3

Rebuilt for this page, with dummy code.

The habit that became a feature

In research, people asked to question one rung, not the whole file. Then, in one session, I watched an engineer copy a rung ID by hand to paste into their IDE. I asked why, and what they did next.

That day I mocked up a "copy" button in Figma and showed it to them. It solved their problem. That became rung-level asks and rung-level copy.

A sketch of the idea, redrawn for this page.
Why it matters

People trust AI more when they can aim it at exactly what they're looking at, and take the answer straight back to their own tools.

06A listening loop

Every answer is a chance to learn

Thumbs up and down, whether people keep asking or come back, and how good their questions are. Feedback prompts come at the right moment, not every moment.

We judge Copilot by what people do, not just what they say.

  • SignalsThumbs up and down, whether people close the chat or keep asking, and whether they come back
  • PromptsHow good people's questions are, so we can help them ask better ones
  • PeopleCustomer success stays close, and engineers hear from customers directly

Asking for feedback is a design problem too. "Tell us about this response" shows up at the right moment, not after every answer.

Three states of a backup job card: a Generate button for an AI change summary, then a Generated confirmation with the summary and description, then thumbs up and down on the summary.
The same loop outside the chat: an AI change summary on a backup job, made only when asked, with the same thumbs up and down as Copilot.

07Built forward

My north star: AI that meets engineers where they are

My north star, not a roadmap: ask about the file you're in, build templates from a file, find anything from one search, and get a heads-up before a line stops.

Copilot was the first step. This is my vision for where AI could go next, not Copia's roadmap.

In the file

Ask about the file or the change you're looking at, right where you're looking at it.

Templates

Turn a file into a template you can tweak and reuse: the hardest part of the work, made easier.

One search

Find any device, agent or file from one place, by asking in plain words.

A heads-up

Spot problems before they stop a line, and tell the engineer early. Almost like observability for factory code.

Visions, not promises. The human stays in the loop for anything that could change a running machine.

✦The future, rewound

What this story says about how I work

AI should feel almost like magic, and never out of your hands. People trust what they can question, correct and walk away from.

The receipts this story, in public

  1. Nov 2024Copia Copilot is introduced Copia announcement ↗
  2. Dec 2024An industry analyst covers the launch: generate, change and explain PLC code ABI Research ↗
  3. TodayUsing Copia Copilot, in the docs Copia docs ↗

Watch what people do

One copied rung ID taught us more than a survey could.

Earn trust in small steps

One vendor first, and grow when the answers are good.

Humans have the last word

Accept, edit, reject or regenerate. Always.

Listen on purpose

Ask for feedback at the right moment, not every moment.

whoami // here I am

Senior title, staff-scope work. Looking for staff product design roles.

Complex, technical products are my favorite kind. The gnarlier, the better.

say --hi // let's talk

Curious how we design AI people can trust?