Prototype to production

“Our AI prototypes work.
None of them made it to production.”

How do we actually get to production?

The business still runs exactly as it did before.

See if this should go to production
FIG. 3  —  THE WHOLE JOB WHAT SHIPPING ACTUALLY REQUIRES The demo. It works. Real data, not the curated set.The security review.Every path nobody demoed.Monitoring, alerting, on-call.A named owner. The demo was never the hard part. A prototype does not sit still while you decide. It expires. EIGHTY PERCENT NOBODY DEMOED Expand
$22M+
Documented impact from AI systems we put into production
99%
Logo detection accuracy, across the millions of websites Mailchimp personalizes
5 yrs
The longest has run daily since 2021, not months in a pilot
McKesson
Intuit Mailchimp
Cox 2M
Scientific Games
Office Depot
NAPA
CommuniCare

Not every prototype should become a product.

The first job is working out which ones deserve to. A demo that impressed the room is not evidence that the thing behind it is worth running for the next five years. We would rather end a bet that has already failed than bill you through it, and we will say which one you have.

Three ways it stalls

It was never going to be the model that stopped you

A prototype proves the idea can work. Production is the eighty percent nobody demoed, and it fails in three predictable places.

The data was curated

It ran on a clean sample somebody prepared for it.
The pilot used an export, not a live connection.
Nobody has priced the data work.
Accuracy drops the moment it meets production records.

It cannot pass the review

You lost on the questionnaire, not on the product.
It touches customer, payment or health data.
No audit trail, no access model, no retention answer.
The review keeps returning the same list.

Nobody owns it

It has a sponsor, which is not the same as an owner.
The people who built it have moved on.
No team volunteered to carry it.
Nobody has said out loud who is on call.
Why now and not next year

A prototype does not keep

It is not sitting still while you decide. It is quietly expiring.

The budget was for a pilot

Production is a fresh ask, harder every quarter with nothing running to point at.

What you built on has moved

Models, SDKs and vendor terms have shifted. A year-old prototype is a migration first.

The context is leaving

Why a threshold sits where it does, which edge cases were deliberate. That lives in people.

Forget the money already spent. The problem the prototype was built to fix is still costing you the same amount it did before.

Proof

Three AI systems that are running, not demoing

Marketing technology, post-acute healthcare, medical devices. Client-owned, in production, with numbers their own finance teams recognize.

The ask
Machine learning R&D their own engineers could not be pulled off the roadmap to attempt.
What we built
Three neural networks. Handwriting recognition, logo detection, image saliency.
Where it ran
Inside design automation used across millions of sites, beside their own data science team.
3
Models in production
99%
Logo detection accuracy
85%
Handwriting recognition

Read the case study →

What made it production
Built for the product. Not a proof of concept handed to someone else to integrate.
Beside their specialists. Their data science team relied on services we ran.
Held up at scale. Millions of sites, not a benchmark set.
What made it production
Real records. Six live sources, not an export.
Evidence linking. Every suggestion traceable, because a coder has to defend it.
Inside the workflow. In the existing process, not a separate tool.
The ask
Trained people repeating the same judgment call, hours at a time.
What we built
An AI coding engine reading six live sources, then a second one for risk coding.
Where it ran
Daily across a national footprint for years. Both handed back when the work was done.
$22M+
PDPM, quality and RAF impact
90%+
Coding accuracy
6
Clinical sources ingested

Read the case study →

The ask
A practicing clinician with a thesis, a company, and no engineering team.
What we built
The computer-vision model, the mobile app, the cloud infrastructure, the monitor pipeline.
Who owns it
He does. The company, the product vision and the IP. We hold no stake.
99.9%
Vital-sign accuracy
<2s
Refresh, live in theatre

Read the case study →

What made it production
Any monitor. Universal device connectivity, not one vendor in a lab.
Sub-two-second refresh. Because a clinician cannot wait for a dashboard.
Evaluated by someone else. The Geneva Foundation, for forward military medical care.
How we work

Price the hard part first, not the demo again

It stalled because nobody put a number on production. That is the first thing we do.

Discover phase
Discover

What the prototype assumed, and what the real data, integrations and review will demand.

Experiment phase
Experiment

The riskiest unknown gets tested first. Usually the review or the live data, never the part that already demos well.

Engineer phase
Engineer

Built as a system rather than a bigger prototype. Rewriting is usually cheaper than promoting.

Optimize phase
Optimize

We run it, and it comes back with runbooks, alerting and monitoring when you want it.

The full method →

Some prototypes should not go to production, and we will tell you which. Billing through a bet that has already failed costs you more than ending it.

The code, the intellectual property and the roadmap are yours. That is in the contract, not the pitch.

On-demand replay

Bob walks through this whole problem for forty minutes

Someone builds a working demo in a weekend, it gets shown to the board, and then it stops. The session goes through what the ones that ship did differently, using five real systems we took to production rather than slideware. Drawn from healthcare work, but the gap is the same anywhere.

“Building got easy. Shipping didn’t.”

From Pilot to Production: Why 95% of Healthcare AI Never Ships

Recorded 4 August · free, no registration

Bob Klein, CEO

What it looks like

Start with a conversation, then a small piece of work

Nobody should commit to a production build to find out whether it can be one. Each stage earns the next.

1–3 weeks

Readiness review

What production will demand, and whether it should go at all.

4–6 weeks

Blueprint

The architecture and a real number, so it becomes a fundable decision.

8–16 weeks

Build it for real

A senior team in your operation, building the system the prototype sketched.

Ongoing

Run it

Support and monitoring for as long as you want us. A clean handover when you do not.

Tell us what you built and where it stopped

Thirty minutes. Walk us through the prototype and what is in the way, and we will tell you what we think is hard about it.

An architect takes the call, not a salesperson.
We will tell you honestly whether we can help.
And roughly what it would take.
Swipe to see the whole drawing