Healthcare AI Doesn't Need to Go Deep. It Needs to Go Long.
Photo by Ksenia Yakovleva on Unsplash
insight

Healthcare AI Doesn't Need to Go Deep. It Needs to Go Long.

By Jason Alan Snyder·November 19, 2024

More parameters. More data. Better benchmarks. The assumption is that depth — going further into a dataset — produces better clinical intelligence. That assumption is wrong for healthcare. Healthcare AI doesn't need to go deep. It needs to go long.

Every AI conference in healthcare leads with the same metrics: model size, benchmark scores, training data volume. More parameters, more data, better outcomes. The assumption is that depth — going further into a dataset — is what produces better clinical intelligence.

That assumption is wrong for healthcare.

Healthcare AI does not need to go deep. It needs to go long.

The difference between deep and long

Deep learning finds patterns within a large dataset at a point in time — or that treats multiple points in time as equivalent inputs.

Longitudinal intelligence is different. It tracks a patient across time, understands how their clinical picture has changed, and weights recent data more heavily than historical data in time-sensitive contexts. It understands that a diagnosis from five years ago and a diagnosis from last Tuesday are not the same kind of input, even if both carry the same label in the training set.

Every provider encounter is a data point on the longitudinal record. Every missed encounter, every unfollowed referral, every appointment canceled and not rescheduled — these are also data points. The gaps are as informative as the visits.

When a model treats all of this as equivalent — ingesting a dataset without understanding the temporal relationships between records — it produces inferences that look statistically valid but are clinically unreliable. The model learned something real about the data. It did not learn anything reliable about the patient.

What the recency dimension measures

The SuperTruth Data Trust Index Recency dimension was built for exactly this problem. It applies time-decay functions by data modality: a continuous HRV stream from a wearable ages differently than a CBC, which ages differently than a medication reconciliation, which ages differently than a surgical note.

The decay is not arbitrary. It reflects the clinical rate of change for each data type. Biomarkers that fluctuate rapidly receive steeper decay curves than structural diagnoses that change slowly. The score reflects the reliability of the data at the moment of inference, not at the moment it was captured.

This is a patented algorithm at the center of the DTI engine. The question it answers is not what does this data say, but how much should a model trust this data right now.

Why this matters for health system AI deployments

Health systems deploying AI models on their data face this problem at scale. Their EMRs contain years of patient records. Some of it is current. Much of it reflects care under conditions that no longer apply — different medications, different diagnoses, different providers, different facilities.

Without a recency layer, the model treats historical data and current data as equally valid inputs for a decision being made today. The model's accuracy on the validation set may look strong. Its accuracy on actual patients will not hold.

A PET scan result that predates a treatment intervention is not the same input as one captured after. A medication record that preceded a known adverse event is not the same input as one from the current regimen. A model that cannot distinguish between these is not a clinical AI. It is a pattern matcher operating on data that has been stripped of its most important attribute: when.

The trust layer does not replace the model. It makes the model's inputs honest — scored, dated, and weighted for the moment of inference rather than the moment of capture.

That is the infrastructure gap that longitudinal healthcare AI requires.

Further reading: See our health systems solution Reach Louis Simeonidis at louis@supertruth.ai or (215) 918-4140.

Jason Alan Snyder

Jason Alan Snyder

Co-founder of SuperTruth and Artists & Robots, and an inventor on the Data Trust Index patents. Twenty-plus years building technology inside Interpublic Group. He writes here nearly every day on data trust, provenance, and what AI should be allowed to act on, and publishes essays on his Substack.

About SuperTruth · LinkedIn · Substack · jasonalansnyder.com

See it in practice

EHR data scored before any AI model sees it.

DTI integrates with Epic, Oracle Health, and all major EHR systems.

See our health systems solution
Share
Healthcare AI Doesn't Need to Go Deep. It Needs to Go Long. | SuperTruth