Home / Data engineering & ML / Training data without patient data

Case study · Healthcare · Synthetic data · July 2023

Training data without patient data

Synthetic datasets generated in Python so models could be trained on healthcare data that nobody can be identified from.

Healthcare Client
Data engineering & ML Practice
July 2023 Published

01 — The challenge

Where it started.

The client’s data was cluttered and incomplete — a poor basis for training — and it was patient data, so the usual remedies for poor data quality were constrained by privacy.

Rare clinical cases were by definition under-represented, which is exactly where model performance matters most.

02 — What we built

The work itself.

Synthetic records in Python. Clean datasets generated to match the shape of the real ones, standing in for records that could not be used directly.

Rare cases simulated. Scenarios generated deliberately rather than waiting for them to appear in the sample.

A controlled environment. Algorithm performance assessed against data whose properties are known, rather than inferred from a messy sample.

03 — Results

What the client has now.

Privacy protected by substituting synthetic records for real patient data. Rare-case detection and clinical scenario simulation improved. Model performance assessable in a controlled setting. Training and educational material expanded without exposing patient records.

Looking for a similar solution? Contact us today!

Related work