MedCPT

Domain-specific transformer embeddings for detecting dosing errors in clinical trial protocols

Researchers from CaresAI evaluated biomedical transformer models (ClinicalBERT, PubMedBERT, BioBERT, MedCPT) for detecting dosing errors in clinical trial protocols, combining text embeddings with structured metadata and classical ML classifiers. BioBERT achieved the best single-encoder performance at ROC-AUC 0.794, while gradient boosting and SVM ensembles reached 0.821–0.853. The study finds that domain alignment of the encoder matters more than stacking multiple embeddings, and demonstrates a practical NLP pipeline for clinical trial safety monitoring.