PATE (Private Aggregation of Teachers for Ensembles)

Semi-supervised knowledge transfer for deep learning from private training data

OpenAI published research on semi-supervised knowledge transfer techniques for training deep learning models on private data, an early contribution to privacy-preserving machine learning. The work addresses how to leverage private training data without exposing sensitive information, using knowledge distillation-style approaches. This is a 2016 archival post surfaced from OpenAI's blog.