Skip to content
Advanced Academy Reader
Exit Reader

Differential Privacy in LLMs

DP adds calibrated noise to training, preventing memorization of individual data points.

advanced•4 / 6

Example

Train GPT-2 variant on sensitive text: DP reduces exact memorization by 90%.

Section 4 of 6
Next →