Skip to content
←Back to glossaryAI

Data leakage through assistant prompts

Disclosure of confidential data by an employee pasting it into an external AI service, an incident with no intrusion and no technical flaw.

Definition

Samsung Electronics, March 2023: less than three weeks after allowing ChatGPT, its semiconductor division found three leaks, source code pasted in to fix errors and the recording of an internal meeting. On May 1, the group blocked generative tools on company computers. An employee who pastes a piece of source code, a contract or a client file into a consumer chat assistant hands that data to a third party. The terms of use of these services sometimes allow the provider to keep it and use it to improve the service. The incident is defined by what it lacks: no intrusion, no exploited vulnerability, no malicious act. No perimeter security device sees it go by, since it is outbound traffic to a legitimate service. Legally, though, it is a personal data breach whenever the information falls within scope, with the notification duty that comes with it. In other cases it is a disclosure of trade secrets. The broader problem, teams using unapproved services on their own initiative, does not yield to a ban: a ban pushes usage onto personal devices, where it becomes invisible. What works is offering an acceptable alternative and logging outbound traffic.

Its 4 cross-references, woven across the glossary's 18 categories
Data leakage through assistant prompts: AI glossary illustration, AlgoPolis
Example

In May 2023, Samsung Electronics restricted the use of external conversational assistants on its internal systems after employees had transmitted internal source code and meeting notes to a consumer service.

Read next
Related terms
Related articles
Stay informed

Follow the research

One letter a week. First, the week's underwriting note, when one is published: a dated, argued decision, signed by Paul Bernardski. Then what the observatory published on cyber risk, political risk and insurance. No account, no tracking.

No spam, one-click unsubscribe, no data ever sold.