How Much Is Too Much?: Ms. Anjana Virmani on Predictive AI

Predictive AI has slowly replaced existing laborious tasks. Do you think a technology of such magnitude poses privacy risks of peering into the lives of individuals too much?

Predictive AI definitely shifts the privacy conversation. It’s no longer just about protecting static data like your phone number or credit card. It’s about protecting what machines can infer about you. Machine learning models can analyze routine location logs or browsing habits, and accurately predict sensitive traits, from health conditions to financial habits, without you ever explicitly sharing them. Models require continuous, high-volume data streams to stay accurate, to replace existing laborious tasks, which naturally incentivizes intrusive surveillance. To keep this technology in check, we have to embed privacy right into the architecture. Ultimately, the goal isn’t to stop prediction altogether, but to ensure that algorithmic utility doesn’t cost us our personal autonomy.