Surfacing Privacy Settings Using Semantic Matching

Rishabh Khandelwal, Asmit Nayak, Yao Yao, Kassem Fawaz


Abstract
Online services utilize privacy settings to provide users with control over their data. However, these privacy settings are often hard to locate, causing the user to rely on provider-chosen default values. In this work, we train privacy-settings-centric encoders and leverage them to create an interface that allows users to search for privacy settings using free-form queries. In order to achieve this goal, we create a custom Semantic Similarity dataset, which consists of real user queries covering various privacy settings. We then use this dataset to fine-tune a state of the art encoder. Using this fine-tuned encoder, we perform semantic matching between the user queries and the privacy settings to retrieve the most relevant setting. Finally, we also use the encoder to generate embeddings of privacy settings from the top 100 websites and perform unsupervised clustering to learn about the online privacy settings types. We find that the most common type of privacy settings are ‘Personalization’ and ‘Notifications’, with coverage of 35.8% and 34.4%, respectively, in our dataset.
Anthology ID:
2020.privatenlp-1.4
Volume:
Proceedings of the Second Workshop on Privacy in NLP
Month:
November
Year:
2020
Address:
Online
Editors:
Oluwaseyi Feyisetan, Sepideh Ghanavati, Shervin Malmasi, Patricia Thaine
Venue:
PrivateNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
28–38
Language:
URL:
https://aclanthology.org/2020.privatenlp-1.4
DOI:
10.18653/v1/2020.privatenlp-1.4
Bibkey:
Cite (ACL):
Rishabh Khandelwal, Asmit Nayak, Yao Yao, and Kassem Fawaz. 2020. Surfacing Privacy Settings Using Semantic Matching. In Proceedings of the Second Workshop on Privacy in NLP, pages 28–38, Online. Association for Computational Linguistics.
Cite (Informal):
Surfacing Privacy Settings Using Semantic Matching (Khandelwal et al., PrivateNLP 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.privatenlp-1.4.pdf
Video:
 https://slideslive.com/38939773
Code
 wi-pi/surface_privacy_dataset