Privly: Find User-Agents of Major Social Networks
Background:
The Priv.ly Project uses special hyperlinks to share content. Some websites and applications like to pre-fetch these links when a user shares them so the website can generate previews for users. In many cases this “previewing” creates a terrible user experience for our users because it places multiple instances of the Privly link onto the webpage and the content is duplicated.
Task:
To fix this problem, we can have our content servers block major web companies from requesting content from our servers. To accomplish this, we need a list of the user-agent strings that Facebook, Google, and other bots present to servers when requesting contents. This will allow us to write rules blocking the site from requesting content, and thus block any previewing of the encrypted application.
Requirements:
Collect the user agent string of 5 or more social networks, forums, and email clients. Submit the list of user-agents as presented to a web server.
Links:
Privly: https://priv.ly/