# Disallow all robots on the cdn

User-agent: Twitterbot
Disallow: 
Allow: /
User-agent: facebookexternalhit/1.1
Allow: /
User-agent: Facebot
Allow: /

User-agent: *
Disallow: /