User-agent: twiceler Disallow: / User-agent: * Disallow: /sitecore/ Disallow: /static/ Disallow: /upload/ Disallow: /temp/ Disallow: /iv/ Disallow: /common/ Disallow: /api/