User-agent: * Disallow: /files/ Disallow: /WEB-INF/ Disallow: /applications/ Disallow: /xml/ Allow: /