User-agent: * Disallow: /assets Disallow: /html Allow: /