User-agent: * Disallow: /admin/ Disallow: /login Disallow: /register Disallow: /password Disallow: /api/ Disallow: /internal/ Disallow: /storage/ Disallow: /vendor/ Disallow: /server-status Disallow: /server-info Disallow: /public Disallow: /*.php$ Disallow: /*.env$ Disallow: /*.log$ # Allow everything else Allow: / # Sitemap (if you have one) Sitemap: https://www.edtech.com/sitemap.xml