User-agent: * Allow: / # Nothing is disallowed here, deliberately. # # The dashboard, login and the real API live on their own hostnames # (dashboard.nexavoxa.com, api.nexavoxa.com), which this file has no authority # over. Rules for them here did nothing but suggest those paths exist. # # Tracking parameters are not blocked either. Every page carries a # self-referencing canonical without query strings, which is what actually # collapses ?utm_ duplicates. Disallowing them instead stops crawlers from ever # reading that canonical, and blocks every campaign and newsletter link we send. # # Pages that genuinely must stay out of the index carry a noindex tag, which # requires the page to be crawlable to be seen at all — so it cannot be paired # with a Disallow here. # # If you add a Disallow below, note that named crawler groups (GPTBot, ClaudeBot, # PerplexityBot, Google-Extended) read only their own group. They are covered by # the wildcard above today, and we want them reading the site. Sitemap: https://nexavoxa.com/sitemap.xml # The help centre is a separate service behind the same hostname, so it keeps # its own sitemap under the prefix it owns. Listing it here is what makes those # articles discoverable without the landing page having to know about them. Sitemap: https://nexavoxa.com/help/sitemap.xml # The blog moved to that same service and generates its own sitemap on request, # so a newly published article is discoverable without a deploy. Kept separate # from the help centre's for the same reason they are separate sections. Sitemap: https://nexavoxa.com/blog/sitemap.xml