Skip to content
SuiteAnalytics
Sign inStart free

robots.txt does not name the sitemap

NetSuite’s Sitemap Generator writes sitemap_<domain>_Index.xml, not /sitemap.xml, and does not add a Sitemap: line to robots.txt. A crawler that is not told where the sitemap is has no way to guess it, so the line has to be added by hand.

Updated · By the SuiteAnalytics team

What we detect

A robots.txt with no Sitemap: line. The same check family also reports a line that points at an HTML page instead of an XML sitemap, and one that points at another host.

How to fix it

  1. Find the index file the Sitemap Generator wrote in the domain’s hosting root: sitemap_<domain>_Index.xml.
  2. Add Sitemap: https://<your domain>/sitemap_<domain>_Index.xml to robots.txt, as an absolute URL on the same host.
  3. Upload the file to the hosting root. It replaces the robots.txt NetSuite generates, so keep any rules you rely on.
  4. Submit the same URL in Search Console and Bing Webmaster Tools.

In NetSuite: Commerce > Hosting > Website Hosting Files, the robots.txt file in the site's hosting root folder Oracle documentation

In NetSuite: Commerce > Marketing > SEO > Sitemap Generator Oracle documentation

Read next