User Documentation

Set an environment’s visibility to search engines

Sign up for Upsun

Get your free trial by clicking the link below.

Get your Upsun free trial

When you have preview environments, you don’t want search engines indexing them and diluting the SEO of your production site.

Search engine indexers are told to ignore all preview environments. When you’re ready to go live, give your production environment a custom domain and then set it to be visible to search engines.

To change your production environment’s visibility to search engines, follow these steps:

To not restrict indexers on your production environment, run the following command:

platform environment:info --environment PRODUCTION_ENVIRONMENT_NAME restrict_robots false
  • Select the project where you want to change visibility.
  • From the Environment menu, select your production environment.
  • Click Settings.
  • In the row with Hide from search engines, click Edit .
  • Select or clear the Hide from search engines checkbox. can’t guarantee that indexers follow the instructions. If you’re concerned about access, set up HTTP access control.

How it’s done Anchor to this heading

When the Hide from search engines is activated, search engines are turned away from environments by including a X-Robots-Tag header:

X-Robots-Tag: noindex, nofollow

That tells search engine indexers to not index these sites and not traverse links from these sites. This helps keep non-Production sites out of search engine indexes.

You can choose whether to keep it on for production sites with custom domains. It’s automatically on for all domains.

Alternative method Anchor to this heading

You can also send instructions to search engine indexers using a robots.txt file. Your app can serve this as a static file from its disk or as a dynamic response from its passthru. Control either with the location section of your app configuration.

If your robots.txt file includes instructions to ignore a page, search engine indexers may ignore it even if you have configured to not send the header.

Is this page helpful?