[4.16.15]: Exclude preview pages from robots so they are not discoverable

[wolispace]

What happened?

Description

When searching for x-craft-preview I see sites are 'exposing' their preview pages.

Maybe SEOMatic should also be adding no-robots, but you can't rely on a plugin for this, and it doesn't hide previews anyhow.

Steps to reproduce

1. Go to google.com
2. Search for "x-craft-preview"

Expected behavior

Useful documentation and help about the concept of "x-craft-preview" only

Actual behavior

Craft websites exposing preview pages

Craft CMS version

4.16.15

PHP version

8.0.30

Operating system and version

No response

Database type and version

No response

Image driver and version

No response

Installed plugins and versions

• SEOMatic 4.1.19

[linear]

CMS-1679

[thupsi]

Hi! Related: #15586

[brandonkelly]

Yeah this should already be fixed as of Craft 4.12.0 and 5.4.0. Are you seeing the -Robots-Tag: none header on preview pages for your site?

[wolispace]

I see this on a preview page:
<meta name="robots" content="none">

So maybe the sites we see where 'found' by Google before the 4.12.0/5.4.0 updates.

Happy to close this, sorry for the bother.