HTTP header version of meta robots. Allows controlling indexation for non-HTML files (PDFs, images, video). Example: X-Robots-Tag: noindex, nofollow
HTTP header version of meta robots. Allows controlling indexation for non-HTML files (PDFs, images, video). Example: X-Robots-Tag: noindex, nofollow