Optional@lemmy.world to Technology@lemmy.worldEnglish · 3 months agoGoogle is no longer asking — feed the AI or you’re not in search resultspivot-to-ai.comexternal-linkmessage-square82fedilinkarrow-up1440arrow-down19file-textcross-posted to: techtakes@awful.systems
arrow-up1431arrow-down1external-linkGoogle is no longer asking — feed the AI or you’re not in search resultspivot-to-ai.comOptional@lemmy.world to Technology@lemmy.worldEnglish · 3 months agomessage-square82fedilinkfile-textcross-posted to: techtakes@awful.systems
minus-squareColinHayhurst@lemmy.worldlinkfedilinkEnglisharrow-up27·edit-23 months agoPut should put these entries into your robots.txt file. To block the Google search crawler use for all of your site: User-agent: Googlebot Disallow: / To block the Google AI crawler use: User-agent: Google-Advanced Disallow: /
Put should put these entries into your robots.txt file.
To block the Google search crawler use for all of your site:
User-agent: Googlebot
Disallow: /
To block the Google AI crawler use:
User-agent: Google-Advanced
Disallow: /
You rock, thank you!