Optional@lemmy.world to Technology@lemmy.worldEnglish · 3 months agoGoogle is no longer asking — feed the AI or you’re not in search resultspivot-to-ai.comexternal-linkmessage-square102fedilinkarrow-up1539arrow-down110file-textcross-posted to: techtakes@awful.systems
arrow-up1529arrow-down1external-linkGoogle is no longer asking — feed the AI or you’re not in search resultspivot-to-ai.comOptional@lemmy.world to Technology@lemmy.worldEnglish · 3 months agomessage-square102fedilinkfile-textcross-posted to: techtakes@awful.systems
minus-squareSnowcano@startrek.websitelinkfedilinkEnglisharrow-up21·3 months agoSo how do I actually opt out? My website is just some personal hobby stuff on wordpress that only friends and family look at, I don’t need seo.
minus-squareColinHayhurst@lemmy.worldlinkfedilinkEnglisharrow-up29·edit-23 months agoYou should put these entries into your robots.txt file. To block the Google search crawler use for all of your site: User-agent: Googlebot Disallow: / To block the Google AI crawler use: User-agent: Google-Advanced Disallow: /
minus-squareJamyang@lemmy.worldlinkfedilinkEnglisharrow-up2·3 months agoWhat if I made a static site using Github pages hosting? Will having a robots.txt in my root folder ward off Google bhoots (devils)?
So how do I actually opt out? My website is just some personal hobby stuff on wordpress that only friends and family look at, I don’t need seo.
You should put these entries into your robots.txt file.
To block the Google search crawler use for all of your site:
User-agent: Googlebot
Disallow: /
To block the Google AI crawler use:
User-agent: Google-Advanced
Disallow: /
You rock, thank you!
What if I made a static site using Github pages hosting? Will having a robots.txt in my root folder ward off Google bhoots (devils)?
Yes.