• reddig33@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    3 months ago

    I also don’t know if a law that says search engines have to honor a robots.txt file. I guess we will see what happens if Bing or some other service decides to ignore it.

    • Evotech@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 months ago

      You can just require a log in to view content, or just flat out auto ban indexing robots.