• ohshit604@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 month ago

    If your reverse proxy is Traefik I would suggest This plugin which pulls the robot.txt from This GitHub repository.

    I honestly should’ve setup a robots.txt a long time ago.