This allows us to identify requests sent by Zeno based (or other gocrawlhq) machines, allowing us to reset them in the future, if needed.
For reference, it currently follows "hostname + "-" + project", so for example "crawl900.us.archive.org-ahrefs"
This allows us to identify requests sent by Zeno based (or other gocrawlhq) machines, allowing us to reset them in the future, if needed.
For reference, it currently follows "hostname + "-" + project", so for example "crawl900.us.archive.org-ahrefs"