Commit Graph
4 Commits
Author SHA1 Message Date
macdoos 3f3ba45beb Proper logging 2024-06-15 23:31:34 +02:00
macdoos 0383a96dba Revert "Fetch robots.txt on 301"
This reverts commit b98fed18e4.
2024-06-15 22:22:42 +02:00
macdoos 161efbe52b Add function to scan.go 2024-06-15 22:22:03 +02:00
macdoos b98fed18e4 Fetch robots.txt on 301 2024-06-14 16:16:49 +02:00