distcrawl
Originally developed for my bachelor's thesis, distcrawl is a fault-tolerant distributed web crawler that scaled across 100+ cloud nodes to approximately 61,000 sites/hour. I have since extended it with Terraform automation, resilience testing, and OpenTelemetry/Grafana Cloud observability.