distcrawl
Originally developed for my bachelor's thesis (grade 1.0), distcrawl is a fault-tolerant distributed web crawler that scaled across 100+ cloud nodes to approximately 61,000 sites/hour. I have since extended it with Terraform automation, resilience testing, and OpenTelemetry/Grafana Cloud observability.