Originally developed for my bachelor's thesis (grade 1.0), distcrawl is a fault-tolerant distributed web crawler that scaled across 100+ cloud nodes to approximately 61,000 sites/hour. I have since extended it with Terraform automation, resilience testing, and OpenTelemetry/Grafana Cloud observability.
First-place project at the SCHOTT X LAUNCH Build Days hackathon. Implemented adaptive source scrapers for a MedTech RAG pipeline that switch between HTTP requests and Playwright based on source requirements.
Real-time collaborative whiteboard deployed as horizontally scalable, stateless containers on AWS. Socket.IO and Redis Pub/Sub synchronize instances, while MongoDB provides persistent storage.