This site shows a daily demo run of the distcrawl-project. Every day at midnight, we use Terraform to automatically spin up the infrastructure, run the demo crawl, and show the results on this site. Then all infrastructure is destroyed. I chose wikipedia, duckduckgo and my personal website. The last crawl of our 3 example websites happened on 2026-06-22.
| Site | Status | Requests | Responses |
|---|---|---|---|
| wikipedia.com | could not be crawled | 0 | 0 |
| duckduckgo.com | could not be crawled | 0 | 0 |
| landmann.ph | could not be crawled | 0 | 0 |