AI crawlers and calendars
| 1 min read
I was helping out a friend whose site got hit with a huge spike in traffic. This is a portfolio site. So no blog or anything like that. The entire site is six pages and static coded via Bootstrap. So why the 10,000x spike in traffic? It turns out the AI crawlers got stuck on his booking calendar in an endless loop. Once we blocked the AI crawlers, things returned to normal.