CGit being a html-generator with arbitrary combinations seems particularly vulnerable.
I am in a similar situation - I have a hobby web tool hosted on AWS lambda's free tier behind cloudfront which is quite economical (I usually stay below limit).
But over last 2 months I am getting many thousand requests a day. In theory there aren't many crawlable pages in my site but these bots are hammering the search endpoints with arbitrary queries which are somewhat related to the subject matter (must be powered by some weak LMs because they're not valid queries, just generated in a plausible way).
I have seen quite a few websites put behind anubis or some other sort of verification system in last 6 months or around. This satire from Krazam [1] was on point.
CGit being a html-generator with arbitrary combinations seems particularly vulnerable.
I am in a similar situation - I have a hobby web tool hosted on AWS lambda's free tier behind cloudfront which is quite economical (I usually stay below limit).
But over last 2 months I am getting many thousand requests a day. In theory there aren't many crawlable pages in my site but these bots are hammering the search endpoints with arbitrary queries which are somewhat related to the subject matter (must be powered by some weak LMs because they're not valid queries, just generated in a plausible way).
I have seen quite a few websites put behind anubis or some other sort of verification system in last 6 months or around. This satire from Krazam [1] was on point.
[1]: https://m.youtube.com/watch?v=IU4ByUbDKNc&pp=0gcJCYsCo7VqN5t...
https://news.ycombinator.com/item?id=49491791 (over 200 comments at the moment)