datasette-ip-rate-limit 0.1a0
Release: datasette-ip-rate-limit 0.1a0 (https://github.com/datasette/datasette-ip-rate-limit/releases/tag/0.1a0)
The datasette.io (https://datasette.io/) site was being hammered by
Release: datasette-ip-rate-limit 0.1a0 (https://github.com/datasette/datasette-ip-rate-limit/releases/tag/0.1a0)
The datasette.io (https://datasette.io/) site was being hammered by poorly-behaved crawlers, so I had Codex (GPT-5.5 xhigh) build a configurable rate limiting plugin to block IPs that were hammering specific areas of the site too quickly.
Here’s the production configuration (https://github.com/simonw/datasette.io/blob/b6022bf9987661b94a26d3143028193a6cabfdcf/datasette.yml#L103-L116) I’m using on that site for the new plugin:
datasette-ip-rate-limit: header: Fly-Client-IP max_keys: 10000 exempt_paths: - “/static/*” - “/-/turnstile*” rules: - name: public-demo-multi-parameter-table-pages paths: - “/global-power-plants/*” - “/legislators/*” window_seconds: 60 max_requests: 60 block_seconds: 20
Tags: datasette (https://simonwillison.net/tags/datasette), rate-limiting (https://simonwillison.net/tags/rate-limiting), codex (https://simonwillison.net/tags/codex)
No comments yet.
Write a comment