A bot management platform decides which traffic reaches your login, checkout and APIs, so one bypass rule or one stolen configuration token can quietly switch off your defences against credential stuffing, scraping and fraud. These platforms sit in the request path at the edge or in front of your application, run detection scripts in your users' browsers and SDKs in your mobile apps, and are increasingly managed as code through APIs. That gives them admin users, API tokens, allowlists, client-side code and a store of device and behaviour data, all of which need protecting. This guide is for web security engineers, platform teams and fraud leads who run bot management. It covers admin roles, configuration tokens, bypass and allowlist rules, origin protection, client-side integrity, data handling, logging and lifecycle. It is vendor-neutral: confirm setting names in your vendor's documentation. For how bot detection works and how to choose responses, see the Bot Management Guide.
Key takeaways
- Allowlists are the crown jewels. Bypass rules for partners, monitoring and verified bots are the easiest way to defeat bot defences, so restrict who can create them and give each one an owner and expiry.
- Configuration tokens are production credentials. API tokens used by infrastructure as code can change every rule; scope them per zone or application, keep them in a secrets manager and rotate them.
- Protect the origin. Bot controls at the edge only work if attackers cannot reach your origin directly; enforce that only the platform can connect.
- Treat the detection script as supply chain. The JavaScript and mobile SDKs run in your customers' sessions; control how they are loaded and updated.
- Log changes outside the platform. Rule, mode and allowlist changes belong in your SIEM, where platform administrators cannot alter them.
What makes up the platform's attack surface
| Component | What it holds or can do | If an attacker controls it | Primary control |
|---|---|---|---|
| Management console | Detection settings, response actions, rules, allowlists, users | Moves protected routes to log-only, allowlists their own infrastructure | SSO with phishing-resistant MFA, least-privilege roles, audit log export |
| Configuration API tokens | Programmatic change of rules and settings, often from pipelines | Silent mass change of rules, outside the console | Scoped, short-lived or rotated tokens in a secrets manager; changes through review |
| Allowlists, bypass rules and verified bot lists | Exempt traffic by address, header, user agent, key or signature | Full bypass for attack traffic that matches the rule | Strong match criteria, owner, expiry and approval |
| Origin connection | Path from the platform to your application | Direct traffic to the origin that never meets bot controls | Origin accepts only authenticated platform traffic |
| Client-side script and mobile SDK | Code in customers' browsers and apps; collects signals | Tampered script, collected data sent elsewhere, broken checkout | Controlled loading, change monitoring, staged SDK updates |
| Signal and event data | IP addresses, device and behaviour signals, account identifiers | Profiling of customers, data protection exposure | Minimisation, retention limits, access control on exports |
| Integrations (SIEM, identity provider, fraud tools) | Tokens and webhooks into other systems | Tampered risk signals, data leaving through webhooks | Per-integration credentials with minimal scope |
Admin roles and console access
- Separate duties: define at least platform administrator (users, tokens, integrations), policy owner (detection and response settings, allowlists), analyst (dashboards, investigation) and read-only roles for application teams. Allowlist and bypass rights belong with the policy owner role, not with every application team.
- Shared edge accounts: bot management is often a feature of a wider edge or CDN account that also controls DNS, certificates and caching. Review who holds account-wide roles, because they can change bot settings too.
- Authentication: enforce SSO and phishing-resistant MFA. The CISA and FBI Secure by Demand guide suggests buyers ask whether standards-based SSO is offered at no additional cost and whether MFA is enabled by default. Keep one documented break-glass account. See the Break-Glass Account Guide.
- Admin devices and elevation: administer from managed devices and grant administrator roles just in time where your access tooling allows. See the Privileged Access Workstations Guide.
- Review: review role assignments every quarter and on every leaver (our recommendation).
Configuration tokens, keys and integrations
| Credential | Needs | Avoid | Pattern |
|---|---|---|---|
| Infrastructure as code token | Change bot settings for named zones or applications | Account-wide tokens that can also change DNS, certificates or users | Scoped token per pipeline, held in a secrets manager, rotated; changes only through reviewed pull requests |
| Analytics or export token | Read events for reporting or SIEM ingestion | Write permissions | Read-only token or push-based log delivery |
| Partner and API client keys used in bypass rules | Identify approved automated clients | Static shared header values used as the only bypass criterion | Per-partner keys, rate limits, and signature-based verification where available |
| Mobile SDK and site keys | Identify your app or site to the platform | Treating a key embedded in a client as secret | Assume client keys are public; enforce on server-side validation instead |
| Identity provider or fraud tool integration | Send risk signals for step-up decisions | Broad administrator rights in the receiving system | Dedicated integration identity with minimal scope |
See the API Key Management Guide and the CI/CD Pipeline Identity Security Guide.
Allowlists, bypass rules and verified bots
Every bot programme accumulates exceptions: uptime monitors, partners, search engine crawlers, internal testing tools, accessibility tools and now AI agents acting for customers. Each exception is a route around your defences.
- Prefer cryptographic identity over spoofable attributes: user agent strings and headers are trivial to copy. Where a client can sign requests, verification of HTTP message signatures (IETF RFC 9421) is far stronger than a header match. See the Web Bot Auth and HTTP Message Signatures for Agents.
- Narrow address-based rules: where you must allowlist by address, use the smallest ranges, document the source and recheck them.
- Owner and expiry: record an owner, reason and expiry for every bypass (our recommendation: 90 days for temporary rules, annual review for permanent ones).
- Scope bypasses: exempt a client from specific checks on specific paths, not from all protection everywhere. A monitoring service needs one health endpoint, not your login page.
- Rate limit the trusted: keep rate limits on allowlisted clients so a stolen partner key cannot run a credential stuffing campaign.
For agent traffic, see the Bot vs AI Agent Traffic Management Guide.
Origin protection and client-side integrity
- Close the side door: if your origin is reachable directly, attackers skip the edge entirely. Restrict origin access to the platform using mutual TLS, an authenticated origin connection or network rules, and keep origin addresses out of public DNS history and error pages where you can.
- Detection script loading: load the platform's script from the location the vendor documents, include it in your content security policy and your inventory of third-party scripts, and monitor for unexpected changes. See the Third-Party JavaScript Management Guide. On payment pages, include it in your PCI DSS script inventory; see the PCI DSS for E-commerce Payment Page Scripts Guide.
- Mobile SDK updates: take SDK updates through your normal dependency review and staged app release.
- Fail behaviour: decide what happens if the platform cannot score a request: fail open keeps the site up but drops protection, fail closed protects but may block customers. Choose per route and document it.
- Updates: for self-hosted components, apply vendor security updates promptly and subscribe to the vendor's security advisories.
Data the platform holds
Bot detection relies on IP addresses, device signals, behavioural data and often account identifiers, much of which is personal data. Agree a lawful basis and retention period with your privacy team, minimise what is exported to analytics tools, restrict raw event access to analysts who need it, and confirm the vendor's storage regions and support access. See the Privacy in Security Logging and Monitoring Guide.
Logging and monitoring
- Audit log to SIEM: export sign-ins, role and token changes, rule edits, mode changes, allowlist additions and exports to your SIEM. NCSC lists logging and auditing administration activities as a principle of secure system administration, and Secure by Demand suggests logs should capture configuration changes and identity events such as token creation.
- Alert on protection drops: a protected route moved to log-only, a new broad allowlist, or a sudden fall in challenged or blocked traffic on login.
- Watch the trusted: alert when an allowlisted client's volume, paths or failure rate change sharply.
- Detect drift: compare live configuration with the version in source control and alert on differences made outside the pipeline.
Lifecycle and decommissioning
- Onboard: keep configuration in code from the start, with an inventory of protected routes, owners and exceptions.
- Change: require a second approver for any change that reduces protection on login, registration, checkout or APIs (our recommendation).
- Exercise: test origin protection, fail behaviour and emergency rollback at least once a year.
- Retire: remove scripts and SDKs from every page and app, revoke tokens and partner keys, close origin rules, export audit logs you must keep, and get written confirmation of data deletion.
Framework mapping
| Control area | NIST SP 800-53 Rev. 5 | NIST CSF 2.0 | ATT&CK threat addressed |
|---|---|---|---|
| Console roles and privileged accounts | AC-2, AC-6, AC-6(5) | PR.AA-05 | T1078 Valid Accounts |
| Configuration tokens and partner keys | IA-5 | PR.AA-01 | T1552 Unsecured Credentials |
| Configuration baseline and drift | CM-6, CM-7 | PR.PS-02 | T1685 Disable or Modify Tools |
| Audit log protection | AU-6, AU-9, AC-6(9) | PR.PS-04 | T1685 Disable or Modify Tools |
| Vendor and client-side code | SA-9, SR-3 | GV.SC-07 | T1195 Supply Chain Compromise |
Common failure patterns
- User agent allowlist: a rule exempts anything claiming to be a known crawler, and attackers simply copy the string.
- Exposed origin: the origin still answers on its public address, so attackers bypass the edge.
- Account-wide token in a pipeline: a token meant for bot rules can also change DNS and certificates.
- Log-only that stayed: login protection was set to log-only during a launch and never restored.
- Forgotten partner: a partner relationship ended but its bypass key still works.
Practitioner checklist
- Map console and account-wide edge roles, enforce SSO with phishing-resistant MFA and keep one break-glass account.
- Restrict allowlist and bypass rights to policy owners, with owner, reason, expiry and approval on every rule.
- Replace user agent and static header bypasses with signature verification or narrow, rate-limited keys.
- Scope configuration tokens per zone or application, store them in a secrets manager and rotate them.
- Restrict origin access to authenticated platform traffic and test it.
- Inventory the detection script and SDK as third-party code and stage updates.
- Agree data minimisation and retention for signal data with your privacy team.
- Export the audit log to your SIEM and alert on protection drops, new bypasses and configuration drift.
- Document fail behaviour per route and a full retirement checklist.
Standards and references
- OWASP: Automated Threats to Web Applications
- IETF: RFC 9421 HTTP Message Signatures
- NIST: SP 800-53 Rev. 5 Security and Privacy Controls
- NIST: Cybersecurity Framework 2.0
- NCSC: Secure system administration
- CISA and FBI: Secure by Demand Guide
- OWASP: Logging Cheat Sheet
Related NHI Mgmt Group resources: Bot Management Guide · Bot Management Buyer's Guide · Web Application Firewall Guide · Securing the identity threat detection and response (ITDR) tool itself