Configure Cold-Start Behavior Latest
Placeholder responses, fallback services, pending request limits, and response headers for cold-start scenarios
When a request arrives for a backend that has been scaled to zero, the interceptor holds the request until the backend becomes ready. You can configure a placeholder response, a fallback service, or both to control what happens during a cold start. You can also limit how many requests are held while the backend scales up.
Placeholder response
The interceptor can return a static HTTP response immediately while the backend scales up, instead of holding the request.
Configure the coldStart.placeholder field to enable this:
apiVersion: http.keda.sh/v1beta1
kind: InterceptorRoute
metadata:
name: my-app
spec:
target:
service: my-app-svc
port: 8080
scalingMetric:
concurrency:
targetValue: 100
coldStart:
placeholder:
response:
body: "<h1>Loading...</h1>"
headers:
Content-Type: text/html
Refresh: "5"
statusCode: 503
The Refresh header tells the browser to reload the page after 5 seconds, so the user automatically sees the real page once the backend is ready.
Response body from a ConfigMap
For larger or more complex responses, store the body in a ConfigMap in the same namespace instead of inline.
The ConfigMap must have the label http.keda.sh/response-body: "true".
apiVersion: v1
kind: ConfigMap
metadata:
name: placeholder-page
labels:
http.keda.sh/response-body: "true"
data:
index.html: |
<!DOCTYPE html>
<html>
<body>
<h1>Loading, please wait...</h1>
</body>
</html>
---
apiVersion: http.keda.sh/v1beta1
kind: InterceptorRoute
metadata:
name: my-app
spec:
target:
service: my-app-svc
port: 8080
scalingMetric:
concurrency:
targetValue: 100
coldStart:
placeholder:
response:
bodyFromConfigMap:
name: placeholder-page
key: index.html
headers:
Refresh: "5"
statusCode: 503
When the key is omitted, it is derived from the request path (without the leading /, defaulting to index.html for /).
This lets a single ConfigMap serve different files for different paths.
The Content-Type header is auto-detected from the key’s file extension unless explicitly set in headers.
Placeholder defaults
- Status code: defaults to
503when not specified. - Body: defaults to an empty body when neither
bodynorbodyFromConfigMapis set.
Cold-start fallback
When the readiness timeout expires during a cold start, the interceptor returns an error by default.
To serve requests from a fallback service instead, configure the coldStart.fallback field:
apiVersion: http.keda.sh/v1beta1
kind: InterceptorRoute
metadata:
name: my-app
spec:
target:
service: <your-service>
port: <your-port>
scalingMetric:
concurrency:
targetValue: 100
coldStart:
fallback:
service:
name: <your-fallback-service>
port: <your-fallback-port>
timeouts:
readiness: 5s
When a fallback is configured but the readiness timeout is 0s (disabled), a 30-second default readiness timeout is applied automatically.
This prevents the fallback from never being triggered.
Combining placeholder and fallback
You can configure both a placeholder response and a fallback service. When both are set, the placeholder response is returned immediately while the backend scales up. If the backend does not become ready within the readiness timeout, subsequent requests are routed to the fallback service.
coldStart:
placeholder:
response:
body: "<h1>Loading...</h1>"
headers:
Content-Type: text/html
Refresh: "5"
statusCode: 503
fallback:
service:
name: fallback-svc
port: 8080
Limiting pending requests
While a backend has no ready endpoints, the interceptor holds incoming requests until an endpoint becomes ready.
Each held request keeps a connection and its buffers open, so a request burst against a scaled-to-zero app can exhaust an interceptor pod’s memory.
Use coldStart.maxPendingRequests to bound how many requests a route holds:
coldStart:
maxPendingRequests: 500
overflow: Reject
Requests arriving when the limit is reached are rejected with HTTP 503.
Rejections are tracked by the interceptor_cold_start_rejections_total metric (see Metrics Reference).
Set overflow to Placeholder to serve the configured placeholder response instead of an error:
coldStart:
maxPendingRequests: 500
overflow: Placeholder
placeholder:
response:
body: "<h1>Loading...</h1>"
headers:
Refresh: "5"
statusCode: 503
With this combination, the first 500 requests are held until the backend becomes ready, and only overflowing requests receive the placeholder.
A placeholder without maxPendingRequests keeps its default behavior: every request receives the placeholder immediately and no requests are held.
The limit applies per interceptor replica: with 3 interceptor replicas, up to 1,500 requests can be held cluster-wide.
When unset, the global KEDA_HTTP_COLD_START_MAX_PENDING_REQUESTS default applies (0 — unlimited, see Configure the Interceptor).
Cold-start response header
The interceptor adds an X-KEDA-HTTP-Cold-Start response header to indicate whether a cold start occurred:
X-KEDA-HTTP-Cold-Start: true— the request triggered a scale-from-zero.X-KEDA-HTTP-Cold-Start: false— the backend was already running.
This header is enabled by default. To disable it, see Configure the Interceptor.
What’s Next
- How Scaling Works — cold-start mechanics and scale-from-zero behavior.
- Configure Timeouts — per-route timeout overrides.
- InterceptorRoute Reference — field details for
coldStart.