Where the check sits in the request path
The classifier is a model, omni-moderation-csam-latest, called through a standalone POST /v1/moderations request. It takes exactly one still image of up to 20 MB, as an HTTP(S) URL or a base64 data URL, and returns two signals: likely-csam and likely-csam/gen-ai. It does not classify text. It is available to approved organizations, and it does not support inline moderation or the Batch API.1 The Responses and Chat Completions APIs likewise don't accept it for inline moderation.2
Two consequences follow. First, the call is not a flag you add to a chat request, so it does not belong in the middle of a vision call. Second, access is tied to an approved organization's key. Treat that key as a restricted credential used by one trust-and-safety service, not as another route target.
The path that holds up:
- The upload lands in quarantine storage, tied to a user.
- Hash matching for known material runs, if you have it. OpenAI's guidance recommends it alongside classifiers.3
- The classifier service sends the image once and records the decision.
- Only a cleared image is passed to the gateway for a vision, edit or generation call.
- A flagged image never reaches the gateway or any second provider. It stays in the restricted store.
If the classifier call fails or is rate limited, hold the upload. A pass-through on error turns an outage into a hole. The trade-offs are the same as in fail open or fail closed.
What to keep out of logs and traces
A gateway log is the wrong place for anything that points at a flagged image. Keep these out of request logs, traces, OpenTelemetry span attributes, error trackers and reverse-proxy access logs:
- image bytes and base64 data URLs, including inside a failed request body that an error handler dumps;
- image URLs, especially signed ones, since a URL with its query string is a retrievable pointer;
- raw category scores in shared dashboards. OpenAI says scores are not calibrated probabilities and are comparable only within the same category and model snapshot, so they mislead outside a review tool.1
- user emails or usernames in clear text. OpenAI's guidance suggests a stable per-user identifier and hashing emails or usernames before sending them.3
On the INFRO side, content logging is off until an owner or admin turns it on, and a per-request logging: false disables capture even then. When capture is on, images carried by a request are stored as files beside the record under the same retention.4 Captured bodies need separate payload access on the key.5 So for any route that carries user images, decide the logging setting deliberately, and send logging: false from the code path that handles uploads.
What a general log may hold is a metadata record:
There is a tension to settle with counsel. OpenAI's guidance also says to keep usable records and identifiers when you report, so you can respond to law enforcement.3 Both can hold if the retained material lives in a separate case store, not in the shared log pipeline.
Who gets access to flagged items
Give the case store its own access list, not the engineering or observability roles. OpenAI's guidance calls for human review of high-severity signals with tools that limit unnecessary exposure and protect reviewer well-being, and for a response playbook that names who reviews, who escalates and who decides on enforcement.3 In practice:
- a small named group, with every open, export and delete recorded in an audit trail;
- no bulk export, no copies into tickets, chat or analytics;
- engineers debug with the metadata record, never the image;
- support for the reviewers themselves.
The gateway helps at its own edge, not in your case store. INFRO's request traces (opens in a new tab) record metadata, project-scoped access limits who reads which requests, and the audit log records member and policy changes. INFRO's guardrails are pattern checks on chat prompts and responses, and are not an image classifier, so they do not replace this step.
What to ask counsel
OpenAI states that its recommendations are not legal advice or a universal standard of care.3 Take these to counsel before launch:
- Does holding a flagged image for review, even briefly or in encrypted form, create exposure in each jurisdiction we operate in? Who may handle it?
- What must we report, to whom and by when, and what do we include in a report?
- May we retain a hash, a score or a user identifier of a flagged image, and for how long?
- What do our contracts with the gateway vendor and providers say about material that reaches them, and what do we tell users?
- What happens to a flagged user's other data, and how do we answer a law-enforcement request?
A flag is a prioritization signal. The classifier states that a category flag doesn't establish that an image is CSAM.1 Decisions about accounts and reports sit with your people and your counsel.
