Govern workloads, not model brands
Classify workloads by data sensitivity, output impact, modality, context, tools, region, and budget. Then approve models that satisfy those requirements. A global approved-model list is usually too permissive for sensitive work and too restrictive for low-risk experiments.
Tie every production model to evaluation evidence and a named owner.
Separate environments and authority
Development may explore a broader catalog with low ceilings and synthetic data. Production should use scoped keys, reviewed models, and explicit fallback policy. Human administrators, application services, and agents need different permissions.
Make exceptions time-bounded and reviewable. Permanent undocumented exceptions become the real policy.
Record decisions and changes
Audit model access changes, key creation and revocation, policy edits, and privileged actions. Link approvals to the evaluation version, data classification, and intended workload.
When a model changes behavior or terms, the record tells you which products need reevaluation.
Keep governance responsive
Publish the requirements, automate checks, maintain a small set of pre-approved patterns, and set a service level for exception review. Teams route around governance when the safe path cannot keep pace with product work.
A gateway is valuable because it provides one enforcement point instead of relying on every codebase to interpret a policy document.
