Wednesday, November 11, 2026

GRC Insights | Volume I – Responsible AI Governance Part X: Agentic AI Governance — Governing Autonomous AI Agents, Delegated Decisions and Enterprise Accountability


From AI that recommends to AI that acts: building the governance architecture for the autonomous enterprise.

Introduction: When AI Stops Recommending and Starts Acting

The evolution of enterprise Artificial Intelligence is entering a new phase.

For several years, organizations have primarily focused on deploying AI systems that analyse information, generate content, summarize documents, identify patterns and recommend decisions. Generative AI has significantly changed how employees interact with technology, access knowledge and perform everyday tasks.

However, the next evolution is more consequential.

Agentic AI systems are increasingly designed to pursue defined objectives, plan multi-step activities, interact with external tools, retrieve information, invoke APIs, communicate with other agents and execute actions with varying degrees of autonomy.

Consider a relatively straightforward enterprise scenario.

An employee asks an AI assistant to review outstanding supplier invoices. A conventional AI assistant might identify overdue invoices and recommend follow-up actions.

An AI agent, depending on its permissions and design, could go considerably further:

  • Retrieve supplier information from an ERP platform.

  • Compare invoices against purchase orders.

  • Identify discrepancies and potential exceptions.

  • Contact suppliers for clarification.

  • Update workflow records.

  • Initiate an approval request.

  • Potentially trigger a payment workflow within its delegated authority.

The distinction is fundamental.

The organization is no longer governing only the information generated by an AI system. It is governing a system capable of taking actions within the enterprise environment.

This introduces a new governance question:

When an AI agent acts on behalf of an organization, who authorized the action, what boundaries governed it, and who remains accountable for the outcome?

Agentic AI governance must address that question before autonomous capabilities become embedded in critical business processes.

1. Understanding Agentic AI: Beyond Traditional Generative AI

Agentic AI refers broadly to AI-enabled systems that can pursue objectives through a sequence of decisions and actions, often using tools, external systems, memory or other agents.

The terminology is evolving, and not every product marketed as an AI agent has the same degree of autonomy. Some agents operate within tightly controlled workflows, while others can dynamically select tools, plan activities and adapt their execution.

For governance purposes, it is useful to distinguish three broad operating patterns.

Pattern 1: AI-assisted decision-making

The system analyses information and produces recommendations. A human reviews and performs the action.

Pattern 2: AI-orchestrated execution

The system plans and coordinates activities, but significant decisions or actions require human approval.

Pattern 3: Autonomous agent execution

The system can independently perform approved activities within predefined permissions, constraints and operating boundaries.

These patterns should not be treated as a simple maturity ladder in which greater autonomy is automatically better. The appropriate level depends on business impact, risk exposure, reversibility, data sensitivity and the organization's ability to maintain effective oversight.

An agent that schedules internal meetings does not require the same governance as one that modifies customer records, changes production infrastructure or initiates financial transactions.

The governance architecture must therefore be proportionate to the agent's actual capabilities and potential impact.

2. Why Agentic AI Creates a New Enterprise Risk Landscape

Traditional AI governance remains relevant, but autonomous execution introduces additional dimensions that organizations cannot adequately address through model accuracy and responsible-use policies alone.

Consider the following risk categories.

2.1 Identity and privilege abuse

An agent may require access to multiple enterprise applications, databases, APIs and services.

If organizations assign agents excessive permissions, reuse human credentials or fail to distinguish individual agents, a compromised or misdirected agent could operate with privileges beyond its intended purpose.

Every agent should have a distinguishable identity, an accountable owner and permissions aligned with its approved responsibilities.

2.2 Goal hijacking and instruction manipulation

An agent may process emails, documents, web pages, tickets or other externally supplied content.

Malicious or manipulated instructions embedded in those sources may influence the agent's behaviour, redirect its objectives or induce it to perform unintended actions.

This is particularly important when agents can access sensitive information or invoke privileged tools.

2.3 Uncontrolled tool execution

An agent's ability to call tools is also its ability to affect enterprise systems.

An incorrectly configured integration, unsafe API call or poorly validated action could result in unauthorized changes, data disclosure or disruption of business operations.

Tool access must therefore be governed as an explicit privilege, not treated as a convenient technical integration.

2.4 Memory and context poisoning

Agents may retain or retrieve information from previous interactions, knowledge bases or external sources.

If this context becomes inaccurate, manipulated or contaminated, future decisions and actions may be affected.

Organizations need to understand what an agent remembers, where that information is stored, how it is updated and when it should be removed.

2.5 Inter-agent communication and cascading failures

An enterprise may deploy several specialized agents that delegate tasks to one another.

A failure in one agent can propagate across interconnected workflows. An incorrect recommendation may become an instruction to another agent, which may execute it without independently validating the original information.

The result can be a chain of unintended actions rather than an isolated AI error.

2.6 Human over-reliance and accountability gaps

Employees may assume that an autonomous system has correctly interpreted a request or completed an activity.

Managers may also assume that another team owns the agent's decisions, particularly when responsibility is divided between technology, business operations and risk functions.

Automation must never become a mechanism for transferring accountability away from the organization.

These risks reinforce an important principle:

An AI agent's autonomy must be matched by an equally mature governance and control environment.

3. The Agentic AI Governance Operating Model

Agentic AI governance should not become a disconnected framework sitting outside the organization's existing AI governance, cybersecurity, enterprise risk and operational control structures.

It should extend the established AI Management System and Enterprise GRC environment to address autonomous execution.

The following operating model provides a practical structure.

Layer 1: Enterprise and Board Oversight

The Board and executive leadership establish the organization's risk appetite for autonomous AI.

Their responsibilities include:

  • Approving the strategic direction for agentic AI adoption.

  • Understanding material business and operational risks.

  • Establishing accountability for autonomous activities.

  • Reviewing significant incidents and control failures.

  • Ensuring that governance investment keeps pace with adoption.

The Board does not need to approve every agent deployment. It needs visibility into material risks, delegated authority and the effectiveness of management oversight.

Layer 2: AI Governance and Enterprise Risk

The AI Governance Council, supported by GRC, Risk, Legal, Privacy and Compliance functions, establishes the enterprise governance requirements.

Its responsibilities include:

  • Defining agent classification and approval criteria.

  • Establishing risk assessment and impact assessment processes.

  • Setting minimum control requirements.

  • Maintaining the enterprise AI and agent inventory.

  • Defining human oversight requirements.

  • Monitoring regulatory and contractual obligations.

  • Reviewing exceptions and residual risks.

This layer translates strategic risk appetite into operational governance requirements.

Layer 3: Security, Identity and Technology Controls

CISO, IAM, Security Architecture, Cloud Security, Application Security and platform engineering teams implement the technical control environment.

Key responsibilities include:

  • Agent identity and authentication.

  • Authorization and privilege management.

  • Secure tool and API integrations.

  • Secrets and credential protection.

  • Network and data access restrictions.

  • Runtime monitoring and anomaly detection.

  • Logging, evidence retention and incident response.

  • Secure development, testing and change management.

Layer 4: Business Ownership and Operational Execution

The business function sponsoring an agent remains accountable for its approved business purpose and operational outcomes.

Responsibilities include:

  • Defining the agent's intended purpose.

  • Identifying the business process and affected stakeholders.

  • Assigning an accountable business owner.

  • Validating the agent's outputs and actions.

  • Maintaining human approval requirements.

  • Monitoring operational performance.

  • Escalating exceptions and incidents.

Technology teams can operate the platform, and GRC can oversee the control framework, but neither should become the substitute for business ownership.

4. The Agentic AI Lifecycle: Governance From Registration to Retirement

One of the biggest governance mistakes organizations can make is treating agent approval as a one-time activity.

Agentic systems can evolve through changes to models, prompts, tools, permissions, connected applications, knowledge sources and operating objectives.

A controlled lifecycle is therefore essential.

The proposed lifecycle is:

Identify → Classify → Assess → Authorize → Deploy → Monitor → Reassess → Retire

Step 1: Identify and Register

Every enterprise agent should be recorded in a centralized inventory.

Minimum information should include:

  • Unique agent identifier.

  • Agent name and business purpose.

  • Business owner and technical owner.

  • Developer, platform and service provider.

  • Model and version information, where available.

  • Connected applications and tools.

  • Data sources and data classifications.

  • Assigned permissions and identities.

  • Approved autonomy level.

  • Human oversight and escalation requirements.

  • Deployment environment and lifecycle status.

An organization cannot govern what it cannot identify.

The inventory should include internally developed agents, externally provided agents, embedded agents within enterprise SaaS platforms and material agents deployed by business functions.

Step 2: Classify the Agent

Not every agent requires the same level of governance.

A practical classification should consider:

  1. Business impact: Could the agent affect financial results, customer outcomes or critical business operations?

  2. Data sensitivity: Does it access confidential, personal, regulated or commercially sensitive information?

  3. Execution authority: Can it read, modify, approve, delete, transfer or execute?

  4. Autonomy: Does it require human approval, or can it act independently?

  5. External exposure: Does it interact with customers, suppliers, public services or external systems?

  6. Reversibility: Can its actions be easily reversed?

  7. Dependency: Does it delegate activities to other agents or rely on third-party services?

A useful internal classification could be:

ClassificationTypical capabilityGovernance expectation
Level 1 – AssistiveRead, summarize and recommendStandard AI controls
Level 2 – CoordinatedPrepare and orchestrate workflowsDefined human approvals
Level 3 – Controlled executionExecute approved, bounded actionsStrong identity, access and monitoring controls
Level 4 – High-impact autonomyExecute material or sensitive activitiesEnhanced approval, segregation, continuous oversight and tested emergency controls

This is a proposed enterprise classification model, not an official regulatory classification.

The organization should map its internal categories to applicable legal and regulatory requirements rather than assuming that autonomy level alone determines regulatory classification.

Step 3: Conduct Agent-Specific Risk Assessment

Traditional AI risk assessments should be supplemented with agent-specific questions.

For example:

  • Can the agent access more information than necessary?

  • Can it execute transactions or modify critical records?

  • Can it invoke tools outside its approved purpose?

  • Can untrusted content influence its instructions?

  • Can it delegate tasks to another agent?

  • Can the agent's memory retain sensitive information?

  • Can an incorrect action create cascading business impact?

  • Is there a reliable mechanism to interrupt execution?

  • Can the organization reconstruct what happened and why?

The assessment should cover business, operational, security, privacy, legal, compliance, third-party and resilience risks.

Risk assessment should also evaluate the full workflow, not just the underlying AI model.

Step 4: Authorize and Approve

Before deployment, the organization should formally authorize:

  • Business purpose and process ownership.

  • Approved autonomy level.

  • Data access and processing boundaries.

  • Tool and application permissions.

  • Human approval checkpoints.

  • Financial or operational execution limits.

  • Monitoring and escalation requirements.

  • Incident response and shutdown procedures.

High-impact agents should undergo documented approval involving the relevant business owner, technology owner and independent control functions.

The approval should be tied to a specific configuration and scope. Material changes to that configuration should trigger reassessment.

Step 5: Deploy With Guardrails

Deployment should follow secure engineering and change-management practices.

The organization should validate:

  • Approved model and agent versions.

  • Identity and access configuration.

  • Tool allowlists and API restrictions.

  • Data access controls.

  • Runtime policy enforcement.

  • Human approval mechanisms.

  • Logging and monitoring.

  • Recovery and rollback procedures.

Production deployment should not rely solely on successful demonstrations or proof-of-concept results.

Step 6: Monitor and Reassess

Agent behaviour and business context may change over time.

Monitoring should cover both technical activity and business outcomes.

Examples include:

  • Unexpected tool invocation.

  • Unusual access patterns.

  • Repeated authorization failures.

  • Actions outside approved operating hours or scope.

  • Excessive delegation or agent-to-agent activity.

  • Policy violations.

  • Unexpected changes in transaction volumes.

  • Repeated human overrides.

  • Material changes to underlying models or integrations.

Reassessment should occur periodically and when significant changes, incidents or new dependencies emerge.

Step 7: Retire and Revoke

Retirement must be treated as a formal control activity.

When an agent is decommissioned, organizations should:

  • Revoke its identities and credentials.

  • Disable API keys and service accounts.

  • Remove application permissions.

  • Review and retain required audit records.

  • Address stored memory and sensitive data.

  • Remove obsolete integrations.

  • Update the enterprise agent inventory.

  • Confirm that dependent workflows remain secure.

An agent that is no longer in use but still has valid credentials is an unnecessary attack surface.

5. Identity and Access Management: Every Agent Needs an Identity

This is arguably one of the most important control areas in agentic AI governance.

Traditional enterprise IAM frameworks are built around human users, service accounts, applications and workloads.

Agentic AI introduces a more complex identity and authorization requirement.

An agent may act on behalf of a human, operate under a business process identity, interact with another agent or execute tasks through multiple connected services.

Organizations must be able to distinguish:

  • Who initiated the activity.

  • Which agent performed it.

  • Which identity was used.

  • What authority was delegated.

  • Which resources were accessed.

  • What action was executed.

  • Whether the action was approved.

  • Which accountable owner is responsible.

Recommended Agent IAM Controls

1. Unique agent identity

Each production agent should have a unique, traceable identity. Shared credentials across multiple agents should be avoided.

2. Least privilege

Grant only the permissions required for the approved business purpose.

An agent that needs to read invoice records should not automatically receive permission to modify supplier bank details or initiate payments.

3. Delegated authorization

Where an agent acts on behalf of a human or another system, authorization should be explicit, limited and traceable.

Delegation should not silently inherit unrestricted privileges from the initiating user.

4. Just-in-time and time-bound access

Where practical, sensitive permissions should be granted only for the required task and duration.

5. Credential and secrets management

API keys, tokens and certificates should be securely managed, rotated and monitored. Credentials must not be exposed through prompts, agent memory or logs.

6. Segregation of duties

An agent should not be allowed to initiate and independently approve a sensitive transaction where organizational policy requires separation of responsibilities.

7. Revocation and emergency disablement

Organizations must be able to revoke an agent's access or suspend its execution quickly when required.

8. Non-repudiable activity records

Logs should preserve the relationship between the initiating user, agent identity, delegated authority, tool invocation and resulting action.

The underlying principle is straightforward:

An AI agent should have an identity, not an anonymous collection of permissions.

6. Human-in-the-Loop: Where Should Human Authority Begin and End?

Human oversight is frequently presented as a universal solution to AI risk.

However, simply adding an approval button does not establish effective human oversight.

The reviewer must have sufficient information, authority, competence and time to make a meaningful decision.

For agentic AI, human oversight should be designed around the potential impact and reversibility of actions.

Three Oversight Patterns

Human-in-the-Loop (HITL)

The agent prepares or recommends an action, but a human must approve it before execution.

Appropriate examples include high-value transactions, sensitive access changes and decisions with significant customer or employee impact.

Human-on-the-Loop (HOTL)

The agent executes predefined activities autonomously, while a human monitors performance and can intervene.

Appropriate examples may include routine, low-impact operational workflows with clear boundaries and tested intervention mechanisms.

Human-in-Command (HIC)

A designated human authority retains the ability to direct, restrict, suspend or terminate the agent's activities.

This is particularly important for critical workflows, material incidents and high-impact autonomous systems.

A Practical Approval Matrix

Action typeSuggested oversight
Read approved internal knowledgeAutonomous within access policy
Draft an internal communicationHuman review before external distribution
Update a low-risk workflow recordBounded autonomous execution with monitoring
Modify privileged accessExplicit human approval
Change supplier payment detailsIndependent verification and human authorization
Initiate a material financial transactionApproval under financial delegation and segregation-of-duties policy
Modify production infrastructureControlled change approval and rollback capability
Delete critical records or suspend essential servicesExplicit authorization and tested emergency controls

The exact thresholds should be defined by the organization based on its business, regulatory and operational context.

A critical distinction must be maintained:

Human oversight is not meaningful if the human cannot understand, challenge or stop the action.

7. Agentic AI Security: Extending the Enterprise Security Architecture

Agentic AI should be integrated into the organization's existing cybersecurity architecture, but with additional controls that address autonomous behaviour and tool use.

The following control domains deserve particular attention.

Application and API Security

  • Maintain approved tool and API inventories.

  • Validate tool inputs and outputs.

  • Enforce authorization at the API layer.

  • Restrict high-risk operations.

  • Apply rate limits and execution quotas.

  • Prevent unauthorized tool discovery and invocation.

Data Security and Privacy

  • Apply data classification and access restrictions.

  • Prevent unauthorized data movement between tools.

  • Mask or minimize sensitive information where appropriate.

  • Protect agent memory and context stores.

  • Define retention and deletion requirements.

  • Monitor data access and exfiltration indicators.

Runtime Security

  • Enforce policies at the point of execution.

  • Detect unusual agent behaviour.

  • Restrict unapproved destinations and integrations.

  • Monitor agent-to-agent communications.

  • Maintain execution limits and circuit breakers.

  • Support immediate suspension and recovery.

Secure Development and Supply Chain

  • Assess third-party agent frameworks and components.

  • Validate plugins, connectors, tools and model dependencies.

  • Review agent configuration and code changes.

  • Maintain version control and release approvals.

  • Conduct adversarial testing and security assessments.

  • Monitor material changes to external dependencies.

Resilience and Business Continuity

  • Define manual fallback procedures.

  • Establish recovery and rollback mechanisms.

  • Test agent failure scenarios.

  • Identify critical dependencies and single points of failure.

  • Prevent cascading failures across interconnected agents.

A particularly important consideration is that the organization should not rely exclusively on model-level safety controls.

An agent can produce a seemingly harmless response while invoking an unsafe tool or performing an unauthorized action. Security controls must therefore operate across the complete execution path.

8. Agentic AI Governance Metrics: What Should Leadership Measure?

Traditional AI dashboards often focus on model performance, adoption, accuracy and productivity.

These remain useful, but agentic AI requires additional metrics that measure authority, execution, control effectiveness and operational outcomes.

A proposed Agentic AI Governance Scorecard could include six dimensions.

DimensionSuggested metrics
Inventory and ownershipPercentage of production agents registered; percentage with named business owners
Identity and accessPercentage with unique identities; privileged access exceptions; credential rotation compliance
Execution controlPercentage of high-impact actions requiring approval; unauthorized tool invocation attempts
Security and resilienceAgent-related incidents; anomalous execution events; successful recovery tests
Human oversightApproval response time; override rate; unresolved exceptions
Assurance and complianceRisk assessment coverage; control testing completion; overdue remediation actions

KPIs and KRIs Must Be Balanced

KPIs help determine whether the agent is delivering business value.

Examples include:

  • Reduction in processing time.

  • Improvement in workflow completion rates.

  • Reduction in manual effort.

  • Increase in service availability.

  • Cost savings.

KRIs indicate whether the organization is accumulating unacceptable risk.

Examples include:

  • Percentage of agents with excessive permissions.

  • Number of unauthorized execution attempts.

  • Number of high-impact actions without adequate approval.

  • Percentage of agents operating outside their registered scope.

  • Number of unresolved critical security findings.

  • Frequency of material human overrides.

An organization that reports only productivity gains may be measuring the benefits of autonomy without measuring the risks created by it.

9. Agentic AI Incident Management: When an Agent Goes Rogue

Incident management must evolve alongside agent capabilities.

Traditional AI incident management already covers model failures, harmful outputs, bias, data leakage and performance degradation.

Agentic AI introduces additional scenarios:

  • An agent executes an unauthorized transaction.

  • An agent modifies or deletes business records.

  • An agent exposes sensitive data through an external integration.

  • A compromised agent uses legitimate privileges maliciously.

  • One agent delegates an unsafe instruction to another.

  • A configuration change expands an agent's execution authority.

  • An agent becomes trapped in a repeated action cycle.

Organizations should define an agent-specific response process.

Detect → Triage → Contain → Investigate → Recover → Learn

Immediate Containment

Depending on the incident, containment may involve:

  • Suspending the affected agent.

  • Revoking credentials and tokens.

  • Disabling specific tools or integrations.

  • Blocking external communication.

  • Preventing further execution.

  • Preserving relevant logs and evidence.

Investigation and Accountability

The investigation should establish:

  • Which user or process initiated the activity.

  • Which agent and version were involved.

  • What instructions and context influenced execution.

  • Which tools and permissions were used.

  • What actions were completed.

  • Whether another agent or external dependency was involved.

  • What business or regulatory impact occurred.

Recovery and Revalidation

Before restoring an agent, organizations should validate the root cause, correct the relevant control weaknesses, review affected data and transactions, and confirm that the agent operates within its approved boundaries.

Recovery should not simply mean restarting the agent.

It should mean restoring the system with sufficient confidence that the original failure cannot recur under the same conditions.

10. Integrating Agentic AI Into Enterprise GRC

Agentic AI governance should not create another disconnected compliance programme.

It should integrate with existing enterprise processes.

Existing GRC processAgentic AI governance integration
Enterprise AI GovernanceAgent inventory, classification, approval and oversight
IT Risk ManagementAgent-specific risk assessment and treatment
IAM GovernanceAgent identities, delegated permissions and access reviews
Third-Party Risk ManagementAgent platforms, tools, models and external dependencies
Change ManagementAgent configuration, model, tool and permission changes
Security OperationsRuntime monitoring, incident detection and response
Privacy ManagementPersonal data access, processing and retention
Business ContinuityManual fallback, agent recovery and dependency resilience
Internal AuditEvidence, control testing and independent assurance
Compliance ManagementApplicable regulatory and contractual obligations

This integration is important because agentic AI risk rarely remains confined to one function.

A single agent may simultaneously create technology risk, operational risk, privacy risk, third-party risk and financial control exposure.

The enterprise needs one coherent governance architecture rather than multiple teams independently assessing fragments of the same activity.

11. The Agentic AI Governance Framework — Six Pillars of Controlled Autonomy

Based on the governance requirements discussed above, I propose the following original framework for enterprise adoption.

The Agentic AI Governance Framework — Six Pillars of Controlled Autonomy

Pillar 1: Identity and Ownership

Every agent must have a unique identity, a named business owner and a technical custodian.

The organization must know who initiated an activity, which agent executed it and who is accountable for its outcome.

Pillar 2: Authority and Boundaries

An agent should operate only within explicitly approved objectives, permissions, tools, data access and execution limits.

Autonomy must be delegated, not assumed.

Pillar 3: Risk and Impact Management

Agents should be classified and assessed based on business impact, data sensitivity, execution capability, autonomy, reversibility and external dependencies.

Higher-impact agents require stronger controls and oversight.

Pillar 4: Human Oversight and Intervention

Human approval, monitoring, escalation and emergency intervention must be proportionate to the potential impact of agent actions.

Oversight must be meaningful, not ceremonial.

Pillar 5: Continuous Security and Assurance

Organizations must monitor agent behaviour, validate permissions, test controls, maintain evidence and reassess material changes throughout the lifecycle.

Pillar 6: Accountability and Resilience

The organization must remain accountable for agent-enabled business outcomes.

It must also be capable of containing failures, recovering operations, investigating incidents and learning from control weaknesses.

These six pillars are intended as an original enterprise governance model. They complement established AI management and cybersecurity frameworks; they are not an official ISO, NIST or regulatory standard.

12. A Practical 90-Day Agentic AI Governance Roadmap

Organizations do not need to wait for a fully mature agentic AI ecosystem before establishing governance.

A structured 90-day programme can create a practical foundation.

Days 1–30: Discover and Establish Control

  • Identify existing and planned AI agents.

  • Establish a central agent inventory.

  • Identify business and technical owners.

  • Document connected tools, applications and data sources.

  • Identify agents with privileged or high-impact capabilities.

  • Define an interim agent usage and approval policy.

  • Review existing service accounts and credentials used by agents.

Expected outcome: Visibility into the agent landscape and immediate control of unmanaged exposure.

Days 31–60: Assess and Implement Guardrails

  • Establish an agent classification methodology.

  • Conduct risk assessments for priority agents.

  • Define approved autonomy levels.

  • Implement unique agent identities.

  • Review permissions and enforce least privilege.

  • Establish human approval thresholds.

  • Introduce runtime logging and monitoring.

  • Define emergency suspension procedures.

Expected outcome: A documented governance and control baseline for priority agent deployments.

Days 61–90: Validate and Operationalize

  • Conduct agent-specific security testing.

  • Test prompt injection and unsafe tool-use scenarios.

  • Validate human approval and intervention mechanisms.

  • Test incident response and recovery procedures.

  • Establish agent governance metrics.

  • Integrate agent risks into enterprise risk registers.

  • Conduct an independent control review.

  • Report material risks and progress to executive leadership.

Expected outcome: A repeatable governance operating model supported by measurable controls and executive oversight.

The 90-day roadmap is a proposed implementation approach, not a regulatory deadline or certification requirement.

13. Ten Questions Every CISO, CIO and GRC Leader Should Ask

Before approving significant agentic AI deployments, leadership should be able to answer ten questions:

  1. Do we have a complete inventory of enterprise AI agents, including those embedded in third-party platforms?

  2. Does every production agent have a clearly identified business owner and technical custodian?

  3. Does every agent have a unique identity and permissions restricted to its approved purpose?

  4. Do we know which agents can independently modify records, initiate transactions or execute privileged operations?

  5. Are agent objectives, tools, data access and execution boundaries formally approved?

  6. Which actions require human approval, and can the human meaningfully challenge or stop them?

  7. Can we reconstruct every material agent action, including its initiating user, identity, permissions and tool calls?

  8. Do we continuously monitor agent behaviour, inter-agent communications and changes to external dependencies?

  9. Can we immediately suspend a compromised or malfunctioning agent without disrupting the wider business unnecessarily?

  10. Can we demonstrate through evidence that our agentic AI controls are operating effectively?

If these questions cannot be answered confidently, the organization may be adopting autonomy faster than it is developing the ability to govern it.

14. Standards, Frameworks and Regulatory Considerations

Agentic AI governance should build upon existing standards and emerging guidance rather than creating an entirely separate compliance universe.

Some particularly relevant references include:

ISO/IEC 42001:2023 — Artificial Intelligence Management Systems

Provides requirements for establishing, implementing, maintaining and continually improving an AI management system. Its management-system approach offers a foundation for governing AI across organizational roles, processes, risks and controls.

NIST AI Risk Management Framework (AI RMF 1.0)

The Govern, Map, Measure and Manage functions provide a useful structure for integrating agentic AI risks into enterprise AI risk management.

NIST: Identity and Authority of Software Agents

NIST's February 2026 concept paper explores how identity standards and authorization practices can be applied to software agents, including identification, authorization, auditing and non-repudiation considerations.

CISA and International Partners: Careful Adoption of Agentic Artificial Intelligence Services (May 2026)

Provides practical cybersecurity guidance on limiting agent autonomy, strengthening identity management, applying layered defences, threat modelling and continuous monitoring.

OWASP Top 10 for Agentic Applications (2026)

Provides a security-focused view of agentic application risks, including goal hijacking, tool misuse, identity and privilege abuse, supply-chain vulnerabilities, memory and context poisoning, cascading failures and rogue agents.

EU Artificial Intelligence Act

Organizations operating in or providing AI systems within the EU should assess the Act's applicability based on the system, role, intended purpose and relevant obligations. Agentic capabilities do not automatically create a separate legal classification. However, where an agent forms part of a regulated AI system or performs activities subject to other legal requirements, those obligations must be assessed accordingly.

The regulatory analysis should also consider applicable privacy, cybersecurity, financial services, employment, consumer protection and sector-specific requirements.

The important distinction is that these standards and guidance documents provide different types of support: management-system requirements, risk-management guidance, cybersecurity recommendations and regulatory obligations. They should not be treated as interchangeable or as automatic certification of an agentic AI deployment.

Final Thoughts

Agentic AI has the potential to transform enterprise operations.

It can reduce manual effort, accelerate decision-making, improve service delivery and enable organizations to execute complex workflows with greater efficiency.

But autonomy introduces a different level of organizational responsibility.

When an AI system can independently access information, invoke tools, modify records and execute business activities, governance can no longer focus exclusively on the quality of its outputs.

It must also govern the authority under which the system operates, the boundaries within which it acts, the evidence it produces and the accountability that remains with the organization.

The objective should not be to eliminate autonomy. It should be to ensure that autonomy is intentional, proportionate, controlled and demonstrably accountable.

An enterprise should never confuse the ability to automate a decision with the authority to make that decision.

The future of responsible AI will not be defined by how much autonomy organizations can deploy, but by how effectively they can govern the autonomy they delegate.

Technology may accelerate innovation. Trust determines whether that innovation endures.

Looking Ahead

In Part XI of GRC Insights | Responsible AI Governance, we will explore another critical dimension:

AI Governance in the Software Development Lifecycle — Securing AI From Design to Deployment and Beyond.

As organizations increasingly embed AI into applications, products and enterprise platforms, governance must move closer to engineering.

We will examine how AI governance can be integrated into secure SDLC, DevSecOps, model development, testing, release management, change control and continuous assurance.

The objective will be to move from governance as a periodic review to governance as an integral part of how AI-enabled products and services are built and operated.

Sources & Further Reading

  1. ISO/IEC 42001:2023 — Artificial Intelligence Management Systems

  2. NIST — AI Risk Management Framework

  3. NIST — New Concept Paper on Identity and Authority of Software Agents (February 2026)

  4. NIST — AI Agent Standards Initiative (February 2026)

  5. CISA and International Partners — Careful Adoption of Agentic Artificial Intelligence Services (May 2026)

  6. OWASP — Top 10 for Agentic Applications (2026)

  7. NIST — Back to the Future: Why Agentic AI Needs a Strong Identity Foundation (August 2026)

Editorial note: The six-pillar Agentic AI Governance Framework, four-level internal agent classification and 90-day roadmap presented in this article are original proposed governance models developed for GRC Insights. They are not official standards, regulatory classifications or certification schemes. Organizations should tailor their implementation to applicable laws, contractual obligations, risk appetite and operating context.

Wednesday, November 4, 2026

GRC Insights | Volume I – Responsible AI Governance - Part IX: AI Governance in the Boardroom — From Executive Accountability to Strategic Oversight

 



Executive Summary

Artificial Intelligence is no longer simply a technology investment.

It is becoming a business capability that influences strategic decisions, operational processes, customer experiences, workforce productivity, product development and competitive positioning.

Organizations are investing in AI to improve efficiency, accelerate innovation, enhance decision-making and create new business opportunities. At the same time, these investments introduce risks involving data privacy, cybersecurity, intellectual property, regulatory compliance, operational resilience, model reliability, human oversight and organizational reputation.

This creates an important leadership challenge.

Who ultimately ensures that AI is being adopted responsibly, that its risks remain within the organization's appetite, and that its business value is being realized?

The answer cannot be limited to the technology function.

CIOs, CISOs, Chief Risk Officers, Legal, Compliance, Data and business leaders all have important responsibilities. But the organization also needs strategic direction, executive ownership and appropriate Board-level oversight.

This is where AI governance moves from an operational control discipline to an enterprise leadership responsibility.

The Board does not need to understand the technical architecture of every AI model. It does need to understand where AI is being used, what strategic opportunities it creates, which risks could materially affect the organization, who is accountable, and whether management has appropriate controls and assurance mechanisms in place.

This article explores how organizations can establish that leadership model, including an original practical framework for Board oversight, executive accountability, AI governance committees, risk appetite, performance reporting and strategic assurance.

The central proposition:

AI governance should not merely protect the organization from AI risk. It should enable the organization to pursue AI opportunities with informed oversight, clear accountability and confidence.


1. Why AI Governance Belongs in the Boardroom

Historically, many organizations approached emerging technology risks through their IT, Information Security, Privacy or Compliance functions.

That approach remains relevant, but AI changes the scale and nature of the discussion.

Consider the following scenarios:

  • An organization deploys generative AI across multiple business functions, but has no consolidated understanding of where sensitive information is being processed.

  • An AI-driven recruitment solution influences candidate selection, creating potential discrimination and employment-related concerns.

  • An autonomous AI agent is granted access to enterprise applications and begins executing actions beyond its intended scope.

  • A third-party AI provider changes its underlying model, materially affecting the behaviour of a business-critical service.

  • An AI-enabled product generates inaccurate outputs that affect customers and create reputational exposure.

  • A business unit rapidly expands AI adoption without corresponding investment in security, governance, monitoring or human oversight.

These are not isolated technology problems.

They can become enterprise-level issues involving financial performance, legal exposure, customer trust, regulatory obligations and strategic resilience.

The Board therefore needs visibility into the organization's AI strategy and its associated risk profile.

This does not mean that every AI deployment should require Board approval.

It means that leadership must establish the governance structures, decision rights, risk boundaries and reporting mechanisms that allow AI adoption to remain aligned with organizational objectives.

The Board's role is to provide direction and oversight. Management's role is to translate that direction into operating decisions, controls and measurable outcomes.

That distinction should be the foundation of the governance model.


2. The Difference Between Board Oversight and Executive Management

One of the most important questions in enterprise AI governance is where accountability sits.

A common mistake is to assign AI governance entirely to the CIO, CISO or GRC function.

These functions may coordinate or lead important parts of the program, but they cannot independently own every business decision, AI use case or enterprise risk.

A more effective model separates strategic oversight from operational management.

The Board of Directors

The Board provides strategic oversight and challenges management on whether the organization's AI activities are aligned with business objectives, risk appetite and applicable obligations.

Its responsibilities may include:

  • Understanding the organization's AI strategy and material dependencies.

  • Reviewing significant AI-related risks and opportunities.

  • Challenging management on governance effectiveness.

  • Understanding material incidents and unresolved risk exposures.

  • Overseeing whether appropriate accountability and assurance structures exist.

  • Ensuring AI risk receives appropriate attention within enterprise risk oversight.

The exact responsibilities depend on the organization's governance structure, jurisdiction, sector and applicable legal duties.

The CEO and Executive Leadership Team

The CEO and executive leadership team translate strategic direction into organizational priorities.

They should ensure:

  • AI initiatives align with business strategy.

  • Accountable executives are identified.

  • Appropriate resources are allocated.

  • Risk ownership is established.

  • Business units follow approved governance requirements.

  • Material risks and exceptions are escalated.

  • AI investments deliver measurable business outcomes.

The CIO and CTO

Technology leadership is responsible for ensuring that the technology strategy and architecture support responsible AI adoption.

This may include:

  • AI platform strategy.

  • Enterprise architecture.

  • Model and application lifecycle management.

  • Technology integration.

  • Scalability and resilience.

  • Technical standards.

  • Infrastructure and platform dependencies.

The CISO and Information Security Leadership

Security leadership addresses the security implications of AI adoption and AI-enabled capabilities.

Key areas include:

  • AI-related threat modelling.

  • Data protection and access controls.

  • Secure AI architecture.

  • Application and API security.

  • AI-specific attack surfaces.

  • Security monitoring.

  • Incident response and resilience.

The Chief Risk Officer / GRC Leadership

Risk and GRC functions provide the governance architecture that connects AI risks to enterprise risk management.

Their responsibilities may include:

  • AI risk methodology.

  • Risk appetite alignment.

  • Control framework development.

  • Regulatory and compliance oversight.

  • Third-party AI risk governance.

  • Risk reporting.

  • Control assurance.

  • Issue and exception management.

Legal, Privacy and Compliance Leadership

These functions help establish how AI activities interact with applicable laws, regulations, contracts, privacy requirements and intellectual-property obligations.

They also help determine when specific AI use cases require additional legal or regulatory review.

Business and Functional Leaders

Business leaders own the business purpose and operational consequences of AI use within their functions.

They must ensure that:

  • AI systems are used for approved purposes.

  • Business risks are understood.

  • Human oversight is appropriate.

  • Operational controls are followed.

  • Performance and exceptions are monitored.

  • Material issues are escalated.

The important principle is that AI governance is distributed across the enterprise, but accountability must never become fragmented.


3. Establishing the AI Governance Operating Model

An organization does not necessarily need a new executive committee, a new reporting hierarchy or a completely separate governance department to manage AI.

It does, however, need an operating model that connects strategic direction, business ownership, risk oversight and technical execution.

I propose a practical structure built around four interconnected layers.

Layer 1 — Board Oversight

The Board or its designated committee receives strategic AI risk and performance reporting.

Depending on the organization's structure, oversight may sit with the Board, Risk Committee, Audit Committee, Technology Committee or another appropriately mandated committee.

Layer 2 — Executive AI Governance Council

A cross-functional executive council provides enterprise-level direction.

Potential participants include:

  • CEO or executive sponsor

  • CIO / CTO

  • CISO

  • CRO

  • Legal and Compliance

  • Privacy leadership

  • Data leadership

  • Business executives

  • Responsible AI / AI Governance leadership

Its role is to establish priorities, resolve cross-functional issues, review material risks, approve decisions within its authority and escalate matters requiring Board attention.

Layer 3 — AI Governance and GRC Function

This function coordinates the governance framework.

It may manage:

  • AI policies and standards

  • AI inventory

  • Risk assessments

  • Governance workflows

  • Control requirements

  • Regulatory mapping

  • Third-party risk coordination

  • Exceptions

  • Monitoring

  • Assurance reporting

Layer 4 — Business and Technology Execution

The teams developing, procuring, deploying and operating AI systems implement the requirements.

They remain responsible for the controls and operational outcomes within their respective areas.

The resulting structure can be represented as:

Board Oversight

↓

Executive AI Governance Council

↓

AI Governance / Enterprise GRC

↓

Business Owners + Technology + Security + Data + Compliance

↓

AI Systems, Controls, Monitoring and Outcomes

This model should connect with existing Enterprise GRC and risk-management structures wherever possible.

Creating a parallel AI governance organization without clear integration can introduce duplicate approvals, competing policies and unclear accountability.

The objective is not more committees.

It is better decisions.


4. The AI Governance Accountability Matrix

An operating model becomes meaningful only when responsibilities and decision rights are documented.

I propose the following practical accountability matrix.

Governance ActivityPrimary AccountabilitySupporting Functions
Enterprise AI strategyCEO / Executive LeadershipCIO, CTO, Business Leaders
AI risk appetiteBoard / Risk Committee, as applicableCEO, CRO, GRC
AI governance policyExecutive ManagementLegal, Compliance, GRC, Security
AI inventoryDesignated AI Governance Owner / Business OwnersIT, Procurement, Data
AI risk assessmentsBusiness / AI System OwnersGRC, Security, Privacy, Legal
Technical AI securityCISO / Security LeadershipEngineering, IT, AI Teams
AI platform and architectureCIO / CTOEngineering, Data, Security
AI regulatory oversightLegal / Compliance LeadershipGRC, Business Owners
Third-party AI riskTPRM / Vendor Risk LeadershipProcurement, Security, Legal
AI incident responseDesignated Incident LeadershipBusiness, Security, Legal, GRC
Control assuranceControl Owners and Second Line OversightInternal Audit
Independent auditInternal AuditRelevant Management Functions
Material AI risk escalationExecutive LeadershipCRO, CISO, Legal, Business Owners

This is an illustrative allocation. Organizations should adapt it to their own governance structures and formally distinguish between who is accountable, who performs the activity, who provides oversight and who must be consulted.

A particularly important point:

Internal Audit should retain its independence.

It should not become the operational owner of AI governance or assume management's responsibility for designing and operating controls that it may later need to audit.


5. Defining AI Risk Appetite at the Enterprise Level

Risk appetite is one of the most important tools available to the Board and executive leadership.

Without it, AI governance can become a collection of disconnected approvals and technical restrictions.

Organizations need to establish what level of AI-related risk they are prepared to accept in pursuit of business objectives.

For example:

An organization may be comfortable using generative AI for internal productivity while maintaining strict restrictions on uploading confidential customer data to unapproved platforms.

It may support AI-assisted decision-making but prohibit fully autonomous decisions in certain high-impact business processes.

It may permit AI agents to automate low-risk workflows while requiring additional approvals and safeguards before granting access to financial systems or privileged enterprise applications.

These are risk appetite decisions.

A practical AI risk appetite framework could address the following areas:

Risk AreaExample Risk Appetite Position
Data PrivacyNo unauthorized disclosure or processing of protected personal information
CybersecurityAI systems must meet defined security requirements before production use
Human OversightMaterial decisions affecting people must have appropriate human oversight where required by risk and applicable obligations
Model ReliabilityAI systems must meet documented performance and reliability thresholds for their intended use
Regulatory ComplianceAI deployment must be assessed against applicable legal and regulatory obligations
Third-Party AIMaterial external dependencies must undergo risk-based due diligence
Autonomous ActionsAgent permissions must be limited according to defined risk thresholds and authorization boundaries
TransparencyMaterial AI use cases must have documented ownership, intended purpose and relevant limitations

These are illustrative positions, not universal requirements.

The organization should distinguish between:

  • Risks it will not accept.

  • Risks it will accept only with defined controls.

  • Risks that require executive approval.

  • Risks that can be accepted by designated business owners.

  • Risks that must be escalated to the Board or an authorized committee.

Risk appetite should also be translated into measurable thresholds, escalation triggers and decision authorities.

A policy stating that the organization has a "low tolerance for AI risk" is not particularly useful unless management can explain what that means in operational terms.


6. The Board AI Governance Scorecard

Boards generally do not need lengthy technical reports.

They need concise, decision-oriented information that explains what is happening, why it matters and whether management is taking appropriate action.

A useful AI governance scorecard should combine strategic performance, risk exposure, control effectiveness and emerging issues.

I propose six reporting dimensions.

1. AI Adoption and Strategic Value

  • Number of material AI initiatives.

  • Business functions adopting AI.

  • AI investments and expected benefits.

  • Productivity or operational improvements.

  • Strategic dependencies.

The Board should understand whether AI investment is creating the intended business value.

2. AI Risk Exposure

  • Number of identified AI systems.

  • High-impact or high-risk use cases.

  • Material open AI risks.

  • Unapproved or restricted AI usage.

  • Significant third-party dependencies.

3. Governance and Compliance

  • Percentage of in-scope AI systems with accountable owners.

  • Risk assessment coverage.

  • Regulatory applicability reviews.

  • Policy exceptions.

  • Overdue governance approvals.

4. Security and Resilience

  • Material AI security incidents.

  • Significant vulnerabilities.

  • AI-related data exposure events.

  • Critical service dependencies.

  • Tested fallback and recovery arrangements.

5. Control Effectiveness and Assurance

  • Critical AI controls tested.

  • Control effectiveness results.

  • Unresolved assurance findings.

  • Overdue remediation.

  • Evidence completeness.

6. People and Accountability

  • AI literacy and training coverage.

  • Human oversight effectiveness.

  • Business ownership.

  • Executive escalations.

  • Significant decisions involving AI systems.

The scorecard should not become another collection of green and amber indicators.

Every material metric should have a defined owner, reporting frequency, threshold and escalation route.


7. KPIs, KRIs and the Questions Behind the Numbers

There is a difference between measuring AI adoption and measuring AI governance effectiveness.

For example:

KPI: Percentage of employees trained on responsible AI use.

This measures progress against an organizational objective.

KRI: Number of material AI systems operating without an approved risk assessment.

This indicates exposure to potential governance failure.

Similarly:

KPI — Performance IndicatorKRI — Risk Indicator
Percentage of AI use cases delivering expected business benefitsPercentage of material AI systems with overdue risk reassessments
AI training completion rateNumber of material AI policy violations
Percentage of AI systems with assigned ownersNumber of material AI systems without accountable owners
Percentage of critical controls testedNumber of critical AI controls rated ineffective
Percentage of vendors completing AI due diligenceNumber of critical AI dependencies with unresolved assurance gaps
Percentage of material incidents closed within targetNumber of unresolved high-severity AI incidents
Percentage of AI systems with documented monitoringNumber of material systems with monitoring gaps

The Board should receive both performance and risk information.

An organization could have excellent AI adoption metrics while simultaneously accumulating significant unaddressed AI risk.

That is why the two perspectives must be considered together.

The six questions behind every Board AI dashboard

  1. What is changing in our AI environment?

  2. What value are we realizing?

  3. What risks are increasing?

  4. Which controls are not operating effectively?

  5. What decisions or interventions are required?

  6. Who is accountable for the next action?

If a dashboard cannot answer these questions, it may be reporting activity rather than supporting governance.


8. AI Governance Committees: Avoiding the Committee Trap

Many organizations respond to emerging technology risks by establishing committees.

This can be useful, but committees alone do not create accountability.

An AI Governance Council should have a clearly defined mandate.

Its responsibilities might include:

  • Reviewing material AI use cases.

  • Establishing governance priorities.

  • Resolving cross-functional conflicts.

  • Reviewing significant AI risks.

  • Approving exceptions within delegated authority.

  • Evaluating emerging regulatory requirements.

  • Reviewing AI incident trends.

  • Monitoring implementation of governance controls.

  • Escalating material matters to executive leadership.

But there are several questions that should be answered before establishing the committee.

Who chairs it?

A senior executive with sufficient organizational authority should sponsor the governance agenda.

Who participates?

Membership should reflect the organization's actual AI risks and operating model.

What decisions can it make?

The committee should have documented decision rights and escalation thresholds.

How frequently does it meet?

Meeting frequency should reflect the scale, risk and pace of AI adoption.

How are decisions recorded?

Material decisions, approvals, exceptions and risk acceptances should be documented.

How does it report to the Board?

There should be a defined reporting relationship, not an informal expectation that important issues will eventually reach senior leadership.

Most importantly, the committee should not become a bottleneck for every AI experiment.

Low-risk activities can be governed through delegated processes, while material or high-impact use cases receive enhanced review.

Effective governance should enable responsible innovation, not unnecessarily delay it.


9. Strategic AI Risk: Beyond Compliance and Cybersecurity

A Board-level AI discussion should not be limited to regulatory compliance or cybersecurity.

Those are critical components, but AI introduces broader strategic considerations.

Strategic Dependency

Is the organization becoming overly dependent on a small number of AI providers or foundation models?

Intellectual Property

Could AI adoption expose proprietary information, trade secrets or confidential business knowledge?

Workforce Transformation

How will AI affect employee roles, skills, organizational structure and workforce planning?

Business Model Disruption

Could competitors use AI to change pricing, customer experience, operating models or delivery economics?

Operational Resilience

Can critical business processes continue if an AI service becomes unavailable or produces unacceptable outputs?

Reputation and Trust

How would customers, employees, regulators and investors respond to a material AI failure?

Competitive Advantage

Are governance processes enabling the organization to adopt AI responsibly and at scale, or are they creating unnecessary friction?

This last question is particularly important.

AI governance should not be viewed only as a defensive control mechanism.

It is also an enabler of sustainable AI adoption.

Organizations that understand their risks, assign ownership, establish clear decision rights and create reliable assurance mechanisms may be better positioned to scale AI with confidence.


10. AI Incidents and Executive Decision-Making

Not every AI incident requires Board involvement.

However, material incidents should have clearly defined escalation criteria.

Consider an AI system that begins generating inaccurate recommendations in a business-critical workflow.

The response may require decisions about:

  • Whether the system should continue operating.

  • Whether its use should be restricted.

  • Whether the affected process should revert to manual execution.

  • Whether customers or employees must be informed.

  • Whether regulators or other authorities must be notified.

  • Whether a third-party provider must be engaged.

  • Whether the system can safely return to production.

These are operational and executive decisions.

A mature governance framework should establish decision rights before the incident occurs.

For example:

DecisionTypical Decision Authority
Routine operational restrictionDesignated AI / Business Owner
Material security containmentIncident Commander / Security Leadership
Suspension of a critical AI serviceAuthorized Business and Executive Leadership
Material customer or regulatory communicationLegal, Compliance and Executive Leadership, as applicable
Acceptance of significant residual riskDesignated risk-acceptance authority
Strategic withdrawal of a material AI capabilityExecutive Leadership, with Board oversight where appropriate

The precise allocation depends on the organization and the nature of the incident.

The Board should not be expected to manage technical incident response.

It should, however, receive timely escalation of material issues and understand whether management is responding effectively.

The principle is straightforward:

The authority to deploy an AI system must be matched by the authority and readiness to restrict, suspend or withdraw it when necessary.


11. The AI Governance Leadership Framework

To bring these elements together, I propose an original practical framework for Board and executive-level AI governance.

I call it the AI Governance Leadership Framework — Six Pillars of Executive Oversight.

Pillar 1 — Strategic Direction

Define how AI supports business strategy, investment priorities and organizational objectives.

Pillar 2 — Accountability

Assign clear ownership across the Board, executive leadership, business functions and control functions.

Pillar 3 — Risk Appetite

Establish boundaries for acceptable AI use, material risk exposure and escalation.

Pillar 4 — Governance and Controls

Integrate AI governance into enterprise policies, risk management, procurement, security, privacy and operational processes.

Pillar 5 — Performance and Assurance

Measure AI value, monitor risk, test controls and obtain evidence of governance effectiveness.

Pillar 6 — Continuous Oversight

Review emerging risks, incidents, regulatory changes, strategic dependencies and opportunities for improvement.

These six pillars form a connected management cycle:

Strategic Direction → Accountability → Risk Appetite → Governance & Controls → Performance & Assurance → Continuous Oversight

The cycle then informs the next round of strategic decisions.

This is important because AI governance is not a one-time approval exercise.

It is an ongoing leadership responsibility that must evolve as AI capabilities, business uses and risk exposures change.


12. What Should Boards Ask Management Every Quarter?

A quarterly AI governance review can be a useful mechanism for maintaining strategic visibility, although the frequency should reflect the organization's risk profile and governance calendar.

I would recommend focusing on ten questions.

  1. AI Strategy: Where are we using AI to create measurable business value?

  2. AI Visibility: Do we have a reliable view of material AI systems and their owners?

  3. Risk Exposure: Which AI risks have increased since the previous review?

  4. Risk Appetite: Are any AI initiatives operating outside approved risk boundaries?

  5. Security and Privacy: Have we experienced material AI-related security or data incidents?

  6. Third-Party Dependencies: Are critical AI capabilities dependent on suppliers we cannot adequately monitor?

  7. People: Do employees and decision-makers have the necessary AI literacy and training?

  8. Assurance: Can management demonstrate that critical AI controls are operating effectively?

  9. Resilience: Can we safely suspend or replace AI capabilities that become unacceptable?

  10. Strategic Readiness: Are our governance capabilities keeping pace with our AI ambitions?

These questions should lead to decisions, not simply another presentation.

The value of Board oversight is not measured by the number of AI governance meetings conducted.

It is measured by whether those discussions improve organizational decisions, clarify accountability and strengthen the organization's ability to manage AI responsibly.


13. A Practical 90-Day Roadmap for Executive AI Governance

For organizations that are still establishing enterprise-level AI governance, a structured 90-day starting point can help create momentum.

Days 1–30: Establish Executive Visibility

  • Identify an executive sponsor.

  • Confirm the AI governance mandate.

  • Identify material AI systems and business use cases.

  • Map existing ownership and decision rights.

  • Review current AI policies and risk appetite.

  • Identify major gaps in Board and executive reporting.

Deliverable: An executive AI governance baseline.

Days 31–60: Establish Accountability and Oversight

  • Form or designate the appropriate executive governance forum.

  • Define responsibilities across business and control functions.

  • Establish AI risk escalation criteria.

  • Define approval and risk-acceptance authorities.

  • Agree on initial KPIs and KRIs.

  • Establish reporting expectations.

Deliverable: An AI governance operating model and accountability matrix.

Days 61–90: Introduce Measurement and Assurance

  • Implement an executive AI governance scorecard.

  • Identify priority control domains.

  • Establish evidence and assurance expectations.

  • Review material third-party dependencies.

  • Conduct a governance readiness assessment.

  • Present material gaps and improvement priorities to the Board or designated committee.

Deliverable: An executive AI governance dashboard and improvement roadmap.

The roadmap is illustrative. Organizations with mature AI programs may need to focus on integration and assurance rather than establishing foundational structures.

The key is to move from informal oversight to a repeatable, evidence-based governance process.


14. Where International Standards and Regulations Fit

Board-level AI governance should be informed by recognized standards and applicable regulatory obligations.

Several important references provide a foundation.

ISO/IEC 42001:2023 establishes requirements for an Artificial Intelligence Management System. Its leadership provisions address top-management commitment, alignment with strategic direction, integration into business processes, resources, management responsibilities and continual improvement.

This is particularly relevant because it positions AI management as an organizational management responsibility rather than a standalone technical activity. ISO/IEC 42001 — Official Standard

NIST AI Risk Management Framework provides a voluntary framework organized around Govern, Map, Measure and Manage. Its Govern function addresses organizational policies, accountability, leadership, roles and responsibilities, while supporting integration of AI risk management across the organization. NIST AI RMF

ISO/IEC 38507:2022 provides guidance for the governance implications of organizations using artificial intelligence. It is particularly relevant to understanding the role of governing bodies in overseeing AI adoption and its implications for organizational governance. ISO/IEC 38507

The EU AI Act establishes obligations for different actors involved in AI systems. For example, Article 26 specifies obligations for deployers of high-risk AI systems, including appropriate technical and organizational measures, human oversight and monitoring. These obligations should be understood in the context of the organization's actual role and the system's regulatory classification. EU AI Act — Article 26

These references do not prescribe one universal Board committee structure or executive reporting model.

Rather, they provide governance principles and requirements that organizations should translate into structures appropriate to their size, industry, AI exposure and regulatory environment.


Final Thoughts

The evolution of AI governance is bringing an important question to the forefront of enterprise leadership:

Can an organization scale AI responsibly if its leadership does not understand the risks, own the decisions or oversee the outcomes?

AI governance cannot succeed as an isolated technology initiative.

It requires alignment between business strategy, executive accountability, enterprise risk management, technology, cybersecurity, legal, compliance, privacy and operational leadership.

The Board does not need to approve every AI use case.

It does need confidence that management understands where AI is being used, that material risks are visible, that responsibilities are clear, that controls are effective and that unacceptable risks can be escalated and addressed.

Likewise, executive leadership cannot delegate all responsibility to a governance committee or GRC function.

The governance framework must be embedded in the way the organization makes decisions, allocates resources, approves investments, manages risk and measures performance.

Ultimately, the organizations that succeed with AI will not necessarily be those that deploy it fastest.

They will be those that understand how to combine innovation with accountability, strategic oversight and trust.

AI governance is not about asking the Board to understand every algorithm. It is about ensuring that the organization understands every material decision it makes with AI.

Technology may accelerate innovation. Trust determines whether that innovation endures.


Looking Ahead

Across the first nine instalments of GRC Insights | Volume I – Responsible AI Governance, we have explored the foundations of responsible AI adoption:

  • Data stewardship

  • The AI governance blind spot

  • AI risk registers

  • Governance maturity

  • Board-level metrics

  • AI incident management

  • Governance assurance

  • Third-party AI risk

  • Executive and Board accountability

The next challenge is to look beyond the traditional AI model and consider a rapidly evolving capability: Agentic AI.

AI systems are increasingly moving from generating recommendations and content to interacting with tools, accessing enterprise information, executing workflows and taking actions with varying degrees of autonomy.

That creates a new governance question:

How do you govern an AI system that does not simply answer a question, but can independently take action on behalf of your organization?

Next: Part X — Agentic AI Governance: Who Controls the Agents That Act on Our Behalf?

We will explore autonomous AI agents, identity and access management, delegated authority, human intervention, agent monitoring, accountability, security controls and the extension of Enterprise GRC into the agentic AI environment.

Because when AI begins acting on behalf of an organization, governance must extend beyond what it knows to what it is authorized to do.


Sources & Further Reading

1. ISO/IEC 42001:2023 — Artificial Intelligence Management System

The international standard for establishing, implementing, maintaining and continually improving an AI Management System. Particularly relevant to leadership commitment, policy, roles, responsibilities and integration into organizational processes.

ISO/IEC 42001 — Official ISO Page

2. NIST — Artificial Intelligence Risk Management Framework (AI RMF 1.0)

A voluntary framework for managing AI risks through Govern, Map, Measure and Manage. Its governance function provides a useful foundation for executive accountability and organizational oversight.

NIST AI Risk Management Framework

3. NIST — AI RMF Playbook

Practical implementation guidance aligned with the AI RMF functions, including governance structures, accountability, documentation, measurement and risk management.

NIST AI RMF Playbook

4. ISO/IEC 38507:2022 — Governance Implications of the Use of Artificial Intelligence by Organizations

Guidance on the governance implications of AI adoption, with relevance to the responsibilities of governing bodies and organizational leadership.

ISO/IEC 38507 — Official ISO Page

5. European Union — Artificial Intelligence Act

The official legislative text establishing obligations for different AI actors and systems, including provisions concerning high-risk AI systems and their deployers.

EU AI Act — Official Text

6. European Union — Article 26: Obligations of Deployers of High-Risk AI Systems

A useful reference for understanding specified deployer responsibilities, including human oversight, monitoring and operational controls.

EU AI Act — Article 26

7. The Institute of Internal Auditors — Global Practice Guide: Artificial Intelligence

A useful reference for Internal Audit professionals considering AI governance, risk and assurance responsibilities.

IIA — Artificial Intelligence Resources


A note on the original framework

The AI Governance Leadership Framework — Six Pillars of Executive Oversight, Board AI Governance Scorecard, accountability matrix and 90-day roadmap presented in this article are original practical models developed for the GRC Insights | Responsible AI Governance series.

They are intended to support organizational discussion and implementation. They are not official NIST, ISO/IEC, IIA or regulatory frameworks, nor should they be interpreted as legal requirements.

Regulatory applicability and governance responsibilities depend on the organization's jurisdiction, structure, industry, AI use cases and the roles it performs.


Wednesday, October 14, 2026

GRC Insights | Volume I – Responsible AI Governance Part VIII: AI Governance & Third-Party Risk — When Your AI Risk Comes From Someone Else

 



Executive Summary

Organizations have spent years developing third-party risk management (TPRM) programs to evaluate suppliers, assess cybersecurity controls, protect sensitive information, monitor compliance and manage operational dependencies.

Artificial Intelligence introduces a new dimension to that responsibility.

Organizations are procuring AI-enabled SaaS platforms, integrating foundation models through APIs, using third-party AI agents, embedding AI capabilities into business applications, and relying on external providers for model development, training data, hosting, inference and monitoring.

This creates a fundamental challenge for Enterprise GRC:

How do you govern risks that originate in technology you do not fully own, operate or understand?

A conventional vendor assessment may establish that a supplier has an acceptable security posture. It may not establish whether its AI system produces unreliable outputs, introduces discriminatory outcomes, retains sensitive prompts, changes behaviour after a model update, or depends on undocumented third-party components.

The challenge becomes even more complex when an organization uses an AI-enabled service without realizing that AI is involved at all.

The National Institute of Standards and Technology (NIST), through its AI Risk Management Framework, explicitly identifies third-party AI risks and supply-chain issues as areas requiring organizational policies, controls and contingency processes. Its guidance recognizes that externally supplied AI technologies can introduce risks that are difficult to assess because of complexity, limited transparency and potentially misaligned risk tolerances. NIST AI RMF 1.0

This makes third-party AI governance more than an extension of a traditional vendor questionnaire.

It requires organizations to connect AI governance, TPRM, cybersecurity, privacy, procurement, legal, business ownership and continuous monitoring into a coherent operating model.

In this article, we explore how to do that practically, including an original framework for assessing third-party AI risk throughout the supplier lifecycle.

The central principle is:

You may outsource the technology. You cannot automatically outsource accountability for the risks your organization accepts by using it.


1. The New Reality of Third-Party AI Risk

Consider a few scenarios.

A business team introduces a generative AI application to summarize customer interactions. The supplier updates its underlying model, and the application begins producing materially different outputs.

A software provider embeds a third-party foundation model into its platform. The organization has assessed the software vendor but has limited visibility into the model provider, data-processing arrangements or downstream dependencies.

A recruitment platform introduces an AI-assisted candidate-ranking feature. The organization's original assessment covered the platform's cybersecurity controls, but not the potential impact of automated recommendations on applicants.

An employee connects an external AI service to internal documents. The service's data-retention and training practices have not been reviewed, and the organization cannot establish whether sensitive information is being handled according to its requirements.

In each case, the supplier relationship may appear acceptable from a conventional TPRM perspective.

Yet the AI introduces additional questions:

  • What is the system intended to do?

  • Which model, data sources and external components does it depend on?

  • How does it behave under expected and unexpected conditions?

  • What information does the provider retain or process?

  • Can the provider change the system without notifying the customer?

  • What happens when the system produces harmful or materially incorrect outputs?

  • Can the organization obtain sufficient evidence to assess and manage the risk?

  • Who can suspend its use if the risk becomes unacceptable?

These are not merely technical questions. They affect operational resilience, regulatory compliance, customer trust, intellectual property, privacy, security and business accountability.

The third-party AI problem is therefore not simply whether the vendor is trustworthy. It is whether the organization understands and governs the risks of the AI capability it is consuming.


2. Why Traditional TPRM Is Necessary but Not Sufficient

Traditional third-party risk management remains essential.

Organizations should continue assessing suppliers for information security, privacy, business continuity, financial stability, regulatory compliance, subcontractor management and contractual obligations.

The issue is not that traditional TPRM is inadequate in general.

It is that AI introduces additional risk dimensions that may not be covered by an existing supplier assessment.

Consider the difference:

Traditional TPRM focusAdditional AI-specific questions
Is the supplier's security program adequate?Are the model, prompts, interfaces and AI-specific controls appropriately secured?
Does the supplier protect customer data?How are prompts, outputs, embeddings and other AI-related data processed, retained and potentially reused?
Does the supplier meet availability commitments?What happens if the model becomes unavailable, changes behaviour or produces unreliable outputs?
Does the supplier have change management?Are model, version, data and capability changes identified, assessed and communicated?
Does the supplier comply with contractual requirements?Do the contract and operating arrangements address AI-specific responsibilities, evidence and incident cooperation?
Does the supplier manage subcontractors?Can the organization identify material downstream model, hosting, data and service dependencies?
Does the service meet business requirements?Has the AI been evaluated for its intended use, limitations, foreseeable misuse and potential impact?
Does the supplier support incident response?Can AI-related failures be investigated, explained sufficiently, escalated and remediated?

The distinction is important.

A supplier can have a mature cybersecurity program and still provide an AI capability that is unsuitable for a particular business purpose.

Likewise, a capable AI model does not compensate for inadequate access controls, poor data handling or unclear contractual responsibilities.

AI risk assessment must complement—not replace—traditional third-party risk assessment.


3. The AI Supply Chain Is More Than One Vendor

One of the most significant blind spots in third-party AI governance is the assumption that the contracted supplier represents the entire risk boundary.

In reality, an AI-enabled service may depend on multiple organizations and technical components.

Consider a simplified AI supply chain:

Your organization

↓

AI-enabled business application

↓

Third-party model provider

↓

Cloud infrastructure and inference service

↓

External data, software and supporting service providers

The actual architecture may be more complicated. Some components may be operated by the primary supplier, while others are provided through subcontractors, APIs or embedded services.

Each dependency can introduce different risks.

For example:

  • A model provider may change the model or its operating characteristics.

  • A cloud provider may experience a regional outage.

  • A data provider may introduce inaccurate or improperly licensed information.

  • An embedded AI component may process data differently from what the organization expects.

  • A downstream service may introduce additional retention, access or security concerns.

  • A supplier may discontinue a model version on which a critical business process depends.

This is where fourth-party risk becomes particularly relevant.

Fourth-party risk refers to risk arising from a supplier's own suppliers and dependencies. In an AI context, this can include upstream model providers, cloud infrastructure, external datasets, evaluation services and other components that materially influence the capability being consumed.

However, organizations do not need complete visibility into every technical dependency for every use case.

They need risk-proportionate visibility into dependencies that could materially affect their business, their data, their obligations or the people affected by their AI systems.

NIST's AI RMF supports this approach. Its Govern function addresses third-party policies and supply-chain risks, while Map includes identifying risks associated with third-party AI technologies, software and data. NIST AI RMF Core

The practical question is not simply, "Who is our vendor?"

It is:

"Which external components materially influence the AI capability we depend on, and how would a failure or change in those components affect us?"


4. The AI Vendor Risk Classification Framework

Not every supplier using AI requires the same level of scrutiny.

A vendor using AI internally to improve its own administrative processes presents a different risk profile from a vendor supplying an AI system that evaluates employees, processes confidential information or supports safety-critical decisions.

Similarly, a general-purpose AI assistant used for low-risk brainstorming should not automatically receive the same assessment burden as an AI agent authorized to access sensitive systems and execute business transactions.

A practical AI vendor risk classification should consider at least six dimensions.

1. Business criticality

How dependent is the organization on the AI capability?

Could an outage or withdrawal materially disrupt business operations?

2. Data sensitivity

Will the supplier process confidential business information, personal data, regulated information, source code, intellectual property or customer records?

3. Decision impact

Could the AI influence decisions affecting employees, customers, financial outcomes, safety, access to services or other significant interests?

4. Technical autonomy

Does the AI merely provide suggestions, or can it initiate actions, call tools, access systems and execute workflows?

5. Transparency and control

Can the organization understand the intended use, limitations, material changes and operating characteristics of the system sufficiently to manage the risk?

6. Dependency and substitutability

Can the organization replace the provider or revert to a safe alternative if the service becomes unavailable or unacceptable?

These dimensions should be considered alongside traditional supplier risk factors, contractual requirements and applicable regulations.

A resulting classification could look like this:

Risk tierIllustrative scenarioGovernance approach
LowAI feature used for non-sensitive, low-impact productivity tasksStandard supplier controls with proportionate AI-use restrictions
ModerateAI service processing internal business informationAI-specific due diligence, data-handling review and defined monitoring
HighAI supporting material customer, employee or business decisionsEnhanced assessment, documented validation, human oversight where appropriate, contractual safeguards and ongoing assurance
CriticalAI agent with privileged access or authority to execute high-impact actionsExecutive risk review, strong technical restrictions, tested fallback arrangements, explicit decision rights and continuous risk monitoring

These tiers are illustrative, not universal regulatory categories.

Organizations should define their own thresholds and escalation criteria based on risk appetite, use cases, business impact and applicable obligations.

The governing principle is proportionality: the higher the potential impact, the stronger the evidence and oversight should be.


5. The Third-Party AI Due Diligence Framework

Traditional vendor questionnaires often concentrate on whether controls exist.

AI due diligence needs to go further by evaluating the capability being acquired, how it will be used, and whether the organization can govern it throughout its lifecycle.

I propose a practical Third-Party AI Due Diligence Framework built around eight assessment domains.

Domain 1 — AI capability and intended use

Establish what the supplier is actually providing.

Questions include:

  • Is AI embedded in the service, or is it an optional feature?

  • Which business functions will use it?

  • Is the system generative, predictive, classificatory or agentic?

  • What uses does the provider support or prohibit?

  • What are the documented limitations?

  • Is the proposed use consistent with the supplier's intended-use guidance?

A vendor's general claim that its product uses "responsible AI" is not sufficient evidence of suitability for a particular deployment.

Domain 2 — Data governance and privacy

Understand the full data-processing lifecycle.

Assess:

  • What information is sent to the AI service?

  • Are prompts and outputs retained?

  • Can customer information be used to train or improve models?

  • Where is data processed and stored?

  • Are retention and deletion commitments documented?

  • How are personal data and confidential information protected?

  • Are cross-border transfers or additional subprocessors involved?

  • Can the organization obtain evidence of relevant data-handling commitments?

Contractual promises should be validated against the technical and operational arrangements wherever feasible.

Domain 3 — Model and output reliability

Evaluate the system against its intended use.

Questions may include:

  • Has the supplier documented relevant performance limitations?

  • Are evaluations available for the proposed use case?

  • How are accuracy, reliability and harmful outputs assessed?

  • What testing is performed for bias or inappropriate outcomes where relevant?

  • Are known failure modes documented?

  • How are significant performance changes communicated?

  • Can the organization conduct its own testing?

A model's published benchmark performance does not automatically demonstrate suitability for a specific enterprise workflow.

Domain 4 — Cybersecurity and access controls

Assess security across the complete AI integration.

This may include:

  • Authentication and authorization

  • Least-privilege access

  • API key management

  • Encryption

  • Network restrictions

  • Logging and monitoring

  • Vulnerability management

  • Secure development

  • Prompt-injection and tool-abuse risks

  • Data-exfiltration pathways

  • Segregation of environments

  • Controls over connected systems and tools

For AI agents, the assessment should examine not only what the model can generate, but what the surrounding application permits it to do.

Domain 5 — Transparency and change management

Determine how much operational visibility the provider offers.

Assess whether the supplier can communicate material changes to:

  • Model versions

  • Underlying providers

  • Data-processing arrangements

  • Supported capabilities

  • Safety or security controls

  • System limitations

  • Service availability

  • Terms of use

Not every model update requires the same governance response. Organizations should establish change thresholds based on potential impact.

A change to a low-risk summarization feature may require routine review. A change to an AI system supporting consequential decisions may require renewed validation and approval.

Domain 6 — Regulatory, contractual and intellectual-property considerations

Determine which obligations apply to the organization, the provider and the intended use.

Review:

  • Applicable privacy and AI regulations

  • Intellectual-property and licensing conditions

  • Ownership and permitted use of inputs and outputs

  • Audit and evidence rights

  • Data-processing terms

  • Incident notification

  • Cooperation with investigations

  • Restrictions on subcontracting

  • Records and documentation

  • Customer and regulatory support

Regulatory responsibility depends on the specific law, the parties' roles and the system's intended purpose. A contract cannot simply transfer away obligations that the law places on an organization.

Domain 7 — Incident management and resilience

Understand how the supplier handles failure.

Questions include:

  • How are AI-specific incidents defined and reported?

  • Will the supplier notify the organization of material incidents and relevant changes?

  • Can the supplier provide logs and other evidence needed for investigation?

  • Are incident responsibilities and escalation paths documented?

  • Can the AI capability be disabled independently?

  • Is there a fallback process?

  • What happens if the model or provider is withdrawn?

  • Can the business continue operating safely without the AI capability?

For material AI dependencies, resilience planning should address both service availability and the possibility that the system remains available but becomes unsafe or unsuitable.

Domain 8 — Ongoing assurance

Finally, establish how the supplier's risk profile will be monitored.

Possible mechanisms include:

  • Periodic reassessment

  • Material-change notifications

  • AI control attestations

  • Targeted evidence reviews

  • Independent assessment reports

  • Performance and incident reporting

  • Subprocessor change notifications

  • Contractual reviews

  • Risk-based testing

A completed onboarding assessment is a starting point, not a permanent guarantee.


6. The Contractual Challenge: What Happens When the Model Changes?

AI services evolve faster than many traditional procurement and vendor-management processes.

Providers may update models, introduce new capabilities, modify retention practices, change subprocessors or retire previously supported versions.

An organization that assessed a service six months ago may be relying on a materially different capability today.

This creates a governance challenge that contracts and operating procedures should address.

For material AI services, organizations should consider negotiating terms covering:

Notification of material changes. Define which changes must be communicated, within what timeframe, and through which channel.

Data usage and retention. Specify permitted processing, retention, deletion, training use and relevant restrictions.

Evidence and assurance. Establish appropriate access to documentation, control evidence, assessment reports and other assurance materials.

Incident cooperation. Define notification, investigation, evidence preservation, remediation and escalation responsibilities.

Subcontractor transparency. Establish expectations for notifying the organization of material changes to relevant downstream dependencies.

Performance and service expectations. Include measurable requirements where appropriate, while recognizing that conventional availability commitments do not fully capture AI reliability.

Suspension and termination rights. Define circumstances in which the organization may restrict use, suspend the service or terminate the relationship.

Exit and portability. Address data retrieval, deletion, migration, alternative providers and continuity arrangements.

Not every supplier will agree to every requested clause. Some AI services, particularly standardized APIs, may offer limited negotiation flexibility.

In those situations, the organization should assess whether alternative controls, restricted use, architectural safeguards or a different supplier are necessary.

The objective is not to secure an ideal contract at any cost.

It is to understand which risks remain outside the organization's control, what evidence is available, and whether the residual risk is acceptable.


7. The Shared Responsibility Model for Third-Party AI

One of the most persistent mistakes in AI governance is assuming that the provider is responsible for everything related to the AI system.

Responsibility is usually distributed.

The provider may control model development, training methods, infrastructure and certain technical safeguards.

The customer may control the business purpose, input data, user permissions, deployment context, human oversight and decisions made using the outputs.

The exact division depends on the service architecture, contractual arrangements and applicable law.

A practical responsibility model might look like this:

ActivityProvider's typical roleCustomer organization's typical role
Model developmentDevelop and evaluate the supplied model or systemAssess suitability for the intended use
Data processingImplement agreed processing and security arrangementsDetermine permitted inputs and assess applicable obligations
Technical securitySecure provider-controlled componentsSecure integrations, identities, access and customer-controlled systems
AI validationSupply relevant documentation and test informationConduct use-case-specific evaluation where necessary
Human oversightProvide instructions and appropriate capabilities where applicableDefine operational oversight and decision authority
MonitoringMonitor provider-controlled components and communicate material issuesMonitor the deployed use, outcomes and business risks
Incident responseInvestigate provider-side issues and cooperate as agreed or requiredManage business impact, escalation and internal response
Regulatory complianceMeet obligations applicable to the providerMeet obligations applicable to the organization in its role
ExitSupport agreed transition and data-handling arrangementsPlan replacement, continuity and safe decommissioning

This is an illustrative allocation, not a universal legal responsibility matrix.

The important distinction is between responsibility for performing an activity and accountability for the organization's decision to use the AI capability.

A supplier can be accountable for its contractual commitments while the customer remains responsible for deciding whether and how the capability should be used in its own business context.


8. Regulatory Perspective: The EU AI Act and the AI Value Chain

The EU AI Act illustrates why roles and responsibilities across the AI value chain matter.

The Act distinguishes between different actors, including providers and deployers, and establishes obligations based on the system, its intended use and the relevant role.

Article 25 addresses responsibilities along the AI value chain. Under specified circumstances, an organization that rebrands a high-risk AI system, substantially modifies it, or changes its intended purpose in a way that makes it high-risk may assume provider responsibilities. The exact conditions and exceptions matter. EU AI Act — Article 25

Article 26 establishes obligations for deployers of high-risk AI systems, including relevant requirements concerning use according to instructions, human oversight, monitoring, input data and incident escalation. EU AI Act — Article 26

These provisions demonstrate an important principle:

The party supplying the technology and the party deploying it may have different, complementary obligations.

Organizations should therefore avoid assuming that a supplier's compliance statement resolves their own regulatory responsibilities.

A practical assessment should establish:

  • What role does the organization occupy?

  • What role does the supplier occupy?

  • What is the AI system's intended purpose?

  • Is the system within the scope of the relevant legislation?

  • Which obligations apply to each party?

  • What evidence is required to demonstrate compliance?

  • How will responsibilities be coordinated in operation?

The EU AI Act is not applicable to every AI deployment in the same way, and not every AI-enabled supplier relationship creates a high-risk AI system. Applicability must be assessed against the relevant legal provisions and facts.

For organizations operating across jurisdictions, AI-related obligations should be mapped into the existing regulatory and third-party risk-management processes rather than managed as an isolated legal exercise.


9. Continuous Monitoring: From Vendor Reviews to AI Risk Signals

Traditional TPRM programs often rely on periodic reassessment.

That remains useful, but it may not be enough for a critical AI dependency whose behaviour, model version or upstream architecture can change between reviews.

A more mature approach combines periodic reviews with event-driven reassessment.

Examples of potential triggers include:

  • A material model or service change

  • A new AI capability being enabled

  • A change in data-retention or training practices

  • A new subprocessor or upstream model provider

  • A significant AI incident

  • A sustained deterioration in output quality

  • A security vulnerability affecting the integration

  • A change in regulatory applicability

  • A contract renewal or service expansion

  • A change in the business purpose or impact of the AI use case

Not every trigger should automatically suspend the service. It should initiate the appropriate review based on severity, impact and established escalation criteria.

Organizations can integrate these signals into their existing GRC platforms and TPRM workflows.

For example, a material provider change could trigger a reassessment task, route the issue to the business owner and relevant control functions, update the risk register, and require documented approval before the expanded capability is used.

This makes third-party AI risk management more responsive to the actual operating environment.

The goal is not to monitor every supplier continuously in the same way. It is to detect material changes before they become unmanaged business risks.


10. The Third-Party AI Governance Lifecycle

To translate these principles into practice, I propose an original framework for managing AI-related supplier risk across the relationship lifecycle.

Identify → Classify → Assess → Contract → Approve → Monitor → Reassess → Exit

1. Identify

Discover suppliers and services that provide or materially depend on AI capabilities.

Include embedded AI, external APIs, AI-enabled SaaS, foundation models and AI agents.

2. Classify

Determine the potential business impact, data sensitivity, decision significance, autonomy and dependency risk.

3. Assess

Conduct proportionate AI-specific due diligence alongside traditional cybersecurity, privacy, operational and compliance assessments.

4. Contract

Establish appropriate responsibilities, data-handling commitments, change notifications, evidence rights, incident cooperation and exit arrangements.

5. Approve

Obtain documented approval from the appropriate business and risk owners before the AI capability is deployed or materially expanded.

6. Monitor

Track relevant provider changes, incidents, performance signals, exceptions and contractual obligations.

7. Reassess

Revisit the risk when the system, supplier, use case, regulatory context or risk profile changes.

8. Exit

Ensure the organization can safely withdraw the capability, manage dependencies, retrieve or delete data as required, and maintain business continuity.

This lifecycle should connect directly to the AI inventory, enterprise risk register, third-party register, control framework, incident-management process and change-management workflow.

The framework is designed to complement existing TPRM practices—not create a parallel process for every AI-enabled supplier.


11. Integrating Third-Party AI Risk Into Enterprise GRC

The most effective approach is to integrate AI supplier risk into the organization's existing governance architecture.

A mature operating model should connect:

AI Inventory

Which AI capabilities are being used, including those provided by third parties?

Third-Party Register

Which suppliers provide, host, maintain or materially influence those capabilities?

AI Risk Register

What risks arise from the use case, the technology and its external dependencies?

Control Framework

Which controls are required, and who owns them?

Contract Repository

What commitments, restrictions, rights and obligations govern the relationship?

Monitoring and Incident Management

What signals or incidents could trigger reassessment or escalation?

Issue and Remediation Management

How are identified weaknesses assigned, tracked and validated?

Executive Reporting

Which material dependencies, unresolved risks and exceptions require management attention?

This integration creates a more complete view of risk.

For example, a critical AI service could be linked to its business owner, supplier, underlying model provider where known, data classification, risk rating, contractual commitments, monitoring requirements, open issues and exit strategy.

Leadership would then be able to understand not only whether the vendor has passed an assessment, but also which business capabilities depend on that supplier, what risks remain, and what happens if the relationship fails.

This is where AI governance becomes a practical extension of Enterprise GRC.


12. What Should the Board and Executive Leadership Ask?

Boards do not need a technical inventory of every foundation model.

They do need a credible view of material AI dependencies and the risks they introduce.

A focused executive discussion could include the following questions.

Visibility: Do we know which material AI capabilities are supplied by external providers?

Concentration: Are critical business processes dependent on a small number of AI or cloud providers?

Data: Do we understand how suppliers process, retain and potentially reuse our information?

Assurance: What evidence do we have that material third-party AI controls are operating effectively?

Change: How would we learn that an important model, capability or underlying provider had changed?

Accountability: Who owns the business risk when a third-party AI system produces an unacceptable outcome?

Resilience: Can we continue operating safely if a critical AI provider becomes unavailable or must be suspended?

Exit: Can we replace or withdraw a critical AI capability without unacceptable disruption?

Regulatory exposure: Have we identified the obligations that apply to our use of externally supplied AI?

Residual risk: Which material risks remain because the supplier cannot provide sufficient transparency, evidence or contractual assurance?

These questions move the discussion beyond vendor onboarding statistics.

They help leadership understand the organization's dependency, exposure, resilience and ability to exercise control.


13. A Practical Starting Point for GRC and TPRM Leaders

Organizations do not need to redesign their entire supplier-risk program to begin addressing third-party AI risk.

A pragmatic starting sequence is:

Step 1 — Establish visibility. Identify known AI-enabled suppliers, external AI APIs, embedded AI features and material model dependencies.

Step 2 — Prioritize by risk. Start with AI capabilities that process sensitive information, influence consequential decisions, support critical operations or exercise meaningful autonomy.

Step 3 — Extend existing assessments. Add targeted AI questions to the current TPRM process instead of creating a disconnected questionnaire.

Step 4 — Define minimum evidence. Determine what documentation, test results, data-handling commitments and monitoring information are required for each risk tier.

Step 5 — Clarify responsibilities. Document which activities belong to the supplier, which belong to the organization, and who owns the residual risk.

Step 6 — Strengthen contracts and approvals. Address material change, incident cooperation, evidence access, data usage, termination and exit where appropriate.

Step 7 — Introduce event-driven reassessment. Establish triggers for material provider, model, data, use-case and regulatory changes.

Step 8 — Integrate reporting. Connect third-party AI risk to the AI inventory, risk register, issues, incidents and executive dashboards.

Step 9 — Test the exit plan. For critical dependencies, validate that the organization can restrict or withdraw the AI capability and continue operating safely.

The objective is not to eliminate every uncertainty associated with third-party AI.

It is to ensure that uncertainty is understood, managed, monitored and accepted by the appropriate authority.


Final Thoughts

Third-party risk management has always been about understanding the risks an organization inherits through its business relationships.

AI makes that responsibility more complex because the supplier relationship may include models, data, infrastructure, APIs, autonomous capabilities and dependencies that change over time.

A conventional supplier assessment remains necessary, but it cannot answer every question about an AI capability.

Organizations need to understand what they are consuming, how it affects their business, what information it processes, which external dependencies matter, what evidence is available, and how the organization will respond when something changes.

Most importantly, they need to distinguish between the supplier's responsibility for delivering a service and their own responsibility for deciding how that service is used.

The strongest AI governance programs will not treat third-party AI as an isolated procurement concern. They will connect it to Enterprise GRC, security, privacy, operational resilience, legal oversight and business accountability.

Because the ultimate question is not whether the supplier has a reassuring questionnaire response.

It is whether the organization has sufficient visibility, evidence and control to manage the risks of the AI capability it depends on.

You may not own the model. You may not control every dependency. But you must understand the risks you are accepting—and know what you will do when those risks change.

Technology may accelerate innovation. Trust determines whether that innovation endures.


Looking Ahead

In the next instalment of GRC Insights | Volume I – Responsible AI Governance, we will bring these governance principles closer to the executive decision-making table.

We have explored AI data stewardship, risk identification, maturity, measurement, incident response, assurance and third-party dependencies.

The next question is how these elements come together at the highest level of the organization.

Who owns AI risk at the enterprise level, what should the Board oversee, and how can executives distinguish responsible AI adoption from uncontrolled experimentation?

Next: AI Governance in the Boardroom — From Executive Accountability to Strategic Oversight

Because responsible AI governance cannot succeed as a technology initiative alone. It needs clear accountability, informed oversight and decisions aligned with the organization's risk appetite and business objectives.


Sources & Further Reading

1. NIST — Artificial Intelligence Risk Management Framework (AI RMF 1.0)

A foundational reference for managing AI risks, including third-party entities, supply-chain risks and external AI components.

Read the NIST AI RMF 1.0

2. NIST — AI RMF Core

Describes the Govern, Map, Measure and Manage functions. The Core includes specific outcomes addressing third-party AI technologies, software, data and supply-chain risks.

Read the NIST AI RMF Core

3. NIST — AI RMF Playbook

Practical guidance for organizations implementing the AI RMF, including suggested actions related to governance, risk mapping, measurement and management.

Read the NIST AI RMF Playbook

4. ISO/IEC 42001:2023 — Artificial Intelligence Management Systems

An international standard specifying requirements for establishing, implementing, maintaining and continually improving an Artificial Intelligence Management System.

Read about ISO/IEC 42001

5. European Union — Artificial Intelligence Act, Article 25: Responsibilities Along the AI Value Chain

Relevant to understanding how provider responsibilities can arise or change under specified circumstances involving high-risk AI systems.

Read Article 25

6. European Union — Artificial Intelligence Act, Article 26: Obligations of Deployers of High-Risk AI Systems

Addresses specified obligations of deployers, including operational use, human oversight, monitoring and relevant incident escalation.

Read Article 26

Important note

The Third-Party AI Due Diligence Framework, AI Vendor Risk Classification Framework and Third-Party AI Governance Lifecycle presented in this article are original practical models developed for the GRC Insights | Responsible AI Governance series. They are not official NIST, ISO/IEC or regulatory frameworks.

This article is intended for general governance and risk-management education, not legal advice. Regulatory applicability depends on the relevant jurisdiction, AI system, intended use and roles of the parties involved.


GRC Insights | Volume I – Responsible AI Governance Part X: Agentic AI Governance — Governing Autonomous AI Agents, Delegated Decisions and Enterprise Accountability

From AI that recommends to AI that acts: building the governance architecture for the autonomous enterprise. Introduction: When AI Stops Rec...