Guide

AI Agents for Customer Analytics: From Evidence to Controlled Customer Action

An AI agent can gather customer evidence, choose among permitted tools and coordinate an approved action. It should be used only when the customer task requires adaptive investigation or multi-system follow-through that a simpler workflow cannot handle reliably. The organisation remains responsible for the evidence, decision policy, tool authority and customer outcome.

Start with the customer task

The use case should describe what the organisation must complete for the customer. Examples include resolving a service failure, preparing a renewal review, investigating a disputed charge or coordinating an onboarding exception. The task needs a defined starting event, owner and completion condition.

Broad goals such as improve customer value or reduce churn do not provide a safe operating boundary. They allow the agent to reinterpret success and search for actions that management never approved. A bounded task tells the organisation which evidence, tools and authority the design requires.

Decide whether the task requires an agent

A dashboard is suitable when a manager needs evidence. A chatbot is suitable when the customer needs information. A deterministic workflow is suitable when the organisation can define the route and exceptions in advance.

An agent becomes useful when the next step depends on changing evidence that the designer cannot enumerate economically and the system must coordinate several tools. Even then, only the uncertain part of the route needs agentic reasoning. Identity checks, calculations, eligibility rules and high-consequence approvals should remain deterministic where possible.

Assemble customer state for a defined purpose

The agent may need account, transaction, journey, contact and model evidence. Before retrieval, the workflow must verify the customer, case and employee or customer purpose. A technical connection to a customer system does not justify access to every available record.

The assembled state should preserve source, time and uncertainty. A churn score, sentiment label or predicted value is an analytical claim, not a customer fact or instruction. The agent should know what each item means, when it was produced and which decisions may use it.

Separate analytical evidence from the decision policy

Analytics can estimate risk, value, likely cause or response to an intervention. Management still needs a policy that says which action is permitted under which conditions. The policy must include consent, eligibility, capacity, cost, fairness and authority.

The agent may apply the approved policy to current evidence. It should not turn a high risk score into permission to contact a customer or turn a sentiment label into compensation. Keeping the claim and policy separate allows management to change one without concealing changes in the other.

Divide tools by consequence

The design should separate read, calculate, propose and act tools. Retrieving an order, calculating an approved amount, drafting a response and issuing a refund have different consequences. Each tool needs input validation, customer and case scope, permission and a recorded result.

The agent should receive the minimum tool authority required for the task. Material financial, contractual, access or eligibility changes should require a deterministic rule or authorised employee. If the preferred action is unavailable, the agent should choose only among approved alternatives or refer the case.

Preserve state through external action

Customer tasks often continue after a tool call. A refund can fail, a delivery partner can reject a request and another team can miss a deadline. Treating submission as completion creates a polished interaction followed by an unresolved customer problem.

The case should retain evidence, selected policy, proposed action, approval, submitted action, external result, owner and deadline. The agent may monitor those states and reopen the case when the result differs from the promise. Persistent state makes follow-through part of the use case rather than an administrative afterthought.

Design a useful human handoff

Escalation should transfer the complete case, not merely tell the customer that a person will respond. The employee needs the verified identity, request, chronology, sources, attempted actions, uncertainty and reason for referral.

The workflow should also state what the agent may do while the case waits. It may acknowledge receipt or preserve a deadline, but it should not make a material promise that the employee cannot fulfil. A clear handoff protects both service continuity and professional authority.

Evaluate the complete trajectory

Evaluation should begin with representative customer tasks and failure modes. Tests should cover identity, evidence selection, analytical interpretation, policy use, tool parameters, permissions, escalation, persistent state and confirmation of the customer outcome. Ambiguous, adversarial and missing-data cases matter because they reveal whether the agent stops safely.

Management should measure task resolution, repeated contact, complaint, correction, cost, time and differences across relevant customer groups. It should also inspect failures even when the final message appears courteous. The agent succeeds only when the organisation completes the task correctly.

Monitor change and retain a safe stop

Products, policies, customers, models and source systems change after deployment. The organisation should version prompts, policies, tools and evaluation sets, monitor failures and define when to restrict or stop the agent.

A missing source, expired permission or changed tool response should not trigger improvisation. The agent should preserve the case, explain the limitation to the responsible employee and follow a tested fallback. Rollback is an operating capability, not an admission that the project failed.

Apply the design to a disputed utility bill

Consider a customer who disputes a high bill after a meter replacement. The account contains prior usage, the replacement event, an estimated reading, a later actual reading and two service contacts. The customer asks for an immediate correction.

The agent can verify the account, assemble the chronology and call a deterministic calculation tool. It may retrieve the approved billing policy and prepare the correction route. It cannot decide that the meter was faulty, waive a material charge or alter the account outside the policy.

If an authorised employee approves a correction, the agent may submit the permitted change and monitor the billing system. The case closes only when the updated balance appears and the organisation communicates the result. The example demonstrates why evidence, calculation, policy, authority and external completion belong to one controlled route.

Build the operating system around the agent

Marketways defines the customer task, evidence, analytical claims, policy, tools, permissions, approval points and completion state. We decide which parts require adaptive reasoning and which should remain deterministic.

We then develop representative scenarios, evaluate complete trajectories and connect production actions with customer and business outcomes. The resulting agent has a named owner, bounded authority, a tested handoff and a safe way to stop when the organisation can no longer support the action.

Related guides

References

  1. NIST AI Risk Management Framework
  2. NIST Generative AI Profile
  3. Turning conversations into workflows for service AI agents
  4. Lessons from contextual bandit learning in a customer support bot