Building agents to accelerate business workflows

Building agents to accelerate business workflows

Initial feedback on agentic AI confirms a decisive shift: to move beyond isolated prototypes, organizations must now think in terms of "agent systems" capable of planning, acting, and collaborating. Where traditional generative AI remained confined to dialogue or document enrichment, agentic AI introduces an operational dimension: direct access to APIs, decision-making capabilities, self-verification loops, memory management, and graduated human involvement. In data centers, on finance desks, or within support teams, these agents are already freeing up valuable brainpower: less manual data entry, more analysis, and more quality control. This evolution, however, remains demanding: the models are expensive, latency must be maintained, cybersecurity tolerates no breaches, and permission governance becomes strategic.

The architecture relies on a progressive spectrum of patterns: reflection, planning, routing, aggregation, ReAct, and specialized multi-agents. Each addresses specific needs—choosing the most relevant API, breaking down a complex task, combining multiple perspectives, or enabling virtual specialists to work in parallel. This granularity avoids the pitfall of a "monolithic prompt" and reduces cognitive strain: rather than piling up endless instructions, reusable, testable, and documented building blocks are created. In practice, a simple "planner" agent can generate a sequential flow (collection, processing, verification), while an intelligent router directs the request to the appropriate microservice. These structures, inspired by graph theory and software design, reconcile two long-standing conflicting imperatives: the creativity of LLMs and the predictability expected by IT.

To scale, three protocols standardize information flow: MCP standardizes access to data and tools; A2A formalizes delegation between agents; and AG-UI continuously exposes the reasoning to the user. In practical terms, MCP acts as a "universal socket": an agent automatically finds the correct connector, negotiates authentication, and returns a structured response, without requiring the user to recode thirty custom adapters. A2A establishes an internal marketplace: each agent publishes its skills, SLAs, and cost, then accepts or rejects a task based on its constraints. Finally, AG-UI restores trust: the user sees the thought process, actions, and observations unfold, can pause execution, add sensitive context, or validate the final decision. Together, these layers mitigate the risks of deviation while reducing the technical debt of integration.

On the implementation side, the ecosystem is currently split between "pro dev" frameworks and Low/No Code platforms. For developers, LangGraph offers granular control over loops and branching; CrewAI simulates a team with explicit roles; Microsoft's Unified Agent Framework combines the enterprise robustness of Semantic Kernel with the multi-agent flexibility of AutoGen; and LlamaIndex blends retrieval, persistent memory, and event-driven orchestration. These tools provide the telemetry, state management, guardrails, and persistence expected in production. Meanwhile, Copilot Studio, AgentKit, and Gemini Enterprise are democratizing the discipline for business users: a visual designer, a few natural language descriptions, ready-to-use connectors, and a governance component. This dual trajectory is reminiscent of the history of RPA: automation begins in expert hands, then spreads via graphical workspaces once the safeguards are in place.

Evaluating an agent-based system requires looking far beyond the text output. An initial automated pass verifies syntactic conformity: callback, precision, sandbox execution for SQL queries, and validation of JSON formats or HTTP statuses. A second pass entrusts the "LLM-judge" with examining semantic consistency and style, comparing several response hypotheses. But only human judgment, focused on critical cases, determines the business value: regulatory relevance, alignment with brand tone, and adherence to a CSR policy. The challenge then becomes distributing the effort: automating everything possible, reserving sensitive cases for experts, and documenting each criterion to limit subjectivity. Some teams even combine evaluation with reinforcement fine-tuning: human feedback retrains the agent's policy to reduce recurring errors.

Memory finally becomes the cornerstone of value. Without it, the agent remains amnesic: each interaction starts from scratch, contexts repeat themselves, and personalization stagnates. With structured memory—episodic for short-term conversations, vector-based for knowledge, and relational for enduring facts—the agent evolves into a persistent partner. It can recall a user preference six months later, avoid suggesting an offer that has already been declined, or connect scattered weak signals. Experiments show that a three-tiered architecture (conversation cache, vector database, transactional database) maximizes relevance while controlling query costs. From this emerges a novel KPI: memory reuse rate, a direct proxy for return on investment.

Beyond the technology, agentic AI is redefining the trajectory of digital transformation. Financial returns are no longer measured solely in hours saved, but in learning cycles accelerated: KYC onboarding compressed from days to minutes, accounting reconciliation that detects discrepancies at every iteration, and a monitoring unit that scrutinizes macroeconomic news 24/24. Successful organizations share seven practices: aligning use cases with a tangible business pain point; prototyping quickly with a simple pattern; securing access to resources via MCP from the Proof of Concept stage; instrumenting evaluation within the CI/CD pipeline; tracking every decision for auditing; orchestrating hardware scaling; and training teams to think "agent first." Under these conditions, the IT system ceases to be a collection of microservices: it becomes a pool of virtual employees that can be hired, fired, promoted, or redeployed as needed, as a well-known GPU designer recently announced.

The path remains fraught with challenges: token costs and network latency, side effects on CPU load, identity propagation in an authorization graph, governance of still-nascent MCP servers, and semantic standardization between vendors. Yet, the ecosystem is converging: the protocol layer is stabilizing, SLM is reducing energy consumption, and frameworks are adding persistence, telemetry, and disaster recovery. In this context, organizations that embrace agentic automation now will gain a dual advantage: a foundation of sustainable workflows and a memory base that can be leveraged by future models. Others risk rebuilding tomorrow what they are automating today.

For further : the new era of the customer journey with agents, the passage from individual productivity to the orchestration of agents and how The rise of AI agents is revolutionizing business.

Back to top
The entire NextStart.AI libraryEight consulting missions, seven pillars, around twenty formats, fifteen professions, five tools
Nine detailed customer case studiesLarge groups, public agencies and networks: from acculturation to production

Insurance and social protection

Health and life sciences

Public sector and research

The NextStart.AI collectiveConsultants, trainers and industry experts: more than 4,850 professionals trained since 2023
All free resourcesDiagnostics, comparison tool, Finders, charter template, Word templates and industry-specific kits
The NextStart.AI blogComparisons of tools, practices, agents, governance: analyses and feedback from the field
Let's talk about your AI projectResponse within 24 business hours, written quote after initial discussion
AI agents in businessUnderstanding, choosing the tool, training the teams, deploying
Delegate entire tasksClaude Cowork, Copilot Cowork, ChatGPT Work, Vibe Work