Build and operate production-ready LLM-powered agents for commercial banking customer service. Responsibilities include agent orchestration, tool and API integrations, RAG systems, knowledge pipelines, human-in-the-loop workflows, evaluation frameworks, safety controls, observability, CI/CD, and secure deployment. The role requires collaboration with product, operations, technology, risk, compliance, platform, and security teams in a regulated financial-services environment.
We are unable to sponsor or take over sponsorship of an employment visa at this time
AI Developer / Agentic AI Engineer
Role Summary
We are building an agentic AI platform to transform commercial banking customer service. The AI developer will design, build, and operate LLM-powered agents that interpret inbound servicing requests (e.g., email / case intake), retrieve grounded knowledge, and execute approved workflows through secure tool/API integrations – with enterprise-grade controls, observability, and human-in-the-loop patterns.
This role sits within a cross-functional team with Product, Operations, Technology, and Risk partners and focuses on delivering production-ready agentic AI capabilities for regulated financial services
Responsibilities
Agentic AI Solution Development
- Build and enhance LLM/agent orchestration (Planner/supervisor patterns, tool-using agents, routing, guardrails).
- Implement intent classification information extraction validation and decision logic for servicing workflows
- Developed tool calling integrations to downstream systems (CRM, workflow engine, core banking services, case management)
- Implement human-in-the-loop workflows (review, approval, escalation, override) based on confidence/risk thresholds
Knowledge and grounding (RAG)
- Design and implement retrieval-augmented generation (RAG) for policy procedure grounding and resolution guidance
- Build knowledge ingestion pipelines with refresh/versioning
- Improve answer quality via chunking strategies, embeddings re ranking and context management
Quality, Safety and Evaluation
- Define and run evaluation frameworks: golden datasets, scenario tests, regression tests, and automated scoring.
- Reduce hallucinations and risk by implementing prompt policies, constraints, structured outputs, and verification steps.
- Partner with risk slash compliance to ensure traceability, audit logs, explain ability requirements are met.
Production Readiness and Operations
- Implement observability for agents (latency, cost, tool failures, drift, quality signals, escalation rates).
- Support CI/CD for agent prompts and configurations (versioning, approvals, rollback).
- Collaborate with platform and security teams on secrets management, access controls, PII protections, and safe deployments.
Required Qualifications
- 4+ years of software engineering experience or equivalent with strong CS fundamentals
- Hands-on experience building with LLMs and modern AI app stack (agents, RAG, tool/function calling).
- Strong proficiency in Python and building back-end services/APIs.
- Experience with at least one: LangChain / LangGraph, Llamalndex, Semantic Kernel or equivalent frameworks.
- Experience with vector databases and search (e.g., Pinecone, Weaviate, Milvus, OpenSearch/Elastic, pgvector)
- Experience deploying services in cloud environments (AWS/Azure/GCP) with basic DevOps practices
- Strong understanding of security and privacy principles (PII handling, least privilege, audit logging)
Preferred Qualifications
- Experience in financial services or other regulated domains (risk controls, compliance audit readiness)
- Experience integrating with enterprise workflows (e.g., ServiceNow, Custom workflow engines, BPM/RPA)
- Familiarity with model evaluation approaches (LLM-as-judge, rubric scoring, retrieval evals, offline/online testing)
- Experience with messaging/eventing (Kafka/SQS), email ingestion pipelines, and document processing
- Exposure to MRM concerns and governance (model cards, risk assessments, validation processes)
Kaleidoscope, an Infosys Company, is an equal opportunity employer, and all qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, spouse of protected veteran, or disability.
Similar Jobs
Fintech • Financial Services
Designs and develops cloud-native applications, APIs, microservices, enterprise integrations, and AI-powered operational workflows. Builds agentic AI capabilities using LLMs, vector search, MCP integrations, and orchestration frameworks for incident triage, root cause analysis, and workflow automation. Leads technical initiatives, contributes to architecture and reliability improvements, supports production operations, resolves complex technical issues, and mentors less experienced engineers.
Top Skills:
Ci/CdDevOpsDistributed SystemsGenerative AiJavaScriptKafkaKubernetesLarge Language ModelsMcp IntegrationsMicroservicesNoSQLOpenshiftPythonRabbitMQRest ApisRetrieval-Augmented GenerationServicenow ApisSQLTypescriptVector Databases
Fintech • Financial Services
Lead the architecture and modernization of enterprise financial crime platforms using AI, agentic workflows, cloud-native systems, microservices, and event-driven architectures. Define technology strategy, engineering standards, and reference architectures; oversee design reviews, prototypes, production code, DevSecOps, and AI model operationalization. Partner with compliance, risk, operations, product, data science, and engineering leaders while mentoring technical teams and presenting modernization strategies to executives.
Top Skills:
Agentic AiAi Agent FrameworksAi GuardrailsAi ObservabilityApi-First PlatformsArtificial IntelligenceCi/CdCloud-Native ArchitecturesDevsecopsDistributed SystemsEvent-Driven SystemsGenerative AiLlm OrchestrationMachine LearningMicroservicesModel RoutingRetrieval-Augmented Generation (Rag)Vector Databases
Fintech • Financial Services
Provides strategic and hands-on leadership for enterprise AI/ML platform architecture, modernization, development, and operations across hybrid and multi-cloud environments. Leads the Tachyon Cortex platform, model lifecycle management, MLOps, predictive and generative AI, RAG, and agentic AI initiatives. Establishes architecture standards, automation, governance, security, monitoring, and compliance practices while advising senior leadership and coordinating with engineering, data, cybersecurity, governance, and infrastructure teams.
Top Skills:
AnsibleAzure Machine LearningChainlitCrewaiCrossplaneGcp Vertex AiGenerative AiGithub ActionsGoogle Cloud PlatformGoogle Kubernetes EngineHarness CdJavaKubernetesLangchainLanggraphLarge Language ModelsMicrosoft AutogenAzureMlopsModel Context ProtocolOpenshift Container PlatformOrchestration FrameworksPlaywrightPrompt EngineeringPythonPyTorchRetrieval-Augmented GenerationShell ScriptingSQLTensorFlowTerraformVector Databases
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
