Design and optimize prompts, agent architectures, MCP tools, RAG workflows, and context-management strategies for reliable AI applications. Develop and integrate LLM-powered solutions with enterprise systems, APIs, healthcare data, and backend services. Establish evaluation and testing frameworks, improve response quality, and support deployment, monitoring, troubleshooting, security, compliance, governance, and responsible AI practices.
Role Summary:
AI Engineer with strong hands-on experience in prompt engineering, LLM response optimization, and AI application development. The ideal candidate can design prompts, improve model output quality, help LLMs understand user input, and build reliable, context-aware AI solutions.
Key Responsibilities
- Design, develop, and optimize prompts for Large Language Models (LLMs) to improve accuracy, reliability, and business outcomes.
- Build and configure Agentic AI solutions that leverage planning, reasoning, memory, and multi-step task execution capabilities.
- Develop and integrate MCP (Model Context Protocol) tools, enabling AIagents to securely discover and interact with enterprise systems, APIs, and data sources.
- Design agent architectures, tool-calling frameworks, retrieval mechanisms, and context management strategies.
- Collaborate with product managers, architects, and engineering teams to translate business requirements into AI-driven solutions.
- Implement Retrieval-Augmented Generation (RAG), knowledge grounding, and context orchestration patterns.
- Define evaluation frameworks and prompt testing methodologies to measure agent performance, quality, and reliability.
- Ensure AI solutions adhere to security, compliance, governance, and responsible AI standards.
- Support deployment, monitoring, troubleshooting, and continuous improvement of AI agents and MCP-enabled workflows.
- Contribute to architecture reviews, technical design documentation, and engineering best practices for AI platforms.
Required Skill
- Hands-on experience with LLMs such as GPT, Claude, Gemini, Llama, or similar models.
- Strong prompt engineering skills, including prompt templates, system prompts, few-shot prompting, and response tuning.
- Develop AI-powered applications using LLM APIs, RAG workflows, enterprise data sources, and backend services.
- Experience with LLM APIs and application integration using Python, Java, JavaScript, or similar programming languages.
- Knowledge of RAG, embeddings, vector databases, semantic search, and knowledge retrieval workflows.
- Ability to evaluate and improve AI responses for accuracy, relevance, completeness, tone, and instruction following.
- Understanding of NLP concepts, hallucination mitigation, prompt injection risks, guardrails, and responsible AI practices.
- Knowledge of healthcare data privacy and secure sensitive-data handling, including HIPAA-aligned PHI/PII practices, data minimization, de-identification, masking, access controls, auditability, and responsible use of healthcare data in AI workflows.
- Experience with MCP servers, cloud platforms, APIs, backend services, and production deployment is preferred.
- Experience integrating AI agents with healthcare, health records, or regulated industry systems.
Similar Jobs
Agency • Information Technology
Design and build scalable backend services and AI-powered applications using Node.js/TypeScript or Python. Develop AI agents, agentic workflows, LLM integrations, tool calling, evaluation frameworks, REST APIs, microservices, and event-driven services. Partner with Product and Business teams, provide architecture guidance and code reviews, lead an offshore engineering pod, and optimize backend and AI workloads for reliability and performance. The role is onsite in Rhode Island or Arizona.
Top Skills:
Agentic WorkflowsAi AgentsAi Evaluation FrameworksAi Orchestration FrameworksAWSAws BedrockAzureAzure OpenaiCi/CdContainersDistributed SystemsEmbeddingsEvent-Driven ArchitecturesGCPGoogle Vertex AiKubernetesLlm Tool CallingLlmsMicroservicesNode.jsObservability ToolsOpenaiPrompt EngineeringPythonRagRest ApisTypescriptVector Databases
Agency • Information Technology
Build and maintain scalable full-stack web applications across front-end and back-end systems. Develop RESTful APIs, integrate AI and machine-learning models using Python, manage SQL and NoSQL databases, and create GitHub Actions CI/CD pipelines. Collaborate with data scientists, troubleshoot and improve existing software, participate in code reviews, and apply modern DevOps, cloud, containerization, and microservices practices.
Top Skills:
AngularAWSAzureCSSDockerGitGithub ActionsGoogle Cloud PlatformHTMLJavaJavaScriptKubernetesMicroservicesMongoDBMySQLNode.jsNoSQLPostgresPythonReactRestful ApisSpring BootSQLVue
Agency • Information Technology
Design, develop, and deploy machine learning and deep learning models; build end-to-end ML pipelines including preprocessing, training, evaluation, and deployment; perform feature engineering on large datasets; deploy and monitor models on cloud platforms; collaborate with cross-functional teams to integrate AI solutions and retrain models as needed.
Top Skills:
AWSAzureCi/CdComputer VisionDockerGCPHadoopKubernetesLlmsNlpPythonPyTorchScikit-LearnSparkSQLTensorFlow
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
