Conduct quality monitoring of AI chatbot responses, resolve issues, optimize models, analyze data, and improve quality-control processes.
Responsibilities
- Quality Monitoring: Conduct daily quality assurance on AI Chatbot responses through manual sampling and user feedback to assess accuracy, relevance, and naturalness.
- Issue Resolution: Detect response-quality issues promptly; document root causes, propose actionable improvements, and follow through to closure.
- Model Tuning: Collaborate with engineering teams to optimize AI models by participating in data annotation, parameter adjustment, and other enhancement tasks to boost performance and answer quality.
- Data Analysis: Collect and analyze user-conversation data to uncover user needs and pain points, providing data-driven insights for optimization.
- Process Improvement: Refine quality-control workflows to increase efficiency and ensure standardization of QA and tuning processes.
Requirements
1. Technical Skills
- Solid understanding of AI Chatbot mechanisms and quality-evaluation criteria.
- Basic data-analysis skills; proficient in SQL, Excel, and related tools.
- Foundational knowledge of Natural Language Processing (NLP) and Machine Learning.
2. Experience
- 2+ years of relevant experience; prior optimization experience with AI or conversational products is preferred.
- Experience with industry-leading AI Chatbot products is a strong plus.
3. Soft Skills
- Strong communication and collaboration abilities.
- Meticulous, patient, and adept at identifying and solving problems.
- Thrives in a fast-paced environment and demonstrates a strong learning aptitude.
Top Skills
Excel
Machine Learning
Natural Language Processing
SQL
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Principal Technical Consultant specializes in integrations and consulting to optimize customer use of the ServiceNow platform, focusing on AI solutions and integration strategies.
Top Skills:
AIExport SetsGenerative AiIdrImport SetsJavaScriptJdbcLdapMiddlewareNluRestServicenowSoapSsoTask IntelligenceVirtual AgentWeb Services
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Technology Consultant will configure and implement ServiceNow integrations, drive customer satisfaction, and support AI solutions while leading technical engagements.
Top Skills:
AIJavaScriptJdbcLdapMiddlewareRestServicenowSoapSsoWeb Services
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Principal Technical Consultant will oversee integrations and AI solutions for customers, ensuring successful implementation and providing technical support and guidance throughout the process.
Top Skills:
AIDatabase DesignJavaScriptJdbcLdapNluRestServicenowSoapSsoVirtual AgentWeb Services
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
