DevSavant Logo

DevSavant

Senior IVA QA Automation Engineer (6 months project)

Posted 7 Days Ago
Be an Early Applicant
Remote
12 Locations
Mid level
Remote
12 Locations
Mid level
The Senior IVA QA Automation Engineer will engage stakeholders, design testing frameworks, evaluate tools, automate tests, and implement reporting for AI-driven voice applications.
The summary above was generated by AI
About DevSavant

DevSavant is a boutique staff augmentation firm serving B2B Tech & AI companies in the US. We specialize in integrating top-tier LATAM professionals into client teams with speed, precision, and cultural alignment. Our mission is to be an extension of our clients' organizations, building sustainable, high-performance teams that scale fast and deliver results.

Responsibilities:

  1. Stakeholder Engagement & Requirements Gathering

    • Coordinate with product, development, and QA Director

    • Define business and technical requirements for voice testing

  2. Current State Analysis

    • Document existing manual test cases and tools

    • Analyze conversation flows and performance metrics

  3. Scope Definition & Prioritization

    • Identify high-priority intents and modules

    • Define automation boundaries and test coverage goals

  4. Tool Evaluation & Selection

    • Assess and choose tools for STT, TTS, test automation, and CI/CD

  5. Framework Design & Environment Setup

    • Architect the voice testing framework

    • Set up environments, SDKs, APIs, and version control

    • Establish CI/CD pipelines

  6. Test Development & Automation

    • Build reusable components and utilities

    • Automate high-priority test cases (intent, flow, entity, fallback)

    • Expand to multi-turn and regression scenarios

  7. CI/CD Integration

    • Integrate voice tests into nightly runs and PR triggers

    • Validate deployments and enable parallel execution

  8. Test Data & Reporting

    • Manage test data setup, teardown, and utterance variations

    • Implement reporting, playback, and performance metrics

  9. Stabilization & Coverage Expansion

    • Fix flaky tests and improve reliability

    • Expand coverage to 70–80% of regression suite

    • Add multi-language, accent, and device testing

  10. Non-Functional Testing

    • Implement performance, load, latency, and security testing

  11. Optimization & Documentation

    • Optimize execution time and resource usage

    • Finalize documentation, best practices, and usage guides

  12. Training & Handover

    • Train QA and developers on framework usage and maintenance

    • Conduct retrospectives and plan for continuous improvement

Requirements:

Technical Skills:

  • Programming: Expert in Python for in-house tool development and test scripting..

  • IVA Testing: Proficiency in testing AI-driven voice applications (e.g., NLP, ASR) using tools like Twilio Autopilot, Cyara, or Dialogflow.

  • Tools: Experience with Postman, Cyara, Twilio.

  • CI/CD: Expertise in building pipelines from scratch (Jenkins, GitHub Actions, GitLab CI) and integrating voice testing environments.

  • Telephony: Knowledge of SIP and cloud telephony platforms (e.g., Twilio, AWS Connect) for voice-to-voice IVA automation.

Soft Skills:

  • Analytical mindset to debug complex IVA failures.

  • Strong collaboration with developers and stakeholders for framework design and defect resolution.

  • Clear documentation and KPI reporting for transparency.

Experience:

  • 3+ years in QA automation, with 1+ years in IVA systems.

  • Proven experience building QA frameworks and CI/CD pipelines from scratch.

  • Hands-on expertise in voice-to-voice call automation and AI-driven IVA testing.

Top Skills

Cyara
Dialogflow
Github Actions
Gitlab Ci
Jenkins
Postman
Python
Twilio

Similar Jobs

22 Hours Ago
Remote or Hybrid
2 Locations
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The Regional Alliances Manager will drive business opportunities in SOLA through strategic partner engagement, delivering growth and enabling successful collaborations on marketing and sales initiatives.
Top Skills: CybersecurityNetworking TechnologiesSaaSSecurity TechnologiesSoftware
22 Hours Ago
Remote
12 Locations
5-5
Senior level
5-5
Senior level
Agency • Digital Media • eCommerce • Professional Services • Software • Analytics • Consulting
Lead the backend development team, mentor junior developers, and deliver projects while collaborating in an Agile environment. Requires strong Node.js and web development skills.
Top Skills: AWSJavaScriptNode.jsPostgres
Yesterday
Remote or Hybrid
12 Locations
53M-53M
Senior level
53M-53M
Senior level
Marketing Tech • Real Estate • Software • PropTech • SEO
Lead the QA strategy and oversee QA teams, ensuring high-quality software delivery across all platforms, including web and mobile.
Top Skills: AppiumAWSCi/CdCypressPlaywrightSelenium

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account