ICF Logo

ICF

Test Automation Engineer

Posted 16 Days Ago
In-Office or Remote
Hiring Remotely in Charlotte, NC, USA
81K-139K Annually
Senior level
In-Office or Remote
Hiring Remotely in Charlotte, NC, USA
81K-139K Annually
Senior level
Develops and maintains automated testing for enterprise platforms, applications, data systems, APIs, cloud services, and AI/ML solutions. Converts acceptance criteria into repeatable tests, implements CI/CD quality gates, performs functional, integration, regression, load, performance, accessibility, and security validation, and supports release certification and rollback readiness. Coordinates release readiness with delivery, engineering, security, governance, and SRE teams while documenting test results, risks, defects, compliance artifacts, and release evidence.
The summary above was generated by AI

Please note: This role is contingent upon a contract award. While it is not an immediate opening, we are actively conducting interviews and extending offers in anticipation of the award. 


The Work 

At ICF our Digital Modernization Division is an information technology and management consulting organization that delivers integrated, strategic solutions to federal clients. We bring expertise in cloud, cybersecurity, enterprise architecture, data modernization, and digital transformation to support mission-critical government programs.  

 

Join a team accelerating the modernization of a large federal agency's enterprise data and analytics ecosystem. This cloud-based platform provides data storage, analytics, governance, and AI/ML capabilities that enable thousands of users to transform data into actionable insights. As demand continues to grow, the team is focused on migrating legacy workloads, streamlining onboarding and support, expanding platform capabilities, and helping organizations across the enterprise adopt modern data and AI solutions at scale. 

 

The test automation engineer implements automated testing, release validation, quality gates, rollback readiness checks, and release evidence capture for platform, application, data, and AI/ML work. Helps teams convert acceptance criteria into automated or repeatable tests and validates that releases meet functional, integration, security, accessibility, and load/performance expectations where applicable. Coordinates release readiness with Agile Delivery Managers, Functional Leads, and SRE. 


Job Location: Remote, however, strong preference for candidates who live in the Washington DC Metro Area. There will be occasional onsite meetings on the client site in Washington, DC. 

*If you accept this position, you should note that ICF does monitor employee work locations, blocks access from foreign locations/foreign IP addresses, and prohibits personal VPN connections. 


What You Will Do: 

  • Implements automated testing, release validation, quality gates, rollback readiness checks, and release evidence capture for platform, application, data, and AI/ML work. 
  • Helps teams convert acceptance criteria into automated or repeatable tests and validates that releases meet functional, integration, security, accessibility, and load/performance expectations where applicable. 
  • Coordinates release readiness with Agile Delivery Managers, Functional Leads, and SRE. 
  • Apply Test automation, CI/CD quality gates, release validation, regression testing, integration testing, load testing, release evidence, and agile QA to support role delivery. 
  • Collaborate with relevant product, engineering, security, governance, quality, and customer-facing stakeholders as required by the role. 
  • Document work products, decisions, risks, and delivery evidence to support traceability and continuous improvement. 

Basic Qualifications 

  • U.S. Citizenship is required due to federal contract requirements. 
  • Candidate must reside in the U.S., be authorized to work in the U.S., and all work must be performed in the U.S. 
  • Candidate must have lived in the U.S. for three (3) full years out of the last five (5) years. 
  • Bachelor's degree in Computer Science, Software Engineering, Information Systems, Quality Engineering, Computer Engineering, or related field; or a high school diploma with four (4) additional years of relevant experience in lieu of a bachelor's degree. 
  • Minimum 6 years of relevant experience aligned to the responsibilities of this role. 
  • Master's degree may substitute for two (2) years of relevant experience. 

Preferred Qualifications 

  • Experience designing, implementing, and maintaining automated testing frameworks and quality engineering practices for enterprise applications, data platforms, APIs, and cloud-native solutions. 
  • Experience developing automated functional, regression, integration, end-to-end, smoke, and user acceptance testing solutions. 
  • Experience translating business requirements, user stories, and acceptance criteria into automated and repeatable test cases and validation processes. 
  • Experience implementing quality gates and automated validation controls within CI/CD pipelines using Azure DevOps, GitHub Actions, Jenkins, or similar DevSecOps platforms. 
  • Experience performing release validation, deployment verification, rollback readiness testing, release certification, and release evidence collection. 
  • Experience testing APIs, integrations, workflow automation solutions, data pipelines, and cloud-based services. 
  • Experience supporting platform modernization, analytics, data engineering, and AI/ML initiatives through test automation and quality assurance practices. 
  • Experience validating data quality, data transformations, reporting outputs, dashboards, and analytical workloads within enterprise data environments. 
  • Experience performing non-functional testing including load testing, performance testing, scalability testing, resiliency testing, and accessibility validation. 
  • Experience utilizing automated testing tools such as Selenium, Playwright, Cypress, Postman, REST Assured, JMeter, LoadRunner, or equivalent technologies. 
  • Experience supporting cloud-based platforms and services including Azure, Databricks, APIs, workflow orchestration platforms, business intelligence tools, and enterprise applications. 
  • Familiarity with AI/ML testing concepts including model validation, data validation, output verification, prompt evaluation, and responsible AI testing approaches. 
  • Experience collaborating with Agile Delivery Managers, Product Managers, Functional Leads, Engineers, SRE teams, Security teams, and stakeholders to assess release readiness and quality risks. 
  • Experience establishing quality metrics, release readiness criteria, testing dashboards, defect tracking processes, and quality reporting. 
  • Experience documenting test results, quality findings, release evidence, defects, risks, and compliance artifacts to support auditability and continuous improvement. 
  • Understanding of security testing, vulnerability validation, accessibility standards (Section 508), and compliance requirements within regulated environments. 
  • Experience supporting Federal government, healthcare, or other highly regulated environments preferred. 
  • Experience working in Agile, Scrum, SAFe, or cross-functional delivery teams. 

Professional Skills: 

  • Highly effective analytical, problem-solving, and decision-making capabilities. 
  • Excellent written and verbal communication skills, with the ability to work effectively across technical and non-technical audiences. 
  • Strong organization, attention to detail, and the ability to prioritize and manage multiple responsibilities. 
  • Collaborative approach with a commitment to quality, accountability, and continuous improvement. 

#LI-CC1 

#Indeed 


Bot and Third-Party Applications

Please note that this application must be submitted directly by the applicant for consideration. Failure to do so may result in the application being excluded for consideration.  Applicants needing an accommodation for disability or religious purposes in connection with the application process should contact [email protected] for assistance.

Working at ICF

ICF is a global advisory and technology services provider, but we’re not your typical consultants. We combine unmatched expertise with cutting-edge technology to help clients solve their most complex challenges, navigate change, and shape the future.

We can only solve the world's toughest challenges by building a workplace that allows everyone to thrive. We are an equal opportunity employer. Together, our employees are empowered to share their expertise and collaborate with others to achieve personal and professional goals. For more information, please read our EEO policy.

We will consider for employment qualified applicants with arrest and conviction records.

 

Reasonable Accommodations are available, including, but not limited to, for disabled veterans, individuals with disabilities, and individuals with sincerely held religious beliefs, in all phases of the application and employment process. To request an accommodation, please email [email protected] and we will be happy to assist. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.  

Read more about workplace discrimination rights or our benefit offerings which are included in the Transparency in (Benefits) Coverage Act. 

 

Candidate AI Usage Policy

At ICF, we are committed to ensuring a fair interview process for all candidates based on their own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) tools to generate or assist with responses during interviews (whether in-person or virtual) is not permitted. This policy is in place to maintain the integrity and authenticity of the interview process.  

However, we understand that some candidates may require accommodation that involves the use of AI. If such an accommodation is needed, candidates are instructed to contact us in advance at [email protected]. We are dedicated to providing the necessary support to ensure that all candidates have an equal opportunity to succeed.  


 

Pay Range - There are multiple factors that are considered in determining final pay for a position, including, but not limited to, relevant work experience, skills, certifications and competencies that align to the specified role, geographic location, education and certifications as well as contract provisions regarding labor categories that are specific to the position.

The pay range for this position based on full-time employment is:

$81,499.00 - $138,549.00

Nationwide Remote Office (US99)

Similar Jobs

One Month Ago
In-Office or Remote
United States
Senior level
Senior level
Big Data • Information Technology • Software • Analytics • Energy
Own the conversion of manual regression suites into automated tests for CAD-based desktop and Revit-integrated applications using T-Plan Robot. Design reusable test frameworks, execute and analyze automated tests, document defects, and maintain CI/CD integrations. Apply AI and LLM tools with validation workflows to improve test authoring and reliability. Collaborate with developers and product owners, track coverage and defect trends, and eventually expand automation frameworks and mentorship across other product teams.
Top Skills: AIAutocadAutodesk RevitAzure DevopsCi/CdGithub ActionsInventorLlmsNunitPostmanSeleniumSQLSwaggerT-Plan RobotWinappdriver
One Month Ago
Remote
United States
80K-100K Annually
Junior
80K-100K Annually
Junior
Software • Energy • Solar • Renewable Energy
Develop and maintain Python-based automated test frameworks for software-, hardware-, and model-in-the-loop environments supporting power plant controllers and SCADA systems. Define verification and validation plans, integrate testing into CI/CD pipelines, execute tests across multiple environments, investigate requirements, analyze failures, and perform root cause analysis using engineering tools and telemetry. Collaborate with controls and systems teams to ensure reliable production-ready software.
Top Skills: BashDnp3DockerGitGithub ActionsHilIec 61131-3Iec 61850JenkinsLogic AnalyzersMilModbusOpenhtfOscilloscopesPlcPytestPythonRtacScadaSil
15 Days Ago
Remote or Hybrid
US
Senior level
Senior level
Mobile • Security • Software • Cybersecurity
Designs and maintains automated testing frameworks for AI-powered applications, APIs, backend services, and distributed systems. Defines test strategies, acceptance criteria, evaluation metrics, tolerances, and quality gates for deterministic and non-deterministic software. Builds regression, integration, API, and end-to-end coverage; evaluates LLMs, agents, prompts, and tool-calling workflows; integrates testing into CI/CD; analyzes failures, telemetry, and logs; reduces flaky tests; and partners with AI, engineering, and product teams on continuous quality practices.
Top Skills: Ai/Ml SystemsChatgptClaudeDockerGitGithub ActionsGithub CopilotGitlab CiJavaJavaScriptJenkinsKubernetesLlmsPostmanPythonRest ApisRest AssuredRetrieval-Augmented GenerationRustTestrailTool CallingTypescript

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account