Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create digital marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realise their financial goals and help them to save time and money.
We operate across a range of markets, from financial services to healthcare, automotive, agrifinance, insurance, and many more industry segments.
We invest in people and new advanced technologies to unlock the power of data and to innovate. A FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 23,300 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.
Job DescriptionWe are looking for an experienced Senior Software Engineer with expertise in AWS and Big Data technologies. You will have a track record in designing, developing, and implementing scalable software solutions using AWS cloud services and Big Data platforms.
You'll have the opportunity to:
- Design, develop, and deploy scalable software solutions on AWS cloud infrastructure.
- Collaborate with teams to gather requirements, define architecture, and implement solutions.
- Use AWS services such as EC2, S3, Lambda, API Gateway, DynamoDB, RDS, EMR, to build reliable distributed applications.
- Develop data processing pipelines using Big Data technologies like Hadoop, Spark, Kafka, and Hive.
- Develop Batch applications using Spark, Scala, or PySpark.
- Optimize performance of data processing applications that are running on Athena, Presto and Spark frameworks.
- Design, develop, and maintain complex data pipelines and workflows using Apache Airflow.
- Configure and manage Airflow environments, including scheduling, monitoring, and troubleshooting workflow execution.
- Implement monitoring, logging, and alerting solutions to ensure system reliability and availability.
- Develop custom operators and sensors to extend Airflow functionality and support specific use cases.
- Conduct code reviews, provide technical guidance, and mentor junior team members.
- You will report to the Software Development Director.
Your background:
- Bachelor's or Master's degree in Computer Science, Engineering, or related field.
- 5+ years experience developing cloud-based applications.
- Experience with AWS services and infrastructure, including compute, storage, networking, security, and serverless computing.
- Proficiency in programming languages such as Java, Python, or Scala, and familiarity with modern software development practices and tools.
- Understanding of Big Data concepts, technologies, and architectures, with practical experience building Batch and Streaming applications.
- Experience with Big Data frameworks like Hadoop, Spark, Kafka and Athena, and related tools such as Hive, HBase, and Presto.
Benefits/Perks:
- Great compensation package and bonus plan
- Core benefits including medical, dental, vision, and matching 401K
- Flexible work environment, ability to work remote, hybrid or in-office
- Flexible time off including volunteer time off, vacation, sick and 12-paid holidays
- Explore all our exciting benefits here: https://yourexperianbenefits.com/cand-index.html
At Experian, our people and culture set us apart. We're deeply committed to creating an environment where everyone feels they belong and can excel. From inclusion and authenticity to work/life balance, development, wellness, collaboration, and recognition, we focus on what truly matters. Our people-first approach has earned us global recognition: World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ 2025 in 26 countries, and Glassdoor Best Places to Work 2024, among others.
Want to see what life at Experian is really like? Explore Experian Life on social or visit our careers site.
Our compensation reflects the cost of labor across several U.S. geographic markets. The base pay range for this position is listed above. Within this range, individual pay is determined by work location and additional factors such as job-related skills, experience, and education. You will be also eligible for a variable pay opportunity.
Experian is proud to be an Equal Opportunity Employer for all groups protected under applicable federal, state and local law, including protected veterans and individuals with disabilities. Innovation is an important part of Experian's DNA and practices, and our inclusive workforce allows everyone to succeed and bring their whole self to work. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.
#LI-Remote
This is a remote position.
Top Skills
Similar Jobs
What you need to know about the Charlotte Tech Scene
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus