Data Engineer - Spark

Your Impact
The primary purpose of this role is to translate business requirements and functional specifications into logical program designs and to deliver modules, stable application systems, and Data or Platform solutions. This includes developing, configuring, or modifying integrated business and/or enterprise infrastructure or application solutions within various computing environments. This role facilitates the implementation and maintenance of business and enterprise Data or Platform solutions to ensure successful deployment of released applications.
What you will do

• Develops integrated business and/or enterprise application solutions in data analytical space to ensure specifications are flexible, scalable, and maintainable and meet architectural standards.
• Develops software/data solutions for business requirements using a good understanding of programming fundamentals.
• Ensures good unit testing and functional testing coverage accounting for all boundary conditions according to the system integration test plan and supports user acceptance testing.
• Follows best source control and continuous integration/continuous deployment practices for efficient testing and deployment of code to different environments.
• Reviews technical documents, design, code, and demonstrations and performs peer reviews for design and code to stay aligned in team approach.
• Develops and participates in group design for data pipelines to move data between different operational systems, transactional systems, streaming systems, and big data systems (on-premises or cloud).
• Implements defined business metrics using a good understanding of structured query language (SQL), in collaboration with technical leads, data analysts, and product owners.
• Implements transformation logic to aggregate, filter, and combine multiple datasets to provide essential business consumable datasets and metrics.
• Analyzes and organizes data to determine data sets and metrics required to drive insights requested by the business.
• Helps develop, design, maintain, and enhance operational, analytical (including self-serve) applications across various business domains; delivers reports on-premises and cloud infrastructure; uses frameworks and reusable components whenever possible.
• Troubleshoots system issues, helps in root cause analysis, and drafts reports that provide insight into system support activities; ensures conformance of the technology solutions with IT governance and regulatory frameworks.
• Helps implement infrastructure-related projects for the organization.

Qualifications
Minimum Qualifications

• Bachelor's Degree in Engineering, Computer Science, CIS, or related field (or equivalent work experience in a related field)
• 2 years of experience in Data, BI or Platform Engineering, Data Warehousing/ETL, or Software Engineering
• 1 year of experience working on project(s) involving the implementation of solutions applying development life cycles (SDLC)

Preferred Qualifications

• Master's Degree in Computer Science, CIS, or related field
• 2 years of IT experience developing and implementing business systems within an organization
• 4 years of experience working with defect or incident tracking software
• 4 years of experience with technical documentation in a software development environment
• 2 years of experience working with an IT Infrastructure Library (ITIL) framework
• 2 years of experience leading teams, with or without direct reports
• Experience with application and integration middleware
• Experience with database technologies

Data Engineering

• 2 years of experience in Hadoop or any Cloud Bigdata components (specific to the Data Engineering role)
• Expertise in Java/Scala/Python, SQL, Scripting, Teradata, Hadoop (Sqoop, Hive, Pig, Map Reduce), Spark (Spark Streaming, MLib), Kafka or equivalent Cloud Bigdata components (specific to the Data Engineering role)

BI Engineering

• Expertise in MicroStrategy/Power BI/SQL, Scripting, Teradata or equivalent RDBMS, Hadoop (OLAP on Hadoop), Dashboard development, Mobile development (specific to the BI Engineering role)

Platform Engineering

• 2 years of experience in Hadoop, NO-SQL, RDBMS or any Cloud Bigdata components, Teradata, MicroStrategy (specific to the Platform Engineering role)
• Expertise in Python, SQL, Scripting, Teradata, Hadoop utilities like Sqoop, Hive, Pig, Map Reduce, Spark, Ambari, Ranger, Kafka or equivalent Cloud Bigdata components (specific to the Platform Engineering role)

About Lowe's
Lowe's Companies, Inc. (NYSE: LOW) is a FORTUNE® 50 home improvement company serving approximately 16 million customer transactions a week in the United States. With total fiscal year 2023 sales of more than $86 billion, Lowe's operates over 1,700 home improvement stores and employs approximately 300,000 associates. Based in Mooresville, N.C., Lowe's supports the communities it serves through programs focused on creating safe, affordable housing and helping to develop the next generation of skilled trade experts. For more information, visit Lowes.com.
Lowe's is an equal opportunity employer and administers all personnel practices without regard to race, color, religious creed, sex, gender, age, ancestry, national origin, mental or physical disability or medical condition, sexual orientation, gender identity or expression, marital status, military or veteran status, genetic information, or any other category protected under federal, state, or local law.