The Senior Data Engineer manages data ingestion, develops ETL/ELT pipelines, integrates systems, and guides data management best practices, focusing on Azure technologies.
Application Instructions
Click Apply to submit your online application. Please attach a resume and thoughtful cover letter on the "My Experience" page in the "Resume/CV" field.
Active City Year Staff members must login to Workday to apply internally.
Number of Positions: 1Work Location: 100% RemotePosition Overview
The Senior Data Engineer works closely with local City Year data experts, school district IT professionals and a multitude of partners to manage ingestion of data from many sources. Our ideal candidate is professionally experienced in all things Azure and familiar with dev ops. They will use their Azure experience, especially with Azure Data Factories and Databricks, to lead the end-to-end development and implementation of modern ETL/ELT data pipelines for our team. This candidate will be excited to promote the effective use of timely and accurate k-12 education data and empower front-line practitioners with the information needed to have greater impact on the students we serve. The Senior Data Engineer reports to the Director of Data Management and Reporting.Job Description
As a Senior Data Engineer at City Year, you will:- Be our resident Azure expert and trusted advisor for Azure
- Own the design, development, and implementation of modern data pipelines, data factories and data streams. This is a hands-on role.
- Lead the planning and then implement the data platform services including sizing, configuration, and needs assessment
- Own the management and development of various third-party data integrations
- Lead development of frameworks, and data architectures for large-scale data processing that ensure timely and accurate processing of data into and among City Year’s systems and help implement them.
- Influence and make recommendations on the technical direction for the team by leveraging your prior experiences and your knowledge of emerging technologies and approaches
- Lead our team in identifying and promoting data management best practices
- Conduct full technical discovery, identify pain points, gather business and technical requirements, and explain the “as is” and “to be” scenarios to fully understand user stories from stakeholders and users
- Lead and participate in deep architectural discussions to build confidence and ensure customer success when building new solutions and migrating existing data applications on the Azure platform
- Serve as a leader in bridging the gap between technical and non-technical staff in understanding our data and its processing at City Year.
- Own the implementation and use of ETL and data management best practices, devops, ci/cd, and deployment strategies to ensure product quality, agility, robustness, and recoverability
- Partner with districts and internal customers to understand their requirements and implement data solutions.
- Create integrations between internal systems and support them operationally.
- Teach others in the DMAR team about Azure, databricks and best practices to ensure all services and technology implemented can be supported by others on the team.
- At least 3+ years of professional experience (not simply coursework or capstone projects) in the following:
- Working in an Azure environment on ETL/ELT projects
- Azure DevOps
- Azure Databricks
- Azure Data Factories
- SQL
- Python
- Relational databases
- Working with heterogeneous datasets/formats from many vendors, providers, and platforms
- Data Architecture experience
- Have experience and demonstrated ability to successfully integrate and manage data across disparate information systems
- Excellent written and verbal communication skills, especially the ability to express complex technical information in understandable and rigorously accurate terms as well as to express technical items in a manner that non-technical users can understand
- Attention to detail while working on multiple projects at once
- Demonstrated success and effectiveness working in and promoting a rapidly changing, collaborative, and time-critical work environment
- Some experience
- with Databricks Lakehouse
- with Microsoft Fabric
- with archiving and backup solutions in Microsoft Azure
- in a role at a school district, Charter Management Organization (CMO), or Ed-tech company with an emphasis on supporting end-user data needs
- in an Agile environment
- Commitment to continuous improvement and City Year’s mission: our desire to focus talents on helping improve outcomes for kids in school and our AmeriCorps members who support them
- You love learning new things. You're curious and ask good questions. You solicit feedback from others, accept it with grace, and act on it
- Your technical skills will be used to have a significant, positive impact on children’s education outcomes and future opportunities
- A role on a small, high-powered team that is integral to delivering on the mission of City Year
- Opportunity for control over the design and implementation of solutions
- Space and opportunity to develop new technical skills
- Focus on creating a work environment that is diverse, inclusive, equitable, and encourages belonging
- Opportunity to work with some amazing people!
Benefits
Full-time employees will be eligible for all benefits including vacation, sick days and organization holidays. You may participate in all benefit programs that City Year establishes and makes available to eligible employees, under (and subject to all provisions of) the plan documents that govern those programs. Currently, City Year offers medical, dental, vision, life, accidental death and dismemberment and disability coverage, Flexible Spending Accounts (FSA), and other benefits including 401(k) plan(s) pursuant to the terms and conditions of company policy and the 401(k) plan document. For more information, click here.
Employment at City Year is at-will.
City Year does not sponsor work authorization visas.
Top Skills
Azure
Azure Data Factories
Azure Databricks
Azure Devops
Python
SQL
Similar Jobs
eCommerce • Legal Tech • Professional Services • Software • Data Privacy
The role involves building data infrastructure, maintaining ETL pipelines, collaborating with analysts, and improving data models and processes.
Top Skills:
Apache AirflowAWSDbtGrafanaPostgresRedshiftSnowflake
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design and build data integration frameworks and pipelines while ensuring data accuracy and resolving management issues, collaborating with DevOps and data scientists.
Top Skills:
AirflowDbtPythonRedshiftSnowflakeSQL
Healthtech • Software
The Senior Data Engineer will build and scale data assets, improve data quality, create data pipelines, and enhance platform capabilities in a cross-functional setting.
Top Skills:
BigQueryCloud ComputingDagsterDbtGCP
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
