Build and maintain Databricks lakehouse infrastructure and reliable ELT pipelines. Develop medallion data models, implement data quality, observability, security, governance, and CI/CD practices, optimize workflow performance and costs, and support AI/ML use cases. Collaborate with engineering, analytics, and business stakeholders in an Agile-Scrum environment while documenting designs and contributing to technical best practices.
Bridgeway is seeking a Data Engineer to build and maintain our data lakehouse infrastructure. This role involves working closely with analysts, engineers, and other stakeholders to contribute to our data architecture, ensuring secure and efficient data pipelines, and enabling advanced analytics. The ideal candidate will have a solid foundation in data engineering, data warehousing, and ELT processes, along with a passion for optimizing data systems.
This is a remote position with preference given to East Coast candidate.
Key Responsibilities:
- Develop and maintain components of a scalable lakehouse architecture, including a medallion (bronze/silver/gold) data model optimized for analytics and AI/ML consumption.
- Build, implement, and operate ELT pipelines, including workflow orchestration, scheduling, and monitoring, to ensure reliable and scalable execution.
- Apply established data quality, testing, and observability practices, and proactively monitor and resolve data and automation issues to ensure platform reliability and trust.
- Implement data security and compliance controls, including role-based access controls for security, encryption, masking, and governance best practices to ensure compliant handling of sensitive information.
- Contribute to optimizing the performance of data workflows and storage for cost efficiency and speed.
- Partner with engineers, analysts, and stakeholders to meet data needs; balance cost, performance, simplicity, and time-to-value and document solutions in line with team standards.
- Participate in code reviews and share knowledge with peers, contributing to team best practices and cross-functional collaboration.
- Support AI/ML use cases through well-structured data models, feature availability, and platform integrations using tools such as AI Search, Foundation Model APIs and Unity Gateway.
- Develop and maintain data pipelines using version control and CI/CD best practices in a collaborative engineering environment.
- Collaborate within an Agile-Scrum framework and contribute to technical design documentation to ensure efficient and successful delivery.
- Build working knowledge of organizational data domains, processes, and best practices.
Requirements:
- 3+ years of hands-on data engineering experience required.
- 2+ years of experience building and operating data pipelines in Databricks, including exposure to data modeling, governance, and CI/CD deployment patterns.
- 2+ years of experience with analytical SQL (ANSI SQL/T-SQL/Spark SQL) and Python for data engineering, including pipeline construction, transformation logic, and automation required.
- Strong communication skills with the ability to collaborate effectively across engineering, analytics, and business stakeholders required.
- Streaming and ingestion tools, such as Lakeflow Connect, AUTO CDC, Fivetran, or Azure Data Factory preferred.
- Terraform; Azure DevOps; GitHub Copilot or Claude Code knowledge is a plus.
- Experience using generative AI tools such as Claude and Copilot to improve productivity and deliver high-quality outcomes
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
Bridgeway is an Equal Opportunity Employer.
Similar Jobs
Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Build and maintain sales compensation systems, data pipelines, integrations, data models, and commission calculation logic. Translate compensation plans into tested technical configurations, ensure reconciliation and historical traceability, and implement access controls, audit trails, monitoring, and release practices. Partner with Sales Compensation Operations, Finance, Payroll, and technical teams to deliver accurate, explainable commission results.
Top Skills:
APIsCaptivateiqCloud Data WarehousesLookerExcelPigmentSalesforceSpiffSQLXactly
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Build and maintain the technical foundation for sales compensation, including commission systems, integrations, data pipelines, calculation logic, data models, testing, access controls, audit trails, reconciliation, and release practices. Partner with Sales Compensation Operations, Finance, Payroll, and technical teams to implement approved compensation plans and ensure accurate, explainable, reproducible commission results.
Top Skills:
Access ControlsAPIsAudit TrailsAutomated TestingData ModelingData PipelinesExcelLookerPigmentSalesforceSQLVersion Control
Cloud • Fintech • Food • Information Technology • Software • Hospitality
Build and maintain scalable production data pipelines and cloud data infrastructure. Ensure data quality, observability, lineage, governance, and cost-efficient performance. Develop data platform tooling, semantic and metrics layers, and enterprise data models supporting analytics, reporting, AI applications, and operational decisions. Collaborate with Analytics, Engineering, Product, operations, and business stakeholders while contributing to architecture, code reviews, testing, and technical standards.
Top Skills:
AirflowAWSAzureBigQueryClaudeDbtDelta LakeDockerGCPGithub CopilotJavaPythonRedshiftScalaSnowflakeSnowflake Cortex AiSQLTerraform
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus


