Leads the architecture, design, and implementation of scalable GCP and Databricks data lakehouse platforms. Designs real-time and batch pipelines, data models, governance, cataloging, security, and performance optimization. Advises clients, translates business requirements into technical solutions, leads project teams, mentors engineers, reviews architectures, and balances strategic planning with hands-on proof-of-concept and troubleshooting work.
About Egen:
Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results. If this describes you, we want you on our team.
Want to learn more about life at Egen? Check out these resources in addition to the job description.
Meet Egen
Life at Egen
Culture and Values at Egen
Career Development at Egen
Benefits at Egen
Responsibilities:
- Lead the end-to-end architecture, design, and implementation of scalable Data Lakehouse solutions on Google Cloud Platform (GCP) using BigQuery, GCS, BigLake, and Dataplex
- Collaborate directly with customers to understand business goals, data challenges, and technical requirements; translate them into robust architectural blueprints and actionable plans
- Design and implement data pipelines supporting both real-time and batch ingestion using modern orchestration and streaming frameworks
- Establish and enforce best practices for data cataloging, metadata management, lineage, and data quality across multiple systems
- Define and implement data security, access control, and governance models in compliance with enterprise and regulatory standards
- Serve as the technical lead for project teams - mentoring engineers, reviewing solutions, and ensuring architectural consistency across deliverables
- Balance strategic architecture discussions with hands-on solutioning, POCs, and deep dives into data pipelines or performance tuning
- Partner with stakeholders, cloud architects, and delivery leads to drive solution adoption, scalability, and long-term maintainability
- Represent the company as a trusted technical advisor in client engagements - clearly articulating trade-offs, best practices, and recommendations
Qualifications:
- 8–10 years of progressive experience in Software Engineering and Data Platform development, with 5+ years architecting data platforms on GCP and/or Databricks
- Proven hands-on experience designing and deploying Data Lakehouse platforms with data products and medallion architectures
- Strong understanding of data ingestion patterns (real-time and batch), ETL/ELT pipeline design, and data orchestration using tools such as Airflow, Pub/Sub, or similar frameworks
- Expertise in data modeling, storage optimization, partitioning, and performance tuning for large-scale analytical workloads
- Experience implementing data governance, security, and cataloging solutions (Dataplex, Data Catalog, IAM, or equivalent)
- Excellent communication and presentation skills - able to confidently engage with technical and non-technical stakeholders and guide clients through solution decisions
- Demonstrated ability to lead by example in mixed teams of engineers, analysts, and architects, balancing architectural vision with hands-on delivery
- Nice to have: Experience with Databricks (Delta Lake, Unity Catalog) and hybrid GCP-Databricks data architectures
- Strong problem-solving mindset, curiosity to explore new technologies, and ability to “zoom out” for architecture discussions and “zoom in” for code-level troubleshooting
Compensation & Benefits:
This role is eligible for our competitive salary and comprehensive benefits package to support your well-being:
- Comprehensive Health Insurance
- Paid Leave (Vacation/PTO)
- Paid Holidays
- Sick Leave
- Parental Leave
- Bereavement Leave
- 401 (k) Employer Match
- Employee Referral Bonuses
Check out our complete list of benefits here - >https://egen.ai/people/#benefits
Important: All roles are subject to standard hiring verification practices, which may include background checks, employment verification, and other relevant checks.
EEO and Accommodations:
Egen is an equal opportunity employer and is committed to inclusion, diversity, and equity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veterans’ status, or any other characteristic protected by federal, state, or local laws. Egen will also consider qualified applications with criminal histories, consistent with legal requirements. Egen welcomes and encourages applications from individuals with disabilities. Reasonable accommodations are available for candidates during all aspects of the selection process. Please advise the talent acquisition team if you require accommodations during the interview process.
Similar Jobs
Insurance
Lead enterprise data architecture strategy and implementation across cloud data platforms, integration ecosystems, analytics, AI, and operational systems. Design scalable lakehouse or warehouse architectures, canonical data models, governance frameworks, data products, and secure healthcare data integrations. Partner with engineering, product, analytics, AI, security, and executive stakeholders while mentoring technical teams. The role requires deep expertise in modern data platforms and integration, with healthcare or insurance experience preferred.
Top Skills:
DatabricksDbtFhirHipaaHl7KafkaSnowflakeX12
Information Technology • Design
Owns enterprise data architecture across warehouses, lakes, lakehouses, streaming systems, governance, modeling, and AI/ML data foundations. Sets platform strategy, architects semantic and unstructured data pipelines, establishes security and observability standards, and drives performance and reliability. Partners with clients and leadership, supports pre-sales, mentors engineers, develops reusable architecture patterns, and remains hands-on with prototypes, production code, and design reviews.
Top Skills:
AWSCi/CdClaudeCursorData LakesData MeshData VaultData WarehousesFeature StoresInfrastructure As CodeKnowledge GraphsLakehouseMedallion ArchitectureOpen Table FormatsRagStreaming SystemsVector Stores
Artificial Intelligence • Big Data • Cloud • Information Technology • Machine Learning
Designs and builds data ingestion, feature engineering, analytics, and machine learning pipelines using healthcare and other structured or unstructured data. Develops, tunes, deploys, monitors, and documents predictive models and enterprise data products. Collaborates with data scientists, engineers, product managers, and stakeholders while ensuring data quality, reliability, and production engineering standards.
Top Skills:
SparkCi/CdDockerETLGoogle Cloud Platform (Gcp)Machine LearningNoSQLPythonRelational DatabasesSQL
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
