Lead end-to-end AI/ML, data, and ETL architecture for regulated insurance platforms. Design lakehouse and Medallion architectures, feature stores, MLOps and GenAI/RAG solutions, scalable batch and streaming pipelines, canonical and dimensional data models, governance controls, security, lineage, and compliance frameworks. Guide technology selection, performance and cost optimization, engineering standards, and architecture reviews with senior client stakeholders.
DATAECONOMY is one of the fastest-growing Data & Analytics company with global presence. We are well-differentiated and are known for our Thought leadership, out-of-the-box products, cutting-edge solutions, accelerators, innovative use cases, and cost-effective service offerings.
We offer products and solutions in Cloud, Data Engineering, Data Governance, AI/ML, DevOps and Blockchain to large corporates across the globe. Strategic Partners with AWS, Collibra, cloudera, neo4j, DataRobot, Global IDs, tableau, MuleSoft and Talend.
AI/ML Data & ETL Data Architect
Charlotte, NC
Full-time
Key Responsibilities
- Architect feature stores, training/inference pipelines, and MLOps workflows for insurance use cases fraud detection, claims triage, underwriting risk scoring, loss reserving, and customer churn/retention.
- Design RAG and GenAI solution patterns for claims summarization, policy/document intelligence, and underwriter/agent copilots.
- Establish model lifecycle controls: versioning, lineage, drift monitoring, evaluation, and human-in-the-loop review.
- Define responsible-AI and governance guardrails appropriate to a regulated insurance environment (auditability, explainability, bias monitoring).
- Own the end-to-end target-state architecture for the insurance data platform policy administration, claims, billing, underwriting, actuarial, and reinsurance domains across raw, curated, and analytics-ready layers.
- Design lakehouse and AI/ML reference architectures (Bronze/Silver/Gold Medallion) that unify structured, semi-structured, and streaming insurance data.
- Define data domain boundaries, source-to-target mappings, and canonical insurance data models for shared enterprise consumption.
- Produce architecture diagrams, design decision records, and patterns that engineering teams can implement consistently.
- Make build-vs-buy, cloud service selection, and cost/performance trade-off decisions and defend them to client architecture review boards.
- Design scalable, production-grade ETL/ELT frameworks (PySpark, Spark SQL, Delta Live Tables / equivalent, orchestrated Workflows).
- Define ingestion patterns for batch, micro-batch, and streaming insurance feeds (policy, claims, payments, third-party/bureau data).
- Establish orchestration, monitoring, alerting, and automation standards for the engineering team.
- Design dimensional models (star/snowflake) and canonical/conformed models for analytical and actuarial workloads.
- Apply normalization/denormalization strategies balancing performance, usability, and regulatory traceability.
- Ensure data quality, integrity, and alignment with enterprise and insurance regulatory governance policies.
- Embed PII/PHI handling, masking, tokenization, and least-privilege access models into platform design.
- Align architecture with insurance regulatory and audit requirements (e.g., NAIC model standards, state DOI, HIPAA where health lines apply, SOC 2, GDPR/CCPA).
- Define metadata management, data lineage, and cataloging strategy (Unity Catalog or equivalent).
- Advanced hands-on data engineering: Spark, Delta Lake / lakehouse, Workflows, Unity Catalog (or cloud-native equivalents).
- AI/ML tooling: MLflow or equivalent, feature stores, model serving, and GenAI/RAG frameworks (LangChain/LangGraph or similar).
- Strong SQL and Python programming with performance tuning skills.
- Cloud platform depth (AWS / Azure / GCP), including managed data and ML services.
- Hands-on AI/ML pipeline and MLOps experience, including at least one production GenAI/RAG deployment.
- Strong command of Medallion architecture (Bronze/Silver/Gold) and modern data modeling for warehousing and analytics.
- Proficiency with PySpark, SQL, ETL/ELT frameworks, and Delta Lake (or equivalent) optimization.
- Experience with CI/CD, Git, and job orchestration tooling.
- Insurance, financial services, or other regulated-industry delivery experience.
- Demonstrated ability to present and defend architecture to senior client and review-board stakeholders.
- Data governance, metadata management, and Unity Catalog (or equivalent) advanced features.
- Streaming technologies (Auto-Loader / Structured Streaming / Kafka / Event Hubs / Kinesis).
- Data security, regulatory compliance, and fine-grained access models.
- Cost optimization and performance tuning in cloud environments.
- Responsible-AI / model governance frameworks (e.g., NIST AI RMF).
- Tools such as Airflow, Databricks Workflows, dbt, or similar.
Requirements
- Data architecture leadership lakehouse / Medallion (Bronze/Silver/Gold) target-state design
- Strong Python (PySpark) and SQL programming with performance tuning
- Databricks (or equivalent) Spark, Delta Lake, Workflows, Unity Catalog
- ETL/ELT framework design and data modeling (dimensional, star/snowflake, canonical)
- AI/ML pipelines + MLOps, plus at least one production GenAI/RAG deployment
- Cloud experience AWS, Azure, or GCP (managed data + ML services)
- CI/CD, Git, job orchestration
- 12+ years total; 3+ years as architect/lead; regulated-industry delivery
Benefits
Standard full-time benefits
Similar Jobs
Information Technology • Internet of Things • Mobile • On-Demand • Software
Supervise a 24x7 Community Solutions Response Center team supporting managed Wi-Fi network surveillance and customers. Responsibilities include coaching staff, managing workflows, improving monitoring and ticketing processes, analyzing communication and outage metrics, coordinating issue resolution, supporting system enhancements, hiring and training employees, and maintaining operational procedures. The role is office-based and includes after-hours on-call responsibilities.
Top Skills:
Converged NetworksFiber Optic NetworksHfc NetworksInstant MessagingMicrosoft Office SuiteNetwork Monitoring ToolsRemedyTicketing ToolsWebexWifiWireless Access PointsWireless Routers
Information Technology • Internet of Things • Mobile • On-Demand • Software
Deliver and automate software deployments, monitor and troubleshoot production systems, develop deployment scripts and monitoring strategies, provide production support and incident management, and collaborate across development, testing, and infrastructure teams.
Top Skills:
.NetAppdynamicsArgocdAWSBashContainer TechnologiesDatadogGitlabGrafanaJenkinsKubernetesLinuxMssqlOraclePrtgSQLUnix
Information Technology • Internet of Things • Mobile • On-Demand • Software
Support and improve third-party billing systems by analyzing performance, documenting requirements and procedures, handling mass adjustments, reporting, interfaces and outages, training users, assisting backlog processing, and contributing to project scheduling and status reporting.
Top Skills:
Microsoft AccessExcelMicrosoft PowerpointMicrosoft ProjectMicrosoft Word
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
