Design and optimize SQL Server solutions, manage data, automate processes with PowerShell, and integrate with external systems to enhance functionality.
Cheesy joke to get you to smile:
Two SQL transactions ask a minister to marry them, but the minister replies, "Only if you're willing to commit."
Summary:
We are seeking a hands-on Data Engineer who is skilled in building complex systems beyond just writing queries. This role focuses on SQL Server in both Linux and Windows environments and requires versatility across various tools, including PowerShell, APIs, Python, and emerging AI/LLM technologies. If you enjoy stretching your expertise beyond SQL and want to contribute to innovative solutions, this position is for you. The role is for one of our North American clients with proprietary software for the insurance industry.
Responsibilities:
- Design, build, and optimize complex SQL Server solutions, emphasizing performance tuning, indexing, and data modeling.
- Manage relational and semi-structured data, including JSON stored in SQL Server and multi-dimensional datasets.
- Query and transform JSON using native SQL Server tools, such as OPENJSON and JSON_VALUE.
- Use PowerShell, SQL Server tools, and scripting to automate processes.
- Enhance functionalities by integrating with APIs and external systems.
- Address problems comprehensively, focusing on end-to-end solutions beyond the database layer.
- Operate within a complex, multi-system application environment, avoiding isolated reporting or analytics tasks.
- Explore and implement LLM-driven workflows, including prompting and structured outputs.
- Continuously enhance efficiency by replacing manual processes with automation.
Required Skills:
- Proficient in SQL Server, including query performance, indexing, and data modeling.
- Experience handling JSON in SQL Server and managing hybrid data models.
- Experience with PowerShell or similar scripting languages for automation purposes.
- Ability to work across multiple systems, including databases, APIs, and services.
- Proven ability to deliver effective solutions in a timely manner.
Preferred Skills:
- Background in smaller teams with end-to-end system ownership.
- Experience in complex application environments rather than isolated reporting or analytics settings.
- Capability to navigate and solve problems without detailed requirements.
- Experience in insurance, financial services, or other regulated, transaction-heavy domains.
- Python experience and familiarity with APIs and integrations.
- Exposure to LLMs like OpenAI and Claude.
- Experience developing internal tools or automation frameworks.
- Experience with cloud or hybrid infrastructure.
This is a fully remote position, offering the flexibility to work from anywhere. If you are ready to take ownership and thrive in a fast-paced, adaptive environment, we encourage you to apply!
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, build, and optimize scalable ETL/data pipelines (SQL Server, Snowflake, Databricks) for large healthcare datasets. Support production cycles, monitor and resolve issues, perform root cause analysis, ensure data quality, conduct code reviews, estimate work, and partner with stakeholders to deliver reliable data solutions.
Top Skills:
.NetAzureDatabricksOraclePythonSnowflakeSQLSQL ServerSsisTeradata
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.
Top Skills:
AirflowAWSAzureDagsterData LakeDatabricksDelta LakeETLGCPGitGitPrefectPysparkPythonRest ApisSparksqlSQL
Fintech • HR Tech
Build and deliver end-to-end, production-grade data solutions: design and maintain scalable ETL pipelines, ingest from diverse sources, implement dbt transformations, ensure data quality and observability, optimize performance and cost, and partner with analytics, product, and engineering teams to drive business impact.
Top Skills:
AIAlertingAPIsAutomated TestingAutomationBigQueryCi/CdData ObservabilityDatabricksDbtETLEvent StreamsJavaMonitoringPythonRedshiftScalaSnowflakeSQL
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
