Smarsh Logo

Smarsh

Data Engineer

Posted 17 Days Ago
Remote
Hiring Remotely in US
160K-180K Annually
Senior level
Remote
Hiring Remotely in US
160K-180K Annually
Senior level
Design and lead scalable, secure, highly available database infrastructure for multi-terabyte SQL Server environments. Set technical direction for data architecture, performance, real-time pipelines, security, and growth. Troubleshoot complex production issues, optimize queries and indexes, guide cross-functional projects, mentor engineers, review changes, reduce technical debt, and evaluate emerging technologies. Monitor database health using Splunk, Datadog, and Grafana while influencing engineering and Site Reliability strategy.
The summary above was generated by AI

As a Database Engineer on the Professional Archive team, you'll operate as a subject-matter expert for the data infrastructure that powers our platform – driving the architecture, scaling, and reliability decisions that keep high-velocity, compliance-critical systems performant and secure. You'll work with SQL Server environments spanning multi-terabyte data volumes, tables with billions of rows, and sustained throughput exceeding 100,000 transactions per second.

You'll work independently through ambiguous and unfamiliar problems, set technical direction for real-time data pipelines and system performance, and act as a go-to resource for engineers across the wider organization. Your work will directly shape how Smarsh clients meet their compliance needs through scalable, dependable data and search capabilities.

You'll partner with leaders across Product Management, Engineering, and Site Reliability, weighing a range of inputs to resolve complex challenges and influence strategy beyond your immediate team. We're looking for someone who brings deep technical judgment, mentors others, and is motivated to make an impact through thoughtful, high-leverage engineering.

How will you contribute?

  • Serve as a subject-matter expert for database architecture and performance, guiding engineers through complex or ambiguous technical problems where established principles don't fully apply
  • Set the technical approach for scalable data solutions, partnering with stakeholders across Product, Engineering, and Site Reliability to shape direction rather than simply implement it
  • Drive larger, cross-functional projects from design through delivery, proactively identifying and addressing upstream and downstream impacts before they become issues
  • Informally mentor other engineers, modeling sound engineering discipline and raising the technical bar for the wider team
  • Shape how the team adopts modern engineering practices, including Agile methodologies, CI/CD pipelines, and DevOps principles
  • Review code and database changes with an eye for systemic risk and performance, while also leading efforts to pay down technical debt across systems
  • Track emerging technologies and make the call on which are worth adopting, guiding the team's direction
  • Interpret database health and performance data (Splunk, Datadog, Grafana) to proactively flag and address risk before it surfaces as an incident

What will you bring?

    We're looking for a recognized subject-matter expert who operates independently, drives clarity through ambiguity, and raises the bar for those around them.

  • Advanced, wide-ranging experience with database systems, with the judgment to operate independently in unfamiliar or ambiguous situations
  • Deep expertise designing logical and physical data models, including schema design and data relationships, at a level others rely on for direction
  • A demonstrated ability to set database performance strategy by tuning queries and indexes and establishing standards that others follow
  • Strong command of data security practices (encryption, access controls, auditing), with the ability to shape how the team approaches them
  • A track record of independently troubleshooting complex issues in systems that require high availability, serving as an escalation point for others
  • Ability to plan for data growth and scale infrastructure with the full flow of work in mind, not just the immediate ask
  • The credibility and collaborative instinct to influence peers and cross-functional partners, not just execute their requests
  • Strong command of modern development practices and Agile methodologies, with a voice in how the team applies them
  • Ability to communicate technical direction, trade-offs, and risk clearly to stakeholders outside your immediate team
  • Comfort setting a course through evolving, ambiguous requirements rather than waiting for them to be resolved
  • A proactive approach to identifying and solving problems that cross team boundaries

Preferred Qualifications

  • If you don't meet every qualification listed below, we still encourage you to apply. We value diverse experiences and perspectives. Progression to this level reflects demonstrated ability to perform as a subject-matter expert, not years of experience alone.

  • 7+ years of hands-on experience with Microsoft SQL Server in a production environment, with demonstrated impact as a subject-matter expert
  • Deep expertise in schema and data model design, including normalization, partitioning, and indexing strategy for both OLTP workloads
  • Advanced proficiency in performance tuning, including T-SQL and stored procedure optimization, execution plan analysis, and query tuning at scale
  • Proven, hands-on experience managing and troubleshooting SQL Server databases at terabyte scale, including tables with billions of rows, and sustained throughput exceeding 100k transactions per second
  • Demonstrated ability to diagnose and resolve production capacity and contention issues at this scale, including lock/latch contention, TempDB performance, and transaction management
  • Experience designing for horizontal as well as vertical scalability, anticipating data growth before it becomes a production risk
  • Familiarity with NoSQL technologies (e.g., MongoDB, Cassandra, DynamoDB) is a plus
  • Experience with cloud database platforms (e.g., AWS RDS/Aurora, MongoDB Atlas) is a plus

What do we offer?

  • Healthcare insurance: We provide medical, dental, and vision insurance, and a flexible spending account that allows you to set aside pre-tax dollars to pay for eligible out-of-pocket expenses.
  • Stock options.
  • Personal time off: A healthy work-life balance is critical to your success at the office. Smarsh offers a “take-what-you-need” time off policy as well as flexible work arrangements.
  • 401K Match: Smarsh provides a 4% 401K match for which employees are fully vested on day one.
  • Sabbatical: The Smarsh sabbatical programme provides a time to recharge, study or simply do something you are passionate about away from the workplace. Employees are eligible after six years of service.
  • Recognition: We’re big on kudos for a job well done. Our employee-recognition programme enables co-workers to nominate their peers who best embody our core values for recognition.

Don't meet every requirement? Apply anyway! We value diverse candidates and encourage applications, even if you don't perfectly match the job description. Studies have shown that some strong candidates may self-select out of the interview process prematurely, at Smarsh we encourage an inclusive, high-performing environment.
 
Smarsh is an equal opportunity and affirmative action employer. Qualified applicants will receive consideration without regard to their race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. Smarsh invites all qualified interested applicants to apply for career opportunities. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions. Including frequency of functions

Similar Jobs

2 Days Ago
In-Office or Remote
113K-193K Annually
Expert/Leader
113K-193K Annually
Expert/Leader
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Leads the architecture, development, modernization, and governance of enterprise-scale Azure data platforms. Builds data pipelines, warehouses, lakes, and analytics solutions using Azure services and Snowflake; automates deployments with Terraform; drives cloud migrations; develops AI-enabled engineering tools; and provides technical leadership, mentorship, security, reliability, and cost optimization guidance.
Top Skills: Ai Orchestration FrameworksAzure Data FactoryAzure Data Lake StorageAzure FunctionsAzure OpenaiAzure SqlCi/CdDatabricksDevOpsInfrastructure As CodeLarge Language ModelsMachine Learning WorkflowsAzurePythonRetrieval Augmented GenerationSnowflakeSparkSQLTerraformVector Databases
8 Days Ago
Remote or Hybrid
OH, USA
Senior level
Senior level
Financial Services
Build and operate scalable Databricks-on-AWS data pipelines using PySpark, Delta Lake, and lakehouse patterns. Optimize performance, implement data quality, monitoring, alerting, and automated remediation, and deliver curated datasets for BI and analytics partners. Collaborate with stakeholders on architecture and design while applying secure software engineering, CI/CD, agile, and operational stability practices. The role also uses AI-assisted development tools and supports workforce data analytics.
Top Skills: AlteryxAmazon AthenaAmazon EmrAmazon S3Apache AirflowApache IcebergSparkAutosysAWSAws CloudwatchAws GlueAws LambdaBitbucketClaudeDatabricksDatabricks WorkflowsDelta LakeDelta Live TablesGitGithub CopilotJavaJenkinsOracleParquetPysparkPythonScalaSigmaSpinnakerSQLTableau
9 Days Ago
Remote or Hybrid
USA
140K-215K Annually
Senior level
140K-215K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.
Top Skills: Apache AirflowApache SupersetAWSAzureCi/CdData ModelingDbtDockerGCPIamKubernetesMachine Learning PipelinesOciOpenmetadataPythonSQLTerraform

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account