The Data Platform Lead will manage the architecture, optimization, and security of data platforms, oversee critical projects, and improve processes for data availability and performance.
About Omnidian
Omnidian, Inc. is a fast-growing Series C tech-enabled service company revolutionizing performance assurance for the distributed solar and energy storage industries. Omnidian is building a more sustainable future for the planet through our passionate teams, our innovative technology, and by creating an amazing customer experience. We are headquartered in Seattle, WA
The Job
We are looking for an experienced Data Platform Lead to own the availability, reliability, recoverability, security and performance of our data platforms. You will be responsible to architect, implement, manage and optimize robust data platforms. You will be responsible for cost transparency, containment and forecasting. You will own, enhance and update Data Platform processes and standards, understand company needs, and own and execute critical projects on our Data Platform roadmap.
Our IoT timeseries data is a critical component of our service. You will be responsible to understand the business and technical requirements for this data and to own the data platform architecture solutions, working closely with our Data Acquisition team for a cohesive architecture.
This role sits within our Engineering department and will report directly to our Director of Data Management and Information Security. Preference to where some of this team is located in Pittsburgh, Seattle, Upstate NY, Denver area.
What You'll Do
- At Omnidian we believe in trust and autonomy. How you create an impact is ultimately up to you. Here is an outline of some of the things you’ll be doing:
- Participate in change management process; implement database changes
- Ensure data structures are available, reliable, recoverable, secure and performant
- Establish appropriate monitoring and alerting mechanisms for data platforms, including runbooks
- Establish a transparent intake process for data platform administration requests; complete requests
- Proactively identify improvements in database code or structure to improve performance and/or mitigate costs; make improvements as needed and/or work with stakeholders to prioritize and track the work
- Create and maintain dashboards and alerts to track and forecast data platform costs
- Own successful outcome and positive impact for critical large scale data platform projects including project management and communication
- Mitigate risks and clear blockers
- Collaborate cross functionally to drive initiatives
- Contribute hands-on to the work as needed
- Establish, communicate and maintain a rolling 5 Quarter roadmap for Data Platform
- Drive stakeholder alignment on roadmap and prioritization
- Ensure scalable and cost effective architecture
- Establish and continuously improve Data Platform architecture, processes and standards
- Provide mentoring, coaching and education on Data Platform best practices and standards to stakeholders
- Work with partner teams to establish SLAs for data platform administration requests and system availability; report against SLAs to stakeholders
Hands on Data Platform Administration (33%)
Own and Lead Critical Data Platform Projects (33%)
Own the Data Platform Roadmap and Strategy (33%)
Who You Are
- Data Architecture Experience: You are comfortable with data architecture and patterns for both structured and unstructured data. You have experience owning and maintaining distributed big data platforms such as Databricks or Hadoop as well as relational databases such as MySQL.
- Data Engineering Expertise: You have a strong working knowledge of Data Engineering processes and standards.
- Leadership Abilities: You possess strong leadership skills, with the ability to provide mentoring cross-functionally.
- Communication: You have excellent verbal and written communication skills, with the ability to effectively communicate technical concepts to both technical and non-technical stakeholders.
- Value Creation: You understand business needs, users, technology, and data, and collaborate with stakeholders to design and deliver data solutions that provide business value.
- Problem-Solving: You demonstrate strong analytical and problem-solving abilities, with a proactive approach to identifying issues and implementing effective solutions.
Experience You’ll Need
- 5+ years experience as a Data Platform Engineer/DBA
- 2+ years in a technical leadership role
- Experience successfully managing large scale data platform projects
- Proficiency with distributed systems like Spark, Kafka and data lakes
- Strong experience with relational databases like SQL Server or MySQL
- Experience with cloud platforms like AWS or Azure
- Understanding of data modeling principles
- Deep understanding of data platform availability, recoverability, security and performance best practices
- Experience implementing and maintaining cost forecasting and containment processes and structures
- Experience implementing data platform monitoring and alerting
- Proficient with SQL
Experience That's a Plus
- Solar Industry experience
- Experience with Databricks
- Experience with RDS
- Experience with IoT Timeseries data
- Experience with Timeseries types of data platforms
- IaC (Infrastructure as Code) experience
Work-life and Culture
- Most of our roles offer the opportunity to work remotely
- If you are in the Seattle area, we offer a vibrant office space in the historic and beautiful Smith Tower, in the heart of Pioneer Square
- We prioritize applicants near one of our employee clusters and offer one or more local gatherings per year
- We provide outstanding benefits including family medical, dental, vision, disability, 401(k) administration and $1k match per year and thoughtful paid time off
- We offer 12 weeks of paid parental leave to all FTE employees (birthing and non-birthing) after 1 year, and four-week paid sabbatical leave after four years
- We offer a competitive total compensation package that includes monthly health insurance premiums, bonuses and long-term stock options for every employee
- We love to lift each other up through company-wide slack channels such as #puppiesandpets, #omnidian-wellness, #praiseandbooms and #sustainablefuture
- We have affinity groups to help employees feel seen and supported, such as Rainbow Array, BIPOC, Thriving Survivors, Vets at Omnidian, Black Lights Matter and Neurospicy R Us
- We are a passionate, mission driven team that believes in collaboration, mutual respect and trust. For examples, come Discover our Story!
Grow With Us
- We mentor and invest in our employees and prioritize them for future opportunities. Check out our Instagram reels to see a few career journey examples
- Internal candidates: Check out our advice on Internal Transfer: Job Application Process
- Here are the next roles in this career track:
- Senior Data Engineering Manager
- Director of Data Management OR
- Director of Software Engineering
- We’re a fast-growing startup, which means we’re constantly reinventing processes, adding new products, and asking people to use all of their skills and talents. That means there’s gonna be a lot of opportunities for you to grow, which also means you will likely be stretched in ways you’ve never experienced in a job before. If you are resilient, determined, and not afraid of a big challenge, come apply.
#LLI-REMOTE
Privacy
California-based candidates: To understand more about the data we collect and process as part of your application, please view our California Job Candidate Privacy Policy. https://www.omnidian.com/privacy-policy-ca-candidates/
Diversity and Inclusion
We strongly believe that diversity of experience, perspectives, and background will lead to a better environment for our employees and a better product for our customers. We are committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. We value diversity and inclusion and are committed to ensuring our hiring and retention practices, as well as our office culture, reflects this value.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
Omnidian is an equal opportunity employer. We are committed to diversity in the workplace. We make employment decisions on the basis of merit and business need. We hire without consideration to age, ancestry, citizenship, disability, gender expression, gender identity, marital status, national origin, political activity or affiliation, race, religion, sexual orientation, veteran status, or any other basis protected by law.
We invite you to be part of our mission to create a workplace that is inclusive and welcoming to all.
Top Skills
AWS
Azure
Databricks
Hadoop
Infrastructure As Code
Kafka
MySQL
Spark
SQL Server
Similar Jobs
Energy
Lead Salesforce architecture and development, drive platform strategy, manage cross-functional relationships, mentor junior staff, ensure compliance and optimize performance.
Top Skills:
ApexAPIsErpsFlowLightningLinksquaresPardotSalesforceZoominfo
Artificial Intelligence • Automotive • Machine Learning • Transportation
Lead a team to design, build, and maintain scalable data processing pipelines for autonomous vehicle logs. Mentor engineers and ensure project alignment with goals.
Top Skills:
AWSETLPython
Artificial Intelligence • Big Data • Cloud • Energy
The Data Platform Lead is tasked with architecting and managing robust data platforms, ensuring scalability, data quality, team leadership, and driving data product development.
Top Skills:
Apache AirflowApache HadoopSparkAWSAzureAzure Synapse AnalyticsDatabricksGCPInformaticaNoSQLPythonScalaSnowflakeSQLTalend
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus