Wizard AI Logo

Wizard AI

Staff Data Engineer (PySpark)

Reposted 13 Days Ago
Easy Apply
Remote
Hiring Remotely in USA
208K-235K Annually
Senior level
Easy Apply
Remote
Hiring Remotely in USA
208K-235K Annually
Senior level
Seeking a Staff Data Engineer to architect scalable data systems, mentor engineers, and enable analytics for AI initiatives using PySpark.
The summary above was generated by AI
About Us

Wizard is the top-performing AI Shopping Agent, delivering the best products from across the web with unmatched accuracy, quality, and trust. 

The Role

We are seeking a Staff Data Engineer with deep expertise in PySpark to join our data team. This is a hands-on technical role for someone passionate about building scalable data systems, mentoring engineers and shaping data strategy.  You’ll architect systems that power high performance batch and real time data processing, enable advanced analytics and accelerate our AI initiatives.

Key Responsibilities
  • Design and evolve scalable, distributed data infrastructure across cloud platforms
  • Build and maintain real time and batch data processing pipelines supporting analytics and AI/ML workloads
  • Develop and manage integrations with third party e-commerce platforms to expand our data ecosystem
  • Ensure data availability, reliability and quality through monitoring and automated auditing
  • Partner with engineering, AI and product teams on data solutions for business critical needs
  • Mentor and support data engineers, establishing best practices and code quality standards 
You
  • 5+ years of software development and data engineering experience with demonstrated ownership of production grade data infrastructure
  • Bachelor's degree in Computer Science or a related field, or equivalent practical experience.
  • Deep expertise scaling Spark in production (Databricks, EMR, etc)
  • Strong understanding of distributed computing and modern data modeling for scalable systems
  • Proficient in Python with experience implementing software engineering best practices
  • Hands-on experience with both relational (MySQL / PostgreSQL) and NoSQL (MongoDB, DynamoDB, Cassandra) databases
  • Strong communicator with experience influencing cross functional stakeholders
Nice to Have
  • Experience working in early-stage, high-growth environments
  • Familiarity with MLOps pipelines and integrating ML models into data workflows.
  • Passionate about problem-solving with a proactive approach to finding innovative solutions.
Compensation & Benefits

The expected base salary range for this role is $180,00- $225,000 USD, and will vary based on skills, experience, role level, and geographic location. Final compensation will be determined by considering these factors alongside overall role scope and responsibilities.

In addition to base salary, Wizard offers:

  • Equity in the form of stock options
  • Medical, dental, and vision coverage
  • 401(k) plan
  • Flexible PTO and company holidays
  • Fully remote work within the United States
  • Periodic company-wide offsites and team gatherings

Wizard is committed to fair, transparent, and competitive compensation practices.

Top Skills

Cassandra
Databricks
DynamoDB
Emr
MongoDB
MySQL
Postgres
Pyspark
Python
Spark

Similar Jobs

8 Minutes Ago
Remote or Hybrid
ND, USA
42K-124K Annually
Senior level
42K-124K Annually
Senior level
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
The Fixed Operations Performance Manager drives value for automotive dealers by optimizing operations, enhancing product utilization, and serving as a trusted advisor to clients.
Top Skills: DealertrackDmsF&IMS OfficeSalesforceXtime
8 Minutes Ago
Remote or Hybrid
Minnesota, USA
42K-124K Annually
Senior level
42K-124K Annually
Senior level
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
The Fixed Operations Performance Manager drives performance and value across Cox Automotive's Dealer Solutions for automotive dealers, leveraging hands-on retail experience to optimize dealership operations and product utilization. This role focuses on enhancing efficiency and profitability through strategic partnerships and consultative approaches.
Top Skills: DealertrackMS OfficeSalesforceXtime
9 Minutes Ago
Remote or Hybrid
Tennessee, USA
50K-134K Annually
Mid level
50K-134K Annually
Mid level
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
The Portfolio Manager oversees a dealer client portfolio, driving growth through relationship management, risk mitigation, and compliance, while achieving performance goals.
Top Skills: ExcelOutlookPowerPointSalesforceTeamsWord

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account