Software Engineer - Big Data Platform

*Role: Software Engineer, Big Data Platform *
*Who We Are*
Granica is an AI information research and engineering company, with expertise derived from Stanford, Google, and Apple.
Granica's State-of-the-Art Data Foundation Platform tackles critical development challenges experienced by ML and AI practitioners building data-centric products and services. These challenges include risks from potential exposure of PII and sensitive information by models, inefficient data storage management, computational resource constraints, and limited utility from growing amounts of unstructured data.
With Granica, ML and AI teams are able to leverage a comprehensive enterprise platform that scales to exabytes, offers unparalleled performance and customer service, and accelerates development cycles for quicker time to market.
Based in Mountain View, California, Granica has raised $45 million in cumulative capital from leading institutional investors, including New Enterprise Associates and Bain Capital Ventures, in addition to prolific technology luminaries and pioneers.
Granica is actively growing its team of technical data and AI experts, seeking individuals who are inspired to challenge the status quo and can be sheer force multipliers across their respective teams and the company at large. We value and welcome unconventional backgrounds, oddballs, and misfits. We foster an ethos of inclusivity no matter what.
*Summary *
We are seeking a talented and experienced Big Data Platform Engineer to join our rapidly growing team. In this role, you will be responsible for designing, building, and maintaining highly scalable, reliable, performant, and secure big data and AI systems at Granica. Additionally, you will work with and make contributions to various open-source technologies such as Spark and Trino\u002FPresto to ensure seamless integration with Granica's data foundation platform. You will collaborate closely with our research scientists, engineers, and key stakeholders to develop big data and AI systems at exabyte scale.
_*Key Responsibilities:*_
• Design, implement, and manage scalable big data platforms using technologies such as Hadoop, Spark, Trino\u002FPresto, and other related tools.• Optimize data processing pipelines for performance and efficiency.• Collaborate with research scientists and engineers to develop big data and AI systems to empower our customers to use AI more safely, effectively and efficiently .• Ensure data security, privacy, and compliance with industry standards and regulations.• Monitor and troubleshoot system performance, resolving issues and ensuring system availability and reliability.• Develop and maintain documentation for data infrastructure, processes, and best practices.• Stay updated with the latest advancements in big data technologies and incorporate them into our platform.
_*Qualifications:*_
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.• Proven experience as a Big Data Engineer or similar role.• Strong expertise in workflow engines like Airflow, and big data technologies such as Hadoop, Spark, Trino\u002FPresto, and related ecosystems.• Proficiency in programming languages such as Python, Java, or Scala.• Experience with cloud platforms such as AWS, Google Cloud.• Familiarity with data warehousing solutions and SQL\u002FNoSQL databases.• Excellent problem-solving skills and the ability to work in a fast-paced environment.• Strong communication and collaboration skills.
_*Preferred Qualifications:*_
• Experience with data streaming technologies such as Kafka or Flink.• Knowledge of data governance and data quality best practices.• Familiarity with Golang, C++\u002FC a plus.• Familiarity with containerization technologies like Docker and orchestration tools like Kubernetes.
*What We Offer:*
• Competitive salary and benefits package.• Opportunity to work with cutting-edge technologies and innovative projects.• Collaborative and inclusive work environment.• Professional development and growth opportunities.
*Pay And Benefits *
The base salary for this role is between $120,000 to $220,000. For sales positions at Granica, the salary range mentioned encompasses the On Target Earnings ("OTE") range specific to each role. This means that the range covers both the target for sales commissions or bonuses, as well as the annual base salary for the role. It is important to note that this salary range applies to various career levels within Granica and will be further refined during the interview phase, taking into account factors such as the candidate's experience, qualifications, and location. In addition to base salary, this role will receive a highly competitive equity compensation package.
_*Our company-sponsored benefits include the following: *_
• Generous 401(k) plan with matching to secure and plan for your financial future • Comprehensive premium health, dental, and vision insurance for you and your dependents • Early exercise provisions of equity options to participate in the company's growth • Unlimited PTO to recharge and rejuvenate • Healthy lunch and dinner options catered daily at our offices• Immigration sponsorship and counseling • Regular team-sponsored events and offsites, including hackathons, that help build strong relationships with your colleagues • And many more!