Senior Application Architect-Databrick

At HCSC, our employees are the cornerstone of our business and the foundation to our success. We empower employees with curated development plans that foster growth and promote rewarding, fulfilling careers.

Join HCSC and be part of a purpose-driven company that will invest in your professional development.

Job Summary

We are seeking a skilled Databricks Architect to design, implement, optimize, and support data platforms built on Databricks. This role focuses on managing large-scale data processing systems, ensuring performance, reliability, and scalability of data pipelines, and enabling advanced analytics and machine learning workloads.
________________________________________
Key Responsibilities
• Configure and manage Databricks workspaces, clusters, and jobs
• Optimize data workflows for performance, cost, and scalability
• Integrate Databricks with cloud platforms (Azure, AWS) and external data sources
• Monitor system performance and troubleshoot issues in production environments
• Implement data security, governance, and access controls
• Collaborate with data engineers, data scientists, and business stakeholders
• Support CI/CD pipelines for data and analytics solutions
• Maintain documentation for architecture, processes, and workflows
• Stay up to date with new Databricks features and best practices
________________________________________
Required Qualifications
• Bachelor’s degree in Computer Science, Information Systems, or related field (or equivalent experience)
• 3+ years of experience in data engineering or big data platforms
• Hands-on experience with Databricks and Apache Spark
• Strong programming skills in Python, SQL, and/or Scala
• Experience with cloud platforms (Azure preferred, but AWS or GCP acceptable)
• Understanding of data warehousing concepts and ETL/ELT processes
• Experience with distributed computing and large-scale data processing
• Familiarity with version control systems (e.g., Git)
________________________________________
Preferred Qualifications
• Databricks certifications (e.g., Databricks Certified Associate/Professional)
• Experience with Delta Lake and Lakehouse architecture
• Knowledge of data orchestration tools (e.g., Airflow, Azure Data Factory)
• Experience with machine learning workflows on Databricks
• Familiarity with infrastructure-as-code tools (e.g., Terraform)
________________________________________
Key Skills
• Data pipeline development and optimization
• Performance tuning and troubleshooting
• Cloud architecture and integration
• Data governance and security
• Analytical thinking and problem-solving
• Strong communication and collaboration skills
________________________________________
Success Metrics
• Reliability and uptime of data systems
• Performance improvements in data pipelines
• Cost optimization of Databricks workloads
• Timely resolution of system issues
• Stakeholder satisfaction with data delivery

Required Job Qualifications: 

• Bachelor degree and 5 years Information Technology experience OR Technical Certification and/or College Courses and 7 year Information Technology experience OR 9 years Information Technology experience.
• 3+ years of experience in data engineering or big data platforms
• Hands-on experience with Databricks and Apache Spark
• Strong programming skills in Python, SQL, and/or Scala
• Experience with cloud platforms (Azure preferred, but AWS or GCP acceptable)
• Understanding of data warehousing concepts and ETL/ELT processes
• Experience with distributed computing and large-scale data processing
• Familiarity with version control systems (e.g., Git)
• Problem solving / analytical thinking.
• Teamwork and collaboration.

Preferred Job Qualifications:

• Bachelor degree in Computer Science or Information Technology
• Product-specific application architecture.
• Ability to tie together solutions across systems.

Are you being referred to one of our roles? If so, ask your connection at HCSC about our Employee Referral process!

Pay Transparency Statement:

At Health Care Service Corporation, you will be part of an organization committed to offering meaningful benefits to our employees to support their life outside of work. From health and wellness benefits, 401(k) savings plan, pension plan, paid time off, paid parental leave, disability insurance, supplemental life insurance, employee assistance program, paid holidays, tuition reimbursement, plus other incentives, we offer a robust total rewards package for employees.  Learn more about our benefit offerings by visiting https://careers.hcsc.com/totalrewards.

The compensation offered will vary depending on your job-related skills, education, knowledge, and experience. This role aligns with an annual incentive bonus plan subject to the terms and the conditions of the plan.

HCSC Employment Statement:

We are an Equal Opportunity Employment employer dedicated to providing a welcoming environment where the unique differences of our employees are respected and valued. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other legally protected characteristics.

Base Pay Range$112,200.00 - $202,600.00

Exact compensation may vary based on skills, experience, and location.