Senior RAG Engineer

At Wipfli, people count.
At Wipfli, our people are core to everything we do-the catalyst behind our ability to create exceptional impact and extraordinary results.
We believe in flexibility. We focus on relationships. We encourage each individual to follow their own path.
People truly matter and they feel it. For those looking to make a difference and find a professional home, Wipfli offers a career-defining opportunity.
Job Summary
Wipfli is building the next generation of AI-powered solutions that transform how our professionals deliver value to clients. As a Senior RAG Engineer, you will play a pivotal role in advancing our AI-driven functional requirements documentation platform, an enterprise application used across the firm to automate the creation of complex project documentation.
This role blends software engineering, machine learning, and enterprise application development. You'll work closely with data scientists, engineers, and business teams to build production-grade retrieval and generation systems that make a measurable impact on hundreds of users.
If you're passionate about building real AI products, not demos or POCs, and you want to shape the foundation of a growing AI capability, this is your opportunity.
Responsibilities:

• Design, develop, and optimize full-stack applications using RAG for high-accuracy retrieval and generation
• Build and maintain APIs and microservices with monitoring and logging for reliability and performance
• Implement vector databases and semantic search; fine-tune retrieval for strong precision and recall
• Optimize chunking, embeddings, and retrieval parameters tailored to professional services content
• Evaluate LLM architectures and maintain prompt-engineering frameworks to improve response quality
• Build ETL pipelines and integrate with firm platforms such as document management, CRM, and engagement systems
• Ensure data quality, security, and compliance, including role-based access, encryption, audit logging, and confidentiality
• Partner across teams-engagement, data science, and ML-to deliver capabilities and mentor junior engineers
• Stay current on emerging AI/ML technologies and assess applicability to enterprise use cases

Required Qualifications:

• Bachelor's degree in Computer Science, Information Management, Data Science, or AI related field
• 3-5 years of experience in data science and AI roles
• 7-10 years of experience software development roles
• Demonstrated track record of building production-grade AI applications from conception to deployment
• Demonstrated deep understanding of RAG methodologies and practical application. Experience with frameworks such as LangChain, LlamaIndex, or Haystack is considered an additional asset
• Experience with document processing and OCR technologies, including integration and deployment within enterprise environments

Preferred Qualifications:

• Master's degree or advanced certification in Data Science or AI
• 4+ years of full stack development experience with modern frameworks (React, Vue, or Angular; Node.js, Python, or similar; .NET experience

Benjamin Dzanic, from our recruiting team, will be guiding you through this process. Visit his LinkedIn page to connect!
#LI-REMOTE #LI-BD1
Additional Details:
Wipfli is an equal opportunity/affirmative action employer. All candidates will receive consideration for employment without regards to race, creed, color, religion, national origin, sex, age, marital status, sexual orientation, gender identify, veteran status, disability, or any other characteristics protected by federal, state, or local laws.
Wipfli is committed to providing reasonable accommodations for people with disabilities. If you require a reasonable accommodation to complete an application, interview, or participate in our recruiting process, please send us an email at [email protected]
Wipfli values fair, transparent, and competitive compensation, considering each candidate's unique skills and experiences. The estimated base pay range for this role is $106,600 to $160,000, with offers typically not made at the maximum, allowing for future salary increases. The actual salary at the time of offer depends on business related factors like location, skills, experience, training/education, licensure, certifications, business needs, current associate pay, and relevant employment laws.
Individuals may be eligible for an annual discretionary bonus, subject to participation rules and based on a variety of factors including, but not limited to, individual and Firm performance.
Wipfli cares about our associates and offers a variety of benefits to support their well-being. Highlights include 8 health plan options (both HMO & PPO plans), dental and vision coverage, opportunity to enroll in HSA with potential Firm contribution and an Employee Assistance Program. Other benefits include firm-sponsored basic life and short and long-term disability coverage, a 401(k) savings plan & profit share as well as Firm matching contribution, well-being incentive, education & certification assistance, flexible time off, family care leave, parental leave, family formation benefits, cell phone reimbursement, and travel rewards. Voluntary benefit offerings include critical illness & accident insurance, hospital indemnity insurance, legal, long-term care, pet insurance, ID theft protection, and supplemental life/AD&D. Eligibility for all benefits programs is dependent on annual hours expectation, position status/level and location.
"Wipfli" is the brand name under which Wipfli LLP and Wipfli Advisory LLC and its respective subsidiary entities provide professional services. Wipfli LLP and Wipfli Advisory LLC (and its respective subsidiary entities) practice in an alternative practice structure in accordance with the AICPA Code of Professional Conduct and applicable law, regulations, and professional standards. Wipfli LLP is a licensed independent CPA firm that provides attest services to its clients, and Wipfli Advisory LLC provides tax and business consulting services to its clients. Wipfli Advisory LLC and its subsidiary entities are not licensed CPA firms.