The Principal AI Platform Engineer will design and maintain the infrastructure for AI systems, ensuring integration, security, and scalability for GenAI products.
The Team
This team will serve as the product owner for GenAI capabilities within PointClickCare, working closely with other engineering teams across the organization to identify, build and support generative AI solutions. This centralized team with deep specialization, closely integrated with key horizontal partners to ensure delivery of safe, scalable and high-impact AI Products
Job summary
The Principal AI Platform Engineer will focus on building the infrastructure that connects AI systems with existing products and will enable seamless delivery of AI-generated insights into agent workflows.
Key responsibilities.
- Design, build, and maintain the core infrastructure layer supporting GenAI products, including model gateways, prompt/versioning stores, vector databases, and LLM evaluation tools.
- Implement secure access controls and authentication mechanisms integrated by default into the AI platform components.
- Develop and manage observability, monitoring, and logging solutions for GenAI workloads and infrastructure.
- Collaborate closely with product and engineering teams to integrate GenAI infrastructure with agent frameworks, and downstream applications.
- Optimize infrastructure for scalability, high availability, cost efficiency for production workloads.
Qualifications & Skills
- Extensive experience building and maintain AI platform infrastructure, Kubernetes, and container security.
- Demonstrated expertise in observability, and monitoring frameworks, with a focus on real-time performance (i.e: experience with OpenTelemetry, MLFlow).
- Experience with AI infrastructure components such as vector databases, prompt/versioning stores, and AI IDEs.
Preferred experience
- Familiarity with vLLM, SGLang or similar framework to host LLM inference workloads.
- Experience with CI/CD pipelines and automation for AI model deployment and platform operations
- Strong knowledge of authentication and authorization frameworks integrated into AI platforms.
#LI-AV1
#LI-remote
Top Skills
Ai Ides
Ci/Cd
Container Security
Kubernetes
Mlflow
Opentelemetry
Vector Databases
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The role involves leading security architecture and development for AI Platform, focusing on cryptography, key management, and machine identity. Collaboration across teams is essential to deliver secure solutions.
Top Skills:
AjaxCSSEjbcaHsm TechnologiesHTMLJavaJavaScriptJSONRestThales CiphertrustmanagerXML
Biotech
The Principal AI Software Engineer leads the design and implementation of Natera's Enterprise AI Platform, focusing on low-code solutions, workflow orchestration, and AI capabilities. Responsibilities include architecture design, integration with enterprise systems, and ensuring compliance with governance and security protocols, as well as mentoring engineers.
Top Skills:
DockerKubernetesPythonTypescript
Biotech
The Principal AI/ML Platform Engineer leads the development and delivery of ML and GenAI platforms, ensuring scalability, compliance, and performance across various workflows and products, while mentoring the engineering team.
Top Skills:
AWSCrewaiLangchainLlamaindexMlflowPythonPyTorchSparkTensorFlowVector Databases
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
