The Principal AI Platform Engineer will design and maintain the infrastructure for AI systems, ensuring integration, security, and scalability for GenAI products.
The Team
This team will serve as the product owner for GenAI capabilities within PointClickCare, working closely with other engineering teams across the organization to identify, build and support generative AI solutions. This centralized team with deep specialization, closely integrated with key horizontal partners to ensure delivery of safe, scalable and high-impact AI Products
Job summary
The Principal AI Platform Engineer will focus on building the infrastructure that connects AI systems with existing products and will enable seamless delivery of AI-generated insights into agent workflows.
Key responsibilities.
- Design, build, and maintain the core infrastructure layer supporting GenAI products, including model gateways, prompt/versioning stores, vector databases, and LLM evaluation tools.
- Implement secure access controls and authentication mechanisms integrated by default into the AI platform components.
- Develop and manage observability, monitoring, and logging solutions for GenAI workloads and infrastructure.
- Collaborate closely with product and engineering teams to integrate GenAI infrastructure with agent frameworks, and downstream applications.
- Optimize infrastructure for scalability, high availability, cost efficiency for production workloads.
Qualifications & Skills
- Extensive experience building and maintain AI platform infrastructure, Kubernetes, and container security.
- Demonstrated expertise in observability, and monitoring frameworks, with a focus on real-time performance (i.e: experience with OpenTelemetry, MLFlow).
- Experience with AI infrastructure components such as vector databases, prompt/versioning stores, and AI IDEs.
Preferred experience
- Familiarity with vLLM, SGLang or similar framework to host LLM inference workloads.
- Experience with CI/CD pipelines and automation for AI model deployment and platform operations
- Strong knowledge of authentication and authorization frameworks integrated into AI platforms.
#LI-AV1
#LI-remote
Top Skills
Ai Ides
Ci/Cd
Container Security
Kubernetes
Mlflow
Opentelemetry
Vector Databases
Similar Jobs
Information Technology • Software
Design and implement full-stack applications and AI agents to enable rapid development and deployment of AI solutions in critical industries. Mentor engineers and take ownership of projects while applying secure SDLC practices and collaborating with cross-functional teams.
Top Skills:
AWSAzureDockerDocumentdbDynamoDBGCPGithub ActionsLangchainNode.jsOpensearchPythonReactRustTerraformTypescript
.png)
Big Data • Healthtech • HR Tech • Machine Learning • Software • Telehealth • Big Data Analytics
The Senior Data Engineer will build and maintain data pipelines, create reusable data sets, and ensure data privacy and security, contributing to healthcare innovations.
Top Skills:
AirbyteAirflowArgoAWSDbtDuckdbElasticsearchIcebergPostgres/SqlPythonSnowflakeSparkTerraform
Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
Lead growth initiatives and partnerships in the US Domestic aerospace and defense sectors, focusing on business development and customer engagement.
Top Skills:
Microsoft Office SuiteSalesforce
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
