Design and maintain backend systems for AI ML features, collaborating with data scientists and ensuring scalable deployments and performance optimization.
Description
Requirements
We are looking for a Senior Backend Engineer to join our AI/ML team. In this role, you’ll work closely with data scientists to transform cutting-edge machine learning models into scalable, production-ready services. You will take ownership of designing, building, and maintaining the backend systems that power our AI-driven features.
This is a key position that bridges the gap between data science and production engineering, ensuring high performance, reliability, and maintainability of our ML-powered products.
Responsibilities
- Collaborate with data scientists to understand modeling outputs and convert them into deployable services.
- Design and develop robust, scalable backend systems and microservices to support AI use cases.
- Own the deployment and monitoring of ML models in production (with CI/CD, logging, observability).
- Implement data processing pipelines in support of model training and inference.
- Ensure software adheres to best practices in architecture, testing, and documentation.
- Optimize model inference for latency, throughput, and resource efficiency.
- Contribute to design decisions and technical strategy alongside AI and infrastructure leads.
Requirements
- 5+ years of experience as a backend/software engineer, preferably in Python, Go, or Java.
- Strong experience with designing APIs, building microservices, and integrating third-party services.
- Familiarity with ML workflows: model serving, feature extraction, and batch vs real-time inference.
- strong architectural/design skills, including working with message queues like Kafka, relational and NoSQL databases, and distributed systems.
- Experience deploying services in containerized environments (e.g., Docker, Kubernetes).
- Proficient with cloud-native tools or on-prem equivalents (e.g., logging, tracing, metrics).
- Knowledge of data processing frameworks (e.g., Pandas, Spark, Airflow) is a plus.
- Comfortable reading and working with Python-based ML code (scikit-learn, TensorFlow, PyTorch, etc.).
- Strong ownership mindset and a collaborative attitude.
Nice to Have
- Experience with model versioning and ML serving frameworks (e.g., MLflow, Seldon, Triton).
- Understanding of data privacy/security implications in model and data pipelines.
- Experience working in cross-functional teams with data scientists and product owners.
Top Skills
Airflow
Docker
Go
Java
Kafka
Kubernetes
Mlflow
Pandas
Python
PyTorch
Seldon
Spark
TensorFlow
Triton
Similar Jobs at Tufin
Security • Cybersecurity
The Senior Data Scientist will explore data, develop machine learning models, and collaborate with teams to create impactful solutions.
Top Skills:
Hugging Face TransformersKubeflowLangchainLlamaindexMatplotlibMlflowNltkNumpyOpenai ApiPandasPythonPyTorchScipySentence TransformersSklearnSpacyTensorFlow
Security • Cybersecurity
The Full-Stack Developer will build AI-powered applications, managing both frontend in Angular and backend using Node.js or Python, while collaborating with teams to optimize performance and ensure functionality.
Top Skills:
AngularCi/CdCSSCypressDockerFastapiFlaskGitGraphQLHTMLJasmineJestKubernetesNode.jsNoSQLPytestPythonRestSQLTypescript
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus