Bio Protocol Logo

Bio Protocol

AI Engineer

Reposted 2 Months Ago
Remote
Hiring Remotely in USA
50-50 Annually
Mid level
Remote
Hiring Remotely in USA
50-50 Annually
Mid level
The AI Engineer will design and build core agent systems, integrating them with tools and ensuring compliance, while optimizing performance and collaborating with scientists and engineers.
The summary above was generated by AI

Bio is a decentralized science protocol that helps launch and grow AI-driven biotech research. It enables scientists to raise funds, create value from their work, and distribute that value directly to their communities. Since 2023, Bio has directed over $50m to global researchers, offering an alternative to traditional pharma funding. Backed by investors like Binance Labs, Northpond Ventures, and Animoca Brands, Bio accelerates real-world therapeutics across longevity, brain health, fertility, psychedelic science, and more.

Why this role exists

As a Member of Technical Staff on the AI Agents team, you’ll design, build, and scale the core agent systems that power Bio Protocol’s products. You’ll work closely with full-stack engineers and scientist-evaluators to create agents that can plan, use tools, and reason safely. This role offers the opportunity to shape the foundation of how AI collaborates with human scientists - combining technical depth with real-world scientific impact. While technical skills matter, we believe drive and cultural fit matter most. If you're passionate about shipping impactful work and excited by our mission, we encourage you to apply - even if you don't check every single box.

What you’ll do
  • Build agent capabilities for planning, tool use, memory, and context management, and ship them into production.

  • Integrate agents with internal and external tools and data sources (retrieval systems, structured datasets, lab/biomed APIs, spreadsheets, search), with robust schemas and safeguards.

  • Develop quality and evaluation systems, including unit, regression, and scenario/benchmark tests, telemetry, and automated scoring.

  • Collaborate with scientists to analyze failure modes and improve performance.

  • Partner with the knowledge and ontology team to ensure outputs are source-traceable and compliant with provenance standards.

  • Implement safety measures, guardrails, and sandboxed execution for risky operations.

  • Optimize performance and reliability through profiling, idempotency, retries, rate limiting, and uptime management.

  • Instrument data pipelines for supervised fine-tuning and reinforcement learning when needed.

  • Contribute to the agent platform, including services, APIs, orchestration, CI/CD, and observability.

Example projects (first 90 days)
  • Deliver a multi-tool agent capable of executing long-horizon scientific tasks with memory and self-correction, supported by regression tests and telemetry.

  • Implement automated citation enforcement, including source checking, freshness validation, and provenance display in the UI.

  • Build an evaluation dashboard tracking competency pass rates, latency, and failure modes.

  • Success metrics

  • Improved pass rates and reduced critical error rates across core scientific competencies.

  • Performance against SLOs for latency, task success, tool-call reliability, and uptime.

  • Increased coverage of regression and evaluation scenarios.

  • Broader adoption of the agent platform by internal teams.

Qualifications
  • Experience building production software in Python and/or TypeScript, with strong systems and API design skills (FastAPI, gRPC, GraphQL, or similar).

  • Proven experience shipping LLM applications or agentic systems (tool use/function calling, retrieval/RAG, structured outputs, evaluation, or observability).

  • Familiarity with agent/orchestration frameworks (e.g., LangChain, LangGraph, AutoGen, CrewAI, MCP) and vector databases (FAISS, Weaviate, Pinecone).

  • Experience with cloud infrastructure and containers (AWS, GCP, or Azure), Docker/Kubernetes/Terraform, CI/CD, and production telemetry.

  • Ability to translate research prototypes into robust, scalable systems.

Nice to have
  • Experience with fine-tuning and reinforcement learning (RL, RLAIF, RLHF), including reward design and offline evaluation.

  • Familiarity with benchmarks and evaluations such as SWE-Bench, OS-World, or tau-bench.

  • Knowledge of retrieval and knowledge systems, including schema and ontology design, entity modeling, and provenance tracking.

  • Background in agentic system safety and security (sandboxing, isolation, permissions, auditability).

  • Exposure to life sciences or scientific computing and collaboration with domain experts.

How we work
  • Evidence-first: every output is grounded and source-verifiable.

  • Tight feedback loops: weekly quality reviews with scientists to ship, measure, and improve.

  • Platform mindset: we create safe, reusable systems that empower others to build new agent capabilities.

Tools you’ll use

Python, TypeScript, FastAPI/gRPC, Postgres, Redis/queues, Docker, Kubernetes, Terraform, cloud LLM APIs, open-weight models, vector databases, telemetry and observability tools, and internal agent/evaluation systems.

Similar Jobs

3 Days Ago
In-Office or Remote
99K-176K Annually
Mid level
99K-176K Annually
Mid level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Build and deploy production-grade AI/ML software, APIs, and applications for healthcare provider use cases. Develop prompt-based AI capabilities, integrate enterprise data and cloud services, create automated tests and evaluation pipelines, and ensure security, observability, scalability, and reliability. Collaborate with product, architecture, data science, and platform teams while owning technical work from proof of concept through production.
Top Skills: APIsCi/CdCloud PlatformsDockerGitJavaJava EeJwtModel EvaluationMongoDBMySQLOauthOpenshiftPrompt EngineeringReactRestSplunkSpring Boot
3 Days Ago
In-Office or Remote
2 Locations
Senior level
Senior level
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Build and own evaluation infrastructure, observability tooling, datasets, annotation workflows, and diagnostic systems for production AI agents. Lead experiments across prompts, models, routing, caching, cost, and latency. Diagnose failures across planning, tool use, and agent execution, while partnering with AI Core engineering. Manage and grow the AI Quality team as a hands-on player-coach, contributing directly to production code and technical direction.
Top Skills: Ai AgentsAnnotation WorkflowsBraintrustCachingCi/CdEvaluation FrameworksLangsmithLlmsModel RoutingObservability ToolingPythonRuby On Rails
3 Days Ago
Remote or Hybrid
CA, USA
238K-322K Annually
Senior level
238K-322K Annually
Senior level
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Set the technical direction for Rapid7’s LLM and agentic AI systems. Lead architecture, model strategy, fine-tuning, post-training, inference optimization, evaluation standards, and complex cross-team initiatives. Build critical model and inference code, mentor senior engineers, resolve technical trade-offs, and influence product and platform strategy across cybersecurity products.
Top Skills: Agentic AiAWSClassical Machine LearningCudaDeepspeedDistributed TrainingDpoFsdpGrpoLlmsLoraPredictive AiPythonPyTorchQloraSglangTensorrt-LlmTransformer ArchitectureTritonVllm

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account