ThirdLaw AI Logo

ThirdLaw AI

Founding Software Engineer

Reposted 3 Months Ago
Remote
Hiring Remotely in USA
Expert/Leader
Remote
Hiring Remotely in USA
Expert/Leader
As a Founding Software Engineer, you'll architect and evolve core backend systems and streaming data pipelines, optimize performance and storage, and define data models to enhance AI deployment safety and performance in real-time environments.
The summary above was generated by AI
About the Company

ThirdLaw is building the control layer for AI in the enterprise. As companies rush to adopt LLMs and AI agents, they face new safety, compliance, and operational risks that traditional observability tools were never designed to detect. Metrics like latency or cost don’t capture when a model makes a bad decision, leaks sensitive data, or behaves unpredictably.

We help IT and Security teams answer the foundational question: "Is this OK?"—and take real-time action when it’s not.

Backed by top-tier venture firms and trusted by forward-looking enterprise design partners, we’re building the infrastructure to monitor, evaluate, and control AI behavior in real-world environments—at runtime, where it matters. If you're excited to build systems that help AI work as intended—and stop it when it doesn’t—we’d love to meet you.

About the Role

You won’t just be piping logs or tuning models—you’ll architect systems that reconcile latency, correctness, and observability across distributed pipelines. You’ll be designing the nervous system of a new class of software—where AI Agents reason, act, and fail in unpredictable ways. If you're excited by AI and want to shape its safe deployment—not just watch from the sidelines—this is your opportunity.

What You’ll Do
  • Architect and evolve core backend systems—event ingestion, real-time risk evaluation, semantic search, and investigation-grade querying.

  • Design and optimize streaming data pipelines using Kafka, Redpanda, or similar technologies to support high-throughput, low-latency processing of LLM interactions.

  • Define and refine data models and schemas across structured (Postgres), analytical (ClickHouse), unstructured (S3), and vector (Qdrant) storage layers.

  • Identify architectural weaknesses and performance bottlenecks across ingest, indexing, and query layers; lead improvements to support scalability, correctness, and observability.

  • Implement data ingestion and transformation frameworks that support policy evaluation, semantic analysis, and dynamic response.

  • Optimize query performance, storage efficiency, and retrieval accuracy to support deep investigation and real-time enforcement.

  • Build and maintain backend APIs, monitoring infrastructure, and policy enforcement workflows that underpin the ThirdLaw platform.

Who We are Looking For

You’ll be one of the first backend hires, helping define not just what we build, but how we build it.

Required

  • 10+ years of backend or data engineering experience, ideally with a focus on distributed systems or streaming architectures.

  • Strong in Golang and/or Python; experienced with gRPC, REST, and working in Unix/Linux environments.

  • You’ve been the architect behind at least one complex distributed system—ideally involving real-time data, search, or observability—and can explain your design decisions clearly.

  • Familiarity with schema evolution, ORMs, and data mapping strategies in evolving analytics systems.

  • Comfort working with Kubernetes and cloud-native services in AWS/GCP/Azure.

  • Ability to debug deeply, reason about performance tradeoffs, and own systems end to end.

Nice-to-Have

  • Experience with semantic search, vector embeddings, AI agent infrastructure (e.g. LangChain, CrewAI, Autogen, etc.) and integrating LLM telemetry or foundation model outputs into observability pipelines.

  • Familiarity with OpenTelemetry, event trace modeling, Model Context Protocol (MCP), or real-time AI evaluation architectures.

  • Based in or willing to spend time in the San Francisco Bay Area for in-person collaboration.

Why Apply?

Our team is small and focused, valuing autonomy and real impact over titles and management. We need strong technical skills, a proactive mindset, and clear written communication, as much of our work is asynchronous. If you're organized, take initiative, and want to work closely with customers to shape our products, you'll fit in well here.

Finally, we pay market cash compensation and generally above-market equity. The compensation package for this role is benchmarked using Carta Total Compensation and reflects real-time market data for our company’s size, this role’s level, and your geographic location. We have well-designed and generous benefits.

https://www.thirdlaw.io/

Similar Jobs

13 Days Ago
In-Office or Remote
190K-270K Annually
Senior level
190K-270K Annually
Senior level
Artificial Intelligence • Software • Biotech • Pharmaceutical • Generative AI
Build and operate production AI systems for FDA regulatory intelligence, including evaluation pipelines, document ingestion and retrieval, multi-agent workflows, data pipelines, cloud infrastructure, and secure multi-tenant services. Collaborate with former FDA experts to translate domain judgment into product requirements and evaluation cases. Own architecture, reliability, observability, cost, security, and rapid 0-to-1 delivery across the stack.
Top Skills: AlembicAmazon EcrAmazon RdsAmazon S3Anthropic ApiApplication Load BalancerAws EcsAws FargateAws Secrets ManagerClaude Agent SdkCloudflareDockerFastapiGithub ActionsGraphragKnowledge GraphsLanggraphMcpOpentofuPostgresPymupdfPythonPython-DocxReactSQLSqlalchemyTailwind CssTerraformTypescriptVercel Ai SdkVite
12 Days Ago
Remote
USA
100K-200K Annually
Expert/Leader
100K-200K Annually
Expert/Leader
Artificial Intelligence • HR Tech • Information Technology • Software
Build and scale Neuroscale’s backend platform for AI-powered recruiting workflows. Responsibilities include developing Python/FastAPI REST APIs, designing high-throughput systems, managing PostgreSQL, Redis, OpenSearch, Celery, and Temporal infrastructure, deploying services on AWS, maintaining containerized CI/CD pipelines, and supporting integrations, data pipelines, and asynchronous workflows. The role owns architecture and reliability decisions, mentors engineers, and collaborates with AI, product, and frontend teams in a high-ownership startup environment.
Top Skills: AWSCeleryCi/CdClaude CodeContainersCursorFastapiOpensearchPostgresPythonRedisRest ApisTemporal
13 Days Ago
Remote
United States
Entry level
Entry level
Cloud • Software • Infrastructure as a Service (IaaS)
Build and maintain backend services, REST APIs, cloud workspace provisioning systems, and resource orchestration infrastructure. Improve performance, reliability, scalability, and security while developing integrations, SDKs, and developer tools. Contribute to architecture and ship features from concept to production. The role requires strong TypeScript, JavaScript, and Node.js skills, backend and database knowledge, and familiarity with Docker, Linux, and cloud infrastructure.
Top Skills: Cloud InfrastructureDistributed SystemsDockerJavaScriptKubernetesLinuxNetworkingNode.jsPostgresRedisRest ApisSdksTypescriptVirtual Machines

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account