Software Engineer (AI Quality & Reliability)

🏢 Taxo · 📍 New York City · 💼 onsite · ⏰ FullTime

⚡ Direct Talent Broker Referral

Why apply through CandidatesReach?

✔ Tailored Executive Endorsement Letter: Highlight your real strengths and verified background directly to hiring leads.

✔ Your Preferred Screening Terms: Choose between a 1-minute quick phone screen or scheduled email calendar.

✔ $500 Cash Hiring Bonus: Receive $500 direct cash reward after 30 days of active employment.

Position Summary & Responsibilities

Software Engineer (AI Quality & Reliability)

Location: New York City | In-office

The Mission

“Leading healthcare into the agentic era.”

Every day, patients call their clinic to schedule an appointment, ask a question, or request a prescription refill. Behind each conversation is a busy healthcare team coordinating people, information, and systems.

Taxo builds Voice AI agents that take on this administrative work. Our agents connect with EHR and practice management systems to help teams handle patient intake, complex scheduling, and refill requests, with reliable workflows and clear handoffs to people.

The Opportunity: Make AI Quality Measurable

As our Software Engineer (AI Quality & Reliability), you’ll build the automated evaluation and regression systems that show whether Taxo is ready to release. You’ll turn product acceptance criteria and real failure modes into repeatable tests across voice agents, application workflows, and integrations. This is a software engineering role focused on test infrastructure, independent quality evidence, and reliable releases.

What You’ll Do

Build the Evaluation System: Own shared evaluation frameworks, test harnesses, and versioned datasets using synthetic or appropriately authorized, privacy-safe data. Make runs repeatable and results easy to investigate.
Test the Whole Workflow: Build automated end-to-end regression coverage across conversations, tool calls, application behavior, and integration boundaries, including failures, recovery, and human escalation.
Measure AI Behavior: Evaluate task completion, tool-use correctness, latency, and conversation quality. Combine deterministic checks with calibrated model-assisted scoring and appropriate human review.
Make Releases Reviewable: Produce release-readiness evidence, maintain quality dashboards, and coordinate quality gates with product and engineering. Surface regressions, coverage gaps, and unresolved risks before

🎯 Candidate Preparation Guide For Taxo Applicants

Key Role Competencies & Evaluation Highlights

Key Role Focus:

Inspecting precision, rigorous data modeling capabilities, and an absolute intolerance for ambiguity in regulatory or financial logic.

📋 Preparation Priorities (Key Areas to Clarify):

1. Hand-waving away data validation errors as 'edge cases we will catch later'
2. Sloppy communication or vague explanations of complex multi-step data transformations
3. Failing to grasp the business impact of computational inaccuracies

✨ Recommended Role Alignment Hook:

I treat data architecture like a balance sheet—zero room for error, maximum traceability, and built to scale.

🔒 Free Candidate Preparation Access

Unlock Preparation Priorities & Alignment Hook

🤝 Talent Broker Referral · $500 Bonus Included

Apply for Software Engineer (AI Quality & Reliability)

Setup your contact terms & referral note to get recommended directly to the hiring lead at Taxo.

⚡ Continue with Google (Instant Setup)

or with email

Already have an account? Sign in here