AI Product Analyst - Voice AI Agents

MEDvidi is an AI-powered mental healthcare platform setting a new standard for safe, effective, and scalable psychiatric care in the United States. We combine licensed providers with proprietary AI tools to deliver consistent, outcomes-driven treatment for conditions like ADHD, anxiety, depression, and more. MEDvidi's technology automates charting, follow-ups, and treatment planning, freeing providers to focus on patient care while improving efficiency and clinical quality.

At MEDvidi, the AI Receptionist Team builds and improves Voice AI Agents that interact directly with patients and automate critical parts of the patient journey. These systems handle real-world conversations, support operational workflows, and help patients navigate care more efficiently.

As these agents become more autonomous and handle increasingly complex interactions, understanding how they behave in production becomes a critical product and business challenge.

We're hiring an AI Product Analyst to help us evaluate, monitor, and improve Voice AI systems operating at scale. You'll work at the intersection of Product, Engineering, Operations, and AI, helping the team understand how AI behaves in the real world, where it creates value, where it fails, and what should be improved next.

Why this role

• Work on one of the most visible AI products inside MEDvidi.

• Help shape the future of Voice AI in healthcare.

• Influence product decisions using real production evidence.

• High ownership in a fast-moving, product-driven medical tech company.

• 3+ years of experience in Product Analytics, Data Analytics, Operational Analytics, or analytics roles within complex production systems.

• Strong SQL skills.

• Python for analytical investigations and working with large-scale text datasets.

• Understanding of LLM limitations, hallucinations, evaluation challenges, prompt sensitivity, and AI failure modes.

• Experience building monitoring systems, analytical frameworks, or operational dashboards.

• Strong communication skills and ability to translate analysis into product decisions.

• Ability to work effectively in ambiguous and fast-changing environments.

• Fluent Russian; English level B2 or higher.

• Ability to work CET-overlapping hours.

Would be a plus

• Experience with conversational AI or AI agents.

• Experience evaluating LLM outputs.

• Experience with AI quality metrics and evaluation methodologies.

• Experience with prompt iteration and AI evaluation frameworks.

• Experience working with ML pipelines or AI-powered products.