Lead Data Scientist - AI-Human Interaction

Key Responsibilities 

• Develop and own ML pipelines for evaluating and improving human-AI interaction across modalities (text, speech, UI/UX feedback, behavioral signals)

• Design adaptive models for intent recognition, dialog state tracking, preference learning, and multi-turn personalization

• Lead human-in-the-loop data collection strategies and feedback integration to fine-tune agent behaviors

• Partner with UX, engineering, and safety teams to embed explainability, user control, and alignment into AI systems

• Develop and monitor human-centered evaluation metrics (e.g., helpfulness, latency, trust calibration, long-term engagement)

• Construct causal inference and A/B testing to assess impact of interaction strategies on behavior and outcomes

• Mentor a team of data scientists and collaborate with AI researchers and product leaders on foundational interaction improvements

• Experience in creating reports, projections, models, and presentations to executives

Technical skills

• Proficiency in SQL, Python, and data analysis/data mining tools.

• Experience with machine learning frameworks like Pytorch, JAX, LangChain, or LangGraph

• Experience with high performance, large-scale ML systems

• Experience with language modeling with transformers

• Experience designing human-centered evaluation protocols, metrics, and pipelines

• Experience with +5 years of experience in applied ML, with at least 3+ in conversational AI, human-in-the-loop systems, or agent UX optimization

• Experience with large-scale ETL

Required Qualifications

• Master's Degree and 4+ years of experience in research/ML engineering or an applied research scientist position preferably with a focus on developing production-ready AI solutions

• 2+ years of experience leading development of AI/ML systems

• Proven track record building production-grade AI models with strong UX and behavioral outcomes

• Expertise in supervised learning, reinforcement learning from human feedback (RLHF), or preference modeling

• Strong communication skills with ability to bridge data science, product, and engineering

Preferred Qualifications

• Ph.D. in in Machine Learning, Human-Computer Interaction, Cognitive Science, NLP, or related field

• LLM-based agent or copilot systems (e.g., OpenAI GPT agents, Claude, Gemini, Mistral, open-agent frameworks)

• Experience working with voice assistants, AR/VR interfaces, or embodied agents

• Familiarity with ethical considerations and safety alignment in interactive systems

• Contributions to human-AI interaction research or open-source tools

Additional Information

Location/Work Style: Remote US

Why Humana?

At Humana, we know your well-being is important to you, and it’s important to us too.  That’s why we’re committed to making resources available to you that will enable you to become happier, healthier, and more productive in all areas of your life. Just to name a few:

• Work-Life Balance

• Generous PTO package

• Health benefits effective day 1

• Annual Incentive Plan

• 401K - Excellent company match

• Well-being program 

• Paid Volunteer Time Off

If you share our passion for helping people, we likely have the right place for you at Humana.

SSN Alert Statement

Humana values personal identity protection. Please be aware that applicants may be asked to provide their Social Security Number, if it is not already on file. When required, an email will be sent from [email protected] with instructions on how to add the information into your official application on Humana’s secure website.