Hi,
Greetings of the Day!
Please find the below needs and let me know your interest.
Job Title: Information Designer II
Location: Mountain View,, CA
Duration: Contract Position
Description:
Duties: Join the AI Evaluations team as a conversation designer to build golden datasets, analyse AI answers at scale and provide insights on quality and accuracy.
Key Responsibilities:
Identify and prioritize opportunities to improve customer experiences and drive business goals in conversational products like chatbots and voice assistants
Develop end-to-end conversation principles, design strategy, playbooks etc and get alignment from stakeholders like engineering and data science
Build AI skills (Claude Code or similar) for generating golden datasets for AI evaluations
Perform offline and online AI answer evaluations at scale with LLM-as-a-judge models and human-in-the-loop
Drive multiple projects with adherence to deadlines, quality and business metrics
Requirements:
Bachelor's degree
8 years of design experience, with at least 4 years of conversation design experience and 1year working on AI agentic platforms
Expertise in data analysis, prompt engineering and AI tools to efficiently deliver artefacts like golden datasets, trends in user responses etc
Knowledge of language modeling and machine learning frameworks (such as NLUs, RAG databases, TensorFlow, PyTorch, or similar).
Working understanding of code (html, python, xml, regex) in order to create dynamic dialog-flows using Boolean logic and decision frameworks
Exceptional communication skills, both written and verbal
Strong leadership skills, with a proven track record of managing stakeholders, mentoring team members and developing talent
Experience in conducting user research and usability testing, experiment design and data analysis
Education or certifications in Interaction Design, HCI, Psychology, Computer Science, Prompt engineering or related field preferred
Sainath Boosi | Sr. Sourcing & Recruiting Specialist
Central Point Partners, LLC
📨 Sainath.Boosi@centralpointpartners.com
🌐 centralpointpartners.com