Information Designer II: 26-03441

Akraya, Inc. • Contract • Mountain View, CA, US • 1d ago

Primary Skills: Conversation Design (advanced), AI Evaluations & Golden Datasets (advanced), Prompt Engineering (advanced), Data Analysis (advanced), AI Agentic Platforms (intermediate)
Contract Type: W2 Only
Location: Mountain View, CA (#Hybrid)
Duration: 12 months
Pay Range: $45-$50 Per Hour on W2
#LP

JOB SUMMARY:
This role focuses on improving the quality and accuracy of AI-powered chatbots and voice assistants. You will design conversational experiences, build golden datasets, evaluate AI-generated responses at scale, and provide insights to improve AI performance.

JOB REQUIREMENTS:
Design conversation strategies, principles, and playbooks for AI-powered products.
Build AI skills using Claude Code or similar tools to generate golden datasets.
Evaluate AI responses using LLM-as-a-Judge models and human feedback.
Analyze AI answer quality, accuracy, and customer experience trends.
Partner with Engineering and Data Science teams to drive improvements.

Must have Skills:
8+ years of design experience, including 4+ years in Conversation Design.
1+ year of experience with AI agentic platforms.
Strong expertise in prompt engineering, AI tools, and data analysis.
Understanding of LLMs, NLP/NLU, RAG, or machine learning frameworks.
Working knowledge of Python, HTML, XML, Regex, or similar coding languages.

INDUSTRY EXPERIENCE:
Experience in conversational AI, chatbots, voice assistants, AI evaluation, or generative AI products is preferred.

ABOUT AKRAYA
Akraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a thriving work environment. Most recently, we were recognized Inc's Best Workplaces 2024 and Silicon Valley's Best Places to Work by the San Francisco Business Journal (2024) and Glassdoor's Best Places to Work (2023 & 2022)!

Industry Leaders in IT Staffing
As staffing solutions providers for Fortune 100 companies, Akraya's industry recognitions solidify our leadership position in the IT staffing space. We don't just connect you with great jobs, we connect you with a workplace that inspires!

Join Akraya Today!
Let us lead you to your dream career and experience the Akraya difference. Browse our open positions and join our team!