About Highspot
Highspot is a software product development company and a recognized global leader in the sales enablement category, leveraging cutting-edge AI and GenAI technologies at the core of its robust Software-as-a-Service (SaaS) platform. Highspot is revolutionizing how millions of individuals work worldwide. Through its AI-powered platform, Highspot drives enterprise transformation to empower sales teams through intelligent content management, training, contextual guidance, customer engagement, meeting intelligence, and actionable analytics. The Highspot platform delivers advanced features tailored to business needs, in a modern design that sales and marketing executives appreciate and is the #1 rated sales enablement platform on G2 Crowd.
While headquartered in Seattle, Highspot has expanded its footprint across America, Canada, the UK, Germany, Australia, and now India, solidifying its presence in the Asia Pacific markets.
About The Role
You will safeguard the quality of our AI and GenAI features by evaluating model outputs, creating “golden” datasets, and guiding continuous improvements in collaboration with data scientists and engineers. Be the guide to the team as the team creates a robust methodology and framework that will drive evaluation of hundreds of AI agents.
Responsibilities
- Validate AI Output – Review model results across text, documents, audio, and video; flag errors and improvement opportunities.
- Create Golden Datasets – Build and maintain high-quality reference data with help from subject-matter experts.
- Data Annotation – Accurately label multi-modal data and perform light preprocessing (e.g., text cleanup, image resizing).
- Quality Analytics – Run accuracy metrics, trend analyses, and clustering to gauge model performance. Fine-Tune Model Code – Adjust training scripts and parameters to boost accuracy and keep behavior consistent across models.
- Process Improvement & Documentation – Refine annotation workflows and keep clear records of methods, findings, and best practices.
- Cross-Functional Collaboration – Partner with ML engineers, product managers, and QA peers to ship reliable, user-ready features.
Required Qualifications
- 2 to 4 years of experience in data science/AI/ML. Specific experience in evaluation of AI results is strongly preferred
- Working knowledge of AI/ML evaluation techniques
- Solid analytical skills and meticulous attention to detail.
- Bachelor’s or Master’s in Computer Science, Data Science, or a related field.
- Strong English written and verbal communication.
- Self-directed, organized, and comfortable with ambiguous problem spaces.
#LI-SG1
Equal Opportunity Statement
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of age, ancestry, citizenship, color, ethnicity, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or invisible disability status, political affiliation, veteran status, race, religion, or sexual orientation.
Did you read the requirements as a checklist and not tick every box? Don't rule yourself out! If this role resonates with you, hit the ‘apply’ button.