As a Search Relevance SME, you will evaluate data submissions, monitor quality, provide feedback to raters, and recommend training sessions based on error trends.
Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span:
ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling.
ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking.
DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection.
RELEVANCE & INTENT: Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output.
Want to join our Welo Data team? We bring practical, applied AI expertise to projects. We have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Help us elevate our clients' Data at Welo Data.
Role Overview
We are seeking a Search Relevance Subject Matter Expert (SME) to join our team. In this role, you will act as a Subject Matter Expert for a high-profile streaming platform. Working closely with our raters, you will evaluate submissions in Label Studio, monitoring the data quality. By identifying recurring errors and offering actionable feedback, you will ensure our team consistently meets and exceeds client expectations.
Key Responsibilities
- Quality Assurance & Guideline Adherence
- Evaluate/correct data annotations for accuracy and compliance with the client’s rating guidelines.
- Collaborate with team members to clarify and update guidelines as needed.
Qualifications
- Previous QA experience: Prior exposure to any kind of QA is highly desirable.
- Strong Analytical & Communication Skills: Ability to synthesize error trends and present clear, actionable insights.
- Multicultural & Pop Culture Awareness: Deep understanding of multicultural perspectives and global pop culture trends is essential for enhancing search relevance.
- Strong English Proficiency: Good command of written and spoken English, as all communication, documentation, and task guidelines are in English.
- Availability for 10–20 hours per week: Flexible schedule with some overlap in working hours for communication with global teams.
- Self-Motivated & Detail-Oriented: Capable of working independently, meeting deadlines, and maintaining strict quality standards in a remote setting.
Top Skills
Label Studio
Similar Jobs
.png)
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Lead the Analytics Engineering team to develop data solutions, optimize pipelines, and leverage AI to drive business impact. Collaborate with product teams to enhance data-driven decision making.
Top Skills:
AIAirflowCi/CdDbtGitHexLlmsSnowflakeSQL
Artificial Intelligence • Cloud • Consumer Web • Productivity • Software • App development • Data Privacy
The Senior Insights Analyst will enhance the Sales Analytics team by driving data consistency, building reports, and providing actionable insights to improve sales performance and revenue growth.
Top Skills:
DatabricksExcelPythonSalesforceSQLTableau
eCommerce • Software • Design • SEO
Lead and mentor a team of data scientists and ML engineers, driving product analytics and experimentation strategies to impact business growth.
Top Skills:
Data AnalyticsData ScienceMachine LearningStatistics
What you need to know about the Charlotte Tech Scene
Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.
Key Facts About Charlotte Tech
- Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
- Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
- Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
- Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus
