Search Ops AI Evaluation Specialist

Responsibilities

About the Team
The Search Operations team aims to improve search user experience, contribute significant DAU impact to the products and drive for increase in traffic and GMV.

The T&S evaluation and investigation team, working closely with the search team, taking the evaluation standards as the baseline and principles, and manually evaluating the search query and the corresponding search results page to reflect the real user experience of the search function.

Responsibilities
- Complete regular assessments relating to AI model quality in accordance to evaluation standard documents.
- Use evaluation method to complete daily strategy assessment of AI model quality in accordance with evaluation standard documents.
- Comb the types of AI model bad cases and rate the quality of result.
- While it is assumed the evaluator will focus on their area of expertise, the will be occassions in which, they will work on projects outside this core area that could require other capabilities, such as using assessment method flexibly to support related projects.
- Willing to work on sensitive issues that include child exploitation, a variety of religious and political views, violence, adult and sexual contents.
- Other ad hoc and relevant projects as assigned.

Qualifications

Minimum Qualifications
- Bachelor degree or above, major in journalism, literature, mathematics, computer, medicine, law, and economics.
- Excellent language skills in English and local language.
- Knowledge about AI or related models, familiar with social media platform.

Preferred Qualifications
- An in depth understanding of local culture and familiarity with the internet usage habit of local users.
- Strong ability to learn and understand.
- Familiar with common office software.
- Search evaluation experience is preferred.