Responsible for localizing labeling policies and guidelines for labeling teams to ensure clear understanding and accurate labeling. Maintains project quality through regular inspection of labeled data, analysis, and action planning to improve accuracy. Manages communications and coordination with internal and external stakeholders, supports training and go-live activities for labeling teams, and generates performance reports from project metrics. Works cross-functionally to provide feedback on data quality, SOPs, policies, and guidelines, and may be moved between projects based on business needs.
Our Search Operations team supports our efforts to address objectionable or disturbing content, which could include images of violence, animal cruelty, hate speech, violent extremism, or content that exploits or endangers children. The team plays a vital role in analyzing user searches and search strategy optimization to ensure a positive and safe user experience for our community. It is possible that this role will be exposed to harmful content as part of the core role/as part of project/ in response to escalation requests/by chance. This may occur in the form of images, video, and text related to every-day life, but it can also include (but is not limited to) bullying; hate speech; child safety; depictions of harm to self and others, and harm to animals. Responsibilities - Be responsible for data labeling project policy and guideline localization, implementation, and clarification for labeling teams to ensure accurate understanding of the policies and guidelines - Ensure project quality via routine-timely inspection of labeled data, conducting analyses, and formulating action plans to improve quality - Manage communications to ensure alignment, which includes, but is not limited to, both internal and external recurring project syncs and calibration meetings with the labeling team to support the appeal process (e.g. analyze diff cases, offer solutions and suggestions to resolve misalignments to improve accuracy) - Support the training and go-live process of the labeling team, including holding follow-up explanation sessions as needed, correcting test results, and handling Q&A - Generate performance reports via analyzing, reviewing, and assembling project metrics / data - Work closely with cross-functional stakeholders in order to provide feedback including on data quality / SOPs / policies / and guidelines - Additional compatible and related responsibilities which are not necessarily listed above - Based on business requirements, you may be moved between projects