Voice AI Evaluator jobs in Israel
What if your voice could help teach AI how to handle a real phone call to a hospital or clinic? We're looking for native Japanese speakers in the Osaka area to hold natural spoken conversations with an AI healthcare receptionist, then evaluate how well it listens, responds, and takes action. You'll role-play as a patient (using fictional personas we provide), record short conversations, and grade the AI's performance. This is a fully remote, flexible contract role for people with clear speech, sharp attention to detail, and an ear for what sounds natural in Japanese clinical settings — including the regional speech patterns of the Kansai area. Organization: Alignerr Type: Contract (task-based) Location: Remote Commitment: Flexible, work at your own pace What You'll Do Hold 4 to 5 minute spoken conversations in Japanese with an AI front desk assistant, playing a fictional patient Say natural trigger phrases to test whether the AI makes the correct function calls — for example, checking a patient record, booking an appointment, or verifying insurance Review transcripts and classify how accurately the AI understood you and responded Flag issues such as mispronunciations (including kanji readings and pitch accent), cutoffs, interruptions, delays, and incorrect function calls, including timestamps Test how the AI handles background noise, short replies (「はい」「いいえ」「大丈夫です」), long numbers, emotional moments, and sensitive or unsafe requests Follow detailed labeling guidelines consistently and submit high-quality work Who You Are Native or near-native Japanese speaker with a clear, natural speaking voice Detail-oriented, with the patience to review recordings and transcripts closely Comfortable role-playing a patient and sounding authentic in a clinical phone context Able to follow multi-step instructions and apply them consistently Reliable and self-directed when working independently Access to a quiet space, a good microphone, a stable internet connection, and a second device for playing background noise Comfortable using web-based tools Nice to Have Experience in voice AI evaluation, data annotation, or QA testing Background in healthcare administration, customer service, or call center work Strong command of polite and honorific speech (敬語) as used in medical and service conversations Awareness of regional speech variation — including Kansai-area Japanese — and how it interacts with standard clinical register Linguistics or language-focused studies Familiarity with medical terminology in Japanese Why Join Us Work on cutting-edge AI projects alongside leading research labs Fully remote and flexible — work when and where it suits you Task-based work with real autonomy Directly help make voice AI more accurate, natural, and safe in Japanese healthcare settings Potential for ongoing work as new projects launch Note: New contributors complete a short unpaid qualification assessment. Contributors who pass are added to paid production work.
What if your voice could help teach AI how to handle a real phone call to a doctor's office? We're looking for native German speakers across Germany to hold natural spoken conversations with an AI healthcare receptionist, then evaluate how well it listens, responds, and takes action. You'll role-play as a patient using fictional personas we provide, record short conversations, and grade the AI's performance. This is a fully remote, flexible contract role for people with clear speech, sharp attention to detail, and an ear for what sounds natural in everyday German. Organization: Alignerr Type: Contract (task-based) Location: Remote Commitment: Flexible, work at your own pace What You'll Do Hold 4 to 5 minute spoken conversations in German with an AI front desk assistant, playing a fictional patient Say natural trigger phrases to test whether the AI makes the correct function calls — for example, checking a patient record, booking an appointment, or verifying insurance Review transcripts and classify how accurately the AI understood you and responded Flag issues such as mispronunciations, cutoffs, interruptions, delays, and incorrect function calls, including timestamps Test how the AI handles background noise, short replies such as "ja," "nein," or "okay," long numbers, emotional moments, and sensitive or unsafe requests Follow detailed labeling guidelines consistently and submit high-quality work Who You Are Native or near-native German speaker with a clear, natural speaking voice Detail-oriented, with the patience to review recordings and transcripts closely Comfortable role-playing a patient and sounding authentic in conversation Able to follow multi-step instructions and apply them consistently Reliable and self-directed when working independently Access to a quiet space, a good microphone, a stable internet connection, and a second device for playing background noise Comfortable using web-based tools Nice to Have Experience in voice AI evaluation, data annotation, or QA testing Background in healthcare administration, customer service, or call centre work Familiarity with regional German variants and colloquial speech patterns Linguistics or language-focused academic background Familiarity with medical terminology in German Why Join Us Work on cutting-edge AI projects alongside leading research labs Fully remote and flexible — work when and where it suits you Task-based work with real autonomy Directly help make voice AI more accurate, natural, and safe in healthcare settings Potential for ongoing work as new projects launch Note: New contributors complete a short unpaid qualification assessment. Contributors who pass are added to paid production work.
What if your voice could help teach AI how to handle a real phone call to a hospital or clinic? We're looking for native Korean speakers in Seoul to hold natural spoken conversations with an AI healthcare receptionist, then evaluate how well it listens, responds, and takes action. You'll role-play as a patient using fictional personas we provide, record short conversations, and grade the AI's performance. This is a fully remote, flexible contract role ideal for Seoul-based talent with clear speech, sharp attention to detail, and an ear for what sounds natural in everyday Korean service interactions. Organization: Alignerr Type: Contract (task-based) Location: Remote Commitment: Flexible, work at your own pace What You'll Do Hold 4 to 5 minute spoken conversations in Korean with an AI front desk assistant, playing a fictional patient Say natural trigger phrases to test whether the AI makes the correct function calls, for example, checking a patient record, booking an appointment, or checking insurance Review transcripts and classify how accurately the AI understood you and responded Flag issues such as mispronunciations, cutoffs, interruptions, delays, and incorrect function calls, including timestamps Test how the AI handles background noise, short replies ("네," "아니요," "괜찮아요"), long numbers, emotional moments, and sensitive or unsafe requests Follow detailed labeling guidelines consistently and submit high-quality work Who You Are Native or near-native Korean speaker with a clear, natural speaking voice Detail-oriented, with the patience to review recordings and transcripts closely Comfortable role-playing a patient and sounding authentic Able to follow multi-step instructions and apply them consistently Reliable and self-directed when working independently Access to a quiet space, a good microphone, a stable internet connection, and a second device for playing background noise Comfortable using web-based tools Nice to Have Experience in voice AI evaluation, data annotation, or QA testing Background in healthcare administration, customer service, or call center work Strong sense of Korean speech levels and politeness (존댓말) in service conversations, and of how Korean numbers are read aloud (native vs. Sino-Korean) Linguistics or language-focused studies Familiarity with medical terminology in Korean Why Join Us Work on cutting-edge AI projects alongside leading research labs Fully remote and flexible, work when and where it suits you Task-based work with real autonomy Directly help make voice AI more accurate, natural, and safe in healthcare settings Potential for ongoing work as new projects launch Note: New contributors complete a short unpaid qualification assessment. Contributors who pass are added to paid production work.
Get voice ai evaluator jobs sent to you
Add your work once. When an opening fits, it comes to you, and you see who you know at the company.
Get openings like these