Skip to content

Mispronunciation

airtable_apply_annotations.mispronunciation

detect_mispronunciation(ground_truth, transcript, homophones=None)

Detects if the pair of ground truth and transcript is considered as a mispronunciation.

We define a mispronunciation to be either an addition (A) / substitution (S). Ignores deletion (D), 100% match (M) and single-word GT (X), returning None. Also handles homophones given a pre-defined list.

Parameters:

Name Type Description Default
ground_truth List[str]

List of ground truth words.

 required
transcript List[str]

List of transcript words.

 required
homophones List[Set[str]]

List of homophone families. Defaults to

 None

Returns:

Name Type Description
str str

Type of mispronunciation present. Otherwise, None.
Source code in src/airtable_apply_annotations/mispronunciation.py 
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
def detect_mispronunciation(
    ground_truth: List[str], transcript: List[str], homophones: List[Set[str]] = None
) -> str:
    """Detects if the pair of ground truth and transcript is considered as a
    mispronunciation.

    We define a mispronunciation to be either an addition (A) / substitution (S).
    Ignores deletion (D), 100% match (M) and single-word GT (X), returning `None`.
    Also handles homophones given a pre-defined list.

    Args:
        ground_truth (List[str]): List of ground truth words.
        transcript (List[str]): List of transcript words.
        homophones (List[Set[str]], optional): List of homophone families. Defaults to
        None.

    Returns:
        str: Type of mispronunciation present. Otherwise, None.
    """
    if homophones is None:
        homophones = HOMOPHONES["en"]

    if len(ground_truth) == 1 or len(transcript) == 0:
        return "DELETE"  # single word or filler-only transcript

    tsc_idx = set(range(len(transcript)))
    gt_idx = set(range(len(ground_truth)))

    aligned_tsc, aligned_gt, _ = match_sequence(transcript, ground_truth, homophones)

    if len(aligned_tsc) == 0 and len(aligned_gt) == 0:
        return "DELETE"  # zero matches/alignments, pretty much random

    tsc_diff = tsc_idx.difference(aligned_tsc)
    gt_diff = gt_idx.difference(aligned_gt)

    if len(gt_diff) == 0 and len(tsc_diff) == 0:
        return "DELETE"  # 100% match
    elif len(gt_diff) > 0 and len(tsc_diff) == 0:
        return "DELETE"  # deletion only
    elif len(gt_diff) == 0 and len(tsc_diff) > 0:
        return "ADDITION"
    elif len(tsc_diff) == len(gt_diff) and tsc_diff == gt_diff:
        return "SUBSTITUTION"
    elif len(tsc_diff) >= len(gt_diff):
        return "ADDITION_SUBSTITUTION"
    else:
        return "DELETE"