In transcript QA, what is typically used as the ground truth for accuracy comparisons?

In transcript QA, what is typically used as the ground truth for accuracy comparisons?

• A. The final published transcript.
• B. A reference transcript created from the original audio and video.
• C. The judge's notes.
• D. An anonymized redacted version.

Answer: (B)

Ground truth in transcript QA is the reference transcript created directly from the original audio and video. This serves as the baseline record of exactly what was spoken, properly aligned to the source media, and is typically produced by combining automated transcription with careful human review to ensure accuracy. Using this reference allows you to compare QA outputs to the true utterances and timing, without the distortions that can come from edits, formatting, or later notes. Relying on the final published transcript would introduce edits or stylistic changes that alter what actually occurred, so it isn’t a reliable standard. A judge’s notes aren’t the verbatim content of the proceedings, so they don’t reflect the spoken record, and an anonymized redacted version likewise omits or hides information, making it unsuitable as a ground truth for accuracy.

Ground truth in transcript QA is the reference transcript created directly from the original audio and video. This serves as the baseline record of exactly what was spoken, properly aligned to the source media, and is typically produced by combining automated transcription with careful human review to ensure accuracy. Using this reference allows you to compare QA outputs to the true utterances and timing, without the distortions that can come from edits, formatting, or later notes.

Relying on the final published transcript would introduce edits or stylistic changes that alter what actually occurred, so it isn’t a reliable standard. A judge’s notes aren’t the verbatim content of the proceedings, so they don’t reflect the spoken record, and an anonymized redacted version likewise omits or hides information, making it unsuitable as a ground truth for accuracy.