Birdwatch Archive

Birdwatch Note Rating

2024-10-02 19:06:38 UTC - NOT_HELPFUL

Rated by Participant: 2B9A073D604E151B420B4282DD5BFE5A1B99D8A6264E8C0AE24C95898EE9BA25
Participant Details

Original Note:

The figures referenced are "diagnostic reasoning scores" not final diagnosis accuracy. Per supplementary eTable 4, GPT-4 had the correct diagnosis in 66% of cases, compared with 62% for the doctors, but this is not a statistically significant difference. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10980135/

All Note Details

Original Tweet

All Information

  • noteId - 1841529891721715876
  • participantId -
  • raterParticipantId - 2B9A073D604E151B420B4282DD5BFE5A1B99D8A6264E8C0AE24C95898EE9BA25
  • createdAtMillis - 1727895998608
  • version - 2
  • agree - 0
  • disagree - 0
  • helpful - 0
  • notHelpful - 0
  • helpfulnessLevel - NOT_HELPFUL
  • helpfulOther - 0
  • helpfulInformative - 0
  • helpfulClear - 0
  • helpfulEmpathetic - 0
  • helpfulGoodSources - 0
  • helpfulUniqueContext - 0
  • helpfulAddressesClaim - 0
  • helpfulImportantContext - 0
  • helpfulUnbiasedLanguage - 0
  • notHelpfulOther - 0
  • notHelpfulIncorrect - 0
  • notHelpfulSourcesMissingOrUnreliable - 0
  • notHelpfulOpinionSpeculationOrBias - 0
  • notHelpfulMissingKeyPoints - 0
  • notHelpfulOutdated - 0
  • notHelpfulHardToUnderstand - 0
  • notHelpfulArgumentativeOrBiased - 0
  • notHelpfulOffTopic - 0
  • notHelpfulSpamHarassmentOrAbuse - 0
  • notHelpfulIrrelevantSources - 0
  • notHelpfulOpinionSpeculation - 0
  • notHelpfulNoteNotNeeded - 1
  • ratingsId - 18415298917217158762B9A073D604E151B420B4282DD5BFE5A1B99D8A6264E8C0AE24C95898EE9BA25