Birdwatch Archive

Birdwatch Note Rating

2023-01-27 11:39:35 UTC - NOT_HELPFUL

Rated by Participant: DC4B2B9A45E6B2C1FC93914EFCDDDB457806CD1BC41D5CEA359ABDA2F8BFD6E2
Participant Details

Original Note:

The cited article (which has not been peer-reviewed) does not conclude that ChatGPT had “passed” the USMLE, as has been stated in this tweet. Rather, the results approached passing but did not meet/reach it, with accuracy for Step 1 68.0%, Step 2CK 58.3%, and Step 3 62.4%. https://t.co/GGKbYfeUFR

All Note Details

Original Tweet

All Information

  • noteId - 1617787710852177920
  • participantId -
  • raterParticipantId - DC4B2B9A45E6B2C1FC93914EFCDDDB457806CD1BC41D5CEA359ABDA2F8BFD6E2
  • createdAtMillis - 1674819575781
  • version - 2
  • agree - 0
  • disagree - 0
  • helpful - 0
  • notHelpful - 0
  • helpfulnessLevel - NOT_HELPFUL
  • helpfulOther - 0
  • helpfulInformative - 0
  • helpfulClear - 0
  • helpfulEmpathetic - 0
  • helpfulGoodSources - 0
  • helpfulUniqueContext - 0
  • helpfulAddressesClaim - 0
  • helpfulImportantContext - 0
  • helpfulUnbiasedLanguage - 0
  • notHelpfulOther - 0
  • notHelpfulIncorrect - 0
  • notHelpfulSourcesMissingOrUnreliable - 0
  • notHelpfulOpinionSpeculationOrBias - 0
  • notHelpfulMissingKeyPoints - 1
  • notHelpfulOutdated - 0
  • notHelpfulHardToUnderstand - 0
  • notHelpfulArgumentativeOrBiased - 0
  • notHelpfulOffTopic - 0
  • notHelpfulSpamHarassmentOrAbuse - 0
  • notHelpfulIrrelevantSources - 0
  • notHelpfulOpinionSpeculation - 0
  • notHelpfulNoteNotNeeded - 1
  • ratingsId - 1617787710852177920DC4B2B9A45E6B2C1FC93914EFCDDDB457806CD1BC41D5CEA359ABDA2F8BFD6E2