DoctorGPT
Feedback from Patients
Patient 1
The doctor was knowledgeable about the MMR vaccine and responded well to the concerned mother. However, there was excessive repetition, particularly in the phrase “I understand your concerns,” which felt unnecessary given that sufficient empathy was already shown. The repetition may have also been influenced by the simulated patient (SP) repeatedly raising the same concerns.
Patient 2
The phrase “I understand your concerns, Mrs Goldentree” was overused, making the empathy seem insincere. The doctor and parent often repeated each other, which felt unnatural. Additionally, the references used were not suitable for the parent.
Patient 3
The doctor frequently used the phrase “I understand,” but overall, the conversation was very effective.
Feedback from Clinicians
Clinician 1
The consultation included good explanations of prevention methods and reassurance, emphasising the benefits of vaccination. However, phrases like “help you make an informed decision” and the repeated use of “I completely understand your concerns” could feel condescending or irritating. There was also too much jargon, especially with journal names and detailed statistics, which may not be helpful or accessible for a concerned parent.
Clinician 2
The doctor showed strong empathy and clearly explained that there’s no link between MMR and autism. However, they should remember to offer written materials or direct the parent to additional resources to support informed decision-making.
Clinician 3
The explanation of the evidence debunking a link between MMR and autism was clear, though some parts of the conversation felt unnaturally repetitive.
PatientGPT
Feedback from Patients
Patient 1
The patient’s concerns about the vaccine were valid, but some questions were repeated unnecessarily, which didn’t seem justified in this scenario.
Patient 2
The patient should avoid using jargon, not repeat the doctor’s statements, and request simple statistics to better understand the evidence.
Patient 3
The patient could have challenged more based on what they’ve read, which would have made the conversation more about managing a difficult discussion.
Feedback from Clinicians
Clinician 1
Repeated questions about risks suggest the patient is either genuinely worried, requiring a more personal response from the doctor, or not fully listening and asking routine questions. Some concerns, like potential harm, were asked and addressed multiple times. One response in particular (after the doctor reassures that it’s normal to worry and ask questions) felt insincere, merely reflecting the doctor’s reassurance. Additionally, the discussion about vaccine timing and doses was overly long and repetitive, lacking natural brevity.
Clinician 2
Parents tend to be harder to convince when they have concerns about vaccines.
Clinician 3
The repetition in certain parts feels unusual, as if the speaker doesn’t recall that the topic was already covered.