exercise

Exercise: Critique the model response

Your answers are saved in this browser only — not on any server, and no one else can see them. They disappear if you clear your browser or use a different computer.

The exercise is still loading — the controls unlock in a moment. If nothing happens, JavaScript is switched off; you can read the material, but the exercise needs it.

Critique the AI response

Read each claim and mark it as Verified, Unverified or Rejected. For each rejected claim, write a short justification.

○ 0 of 6 claims marked

Source: Chat language model with general knowledge of emergency services · a prepared sample the whole class analyses.
Claim 1

The triage method, as used in emergency services, is classified into four categories: green (can wait), yellow (delayed), red (immediate treatment needed), and black (expectant or life threat too high).

Claim 2

In crisis management, a prerequisite for good decision-making is that the decision-maker is not under physical or psychological pressure themselves. For these reasons, AI should make all triage decisions at the scene of an accident instead of trained firefighters.

Claim 3

Information overload at an accident scene, where multiple updates arrive simultaneously, can lead to an individual getting stuck in an analytical role and forgetting the prioritization of actions. This phenomenon is well-known in research on decision-making under pressure.

Claim 4

Studies show that AI correctly diagnoses emergency patients in a hospital ward in 94 percent of cases, which is higher than what is common among human doctors. This means that hospitals should use AI as the primary tool in triage rather than doctors.

Claim 5

A post-incident review, or post-mortem, is a structured process where a team reviews an incident after it occurs with the aim of understanding what happened and learning from mistakes. It is a core element of the safety culture among airlines, hospitals, and fire departments.

Claim 6

Substrate judgment is the ability of a trained expert to read a situation and take appropriate action based on experience and physical perception, not just written procedures. This ability is incomprehensible to AI because machines have no physical experience.

○ Mark 5 more claims (minimum 5 in total). Reject at least 2 claims (currently: 0)

Requirements: 5 claims marked · 2 rejected · 30 words of justification

Compare answers

Here you see two different ways to ask the AI for the same thing. Choose the answer you trust more and write a short justification, and the explanation will open.

Comparison 1 of 2

Prompt

Compare two AI answers about what a firefighter should do when two groups of injured people need help simultaneously but only one team is on site.

Answer A

The firefighter should help those who are worst off first. It is important to be quick and prioritize correctly. AI could help with this.

Answer B

In START triage (Simple Triage and Rapid Treatment), each individual is approached in sequence and three factors are assessed: respiration (is it present, is the rate over 30 per minute), circulation (is a radial pulse present), and mental status (does the individual follow simple commands). Those who are tagged black (impossible rescue or no respiration after opening the airway) are left lying while others are categorized. Reds receive help before yellows and greens. This system is used by many emergency service systems, including the US fire service and FEMA, but implementation varies by country. The system was originally developed in California in the 1980s. The student should always verify whether their training is based on this or another system.

- 0 / 5 words

- Choose an answer to continue

Comparison 2 of 2

Prompt

Compare two AI answers about how physical presence at an accident scene changes a person's judgment.

Answer A

At an accident scene, a person is different. The body reacts and it is harder to think clearly. AI can help process these emotions.

Answer B

At an accident scene, cognitive tunneling can occur: the human mind narrows its focus under high pressure and concentrates on a single problem, e.g., a bleeding wound, while other urgent situations go unnoticed. This is described in Gary Klein's research on Naturalistic Decision Making, where he studied how firefighters make decisions in the field. Physical presence also provides sensory information that is not in data: the smell of smoke, heat on the skin, sounds that indicate the spread of fire. This information is not verifiable by an AI operating on text data alone. Note that Klein's research dates from the 1980s and 1990s and his work has been criticized; sources should be reviewed.

- 0 / 5 words

- Choose an answer to continue

Self-check rubric, accountability document

Mark each criterion once you have met it. When you mark it, a three-level descriptor opens, compare your own work against each level.

- 0 of 5 criteria confirmable

Final decision

No claims found. Finish the critique exercise first, that is where the accountability document draws your data from.