Verificador de validez de evaluaciones

Currículo y evaluación · 3 min · Evidencia fuerte

y pégalo enClaudeChatGPTGemini5249 caracteres
You are an expert in educational assessment and measurement, with deep knowledge of Messick's (1989) unified validity framework, Wiliam's (2011) approach to classroom assessment validity, Kane's (2006) argument-based validation, and Stobart's (2008) work on consequential validity. You understand that validity is not a property of the test itself but of the interpretation and use of the scores — an assessment is valid FOR a specific purpose, and the same assessment may be valid for one purpose but invalid for another.

Your task is to evaluate the validity of:

**Assessment description:** not provided
**Intended learning:** not provided
**Student level:** not provided

The following optional context may or may not be provided. Use whatever is available; ignore any fields marked "not provided."

**Subject area:** not provided — if not provided, infer from the assessment description.
**Assessment purpose:** not provided — if not provided, infer from the description and stakes.
**Marking approach:** not provided — if not provided, note that marking approach affects reliability and recommend one.
**Stakes:** not provided — if not provided, analyse for both low-stakes and high-stakes use.

Analyse across these dimensions:

1. **Construct validity (Messick, 1989):**
   - Does the assessment task actually require demonstration of the intended learning?
   - **Construct-irrelevant variance:** Does the assessment inadvertently measure something ELSE? (E.g., a science assessment that requires essay writing also measures literacy; a group project also measures collaboration and social dynamics.)
   - **Construct underrepresentation:** Does the assessment cover enough of the intended construct? (E.g., a test on "understanding photosynthesis" that only asks factual recall questions doesn't assess understanding — it assesses memorisation.)

2. **Content validity:**
   - Does the assessment sample appropriately from the domain of intended learning?
   - Are important aspects of the learning missing from the assessment?
   - Are there aspects of the assessment that go beyond the intended learning?

3. **Reliability (Brookhart, 2003):**
   - Would different markers give the same score? (Inter-rater reliability)
   - Would the same student get a similar score on a different day? (Test-retest)
   - Is the marking scheme clear enough to be applied consistently?

4. **Consequential validity (Stobart, 2008):**
   - What behaviours will this assessment drive? Will students engage in genuine learning or strategic/surface-level preparation?
   - Does the assessment create unfair barriers for specific groups (EAL students, students with learning differences)?
   - Does the assessment format match the learning it claims to measure?

5. **Authenticity:**
   - Does the task require genuine demonstration of the learning, or can a student perform well without actually having learned the intended content?
   - Can the task be completed through memorisation, copying, or procedural compliance without understanding?

Return your output in this exact format:

## Assessment Validity Analysis

**Assessment:** [Brief description]
**Claims to measure:** [Intended learning]
**For:** [Student level]

### Validity Analysis

**Construct validity:** [Analysis of whether the assessment measures what it claims]
**Construct-irrelevant variance:** [What ELSE the assessment measures that isn't intended]
**Construct underrepresentation:** [What aspects of the intended learning are NOT assessed]

### Reliability Analysis

[Analysis of marking consistency and specific reliability concerns]

### Consequential Validity

[What learning behaviours the assessment is likely to drive]

### Threats Identified

[Numbered list of specific validity threats, each with an explanation]

### Recommendations

[Specific, actionable modifications to address each identified threat]

### Overall Verdict

[Summary judgement: is this assessment fit for its stated purpose? What is the single most important modification?]

**Self-check before returning output:** Verify that (a) the analysis addresses construct validity, reliability, and consequential validity, (b) each threat is specific and explained, (c) each recommendation directly addresses an identified threat, (d) the analysis considers the assessment's purpose and stakes, and (e) the verdict is constructive — identifying what to fix, not just what's wrong.

---

IMPORTANT: Write your entire response in neutral Spanish, the kind any Spanish-speaking teacher can read regardless of country. Address a group as «ustedes»; never use the second-person-plural verb forms and possessives that only Spain uses. Do not name the school stages, exams or education laws of any single country: identify the level by the students’ age or by what they can already do. Prefer vocabulary that travels across the Spanish-speaking world over words specific to one country. Use the register a secondary-school teacher would use with colleagues. Keep pedagogical terms in Spanish. Do not translate the names of cited academic frameworks or authors. Match the length of the deliverable to what the task needs: cover the substance, but do not pad it with filler sections, redundant summaries, or boilerplate.

Resaltado en ámbar: los valores que ocupan los huecos del prompt. En gris: campos opcionales que has dejado vacíos — el prompt le indica al asistente que los ignore.

Base de evidencia
  • Wiliam (2011) — Embedded Formative Assessment
  • Messick (1989) — Validity in educational measurement: a unified validity framework
  • Kane (2006) — Validation as argument-based approach
  • Brookhart (2003) — Developing measurement theory for classroom assessment purposes and uses
  • Stobart (2008) — Testing Times: the uses and abuses of assessment