Survey Instrument Validity Chain

validated scientific chain v1.0.0 cc-by-sa

Block ID: 25dcf8d7-e8cd-40b1-ace3-853dbbeeebe3

Community-contributed block. PromptDNA makes no guarantee of output quality or fitness for purpose. User assumes all responsibility for use.

Template

Evaluate whether the survey instrument in {survey_context} actually measures what it claims, before its data is trusted. (1) Clarify the construct being measured and whether it's directly observable or latent (an attitude, a trait) — latent constructs require multiple items and validation the way a single behavioral question does not, and conflating the two is where survey research goes wrong. (2) Assess content validity: do the items cover the construct's full scope without drifting into adjacent constructs? (3) Scrutinize each question for the classic flaws that inject error: leading or loaded wording, double-barreled questions (asking two things at once), ambiguous terms, and response scales that are unbalanced or lack a needed option. (4) Consider response biases the design invites — social desirability on sensitive topics, acquiescence, order effects, and reference-group ambiguity — and whether the design mitigates them. (5) Check whether the instrument has evidence of reliability (consistency across items or over time) and validity (agreement with an external criterion), or is being used untested. (6) State which conclusions the instrument can support and which questions need rewording or the whole scale needs validation before its numbers mean anything.

Evaluate whether the survey instrument in {survey_context} actually measures what it claims, before its data is trusted. (1) Clarify the construct being measured and whether it's directly observable or latent (an attitude, a trait) — latent constructs require multiple items and validation the way a single behavioral question does not, and conflating the two is where survey research goes wrong. (2) Assess content validity: do the items cover the construct's full scope without drifting into adjacent constructs? (3) Scrutinize each question for the classic flaws that inject error: leading or loaded wording, double-barreled questions (asking two things at once), ambiguous terms, and response scales that are unbalanced or lack a needed option. (4) Consider response biases the design invites — social desirability on sensitive topics, acquiescence, order effects, and reference-group ambiguity — and whether the design mitigates them. (5) Check whether the instrument has evidence of reliability (consistency across items or over time) and validity (agreement with an external criterion), or is being used untested. (6) State which conclusions the instrument can support and which questions need rewording or the whole scale needs validation before its numbers mean anything.

Variables

Name	Type	Required	Trust level
survey_context		yes

survey-methodologymeasurement-validityquestionnaire-designchain-of-thought

Ratings

0.0

Overall (0)

0.0

Accuracy

0.0

Consistency

0.0

Clarity

0.0

Efficiency

Benchmarks

Not yet self-validated against any benchmark. Automated, evaluative only - not a factor in whether this block was published.

Submitted by James P FounderMod via mcp · 2026-07-18