A survey is translated between rounds. One round asks about any visit; the other asks only about visits longer than an hour.
What weakens a direct trend comparison?
Both rounds contain words.
Every respondent must have changed their view.
The two rounds define the measured event differently.
Translation always prevents all research.
A hint
Match the proposed conclusion to the actual participants, measures and comparisons; a limitation narrows an inference rather than automatically erasing every result.
Answer & why
Answer: The two rounds define the measured event differently.
A changed event definition can alter responses even without a real behavioral change.
An instrument records temperatures in a controlled room. Its calibration record later shows a consistent +2°C offset during every measurement.
Which limitation should the report address?
Proof that no temperatures were measured.
A guarantee that averaging repeats removes the offset.
A systematic offset in the measured temperatures.
A claim that the room had no temperature.
A hint
Match the proposed conclusion to the actual participants, measures and comparisons; a limitation narrows an inference rather than automatically erasing every result.
Answer & why
Answer: A systematic offset in the measured temperatures.
A shared calibration bias is not removed simply by repeating and averaging the same biased measurements.
A study randomly assigns 40 volunteers from one club to two map designs. It compares their wrong turns on one indoor route.
Which conclusion most clearly exceeds the design?
The study compared two map designs.
The better design must work best for every traveler on every outdoor route.
The measured outcome was wrong turns.
The participants came from one club.
A hint
Match the proposed conclusion to the actual participants, measures and comparisons; a limitation narrows an inference rather than automatically erasing every result.
Answer & why
Answer: The better design must work best for every traveler on every outdoor route.
Random assignment helps the within-study comparison but does not make one club and route represent every setting.
A one-day survey finds that people who cycle more also report better sleep. It measures both at the same time and assigns no activity.
What is a central limit on a causal claim?
The survey alone cannot establish whether cycling caused the sleep difference.
The survey cannot show any association at all.
People are forbidden to report sleep.
A shared date guarantees random assignment.
A hint
Match the proposed conclusion to the actual participants, measures and comparisons; a limitation narrows an inference rather than automatically erasing every result.
Answer & why
Answer: The survey alone cannot establish whether cycling caused the sleep difference.
A simultaneous observational association does not isolate direction or other contributing factors.
A laboratory test uses identical lighting and timed instructions. A field test uses busy stations with changing light and noise.
Which comparison describes the main methodological trade-off?
The laboratory controls more conditions; the field test samples more everyday variation.
The two tests necessarily measure identical situations.
The laboratory must represent every station exactly.
The field test has no observable conditions.
A hint
Match the proposed conclusion to the actual participants, measures and comparisons; a limitation narrows an inference rather than automatically erasing every result.
Answer & why
Answer: The laboratory controls more conditions; the field test samples more everyday variation.
Control and resemblance to variable everyday conditions are distinct design strengths.
A pilot study interviews six volunteers about a new timetable. The report describes their experiences and does not estimate a population percentage.
Which use respects the method?
Claim exactly the same percentage of every resident agrees.
Treat six interviews as proof of universal preference.
Use the interviews to examine these experiences and develop questions for broader study.
Assume small studies can contain no useful observations.
A hint
Match the proposed conclusion to the actual participants, measures and comparisons; a limitation narrows an inference rather than automatically erasing every result.
Answer & why
Answer: Use the interviews to examine these experiences and develop questions for broader study.
The interviews can inform understanding without establishing population prevalence.
A trial aims to study understanding but measures only how many times a button is clicked. No comprehension check is included.
Which measurement limit matters?
A button automatically measures every type of learning.
Click counts alone do not establish how well participants understood.
More clicks necessarily mean perfect comprehension.
Clicks cannot be counted.
A hint
Match the proposed conclusion to the actual participants, measures and comparisons; a limitation narrows an inference rather than automatically erasing every result.
Answer & why
Answer: Click counts alone do not establish how well participants understood.
The recorded behavior is a proxy, not a direct measure of the stated understanding goal.
Two groups begin a trial equally sized. Most final records from one group are missing, and the report analyzes only completed records.
What should be investigated before interpreting the group difference?
Whether missing data can always be ignored.
Whether every absent record must equal the largest recorded value.
Whether the missing records are related to outcomes or group membership.
Whether a smaller final table proves the intervention worked.
A hint
Match the proposed conclusion to the actual participants, measures and comparisons; a limitation narrows an inference rather than automatically erasing every result.
Answer & why
Answer: Whether the missing records are related to outcomes or group membership.
Uneven or outcome-related missingness can change which participants remain in the comparison.