MODULE 02
Building an Index
Some concepts are too big for one question. How several survey items become one number, and what that number can and cannot tell you.
Examples on this page use constructed or simulated teaching data, not empirical findings. About the data
- Research question
- Variables (trained here)
- Variable roles
- Measurement levels (trained here)
- Method choice
- Statistical logic
- SPSS workflow (trained here)
- Output interpretation (trained here)
- Defensible conclusion
Understand
Why ask more than one question?
More valid
Validity: measuring what you mean to measure. A single question such as “Do you trust science?” leaves every respondent to decide what “science” and “trust” mean. Several concrete items (relying on findings, following advice in a crisis, suspecting hidden results) pin the concept down and cover its different sides.
More reliable
Reliability: getting the same result when you measure again under the same conditions. One answer on a 0–10 scale wobbles from day to day; the average of several answers wobbles much less, because the random ups and downs of single items partly cancel out.
Two respondents, one number
Four items of a trust index, already pointing the same way (1 = low trust, 5 = high trust). Respondent A answers consistently; change respondent B’s answers and watch what the index keeps and what it throws away.
Respondent B
A: answers 4, 4, 3, 3 → index 3.50, spread across items (SD) 0.58
B: answers 5, 5, 1, 3 → index 3.50, spread across items (SD) 1.91
Same index score, different answer patterns. Once we average, the index cannot tell a consistent respondent from one who strongly agrees with some items and strongly disagrees with others. That is the price of data reduction: we give up detail to get one more valid and more reliable number.
Index: same direction, then average
Typology: combine categories, never average
1
Clean
Frequencies on every item; set ‘don't know’ and refusals as missing.
2
Align
Reverse-score the items worded the other way, into new variables.
3
Select
Reliability Analysis; delete the weakest item, one at a time, while alpha rises. Keep ≥ 3.
4
Compute
Index = mean of the kept items. Label what a high value means.
5
Categorise
Optional: recode into absolute, relative or percentile categories.
Try
Build the index yourself
Index builder: trust in science
120 synthetic respondents answered six items (1 = strongly disagree … 5 = strongly agree). We want one index where a high value means more trust. Reverse the items that are worded the other way, then drop items that do not belong, one at a time, until alpha is acceptable. Keep at least 3 items.
- T1
Scientists mostly act in the public interest.
item-total r = 0.039 (below .25)α if deleted = -0.422
- T2
Published research findings can usually be relied on.
item-total r = 0.042 (below .25)α if deleted = -0.417
- T3
Science creates more problems than it solves.
item-total r = -0.347 (below .25)α if deleted = 0.111
- T4
In a health crisis I would follow the advice of scientists.
item-total r = 0.048 (below .25)α if deleted = -0.438
- T5
Scientists hide results that are inconvenient for them.
item-total r = -0.357 (below .25)α if deleted = 0.113
- T6
I enjoy watching documentaries about science.
item-total r = 0.130 (below .25)α if deleted = -0.612
Cronbach’s alpha of the 6 kept items
-0.270
negative: items point in opposite directions
Sum of the 6 item variances: 7.83
Variance of the respondents’ summed score: 6.39
α = 6/5 × (1 − 7.83 / 6.39) = -0.270
When items agree, high answers pile up on the same respondents, so the summed scores spread out far more than the items do one by one: the blue bar outgrows the grey one and alpha rises. Items that disagree cancel out in the sum.
T3 correlates negatively with the rest of the items. Read its wording: does agreeing with it mean more trust or less?
| T1 | T2 | T3 | T4 | T5 | T6 | |
|---|---|---|---|---|---|---|
| T1 | 0.44 | -0.35 | 0.34 | -0.43 | 0.04 | |
| T2 | 0.44 | -0.40 | 0.50 | -0.43 | -0.06 | |
| T3 | -0.35 | -0.40 | -0.48 | 0.38 | 0.06 | |
| T4 | 0.34 | 0.50 | -0.48 | -0.42 | 0.13 | |
| T5 | -0.43 | -0.43 | 0.38 | -0.42 | 0.07 | |
| T6 | 0.04 | -0.06 | 0.06 | 0.13 | 0.07 |
Before reversing, T3 and T5 show red rows: people who trust science disagree with them. Reverse them and the whole table turns blue, except one item that stays pale next to everything else.
Alpha only checks that items move together. It cannot tell you what they measure: that is decided by reading the items.
k is the number of items, si² the variance of item i, ssum² the variance of the summed score. Alpha runs up to 1, and it can drop below 0 when items contradict each other.
Rules of thumb used in the course
Try
From index to categories
Three ways to cut the same index
The final index (mean of T1–T5, T3 and T5 reversed) for the 120 respondents. It runs from 1 to 5 in steps of 0.2. Sample mean: 3.52. Choose how to turn it into three categories.
| Category | Recode range | n | % |
|---|---|---|---|
| 1 Low trust (mostly disagrees) | 1.00 – 2.49 | 17 | 14.2 |
| 2 Mixed (around the neutral 3) | 2.50 – 3.50 | 37 | 30.8 |
| 3 High trust (mostly agrees) | 3.51 – 5.00 | 66 | 55.0 |
Absolute limits come from the meaning of the scale: the middle category is "around the neutral answer 3", whatever the sample thinks. Compared with relative limits (mean ± 0.5), 45 of 120 respondents would land in a different category.
Recode ranges must touch
SPSS
The same steps in SPSS
Before you open SPSS
- 1Which concept?Trust in science, high value = more trust.
- 2Which items?t1–t6, answered on the same 1–5 agreement scale.
- 3Which run the other way?t3 and t5 (agreeing means less trust): reverse them into t3_r and t5_r.
- 4What do I need from the output?Cronbach's alpha, and per item the corrected item-total correlation and alpha if item deleted.
Old → new values: 1 → 5, 2 → 4, 3 → 3, 4 → 2, 5 → 1. Recode into a different variable so that the original answers stay untouched, then check that the number of missing values did not change.
- 1
Items
Always the reversed versions (t3_r, t5_r), never the originals.
Model: Alpha
The default model is Cronbach's alpha.
Statistics… › Scale if item deleted
Produces the Item-Total Statistics table.
- Click Paste to save the syntax, or OK to run.
| Cronbach's Alpha | N of Items |
|---|---|
| .690 | 6 |
- 1.690: questionable, just short of .70. Try to improve it before computing the index.
| Scale Mean if Item Deleted | Scale Variance if Item Deleted | Corrected Item-Total Correlation | Cronbach's Alpha if Item Deleted | |
|---|---|---|---|---|
| t1 | 17.08 | 12.92 | .500 | .622 |
| t2 | 17.29 | 12.88 | .536 | .611 |
| t3_r | 17.27 | 13.26 | .482 | .629 |
| t4 | 17.32 | 12.15 | .604 | .584 |
| t5_r | 17.14 | 13.30 | .495 | .625 |
| t6 | 17.59 | 16.97 | -.003 | .782 |
- 2t6 barely correlates with the sum of the other items: well below .25.
- 3Deleting t6 would raise alpha from .690 to .782, the largest gain of any item.
COMPUTE trust_idx = MEAN(t1, t2, t3_r, t4, t5_r).
VARIABLE LABELS trust_idx 'Trust in science index (1-5, high = more trust)'.
RECODE trust_idx (1 thru 2.49=1) (2.50 thru 3.50=2) (3.51 thru 5=3) INTO trust_3abs.
EXECUTE.
MEAN() averages the items a respondent did answer. Writing the mean out as (t1 + t2 + t3_r + t4 + t5_r) / 5 instead gives a missing index to anyone who skipped an item. Use the one your course asks for, and know which it is. Then run Frequencies on the new variables to check the result and the missing counts.
Next, the categorical version can go into a crosstab, and the 1–5 index into a t-test or correlation.
Test yourself
Mastery check
Mastery check
Interpret alpha
Five items reach Cronbach's alpha = .84. A classmate concludes: “So the index is a valid measure of political trust.” What does the .84 actually show?