The "do nothing" control changes answers too, and the random control cannot see it
The "do nothing" control changes answers too, and the random control cannot see it
Answer changes over 864 rows per arm, two ways of labelling the pictures
Sham, normal labels203
Sham, swapped labels49
Random, normal labels0
Random, swapped labels5
Note: The sham adds the same vector to both pictures, so it swaps nothing and is usually read as a null. Its answer changes land on one letter at rates of 1.00 and 0.88. The random control barely moves the model, so it has nothing to compare against.
Source: Taylor et al., NeurIPS 2026 InterpScience workshop. Qwen2-VL-7B-Instruct.