The directions point almost exactly along the answer-letter direction
The directions point almost exactly along the answer-letter direction
Cosine similarity with the answer-letter direction at layer 29 (1.00 means the same direction)
Color direction0.99
Object direction0.99
Note: The color direction, applied unchanged to a question about shape, gave the same results (r = 0.9999 on prediction rate). A direction that only knows the answer letter would do that.
Source: Taylor et al., NeurIPS 2026 InterpScience workshop. Qwen2.5-VL-3B-Instruct unless noted.