CODI Latent Token Dashboard
input token
latent ref
— Predicted = top-1 decoded token from logit lens at each latent position. z5/z6 are greyed out (causally dead).
Q0: Janet’s ducks lay 16 eggs per day. She eats three for breakfast every morning and bakes muffins for ...
CoT: <<16-3-4=9>> <<9*2=18>> → 18.0
z0attends: 16 akes <BOT> and three→ 13
z1attends: <LAT0> ? <BOT> and $→ than
z2attends: <LAT0> <LAT1> the four 16→ 9
z3attends: <LAT1> <LAT2> 2 ? $→ -
z4attends: <LAT0> <LAT1> <LAT3> <LAT2> four→ 9
z5attends: <LAT3> <LAT1> <LAT4> <LAT2> 2→ -
z6attends: <LAT0> <LAT1> <LAT3> <LAT5> four→ 9
Prediction: The answer is: 18<|endoftext|>
Q1: A robe takes 2 bolts of blue fiber and half that much white fiber. How many bolts in total does it t...
CoT: <<2/2=1>> <<2+1=3>> → 3.0
z0attends: 2 <BOT> . ? How→ 1
z1attends: <LAT0> ? half How .→ \n
z2attends: 2 <LAT1> . half that→ 1
z3attends: <LAT1> ? <LAT0> <LAT2> How→ >>
z4attends: 2 . half <LAT3> <LAT1>→ 1
z5attends: <LAT3> <LAT1> ? <LAT4> <LAT0>→ >>
z6attends: 2 . half <LAT5> that→ 1
Prediction: The answer is: 3<|endoftext|>
Q3: James decides to run 3 sprints 3 times a week. He runs 60 meters each sprint. How many total meters ...
CoT: <<3*3=9>> <<9*60=540>> → 540.0
z0attends: 3 3 <BOT> ? He→ 9
z1attends: <LAT0> ? 60 meters .→ The
z2attends: 3 <LAT1> 3 He <LAT0>→ 9
z3attends: <LAT1> <LAT0> <LAT2> ? 60→ The
z4attends: 3 3 <LAT3> <LAT1> He→ 9
z5attends: <LAT3> <LAT1> <LAT4> <LAT0> <LAT2>→ The
z6attends: 3 3 <LAT5> <LAT3> <LAT1>→ 9
Prediction: The answer is: 540<|endoftext|>