← notesLearning Through Imitation · deep dive: the theory benchmark and the three-parameter modelAgranov, Lopez-Moctezuma, Strack, Tamuz · what a Bayesian would do, and the noisy heuristic people seem to use13 slides · 7.0 min at 1× · built 2026-09-17 06:44
Paused so you can answer in your head. Press space for the answer.

1 of 13 · Q: what do we already know?

Redundant guesses helped, and every group fell well short of Bayes

state: which color holdsthe 6 of 10. Fair coin.8 players, 20 rounds.Guess first, then oneprivate draw each round. paid on one random round: $20 if right, $5 if notothers' signals hiddenothers' signals shownno infoown signals onlysignalsall 8 players' signalsactionsown signals + past guessesallsignals + past guesses0.66observed0.81Bayesian0.83observed> 0.99Bayesian0.79observed0.90Bayesian0.885observed> 0.99Bayesianround 20. observed: read off Figures 1 and 5. Bayesian: Table 2all − signals: +0.051, SE 0.028this lesson1 · where the Bayesian numbers come from2 · the three-parameter model behind the gap

A short recap. An urn holds six balls of one color and four of the other. Eight players guess the majority color for twenty rounds. After each guess, each player gets one private draw that matches the truth sixty percent of the time.

Four treatments vary what you see of the others: nothing, their guesses, their signals, or both. The last is called all.

By round twenty, the all treatment is right about eighty eight percent of the time and signals about eighty three. A Bayesian would pass ninety nine in both.

This lesson takes that benchmark apart, then builds the model the authors use to explain the gap.

2 of 13 · Q: what would a Bayesian do, and how well?

The Bayesian benchmark is a majority vote on the pooled tally, and its accuracy is a binomial sum

151015200.50.60.70.80.91.0Bayesian P(correct) by round, computed exactlyround tsufficient statistic: the tally guess the color that is ahead; flip a coin on a tie group of 8group of 4lone playerround 2, k = 8: correct signals out of 8012345678 Table 2: 0.71lone player moves in pairs: an even-numberedsignal can create a tie, never flip the lead

Every signal carries the same evidence, up or down. So the posterior depends only on the tally, reds minus greens, and the best guess is the color ahead.

That makes the benchmark exact: a binomial tail plus half the chance of a tie. Here it is for one player, four, and eight.

One worked entry: round two, eight signals. Five or more correct has probability zero point five nine four. Half of the ties adds zero point one one six. That gives zero point seven one, matching Table two.

The lone player's curve moves in pairs: an even numbered signal can never flip the lead. At most it creates a tie.

3 of 13 · Q: why are actions worthless to a Bayesian in all, and hard to use in actions?

With signals on screen, actions are screened off. With signals hidden, inverting actions breaks down after one round.

the urnall signals so far all past actions choice noise, independent of the urn with every signal on screen, actionscannot move a Bayesian posterior:all and signals share one benchmarkthe actions treatment: signals private, guesses visibleround 2everyone plays her own firstsignal, so each action revealsone signal exactlyround 3own 2 signals + 7 revealed = 9 Table 2: 0.73hand check from our surveyp.21: round 2 may reveal 7 signalsround 4 onward (our boundary)each guess now blends privatesignals with what everyone alreadyinferred. Authors: the actions case isanalytically intractable. Table 2simulates myopic players withcommon knowledge of rationality.

Here is the causal chain. The urn generates signals. Signals generate actions, along with noise unrelated to the urn.

In the all treatment, a Bayesian sees every signal. Given the signals, actions carry no further news about the urn. So all and signals share one benchmark.

In actions, signals are private. In round two everyone plays her own first signal, so each action reveals one signal. Our survey's hand check: nine signals in round three give zero point seven three, matching Table two.

After that, each guess blends private signals with what everybody already inferred. The authors call the case analytically intractable, and simulate myopic players with common knowledge of rationality.

4 of 13 · Q: what does theory say about group size?

Table 2 predicts a group-size gain of similar size in both settings; the data show it with public signals and cannot separate little from none with actions

151015200.50.60.70.80.91.0Bayesian benchmark by round (Table 2)round tallall4gap 0.03 to 0.09actionsactions4gap 0.04 to 0.06Harel, Mossel, Strack, Tamuz (2021)Bayesian, myopic agents who see only actions:add many more agents and the speed oflearning stays bounded.authors' caveat: the theorem is about the long run.Reading it into 20 rounds is “quite a loose interpretation”.measured effect of group size, 95% interval (Table A.3)Table 2 gapTable 2 gapall − all4actions − actions4−0.0500.050.10

With public signals, a bigger group means more draws per round. Table two puts that gain at three to nine points.

With actions only, the same table gives four to six points. The authors cite Harel, Mossel, Strack and Tamuz: for Bayesian myopic agents watching actions, the speed of learning stays bounded as the group grows.

They add a caveat. The theorem concerns the long run, and mapping it onto twenty rounds is, in their words, quite a loose interpretation.

Measured: six and a half points in the all treatment, under one point in actions. Our survey adds that the second interval still overlaps the benchmark gap.

5 of 13 · Q: what is the behavioral model?

Two stimuli, a normalized tally and one sampled peer, pushed through a logistic

-3-2-1012300.250.50.751P(guess red), at the Table 3 estimates for the all treatment two stimuli the pooled tally, shrunkby the sample size last guess of one random other player signals only, no peerpeer guessed redpeer guessed green0.310.09close tally: the sampled peer decides.lopsided tally: the peer barely matters.

Each player gets two stimuli. S is the tally divided by a power of the number of signals. A is the last guess of one random other player, coded plus or minus one.

She guesses red with a logistic probability in beta S plus gamma A. At gamma zero, this is one soft step in the tally.

A red peer slides the curve one way, a green peer the other. These use the estimates for the all treatment.

The gap between the curves is the peer's influence: zero point three one at a tied tally, under a tenth at S equal to two. Imitation switches on when evidence is close.

6 of 13 · Q: how should a lead be scaled by sample size?

The exponent psi sets how fast a fixed lead loses force, and the estimates sit a little above one half

481640801520.50.60.70.80.91.0chance of following a fixed lead of 4 signals signals seen, N (log scale) Griffin and Tversky: a givenlead persuades less asthe sample grows raw difference, Bayes square root sample proportionestimated exponent, 95% credible interval (Table 3)nonesignalsactionsall0.450.500.550.600.650.70why accuracy plateaus: our survey's reading under raw differences: near 1

The third parameter is an exponent, psi. The motivation is Griffin and Tversky: a given lead persuades less as the sample grows.

Take a lead of four signals. At psi zero, the Bayesian case, it convinces equally at any sample size. At psi one, the sample proportion, it fades fast. One half is the square root case.

The estimates run from zero point five two to zero point six three. One half lies outside the intervals for signals and for the all treatment.

Our survey's reading: psi produces the accuracy plateau. By round twenty there, the typical index is only one point six five, which maps to zero point eight four.

7 of 13 · Q: why can a redundant, noisy peer help?

A peer's guess is a second noisy read of the same tally, so a moderate weight on it cuts the error

01234560.300.320.340.360.380.40error probability (our calculation, not the paper's) 0guess wrongguess rightthe decision index, signed so that positive means correct peer right, prob. 0.60peer wrong, prob. 0.40 the peer is a second noisy read of the same tallyminimum 0.376one imitator copies a plain decoder everyone imitates, tally frozen, groupsettled. Dot: 0.37 at the estimate, 0.65

Fix a weak tally, beta S at zero point four one. Alone, she errs forty percent of the time.

Her peer reads the same tally with the same noise. He is right sixty percent of the time and shifts her index by gamma. The paper argues likewise.

These curves are ours. Her error falls to zero point three seven six near gamma of one, then returns to forty percent: pure copying inherits his error.

If everyone imitates and the group settles, the error is zero point three seven at the estimated gamma. It nears zero point three one, as if beta doubled, only for huge gamma. No urn news entered.

8 of 13 · Q: how do you estimate a model whose peer is unobserved?

Integrate the latent peer out: the choice probability is a two-part mixture of logits, weighted by the share on red

the data show who guessed red last round, not which peer subject i sampled (6) 00.5100.51model P(red) against the share of peers on red tied tallyidentification in three moves slope in p at a tied tally: invert the mixture at each history same tally, two sample sizes; then the signal weightTable 3: posterior medians, 95% credible intervals none1.05signals1.02actions1.270.97all1.270.650.91.11.31.50.60.81.0

The data show who guessed red, not which peer a subject sampled. That peer is latent.

The paper integrates it out. The peer is red with probability p, the share of others on red, which gives a mixture of two logits, equation six.

It is linear in p, and at a tied tally the slope gives gamma. Inverting the mixture gives the index. Two sample sizes at one tally give psi.

The fit is Markov chain Monte Carlo. Beta is near one without actions on screen and one point two seven with them. Gamma is zero point nine seven in actions and zero point six five in all.

9 of 13 · Q: do the illustration and the estimates use the same units?

They do not: in our re-simulation, matching the paper's Figure 6 needs beta doubled and gamma left alone

Section 6, the illustrationred chosen with probability “proportional to” simulated at Section 6.2, the estimation Table 3's probability effects confirm this scale signalsno info0.60.70.80.91.0accuracy in round 20. dots: our re-simulation, 10,000+ games eachpaper, Figure 6literal readingsignal weight doubledallall4actionsboth weights doubledin Table 3 units the illustration is about · all treatment estimates: the survey's ruling

This is a finding of our survey. Section six says red has probability proportional to an exponential, and simulates at beta one half and gamma one. Section six point two writes a plain logistic. The first wording fits two rules.

We simulated each reading against the paper's Figure six. Without imitation there is no freedom: the literal reading misses, and doubling beta hits.

With imitation, doubling gamma too overshoots every curve. A gamma of zero point eight to one fits.

So in Table three units the illustration has beta near one and gamma near zero point nine. The all treatment estimate, zero point six five, sits a little below.

10 of 13 · Q: how big is the peer effect?

Figure 3 shows a swing of 0.73, the model's effect at a tied tally is 0.31, and within-bin tallies explain most of the difference (our reading)

the paper's Figure 3 (p.16): P(red) against the share of others on red, by signal strength0.73swing of the yellow Weak line,0.13 up to 0.860.31the same counterfactual in theestimated model, at a tied tallymean tally inside the Weak bin, by peers' share (ours)00.51−100+10share of others on red0.67our simulation of that model,grouped by share: 0.16 to 0.84paper's Figure 9 agrees: 0.19 to 0.83

In the paper's mechanism figure, the Weak line swings by zero point seven three as the others go from all green to all red.

The gold line is the same counterfactual in the estimated model, at a tied tally: zero point three one.

Our survey's explanation is a confound. Inside the Weak bin, tallies range over plus or minus fourteen, and in our simulation the mean tally climbs from minus nine to plus nine with peers' share.

Grouped by share, that simulated model swings by two thirds from a true effect of zero point three one. The paper's Figure nine agrees. Imitation is real. The picture doubles it.

11 of 13 · Q: how well does the model fit, and who differs?

The fit is tight late and low early, and IQ moves the weight on signals while leaving imitation alone

share correct: data (Figure 1) against the fitted model (Figure 8)datamodelread off the figures, ±0.010.60.70.80.9round 20 · allround 20 · signalslate rounds: the model lands within a pointround 2 · allround 2 · signalsround 2: the model is low by 3 to 6 points-3-2-1012300.51Figure 10: the model refit by IQ group, all treatment low IQhigh IQ0.610.68interval for the difference includes zero

Figure eight feeds the estimates back through the model. At round twenty it predicts zero point eight seven five for the all treatment and zero point eight three for signals, within a point of the data.

Round two is weaker. Reading the figures, our survey finds the model low by three to six points.

Figure ten refits that treatment with separate weights by I Q group. Beta is zero point nine nine for low I Q and one point six four for high, and the difference excludes zero.

Gamma is zero point six one and zero point six eight, and that difference includes zero. Both groups lean on peers about equally.

12 of 13 · Q: is there an accuracy-maximizing gamma?

In our re-simulation accuracy peaks at a moderate gamma, above the estimate, and collapses when imitation dominates

01234560.50.60.70.80.9OUR re-simulation in Table 3 units, not a result of the paper the authors' conjecture (p.31–32)some positive weight on actions beatsnone, and the benefit should fade oncethe weight gets too large. No optimalvalue is claimed; proofs are future work.accuracy in round 20estimate 0.65mean over rounds 2 to 20pay is for one random round, so the meanis the paid objective: 0.783 at the estimate,0.802 at the peak near 1.5why heavy imitation collapses (our arithmetic)at a tied tally the group's expectedshare forgets its past over about 0.65 → 1.52 → 44 → 28

The paper conjectures that some positive gamma beats zero and that the benefit fades. The rest is our simulation and arithmetic, in Table three units at the all treatment estimates.

Final round accuracy is zero point eight two without imitation and zero point eight six at the estimate. It peaks near zero point nine around gamma of two, then collapses.

Pay is for a random round, so the mean matters more. It peaks near one and a half, two points above the estimate.

Heavy imitation fails because the group's share of red remembers its past for about half of one plus e to the gamma rounds. At gamma four that exceeds the game.

13 of 13 · Q: what is open, and where next?

The authors leave the theory of their heuristic open, and Appendices F and N are the first checks to read

open problems the authors name (p.4, p.31–32)prove the conjecturessome imitation beats none;too much hurts. The formalanalysis is future work.group size under the heuristicconjecture: little effect whenonly actions are visible, echoingHarel et al. for Bayesiansrobustness of imitationa well-informed central source;ideological agents who ignore thedata; unequal information qualityread nextAppendix F, then Appendix NF: lab against online. Signals ran only online,and the headline effect has p < 0.10.N: random-action subjects. Is the plateau,and so the exponent, partly a lapse rate?Figure H.1, then Harel et al. (2021)H.1: narrower Weak bands; the swing shrinksfrom 0.73 to about 0.46 (our read-off).Harel et al.: the group-size bound at itssource, outside this PDF.

The authors name their open problems. They promise proofs that some imitation beats none, and conjecture that group size matters little under the heuristic when only actions are visible.

They ask how imitation fares against a well informed central source, ideological agents who ignore the data, and unequal information quality.

Start with Appendix F: signals ran only online and the headline effect is marginal. Then Appendix N, on random subjects, which bears on whether psi absorbs lapses.

Then Figure H one, which narrows the Weak band. By our reading the swing drops to zero point four six, as the confound predicts. Last, Harel and coauthors, for the group size bound.

1.00×
keys
space play / pause
slide · , . beat
[ ] speed · c captions · d deeper
m mute · f fullscreen · r replay slide