Found a paper [0] that discusses a possible mechanism [1]:
> The manual for Open Sesame! mentions that some neural learning mechanism is used but does not give further explanations [...] (Caglayan et al. 1996), however claim that Open Sesame! makes use of a variation of adaptive resonance theory-2 (ART-2) algorithm of Carpenter and Grossberg.
[0] https://api.digie.ai/publications/Hoyle-paper-review.pdf