SeanFDZ / macmind

What it does

MacMind is a 1,216-parameter single-layer single-head transformer that learns the bit-reversal permutation, the opening step of the Fast Fourier Transform, from random examples. Every line of the neural network is written in HyperTalk, a scripting language from 1987 designed for making interactive card stacks, not matrix math. It has token embeddings, positional encoding, self-attention with scaled dot-product scores, cross-entropy loss, full backpropagation, and stochastic gradient descent. No compiled code. No external libraries. No black boxes.