Based is an efficient architecture inspired by recovering attention-like capabilities (i.e., recall). We do so by combining 2 simple ideas: Short sliding window attention (e.g., window size 64), to ...