Attention & Representation

The Approximation Rank of Softmax Attention

Studies the approximation complexity of softmax attention through support geometry and softmax-visible interaction dimension.

2026 · preprint

Project lead

Sharp Geometric Laws and Robust Interaction Dimension

Overview

This project is listed as SoftRank in the QRS project catalog. Its existing title and URL are retained here.

Approximation rank of softmax attention, support geometry, and robust interaction dimension.

My role

I lead this project within QRS. Associated research outputs carry their own author lists.

Current scope

Active research, as recorded in the QRS project registry reviewed on 10 October 2026.

Public resources

Source and status

This description is grounded in the QRSNTU project registry and its generated public project page, reviewed on 10 October 2026. Project status and paper status are separate; related publication records retain their own visibility and metadata.

Associated research

The QRS research registry associates the following public research records with this project. These references are kept separate from this website’s curated publication catalog.

Related publications

2026accepted

The Approximation Rank of Softmax Attention: Sharp Geometric Laws and Robust Interaction Dimension

Yuhe Sui, Jianing Zhang

NeurIPS 2026 NeurReps Extended Abstracts · 2026