The proposed Staircase SAE architecture using Top-
K activation, as described in Section 3. The total number of features N = n ×
(L + 1) was chosen such that the total parameter count is comparable to the Topk and
Topk-Staircase-Tied-All models.
This is what you want if you want the staircase model. Use this one.
