Failure of Linear/Hybrid Model in the QMKAR Task
In the Test-time regression paper, the authors analyze sequence modeling with a test-time regression framework using the concept of associative memory. Specifically, given a set of associations (\mathbf{k}_1, \mathbf{v}_1), ..., (\mathbf{k}_T, \mathbf{v}_T), an associative memory system performs associative recall: return \mathbf{v}_i when given \mathbf{k}_i. To construct such a system m, we can formulate the problem as a weighted regression problem:
1430 words
|
7 minutes
1