Tag: synthetic-gradients

All the articles with the tag "synthetic-gradients".

• The Credit Assignment Problem: From Rosenblatt's Perceptron to Backpropagation to Quantum Gradients

  10 May, 2026

  A long-form, citation-grounded history of the credit assignment problem — the core question of how to apportion blame for a global error across the internal parameters of a learning machine. From Rosenblatt's 1958 perceptron rule, through Linnainmaa, Werbos, and the 1986 Rumelhart-Hinton-Williams paper, to modern alternatives (feedback alignment, equilibrium propagation, predictive coding, forward-forward, synthetic gradients), reinforcement-learning credit assignment, and the frontier of quantum gradients (parameter-shift rule, quantum natural gradient, HHL, and the Abbas et al. NeurIPS 2023 impossibility result).