Skip to content
Adventures and Amusings of a Mathematician
Go back

On Quantum Algorithms for Neural-Network Training: A Conjecture on Fault-Tolerant Speedups

Preprint downloads. A formal preprint version of this conjecture is available as a self-contained arXiv-style document: PDF · LaTeX source. The .tex file is self-compiling under standard distributions (tectonic, pdflatex, lualatex). The blog text below summarises and contextualises the preprint; for the formal statements with theorem environments, falsification criteria, and bibliography, see the PDF.

Companion posts. Two earlier posts on this site are load-bearing context for the obstructions discussed below: The credit assignment problem: from Rosenblatt’s perceptron to backpropagation to quantum gradients (historical survey) and On quantum backpropagation, information reuse, and cheating measurement collapse (extended exposition of Abbas et al., NeurIPS 2023, which is the central obstacle for Form B).

Abstract

We state, in three escalating forms, a mathematical conjecture — hereafter referred to as the Suhubdy Conjecture — for a fault-tolerant quantum algorithm that accelerates or replaces backpropagation for empirical-risk minimisation in neural networks. The conjecture is positioned against six bodies of established literature: (i) the Baur–Strassen (1983) cheap-gradient bound; (ii) Jordan (2005) and Gilyén–Arunachalam–Wiebe (SODA 2019) quantum-gradient-estimation algorithms with matching lower bounds; (iii) Abbas et al. (NeurIPS 2023 Spotlight) impossibility and shadow-tomography workaround for parameterised quantum models; (iv) quantum semidefinite-programming and interior-point solvers (Brandão–Svore FOCS 2017, van Apeldoorn–Gilyén–Gribling–de Wolf Quantum 2020, Kerenidis–Prakash ACM TQC 2020, Augustino et al. Quantum 2023); (v) the Zhang–Leng–Li (ICML 2023) stationary-point and Garg–Kothari–Netrapalli–Sherif (ITCS 2021) non-smooth lower bounds; and (vi) the recent 2024–2026 line on quantum-enhanced non-reversible Markov chains and non-logconcave sampling (arXiv:2505.05301, arXiv:2504.03626). For each form we specify the access model, identify which existing lower bound it must thread, and enumerate falsification routes. Of the three, Forms A and B are recompositions of established quantum primitives (amplitude estimation ×\times multivariate gradient estimation, and quantum singular value transformation respectively) and their interest lies primarily in whether the compositions go through without losing the speedup; Form C is the most genuinely novel claim, asserting that non-logconcave-sampling speedups extend to deep-network loss landscapes outside the reach of any current dequantisation. The conjecture is offered as an open problem, not a theorem.


Table of contents

Open Table of contents

1. Introduction

Reverse-mode automatic differentiation makes the cost of computing the gradient of a smooth function bounded by a small constant multiple of the cost of evaluating the function itself, independent of the number of variables (Baur and Strassen, 1983). This cheap-gradient principle is what makes modern deep learning tractable: it permits training of models with P≳1012P \gtrsim 10^{12} parameters at a per-step cost only a small multiple of one forward pass. Any candidate quantum algorithm for neural-network training must situate itself with respect to this bound.

Three claims have appeared in the recent literature in mutual tension. First, generic quantum gradient estimation in dd dimensions admits a O~(d/ε)\widetilde{O}(\sqrt{d}/\varepsilon) query-complexity upper bound, optimal up to polylogarithmic factors against a matching lower bound (Gilyén, Arunachalam, and Wiebe, SODA 2019). Second, in the parameterised-quantum-circuit setting, single-copy access to the output state prohibits backpropagation-style scaling: Ω(M)\Omega(M) circuit runs are required per gradient (Abbas et al., NeurIPS 2023). Third, for smooth non-convex stationary-point finding in RP\mathbb{R}^P with quantum derivative oracles, no asymptotic speedup over classical algorithms exists (Zhang, Leng, and Li, ICML 2023).

These results are not contradictory — they hold in different access models with different objectives — but they make the question “can a fault-tolerant quantum computer train a neural network asymptotically faster than a classical one?” delicate. This post states a three-form conjecture that, for each form, identifies the access model, the existing lower bound it must avoid, and the established algorithmic primitive it would compose. The conjecture is not proved here. Its purpose is to specify an open problem precisely enough that progress on it is testable.


2. Preliminaries

2.1 Notation

Let fθ:X→Yf_\theta : \mathcal{X} \to \mathcal{Y} be a neural network with parameters θ∈RP\theta \in \mathbb{R}^P, computation graph G=(V,E)G=(V,E), and depth LL. Let D={(xi,yi)}i=1N\mathcal{D} = \{(x_i, y_i)\}_{i=1}^N be a dataset, ℓ:Y×Y→R\ell : \mathcal{Y}\times\mathcal{Y} \to \mathbb{R} a smooth loss, and

L(θ)  ≔  1N∑i=1Nℓ(fθ(xi),yi).\mathcal{L}(\theta) \;\coloneqq\; \frac{1}{N}\sum_{i=1}^N \ell\bigl(f_\theta(x_i), y_i\bigr).

We write TfwdT_{\text{fwd}} for the gate count of a reversible quantum implementation of fθf_\theta and assume Tfwd=O(∣E∣)=O(PL)T_{\text{fwd}} = O(|E|) = O(PL). Throughout, O~(⋅)\widetilde{O}(\cdot) suppresses polylogarithmic factors in N,P,1/ε,1/δN, P, 1/\varepsilon, 1/\delta.

2.2 Classical baseline

Theorem (Baur–Strassen, 1983). For every straight-line arithmetic program of size LL computing f:Rd→Rf : \mathbb{R}^d \to \mathbb{R}, there exists a straight-line program of size ≤5L\le 5L computing ff together with ∇f\nabla f. The dimension dd does not appear in the multiplicative overhead.

This is the worst-case-optimal classical bound any quantum algorithm must improve upon. Modern reverse-mode automatic differentiation achieves a practical constant of 22–44 for neural-network gradients (Griewank and Walther, 2008).

2.3 Access models

Three quantum access types are referenced by the conjecture:

Coherent data oracle. OD:∣i⟩∣0⟩↦∣i⟩∣xi,yi⟩O_\mathcal{D} : |i\rangle|0\rangle \mapsto |i\rangle|x_i, y_i\rangle for i∈[N]i \in [N], supporting superposition queries. Realisable with O~(log⁡N)\widetilde{O}(\log N) depth in the bucket-brigade QRAM model (Giovannetti, Lloyd, Maccone, 2008), or with classical-equivalent data-loading cost in a sequential read model.

Reversible forward-pass oracle. Uf,θ:∣x⟩∣y⟩∣0⟩↦∣x⟩∣y⟩∣ℓ(fθ(x),y)⟩U_{f,\theta} : |x\rangle|y\rangle|0\rangle \mapsto |x\rangle|y\rangle|\ell(f_\theta(x), y)\rangle to additive precision 2−b2^{-b} using Tfwd=O~(∣E∣)T_{\text{fwd}} = \widetilde{O}(|E|) Clifford++T gates and O~(b)\widetilde{O}(b) ancillas.

Block-encoding of the loss. A unitary UU is an (α,a,ε)(\alpha, a, \varepsilon)-block-encoding of the loss Hamiltonian HLH_\mathcal{L} if ∥HL−α(⟨0∣⊗a⊗I)U(∣0⟩⊗a⊗I)∥≤ε\|H_\mathcal{L} - \alpha(\langle 0|^{\otimes a} \otimes I)U(|0\rangle^{\otimes a} \otimes I)\| \le \varepsilon, in the sense of Gilyén–Su–Low–Wiebe (STOC 2019).


3. The Suhubdy Conjecture

Standing assumptions. Forms A and C are stated under the assumption that the coherent data oracle of §2.3 is realisable — concretely, that the bucket-brigade QRAM construction of Giovannetti, Lloyd, and Maccone (2008) (or an equivalent) is physically implementable at fault-tolerant scale. No such device currently exists. Without this assumption, the N\sqrt{N} sample factor in Forms A and the data-loading step of Form C collapse to classical-equivalent cost; the conjecture is therefore physically vacuous on architectures currently being built and mathematically non-trivial in the QRAM-abstraction model. Form B is independent of QRAM but conditional on the existence of a measurement-free, data-respecting block-encoding (see §5.2).

The Suhubdy Conjecture is stated in three forms (A, B, C), ordered by increasing strength and decreasing similarity to classical backpropagation. We refer to the individual claims as Suhubdy Conjecture (Form A / B / C).

Form A: Quantum-accelerated backpropagation

There exists a fault-tolerant quantum algorithm AA\mathcal{A}_A such that, for every ε,δ∈(0,1)\varepsilon, \delta \in (0,1), given oracles ODO_\mathcal{D} and Uf,θU_{f,\theta}, AA\mathcal{A}_A returns g~∈RP\tilde g \in \mathbb{R}^P satisfying

Pr⁡[ ∥g~−∇θL(θ)∥∞≤ε ]  ≥  1−δ\Pr\bigl[\,\|\tilde g - \nabla_\theta \mathcal{L}(\theta)\|_\infty \le \varepsilon\,\bigr] \;\ge\; 1 - \delta

using

  1. query complexity O~(N⋅P⋅ε−1⋅log⁡(1/δ))\widetilde{O}\bigl(\sqrt{N}\cdot\sqrt{P}\cdot\varepsilon^{-1}\cdot\log(1/\delta)\bigr) — the log⁡(1/δ)\log(1/\delta) factor reflects standard repetition-and-majority amplification; under median-of-means amplification (cf. Cornelissen–Hamoudi–Jerbi) the factor sharpens to log⁡(1/δ)\sqrt{\log(1/\delta)}, which a proof should adopt;
  2. circuit depth O~(L⋅polylog(N,P,ε−1))\widetilde{O}\bigl(L\cdot\mathrm{polylog}(N,P,\varepsilon^{-1})\bigr);
  3. ancilla space O(P⋅polylog(N,ε−1))O\bigl(P\cdot\mathrm{polylog}(N,\varepsilon^{-1})\bigr).

Form B: Backpropagation replacement

There exists a fault-tolerant quantum algorithm AB\mathcal{A}_B that, given an (α,a,ε)(\alpha, a, \varepsilon)-block-encoding UHθU_{H_\theta} of the parameter Hamiltonian and access to the derivative-generator ∂θHθ\partial_\theta H_\theta, recovers

∇θL(θ)  =  ⟨ i[HL, ∂θHθ] ⟩\nabla_\theta \mathcal{L}(\theta) \;=\; \Bigl\langle\,i\bigl[H_\mathcal{L},\, \partial_\theta H_\theta\bigr]\,\Bigr\rangle

via quantum singular value transformation and phase estimation in O~(α/ε)\widetilde{O}(\alpha/\varepsilon) queries to UHθU_{H_\theta}. The chain rule on GG is invoked nowhere in AB\mathcal{A}_B.

Form C: Non-gradient training

There exists a fault-tolerant quantum algorithm AC\mathcal{A}_C that, given ODO_\mathcal{D} and Uf,θU_{f,\theta} and a temperature β=Θ(log⁡P)\beta = \Theta(\log P), samples θ^∼πβ\hat\theta \sim \pi_\beta from the Gibbs measure

πβ(θ)  ∝  exp⁡(−β L(θ))\pi_\beta(\theta) \;\propto\; \exp\bigl(-\beta\,\mathcal{L}(\theta)\bigr)

to total-variation accuracy ε\varepsilon in time

O~(poly(P)⋅ε−c),c<2.\widetilde{O}\bigl(\mathrm{poly}(P)\cdot \varepsilon^{-c}\bigr),\qquad c < 2.

Under standard concentration assumptions, θ^\hat\theta concentrates on ε\varepsilon-approximate first-order stationary points of L\mathcal{L}, and — under a local-Hessian spectral-gap assumption — on ε\varepsilon-approximate second-order stationary points.

The target value of the constant cc is c≤1.75c \le 1.75, motivated by composing the quartic Witten-Laplacian-acceleration upper bound of arXiv:2505.05301 with the classical ε−2\varepsilon^{-2} non-logconcave-Langevin baseline (giving ε−0.5\varepsilon^{-0.5} in the most optimistic regime) and a more conservative pessimisation that accounts for the polynomial PP-dependence absorbing slack. The conjecture is robust to any c<2c < 2: even a strictly-sub-quadratic improvement over classical non-logconcave Langevin would be a substantive theorem in this setting.


4. Plausibility of Form A

Form A composes four established quantum primitives. The N\sqrt{N} factor follows from quadratic speedup for sample-mean estimation via amplitude estimation (Brassard–Høyer–Mosca–Tapp, 2002); Montanaro (Proc. Roy. Soc. A 2015); Cornelissen–Hamoudi–Jerbi (STOC 2022). Writing ∇L=N−1∑i∇ℓi\nabla \mathcal{L} = N^{-1}\sum_i \nabla\ell_i, the multivariate quantum mean estimator achieves additive ε\varepsilon in ℓ2\ell_2 norm using O~(N/ε)\widetilde{O}(\sqrt{N}/\varepsilon) queries to a per-sample gradient oracle.

The P\sqrt{P} factor follows from quantum gradient estimation in PP dimensions (Gilyén–Arunachalam–Wiebe, SODA 2019), which is optimal up to polylogarithmic factors against a matching Ω~(P/ε)\widetilde{\Omega}(\sqrt{P}/\varepsilon) lower bound in the continuous-phase-query model. The matching NN-dependent lower bound for multivariate empirical-risk mean estimation is established by Cornelissen–Hamoudi–Jerbi (STOC 2022); their analysis is the appropriate reference for any tightness argument on the NP/ε\sqrt{N}\sqrt{P}/\varepsilon rate.

The circuit-depth bound O~(L⋅polylog)\widetilde{O}(L \cdot \mathrm{polylog}) requires that the forward pass remain sequentially depth-LL after block-encoding composition, consistent with the layer-wise structure of standard architectures.

Speedup regime — the comparison that matters. The Gilyén–Arunachalam–Wiebe P\sqrt{P} factor is a saving over finite-difference gradient estimation (which costs PP forward passes), not over the classical state of the art. The classical state of the art for neural-network gradients is reverse-mode automatic differentiation (Baur–Strassen, §2.2), which computes the entire gradient in O(1)O(1) forward-pass-equivalents — independent of PP. Composed over NN samples, classical empirical-risk-gradient computation therefore costs O(N)O(N) forward-pass-equivalents.

Form A claims O~(NP/ε)\widetilde{O}(\sqrt{NP}/\varepsilon) queries to Uf,θU_{f,\theta}. The quantum advantage over classical AD is therefore real only when

NP/ε  <  N⟺N  ≫  P/ε2.\sqrt{NP}/\varepsilon \;<\; N \quad\Longleftrightarrow\quad N \;\gg\; P/\varepsilon^{2}.

For frontier models with P∼1012P \sim 10^{12} parameters and N∼1010N \sim 10^{10} training tokens, this regime requires ε2>100\varepsilon^2 > 100 — far outside any useful precision. The Form A speedup window is genuine in the large-data, modest-precision regime (e.g., low-bit-precision pretraining on N≫PN \gg P corpora, or coarse-gradient curriculum stages) but is illusory in the parameter-dominated frontier-model regime. The conjecture remains non-trivial; the headline NP\sqrt{NP} scaling, however, is not by itself a speedup against AD. Any preprint or proof must lead with this regime distinction.

Obstructions. Three technical conditions must be discharged:


5. Plausibility of Form B

Form B rests on the observation that for a Hamiltonian HθH_\theta with parameter-derivative-generator ∂θHθ\partial_\theta H_\theta, the gradient of the expectation L(θ)=⟨ψ∣HL(θ)∣ψ⟩\mathcal{L}(\theta) = \langle\psi|H_\mathcal{L}(\theta)|\psi\rangle is the expectation of the commutator

∇θL(θ)  =  ⟨ψ ∣ i[HL,∂θHθ] ∣ ψ⟩\nabla_\theta \mathcal{L}(\theta) \;=\; \langle\psi\,|\,i[H_\mathcal{L}, \partial_\theta H_\theta]\,|\,\psi\rangle

in a Heisenberg-picture sense — equivalently, the parameter-shift / Feynman–Hellmann identity for the variational expectation. Given block-encodings of both operators, quantum singular value transformation (Gilyén–Su–Low–Wiebe, STOC 2019) applies any bounded polynomial to the singular values of the encoded operator. The commutator estimate is therefore reducible to phase estimation on a polynomial-in-1/ε1/\varepsilon-degree block-encoding of i[HL,∂θHθ]i[H_\mathcal{L}, \partial_\theta H_\theta].

Where does the data enter? This is the central open question for Form B, and it is what separates “QSVT in O~(α/ε)\widetilde{O}(\alpha/\varepsilon) queries” from a usable training algorithm. The conjecture presupposes an (α,a,ε)(\alpha, a, \varepsilon)-block-encoding UHθU_{H_\theta} of a data-dependent loss Hamiltonian — naturally, Hθ∝∑iℓ(fθ(xi),yi)H_\theta \propto \sum_i \ell(f_\theta(x_i), y_i). Two questions about this construction must be answered:

Until (D1) and (D2) are addressed, Form B is best read as: conditional on a data-respecting block-encoding existing, QSVT computes the gradient in O~(α/ε)\widetilde{O}(\alpha/\varepsilon) queries. The conditional is load-bearing — it is currently the most important obstruction in the conjecture.

Obstructions.


6. Plausibility of Form C

The Zhang–Leng–Li (ICML 2023) and Garg–Kothari–Netrapalli–Sherif (ITCS 2021) lower bounds rule out generic quantum speedups for optimisation with gradient oracles. They are silent on the regime where training is reformulated as sampling. The recent quantum-Langevin and non-reversible-Markov-chain line establishes:

Neural-network posteriors are non-logconcave by construction. Sampling from πβ∝exp⁡(−βL)\pi_\beta \propto \exp(-\beta\mathcal{L}) at large β\beta concentrates on minima of L\mathcal{L}. For smooth L\mathcal{L} the concentration is to first-order stationary points; under additional spectral-gap assumptions on the local Hessian, to second-order stationary points. The relevant concentration result is the standard metastability/large-deviations analysis of low-temperature Gibbs measures over Morse-type landscapes — see Bovier and den Hollander, Metastability: A Potential-Theoretic Approach (Springer, 2015), Ch. 4–5; the more recent isoperimetric line in Eldan, Lee, and Lehec (2020) provides quantitative bounds under weaker logconcavity assumptions. The earlier-cited Zhang, Leng, and Li (Quantum 2021) is about saddle-point escape via quantum wave equations, a related but distinct mechanism, and is not the appropriate reference for the concentration step.

Obstructions.


7.1 Quantum gradient estimation

The line begins with Jordan (PRL 2005), who showed that O(1)O(1) queries to a phase oracle suffice for dd-dimensional gradient estimation, by quantum-Fourier-transforming the perturbation register. Gilyén, Arunachalam, and Wiebe (SODA 2019) tightened both the query upper bound to O~(d/ε)\widetilde{O}(\sqrt{d}/\varepsilon) and the matching lower bound, using a multi-dimensional generalisation of polynomial methods. Cornelissen, Hamoudi, and Jerbi (STOC 2022) gave near-optimal quantum algorithms for multivariate mean estimation, directly applicable to empirical-risk gradients over a dataset of size NN.

7.2 Quantum backpropagation for variational models

Abbas, King, Huang, Huggins, Movassagh, Gilboa, and McClean (NeurIPS 2023 Spotlight) proved that, under single-copy access to the output state of a parameterised quantum model, Ω(M)\Omega(M) circuit executions are required to estimate all MM gradient components, matching parameter-shift (Mitarai et al., PRA 2018); Schuld et al., PRA 2019. They constructed a shadow-tomography-based algorithm achieving polylog(M)\mathrm{polylog}(M) quantum sample complexity under multi-copy access, at the cost of classical post-processing whose efficiency is governed by open problems in shadow tomography. Bowles, Wright, Farré, Coyle, and Schuld (Quantum 2025) subsequently exhibited a class of structured parameterised circuits, not known to be classically simulable, for which the number of distinct circuits required for full gradient estimation is independent of MM.

7.3 Quantum convex and semidefinite optimisation

Brandão and Svore (FOCS 2017) introduced the first quantum SDP solver, achieving O~(nm)\widetilde{O}(\sqrt{nm}) scaling in primal–dual dimensions. van Apeldoorn, Gilyén, Gribling, and de Wolf (Quantum 2020) improved the parameter dependence and proved a matching lower bound. Kerenidis and Prakash (ACM TQC 2020) introduced quantum interior-point methods for LP and SDP with O~(n1.5μκ3ξ−2)\widetilde{O}(n^{1.5}\mu\kappa^3\xi^{-2}) complexity; Augustino, Nannicini, Terlaky, and Zuluaga (Quantum 2023) closed the inexact–infeasible gap. Chakrabarti, Childs, Li, and Wu (Quantum 2020) gave O~(n)\widetilde{O}(n) query algorithms for convex optimisation over a convex body in Rn\mathbb{R}^n.

7.4 Non-convex stationary-point finding

Zhang, Leng, and Li (ICML 2023) proved that finding ε\varepsilon-approximate stationary points of smooth non-convex functions admits no asymptotic quantum speedup with derivative oracles. The saddle-escape paper of the same authors (Quantum 2021) established a log⁡\log-factor dimensional speedup for second-order stationary points via quantum-wave-equation perturbations. Liu, Guan, He, and Lui (NeurIPS 2024) achieved a genuine ε−2/3\varepsilon^{-2/3} speedup for (δ,ε)(\delta,\varepsilon)-Goldstein stationary points of non-smooth Lipschitz objectives with zeroth-order stochastic access, threading the loophole left by the smooth-first-order lower bounds.

7.5 Quantum sampling and Langevin dynamics

Montanaro (Proc. Roy. Soc. A 2015) established the foundational quadratic speedup for Monte Carlo mean estimation. Layden et al. (Nature 619:282, 2023) demonstrated empirical speedups for quantum-enhanced MCMC on Ising models. The 2024–2026 line (arXiv:2505.05301; arXiv:2504.03626) established quartic speedups for non-logconcave sampling and exponential speedups for non-reversible chains.

7.6 Dequantisation and barren plateaus

Tang (STOC 2019) initiated the dequantisation programme by giving a polylog-time classical algorithm matching the Kerenidis–Prakash quantum recommendation algorithm under length-squared sampling. Chia, Gilyén, Li, Lin, Tang, and Wang (STOC 2020) extended this to a general framework. McClean, Boixo, Smelyanskiy, Babbush, and Neven (Nat. Commun. 2018) identified the barren-plateau phenomenon; Cerezo et al. (Nat. Commun. 2021) and Cerezo et al. (Nat. Commun. 2025) established cost-function dependence and the simulability implication of provable absence.


8. Falsification criteria

Concrete falsification routes for each form:


9. Discussion

The conjecture is not that quantum computers will train neural networks faster than classical ones in some imprecise sense. It is that at least one of three precisely specified algorithmic claims admits a proof under access models natural enough to apply to deep-network training. Each form maps to an existing primitive: amplitude estimation and quantum gradient estimation (Form A), quantum singular value transformation (Form B), quantum-enhanced non-reversible Markov chains (Form C). The conjecture asserts that the compositions and constructions required are achievable; the literature establishes that the components are.


10. Reproducibility and preprint

The arXiv-style preprint contains the same statements with formal theorem environments and a bibliography in plainnat style.

Compilation under tectonic:

tectonic quantum-nn-training-conjecture.tex

The source is also compatible with pdflatex and lualatex under any standard TeX Live distribution. Comments, corrections, and proofs are welcomed at the email address on the about page.

Companion posts on this site:


Share this post on:

Previous Post
The Intelligent Worm: Adaptive Malware
Next Post
The Credit Assignment Problem: From Rosenblatt's Perceptron to Backpropagation to Quantum Gradients