1Theoretical Division, MS B213, Los Alamos National Laboratory, Los Alamos, NM 87545, USA.
2Max Planck Institute for Intelligent Systems, Max-Planck-Ring 4, 72076 Tübingen, Germany.
Find this paper interesting or want to discuss? Scite or leave a comment on SciRate.
Abstract
Variational hybrid quantum-classical algorithms (VHQCAs) have the potential to be useful in the era of near-term quantum computing. However, recently there has been concern regarding the number of measurements needed for convergence of VHQCAs. Here, we address this concern by investigating the classical optimizer in VHQCAs. We introduce a novel optimizer called individual Coupled Adaptive Number of Shots (iCANS). This adaptive optimizer frugally selects the number of measurements (i.e., number of shots) both for a given iteration and for a given partial derivative in a stochastic gradient descent. We numerically simulate the performance of iCANS for the variational quantum eigensolver and for variational quantum compiling, with and without noise. In all cases, and especially in the noisy case, iCANS tends to out-perform state-of-the-art optimizers for VHQCAs. We therefore believe this adaptive optimizer will be useful for realistic VHQCA implementations, where the number of measurements is limited.
Popular summary
However, there is a legitimate concern over whether or not the number of times a quantum state must be prepared and measured (i.e. the number of “shots” taken on the quantum device) in order for the variational algorithm to converge will be prohibitive. This and related questions have sparked a recent interest in researching which classical optimizer should be used in variational algorithms.
In this work, we propose a shot-frugal optimization strategy for variational algorithms that dynamically adjusts the number of shots expended (and thus the precision) for each update step in a stochastic gradient descent procedure that we name iCANS (individual Coupled Adaptive Number of Shots). Allocating measurement resources separately for each component of the gradient estimates, iCANS takes advantage of very inexpensive update steps requiring few shots early in the optimization and smoothly increases the number of shots used in order to achieve a high precision optimization result. We present comparisons between iCANS and other optimizers that have been discussed for the context of variational algorithms and find that iCANS often performs better than these other methods.
► BibTeX data
► References
[1] J. Preskill, Quantum computing in the NISQ era and beyond, Quantum 2, 79 (2018).
https://doi.org/10.22331/q-2018-08-06-79
[2] J. R. McClean, J. Romero, R. Babbush, and A. Aspuru-Guzik, The theory of variational hybrid quantum-classical algorithms, New Journal of Physics 18, 023023 (2016).
https://doi.org/10.1088/1367-2630/18/2/023023
[3] A. Peruzzo, J. McClean, P. Shadbolt, M.-H. Yung, X.-Q. Zhou, P. J. Love, A. Aspuru-Guzik, and J. L. O’brien, A variational eigenvalue solver on a photonic quantum processor, Nature Communications 5, 4213 (2014).
https://doi.org/10.1038/ncomms5213
[4] E. Farhi, J. Goldstone, and S. Gutmann, A quantum approximate optimization algorithm, arXiv:1411.4028 (2014).
arXiv:1411.4028
[5] P. D. Johnson, J. Romero, J. Olson, Y. Cao, and A. Aspuru-Guzik, QVECTOR: an algorithm for device-tailored quantum error correction, arXiv:1711.02249 (2017).
arXiv:1711.02249
[6] J. Romero, J. P. Olson, and A. Aspuru-Guzik, Quantum autoencoders for efficient compression of quantum data, Quantum Science and Technology 2, 045001 (2017).
https://doi.org/10.1088/2058-9565/aa8072
[7] R. LaRose, A. Tikku, É. O’Neel-Judy, L. Cincio, and P. J. Coles, Variational quantum state diagonalization, npj Quantum Information 5, 57 (2019).
https://doi.org/10.1038/s41534-019-0167-6
[8] A. Arrasmith, L. Cincio, A. T. Sornborger, W. H. Zurek, and P. J. Coles, Variational consistent histories as a hybrid algorithm for quantum foundations, Nature Communications 10, 3438 (2019).
https://doi.org/10.1038/s41467-019-11417-0
[9] M. Cerezo, A. Poremba, L. Cincio, and P. J. Coles, Variational quantum fidelity estimation, Quantum 4, 248 (2020).
https://doi.org/10.22331/q-2020-03-26-248
[10] T. Jones, S. Endo, S. McArdle, X. Yuan, and S. C. Benjamin, Variational quantum algorithms for discovering hamiltonian spectra, Physical Review A 99, 062304 (2019).
https://doi.org/10.1103/PhysRevA.99.062304
[11] X. Yuan, S. Endo, Q. Zhao, Y. Li, and S. C. Benjamin, Theory of variational quantum simulation, Quantum 3, 191 (2019).
https://doi.org/10.22331/q-2019-10-07-191
[12] Y. Li and S. C. Benjamin, Efficient variational quantum simulator incorporating active error minimization, Physical Review X 7, 021050 (2017).
https://doi.org/10.1103/PhysRevX.7.021050
[13] C. Kokail, C. Maier, R. van Bijnen, T. Brydges, M. Joshi, P. Jurcevic, C. Muschik, P. Silvi, R. Blatt, C. Roos, et al., Self-verifying variational quantum simulation of lattice models, Nature 569, 355 (2019).
https://doi.org/10.1038/s41586-019-1177-4
[14] S. Khatri, R. LaRose, A. Poremba, L. Cincio, A. T. Sornborger, and P. J. Coles, Quantum-assisted quantum compiling, Quantum 3, 140 (2019).
https://doi.org/10.22331/q-2019-05-13-140
[15] T. Jones and S. C. Benjamin, Quantum compilation and circuit optimisation via energy dissipation, arXiv:1811.03147 (2018).
arXiv:1811.03147
[16] K. Heya, Y. Suzuki, Y. Nakamura, and K. Fujii, Variational quantum gate optimization, arXiv:1810.12745 (2018).
arXiv:1810.12745
[17] S. Endo, Y. Li, S. Benjamin, and X. Yuan, Variational quantum simulation of general processes, arXiv:1812.08778 (2018).
arXiv:1812.08778
[18] K. Sharma, S. Khatri, M. Cerezo, and P. Coles, Noise resilience of variational quantum compiling, New Journal of Physics (2020), 10.1088/1367-2630/ab784c.
https://doi.org/10.1088/1367-2630/ab784c
[19] J. Carolan, M. Mosheni, J. P. Olson, M. Prabhu, C. Chen, D. Bunandar, N. C. Harris, F. N. Wong, M. Hochberg, S. Lloyd, et al., Variational quantum unsampling on a quantum photonic processor, arXiv:1904.10463 (2019).
arXiv:1904.10463
[20] N. Yoshioka, Y. O. Nakagawa, K. Mitarai, and K. Fujii, Variational quantum algorithm for non-equilirium steady states, arXiv:1908.09836 (2019).
arXiv:1908.09836
[21] C. Bravo-Prieto, LaRose, M. Cerezo, Y. Subasi, L. Cincio, and P. J. Coles, Variational quantum linear solver: A hybrid algorithm for linear systems, arXiv:1909.05820 (2019).
arXiv:1909.05820
[22] X. Xu, J. Sun, S. Endo, Y. Li, S. C. Benjamin, and X. Yuan, Variational algorithms for linear algebra, arXiv:1909.03898 (2019).
arXiv:1909.03898
[23] S. McArdle, T. Jones, S. Endo, Y. Li, S. C. Benjamin, and X. Yuan, Variational ansatz-based quantum simulation of imaginary time evolution, npj Quantum Information 5, 1 (2019).
https://doi.org/10.1038/s41534-019-0187-2
[24] C. Cirstoiu, Z. Holmes, J. Iosue, L. Cincio, P. J. Coles, and A. Sornborger, Variational fast forwarding for quantum simulation beyond the coherence time, arXiv:1910.04292 (2019).
arXiv:1910.04292
[25] D. Wecker, M. B. Hastings, and M. Troyer, Progress towards practical quantum variational algorithms, Phys. Rev. A 92, 042303 (2015).
https://doi.org/10.1103/PhysRevA.92.042303
[26] Y. Cao, J. Romero, J. P. Olson, M. Degroote, P. D. Johnson, M. Kieferová, I. D. Kivlichan, T. Menke, B. Peropadre, N. P. Sawaya, et al., Quantum chemistry in the age of quantum computing, Chemical reviews (2018), 10.1021/acs.chemrev.8b00803.
https://doi.org/10.1021/acs.chemrev.8b00803
[27] S. McArdle, S. Endo, A. Aspuru-Guzik, S. Benjamin, and X. Yuan, Quantum computational chemistry, arXiv:1808.10402 (2018).
https://doi.org/10.1103/RevModPhys.92.015003
arXiv:1808.10402
[28] A. Jena, S. Genin, and M. Mosca, Pauli partitioning with respect to gate sets, arXiv:1907.07859 (2019).
arXiv:1907.07859
[29] A. F. Izmaylov, T.-C. Yen, R. A. Lang, and V. Verteletskyi, Unitary partitioning approach to the measurement problem in the variational quantum eigensolver method, arXiv:1907.09040 (2019).
arXiv:1907.09040
[30] T.-C. Yen, V. Verteletskyi, and A. F. Izmaylov, Measuring all compatible operators in one series of a single-qubit measurements using unitary transformations, arXiv:1907.09386 (2019).
arXiv:1907.09386
[31] P. Gokhale, O. Angiuli, Y. Ding, K. Gui, T. Tomesh, M. Suchara, M. Martonosi, and F. T. Chong, Minimizing state preparations in variational quantum eigensolver by partitioning into commuting families, arXiv:1907.13623 (2019).
arXiv:1907.13623
[32] O. Crawford, B. van Straaten, D. Wang, T. Parks, E. Campbell, and S. Brierley, Efficient quantum measurement of pauli operators, arXiv:1908.06942 (2019).
arXiv:1908.06942
[33] P. Gokhale and F. T. Chong, $o(n^3)$ measurement cost for variational quantum eigensolver on molecular hamiltonians, arXiv:1908.11857 (2019).
arXiv:1908.11857
[34] W. J. Huggins, J. McClean, N. Rubin, Z. Jiang, N. Wiebe, K. B. Whaley, and R. Babbush, Efficient and noise resilient measurements for quantum chemistry on near-term quantum computers, arXiv:1907.13117 (2019).
arXiv:1907.13117
[35] G. Verdon, M. Broughton, J. R. McClean, K. J. Sung, R. Babbush, Z. Jiang, H. Neven, and M. Mohseni, Learning to learn with quantum neural networks via classical neural networks, arXiv:1907.05415 (2019).
arXiv:1907.05415
[36] M. Wilson, S. Stromswold, F. Wudarski, S. Hadfield, N. M. Tubman, and E. Rieffel, Optimizing quantum heuristics with meta-learning, arXiv:1908.03185 (2019).
arXiv:1908.03185
[37] K. M. Nakanishi, K. Fujii, and S. Todo, Sequential minimal optimization for quantum-classical hybrid algorithms, arXiv:1903.12166 (2019).
arXiv:1903.12166
[38] R. M. Parrish, J. T. Iosue, A. Ozaeta, and P. L. McMahon, A Jacobi diagonalization and Anderson acceleration algorithm for variational quantum algorithm parameter optimization, arXiv:1904.03206 (2019).
arXiv:1904.03206
[39] J. Stokes, J. Izaac, N. Killoran, and G. Carleo, Quantum natural gradient, arXiv:1909.02108 (2019).
arXiv:1909.02108
[40] L. Balles, J. Romero, and P. Hennig, in Proceedings of the Thirty-Third Conference on Uncertainty in Artificial Intelligence (UAI) (2017) pp. 410–419.
http://auai.org/uai2017/proceedings/papers/141.pdf
[41] G. A. et.al., Qiskit: An Open-source Framework for Quantum Computing, (2019).
https://doi.org/10.5281/zenodo.2562111
[42] D. P. Kingma and J. Ba, in Proceedings of the 3rd International Conference on Learning Representations (ICLR) (2015).
arXiv:1412.6980
[43] J. C. Spall, Multivariate stochastic approximation using a simultaneous perturbation gradient approximation, IEEE transactions on automatic control 37, 332 (1992).
https://doi.org/10.1109/9.119632
[44] Y. LeCun, Y. Bengio, and G. Hinton, Deep learning, Nature 521, 436 (2015).
https://doi.org/10.1038/nature14539
[45] K. Mitarai, M. Negoro, M. Kitagawa, and K. Fujii, Quantum circuit learning, Phys. Rev. A 98, 032309 (2018).
https://doi.org/10.1103/PhysRevA.98.032309
[46] M. Schuld, V. Bergholm, C. Gogolin, J. Izaac, and N. Killoran, Evaluating analytic gradients on quantum hardware, Phys. Rev. A 99, 032331 (2019).
https://doi.org/10.1103/PhysRevA.99.032331
[47] V. Bergholm, J. Izaac, M. Schuld, C. Gogolin, and N. Killoran, Pennylane: Automatic differentiation of hybrid quantum-classical computations, arXiv:1811.04968 (2018).
arXiv:1811.04968
[48] A. Harrow and J. Napp, Low-depth gradient measurements can improve convergence in variational hybrid quantum-classical algorithms, arXiv:1901.05374 (2019).
arXiv:1901.05374
[49] G. G. Guerreschi and M. Smelyanskiy, Practical optimization for hybrid quantum-classical algorithms, arXiv:1701.01450 (2017).
arXiv:1701.01450
[50] J. S. Bergstra, R. Bardenet, Y. Bengio, and B. Kégl, in Advances in Neural Information Processing Systems 24 (2011) pp. 2546–2554.
http://papers.nips.cc/paper/4443-algorithms-for-hyper-parameter-optimization.pdf
[51] L. Liu, H. Jiang, P. He, W. Chen, X. Liu, J. Gao, and J. Han, On the variance of the adaptive learning rate and beyond, arXiv:1908.03265 (2019).
arXiv:1908.03265
[52] J. C. Spall, Implementation of the simultaneous perturbation algorithm for stochastic optimization, IEEE Transactions on aerospace and electronic systems 34, 817 (1998).
https://doi.org/10.1109/7.705889
[53] A. Kandala, A. Mezzacapo, K. Temme, M. Takita, M. Brink, J. M. Chow, and J. M. Gambetta, Hardware-efficient variational quantum eigensolver for small molecules and quantum magnets, Nature 549, 242 (2017).
https://doi.org/10.1038/nature23879
[54] M. J. Powell, An efficient method for finding the minimum of a function of several variables without calculating derivatives, The Computer Journal 7, 155 (1964).
https://doi.org/10.1093/comjnl/7.2.155
[55] R. P. Brent, Algorithms for Minimization Without Derivatives (Dover Publications, 2013).
[56] D. G. Anderson, Iterative procedures for nonlinear integral equations, Journal of the ACM (JACM) 12, 547 (1965).
https://doi.org/10.1145/321296.321305
[57] P. Pulay, Improved scf convergence acceleration, Journal of Computational Chemistry 3, 556 (1982).
https://doi.org/10.1002/jcc.540030413
[58] IBM Q 16 Melbourne backend specification, https://github.com/Qiskit/ibmq-device-information/tree/master/backends/melbourne/V1 (2018).
https://github.com/Qiskit/ibmq-device-information/tree/master/backends/melbourne/V1
[59] R. Sweke, F. Wilde, J. Meyer, M. Schuld, P. K. Fährmann, B. Meynard-Piganeau, and J. Eisert, Stochastic gradient descent for hybrid quantum-classical optimization, arXiv:1910.01155 (2019).
arXiv:1910.01155
Cited by
[1] Carlos Bravo-Prieto, Diego García-Martín, and José I. Latorre, “Quantum Singular Value Decomposer”, arXiv:1905.01353.
[2] Cristina Cirstoiu, Zoe Holmes, Joseph Iosue, Lukasz Cincio, Patrick J. Coles, and Andrew Sornborger, “Variational Fast Forwarding for Quantum Simulation Beyond the Coherence Time”, arXiv:1910.04292.
[3] M. Cerezo, Akira Sone, Tyler Volkoff, Lukasz Cincio, and Patrick J. Coles, “Cost-Function-Dependent Barren Plateaus in Shallow Quantum Neural Networks”, arXiv:2001.00550.
[4] Ryan Sweke, Frederik Wilde, Johannes Meyer, Maria Schuld, Paul K. Fährmann, Barthélémy Meynard-Piganeau, and Jens Eisert, “Stochastic gradient descent for hybrid quantum-classical optimization”, arXiv:1910.01155.
[5] Kunal Sharma, Sumeet Khatri, M. Cerezo, and Patrick J. Coles, “Noise Resilience of Variational Quantum Compiling”, arXiv:1908.04416.
[6] M. Cerezo, Alexander Poremba, Lukasz Cincio, and Patrick J. Coles, “Variational Quantum Fidelity Estimation”, arXiv:1906.09253.
[7] Bálint Koczor and Simon C. Benjamin, “Quantum natural gradient generalised to non-unitary circuits”, arXiv:1912.08660.
[8] M. Cerezo, Kunal Sharma, Andrew Arrasmith, and Patrick J. Coles, “Variational Quantum State Eigensolver”, arXiv:2004.01372.
[9] Bálint Koczor, Suguru Endo, Tyson Jones, Yuichiro Matsuzaki, and Simon C. Benjamin, “Variational-State Quantum Metrology”, arXiv:1908.08904.
[10] Frederic Sauvage and Florian Mintert, “Optimal quantum control with poor statistics”, arXiv:1909.01229.
[11] Andrew Arrasmith, Lukasz Cincio, Rolando D. Somma, and Patrick J. Coles, “Operator Sampling for Shot-frugal Optimization in Variational Algorithms”, arXiv:2004.06252.
[12] Chris Cade, Lana Mineh, Ashley Montanaro, and Stasja Stanisic, “Strategies for solving the Fermi-Hubbard model on near-term quantum computers”, arXiv:1912.06007.
[13] Seth Lloyd, Maria Schuld, Aroosa Ijaz, Josh Izaac, and Nathan Killoran, “Quantum embeddings for machine learning”, arXiv:2001.03622.
[14] Dan-Bo Zhang and Tao Yin, “Collective optimization for variational quantum eigensolvers”, Physical Review A 101 3, 032311 (2020).
[15] Tyler Volkoff and Patrick J. Coles, “Large gradients via correlation in random parameterized quantum circuits”, arXiv:2005.12200.
[16] Eric Sillekens, Wenting Yi, Daniel Semrau, Alessandro Ottino, Boris Karanov, Sujie Zhou, Kevin Law, Jack Chen, Domanic Lavery, Lidia Galdino, Polina Bayvel, and Robert I. Killey, “Experimental Demonstration of Learned Time-Domain Digital Back-Propagation”, arXiv:1912.12197.
[17] Barnaby van Straaten and Bálint Koczor, “Measurement cost of metric-aware variational quantum algorithms”, arXiv:2005.05172.
[18] Kevin J. Sung, Matthew P. Harrigan, Nicholas C. Rubin, Zhang Jiang, Ryan Babbush, and Jarrod R. McClean, “An Exploration of Practical Optimizers for Variational Quantum Algorithms on Superconducting Qubit Processors”, arXiv:2005.11011.
[19] Kunal Sharma, M. Cerezo, Lukasz Cincio, and Patrick J. Coles, “Trainability of Dissipative Perceptron-Based Quantum Neural Networks”, arXiv:2005.12458.
The above citations are from SAO/NASA ADS (last updated successfully 2020-06-03 14:46:27). The list may be incomplete as not all publishers provide suitable and complete citation data.
On Crossref’s cited-by service no data on citing works was found (last attempt 2020-06-03 14:46:26).
This Paper is published in Quantum under the Creative Commons Attribution 4.0 International (CC BY 4.0) license. Copyright remains with the original copyright holders such as the authors or their institutions.
Source: https://quantum-journal.org/papers/q-2020-05-11-263/
