A Meticulous Guide to Advances in Deep Learning Efficiency over the Years

Alex L. Zhang¹ wrote an excellent review² about deep learning algorithms, hardware, libraries, compilers over the years. His article focuses on how these have evolved and have become more efficient. Take a look at it, pretty good content.