Deep Learning

Is the Rectified Adam (RAdam) optimizer actually better than the standard Adam optimizer? According to my 24 experiments, the answer is no, typically not (but there are cases where you do want to use it instead of Adam). In Liu…

In this tutorial, you will learn how to use Keras and the Rectified Adam optimizer as a drop-in replacement for the standard Adam optimizer, potentially leading to a higher accuracy model (and in fewer epochs). Today we’re kicking off a…

In this tutorial, you will learn how to use Keras to train a neural network, stop training, update your learning rate, and then resume training from where you left off using the new learning rate. Using this method you can…

In today’s blog post, I interview Kapil Varshney, a PyImageSearch reader who was recently hired at Esri Research and Development as a Data Scientist focusing on Computer Vision and Deep Learning. Kapil’s story is really important as it shows that,…

In this tutorial, you will learn how to automatically find learning rates using Keras. This guide provides a Keras implementation of fast.ai’s popular “lr_find” method. Today is part three in our three-part series of learning rate schedules, policies, and decay…

In this tutorial, you will learn how to use Cyclical Learning Rates (CLR) and Keras to train your own neural networks. Using Cyclical Learning Rates you can dramatically reduce the number of experiments required to tune and find an optimal…

In this tutorial, you will learn about learning rate schedules and decay using Keras. You’ll learn how to use Keras’ standard learning rate decay along with step-based, linear, and polynomial learning rate schedules. When training a neural network, the learning…

In this tutorial, you will learn how to perform video classification using Keras, Python, and Deep Learning. Specifically, you will learn: The difference between video classification and standard image classification How to train a Convolutional Neural Network using Keras for…

In today’s tutorial, you will learn how to use Keras’ ImageDataGenerator class to perform data augmentation. I’ll also dispel common confusions surrounding what data augmentation is, why we use data augmentation, and what it does/does not do. Knowing that I…