CSE 450 - Machine Learning

Module 05 — Convolutional Neural Networks

Eyeball Photo by Amanda Dalbjörn on Unsplash

Overview

The objective of this module is to provide a real-world scenario in which you can practice using Convolutional Neural Networks.

Estimated Reading Time

Plan on around 120 - 240 minutes for this preparation reading, which consists of online reading and videos.

Preparation Reading

Theory vs Practice

There is a lot of content to read this week. For the sake of the preparation quiz and Friday's discussion, you should go through everything in the Theory section below.

The items in the Practical section are things you'll want to go through before you start in on the actual case study work on Monday.

Theory

Please go through this content before the reading quiz and class discussion on Friday:

Convolutional Neural Networks

First, read the following article that introduces how Convolutional Neural Networks work. But, ignore the code examples, because the article uses an older version of TensorFlow:

Next, watch this video from MIT, which dives a little deeper into the concepts of how convolutional neural networks work, and how they can be used to solve machine learning problems.

Data Augmentation

Next, read through this article on data augmentation. Don't worry too much about the code, just make sure you understand the main ideas.

Network Architecture

At this point, you might be wondering how to decide what network architecture is best? How do you decide how many convolutional layers to use? How do you pick a filter size? How do you determine how many filters and dense layers to use?

The most common approach is to experiment — adjust parameters one at a time and see how those adjustments affect your outcome.

Another approach is to start with one of the many well known CNN network architecture designs and adjust those as needed for your particular problem.

CNN architecture is a very active field of development. As with most things in machine learning, there is no "one size fits all" answer.

Practical

Please go through this content before class on Monday:

Sign Information