Dr. Durant: CS-4981 Deep Learning in Signal Processing

Overview

This elective course provides an overview of deep learning methods and models as used in digital signal processing (DSP), including key DSP concepts that appear in and adjacent to such models in both real-time and off-line applications. Key topics include training pipelines, convolutional layers of various dimensions used on both time series and time-frequency representations of data, common network architectures, mitigation of overfitting, error metrics, and performance evaluation. Topics of student interest will be addressed by special lecture topics and course projects.

Course in Canvas

Course Outline and Grading (PDF)

General Course Policies

Labs

Project

Toolset

Rosie is MSOE’s high performance supercomputer, which we will be using in this class. Please find the user’s guide here.

We will use MATLAB’s Deep Learning Toolbox running on Rosie for this class. The course does not assume knowledge of MATLAB or Python, etc.

MATLAB Deep Learning Toolbox on Rosie

  1. Launch interactive desktop on compute node using VNC. Use your username without @msoe.edu to log in.
  2. Select 1 GPU and the number of hours you need. Select “Launch.”
  3. It may take a minute to prepare your session. Select “Launch Rosie VNC Desktop” when given the option.
  4. Open a terminal window on the remote desktop. You can do this by clicking the footprint icon in the upper left and searching for “term.” Select “MATE Terminal.”
  5. See procedure below to get a license file for MATLAB.
  6. singularity exec --nv /data/containers/matlab-r2021b.sif bash
  7. matlab&
    • If you receive an error that the license for a different computer is installed, /opt/matlab/R2021b/bin/activate_matlab.sh to manually start the activation process, which will allow you to select a different license file.
  8. Chose “Activate manually without the Internet”, “Next”, “Enter the full path…”, “Browse” and then point MATLAB to the license file you downloaded from MathWorks and uploaded to Rosie. Click “Next,” receive success message, and click “Finish” to exit.
  9. matlab&
  10. The MATLAB GUI appears and you have access to:
    • Deep Learning Toolbox
    • Signal Processing Toolbox
    • Statistics and Machine Learning Toolbox
    • Image Processing Toolbox
    • and much more

Alternate Method (X11 forwarding)

This method forwards the GUI calls from your node on Rosie, through a Roise management node, back to your local computer. It requires an X Server such as VcXsrv for Windows. MATLAB licensing is handled as above. The key steps follow.

  1. ssh into a Rosie management node (dh-mgmtN.hpc.msoe.edu, where N is between 1 and 4.).
    • Use -X (capital), or the equivalent option in your ssh client, to enable X11 forwarding.
    • Use -C (capital), or the equivalent option in your ssh client, to enable compression.
  2. srun --time=01:00:00 --pty --partition=teaching --gres=gpu:t4:1 --x11 singularity exec --nv /data/containers/matlab-r2021b.sif bash, set to more than 1 hour if needed
  3. matlab&

Get MATLAB License File

Once you know which node you’re on, you need to generate a MATLAB license file (unless you previously generated one for this particular node).

You should complete these steps directly on your laptop using Chrome. This does not need to be done on Rosie.

These instructions are adapted from this MathWorks Central post.

  1. Go to the License Center
  2. Log into (or create) your MathWorks Account if you are not already logged in
  3. Select your license number from the list. If you don’t see your license, use the links in the upper left hand corner to toggle between Licenses, Trials, and Prereleases
  4. Select the “Install and Activate” tab
  5. Click the “Activate to Retrieve License File” link under “Related Tasks” on the right side of the page.
  6. On the page titled “Activated Computers,” click the blue “Activate a Computer” button on the right side of the page.
  7. Enter the required information to complete activation. Release = R2021b, Operating System = Linux
  8. For the Host ID, enter the MAC address of your assigned node. /sbin/ifconfig eth0 on your assigned Rosie node. Copy the 6-byte address that shows up after ether
  9. For the Computer Login Name, enter your MSOE username (e.g., doej)
  10. For the Activation Label, make it correspond your node number, e.g., “Rosie dh-nodeNN” to aid in finding it later
  11. Select “Yes” when asked “Is the software installed?”
  12. MathWorks will verify your MSOE account through MSOE SSO. This sometimes generates an error message when attempting to open the SSO URL. If this happens, copy the entire (very long) URL from the error message and open it in a new tab. You should be told that verification was successful (you may need to enter your MSOE username and password if not already authenticated). At this point, you should be able to go back to the MathWorks window and finish downloading your license file.
  13. Download the license file. Recommended naming convention: license-username-node.lic, e.g., license-durant-dh-node18.lic
  14. Upload to Rosie. Recommended method is selecting Files, Home Directory from your Rosie Dashboard, but you could also use a SecureFTP program connected to one of the management nodes.