Cleveland State University

Department of Electrical and Computer Engineering

EEC 693/793 Applied Computer Vision with Depth Cameras

Summer 2018

 

Course Objectives:

Depth cameras are one of the most exciting new developments in the field of computer vision. This course covers the technology behind the most well-known depth camera on the market - Microsoft Kinect. The Kinect technology enables human-computer interaction via natural interfaces, such as via gestures and speech-based commands. Topics covered include the handling of Kinect color frames, depth frames, and skeleton frames; gesture recognition; face tracking; and 3D game development with Unity3D for Kinect, OpenCV with Kinect. If time allows, we also introduces the technology behind the Leap Motion device, which tracks only fingers.

 

Prerequisite:

Approval of instructor and academic adviser

 

Textbooks:

Kinect for Windows SDK Programming Guide, by Abhijit Jana, PACKT publishing, 2012

References:

Kinect Hacks, by Jared St. Jean, O'Reilly, 2013

Hacking the Kinect, by Jeff Kramer et al., Apress, 2012.

 

Instructors:

Dr. Wenbing Zhao

Office:  FH 317

Phone: (216) 523-7480

Fax:     (216) 687-5405

E-mail: w.zhao1@csuohio.edu

Lecture time: M W 6:00-9:10pm

 

Tentative Schedule:

Week

Topics

1

(May 21 - 25)

May 21:

  • Lecture #1 - Overview of the course; syllabus; policies (notes)
  • Lecture #2 - Kinect application development environment (notes)

May 23:

  • Study C# primer (notes)

 

2

(May 28 - June 1)

May 28:

  • Memorial Day - No class

May 30:

  • Lecture #7 - Kinect Depth Image Stream (notes)

3

(June 4 - 8)

June 4:

  • Lecture #4 - Kinect Color Image Stream (part I)  (notes)

June 6:

  • Lecture #5 - Kinect Color Image Stream (part II) (notes)

4

(June 11 - 15)

June 11:

  • Lecture #8 - Kinect Skeleton Tracking (part I) (notes)
  • Lecture #9 - Kinect Skeleton Tracking (part II) (notes)

June 13:

  • Lecture #10 - Kinect Skeleton Tracking (part III) (notes)
  • Lecture #11 - Gesture (part I) (notes)

5

(June 18 - 22)

June 18:

  • Lecture #12 - Gesture (part II) (notes)
  • Lecture #13 - Kinects 3D Game Development with Unity3D (part I) (notes)

June 20:

  • Lecture #14 - Kinects 3D Game Development with Unity3D (part II) (notes)
  • Lecture #15 - Kinect Microphone Array (notes)

6

(June 25 - 29)

June 25:

  • Lecture #16 - Speech Recognition (notes)

June 27:

  • Lecture #17 - Logging and Replay (notes)

7

(July 2 - 6)

July 2:

  • Lecture #18 - Research Seminar: Reducing Lower-Back Injuries with a Privacy-Aware Compliance Tracking System (notes)

July 4:

  • Holiday, no class
         

8

(July 9 - 13)

July 9:

  • Project Presentation

July 11:

  • Project Presentation

 

 

Class Participation

60% of the course credit is allocated to encourage student class participation. A roll call may be carried out in the beginning of each class to determine the attendance. Any absent session without prior-approval will lead to credit reduction.

 

Grading

         Class participation 60%

         Projects 40% 

The final grading is based on your accumulated effort in this course. Your final grade is determined approximately based on the following schedule:

A: 90-100%

A-: 85-89%

B+: 80-84%

B: 75-79%

B-: 70-74%

C: 60-69%

F: <60%