Cleveland State University

Department of Electrical and Computer Engineering

EEC 492/592 Kinect Application Development

Spring Semester 2014

 

Course Objectives:

This course introduces the fundamental Kinect technology for enabling human-computer interaction via natural interfaces, such as via gestures and speech-based commands. Topics covered include the handling of Kinect color frames, depth frames, and skeleton frames; gesture recognition; speech recognition; face tracking; and 3D game development with Unity3D for Kinect.

 

Prerequisite:

Approval of instructor and academic adviser

 

Textbooks:

       Kinect for Windows SDK Programming Guide, by Abhijit Jana, PACKT publishing, 2012

       Kinect Hacks, by Jared St. Jean, OíReilly, 2013

       Hacking the Kinect, by Jeff Kramer et al., Apress, 2012.

 

Instructors:

Dr. Wenbing Zhao

Office: SH434

Phone: (216) 523-7480

Fax:     (216) 687-5405

E-mail:            wenbingz@gmail.com

Lecture time: M W 4:00-5:50pm

Office hours: M 6-8pm W noon-2pm

 

 

Tentative Schedule:

Week

Topics

1

(Jan 13 – 15)

Jan 13:

      Lecture #1 – Overview of the course; syllabus; policies (notes)

Jan 15:

      Lecture #2 – Kinect application development environment (notes)

2

(Jan 20 – 22)

Jan 20:

      Martin Luther King Day (no class)

Jan 22:

      Lecture #3 – C# primer (part I) (notes)

3

(Jan 27 – 29)

Jan 27:

      Class cancelled due to school closing

Jan 29:

      Lecture #4 – Kinect Color Image Stream (part I) (notes)

4

(Feb 3 – 5)

Feb 3:

      Lecture #5 – Kinect Color Image Stream (part II) (notes)

Feb 5:

      Class cancelled due to school closing

5

(Feb 10 – 12)

Feb 10:

      Lecture #6 – C# primer (part II) (notes)

Feb 12:

      Lecture #7 – Kinect Depth Image Stream (notes)

6

(Feb 17 – 19)

Feb 17:

      Presidentís Day, no class

Feb 19:

      Lecture #8 – Kinect Skeleton Tracking (part I) (notes)

7

(Feb 24 – 26)

Feb 24:

      Lecture #9 – Kinect Skeleton Tracking (part II) (notes)

Feb 26:

      Lecture #10 – Kinect Skeleton Tracking (part III) (notes)

8

(Mar 3 – 5)

Mar 3:

      Lecture #11 – Kinect Microphone Array (notes)

Mar 5:

      Lecture #12 – Speech Recognition (notes)

9

(Mar 10 – 12)

 

Spring break, no class

10

(Mar 17 – 19)

Mar 17:

      Project Proposal Presentation

Mar 19:

      Project Proposal Presentation

11

(Mar 24 – 26)

Mar 24:

      Lecture #13 – Kinects 3D Game Development with Unity3D (part I) (notes)

Mar 26:

      Lecture #14 – 3D Game Development with Unity3D (part II) (notes)

12

(Mar 31 - Apr 2)

Mar 31:

      Lecture #15 – Gesture (part I) (notes)

Apr 2:

      Class cancelled due to travel

 

13

(Apr 7 – 9)

Apr 7:

      Lecture #16 – Gesture (part II) (notes)

Apr 9:

      Lecture #17 – OpenCV with Kinect (part I)(notes)

14

(Apr 14 – 16)

Apr 14:

      Project progress assessment workshop

Apr 16:

      Lecture #18 – OpenCV with Kinect (part II) (notes)

15

(Apr 21 – 23)

Apr 21:

      Lecture #19 – OpenCV with Kinect (part III) (notes)

Apr 23:

      Guest Seminar on Entrepreneurship and Career Development, Mr. Benjamin Rosolowski, MBA, CEO, CPI Group Limited

16

(Apr 28 – 30)

Apr 28:

      Project presentation

Apr 30:

      Project presentation

17

(May 5 – 7)

May 5:

      Project presentation

Class Participation

60% of the course credit is allocated to encourage student class participation. A roll call may be carried out in the beginning of each class to determine the attendance. Any absent session will lead to credit reduction.

Grading

− Class participation 60%

− Projects 40%

The final grading is based on your accumulated effort in this course. Your final grade is determined approximately based on the following schedule:

A: 90-100%

A-: 85-89%

B+: 80-84%

B: 70-79%

B-: 60-69%

C: 50-59%

D: 40-49% (undergraduate only)

F: (<50% for graduate students; <40% for undergraduate students)