1. Kinect를 활용한 Chan Seok Kang
동작 인식 프로그래밍 KIST
2012.12.08
KINECT FOR WINDOWS

2. Biography
강찬석 (Chan Seok Kang)
• 2011 Microsoft Student Partner 5기
• 2012 Imagine Cup 2012 :
Kinect Fun Lab Semi-Finalist
• KIST 실감교류 연구센터 위촉 연구원
Blog : 자신에 대한 고찰 ( http://talkingaboutme.tistory.com )
Facebook : http://www.facebook.com/kcsgoodboy
KINECT FOR WINDOWS

3. Today`s Session
• Review : Kinect Explorer(1h)
• Kinect QuickStart 시청 및 질의 응답 ( 1h )
• Beam Angle Detector ( 1.5h )
KINECT FOR WINDOWS

4. 11th Project
: Review – Kinect Explorer
KINECT FOR WINDOWS

5. Review – Kinect Explorer
• Add Reference File & namespace
KINECT FOR WINDOWS

6. Review – Kinect Explorer
• Split the Grid
KINECT FOR WINDOWS

7. Review – Kinect Explorer
• Insert the ImageControl & Canvas, Button
KINECT FOR WINDOWS

8. Review – Kinect Explorer
• XAML View
KINECT FOR WINDOWS

9. Review – Kinect Explorer
• Initialize Kinect & Enable Stream
KINECT FOR WINDOWS

10. Review – Kinect Explorer
• Fill out the ColorStream
KINECT FOR WINDOWS

11. Review – Kinect Explorer
• Fill out the DepthStream
KINECT FOR WINDOWS

12. Review – Kinect Explorer
• Fill out the Skeleton Stream
KINECT FOR WINDOWS

13. Review – Kinect Explorer
• #region Skeleton
KINECT FOR WINDOWS

14. Review – Kinect Explorer
• #endregion Skeleton
KINECT FOR WINDOWS

15. Review – Kinect Explorer
• Define the DrawBone
KINECT FOR WINDOWS

16. Review – Kinect Explorer
• Use the DrawBone
KINECT FOR WINDOWS

17. Review – Kinect Explorer
• test
KINECT FOR WINDOWS

18. Review – Kinect Explorer
• Make a Button Event
KINECT FOR WINDOWS

19. Review – Kinect Explorer
• Fill out the Button Event
KINECT FOR WINDOWS

20. Review – Kinect Explorer
• Result
KINECT FOR WINDOWS

21. Review – Kinect Explorer
• Insert Anything you want!
(Near mode, Seated Mode, slider etc…)
KINECT FOR WINDOWS

22. Kinect Studio
• Test the Parameter (Depth Data , Position…)
KINECT FOR WINDOWS

23. Break? Break!
KINECT FOR WINDOWS

24. Kinect QuickStart
- Audio Fundamentals
KINECT FOR WINDOWS

25. Kinect QuickStart
KINECT FOR WINDOWS

26. Kinect QuickStart
• 4 –Array High Quality Microphone
- Can get a direction of SoundSource
KINECT FOR WINDOWS

27. Kinect Audio로 할 수 있는 것
• Audio Capture -> Recorder
• Sound Information
• Speech Recognition
• Raw Voice Data Access (using Software-Filter)
->하지만 오디오컨트롤 자체가 하드웨어와 연관되어 있어서
세밀한 조절을 위해서는 궁극적으로 C++을 이용해야 함.
KINECT FOR WINDOWS

28. C++에서 제공하는 API
• KinectAudio DirectX Media Object(DMO)
• Windows Audio Session API (WASAPI)
KINECT FOR WINDOWS

29. SOUND POSITION
• Sound Source Angle : 소리가 나는 방향 과 강도
• Beam Angle : 소리가 진행하는 방향
-50 0 +50
KINECT FOR WINDOWS

30. Recording
• KinectAudioSource가 일종의 버퍼 역할
• Use Echo Cancellation to not record PC sound
KINECT FOR WINDOWS

31. Attention!!
• 반드시 AudioStream은 SkeletonStream을 활성화
시킨 후에 활성화시켜야 함
kinectSensor.Start();
kinectSensor.AudioSource.Start(); // --> this will create an audio stream
kinectSensor.SkeletonStream.Enable(); // --> this will stop the audio stream as an undesired side effect
나쁜 예
KINECT FOR WINDOWS

32. Attention!!
• 반드시 AudioStream은 SkeletonStream을 활성화
시킨 후에 활성화시켜야 함
Workaround #1 (start audio after skeleton):
kinectSensor.Start();
kinectSensor.SkeletonStream.Enable();
kinectSensor.AudioSource.Start();
Workaround #2 (restart audio after skeleton):
kinectSensor.Start();
kinectSensor.AudioSource.Start(); // --> this will create an audio stream
kinectSensor.SkeletonStream.Enable(); // --> this will stop the audio stream as an undesired side effect
kinectSensor.AudioSource.Start(); // --> this will create another audio stream
좋은 예
KINECT FOR WINDOWS

33. Break? Break!
KINECT FOR WINDOWS

34. 12th Project
: Beam Angle Detector
KINECT FOR WINDOWS

35. Beam Angle Detector
• Add Reference File & namespace
KINECT FOR WINDOWS

36. Beam Angle Detector
• Grid -> Canvas (Width:640 / Height: 480)
KINECT FOR WINDOWS

37. Beam Angle Detector
• Sound의 특성상 Thread 의 사용이 필요!!
KINECT FOR WINDOWS

38. Beam Angle Detector
• Sound Initialize (순서 유의)
KINECT FOR WINDOWS

39. Beam Angle Detector
• 탐지판 생성
KINECT FOR WINDOWS

40. BeamAngle
• test
KINECT FOR WINDOWS

41. Beam Angle Detector
• Define DrawLine
KINECT FOR WINDOWS

42. Beam Angle Detector
• 탐지침 선언
KINECT FOR WINDOWS

43. Beam Angle Detector
• 입력이 없을 때는 안보이게!
KINECT FOR WINDOWS

44. Beam Angle Detector
• 실효값 구하기
(SoundSourceAngle)
KINECT FOR WINDOWS

45. Beam Angle Detector
• 잠깐!!
• SoundSourceAngle 자체는 키넥트를 기준으로
판단하기 때문에 사람이 잘 보려면 -1을 곱해줘야 함.
KINECT FOR WINDOWS

46. Beam Angle Detector
• RotateLine 정의
KINECT FOR WINDOWS

47. Beam Angle Detector
• Add the Line Thickness
KINECT FOR WINDOWS

48. Beam Angle Detector
• 현재값 구하기
(BeamAngle)
KINECT FOR WINDOWS

49. Beam Angle Detector
• Fill out the BeamAngleChanged
KINECT FOR WINDOWS

50. Beam Angle Detector
• Result
KINECT FOR WINDOWS

51. If you need help,
Just visit in My blog
http://talkingaboutme.tistory.com
KINECT FOR WINDOWS

52. KINECT FOR WINDOWS