- 快召唤伙伴们来围观吧
- 微博 QQ QQ空间 贴吧
- 文档嵌入链接
- 复制
- 微信扫一扫分享
- 已成功复制到剪贴板
16InteractionTechnique--3D
展开查看详情
1 .1 © 2014 - Brad Myers Brad Myers 05-899A/05-499A: Interaction Techniques Spring, 2014 Lecture 16: Past to Future: Interactions in 3D, Very Large Displays, and Virtual Reality
2 .St. Patrick’s Day Today! © 2014 - Brad Myers 2
3 .Mardi Gras Was March 4 © 2014 - Brad Myers 3
4 .Homework 3 Everyone did well. Observations: Sometimes iPad Minis performed well, otherwise flick gesture was terrible. 2-finger OSX scroll was in the middle. Generally notched mouse wheel was the best. Keyboard, as expected, was very accurate but slow. PgDown was remarkably good. Homework 4 due today © 2014 - Brad Myers 4
5 .MidTerm Test Grades Average: 82.25 © 2014 - Brad Myers 5
6 .Midterm Test – answers Q1 & Q2: see lecture 1 , slides 18-20; 21 Q11 – could use same one from lecture 11 , slide 3 Or could omit the “hover” state Q13 – GOMS and Keystroke model were covered in both lecture 11, slides 29-30 and lecture 13, slides 4-15 © 2014 - Brad Myers 6
7 .Final Projects Start today! See description on line Need to figure out groups and project ideas by this Wednesday ! Enter information into Piazza under “project” © 2014 - Brad Myers 7
8 .Office Hours Brad Myers: Tuesday 3-4, NSH 3517 Project ideas Midterm grading Jeff Rzeszotarski, Friday, 1PM to 3PM, NSH 4605 **special time** Project ideas Homework 3 grading But project ideas are due by Wednesday at 1:30 © 2014 - Brad Myers 8
9 .9 © 2014 - Brad Myers Lecture 16: Past to Future: Interactions in 3D, Very Large Displays, and Virtual Reality
10 .Why is 3D Harder? Objects have six degrees of freedom ( DoF ) X, Y, Z Roll, pitch, yaw Also camera position Occlusion and resolution issues Difficulty of orienting oneself People are not very good at 3D manipulation or reasoning Mouse is basically 2D Generally, dealing with complex, hierarchical objects © 2014 - Brad Myers 10
11 .Why is 3D Harder? Objects have six degrees of freedom ( DoF ) X, Y, Z Roll, pitch, yaw Also camera position Occlusion and resolution issues Difficulty of orienting oneself People are not very good at 3D manipulation or reasoning Mouse is basically 2D Generally, dealing with complex, hierarchical objects © 2014 - Brad Myers 10
12 .Where 3D displayed? Desktops – just on a screen in the usual way 3D “Cave” or other large displays ( ACM ref ) Display on 1 or up to all walls and ceiling Virtual Reality (VR) or Augmented Reality (AR) headsets AR – can see through the display, so pictures are superimposed on the view © 2014 - Brad Myers 12
13 .3D Control Regular Mouse or touch – 2D Possibly with extra knobs or buttons “Mouse in the air” tracked in 3D = “ bat ”; 6 DoF “bat” translates to fledermaus in German (mouse that flies through the air) Fixed camera tracking object in 3D space Moving the end of an articulated motorized arm 3D physical objects incorporating the above © 2014 - Brad Myers 13
14 .Types of 3D sensors © 2014 - Brad Myers 14 Earliest: Boxes with sets of knobs for each dimension Polhemus trackers (“ bat ”) Starting in 1969 Magnetic cube on part to be tracked and nearby receiver 6 DOF Limited sensing area Company still selling similar products Often attached to gloves, head-trackers, etc. DataGlove Starting about 1982 Measured finger bending = pose of hand Incorporated Polhemus tracker on the wrist Nintendo “ PowerGlove ” – 1989 Unsuccessful – only 2 games
15 .Types of 3D sensors © 2014 - Brad Myers 14 Earliest: Boxes with sets of knobs for each dimension Polhemus trackers (“ bat ”) Starting in 1969 Magnetic cube on part to be tracked and nearby receiver 6 DOF Limited sensing area Company still selling similar products Often attached to gloves, head-trackers, etc. DataGlove Starting about 1982 Measured finger bending = pose of hand Incorporated Polhemus tracker on the wrist Nintendo “ PowerGlove ” – 1989 Unsuccessful – only 2 games
16 .Minority Report , 2002 Using data gloves to interact with large 2-D displays in the air (or on a surface) MIT Media Lab advised on science ( John Underkoffler ) © 2014 - Brad Myers 16
17 .History of 3D sensors, cont. Lots of motion capture research and systems Motion capture rooms with cameras Used for movies, etc. (But no interaction techniques) Kinect Introduced 2010 Two cameras Next lecture (w/ game controllers) Leap Motion 2013 Camera based – designed to look upwards © 2014 - Brad Myers 17
18 .3D “arm” Controllers Motors to measure 3D movements and provide force feedback Phantom OMNI from Sensable Technologies Medical Applications, etc. 3D editing and drawing Falcon from Novint Marketed for gaming © 2014 - Brad Myers 18
19 .3D “arm” Controllers Motors to measure 3D movements and provide force feedback Phantom OMNI from Sensable Technologies Medical Applications, etc. 3D editing and drawing Falcon from Novint Marketed for gaming © 2014 - Brad Myers 18
20 .Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya
21 .Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya
22 .Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya
23 .Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya
24 .Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya
25 .Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya
26 .Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya
27 .Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya
28 .Mouse-Based 3D manipulation Common 4-panel display Mouse works in conventional way in each panel Still tricky to manipulate © 2014 - Brad Myers 20 AutoDesk Maya