Announcements

• Frank Migliorelli, Director of Digital Experience at the New York Public Library, is our guest speaker today and will be presenting this week’s Brown Bag Lunch
• Project Vision Statements due in 2 weeks (Friday, Oct. 17)

Homework Discussion

Let’s talk about your 1st Exhibition Critiques.

Trend: Natural User Interfaces

According to Wikipedia:

“…a user interface that is (1) effectively invisible, or becomes invisible with successive learned interactions, to its users, and (2) is based on nature or natural elements”

NUI in the news:

• In Wired Design: http://www.wired.com/design/2013/10/watch-a-computer-orchestra-you-conduct-by-waving-your-hands/

NUIs (Natural User Interfaces) are generally divided into several categories:

• Multi-touch interfaces
• Gestural Interfaces
• Speech interfaces
• Physical Object interfaces

Multi-touch

• Smart Phones
• Tablets
• Muti-touch Screens
  • Jeff Han, NYU
  • CNN Magic Wall http://en.wikipedia.org/wiki/Multi-Touch_Collaboration_Wall
  • InteractiveLab http://nuigroup.com/forums/viewthread/14844/

Making a Multi-touch Screen

• The Mill http://vimeo.com/27718212
• Hammer.js http://hammerjs.github.io/

Gesture

Remotes & Smart Phones

• Wii Remote http://vimeo.com/9303777
  • WiiRemote Library for Processing http://sourceforge.jp/projects/wrj4p5/wiki/EnglishHere
• MSA Remote for iPhone http://www.memo.tv/archive/iphone/msaremote
• TUIODroid https://play.google.com/store/apps/details?id=tuioDroid.impl&hl=en

Depth Cameras

Kinect = Microsoft software + PrimeSense Hardware

• Microsoft Kinect http://www.microsoft.com/en-us/kinectforwindows/
• Microsoft SDK (Depth, Sound & Rotation)

PrimeSense open sourced Interface and middleware libraries

• OpenNI http://www.openni.org/
• SimpleOpenNI Processing Library https://code.google.com/p/simple-openni/

Adafruit Bounty + Josh Blake’s OpenKinect

• OpenKinect was killed by Apple this year after they bought PrimeSense
• Shiffman’s Kinect Processing Library http://shiffman.net/p5/kinect/

Alternative Depth Cameras

• Asus Xtion http://www.asus.com/Multimedia/Xtion
• Leap3D https://www.leapmotion.com/product
• Creative Senz3D http://us.creative.com/p/web-cameras/creative-senz3d

Kinect + Processing Demo

Speech

• Voice Search http://www.google.com/insidesearch/features/voicesearch/index-chrome.html
• Shazam http://www.shazam.com/
• Siri http://www.apple.com/ios/siri/
• Ford Sync http://www.ford.com/technology/sync/

Physical Object Sensors

Micro-controllers

• Arduino http://www.arduino.cc/
• Lillypad http://lilypadarduino.org/
• MakeyMakey http://www.makeymakey.com/
• Bare Conductive’s Touch Board http://www.bareconductive.com/shop/touch-board/

Examples

• Banana Piano http://www.youtube.com/watch?v=C4XiICMoTgE&feature=related
• Living Wall http://www.youtube.com/watch?v=r9j8DIHXSKA

Conductive Materials http://www.kobakant.at/DIY/?p=634

• Thread
• Paint
• Fruits & Veggies
• Water
• Playdough http://courseweb.stthomas.edu/apthomas/SquishyCircuits/conductiveDough.htm

MakeyMakey Demo

Touchboard Demo

Choosing your implementation options

– Who’s your audience?

• Are you providing the interface (kiosk, installation, loaner device, etc)? Or are they providing their own (cell phone, tablet, desktop, etc)?
• Diffusion of Innovation curve – http://en.wikipedia.org/wiki/Diffusion_of_innovations
• Gartner Hype Cycle – http://www.gartner.com/newsroom/id/2819918
• Analytics

– What are the characteristics of the exhibition space?

• Wifi
• Interference
• Lighting

– What’s easiest, least invasive, least effort for your users (how can you make the technology “disappear”)?

– What’s simplest to implement?

– What is most maintainable/durable?

– What fits in your budget?

Functional Prototype Ideas

• Gallery Space Map Document Interface
• Studio II Game Console Simulation
• Personal Computer Model 00 Simulation
• Please Touch Lego Phonograph

Homework Assignment 6a (5 points)

1. Read the following: (1 point)
   • Elements of Innovation (pp 84-94)
2. Create a new page in your Design Notebook with the heading “Inventing the Future V” (1 point)
3. Look through the Collection Opening Items listing, the associated item texts and the collection bibliography. Which Collection Opening items & references relate to the chapters above? Search the bibliography sources for more information on one or more of the items. What sort of interactive experience could you create to demonstrate the items; how they work, or the context in which they were developed? Write down your thoughts in your Design Notebook & cite your references. (3 points)

Assignment 6b  (5 points, 1 point each)

1. Read the 2012 NMC Horizon Report pp 31-35
2. Create a new page in your Design Notebook with the heading “Natural User Interfaces”
3. Take a look at some of the examples of natural user interfaces currently used in museums on pp 33 & 34 of the Horizon Report and write a paragraph about your favorite example.
4. Can you find any other examples of the “Natural User Interfaces” being used “in the wild”?  Jot down a brief description & a link to what you find in your Design Notebook.

Submitting Your Work This week’s homework assignments are due by next Thurs, Oct. 9, at 5:00 pm EST. When you’ve completed them, post a comment on this page (Natural User Interfaces), including a link to your Design Notebook.

Project Vision Statements

Your Project Vision Statements are due in 2 weeks on Oct 17. Here’s the template for the assignment.

Studio Time

• Work on Project Vision Statements
• InteractiveLab http://www.interactivelab.ru/
• Coffee Cup Natural User Interface http://vimeo.com/57437189
• Fluid Interfaces http://fluid.media.mit.edu/
• Siftables http://www.ted.com/talks/david_merrill_demos_siftables_the_smart_blocks.html