Augmented Reality & the Internet of Things

Announcements

Sarnoff Innovation Lectures
Additional resources from Ben Gross:
1. Radio Age Archive: This website contains PDF versions of RCA’s in-house publicity magazine from 1942 through 1957. It is especially useful to see what technical or commercial accomplishments the company wished to publicize and the marketing strategies it used.
2. RCA Engineer online index: This online database contains articles from 30 years of RCA Engineer, a technical magazine circulated among RCA’s various operating divisions. Its articles are more technical, but often contain useful biographical information about their authors.
3. CED Magic: The definitive website about the RCA VideoDisc system. In addition to materials about RCA’s various home video projects and a full catalog of VideoDisc titles, it also boasts a “Who’s Who in VideoDisc” section that draws upon internal company biographies.
5. Lots of commercials & films on Youtube and the Internet Archive
The New Jersey State Museum visit is next week! We’ll meet here at 9:30 and drive over
- Need cell phone numbers for field trip form

Homework Discussion

What was your favorite example of Augmented Reality from the reading this week? What examples did you find “in the wild”?

Guest Speaker

John Kuiphoff – IMM Professor, developer & designer, specializing in web development, interactive art and physical computing

Trend: Augmented Reality

Augmented Reality Could Save Your Life

What is Augmented Reality?

Reality ———-> AR ———-> Virtual Reality

Triggers

Feature Recognition – markers, QR codes, images, colors, etc.
Positioning Data – location, orientation
What kinds of devices have cameras, GPS & accelerometers?

Augmented Reality & the Web

WC3 Augmented Reality Group

Why use it in Museums?

In exhibition space – provide additional levels of interpretation
Outside the exhibition space – extend exhibition reach and provide additional levels of interpretation for digital/print exhibit media

Augmented Reality with HTML5

WebRTC
Navigator.getUserMedia() – access webcam & microphone using Javascript
JSARToolkit
JS-ARUCO

Libraries for Native Apps

Alternative Apps & SDKs

Examples

More Background on AR

IMM Digital Tour Exercise

Divide into three groups representing three tracks at IMM
Log into the class blog and create a post for your track
Go to http://qrcode.kaywa.com/ and create QR Codes for your track page
Cut out & place QRCodes around AIMM building
Take it for a test drive and suggest how it could be made better

Trend: Internet of Things (IoT)

According to Wikipedia:

“The Internet of Things refers to uniquely identifiable objects and their virtual representations in an internet-like structure.”

The idea is that objects can be directly connected to the internet, transmitting or receiving data, or be tagged in such a way to have digital representations of the objects be accessible over the internet. And, increasingly, much of that IoT traffic is M2M.

http://www.youtube.com/watch?v=LVlT4sX6uVs

History – http://postscapes.com/internet-of-things-history

Roadmap – http://robertoigarza.files.wordpress.com/2008/09/rep-six-technologies-with-potential-impacts-on-us-anexothe-internet-of-things-nic-2008.pdf

More info on IoT – http://postscapes.com/internet-of-things-resources/

How do we connect everyday objects to the internet?

QRCodes
RFIDs
iBeacons
MicroControllers
- Arduino http://www.arduino.cc/
- Raspberry Pi http://www.raspberrypi.org/
- Tessel http://tessel.io/

examples:

Estimote – http://estimote.com/
RFIDs – http://www.simonsothcott.com/2011/11/what-is-rfid-10-examples-of-rfid.html
EggMinder on Leno – http://www.quirky.com/blog/post/2013/09/quirky-ideas-and-egg-minder-take-the-tonight-show-by-storm/

The Internet of Things is about sensors and networks

The Internet is the network of networks

examples:

Google Web Lab http://www.b-reel.com/projects/digital/case/8/web-lab/

How do we connect sensors to networks?

Wireless networks:

WiFi

rangle: ~ 150′ indoors, 300′ outdoors
topology: Hub, typically connected to internet
bandwidth: high
speed: high
energy consumption: high
platforms: Most smartphones & micro-controllers
examples: – Processing w/Ketai library https://code.google.com/p/ketai/

But a lot of the value of connected objects is local

Bluetooth

range: class 1 ~ 300′, class 2 ~ 30′
topology: peer-to-peer, local
bandwidth: medium
speed: high
energy consumption: medium
platforms: Most smartphones & micro-controllers
examples:
- Processing w/Ketai library https://code.google.com/p/ketai/
- http://www.epictinker.com/Bluetooth-Shield-p/sld63030p.htm

Bluetooth Low Energy

NFC

range: ~ 4cm
topology: 2 way, peer-to-peer, local
bandwidth: low
speed: low
energy consumption: low
platform: Android 4+, micro-controllers
examples:
- Android Beam – http://www.youtube.com/watch?v=cwU4TvQEq0g
- http://en.wikipedia.org/wiki/Near_field_communication
- http://www.adafruit.com/products/789
- Processing w/Ketai library https://code.google.com/p/ketai/

RFID

range: 10cm-1m
topology: 1 way, peer-to-peer, local
bandwidth: low
speed: low
energy consumption: low
platforms: Android 4+
examples:
- http://en.wikipedia.org/wiki/RFID
- Processing w/Ketai library https://code.google.com/p/ketai/
- Reading RFIDs on iOS – http://www.youtube.com/watch?v=-hLJOXAZulA

QR Codes

range: ~1′
topology: 1 way, peer-to-peer, local
bandwidth: low
speed: low
energy consumption: low
platforms: iOS, Android, others
examples:

Choosing your implementation options

– Who’s your audience?

Are you providing the interface (kiosk, installation, loaner device, etc)? Or are they providing their own (cell phone, tablet, desktop, etc)?
Diffusion of Innovation curve – http://en.wikipedia.org/wiki/Diffusion_of_innovations
Gartner Hype Cycle – http://www.gartner.com/newsroom/id/2575515
Analytics

– What are the characteristics of the exhibition space?

Wifi
Interference
Lighting

– What’s easiest, least invasive, least effort for your users (how can you make the technology “disappear”)?

– What’s simplest to implement?

– What is most maintainable/durable?

– What fits in your budget?

Functional Prototype Ideas

Interactive Guide to the Vacuum Tube Carousel
Electron Microscope Simulation
Interviews with retired RCA researchers
Integration of collection objects not displayed on the exhibition floor

Google Floor Plan + Walkthrough : http://maps.google.com/help/maps/floorplans/
iBeacon, QRCode or RFID tours
Mobile Radio or TV controller

Homework Assignment 4a (5 points)

Read the following: (1 point)
- Inventing the Future: Extending the Power of Sight (pp 64-73)
- Inventing the Future: Transmitting Intelligence (pp 74-83)
Create a new page in your Design Notebook with the heading “Inventing the Future IV” (1 point)
Look through the Collection Opening Items listing, the associated item texts and the collection bibliography. Which Collection Opening items & references relate to the chapters above? Search the bibliography sources for more information on one or more of the items. What sort of interactive experience could you create to demonstrate the items; how they work, or the context in which they were developed? Write down your thoughts in your Design Notebook & cite your references. (3 points)

Assignment 4b (5 points, 1 point each)

Read the 2012 NMC Horizon Report pp 27-30
Read the AAM 2013 TrendsWatch pp 24-29
Create a new page in your Design Notebook with the heading “Internet of Things”
Take a look at some of the examples of internet addressable objects currently used in museums on pp 27-30 of the Horizon Report and on pp 24-29 of TrendsWatch, and write a paragraph about your favorite example.
Can you find any other examples of the “Internet of Things” being used “in the wild”? Jot down a brief description & a link to what you find in your Design Notebook.

Submitting Your Work This week’s homework assignments are due by next Wed, Sept. 25, at 5:00 pm EST. When you’ve completed them, post a comment on this page (Augmented Reality), including a link to your Design Notebook.

Exhibition Critiques Your first Exhibition Critique is due in 2 weeks on October 3rd. Here’s the template for the assignment.

Studio Time