Tag Archives: Apple

Audio, Haptics and other changes in the way we interact with technology

6 Mar

SXSW kicks off on the 9th and I’m looking forward to seeing what particular hits, misses and hypes come up.

But beyond the usual “marketing tech” I think the most interesting areas at the moment are around the way we physically interact with technology and media.

Two of the most innovative areas are Audio and Haptic technologies.

Audio

Audio in interaction design terms has been a long neglected area that is now exploding in terms of possibility and the potential for mainstream exploitation and adoption. The poster-child is obviously Siri on the iPhone 4s or Iris on Android but Ford has been employing Microsoft Sync—which also uses voice control extensively—in its cars for a few years, even in lower cost vehicles aimed at younger drivers. However, it is the use of Audio based interactions in the real or entertainment worlds where the interesting applications apply.

Sonic Notify is an interesting example. It uses Audio detection to deliver tailored and synched media content to people in a store, in front of a TV or at a concert. The media is actually transferred over audio via “the communication of data in the ultra high-frequency inaudible range between any speaker and microphone. The [Sonic Notify] decoding algorithm enables a common process for extracting data from audio using any microphone on any smartphone or tablet.”

If you can cope with the intense American spokes-model-weirdo below there’s an interesting demo:

http://vimeo.com/33556728

Media can effectively “piggy back” on TV soundtracks, store PA systems, or radio ads and offer a richer experience without people having to use their own data allowances.

Similar Audio driven interactions are found in the eBay Application which synchs content and goods displayed with the TV programme people are watching – more Retail TV than Social TV or IntoNow.

Haptics

Haptic technology is all about touch. It is incredibly personal and all about giving natural instantly understandable feedback to people. It is when technology starts to make a physical connection with people. It has been described as “doing for the sense of touch what computer graphics does for vision”.

We’re starting to see more high end implementations such Surgical Robots but the idea is leaking into more and more concept products such as the Seabird phone.

Or even concept haptic speakers.

sourdine_arnaud_lapierre_yatzer_2

Or potentially something (anything) that could save the Blackberry smart-ish-phone.

But ultimately Haptics is more than waving your hands or body in the air (Kinect) or trying to use a holographic projection or wall mounted Tablet (like Samsung’s CES Innovation award-winning Smart Window) which rapidly leads to a heavy, tired sensation, or “Gorilla Arm” as Human Computer Interface designers call it.

It is about creating a dynamic tactile medium which should be able to tangibly represent almost anything. That might be through a descendent of deformable materials (Shape Memory-alloy or Electroactive Polymers) or a descendent of haptic holography.

It is the Tangible User Interface and will play a big role in the future of mobile devices or even flexible eReader Paper.

So far, so Sci-fi, but could Haptic technology make the mainstream sooner than we think? If there’s anyone who can the technology into real people’s hands – not just those of early adopters – it’s the people at Apple.

The invite to the iPad 3 (or iPad HD?) launch hints that “We have something you really have to see. And touch” and people are taking this to be a trial for possible use of haptics.

If so it could be “a technology from Senseg, a Finnish startup which has developed a system called E-Sense which appears to give texture to a touchscreen. By using “tixels” generated by electric fields from elements embedded around the screen, it can make areas of the screen feel rough, ridged or rounded – and change those just as the screen pixels can change.” Guardian.

We’ll see soon. It could be hype.

It could be a red herring.

it could be a disappointment like the iPhone 5.

Hopefully it won’t be as under-whelming and over-priced as iAds. 😉