People today are faced with the cumbersome task of dealing with disparate content on multiple screens, via multiple platforms, and through multiple profiles. The unification of experience is the great frontier for innovation in technology, user interface design, and computing. How we get there is up in the air.

The number of ‘digital’ screens we view every day and the sheer amount of diverse content we consume through those screens can feel overwhelming at times. How our experiences of those screens and the content we consume through them (more the latter, as screens may become antiquated) are brought together, consolidated and streamlined is the great frontier of innovation in technological development and user interface design, I believe.

The unification of experience is the term I’ll use to describe the unrealized ideal of a trend toward the coalescence of our experiences through those screens (though I’ll limit the discussion to ‘digital’ screens, as opposed to traditional ‘screens’ like book pages and canvases).

The screens I personally interact with regularly are: my  personal laptop, my netbook, my personal monitor, the other personal monitor/LCD my friend loaned me, my work laptop, my work monitor, various other screens I use at work (the LCDs I use on the walls of meeting rooms and the projector in the screening room), my smart phone, and the TV in my living room.

I admit, though — I probably interact with a lot more screens than the average person. Still, according to recent research by the Council for Research Excellence (recently cited by CBS), “The average American adult now spends 8-1/2 hours a day staring into screens.” That’s not an insignificant amount of time, and chances are that those interactions aren’t limited to a single screen.

The screens of our life and the content we consume through them take up varying proportions of our time, on average. An interesting infographic from Boston's AMP agency, released during MITX's first annual FutureM Conference.

As both the number of screened devices people use and the time they spend with those devices increases,  the unification of experience becomes an increasingly important idealization of a trend — and one that  the titans of media and technology are seeking to attain at an ever faster clip through varying strategies and tactics.

3 Approaches That Could Work

While there are a host of innovators aiming to attain the unification of experience  through myriad tacks, there are only a few avenues that I think are truly viable. Even these, though,  are harried by obstacles that lead me to believe it’s unlikely that any single one of these strategies will ever have the opportunity to fully succeed.

1. The Cloud, Ubiquitous Broadband & Inter-Operable Languages. Companies like VMWare, Cisco and IBM (among others) are laying the groundwork for a computing future in ‘the cloud’, while the FCC pushes policies to expand the scope and speed of broadband coverage in the United States. These trends, in tandem with development and dissemination of inter-operable computer languages, could be factors that facilitate the perfect storm of tech that would ultimately lead to (something like) the unification of experience naturally. Simply put, the cloud provides an external place where programs, content and even computing can live, while users are free to move from device to device and have similar experiences that are delivered via the internet.  Think Google Apps, but broader. The adoption of a singular inter-operable language (which is dominating certain niches of cross-platform communication — e.g., Flash vs HTML5), while less likely, would augment the cloud and broadband’s strides toward the unification of experience.
2. A Closed Ecosystem of Devices, Software & Experiences. Undoubtedly, the company most successful at executing this strategy is Apple. Their “walled apple grove” is both beautiful and verdant. Their hardware, software, virtual shopping experiences and developer community — while aggravating to many competitors and developers — has created an unparalleled attempt at taking on the unification of experience single-handed. The problem: there are competitors that are coming out with comparably awesome experiences. Their barrier for creating a similarly closed ecosystem? — They’re not as cool. Don’t count competition out, though. Companies like Samsung are going to give Apple a run for their (heaping pile of) money.
3. Cross-Platform programs that Bridge Devices and Share Content. While many of these types of programs (e.g., Google’s many online apps) reside in the cloud, there are a host of ‘hybrid’  programs (downloadable programs, online portals, mobile interfaces) that allow devices to communicate and share content among each other seamlessly and with little thought for users (other than using them). Among my favorites are Evernote and Dropbox; sadly, I have yet to see All Share (on my Samsung Epic 4G) work in action, though it seems to have a lot of potential. Less ambitious programs like Gmote are also tackling the unification of experience, though in much smaller bites.

Barriers to Unity

• Privacy, Security & Cultural Backlash: With data, content and operable capabilities flowing from device to device, it’s no wonder that attaining the unification of experience is fraught with security and privacy issues. User access, compliance with regulations and figuring out where data resides are among the many security challenges, for example, that cloud computing faces, according to Gartner Research. Google and Facebook are the most publicized villains in the ever-growing debate over online privacy. Truth be told, though, it’s a broader cultural question — with vast differences across nations — that pits one of the fastest growing areas of business (how companies wield data) against traditional cultural mores about privacy. How this will play out remains to be seen.
• A Competitive Market & Fragmented Innovation. The nature of a competitive market gives rise to the fragmentation of technological innovation (as a result of differing business models). Not every company can be Apple, but many will try their damnedest to break the efficacy of Apple’s business model and introduce disruptive innovations that prevent them and others like them from gaining too great an advantage in any one of the aforementioned strategic areas. The result is a ‘king of the hill’ approach toward playing in this space. But, if businesses can find mutual benefits from helping each other win (as many are already doing — e.g. Sony, Intel and Google with GoogleTV) we may be looking at a more unified future.

Closing Thoughts

I initially wanted to include a piece about ‘pervasive computing,’ which is, in many ways, of the same ilk of idealized trends as the unification of experience. But, for the sake of brevity (yes, I realize this post is long), I’ll leave you with a salient quote from IBM’s W.S. Ark and T. Selker:

“Part of the beauty of pervasive computing is that we will not even realize that it is here, once it has become a necessary part of our lives. In the future it will often be invisible, and the user interface will be intuitive. The other important part of the story is that it will all be networked. Data, once entered, will never have to be entered again, but will be readily available whenever and wherever needed.”

Regardless of whether unification of experience or pervasive computing is attainable, is it a reality we want? Do we really want to be that ‘jacked in’?  I leave you with this video, which one of my colleagues sent me with the note: “If this is the future, shoot me now.”

I’d love to read what you think in the comments section.

Share the Future

Will marketers and developers recognize the full potential of Kinect's functionalities?

What Kinect Does & What Makes it Unique

In an initial ‘Project Natal’ (Kinect) fact sheet released in May 2009, Microsoft describes what differentiates its functionality:

• Controller-free gaming and entertainment. “Project Natal” provides a whole new way to play — no controller required. It uses a sensor to track your body movement and recognize your face, even listen to your voice. If you know how to move your hands, shake your hips, or speak, you and your friends will be able to jump instantly into any “Project Natal” experience.
• Full-body play. “Project Natal” provides a new way to play where you use all parts of your body — head, hands, feet and torso. With controller-free gaming you don’t just control the superhero, you are the superhero. Full-body tracking allows the “Project Natal” sensor to capture every move, from head to toe, to give players a full-body gaming experience.
• Personalized play. “Project Natal” provides an in-game experience in which the player’s face and voice are recognized. Greet and speak to characters in the game, or simply step into view of the sensor to log into Xbox LIVE and connect with friends. Only “Project Natal” is smart enough to remember voices and faces. Fun has never been so personalized.
• Off-the-couch play. “Project Natal” provides gameplay that gets you off the couch, on your feet and in the fun. Each “Project Natal” experience is designed to get players moving, laughing, cheering and playing together. “Project Natal” makes social gaming off-the-couch fun.
• Easy-to-play fun. “Project Natal” makes sharing in the fun a snap. Talk or watch a movie in the same living room or on the other side of the world — no headset, no keyboard and no controllers required. It’s just you, your friends, your family and a whole new way to play.

Controller-free interaction already places Kinect a cut above Nintendo‘s wildly popular Wii gaming system–and Sony‘s soon-to-be released Move controller apparatus for Playstation 3.

Beyond not needing a controller, the platform’s ability to recognize a person’s entire body — face included — and voice creates a whole new level of identification between the user and her virtual persona. On top of recognizing you, it remembers you, allowing for easy recollection of checkpoints and check-ins (a hint of what’s to come in the article!).

Seeing the Kinections

Now that you know what it does, let’s consider some of its potential applications.

• Retail: Zugara’s webcam social shopper cracked the door open to the possibility of a camera-based virtual retail experience. Despite its efforts, however, its inability to gauge size and body type of the user makes the experience somewhat useless, in terms of how the item actually fits. With its ability to recognize all parts and angles of a person’s body and gauge depth perception, the Kinect platform kicks the door wide open not only to virtual experiences in clothing retail, but also to head-focused retail like cosmetics and glasses.
• Customer Loyalty Programs: Mark Cuban’s recent suggestion of ‘checking-in’ via facial recognition (by a company he recently purchased, of course) is a step in the right direction. Even separated from services like foursquare or gowalla, the notion of ‘checking in’ — particularly, by facial recognition — can dramatically impact how businesses run their customer loyalty programs. For small businesses, Kinect and Xbox 360 could provide a relatively inexpensive platform to deploy this type of model. But, using such a system would naturally depend on customers’ privacy thresholds for being recognized whenever they enter a store.
• Fitness: For Wii users, using motion-sensitive gaming is a foregone conclusion. For Kinect users, the experience will be that much better, largely due to enhanced sensitivity to users’ actual physical bodies, not a controller’s relative position to where it was moments before. This leads to my next point.
• Education: Training programs that require physical movement — e.g., sports training, physical therapies and some forms of art — could be greatly enabled by Kinect’s platform. Not only that–they could be social, and people could participate in programs ‘alongside’ friends and other users from around the world, allowing interactions among those who are learning in real-time.

While I briefly discuss some broad applications, there are certainly more, and I’d love to hear some of your ideas in the comments section! Enjoy this video demo of Kinect from CNN!

Share the Future

Steve Jobs holding up the iPad, to be released in April 2010.

Rumors that Apple’s highly anticipated iPad will ship with a webcam gives me reason to believe that Steve Jobs’ tablet from on high is, indeed, the must-have item of the next decade.

A webcam not only adds value to the iPad’s functionality, but it also can potentially transform how we communicate with one another, interact with the real world, and convey our identities through social media.

1. As a Portable Video Replacement for the Cell Phone. Imagine a world in which people replace cell phones with iPads. Looking into the face of callers on a 10-inch color screen replaces audio-only communication. Not only that — instead of paying for the minutes and data plan for your smart phone, you only pay one flat fee for unlimited iPad 3g/4g service.

Skype on iPhone - click to Learn more about its limitations.

2. Augmented Reality Viewer. Imagine pointing your iPad at an object and/or place and immediately receiving a wide array of information about the object, which is overlaid on the image. Imagine you’re an anatomy student looking at a cadaver. Now a person in a mall. Now an art lover in a museum. The possibilities are endless.

3. The Ultimate Social Media Device. Imagine a world of mobile video journals, equipped with what is effectively a 10-inch mirror. Narcissistic video bloggers will have an even better tool to give on-the-go, content-rich updates of their thoughts and physical appearance at any given moment. Enabling mobile, video-rich social media updates may also empower a new level of citizen journalism, beyond video snippets and mobile tweeting.

Assuming both strong networks to support iPad and that Apple will leave these features unlocked — admittedly “ifs” — these features (enabled by another big “if,” the webcam) can alter the communications landscape even more so, I think, than the reader features will immediately affect the old media landscape.

Share the Future