Microsoft's corporate campus is a sprawling affair,
with more than 100 buildings scattered over 261 acres. To make sense of
it all, you have to navigate by numbers. The Microsoft Visitor Center,
for instance, is in Building 127, north campus, while the Microsoft
Conference Center is in Building 33, just down the road from the
company soccer and baseball fields. About 4 miles away, however, there
is an unnumbered building that is decidedly "off campus." In that
building, Microsoft has quietly been developing the first completely
new computing platform since the PC — a project that was given the
internal code name Milan. This past March, when the project was still
operating on the down low, I became the first reporter invited inside
these offices. My hosts politely threatened legal consequences if I
blabbed about the project to anyone not directly involved in it, then
escorted me down a dark hallway to a locked corner conference room.
Inside that room was Microsoft's best-kept technology secret in years
... a coffee table.
The product behind the Milan project is called the Microsoft
Surface, and the company's unofficial Surface showman is Jeff Gattis.
He's a clean-cut fellow who is obviously the veteran of a thousand
marketing seminars. He spoke in sentences peppered with "application
scenarios," "operational efficiencies" and "consumer pain points" while
he took me through a few demonstrations of what the Surface can do. One
of Gattis's consumer pain points is the frustrating mess of cables,
drivers and protocols that people must use to link their peripheral
devices to their personal computers.
Surface has no cables or external USB ports for plugging in
peripherals. For that matter, it has no keyboard, no mouse, no
trackball — no obvious point of interaction except its screen.
Gattis took out a digital camera and placed it on the Surface.
Instantly, digital pictures spilled out onto the tabletop. As Gattis
touched and dragged each picture, it followed his fingers around the
screen. Using two fingers, he pulled the corners of a photo and
stretched it to a new size. Then, Gattis put a cellphone on the surface
and dragged several photos to it — just like that, the pictures
uploaded to the phone. It was like a magic trick. He was dragging and
dropping virtual content to physical objects. I'm not often surprised
by new technology, but I can honestly say I'd never seen anything like
it.
Diagram by Intoaroute
(1) Screen: A diffuser turns the Surface's acrylic
tabletop into a large horizontal "multitouch" screen, capable of
processing multiple inputs from multiple users. The Surface can also
recognize objects by their shapes or by reading coded "domino" tags.
(2) Infrared: Surface's "machine vision" operates in
the near-infrared spectrum, using an 850-nanometer-wavelength LED light
source aimed at the screen. When objects touch the tabletop, the light
reflects back and is picked up by multiple infrared cameras with a net
resolution of 1280 x 960.
(3) CPU: Surface uses many of the same components found in everyday desktop computers
— a Core 2 Duo processor, 2GB of RAM and a 256MB graphics card.
Wireless communication with devices on the surface is handled using
WiFi and Bluetooth antennas (future versions may incorporate RFID or
Near Field Communications). The underlying operating system is a
modified version of Microsoft Vista.
(4) Projector: Microsoft's Surface uses the same DLP
light engine found in many rear-projection HDTVs. The footprint of the
visible light screen, at 1024 x 768 pixels, is actually smaller than
the invisible overlapping infrared projection to allow for better
recognition at the edges of the screen.
The Anti-PC
The name Surface comes from "surface computing," and Microsoft envisions the coffee-table machine as the first of many such devices.
Surface computing uses a blend of wireless protocols, special
machine-readable tags and shape recognition to seamlessly merge the
real and the virtual world — an idea the Milan team refers to as
"blended reality." The table can be built with a variety of wireless
transceivers, including Bluetooth, Wi-Fi and (eventually) radio
frequency identification (RFID) and is designed to sync instantly with
any device that touches its surface.
One of the key components of surface computing is a "multitouch"
screen. It is an idea that has been floating around the research
community since the 1980s and is swiftly becoming a hip new product interface — Apple's new iPhone
has multitouch scrolling and picture manipulation. Multitouch devices
accept input from multiple fingers and multiple users simultaneously,
allowing for complex gestures, including grabbing, stretching,
swiveling and sliding virtual objects across the table. And the Surface
has the added advantage of a horizontal screen, so several people can
gather around and use it together. Its interface is the exact opposite
of the personal computer: cooperative, hands-on, and designed for public spaces.
If it seems as though the Surface machine sprang up out of nowhere,
that's only because Microsoft has been unusually secretive about it.
Early designs of the table were displayed around the room as evidence
of the product's long development cycle; rejected shapes included
"squashed white egg" and "podium." Steven Bathiche, research manager
for the project, has been involved since the beginning (in 2001) when
he and fellow researcher Andy Wilson first dreamed up the idea of a
tabletop computer. Bathiche spoke about the Milan project's evolution
with the evident excitement of a man who's had to keep the most
important thing he's ever done a secret for six years. "We've gone
through several generations of this machine," he said. "The first was a
proof-of-concept called T1, and we just hacked it into an IKEA table."
And there it was, partially disassembled, behind me. It looked as
if they had attacked the prefab particleboard furniture from the
Swedish superstore with a Sawzall, then stuffed in off-the-shelf
computer parts, cameras, projectors and mirrors until it all worked.
The idea went straight to the top: Once Bill Gates okayed it, surface
computing moved from a heady research project to the nuts-and-bolts
planning of product development.
After you see the Surface in action, it doesn't take long to figure out
just how attractive such a machine must be to the retail and service
industries. Microsoft has partnered up with cellular provider T-Mobile,
as well as hotel conglomerate Starwood Hotels and Resorts (which owns
Sheraton, Westin and W Hotels, among others) and Vegas casino giant
Harrah's Entertainment. Machines will be ready for deployment by the
end of 2007.
So you could, for instance, walk into a T-Mobile store, pick up a
phone you're considering buying and place it on the Surface. The table
could then either link with the phone via Bluetooth or scan a code
imprinted on the packaging to identify it. Suddenly, the phone is
surrounded by graphical information (pricing, features, etc.). After
selecting a service plan and any accessories, you just run your credit
card through a reader built into the table (or, when RFID cards have become the norm,
just slap your card on the tabletop) and your new phone is paid for. By
the time you open the package, everything is set up — all without
talking to a single employee.
It's easy to dismiss the concept as pure novelty — and at first it
may well be. But ask yourself: When was the last time you made a bank
withdrawal from a human teller? The Surface machine is networked and
infinitely flexible. You could use it to order food in a restaurant.
While you wait, you could play games or surf the Internet, and then eat
off its surface. And every table in the joint could be a jukebox, a
television or a billboard for advertising. (You didn't think
advertisers would miss out on this, did you?)
And once you've gotten used to ordering calamari through a tabletop
at your favorite eatery, you may want to use it to call up recipes on
your kitchen counter. Surface machines will cost $5000 to $10,000 at
launch, but as prices fall, similar devices may find their way into the
home. "We view its migration as similar to that of plasma TVs," says
Pete Thompson, Microsoft's general manager for surface computing.
"People will see it in public spaces like bars and restaurants and want
to expand it into other environments." Its current coffee-table shape
could evolve into a Pottery Barn-style catalog of computerized
furniture — a dining room table, a wall-mounted panel, a desk or
practically any surface. "It's a platform that can be put into various
form factors," Thompson says. "This is a way to put technology into a
piece of wood."
Computer
scientists see technologies such as surface computing and multitouch as
the key to a new era of ubiquitous computing, where processing power is
embedded in almost every object and everything is interactive. Last
year, New York University professor Jeff Han launched a company called
Perceptive Pixel, which builds six-figure-plus custom multitouch
drafting tables and enormous interactive wall displays for large
corporations and military situation rooms. "I firmly believe that in
the near future, we will have wallpaper displays in every hallway, in
every desk. Every surface will be a point of interaction with a
computer," Han says, "and for that to happen, we really need interfaces
like this."
Short-term success for a technology can be measured by how much
attention a product gathers when it is new. Long-term success is
measured by how effectively that product disappears into the everyday
routine of life. Surface computing has enormous potential to do both —
it is a splashy new computer interface, surrounded by hype, but it is
also, quite literally, furniture. It is a technology in its infancy,
where even the engineers behind it can't predict its full impact; but
the possibilities are everywhere, underhand and underfoot — on every
surface imaginable.
This tabletop computer
uses “multitouch” technology to let several users, employing their
fingers, manipulate images and other data right on the screen—no
keyboard or mouse needed. In that, it’s like two other Breakthrough
winners, the Apple iPhone and Jeff Han’s Media Wall.
But the Surface recognizes more than mere fingers—it can also sense and
interact with objects both digital (cameras, phones) and nondigital
(water glasses, paint brushes) placed on top of it. It’s a big step
toward a future of pervasive computing, where digital processing power
makes everything from tables to walls to floors interactive.