LOS ANGELES Star Wars and NASA's Mars rover landings have one thing in common: killer graphics. The two worlds they represent, of fantasy and fact, came together here at the annual Siggraph conference.
Siggraph's popular Emerging Technologies pavilion offered a taste of how computer graphics and imaging will one day be used in interfaces, visualization and the presentation of content.
Presentations from Japanese teams explored the use of graphics technology to represent facial emotions and techniques for embedding cameras into a moving ball, offering a whole new angle on baseball or other sports. A team at Chiba University in Japan detailed the Color-Enhanced Emotion system, which recognizes facial expressions in computer graphics content and controls skin-pigment components using a real-time processor to enhance them. The result is an "emotional facial expression."
"This is very important for Japanese people," said head researcher Toshiya Nakaguchi. "They tend to show little emotion in face-to-face meetings."
With video phones and video chat becoming more commonplace, the researchers said, it will be increasingly important to control image quality in a limited-bandwidth environment by applying emotion effects in real-time at a reasonable cost. The technique could also be applied to movie editing, the team maintained.
The Color-Enhanced Emotion system uses computer vision techniques to recognize feelings expressed in facial images, and then implements a hardware-accelerated real-time processing system to control the pigment components of the skin by replicating a broad range of conditions with color enhancements: fair, suntanned, pale, red-faced and so on. Accurate registration cameras decompose the surface reflection of the face to enhance it with the colors associated with commonly observed emotions.
Elsewhere, Andy Wilson at Microsoft Research wants to let users control objects in displays by movement and gestures. In a demonstration of the company's TouchLight technology, a transparent acrylic-plastic 4 x 3-foot board actually an advanced optical-lens screen from dnpDenmark, a company near Copenhagen was mounted vertically on a jig. Three off-the-shelf cameras and a projector were placed in the back. Like the futuristic displays in the film Minority Report, an otherwise normal-looking sheet of plastic was transformed into a high-bandwidth input/output surface suitable for gesture-based interaction.
"Our current goals include exploration of interaction techniques, signal-processing algorithms and artistic installations that are idiomatic to this configuration," said Wilson.