Sound Of Code

ABOUT

Interactive surfaces provide novel ways of interactions by closely replicating the familiar hands-on experience of everyday object manipulation. It is much more enjoyable and efficient than using a mouse and keyboard. However, most of the currently available interactive surfaces are based on infrared sensing and projection. Thus, those are very expensive and require a higher engineering knowledge to setup.

The purpose of this project is to avoid those expensive infrared sensing techniques and provide a computer-vision based solution to retrofit existing flat displays into interactive surfaces. Furthermore, the proposed solution is cost effective and requires minimum engineering knowledge to setup, as it uses a small number of hardware devices.

This project is submitted in partial fulfillment of the requirements for the BSc (Hons) Software Engineering degree. The Hardware prototype of iDisplay includes minimum number of devices. It doesn't use any expensive sensors and Infrared based techniques.

The Sensing System of iDisplay is implemented using C++ with OpenCV as the image processing library. openFrameworks is used as the main application framework. openFrameworks wraps OpenCV and OpenGL providing an easy and simple development environment for wide range of applicaitons. Several suitable image processing techniques, including background subtraction and skin colour detection are empliyed to identify the user input.

Pinching gesture is used as the main interaction method and the system is capable of identifying circular tangible objects and their colours.

iDisplay uses TUIO to send touch events to client applications. Therefore, existing multitouch applications, which are developed using TUIO, can also be integrated with the same hardware prototype.

PICTURES

     

     

     

     


VIDEOS



Above video demonstrates the extensibility of iDisplay using some exisiting multitouch applications developed by the community. Please visit NUI Group for more info about these multitouch applications.

Interactive Applicaitons

Even though the main concern of iDisplay is to develop a generic, low cost and simple hardware setup; Following interactive applications were also developed and used to demonstrate the capabilities of iDisplay.

iDisplay RGB	iDisplay RGB PlayIT
iDisplay GhostVIew

PUBLICATIONS

• Lahiru Priyadarshana. "iDisplay: A Computer-Vision Based Solution to Retrofit Existing Flat Displays into Interactive Surfaces." BSc. Thesis. Informatics Institute of Technology, Sri Lanka. 2009

AWARDS

Academic Excellence Award First Place for the Best Final Year Undergraduate Project at Cutting Edge 2009

Tertiary Category Gold Award at the National Best Quality Software Awards (NBQSA) 2009

Special Award for the Best Project Developed Using OpenSource Technologies at the National Best Quality Software Awards (NBQSA) 2009

Special Merit Award at the Asia Pacific ICT Awards 2009 (APICTA)

MENTIONS

Natural User Interface (NUI) Group - iDisplay - In Air Interactive Gestures

Hack a Day - iDisplay, webcam multitouch

MULTITOUCH + NUI - iDisplay - Gesture and Tangible Computing On The Cheep

BCS - Sri Lanka Section - NBQSA winners bring recognition to Sri Lanka at APICTA 2009

Daily News - 10 Feb 2010 - Informatics student wins : At the Asia Pacific ICT Awards (APICTA)

The Sunday Times - 18 July 2010 - Logistics, inclusion added to NBQSA awards categories

CONTACT

Lahiru Lakmal Priyadarshana  |  M: +94 (0) 776192598  |  llahiru AT gmail DOT com

^