Interactive surfaces provide novel ways of interactions by closely replicating the familiar hands-on experience of everyday object manipulation. It is much more enjoyable and efficient than using a mouse and keyboard. However, most of the currently available interactive surfaces are based on infrared sensing and projection. Thus, those are very expensive and require a higher engineering knowledge to setup.
The purpose of this project is to avoid those expensive infrared sensing techniques and provide a computer-vision based solution to retrofit existing flat displays into interactive surfaces. Furthermore, the proposed solution is cost effective and requires minimum engineering knowledge to setup, as it uses a small number of hardware devices.
This project is submitted in partial fulfillment of the requirements for the BSc (Hons) Software Engineering degree. The Hardware prototype of iDisplay includes minimum number of devices. It doesn't use any expensive sensors and Infrared based techniques.
The Sensing System of iDisplay is implemented using C++ with OpenCV as the image processing library. openFrameworks is used as the main application framework. openFrameworks wraps OpenCV and OpenGL providing an easy and simple development environment for wide range of applicaitons. Several suitable image processing techniques, including background subtraction and skin colour detection are empliyed to identify the user input.
Pinching gesture is used as the main interaction method and the system is capable of identifying circular tangible objects and their colours.
iDisplay uses TUIO to send touch events to client applications. Therefore, existing multitouch applications, which are developed using TUIO, can also be integrated with the same hardware prototype.
| iDisplay RGB | iDisplay RGB PlayIT |
| iDisplay GhostVIew | |
Academic Excellence Award First Place for the Best Final Year Undergraduate Project at Cutting Edge 2009
Tertiary Category Gold Award at the National Best Quality Software Awards (NBQSA) 2009
Special Award for the Best Project Developed Using OpenSource Technologies at the National Best Quality Software Awards (NBQSA) 2009
Special Merit Award at the Asia Pacific ICT Awards 2009 (APICTA)
Natural User Interface (NUI) Group - iDisplay - In Air Interactive Gestures
Hack a Day - iDisplay, webcam multitouch
MULTITOUCH + NUI - iDisplay - Gesture and Tangible Computing On The Cheep
BCS - Sri Lanka Section - NBQSA winners bring recognition to Sri Lanka at APICTA 2009
Daily News - 10 Feb 2010 - Informatics student wins : At the Asia Pacific ICT Awards (APICTA)
The Sunday Times - 18 July 2010 - Logistics, inclusion added to NBQSA awards categories
Lahiru Lakmal Priyadarshana | M: +94 (0) 776192598 | llahiru AT gmail DOT com