martes, 2 de abril de 2013

PUI - a new gateway to control your computer!


Perceptual User Interface (PUI) is one kind of technology that allows user to interact with computer without using other forms of aids such as keyboard and mouse. It is extremely useful for people have physical difficulties to use computers and it has become a very popular subject in computing department in most of universities.

When I was doing my undergraduate, I have studied a course called computer vision. Computer vision is a field that includes methods for acquiring, processing, analysing, and understanding images and, in general, high-dimensional data from the real world in order to produce numerical or symbolic information[1].

During the course, we were required to develop a graphical user interface that would allows user interact with the system by pointing with their finger.  Basically, we set up a camera and record the movement of our fingers, the camera was connecting with computer so it was sending the live video to the computer at the same time. What the program does is tracing the tip of the finger (please see the picture below, there is a red arrow at the tip of the finger on the right window) when the finger is moving in the video simultaneously. This program is very helpful for disabled people that cannot use the keyboard or mouse. For example, if a disabled person wants to tell computer to open a website, he/she can just by pointing his/her finger to a specific point which we can pre-define that point is ‘internet’ browser point, so the computer can open web browser automatically.  It does sounds similar to iphone, but the difference is to use Iphone’s touch screen, the user will need to touch the screen physically. However, the program I developed does not even need the user to touch the screen at all. This is much cooler as you can control your computer remotely without any physical touch!






[1] http://en.wikipedia.org/wiki/Computer_vision

No hay comentarios:

Publicar un comentario