Eye Movement Recognition based Human Machine Interaction System

Abstract

The sector of human computer access has been undergoing a new revolution lately. While other companies have and are still spending millions to develop highly visually appealing GUIs and state-of–art interaction systems for the common users since the inception of desktops, the development of interaction systems for the disabled has taken a kick start recently. This Eye gaze system is a control system for people with naturally challenged which can run system with their eyes. Where we all are blessed to operate the computer with ease using our hands. But in case of paralytic patients with no mobility and speech even though their brains and vision are functional, they can’t utilize their intelligence and stay unemployed. Thus, our eye gaze system helps in providing solution to this problem.

Introduction

I. INTRODUCTION

Our Eye gaze is a technique used in a variety of areas, including neuroscience, psychology, cognitive science, human computer interaction, etc. However, most previous usage has focused on using the eye tracker as a tool for studying the cognitive processes of the brain. The concept of using an eye tracker as an input device for the control of a computer is a much less studied area of research, mostly focusing on helping those with motor impairments where the eyes could be used as a substitute for the hands. There are different types of eye gazing methodologies available but most of them is pretty uncomfortable for the user. A more invasive technique involves placing a contact lens with a magnetic coil against the user's cornea and adhering it in place with suction.

IILITERATURE REVIEW

1. The existing system such that the interaction amongst the computer and human is carried out with eye-tracking and blink-detection. In this concept, human computer interface system exists which tracks the direction of the human eye. The particular motion and the direction of iris is employed to drive the interface by positioning the mouse cursor consequently. The location iris is completed in batch mode. Here the frames are stored in a permanent storage device and are retrieved one by one. Each of the frames is processed for finding the location of the iris position and there by placing the mouse cursor consequently. Such a system that detects the iris position from still images provides an alternate input modality to facilitate computer users with severe disabilities.
2. In this paper, an individual human computer interface system using eye motion tracking is introduced. Traditionally human computer interface uses mouse, keyboard as an input device. However, the proposed vision-based virtual interface controls system work on various eye movements such as eye blinking. The planned virtual multimodal interface system provides vision-based mechanism, to convey between human and computer system, instead of conventional human computer interaction through mouse and keyboard. For motion tracking, recognition of eye is explored through an optical flow technique. To minimize the error caused by light variation, histogram equalization and max-min normalization is used to improve every frame. An innovative system for user-computer interaction based on the user’s eye-gaze behavior.
3. In  this  paper  we  roughly  describe  some  representative  studies  in  the field  of  eye  tracking,  covering  some  aspects  regarding  different  types  of devices, algorithms for pupil detections, image processing or data filtering and also  some well-known  applications  in assistive  technology,  human  computer interaction, virtual reality, psychology or eBlearning.   As a general tendency we can conclude that in the future eye tracking approaches will be a hot subject for researchers. It is argued by some traditional conferences,  international  projects,  books  and  scientific  papers  and  technical reports.  For  example,  held  once  every  two  years,  Eye  Tracking  Research  & Application  (ETRA)  Conferences  join  together  companies  and  researchers involved in eye tracking technologies and highlight new hardware and software solutions.  Among  many  others  research  groups,  EyeBCom  Corporation  is  an advanced  center  for  eye  tracking  research  and  development  dedicated  to  the creation  of  innovative  eye  tracking  technology  to  improve  and  save  lives, support  the  advancement  of  research,  and  revolutionize  human Btechnology interaction. Special attention should be paid for  performing  experimental procedures in order to evaluate the usability, accuracy and reliability of the eye tracking systems.
4. This research provides a system that is able to trigger mouse movements for controlling an interface for the people who are suffering from some kind of severe. Physical disabilities and who cannot use the system with their hands. The system is able to track eye movement sufficiently and accurately by using the pupil portion and can accurately detect eye blinks whether voluntary and involuntary. The system can track eye portion with the 90% detection accuracy. The system is expanded to work in real time using recorded videos. The proposed system is purely non?intrusive as no hard ware device has been attached to the human body so the system is user friendly and easier to configure. There are still some aspects of the system that are under experimental conditions and development. But this project proved to be an overall success and achieved the goals and requirements as proposed in the system specifications. Many aspects of the system can be a part of the future work for making more efficient and robust eye tracking system. The system can be shifted from recorded videos to a live web cam video with some modifications, for making it alive system. The system can be developed in such away so that it could also detect human eye gazes and act accordingly. There can be some kind of mouse action when the blink is detected. System efficiency can be achieved for making it a more efficient dynamic system.

III. SYSTEM DIAGRAM

IV. ACKNOWLEDGEMENT

First and foremost, I would like to express my sincere gratitude to my Dr. M. A. Pund,  Prof. S. S. Dandgewho has in the literal sense, guided and supervised me. I am indebted with a deep sense of gratitude for the constant inspiration and valuable guidance throughout the work.

Conclusion

This paper comprehensive study of the gaze-based interaction processes is implemented. The mouse pointer is operated using eye. Hence we discuss & study the above Literature survey for developing low-cost based system aims to handle & also affordable for the majority of the physically challenge subjects. This makes the interaction more efficient and enjoyable

References

[1] A Review Paper on Mouse Pointer Movement Using Eye Tracking System and Voice Recognition Prajakta Tangade1 , Shital Musale1 , Gauri Pasalkar1 Miss. Umale M.D., Miss. Awate S.S. 1Computer Engineering, DCOER, Pune, India [2] Shazia Azam, Aihab Khan, M.S.H. Khiyal, “design and implementation of human computer interface tracking system based on multiple eye features” JATIT?journal of theoretical and applied information technology, Vol.9, No.2 Nov, 2009. [3] Craig Hennessey, Jacob Fiset, “Long Range Eye Tracking: Bringing Eye Tracking into the Living Room”, IEEE, 2012 [4] Sidra Naveed, Bushra Sikander, and Malik Sikander Hayat Khiyal “Eye Tracking System with Blink Detection”, [5] Yingxi Chen, “Design and evaluation of a human-computer interface based on electro-oculography”, 2003, unpublished. URL: vorlon.case.edu/~wsn/theses/ yingxichen_thesis.pdf [6] Arantxa Villanueva ,Rafael Cabeza,Sonia Porta “Eye Tracking System Model With Easy Calibration”,IEEE , 2011 [7] Arie E. Kaufman, Amit Bandopadhay, and Bernard D. Shaviv “An Eye Tracking Computer User Interface”, IEEE , 2011 [8] Takehiko Ohno ,Naoki Mukawa ,Shinjiro Kawato “Just Blink Your Eyes: A Head-Free Gaze Tracking System”, IEEE, 2011 [9] Shazia Azam, Aihab Khan, M.S.H. Khiyal, “design and implementation of human computer interface tracking system based on multiple eye features” JATIT?journal of theoretical and applied information technology, Vol.9, No.2 Nov, 2009. [10] Margrit Betke, James Gips,Peter Fleming ,“The Camera Mouse: Visual Tracking of Body features to Provide Computer Access for People With Severe Disabilities”, IEEE Transactions On Neural Systems And Rehabilitation Engineering, Vol.10, No.1, March 2008..

Copyright

Copyright © 2022 Miss. Aakansha P. Tiwari, Dr. M. A. Pund, Prof. S. S. Dandge. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.