Finger Gesture Recognition based Home Automation using IOT

Abstract

Home automation is a fast-expanding industry that attempts to give homeowners a more practical and effective method to manage their properties. The goal of this project is to create a home automation system using Arduino that recognises hand gestures and controls the linked home appliances using an APDS9960 gesture sensor. To recognise hand movements like up, down, left, and right and to carry out operations like turning on and off lights, fans, etc., the hand gesture algorithm is built using the Arduino IDE. The suggested technique eliminates the requirement for physical switches and offers a more practical and approachable method of operating household equipment.

Introduction

I. INTRODUCTION

Recognition of hand gestures using IoT with the use of hand gestures, consumers can operate home appliances through home automation technology. A computer or microcontroller processes the hand motions captured by sensors in the system in order to interpret them and carry out the intended actions, such as turning on or off lights or altering the temperature. Without the need for physical buttons or switches, this technology provides a simple and convenient method to operate household appliances. Additionally, a system that meets the requirements of the elderly and the disabled and enables remote monitoring of their health is required for the convenience of all parties. Such a system would provide much-needed assistance to them.

II. METHODOLOGY

A. Hardware Configuration

The system combines a gesture sensor with a microcontroller, such as an Arduino.

B. Gesture Detection

The user's hand motions are recognised by the gesture sensor module, which then provides the relevant data to the microcontroller.

???????C. Gesture Interpretation

To interpret gesture input and link it with predetermined motions that are connected to certain household appliances or tasks, the microcontroller executes an algorithm.

???????D. Contactless Communication

Following the microcontroller's interpretation of the gesture, the device or appliance (such as a smart bulb or a smart lock) will send a signal to carry out the required action.

III. COMPONENTS REQUIRED

The following components are necessary for the proposed system:

???????A. Arduino UNO

The ATmega328P microcontroller serves as the base for the open-source Arduino Uno microcontroller board. It was first released in 2010 by the Arduino Corporation in Italy.

Here is a brief description of each pin:

Reset: The microcontroller is reset via this pin.

3.3V: This pin offers regulated power at 3.3 volts

5V: This pin delivers regulated power at 5 volts

GND: These pins are connected to the ground.

AREF: For analogue inputs, this pin serves as the reference voltage.

6–11 Digital I/O Pins: These pins, known as digital I/O, can be used as inputs or outputs. They can deliver up to 40 mA of current and run at 5 volts.

12–13 Crystal Pins: For precise timing, these pins are used to link an external crystal oscillator.

14–19. Analogue Input Pins: These pins are capable of serving as analogue inputs. They are capable of measuring voltages between 0 and 5.

I2C pins: I2C communication is carried out using these pins.

???????B. APDS9966-Gesture Sensor

The APDS-9960 Gesture Sensor is a flexible sensor that may be utilised in several applications that call for gesture recognition, proximity sensing, and ambient light sensing. It is ideal for use in portable and wearable devices because of its low power consumption and tiny form factor.

Operational Voltage: 2.4V to 3.6V

Operating Range: 4–8 inches (10–20 cm)

I2C Interface (0x39 for I2C Address).

Proximity, RGB colour sensing, and ambient light Gesture detection and sensing in an optical module

I2C-bus Fast Mode Compatible interface with 400 kHz data rates.

C. LCD Display

An LCD display is one of the most popular accessories for microcontrollers. 16x2 and 20x2 LCD screens are some of the most

popular LCDs attached to the numerous microcontrollers.

According to this, there are 16 characters per line by 2 lines and 20 characters per line by 2 lines, respectively. It is simple to connect to the Arduino.

VI. FUTURE SCOPE

Based on the present scenario, we may create a cross-platform system that can be used on several platforms, such as iOS and Windows. By automating all other household appliances as well, the restriction of only being able to operate a few gadgets may be lifted. The prototype may incorporate sensors to implement autonomous control of household appliances, such as an LDR that can detect daylight and adjust bulb timing and a PIR that can detect motion and be used for security reasons by sounding an alert. By including small workplaces in the project's scope as well as households, the project's reach may be extended to a wide range of settings. This project allows for voice control of the devices utilising Bluetooth by attaching a voice module.

Conclusion

It is clear from this project\'s work that a home automation system for individual control can be made inexpensively from low-cost, locally available components and used to control a variety of home appliances, including security lamps, televisions, air conditioners, and even the entire home lighting system. Better yet, the small number of components needed allows them to be packaged into a discrete, small container. Different home appliances used in the lighting system, air conditioning system, home entertainment system, and many more are controlled by the designed home automation system. Due to its scalability and adaptability, this system It has been created with features that integrate with all of the hardware used. Each module\'s presence and placement have been carefully considered and have a positive impact on how well the unit functions. In addition, the project has been implemented effectively, employing cutting-edge ICs and advancing technology. Consequently, the project has been successfully developed and tested

References

[1] Smruti Kshirsagar, Srushti Sachdev, Navjyot Singh, Anushka Tiwari, Sunita Sahu , “IoT Enabled Gesture Controlled Home Automation for Disabled and Elderly”, IEEE, 978-1-7281-4889-2/20/$31.00 ©2020 IEEE, 1-6. [2] C Nithin, B Rakesh, B Sai Teja, S Rekha, “Gesture Recognition based Contactless Switch using IoT ”, ISSN : 2455- 3778, 2021, 1-6. [3] S. P. Manikanta, Bandari Subhakar, Duda Prasad, “Gesture Based Appliance Automation System using IOT”, JES, Vol 11, Issue 4 , April/2020 ISSN NO:0377-9254, 1-5. [4] Dr. C. K. Gomathy, MR. Y. Venkata Sai , Mr. Y. Yaswanth Kumar “The Home Automation using IOT”, IJSREM, Volume: 05 Issue: 10 | Oct – 2021, 1-8. [5] R. Jayanthi, A. Bhuvaneswari, S. Rajkumar , K. P. Rama Prabha, “Vision based Hand gesture pattern recognition enabled home automation system using Internet of Things ”, ISSN, ISSN: 0011-9342 | Year 2021 Issue: 7 | Pages: 8975-8990, 1-17. [6] Ricquebourg, Vincent, David Menga, David Durand, Bruno Marhic, Laurent Delahoche, and Christophe Loge. \"The smart home concept: our immediate future.\" In 2006 1st IEEE international conference on e-learning in industrial electronics, pp. 23-28. IEEE, 2006. [7] Alshu\'Eili, Humaid, Gourab Sen Gupta, and Subhas Mukhopadhyay. \"Voice recognition based wireless home automation system.\" In 2011 4th International Conference On Mechatronics (ICOM), pp. 1-6. IEEE, 2011. [8] Ravi, A., R. Brindha, S. Janani, S. Meenatchi, and V. Prathiba. \"Smart Voice Recognition Based Home Automation System for Aging and Disabled People.\" International Journal of Advanced Scientific Research & Development (IJASRD) 5, no. 1 (2018): 11-18. [9] S. Kumar and S. S. Solanki, \"Voice and touch control home automation,\" 2016 3rd International Conference on Recent Advances in Information Technology (RAIT), Dhanbad, 2016, pp. 495-498.

Copyright

Copyright © 2023 Neha G, Harika CH, Swetha G, Vishu Kanth G. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.