Cardiac arrest is one of the main causes of human death worldwide. Every year, about 610,000 people die of heart attack that is one in every four deaths but there are well understood early symptoms of heart attack that could be used to greatly help in saving many lives and reducing damages bydetecting and sending alerts at an early stage. According to survey, every year, about 2.35 million people meet with accident from road accidents. Surprisingly, many of these fatal accidents happen due to the heart attack of drivers that leads to the loss of control of the vehicle. Accidents are imminent as long as there are drivers with medical conditions resulting in a lot of unfortunate crashes. We have designed a system which captures the facial image of the person and analyses the Heart attack symptoms. Immediately if any of the symptoms matches with the image of the face captured, the system would check other parameters. other parameters including Heart rate and oxygen level. When these parameters also match with abnormal conditions, then our designed system would give an output saying that the person is going through a Heart attack and sending alert messages to nearby hospitals.
Introduction
I. INTRODUCTION
Heart attack is one of the main cause of human death worldwide. Every year, about 610,000 people die of heart attack that is one in every four death but there are well understood early symptoms of heart attack that could be used to significantly help in saving many lives and reduce damages by detecting and reporting at an early stage. Hence there is lack of information in individuals about the initial stage of heart attack.
While a person meeting with a heart attack, a plaque will rupture and spill cholesterol and other substances in the bloodstream. A clot is formed at the site of the rupture. If the clot is huge, it will block blood flowing through the coronary artery, starving the heart of oxygen and nutrients (ischemia).
The current work proposes the development of a system for real-time detection and warning of heart attacks in drivers, which could be enormously helpful in reducing road accidents. The system consists of a web camera that monitors the driver’s facial expressions. When facial expressions are observed, the data send to sensors which record the other parameters such as heart rate and oxygen level conditions.
Emergency call is sent to a nearby hospital and the speed of the Based on this the system detects whether the person has the heart attack or not. If the heart attack is detected an vehicle is reduced. The designed system can therefore help in decreasing the loss of lives from the increasing number of road accidents all over the world..
This project can be installed in a car where our designed system can say whether driver would meet with Heart attack or not, then we can slow down the speed of car .So this avoids the road accidents and also inform the nearby hospitals about the situation. By this we can save many lives.
It can be used to monitor the old people at home who have a greater chances of getting Heart attack. It can also be used in hospitals to monitor patient admitted with heart related issues because Doctors can’t monitor the patients 24*7 ,so this can alert the Doctor if a patient is going to meet with Heart attack.
II. RELATED WORKS.
A. XiaodongZhuang and others (2019) proposed a “Face Analysis for Coronary Heart Disease Diagnosis”. In
In this paper, they conducted an automatic analysis of the texture features extracted from eight ROIs (Regions of Interests) of the face images. Depending on the texture features, random forest and decision tree are used to detect whether the it has a CHD, or not. The experimental results on a set of 1528 face images collected from 309 subjects suggest that, our approach achieved a promising, i.e. 72.73%, prediction accuracy.First of all, the 68 facial landmark points and ears are detected.
B. Shen Lin1, Zhigang Li, Bowen Fu (2020) proposed a “Feasibility of using deep learning to check coronary artery disease based on facial ”.
In the paper it has conducted a multicentre cross-sectionalstudy of patients undergoing coronary angiography or computed tomography angiography at nine Chinese sites to train and validate a deep convolutional neural network for the detection of CAD (at least one >_50% stenosis) from patient facial photos. Amid July 2017 and March 2019, 5796 patients from eight sites were consecutively registered and randomly separated into training (90%, n= 5216).
C. Gabriel Rojas-Albarracín and others (2019) proposed a “ Heart Attack Detection in Colour Images Using Convolutional Neural Networks”.
This article represents a novel proposal to identify people with an apparent heart attack in colour images by detecting characteristic postures of heart attack. This system of identifying infarcts makes use of convolutional neural networks. The system have been trained with a specially organized images that contain people simulating a heart attack.
D. Maria T. Bekendam and others (2021) proposed a “ Facial Expressions of Emotions During Pharmacologicaland Exercise Stress Testing: The Role of Myocardial Ischemia and Cardiac Symptoms”
Psychological factors such as depression, anxiety, and anger are frequent in patients with ischemic heart disease. These psychological factors are recognized to adversely affect clinical outcomes in cardiac patients. Depression is more common in patients with ischemia. Also, anginal (chest pain) symptoms were associated with more negative emotions digitally assessed emotion expression, and symptoms during cardiac stress testing CST in patients undergoing myocardial perfusion imaging
III. MATERIALS AND METHODS
A. Convolutional Neural Network Models
In machine learning, Convolutional neural network method is one of the well known algorithms. The classification of texts, audios and images is mainly done using this algorithm. Neural networks are "trained" to signify a system by means of existing data that includes specific matchings of the model’s inputs and outputs.
In traditional artificial neural networks, CNNs are a branch that is especially used for applications with repeated patterns in various parts of the modelling space, mainly image recognition. The task of identifying plant illnesses from photographs of their leaves through AlexNet and GoogLeNet were the two basic CNN architectures examined in this study. These algorithms, as well as their training and testing procedures, were employed using the Torch71 machine learning computational framework, which uses the LuaJIT2 programming language.
B. Training and Testing Datasets
The dataset is taken from the kaggle website. The dataset contains 1680 directories. Each directory contains 2-50 images. Each picture is centered on a single face. These images are encoded in RGB. The original size of the image is 250x250. Additionally, the images of the students are going to be taken and uploaded to the dataset.
C. Methods
The work is to develop a system that can detect the heart attack by using face recognition and other parameter like heart rate , oxygen level and temperature. It makes use of Raspberry Pi with a camera, heart rate sensor , and a spo2 sensor. The system is complemented with a screen LCD which presents the detected classes to the user. Immediately if any of the symptoms matches with the image of the face captured , the system would check other parameters. Other parameters includes Heart rate and respiratory rate . When these parameters also matches with Heart attack parameters, then our designed system would give an output saying that the person can meet with Heart attack within some time.
Step for Detecting Heart Attack:
Taking input images of the person sitting infront of the camera.
From the input image, detected facial expression will be recognized.
Next step will be face recognition by using CNNalgorithms.
Then checking for other two parameters(Heartbeat andoxygen) to be sure about the heart attack.
Once all three parameters are matched it displaysheartattack.
This project can be installed in a car where our designed system can say whether driver would meet with Heart attack or not, then we can slow down the speed of car. So this avoids the road accidents and also inform the nearby hospitals about the situation. By this we can save many lives. It can be used to monitor the old people at home who have a greater chances of getting Heart attack. It can also be used in hospitals to monitor patient admitted with heart related issues because Doctors can’t monitor the patients 24*7 ,so this can alert the Doctor if a patient is going to meet with Heart attack.
IV. RESULTS
The current work proposes the development of a system for real-time detection and warning of heart attacks in drivers, which could be enormously helpful in reducing road accidents.
The system consists of a web camera that monitors the driver’s facial expressions. When facial expressions are observed, the data send to sensors which record the other parameters such as heart rate and respiratory conditions.
Based on this the system detects whether the subject has a heart attack or not. If a heart attack is detected an emergency call is sent to a nearby hospital, the speed of the vehicle is reduced and alarm is used to alert the surrounding people.
The designed system can therefore help in saving the lives of the people all over the world.
The efficiency of detection is high because of considering of three parameters that is facial recognition ,heart rate, oxygen rate. datasets. The algorithms utilized were LBP(Local binaryPattern),KNN(KNearestNeighbour),CNN(Convolutio nal Neural Network), Haar Cascade algorithm and RNN(Recurrent Neural Network). So finally after detection we are going to slow down the speed of the car .Also we are informing the nearby hospitals about the situation. Hence by using this system we are reducing loss of human life and we can also control the death rate caused due to heart attack.
V. ACKNOWLEDGMENT
Apart from our efforts in this project, it was in our benefit to have been accompanied by our guide Prof. Abdul Saleem and our Head Of Department Dr. LathaRajagopalan. We are grateful to them for their constant guidance and valuable support to our work and motivating us to complete our project. We would also like to thank our family members, friends and colleagues for their moral support and inspiration which aided us in building the project.
References
[1] World Health Organization. The Top 10 Causes of Death; WHO: Geneva, Switzerland, 2018.S.
[2] The World Bank. Population Ages 65 and above (% of Total); The World Bank: Washington, DC, USA, 2017.
[3] Yahaya, S.W.; Lotfi, A.; Mahmud, M. A Consensus Novelty Detection Ensemble Approach for Anomaly Detection in Activities of Daily Living. Appl. Soft Comput. 2019, 83, 105613.
[4] Dhiman, C.; Vishwakarma, D.K. A review of state-of- the- art techniques for abnormal human activity recognition. Eng. Appl. Artif. Intell. 2019, 77, 21–45.
[5] Patel, A.; Fang, J.; Gillespie, C.; Odom, E.; Luncheon, C.; Ayala, C. Awareness of heart attack signs and symptoms and calling 9-1-1 among U.S. adults. J. Am.Coll. Cardiol. 2018, 71, 808–809.
[6] Mshali, H.; Lemlouma, T.; Moloney, M.; Magoni, D. A survey on health monitoring systems for health smart homes. Int. J. Ind. Ergon. 2018, 66, 26–56.
[7] Fernández-Caballero, A.; Martínez-Rodrigo, A.; Pastor, J.M.; Castillo, J.C.; Lozano-Monasor, E.; López, M.T.; Zangróniz, R.; Latorre, J.M.; Fernández-Sotos, A. Smart environment architecture for emotion detection and regulation. J. Biomed. Inform. 2016, 64, 55–73.
[8] Tang, D.; Yusuf, B.; Botzheim, J.; Kubota, N.; Chan, C.S. A novel multimodal communication framework using robot partner for aging population. Expert Syst.
[9] Goff, D.C.; Sellers, D.E.; McGovern, P.G.; Meischke, H.; Goldberg, R.J.; Bittner, V.; Hedges, J.R.; Allender,P.S.;
[10] Nichaman, M.Z.; for the REACT Study Group. Knowledge of Heart Attack Symptoms in a Population Survey in the United States: The REACT Trial. JAMA Intern. Med. 1998, 158, 2329–2338
[11] Wilson, G.; Pereyda, C.; Raghunath, N.; de la Cruz, G.; Goel, S.; Nesaei, S.; Minor, B.; Schmitter- Edgecombe, M.; Taylor, M.E.; Cook, D.J. Robot- enabled support of daily activities in smart home environments. Cogn. Syst. Res. 2019, 54, 258–272.
[12] Haider, D.; Yang, X.; Abbasi, Q.H. Post-surgical fall detection by exploiting the 5 G C-Band technology for eHealth paradigm. Appl. Soft Comput. 2019, 81, 105537.
[13] Pilco, H.; Sanchez-Gordon, S.; Calle-Jimenez, T.;Pérez- Medina, J.L.; Rybarczyk, Y.; Jadán-Guerrero, J.; Maldonado, C.G.; Nunes, I.L. An Agile Approach to Improve the Usability of a Physical Telerehabilitation Platform. Appl. Sci. 2019, 9, 480.
[14] Sahoo, S.P.; Ari, S. On an algorithm for human action recognition. Expert Syst. Appl. 2019, 115, 524– 534.
[15] Khemchandani, R.; Sharma, S. Robust least squares twin support vector machine for human activity recognition. Appl. Soft Comput. 2016, 47, 33–46.
[16] Alazrai, R.; Momani, M.; Daoud, M.I. Fall Detectionfor Elderly from Partially Observed Depth- Map Video Sequences Based on View-Invariant Human Activity Representation. Appl. Sci. 2017, 7, 316.
[17] Sokolova, M.V.; Serrano-Cuerda, J.; Castillo, J.C.; Fernández-Caballero, A. A fuzzy model for human fall detection in infrared video. J. Intell. Fuzzy Syst. 2013, 24, 215–228.
[18] Cho, C.W.; Chao, W.H.; Lin, S.H.; Chen, Y.Y. A vision-based analysis system for gait recognition in patients with Parkinson’s disease. Expert Syst. Appl. 2009, 36, 7033–7039.