Hand-written Character Recognition with Neural Network

Abstract

Various handwriting styles are unique in this manner, making it challenging to identify characters that were written by hand. Handwritten character recognition has become the subject of exploration over the last few decades through an exploration of neural networks. Languages written from left-to-right, such as Hindi, are read from start-to-finish design. To recognize these types of writing, we present a Deep Learning-based handwritten Hindi character recognition system utilizing deep learning techniques such as Convolutional Neural Networks (CNN) with Optimizer Adaptive Moment Estimation (Adam) and Deep Neural Networks (DNN) in this paper. The suggested system was trained on samples from a large number of database images and then evaluated on images from a user-defined data set, yielding extremely high accuracy rates.

Introduction

I. INTRODUCTION

According to various reports, Hindi is widely recognized as a written language. With neural networks working on the most frequently used characters in the language, there is still a prospect for higher accuracy and a lack of auto-coding. As a result, a person-written system for learning and teaching Hindi is urgently needed to ensure that every recognition is true. The capacity of the PC to get, and decipher clear transcribed contributions from sources such as, for example, paper documents, photographs, touch screens, and different devices. This will be done by way of showing a neural network  that ought to be organized over a dataset. Handwriting recognition frameworks use diagram coordination to convert manually produced letters into continuously evaluated PC messages or directives.

The goal of this work is to create software that is capable of understanding and systemizing characters in the Hindi language. Neural networks are particularly useful for solving issues that cannot be expressed as a series of steps, such as sensing designs, organising them into groupings, predicting sequences, and mining statistics.

Artificial Neural Networks additionally discover specific articles faster than people do and appear to recognize them with ease, not with standing the large extent of visible data, which requires little work from them. It is the aim of this paper to recreate the errands carried out with the aid of neural networks to see how close it can get to how a human knows matters with the aid of proscribing its skills with constraints such as constrained reminiscence dimension and processing power.

Deep learning methods have been successfully utilized in various areas like photo classification, speech recognition, medical image detection, face detection, satellite TV for PC images, recognizing visitors' signs and symptoms, pedestrian detection, and so on. The first deep learning technique, which is one of the main computing device learning techniques, was proposed for personality focus in 1998 on the

MNIST database. Deep learning strategies are essentially composed of multiple hidden layers, and every hidden layer consists of multiple neurons, which compute the appropriate weights for the deep network. A lot of computing energy is needed to compute these weights, and an effective device was once needed, which used to be effortlessly accessible at that time. Since then, the researchers have turned their interest to discovering the technique that uses much less electricity by means of changing the images into characteristic vectors.

In the last few decades, a lot of characteristic extraction strategies have been proposed, such as HOG (histogram of oriented gradients), and many different techniques are used as outstanding characteristic extraction methods, which have been experimented with for many purposes, like image recognition, personality recognition, face detection, etc. These aspects are handcrafted and actually designed by the lookup community.

A convolutional neural network has a couple of convolutional layers to extract the facets automatically. The aspects are extracted solely as soon as possible in most of the shallow learning models. However, in the case of deep learning to know models, multiple convolutional layers have been adopted to extract more discriminating elements than one. This is one of the reasons that deep learning techniques are normally successful. And additionally, in deep neural networks, points are computed mechanically via the usage of a distinctive number of hidden layers.

II. RELATED WORK

R. Vijaya Kumar Reddy, U. Ravi Babu [1] proposed   a manual-written Hindi character recognition framework using a variety of deep learning techniques. Manually written personality consciousness is taking up a sizable function and is now being seen by specialists as having achievable purposes in assisting innovation for blind and disabled clients. Here, the Convolutional Neural Network (CNN) and Deep Feed Forward Neural Networks (DFFNN) are trained and tested on a well-known user dataset that is gathered from one-of-a-kind clients. According to the test results, DFFNN, CNN provides the best exactness for handwritten Hindi characters when compared to the other procedures.

Ajay Indian, Karamjit Bhatia [2] proposed a extensive definition of examination work has been finished for perceiving the disconnected manually written characters utilizing specific methodologies such as ANNs, Fuzzy Logic, Genetic Calculations, SVM, KNN Hidden Markov Model (HMM), Bacterial Foraging, Clonal Selection Calculation, and so on, and we discuss their exhibition at some distance from the exactness of perceiving the characters. It has been viewed that the precision of offline handwritten Hindi character recognition depends upon division process, neighborhood, as well as global elements, separated; an assortment of classifier frameworks, and a combining of methods taken on. The precision of offline handwritten Hindi character recognition (OFHCR) has increased by one hundred percent as a result of the use of distinct positive nearby elements and global factors extraction.

Vinod Jha, K. Parvathi,[3] proposed Braille is a language of most severe importance for the uplifting of visually impaired individuals. One of the problems with the education of visually impaired men and women is the inaccessibility of assets like books, and so on, which are, for the most part, in close-by dialects, being utilized by wide individuals. As of late, lots of work has been executed to mechanize the approach concerned with deciphering books in English, Arabic, and so on. The accuracy degree of this is 95.56%, as in contrast to before.

Muna Ahmed Awel, Ali Imam Abidi [4] Their research examines personality features in characters written in English, Arabic, and Devanagari. Through the advancement of optical character recognition, they make explicit the tactics they employ and the obstacles they face. There are prominent steps concerned with personality detection in optical scanning, pre-handling, segmentation, feature extraction, and so on. To achieve exceptional precision, the inspection work discussed in this study employs a variety of approaches.

R. Vijaya Kumar Reddy, Dr. B. Srinivasa Rao [5] proposed a novel technique has been proposed for handwritten Hindi character recognition. The most difficult element of figuring out these characters is that journalists have one-of-a-kind penmanship patterns in each and every dialect. For these sorts of characters, a neural community executed an accuracy charge of 99.85% with the proposed strategy.

Prasanta Pratim Bairagi [7] proposed   Optical Character Recognition (OCR) is the mechanical or digital interpretation of images of transcribed or printed textual content into machine-editable text. Over the last 50 years, this approach has been tested to be an effective way of shooting information. It is quicker, has greater accuracy, and has a higher choice for typing. The accuracy relies upon how many unique photos are scanned.

III. PROPOSED SYSTEM

The proposed approach normally consists of four phases and four steps. In the fundamental phase, they collect the characters from the Kaggle dataset and gather images from specific users. After collecting the dataset of grayscale images, they will be preprocessed by checking for null and lacking values. Using the normalisation methods to convert the grey degree values and then labelling Hindi characters from 0 to 47 with one warm code will generate a vector form of data. In the third phase, we extracted the features atomically from the deep learning knowledge of algorithm-like convolutional neural networks (CNN) for the focus of a handwritten personality system. In the end, we utilised an optimization method like Optimizer Adam Estimation to get very promising results. The proposed method block diagram is below.

A. Convolutional Neural Network

Computer Vision and Pattern Recognition is a fundamentally increasing field in the area of image processing. In that, convolutional neural networks (CNN) perform a major function in PCS vision. CNN is working on many functions in image classification, and it is the core of most computer vision and sample consciousness structures today, from automatic tagging of pictures on Facebook to self-driving cars, apprehending digits, alpha-numerals, visitor signboards, and the different object classes. We used a five-layer Convolutional Neural Network (CNN) model. On the one hand, layers for convolutional, one layer for max-pooling or subsampling, one flattening layer which converts a 2D array into a 1D array, and subsequently two linked layers for classification.

B. Adaptive Moment Estimation

Adaptive Moment Estimation (Adam) is another approach that computes adaptive study quotes for every parameter. Adam additionally continues an exponentially decaying series of previous gradients, comparable to momentum. Adam can be seen as an aggregate of Adagrad and RMSprop, (Adagrad) which works properly on sparse gradients, and (RMSProp), which works nicely in online and nonstationary settings, respectively. Adam implements the exponential shifting common of the gradients to scale the gaining of knowledge of charge as a substitute for an easy common as in Adagrad. It maintains an exponentially decaying common gradient of previous gradients. Adam is computationally environmentally friendly and has very few reminiscence requirements.

C. And Softmax Activation Function

Activation functions assist in deciding the output of a neural network. These sorts of features are connected to every neuron in the network, and they decide whether or not they must be activated or not, based totally on whether or not every neuron's input is applicable for the model's prediction. The activation characteristic additionally helps to normalize the output of every neuron to a variety between 1 and 0 or between -1 and 1. Here we use two types of activation functions. They are Relu and Softmax Activation Functions.

The Relu Function is genuinely a characteristic that has the most value. Note that this is now not totally interval-derivable; however, we can take sub-gradients. Although Relu is simple, it has become an essential fulfillment in recent years.

Additionally, it has many purposes in multiclass classification and neural networks. Softmax differs from the standard max function in that the max function only returns the greatest value, whereas Softmax ensures that smaller values are less likely to be discarded directly.

IV. RESULTS AND DISCUSSION

We evaluated the overall performance of CNN with ADAM Optimization. In that dataset, we chose numerals from 48 classes, resulting in 63852 images for every type of handwritten Hindi character considered. Each character has a decision measurement of 32 × 32 pixels. Some pattern sets of images were checked out in our experiment from the database. Then The data set was split into a training set and a test set, with randomly chosen 80% of the images for the training set, 10% of the images for testing, and 10% for validation.

In this testing segment, we used a 6 layered Convolutional Neural Network (CNN) model with Adam Optimization. On them, one layer for convolutional, one layer for max-pooling or subsampling, one flattening layer which converts a 2D array into a 1D array, and at the end, two wholly related layers for classification. All the parameters are recognised by the corresponding layers. Below, we mention the total parameters.

The code under is for plotting loss and accuracy curves for training and validation. Because no one is bound to epochs of 40, Iterations are used for our experiment. Here we use the early stopping function. The Monitor values a song to the point where it is used to determine whether or not the education must be terminated. In this case, we use validation accuracy. The threshold that triggers termination is the min_delta. In this case, we require that the accuracy be at least enhanced to 0.0001. Persistence is the range of "no enhancement epochs" to wait till education is stopped. With endurance = 1, training terminates right now after the first epoch. It is worth noting that the twenty-fourth epoch resulted in higher education accuracy but decreased validation accuracy. Thus, coaching terminated at the 24 epoch, in spite of the reality that the most common range of epochs is set at 40. I will show you the training and validation curves acquired from the model. The model achieves nearly 87.41% accuracy on the validation dataset after 24 epochs.

Conclusion

In this paper, we proposed a neural network strategy for the recognition of handwritten Hindi characters. We evaluated the performance of the use of convolutional neural networks (CNNs) with the ADAM optimization technique. These approaches are trained and tested on a preferred user. It defines a dataset that is accumulated from unique users. From experimental results, it is found that CCN-Adam yields first-class accuracy for handwritten Hindi characters. We observed promising effects from the proposed technique with an excessive accuracy rate.

References

[1] R. Vijaya Kumar Reddy, U. Ravi Babu (Feb 2019). Handwritten Hindi Character Recognition using Deep Learning Techniques. In 2019 International Journal of Computer Sciences and Engineering (IJCSE). (Vol.-7, Issue-2,). [2] Ajay Indian, Karamjit Bhatia (2017) A Survey of Offline Handwritten Hindi Character Recognition. In 2019 International Conference on Inclusive Technologies and Education (CONTIE). IEEE. [3] Vinod Jha, K. Parvathi,(2019) Braille Transliteration Of Hindi Handwritten Texts Using Machine Learning For Character Recognition. In 2019 INTERNATIONAL JOURNAL OF SCIENTIFIC & TECHNOLOGY RESEARCH (VOLUME 8, ISSUE 10). IJSTR. [4] Muna Ahmed Awel, Ali Imam Abidi (2019) REVIEW ON OPTICAL CHARACTER RECOGNITION. In 2019 International Research Journal of Engineering and Technology (IRJET). (Vol-06, Issue-06). [5] R. Vijaya Kumar Reddy, Dr. B. Srinivasa Rao, K. Prudvi Raju(2018).Handwritten Hindi Digits Recognition Using Convolutional Neural Network with RMSprop Optimization. In 2018 Proceedings of the Second International Conference on Intelligent Computing and Control Systems (ICICCS). IEEE . [6] Nicole Dalia Cilia (2018). A ranking-based feature selection approach for handwritten character recognition. In 2018 Accelerating the world\'s research. (ELSEVIER). (www.elsevier.com/locate/patrec).(Vol-121). [7] Prasanta Pratim Bairagi (2018) Optical Character Recognition for Hindi. In 2018 International Research Journal of Engineering and Technology (IRJET) (Volume: 05 Issue: 05). [8] Abhishek Mehta, Dr. Subhashchdra Desai ,Dr. Ashish Chaturvedi (2021).Hindi Handwritten Character Recognition from Digital Image using Deep Learning Neural Network. In 2021 International Journal of Engineering Research & Technology (IJERT).( Volume 9, Issue 5). [9] Rumman Rashid Chowdhury, Mohammad Shahadat Hossain,(2019).Bangla Handwritten Character Recognition using Convolutional Neural Network with Data Augmentation. In 2019 8th International Conference on Informatics, Electronics & Vision (ICIEV). [10] Vinoj Jayasundara, Sandaru Jayasekara, Hirunima Jayasekara (2019). Handwritten Character Recognition with Very Small Datasets. In 2019 Winter Conference on Applications of Computer Vision (WACV) IEEE.

Copyright

Copyright © 2022 Priti Singh Rathore, Dr. Pawan Kumar. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.