Ijraset Journal For Research in Applied Science and Engineering Technology
Authors: Sneha Kokare, Prof. Prasanna Kandekar
DOI Link: https://doi.org/10.22214/ijraset.2024.64899
Certificate: View Certificate
This assignment pursuits to create an internet utility for food popularity that provides nutritional information to assist customers make better nutritional alternatives. The application will allow customers to browse food items, use picture popularity to identify meals, and access certain nutritional content which includes energy, protein, fat, and other crucial nutrients for every dish. The device will use a superior machine gaining knowledge of models like YOLOv8m to understand numerous meals, that specialize in Indian delicacies, and retrieve nutritional records from databases which include USDA and Edamam. this could offer a continuing experience for fitness-aware individuals and food fanatics targeted on their health and health. The system structure is designed for scalability and actual-time software, with a web-based totally interface allowing customers to add meal snap shots and obtain on-the-spot dietary analysis.
I. INTRODUCTION
Increasingly in today’s society individuals have dietary awareness yet manually logging food consumption or rather caloric intake is comparative. The primary objective of the project is to generate an error-free food intelligence that not only recognizes many foods, especially Indian foods but also includes information about the food. While the overall tools aimed at food analysis is enormous, however, some of the major categories of Indian food and the corresponding means of determining their nutritional value remain scanty. Indian food includes many varieties of food 00, most of which are quite similar; therefore, it becomes hard for the previous strategies to differentiate between meals. Authentic food identification: Employing the most superior model of YOLO at its median form (YOLOv8m) for detecting food items, particularly Indian foods. Nutritional analysis: Pair certified foods with USDA and Edamam to quickly get nutritional values such as calories, macronutrients, and micronutrients.
A. Need
Unfortunately in today’s world, because of the factors associated with lifestyle like obesity and diabetes, it is essential to monitor the food intake daily and make good choices. The project revolves around developing an e-device that can recognize food from images and produce correct food info. That is why there is a need for the creation of this system: overall health awareness has risen significantly, and people can easily monitor their feeding correctly and improve health management as a result. Focus on Indian cuisine: Most of the current standards are not descriptive enough to capture the real Indian foods. That is why this project is designed to fill this gap by accurately identifying specific food sources in regions of interest. Making food more accessible: It searches foods and their nutrient content and reduces food processing allowing the users. Unbalanced category check: The system is also able to use AI, to identify the dish in question as incorrect, balance the meal, and then check its accuracy. Instant feedback: People can take photos of their meals and receive information about the nutrition of such meals immediately which may be rather helpful for weight-conscious customers or people with certain food restrictions.
B. Motivation
The exponential growth in AI and machine learning, especially in computer vision, holds the technical feasibility for this work. The process of deploying these technologies to train a food recognition system represents a good chance to try to apply and work on such tools as YOLOv8 and transfer learning together with data augmentation. In addition, empirical issues that come with the project include the increasing demand for diet-related information for instance concerning the Indian food industry. As it will be obvious, there are many existing systems for food recognition, and many of them are not meant for Indian food and that certainly makes the project more challenging and unique. It is almost angelical in a way because it gives the opportunity to be resourceful, to design a system for a set of people, and to do it in a meaningful way. Furthermore, this project also provides practical exposure at-, AI, data processing as well as mobile & web application development that are vital in the engineering and technology profession in the future.
C. Background
Advanced AI in health technology has resulted in the development of improvements in dieting technologies. Nevertheless, the current food recognition systems primarily showcase Western food, and hence users from different regions like India would lack in such facilities. This project deals with that problem by designing a food recognition and nutritional facts application exclusively for Indian dishes. Despite leveraging intelligent techniques such as the YOLO object detection model, the system recognizes food items and accesses their information from the linked databases. Such a problem as visually similar dishes or class imbalance is solved using data augmentation and optimization. It is to improve the effectiveness and usability of the food recognition technology, making users receive and analyze nutritional information in real-time, and help them monitor their consumption. This system meets an important purpose in dietary profiling, especially for people who want to improve nutritional supervision in various preparations.
II. LITERATURE REVIEW
NUTRIFYAI by Michelle (2024), developed in New York, introduces an innovative approach utilizing the YOLOv8 model for real-time food detection and personalized nutritional analysis. This system integrates AI technology to recommend meal plans based on the detected food items, offering a unique combination of object detection and dietary personalization.
Similarly, Fitroh Romadhon, Faisal Rahutomo, and colleagues (2023) from Indonesia propose a food image detection system using the YOLOv8 model to estimate calorie content. Their system, designed for web applications, integrates image annotation and data augmentation techniques to enhance the accuracy of food detection and nutritional estimation. The methodology highlights the importance of object detection in controlling calorie intake and providing comprehensive nutritional information.
Another notable work is DEEPNOVA, developed by Hala Ghattas and collaborators (2022) from Colombia, which presents a deep learning-based food classifier using the MobileNet V2 architecture. The NOVA model is employed to classify food items based on images, focusing on data analysis, processing, and augmentation techniques. The use of deep learning tools and mobile-friendly architectures highlights the increasing demand for real-time food classification solutions on mobile platforms.
In China, the DeepFood system by Landu Jiang and colleagues (2020) utilizes a Convolutional Neural Network (CNN) to perform food image analysis and dietary assessment. The model focuses on enhancing the accuracy of food detection through extensive datasets and augmentation techniques. Their work emphasizes the use of deep learning for both food image recognition and the assessment of nutritional content, providing an effective solution for diet tracking.
Finally, the detection of oil-containing dressing on salad leaves using multispectral imaging is explored by Viprav B. Raju and Edward Sazonov (2020) in Tuscaloosa. This research leverages ANOVA and spectroscopy techniques for analyzing food compositions, with a focus on oil detection. The application of multispectral imaging in food analysis represents an interesting alternative to traditional food detection methods, offering the potential for further development in detecting specific food components. Food Image Detection System And Calorie Content Estimation Using Yolo To Control Calorie Intake In The Body by Fitroh Romadhan, Faisal Rahutomo, Joko Hariyono, Sustrisno, Meiyanto Eko Sulistyo, Mahummad Hamka Ibrahim, Subuh Pramono (2023) done in Indonesia which introduces an innovative approach to excess calories in the body can cause obesity and several degenerative diseases, such as diabetes mellitus, heart disease, stroke, hypertension and other. this helps to maintain the calorie count that enters the body. They have used the Yolo model.
III. METHODOLOGY
Fig .1. System Architecture
A. Data Collection and Preprocessing
B. Model Selection and Training
C. Nutritional Database Integration
D. Model Evaluation
E. Deployment in Web Application
F. User Experience and Feedback Mechanism
IV. RELATED STUDY
A. Overview of YOLOv8m
B. Architecture and Key Features
C. Relevance to Food Detection and Nutritional Analysis
D. Comparison with Other Models in Food Detection
E. Summary of YOLOv8m’s Benefits for Food Detection
V. RESULT ANALYSIS
Fig .2. (a) New vs Fig .2. (b) Previous
Figure 2(a): Performance of YOLOv8m Model
In Figure 2(a), the graph represents the performance metrics of the food recognition model after implementing the YOLOv8m architecture. For each food item category (Dal, Chawal, Paneer Tikka, Palak Paneer, Idli, and Sambar), the metrics—Accuracy, Precision, Recall, and F1 Score—are displayed as percentages. The results show consistently high performance across all metrics, with most food items achieving scores near or above 90%. This suggests that the YOLOv8m model performs effectively, especially in terms of identifying different types of Indian food accurately. The balanced distribution of precision, recall, and F1 score also indicates that YOLOv8m can handle the nuances in these food categories effectively.[1]
Figure 2(b): Performance of YOLOv8 Model
In Figure 2(b), the graph illustrates the performance metrics when using only the YOLOv8 model, without the enhancements of YOLOv8m which is designed according to the literature survey. There is a noticeable drop in accuracy, precision, recall, and F1 score across most food items compared to Figure 2(a). While some food items like "Chawal" and "Idli" still perform reasonably well, others, such as "Paneer Tikka" and "Sambar," show a more significant decline. This indicates that the standard YOLOv8 model may struggle with specific foods, likely due to challenges in distinguishing visually similar items or handling the diverse textures and shapes present in Indian cuisine.
Fig .2. (c) Comparative graph of (a) and (b)
This graph provides a comparative analysis of the model's performance on general food items versus Indian cuisine, specifically comparing the previous model (YOLOv8) and the improved model (YOLOv8m) across key performance metrics: Accuracy,
A. Precision, Recall, and F1 Score
1) Explanation of Comparative Graph
2) Observations and Analysis
The comparative analysis shows that the YOLOv8m model outperforms the YOLOv8 model across all tested metrics, especially in terms of recognizing Indian food items accurately. The enhancements introduced in YOLOv8m make it more robust for food recognition applications, especially when dealing with culturally diverse and visually similar cuisines like Indian food. This validates the effectiveness of YOLOv8m for applications focused on dietary tracking and nutritional analysis for Indian cuisine.
VI. FINDING AND TRENDS
These techniques help balance datasets by creating more examples of underrepresented classes, thereby improving model performance on rare or unique dishes. This approach is relevant to our project, which employs synthetic data augmentation to handle the imbalance in recognizing Indian foods that are less common in standard datasets.
This is an innovative approach to food recognition and nutritional analysis, specifically tailored for Indian cuisine, which poses unique challenges due to its diversity and variety. By utilizing the YOLOv8m model along with data preprocessing, transfer learning, and synthetic data augmentation, this system achieves improved performance in accurately identifying diverse Indian dishes and provides detailed nutritional information to aid users in making informed dietary choices. Through model evaluation and user feedback, the system has demonstrated promising accuracy, precision, recall, and F1 scores across a variety of Indian food items. This project addresses the critical need for accessible dietary tracking and is designed to integrate seamlessly into mobile applications, making it a valuable tool for health-conscious users, fitness enthusiasts, and individuals with dietary restrictions.
[1] Michelle Han New York University Department of Technology, Junyao Chen New York University Department of Technology, “NutrifyAI: An AI-Powered System for Real-Time Food Detection, Nutritional Analysis, and Personalized Meal Recommendations”, New York , arXiv:2408.10532v1 [cs.CV],2024[Online] available on https://www.researchgate.net/figure/Nutrient-analysis-chart-on-web-app-interface-b-Edamam-Recipe-and-Meal-Planning-API . [2] Fitroh Romadhon1, Faisal Rahutomo1*, Joko Hariyono1, Sutrisno1, Meiyanto Eko Sulistyo1, Muhammad Hamka Ibrahim1, Subuh Pramono,“Food Image Detection System And Calorie Content Estimation Using Yolo To Control Calorie Intake In The Body”, Indonesia, E3S Web of Conferences 465,2023[Online] available on https://ui.adsabs.harvard.edu/abs/2023E3SWC.. [3] Hala ghattas2,3, jalila el ati4 , zoulfikar shmayssani 1 , sarah katerji1 , yorgo zoughbi1, aline semaan5, christelle akl2, houda ben gharbia 4 , and Sonia sassi4, ‘‘Deepnova: A Deep Learning Nova Classifier For Food Images Shady Elbassuoni’’, Colombia,2022[Online] available on https://ieeexplore.ieee.org/document/9975313. [4] Viprav b. Raju, (student member, ie), and Edward Sazonov, (senior member, ieee), ‘‘Detection Of Oil-Containing Dressing On Salad Leaves Using Multispectral Imaging’’, Tuscaloosa, 2020 [Online] available on https://www.researchgate.net/publication/341141009_Detection_of_OilContaining_Dressing_on_Salad_Leaves_Using_Multispectral_Imaging. [5] Shizhong Yang ,Wei Wang ,Sheng Gao ,Zhaopeng Deng,Qingdao University of Technolgy “ Strawberry Ripeness Detection Bassed On Yolov8 Algorithm Fused With Lw-Swim Transformer”,China,2023 [Online] available on https://www.sciencedirect.com/science/article/abs/pii/S0168169923007482. [6] Yinzeng Liu ,Fandi Zeng ,Hongwei Diao, Junke Zhu , Dong Ji ,Xijie Liao and Zhihuan Zhao Shandong University of Technology China ,”Yolov8 Model For Weed Detection In Wheat Fields Based On A Visual Converter And Multi-Scale Feature Fusion”,China ,2024,[Online] avaialable on https://doi.org/10.3390/s24134379 .
Copyright © 2024 Sneha Kokare, Prof. Prasanna Kandekar. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Paper Id : IJRASET64899
Publish Date : 2024-10-29
ISSN : 2321-9653
Publisher Name : IJRASET
DOI Link : Click Here