Augmented reality image data processing method and device, equipment and storage medium

Abstract

The invention relates to an augmented reality image data processing method and device, computer equipment and a storage medium. The method comprises the steps of obtaining a reality scene image collected by a camera carried on a refrigerator; identifying food materials in the real scene image through a food material identification model, wherein the food material identification model is a cascadenetwork of a feature pyramid network and a YOLOV3 network; obtaining virtual resources corresponding to the food materials in the real scene image, wherein the virtual resources are virtual animationresources designed according to nutritional ingredients of the food materials; and displaying the virtual animation resources and the real scene images in a combined manner, wherein the feature pyramid network and the YOLOV3 network can extract food materials of different scales; according to the invention, the requirements of various food materials are met, the detection speed is high, the food materials can be quickly and accurately recognized, the virtual animation image is displayed in an AR (augmented reality) mode to display the nutritional ingredients of the food materials, a user selects the food materials according to the nutritional ingredients, and the diet quality is guaranteed.

Description

technical field [0001] The present application relates to the field of computer technology, and in particular to an augmented reality image data processing method, device, device and storage medium. Background technique [0002] With the improvement of living standards, people's requirements for diet quality are also increasing day by day, not only requiring food to meet their own taste preferences, but also to meet the needs of nutrition and health. However, each user has different nutritional knowledge, and it is difficult to determine the corresponding nutritional content according to the purchased ingredients, which makes it difficult to choose ingredients with appropriate nutritional components before cooking, thereby affecting the quality of the diet. Contents of the invention [0003] In order to solve the above technical problems or at least partly solve the above technical problems, the present application provides a method. [0004] The application provides a me...

AI Technical Summary

Problems solved by technology

However, each user has different nutritional knowledge, and it is difficult to determine the corresponding nutritional content according to the purchased ingredients, making it difficult to choose ingredients with appropriate nutritional components before cooking, thus affecting the quality of the diet

Images