Sound wave and image fused food volume measurement method and system in smartphone

Abstract

The invention discloses a sound wave and image fused food volume measurement method and system in a smartphone. The method comprises the following steps: S100, obtaining a top view image and a side view image of a container which is placed on a desktop and contains food through a camera of the smartphone, and obtaining an audio signal transmitted by a loudspeaker through a receiver in a photographing period of the camera; S200, performing food cutting and container classification on the top view image and the side view image to obtain food images corresponding to the top view image and the side view image respectively, AND calculating the vertical distance from the camera to the desktop according to the audio signal; and S300, based on the food image corresponding to the top view image, calculating the actual size of the food according to the vertical distance from the camera to the desktop and various parameters of the camera, constructing a food model based on the food image corresponding to the side view image and the actual size of the food, and calculating to obtain the volume of the food. A user can conveniently, quickly and accurately measure the volume of the food only by using a mobile phone or other intelligent terminals.

Description

technical field [0001] The invention relates to the technical field of food volume measurement, in particular to a food volume measurement method and system for combining sound waves and images in a smart phone. Background technique [0002] People's health is closely related to their daily dietary intake. According to relevant medical research, many chronic diseases such as diabetes and kidney disease are caused by unhealthy diet. Diet logging can help people maintain healthy eating habits and thus improve their health. With the popularity of smart phones, some diet recording software (such as MyFitnessPal1, LoseIt2, etc.) help users evaluate their daily food intake. Several studies have shown that smartphone-based food recording applications can significantly improve users' awareness of food intake and help them better manage their nutrition, thereby improving their health. [0003] Smartphone-based food recording methods and applications help users complete two tasks: ...

AI Technical Summary

Problems solved by technology

[0011] Aiming at the defects existing in the prior art, the object of the present invention is to provide a method and system for measuring the volume of food in a smart phone in which sound waves and images are fused. Volume measurement, so as to better manage the diet, to solve the problem that the current food volume measurement method has large errors or the need for reference objects is not convenient and quick

Images