Method for determining shape information and related device, equipment and storage medium

Abstract

The application discloses a body information determination method and related device, equipment and storage medium, and the method comprises the steps that body type related data of a target object is acquired; the reference object matched with the target object is determined by using the body type related data; and the target body information of the target object is determined based on the reference body information corresponding to the reference object. Through the method, the target body information of the target object can be acquired.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of health management, in particular to a body information determination method and related device, equipment and storage medium. BACKGROUND

[0002] At present, people pay more and more attention to their health management. People's body information is often a manifestation of personal health, so people are also very concerned about their body information.

[0003] However, the body information of the human body often needs to be measured by professional measuring tools. For ordinary people, professional measuring tools are often very scarce, which leads to the fact that part of the population cannot conveniently obtain their own body information.

[0004] Therefore, how to enable users to conveniently obtain their own body information is of great significance. SUMMARY

[0005] The present application provides a body information determination method and related device, equipment and storage medium.

[0006] The first aspect of the present application provides a body information determination method, which comprises: obtaining body type related data of a target object; determining a reference object matched with the target object by using the body type related data; and determining target body information of the target object based on reference body information corresponding to the reference object.

[0007] Therefore, by using the body type related data of the target object, the reference object matched with the target object can be determined by using the body type related data of the target object, and then the target body information of the target object can be determined according to the reference body information corresponding to the reference object, thereby realizing the acquisition of the target body information of the target object.

[0008] The reference body information and the target body information both include at least one of body fat information and muscle tissue distribution information; and / or, the determination of the target body information of the target object based on the reference body information corresponding to the reference object comprises: taking the reference body information of the reference object as the reference body information of the target object.

[0009] Therefore, the acquisition of at least one of the body fat information and the muscle tissue distribution information of the target object by the body information can be realized. The determination of the reference object matched with the target object by using the body type related data comprises: selecting a reference object matched with the target object from a first candidate object set based on the body type related data; wherein the first candidate object set comprises a plurality of candidate objects, and the candidate objects are pre-provided with reference body information.

[0010] Therefore, by pre-storing the candidate object set and pre-providing each object in the candidate object set with reference shape information, a reference object matching the target object is selected from the candidate object set, and the target shape information of the target object can be determined based on the reference shape information of the reference object.

[0011] Before determining the reference object matching the target object based on the body shape related data, the method further comprises: obtaining object information of the target object, wherein the object information comprises one or more of gender and height; and searching at least one candidate object matching the object information from the second candidate object set to form the first candidate object set.

[0012] Therefore, by searching at least one candidate object matching the object information from the second candidate object set, a candidate object matching the body shape related data of the target object more closely can be selected from the second candidate object set to form the first candidate object set, and the number of candidate objects that need to be matched with the body shape related data of the target object can be reduced, thereby improving the efficiency of searching for the reference object.

[0013] The body shape related data of the target object is obtained by detecting a target image containing the target object to obtain a plurality of human body key points of the target object, and the body shape related data of the target object is obtained based on the plurality of human body key points.

[0014] Therefore, by detecting a target image containing the target object to obtain a plurality of human body key points of the target object, the body shape related data of the target object can be determined based on the obtained human body key points.

[0015] The body shape related data of the target object is a target image containing the target object. The reference object matching the target object is determined based on the body shape related data, comprising: comparing the target image with candidate images containing each candidate object to obtain a body shape matching degree of the target object with each candidate object; and selecting a candidate object with a corresponding body shape matching degree satisfying a preset requirement as the reference object.

[0016] Therefore, by comparing the target image with candidate images containing each candidate object, a body shape matching degree of the target object with each candidate object can be obtained, and then a candidate object with a body shape matching degree satisfying a preset requirement can be selected as the reference object, thereby realizing the matching of the candidate object with the target object.

[0017] The target image includes: a plurality of target sub-images obtained by respectively photographing the target object from a plurality of angles; the comparing the target image with the candidate image containing each candidate object to obtain the body shape matching degree of the target object and each candidate object includes: comparing the plurality of target sub-images with the candidate image to obtain the body shape matching degree of the target object and each candidate object in each target sub-image; and the selecting the candidate object corresponding to the body shape matching degree satisfying the preset requirement as the reference object includes: selecting the candidate object corresponding to the body shape matching degree satisfying the preset requirement based on the body shape matching degree of the target object and each candidate object in each target sub-image.

[0018] Therefore, the target object can be better matched with the candidate object by obtaining more comprehensive body shape related data of the target object from the plurality of target sub-images obtained by respectively photographing the target object from a plurality of angles, which helps to improve the matching accuracy.

[0019] The method for determining the body shape information further includes: displaying the target body shape information on the target image after determining the target body shape information of the target object.

[0020] Therefore, the target body shape information of the user can be conveniently understood by displaying the target body shape information on the target image. The display method of the target body shape information is, for example, a display method realized by using an augmented reality technology.

[0021] The target body shape information includes body fat information. The displaying the target body shape information on the target image includes: determining the heat corresponding to the fat weight of the target object based on the body fat information; determining the heat material matched with the heat; and displaying the heat material on the target image by using an augmented display technology.

[0022] Therefore, the body fat information of the target object can be more intuitively displayed by determining the heat material matched with the heat corresponding to the fat weight of the target object and displaying the heat material on the target image by using the augmented display technology, so that the user can conveniently understand the body fat information.

[0023] The second aspect of the present application provides a body shape information determination device, which includes: an acquisition module, an object determination module and an information determination module. The acquisition module is used to acquire the body shape related information of a target object. The object determination module is used to determine the reference object matched with the target object by using the body shape related data. The information determination module is used to determine the target body shape information of the target object based on the reference body shape information corresponding to the reference object.

[0024] The third aspect of the present application provides an electronic device, comprising a processor and a memory coupled with each other, wherein the processor is configured to execute a computer program stored in the memory to perform the method described in the first aspect.

[0025] The fourth aspect of the present application provides a computer readable storage medium, having program instructions stored thereon, the program instructions being executed by a processor to implement the method described in the first aspect.

[0026] The above scheme can determine the reference object matched with the target object by using the body shape related data of the target object, and then determine the target body shape information of the target object according to the reference body shape information corresponding to the reference object, thereby realizing the acquisition of the target body shape information of the target object. BRIEF DESCRIPTION OF DRAWINGS

[0027] Figure 1 is a flowchart of an embodiment of the method for determining body shape information of the present application;

[0028] Figure 2 is a flowchart of another embodiment of the method for determining body shape information of the present application;

[0029] Figure 3 is a flowchart of still another embodiment of the method for determining body shape information of the present application;

[0030] Figure 4 is a flowchart of yet another embodiment of the method for determining body shape information of the present application;

[0031] Figure 5 is a framework diagram of an embodiment of the device for determining body shape information of the present application;

[0032] Figure 6 is a framework diagram of an embodiment of the electronic device of the present application;

[0033] Figure 7 is a framework diagram of an embodiment of the computer readable storage medium of the present application. DETAILED DESCRIPTION

[0034] The schemes of the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0035] In the following description, specific details are set forth in order to provide a thorough understanding of the present application, but the present application can be practiced without these details. In other instances, well-known methods, structures and techniques have not been described in detail in order to avoid obscuring the present application.

[0036] The terms "system" and "network" are often used interchangeably herein. The term "and / or", merely describes an associated relationship, which means that there can be three relationships, for example, A and / or B, which means that A exists alone, A and B exist together, and B exists alone. In addition, the character " / " generally represents an "or" relationship between the associated objects. In addition, "multiple" herein means two or more.

[0037] The device for performing the method of determining shape information in the present application can be a computer, a mobile phone, a tablet computer, smart glasses, and the like electronic device.

[0038] Please refer to Figure 1 , Figure 1 is a flowchart of an embodiment of the method of determining shape information. Specifically, it can include the following steps:

[0039] Step S11: Obtain the body shape related data of the target object.

[0040] The body shape related data of the target object, for example, includes the size data of the human body, such as height, upper arm length, forearm length, thigh length, calf length, chest thickness, shoulder height and the like size data, and can also include the contour information of the body shape of the target object and other data related to the body shape. The method of obtaining the body shape related data of the target object can be through instrument measurement, user input and the like, and the present application does not make specific limitation on the method of obtaining the body shape related data of the target object. In one specific embodiment, the height, upper arm length, forearm length, thigh length, calf length and the like data of the target object can be determined by analyzing the target image containing the target object, for example, by measuring the target image. In another specific embodiment, the body shape feature information of the target object can also be extracted by feature extraction on the target image containing the target object, and the body shape feature information is taken as the body shape related data of the target object.

[0041] In one embodiment, obtaining the body shape related data of the target object can specifically include step S111 and step S112.

[0042] Step S111: Detect the target image containing the target object to obtain a plurality of human key points of the target object.

[0043] The method for detecting the target image containing the target object can be a general human key point detection algorithm in the field of computer vision. For example, a 2D key point detection algorithm or a 3D key point detection algorithm can be used for detection. The 2D key point detection algorithm can be a Convolutional Pose Machines (CPM) algorithm or an Hourglass algorithm. The present application does not limit the human key point detection algorithm. The human key points can be left and right shoulders, left and right elbows, left and right wrists, left and right hips, left and right knees, and left and right ankles.

[0044] Step S112: obtaining body shape related data of the target object based on the human key points.

[0045] Because the human key points can reflect the body shape of the human body, the body shape related data of the target object can be obtained by using the human key points. For example, the shoulder width of the target object can be obtained by the distance between the left and right shoulder key points. The left leg length of the target object can be determined by determining the distance between the left hip key point and the left ankle key point. The left thigh length can be determined by determining the distance between the left hip key point and the left knee key point.

[0046] Therefore, by detecting the target image containing the target object to obtain the human key points of the target object, the body shape related data of the target object can be determined based on the obtained human key points.

[0047] Step S12: determining the reference object matched with the target object by using the body shape related data.

[0048] The reference object matched with the target object can be determined by determining the reference object matched with the body shape related data of the target object. In one specific embodiment, the body shape related data of a plurality of candidate objects can be obtained, and then the body shape related data of the candidate objects and the body shape related data of the target object are matched to determine the reference object matched with the target object. For example, the body shape related data of the target object is 175 cm in height, 110 cm in thigh length, and 45 cm in upper arm length. The reference object matched with the target object can be determined by using the three body shape related data. In another specific embodiment, the reference object matched with the target object can also be determined by using the body shape feature information of the target object for feature matching.

[0049] In one embodiment, the reference object matching the target object is determined by using the body shape related data, specifically including: selecting the reference object matching the target object from the first candidate object set based on the body shape related data. In this embodiment, the first candidate object set includes a plurality of candidate objects, each of which has predetermined reference body shape related data. The candidate objects in the candidate object set can be objects of different ages, different genders, different regions, etc. In this way, the reference object can be determined by matching the body shape related data of the target object with the reference body shape related data of each candidate object. In addition, each candidate object is pre-provided with reference body shape information, so that the target body shape information of the target object can be obtained by using the reference body shape information of the reference object selected from the first candidate object.

[0050] For example, the body shape related data of the target object is 175 cm in height, 110 cm in thigh length, and 45 cm in upper arm length. The first candidate object set includes three candidate objects, the first candidate object has body shape related data of 173 cm in height, 105 cm in thigh length, and 40 cm in upper arm length, the second candidate object has body shape related data of 177 cm in height, 111 cm in thigh length, and 47 cm in upper arm length, and the third candidate object has body shape related data of 175 cm in height, 110 cm in thigh length, and 44 cm in upper arm length. In this way, the matching degree of the height of each candidate object with the height of the target object can be calculated, the matching degree of the thigh length of each candidate object with the thigh length of the target object can be calculated, and the matching degree of the upper arm length of each candidate object with the upper arm length of the target object can be calculated. Then, the reference object matching the target object is determined by combining the three data matching degrees.

[0051] In one specific embodiment, the formula (1) of the matching degree calculation method is as follows:

[0052]

[0053] Wherein, A is the body shape related data of the target object, B is the body shape related data of the candidate object, and θ is the calculated matching degree.

[0054] For example, the height of the target object is 175 cm, and the height of the candidate object is 173 cm. After calculation, the matching degree is about 98.86%.

[0055] After obtaining the matching degree of each data, the matching degree of each data can be weighted to obtain the final matching degree. It can be understood that the method of calculating the matching degree of each data and the final matching degree is not limited to the above examples, and the present application does not make any limitation.

[0056] The reference object matched with the target object can be selected from the first candidate object set. The candidate object matched with all the body type related data of the target object can be selected as the reference object. The candidate object matched with a certain body type related data can be selected as the reference object. The candidate object matched with part of the body type related data can be selected as the reference object.

[0057] Therefore, by pre-storing the candidate object set and pre-setting the reference body information of the objects in the candidate object set, the reference object matched with the target object can be selected from the candidate object set. The target body information of the target object can be determined based on the reference body information of the reference object.

[0058] Step S13: determining the target body information of the target object based on the reference body information corresponding to the reference object.

[0059] The reference body information corresponding to the reference object can be directly used as the target body information of the target object. The reference body information can be processed based on the matching degree between the body type related data of the reference object and the body type related data of the target object, and then the target body information of the target object can be determined. The reference body information corresponding to the reference object can be converted to determine the target body information of the target object.

[0060] In an embodiment, the reference body information and the target body information each include at least one of body fat information and muscle tissue distribution information. The body fat information is, for example, body fat rate and / or fat distribution information. In this way, at least one of the body fat information and the muscle tissue distribution information of the target object can be obtained.

[0061] Therefore, by using the body type related data of the target object, the reference object matched with the target object can be determined based on the body type related data of the target object. The target body information of the target object can be determined based on the reference body information corresponding to the reference object. The target body information of the target object can be obtained.

[0062] Please refer to Figure 2 , Figure 2 is a flowchart of another embodiment of the method for determining body information. In this embodiment, before the step of "determining the reference object matched with the target object based on the body type related data", the method for determining body information further includes steps S21 and S22.

[0063] Step S21: obtaining at least the object information of the target object.

[0064] In the embodiment, the object information includes one or more of gender and height. In other embodiments, the object information can also include age, residence, birthplace, weight, and the like.

[0065] Step S22: finding at least one candidate object matching the object information from the second candidate object set to form the first candidate object set.

[0066] Generally, the candidate object and the target object whose body size related data match the object information have a higher matching degree. Therefore, in the embodiment, at least one candidate object matching the object information can be found from the second candidate object set to form the first candidate object set. For example, the object information of the target object is gender and height, the gender is male, and the height is 180 cm. At least one candidate object with the gender of male and the height of 180 cm can be found from the second candidate object set to form the first candidate object set. In a specific implementation, when the object information of the target object includes the height, candidate objects with the height difference from the height of the target object within a certain range can also be selected to form the first candidate object set.

[0067] Therefore, by finding at least one candidate object matching the object information from the second candidate object set, candidate objects with body size related data more matching the target object can be selected from the second candidate object set to form the first candidate object set, and the candidate objects needing to match the body size related data of the target object can be reduced, and the search efficiency of the reference object for improving the body information can be improved.

[0068] Please refer to Figure 3 , Figure 3 is a flowchart of another embodiment of the method for determining body information. In the embodiment, the body size related data of the target object is a target image containing the target object. The target object in the target image can reflect the body size related data of the target object, for example, the size data such as the thigh length and the upper arm length of the target object can be determined through the target image. In addition, the image information on the target image can also reflect the body size related information of the target object as a whole. Therefore, in the embodiment, the body size related data of the target object is determined as the target image containing the target object. In the embodiment, the "determining the reference object matching the target object by using the body size related data" mentioned in the above embodiments includes steps S31 and S32.

[0069] Step S31: comparing the target image with candidate images containing respective candidate objects to obtain the body size matching degrees of the target object and the respective candidate objects.

[0070] The target image is compared with the candidate images containing the candidate objects, in one embodiment, the comparison can be based on image matching, specifically, the target object in the target image is compared with the candidate objects in the candidate images. The image matching method can be a general matching method, which is not described here. In another embodiment, the specific body shape related data of the target object in the target image can be obtained, for example, by using an augmented reality based measurement method, or by detecting the human key points of the target object as mentioned in the above embodiment. In addition, the specific body shape related data of the candidate objects in the candidate images can also be obtained, which can be pre-set data. Then, the matching degree of the two body shape related data is calculated. In this way, the body shape matching degree of the target object with each candidate object can be obtained.

[0071] In one embodiment, the target image includes a plurality of target sub-images obtained by photographing the target object from a plurality of angles. Based on the plurality of target sub-images, the target object from a plurality of angles can be obtained, and the plurality of target sub-images can be compared with a plurality of candidate sub-images of a candidate object from a plurality of angles. In one embodiment, the target image can be displayed with relevant prompt information, so that the target object can be photographed while wearing tight clothes, so as to obtain more body shape related data conforming to the body shape of the target object.

[0072] Specifically, the step "comparing the target image with the candidate images containing the candidate objects to obtain the body shape matching degree of the target object with each candidate object" mentioned in the above embodiment can include: comparing the plurality of target sub-images with the candidate images respectively corresponding to each candidate image to obtain the body shape matching degree of the target object in each target sub-image with each candidate object.

[0073] In one embodiment, the target sub-images are compared with the candidate sub-images respectively to obtain the body shape matching degree of the target object in each target sub-image and the candidate object. For example, the target sub-images include the front, back and two side images of the target object, and the candidate sub-images also include the front, back and two side images of the candidate object. The front image of the target sub-image is compared with the front image of the candidate object, the back image of the target sub-image is compared with the back image of the candidate object, and so on, to finally obtain the body shape matching degree of the target object in each target sub-image and the candidate object.

[0074] In one embodiment, the body shape related data of the target object corresponding to each target sub-image can be obtained based on the target sub-image, and then the body shape related data of the target object corresponding to each target sub-image is matched with the body shape related data of the candidate object to obtain the body shape matching degree of the target object in each target sub-image and the candidate object. For example, the chest thickness data obtained from a target sub-image is matched with the chest thickness data of the candidate object to obtain the body shape matching degree of the target object in the target sub-image and the candidate object. The method for calculating the body shape matching degree can be, for example, the method for calculating the matching degree and the final matching degree described above, to obtain the body shape matching degree of the target object in each target sub-image and the candidate object.

[0075] Step S32: selecting the candidate object corresponding to the body shape matching degree meeting the preset requirement as the reference object.

[0076] In one embodiment, the body shape matching degree meeting the preset requirement can be the highest body shape matching degree. For example, after the body shape matching degree of each candidate object and the target object is calculated, the candidate object with the highest body shape matching degree with the target object is selected as the reference object. In one embodiment, the body shape matching degree meeting the preset requirement can also be the highest body shape matching degree of the body shape related data. For example, the matching degree corresponding to the chest circumference, waist circumference, hip circumference, upper arm length, thigh length and calf length of the target object and the candidate object is calculated respectively, and the candidate object with the highest body shape matching degree based on the chest circumference, waist circumference and hip circumference with the target object is selected as the reference object.

[0077] In one embodiment, when the target image corresponds to a plurality of target sub-images respectively taken from a plurality of angles, the candidate object corresponding to the body shape matching degree satisfying the preset requirement can be selected based on the body shape matching degree between the target object in each target sub-image and each candidate object. In one specific embodiment, the final body shape matching degree can be obtained based on the body shape matching degree between the target object in each target sub-image and each candidate object, and then the candidate object corresponding to the highest final body shape matching degree can be selected as the reference object. In another specific embodiment, the final body shape matching degree can be obtained based on the body shape matching degree between the target object in part of the target sub-images and each candidate object, and then the candidate object corresponding to the highest final body shape matching degree can be selected as the reference object. Therefore, the target object can be taken from a plurality of angles to obtain a plurality of target sub-images, and more comprehensive body shape related data of the target object can be obtained, so that the target object can be better matched with the candidate object, and the matching accuracy can be improved.

[0078] Therefore, by comparing the target image with the candidate image containing each candidate object, the body shape matching degree between the target object and each candidate object can be obtained, and then the candidate object with the body shape matching degree satisfying the preset requirement can be selected as the reference object, so that the matching between the candidate object and the target object is realized.

[0079] In one embodiment, the body shape related data of the target object is a target image containing the target object, and after the target body information of the target object is determined, the method for determining the body shape information further includes: displaying the target body information on the target image. For example, the target body information is the body fat rate and the muscle tissue distribution information, and the body fat rate and the muscle tissue distribution information can be displayed on the target image. In addition, the muscle tissue can be superimposed and displayed on the target object in the target image, so that the user can more intuitively understand the muscle tissue distribution information of the user. Therefore, by displaying the target body information on the target image, the user can conveniently understand the target body information of the user. The specific method for displaying the target body information is, for example, a display method realized by using augmented reality technology.

[0080] Please refer to Figure 4 , Figure 4 is a flowchart of another embodiment of the method for determining the body shape information. In this embodiment, the target body information includes body fat information. The above-mentioned "displaying the target body information on the target image" includes steps S41 to S43.

[0081] Step S41: determining the heat corresponding to the fat weight of the target object based on the body fat information.

[0082] In the embodiment, if the weight of the target object has been determined, the fat weight of the target object can be determined based on the weight and the body fat rate of the target object, and the heat corresponding to the fat weight of the target object can be determined according to the conversion relationship between fat and heat. If the weight of the target object has not been determined, the heat corresponding to the fat weight of the target object can be determined by using the weight information of the reference object.

[0083] Step S42: determining heat materials matching the heat.

[0084] The heat materials can be materials whose heat has been determined. The heat materials matching the heat are materials whose heat is the same as the heat corresponding to the fat weight of the target object. For example, if the heat corresponding to the fat weight of the target object is determined to be 10000 calories, and each hamburger contains 250 calories, then the heat materials matching 10000 calories are 40 hamburgers.

[0085] Step S43: displaying the heat materials on the target image by using the augmented display technology.

[0086] The heat materials can be displayed on the target object of the target image, or can be displayed on other places of the target object. The specific method of display can be to display the heat materials on the target image by using the augmented display technology. In other embodiments, the heat materials can be directly displayed on the target image.

[0087] In one embodiment, the target image can be continuously acquired, and then the heat corresponding to the fat weight of the target object on the target image is determined based on the acquired target object, and then the heat materials are displayed on the target image on the acquired image by using the augmented display technology. In a specific embodiment, when the target body information further includes the fat distribution information, the heat materials matching the fat of the corresponding part of the target object can be determined on the corresponding part of the target object according to the fat distribution of the target object, and the part displays the heat materials by using the augmented display technology. For example, if the heat materials matching the fat of the belly of the target object are two roasted chickens, then the two roasted chickens can be displayed on the belly of the target object.

[0088] Therefore, by determining the heat materials matching the heat corresponding to the fat weight of the target object, and displaying the heat materials on the target image by using the augmented display technology, the body fat information of the target object can be more intuitively displayed, and the user can conveniently know the body fat information of the target object.

[0089] Please refer to Figure 5 , Figure 5is a schematic diagram of a framework of an embodiment of the body shape information determination apparatus. In this embodiment, the body shape information determination apparatus 50 comprises an acquisition module 51, an object determination module 52, and an information determination module 53. The acquisition module 51 is configured to acquire body shape related information of a target object. The object determination module 52 is configured to determine a reference object matching the target object by using the body shape related data. The information determination module 53 is configured to determine target body shape information of the target object based on reference body shape information corresponding to the reference object.

[0090] In the above, the reference body shape information and the target body shape information each comprise at least one of body fat information and muscle tissue distribution information; and / or the information determination module 53 is configured to determine the target body shape information of the target object based on the reference body shape information corresponding to the reference object, comprising: taking the reference body shape information of the reference object as the reference body shape information of the target object.

[0091] In the above, the object determination module 52 is configured to determine the reference object matching the target object by using the body shape related data, comprising: selecting the reference object matching the target object from a first candidate object set based on the body shape related data; wherein the first candidate object set comprises a plurality of candidate objects, and each candidate object is pre-provided with reference body shape information.

[0092] In the above, the body shape information determination apparatus 50 further comprises a screening module. Before the acquisition module 51 is configured to acquire the body shape related information of the target object, the screening module is configured to acquire at least object information of the target object, wherein the object information comprises one or more of gender and height; and find at least one candidate object matching the object information from a second candidate object set to form the first candidate object set.

[0093] In the above, the acquisition module 51 is configured to acquire the body shape related information of the target object, and specifically comprises: detecting a target image containing the target object to obtain a plurality of human body key points of the target object; and acquiring the body shape related data of the target object based on the plurality of human body key points.

[0094] In the above, the target object is a target image containing the target object, and the object determination module 52 is configured to determine the reference object matching the target object by using the body shape related data, comprising: comparing the target image with candidate images containing each candidate object to obtain a body shape matching degree of the target object with each candidate object; and selecting a candidate object corresponding to a body shape matching degree satisfying a preset requirement as the reference object.

[0095] The target image includes: a plurality of target sub-images obtained by respectively photographing the target object from a plurality of angles; the object determination module 52 is configured to compare the target image with a candidate image containing each candidate object to obtain a body shape matching degree of the target object and each candidate object, including: comparing the plurality of target sub-images with the candidate image to obtain the body shape matching degree of the target object and each candidate object in each target sub-image; the object determination module 52 is configured to select a candidate object corresponding to the body shape matching degree meeting a preset requirement as a reference object, including: selecting a candidate object corresponding to the body shape matching degree meeting the preset requirement based on the body shape matching degree of the target object and each candidate object in each target sub-image.

[0096] The shape information determination apparatus 50 further includes a display module, which is configured to display the target shape information on the target image after the information determination module 53 determines the target shape information of the target object.

[0097] The target shape information includes body fat information; the display module is configured to display the target shape information on the target image, including: determining a calorie corresponding to a fat weight of the target object based on the body fat information; determining a calorie material matching the calorie; and displaying the calorie material on the target image by using an augmented display technology.

[0098] Please refer to Figure 6 , Figure 6 is a schematic diagram of a framework of an embodiment of the electronic device. The electronic device 60 includes a memory 601 and a processor 602 coupled with each other. The processor 602 is configured to execute program instructions stored in the memory 601 to implement the steps of any of the above-described shape information determination method embodiments. In a specific implementation scenario, the electronic device 60 can include but is not limited to: a microcomputer, a server, and in addition, the electronic device 60 can also include a notebook computer, a tablet computer, and the like, without limitation.

[0099] Specifically, the processor 602 is configured to control itself and the memory 601 to implement the steps of any of the above-described embodiment of the method for determining shape information. The processor 602 can also be referred to as a CPU (Central Processing Unit). The processor 602 can be an integrated circuit chip having a processing capability. The processor 602 can also be a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor. In addition, the processor 602 can be implemented by an integrated circuit chip together.

[0100] Referring to Figure 7 , Figure 7 is a schematic diagram of a framework of an embodiment of the computer-readable storage medium of the present application. The computer-readable storage medium 70 stores program instructions 701 capable of being executed by a processor, the program instructions 701 being configured to implement the steps of any of the above-described embodiment of the method for determining shape information.

[0101] The above-described scheme can determine a reference object matched with the target object by using the body shape related data of the target object, and then determine the target shape information of the target object according to the reference shape information corresponding to the reference object, thereby achieving the acquisition of the target shape information of the target object.

[0102] The present disclosure relates to the field of augmented reality, by acquiring image information of a target object in a real environment, and then detecting or recognizing the related features, states and attributes of the target object by means of various visual related algorithms, thereby obtaining an AR effect combining virtual and real objects matched with specific applications. Exemplarily, the target object can relate to a face, a limb, a gesture, an action, etc. related to a human body, or a marker, a sign, etc. related to an object, or a sand table, a display area or a display object, etc. related to a venue or a place. The visual related algorithms can relate to visual positioning, SLAM, three-dimensional reconstruction, image registration, background segmentation, key point extraction and tracking of an object, pose or depth detection of an object, etc. The specific applications can not only relate to interactive scenes such as guiding, navigation, explanation, reconstruction, virtual effect superimposed display, etc. related to real scenes or objects, but also relate to interactive scenes such as makeup beautification, limb beautification, special effect display, virtual model display, etc. related to a person.

[0103] The related features, states and attributes of the target object can be detected or recognized by a convolutional neural network. The convolutional neural network is a network model obtained by model training based on a deep learning framework.

[0104] In some embodiments, the apparatus provided by the embodiments of the present disclosure has functions or includes modules that can be used to perform the methods described in the above method embodiments, and the specific implementation can refer to the description of the above method embodiments. For brevity, details are not repeated here.

[0105] The above description of each embodiment tends to emphasize the differences between each embodiment, and the same or similar parts can be mutually referred to. For brevity, details are not repeated here.

[0106] In several embodiments provided in the present application, it should be understood that the disclosed methods and apparatuses can be implemented in other ways. For example, the above-described apparatus implementation is only schematic, for example, the division of modules or units is only a logical function division, and actual implementation can have another division manner, for example, a unit or component can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the shown or discussed mutual elements can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or other forms.

[0107] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on network units. According to actual needs, some or all of the units can be selected to achieve the purpose of the present embodiment.

[0108] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The above integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0109] The integrated unit, if implemented in the form of a software function unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application, essentially or in other words, the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the methods in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various media that can store program codes.

Claims

1. A method of determining body information, characterized by, The method comprises the following steps: Performing measurement based on augmented reality technology on a target image containing a target object to obtain body shape related data of the target object; the target image comprises a plurality of target sub-images obtained by photographing the target object from a plurality of angles; the body shape related data comprises body shape related data corresponding to each target sub-image, and the body shape related data comprises at least one of the upper arm length, forearm length, thigh length, calf length, chest thickness and shoulder height of a human body; At least obtaining object information of the target object, wherein the object information comprises one or more of gender and height; Finding a plurality of candidate objects matching the object information from a second candidate object set; Matching the body shape related data corresponding to each target sub-image with the body shape related data of the plurality of candidate objects to obtain a body shape matching degree of the target object with each candidate object in each target sub-image; Selecting the candidate object corresponding to the body shape matching degree satisfying a preset requirement as a reference object; Determining target body shape information of the target object based on reference body shape information corresponding to the reference object; the reference body shape information and the target body shape information both comprise body fat information and muscle tissue distribution information.

2. The method of claim 1, wherein, The determination of the target body shape information of the target object based on the reference body shape information corresponding to the reference object comprises: taking the reference body shape information of the reference object as the reference body shape information of the target object.

3. The method according to claim 1 or 2, characterized in that, The first candidate object set comprises the plurality of candidate objects, and the candidate objects are preset with reference body shape information.

4. The method of claim 1, wherein, After the target body shape information of the target object is determined, the method further comprises: Displaying the target body shape information on the target image.

5. The method of claim 4, wherein, The target body shape information comprises body fat information; the displaying of the target body shape information on the target image comprises: Determining a heat corresponding to the fat weight of the target object based on the body fat information; Determining a heat material matching the heat; Displaying the heat material on the target image by using augmented display technology.

6. An apparatus for determining shape information, characterized by comprising: The method comprises the following steps: An acquisition module is configured to perform measurement based on augmented reality on a target image containing a target object to obtain body shape related data of the target object; the target image comprises a plurality of target sub-images obtained by photographing the target object from a plurality of angles; the body shape related data comprises body shape related data corresponding to each target sub-image, and the body shape related data comprises at least one of the upper arm length, forearm length, thigh length, calf length, chest thickness and shoulder height of a human body; A screening module is configured to at least obtain object information of the target object, wherein the object information comprises one or more of gender and height; and find a plurality of candidate objects matching the object information from a second candidate object set; An object determination module is configured to match the body shape related data corresponding to each target sub-image with the body shape related data of the plurality of candidate objects to obtain a body shape matching degree of the target object with each candidate object in each target sub-image; and select the candidate object corresponding to the body shape matching degree satisfying a preset requirement as a reference object. The information determining module is configured to determine target body shape information of the target object based on reference body shape information corresponding to the reference object, wherein the reference body shape information and the target body shape information both include body fat information and muscle tissue distribution information.

7. An electronic device, comprising: comprising a processor and a memory coupled to the processor, The processor is configured to execute a computer program stored in the memory to perform the method of any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that, The computer program stored in the memory can be run by the processor, and the computer program is used to implement the method of any one of claims 1 to 5.

Images