Method and device for determining maxillofacial symmetry based on three-dimensional images

Abstract

The application provides a method and device for determining jaw facial symmetry based on a three-dimensional image. The method comprises the following steps: in response to a request instruction input by a user, acquiring a three-dimensional image of the jaw face of the user and complaint information input by the user; identifying position information of a plurality of preset landmark points in an image region; determining second scoring information of the image region according to the position information of the preset landmark points; if the request instruction indicates that the user currently does not need expert evaluation services, determining asymmetry result information of a part corresponding to the image region according to the complaint information and the second scoring information; and pushing the asymmetry result information to the user. The application divides the three-dimensional image of the jaw face into image regions, so as to obtain asymmetry result information of each image region in the jaw face, and makes the asymmetry result more comprehensive. Furthermore, the asymmetry result can be determined in combination with the information and the second scoring information, so as to improve the accuracy of the asymmetry result evaluation.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of data processing, and in particular to a method and device for determining jaw-face symmetry based on a three-dimensional image. BACKGROUND

[0002] At present, jaw-face symmetry significantly affects the external harmony and aesthetic evaluation of a user's face, and the determination of jaw-face symmetry plays an important role in the reconstruction of a user's face.

[0003] In related technologies, the symmetry of a user's jaw-face is usually determined by using a two-dimensional image of the user's jaw-face and a subjective evaluation by the user, so that the obtained symmetry evaluation result has strong subjectivity.

[0004] Therefore, there is an urgent need for a method for determining jaw-face symmetry to avoid the above technical problems. SUMMARY

[0005] The method and device for determining jaw-face symmetry based on a three-dimensional image provided by the present application solve the problem of inaccurate symmetry evaluation results determined by using a two-dimensional image and a subjective evaluation by a user in related technologies.

[0006] In a first aspect, the present application provides a method for determining jaw-face symmetry based on a three-dimensional image, comprising:

[0007] In response to a request instruction input by a user, a three-dimensional image of the jaw-face of the user and complaint information input by the user are obtained; wherein the request instruction is used to instruct image processing of the three-dimensional image of the jaw-face of the user, the three-dimensional image of the jaw-face includes a plurality of image regions; and the complaint information includes first scoring information of the user on the asymmetry of the part indicated by the image region and user information;

[0008] The position information of a plurality of preset landmark points in the image region is identified;

[0009] Second scoring information of the image region is determined according to the position information of the preset landmark points; the second scoring information is used to indicate the degree of asymmetry of the part corresponding to the image region on the left and right sides of the jaw-face;

[0010] If the request instruction indicates that the user does not need expert evaluation service at present, the asymmetry result information of the part corresponding to the image region is determined according to the complaint information and the second scoring information; and the asymmetry result information is pushed to the user.

[0011] In a possible implementation, determining the second scoring information of the image region according to the position information of the preset landmark points comprises:

[0012] determine first angle information and second angle information composed of preset landmark points having a connection relationship; the connection relationship is used to indicate the connection order among three different preset landmark points; the first angle information is used to indicate the angle information composed of the preset landmark points located on the left side of the maxillofacial region in the image region; the second angle information is used to indicate the angle information composed of the preset landmark points located on the right side of the maxillofacial region in the image region;

[0013] determine second scoring information of the image region according to the first angle information and the second angle information.

[0014] In a possible implementation, the first angle information has a direction dimension; the second angle information has a direction dimension; the second scoring information is determined by the first angle information in different direction dimensions and the second angle information in different direction dimensions; the direction dimension is any one of a horizontal dimension, a vertical dimension, and a sagittal dimension.

[0015] In a possible implementation, the determining the second scoring information of the image region according to the first angle information and the second angle information includes:

[0016] performing difference processing on both the first angle information and the second angle information to obtain a difference result;

[0017] determining the ratio of the difference result to the first angle information, and determining the second scoring information of the image region according to the ratio.

[0018] In a possible implementation, the determining the asymmetry result information of the part corresponding to the image region according to the chief complaint information and the second scoring information includes:

[0019] determining a first weight value according to gender information in the user information; the first weight value is used to indicate the feeling degree of the user in the gender information to the asymmetry of the maxillofacial region;

[0020] determining a first evaluation result according to the first weight value, a preset second weight value, and the first scoring information; the preset second weight value is used to indicate the feeling degree of the user to the asymmetry of the part indicated by the image region corresponding to the second scoring information;

[0021] performing weighted summation processing on the first evaluation result and the second scoring information to obtain the asymmetry result information of the part corresponding to the image region.

[0022] In a possible implementation, the method further includes:

[0023] If the request instruction indicates that the user currently needs expert evaluation service, third scoring information is acquired, where the third scoring information is used to indicate scoring information of an expert for asymmetry of a part indicated by the image region;

[0024] According to the third scoring information, the chief complaint information, and the second scoring information, asymmetry result information of the part corresponding to the image region is determined.

[0025] In a possible implementation, the method further includes:

[0026] If the asymmetry result information of the part corresponding to the image region indicates that the part is in an asymmetric state, according to a preset correspondence between the part corresponding to the image region and the clinic information, the user is recommended the clinic information, where the clinic information includes clinic department information and clinic doctor information.

[0027] In a possible implementation, the plurality of image regions include at least two of a lip region, a gonial angle region, a cheek region, a chin region, and a condylar tragus region.

[0028] In a possible implementation, the method further includes:

[0029] First value information of a plurality of preset measurement indexes corresponding to the image region in a preset three-dimensional maxillofacial image is acquired, where the preset three-dimensional maxillofacial image includes a plurality of image regions, and parts indicated by each image region are in a symmetric state; the preset measurement indexes are determined by position information of a plurality of initial landmark points in the preset three-dimensional maxillofacial image;

[0030] The image region is subjected to simulation movement processing to obtain a moved three-dimensional maxillofacial image; parts indicated by the image region in the moved three-dimensional maxillofacial image are in an asymmetric state;

[0031] Second value information of the plurality of preset measurement indexes corresponding to the image region in the moved three-dimensional maxillofacial image is determined;

[0032] A difference between the second value information and the first value information is determined;

[0033] A preset landmark point corresponding to a preset measurement index whose value is greater than a preset value is determined.

[0034] In a second aspect, the application provides a determination apparatus for maxillofacial symmetry based on a three-dimensional image, including:

[0035] The first acquisition unit is configured to acquire a three-dimensional image of a maxillofacial part of a user and chief complaint information input by the user in response to a request instruction input by the user, wherein the request instruction is used to instruct image processing of the three-dimensional image of the maxillofacial part of the user, and the three-dimensional image of the maxillofacial part includes a plurality of image regions; and the chief complaint information includes first scoring information of the user on asymmetry of a part indicated by the user in the image region and user information.

[0036] The identification unit is configured to identify position information of a plurality of preset landmark points in the image region.

[0037] The first determination unit is configured to determine second scoring information of the image region according to the position information of the preset landmark points, wherein the second scoring information is used to indicate a degree of asymmetry of a part corresponding to the image region on a left side and a right side of the maxillofacial part.

[0038] The second determination unit is configured to determine asymmetry result information of the part corresponding to the image region according to the chief complaint information and the second scoring information if the request instruction indicates that the user currently does not need expert evaluation service.

[0039] The first pushing unit is configured to push the asymmetry result information to the user.

[0040] In a possible implementation, the first determination unit includes:

[0041] The first determination module is configured to determine first angle information and second angle information composed of preset landmark points having a connection relationship according to the connection relationship of the preset landmark points and the position information of the preset landmark points, wherein the connection relationship is used to indicate a connection order among three different preset landmark points; the first angle information is used to indicate angle information composed of preset landmark points located on a left side of the maxillofacial part in the image region; and the second angle information is used to indicate angle information composed of preset landmark points located on a right side of the maxillofacial part in the image region.

[0042] The second determination module is configured to determine the second scoring information of the image region according to the first angle information and the second angle information.

[0043] In a possible implementation, the first angle information has a direction dimension; the second angle information has a direction dimension; the second scoring information is determined by the first angle information in different direction dimensions and the second angle information in different direction dimensions; and the direction dimension is any one of a transverse dimension, a vertical dimension, and a sagittal dimension.

[0044] In a possible implementation, the second determination module is specifically configured to:

[0045] differencing the first included angle information and the second included angle information to obtain a difference result;

[0046] determining a ratio of the difference result and the first included angle information, and determining second scoring information of the image region according to the ratio.

[0047] In a possible implementation, the second determining unit comprises:

[0048] The third determining module is configured to determine a first weight value according to gender information in the user information, wherein the first weight value is used to indicate a degree of feeling of the user under the gender information on the asymmetry of the jaw and facial part.

[0049] The fourth determining module is configured to determine a first evaluation result according to the first weight value, a preset second weight value and the first scoring information, wherein the preset second weight value is used to indicate a degree of feeling of the user on the asymmetry of the part indicated by the image region corresponding to the second scoring information.

[0050] The processing module is configured to perform weighted summation processing on the first evaluation result and the second scoring information to obtain asymmetry result information of the part corresponding to the image region.

[0051] In a possible implementation, the apparatus further comprises:

[0052] The second obtaining unit is configured to obtain third scoring information if the request instruction indicates that the user currently needs expert evaluation service, wherein the third scoring information is used to indicate scoring information of an expert on the asymmetry of the part indicated by the image region.

[0053] The third determining unit is configured to determine asymmetry result information of the part corresponding to the image region according to the third scoring information, the chief complaint information and the second scoring information.

[0054] In a possible implementation, the apparatus further comprises:

[0055] The second pushing unit is configured to recommend, to the user, treatment information according to a preset corresponding relationship between the part corresponding to the image region and the treatment information if the asymmetry result information of the part corresponding to the image region indicates that the part is in an asymmetric state, wherein the treatment information comprises treatment department information and treatment doctor information.

[0056] In a possible implementation, the plurality of image regions comprise at least two of a lip region, a gonial angle region, a cheek region, a chin region and a condylar tragus region.

[0057] In a possible implementation, the apparatus further includes:

[0058] a third obtaining unit, configured to obtain first value information of each of a plurality of preset measurement indexes corresponding to an image region in a preset three-dimensional maxillofacial image, the preset three-dimensional maxillofacial image including a plurality of image regions, and each image region indicating a part in a symmetrical state; the preset measurement indexes being determined by position information of a plurality of initial landmark points in the preset three-dimensional maxillofacial image;

[0059] a moving unit, configured to perform simulation moving processing on the image region to obtain a moved three-dimensional maxillofacial image; the part indicated by the image region in the moved three-dimensional maxillofacial image being in an asymmetrical state;

[0060] a fourth determining unit, configured to determine second value information of each of the plurality of preset measurement indexes corresponding to the image region in the moved three-dimensional maxillofacial image;

[0061] a fifth determining unit, configured to determine a difference between the second value information and the first value information;

[0062] a sixth determining unit, configured to determine, as a preset landmark point, an initial landmark point corresponding to a preset measurement index whose difference value is greater than a preset value.

[0063] In a third aspect, the present application provides an electronic device, including: a memory, a processor;

[0064] a memory; a memory for storing executable instructions of the processor;

[0065] The processor is configured to execute the method according to any one of the first aspect.

[0066] In a fourth aspect, the present application provides a computer readable storage medium, the computer readable storage medium storing computer execution instructions, the computer execution instructions being executed by a processor to implement the method according to any one of the first aspect.

[0067] In a fifth aspect, the present application provides a computer program product, the computer program product including a computer program, the computer program being executed by a processor to implement the method according to any one of the first aspect.

[0068] This application provides a method and apparatus for determining facial symmetry based on three-dimensional images. The method includes: responding to a user-inputted request instruction, acquiring a three-dimensional image of the user's facial structure and the user's input complaint information; wherein the request instruction is used to instruct image processing of the three-dimensional image of the user's facial structure, the three-dimensional image of the facial structure including multiple image regions; the complaint information includes the user's first score information on the asymmetry of the area indicated by the image region and user information; identifying the position information of multiple preset marker points in the image region; determining second score information of the image region based on the position information of the preset marker points; the second score information is used to indicate the degree of asymmetry of the area corresponding to the image region on the left and right sides of the facial structure; if the request instruction indicates that the user does not currently require expert evaluation services, then determining the asymmetry result information of the area corresponding to the image region based on the complaint information and the second score information; and pushing the asymmetry result information to the user. This application processes images of various regions within a three-dimensional image of a user's forehead and face to obtain the location information of preset marker points within each region. Then, based on the obtained location information of these preset marker points, the asymmetry of the areas indicated by the image regions is evaluated to obtain a second score. Subsequently, the final asymmetry result can be determined by combining the user's request instructions, the user's complaints, and the determined second score. In this embodiment, by dividing the maxillofacial region into image regions, the user can obtain asymmetry result information for the symmetry of each image region within the maxillofacial region, resulting in a more comprehensive asymmetry assessment. Furthermore, the asymmetry result can be determined by combining the user's complaints and the second score information determined by the determining device based on the three-dimensional image, thereby improving the accuracy of the asymmetry result evaluation. Attached Figure Description

[0069] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0070] Figure 1 A flowchart illustrating a method for determining facial symmetry based on three-dimensional images, provided in an embodiment of this application;

[0071] Figure 2 A flowchart illustrating the second method for determining facial symmetry based on three-dimensional images, provided in this application embodiment;

[0072] Figure 3 This is a schematic diagram of the structure of an image region provided in an embodiment of this application;

[0073] Figure 4A structural schematic diagram of a device for determining jaw-face symmetry based on a three-dimensional image according to an embodiment of the present application is provided.

[0074] Figure 5 A structural schematic diagram of a device for determining jaw-face symmetry based on a three-dimensional image according to another embodiment of the present application is provided.

[0075] Figure 6 A structural schematic diagram of an electronic device according to an embodiment of the present application is provided.

[0076] The specific embodiments of the present application have been shown and described in the above-described drawings, and will be described in more detail hereinafter. These drawings and detailed description are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0077] The exemplary embodiments will be described in detail herein below with reference to the drawings. In the following description, the same drawings refer to the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of the present application.

[0078] At present, the symmetry of the jaw-face significantly affects the harmony and aesthetic evaluation of the user's face externally, and plays a very important role in the physical and mental health and social activities of the individual, in addition to having an important role in the reconstruction of the user's face.

[0079] At present, when evaluating the asymmetry of the user's jaw-face, the symmetry of the jaw-face is usually evaluated by a subjective evaluation method using two-dimensional images of the user. However, since the structure of the jaw-face from the internal bone to the external muscle, fat, skin tissue, etc. is relatively complex, the analysis using only two-dimensional images is prone to result in inaccurate symmetry results, and the results obtained are highly subjective.

[0080] The method and device for determining jaw-face symmetry based on a three-dimensional image provided by the present application are used to solve the above technical problems.

[0081] The technical solutions of the present application and how the technical solutions of the present application solve the above technical problems will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes can not be described again in some embodiments. The embodiments of the present application will be described below with reference to the drawings.

[0082] Figure 1A flowchart of a method for determining jaw-face symmetry based on a three-dimensional image is provided in the embodiments of the present application, as shown in Figure 1 The method includes the following steps:

[0083] S101, in response to a request instruction input by a user, a three-dimensional image of a jaw-face of the user and chief complaint information input by the user are acquired; wherein the request instruction is used to instruct image processing on the three-dimensional image of the jaw-face of the user, and the three-dimensional image of the jaw-face includes a plurality of image regions; and the chief complaint information includes first scoring information of the user on the asymmetry of a part indicated by the user and user information.

[0084] Exemplarily, the execution subject in the embodiments can be a determination device for jaw-face symmetry based on a three-dimensional image, which can be a server (such as a cloud server or a local server), a computer, a terminal device, a processor, a chip, etc., and the embodiments are not limited thereto. The execution subject of the embodiments is taken as the determination device for illustration.

[0085] When the user wants to determine the symmetry of the jaw-face tissue, the user can input a request instruction to the determination device, wherein the request instruction instructs the determination device to perform image processing on the three-dimensional image of the jaw-face of the user. In addition, in the embodiments, after the determination device acquires the three-dimensional image of the jaw-face of the user, the three-dimensional image is divided into a plurality of image regions, so that the symmetry of each image region in the three-dimensional image can be determined respectively.

[0086] In one example, when the user inputs the request instruction, the user can carry the identification information of the three-dimensional image of the jaw-face corresponding to the user in the request instruction at the same time, so that the determination device can accurately acquire the three-dimensional image of the jaw-face of the user. It should be noted that the manner of inputting the request instruction by the user is not limited in the embodiments, which can be voice input or input through an external input device corresponding to the determination device.

[0087] In addition, the chief complaint information of the user in this embodiment can be input by the user to the determination apparatus in advance, or can be acquired by the determination apparatus from the remaining devices. The chief complaint information input by the user includes user information and first scoring information determined by the user, wherein the user information generally includes the age, gender, and historical medical record of the user. The first scoring information determined by the user can be understood as scoring information of the user on the asymmetry of the image region of the maxillofacial part. In actual application, the scoring information can be grade information or a specific score value, which is not specifically limited in this embodiment. When the grade of the first scoring information determined by the user is higher or the score value is larger, it indicates that the asymmetry of the image region perceived by the user is more obvious.

[0088] In actual application, when determining the symmetry of the maxillofacial part of the user, the symmetry of each image region in the three-dimensional image of the maxillofacial part can be determined, or the symmetry can be determined according to the image region indicated by the user, which is not specifically limited in this embodiment.

[0089] S102, identify the position information of the plurality of preset landmark points in the image region.

[0090] For example, in this embodiment, a plurality of preset landmark points are provided for each image region corresponding to the maxillofacial part. After the determination apparatus acquires the three-dimensional image corresponding to the maxillofacial part of the user, for the image region in which the symmetry needs to be determined, the position information of each preset landmark point included in the image region can be identified first.

[0091] In one example, when identifying the position information of the landmark points in the image region, the position information of the preset landmark points can be determined according to the template matching method. When performing template matching, the image region in which the position information needs to be determined and the image region with known landmark position information can be determined first, and the two image regions are image registered (for example, a non-rigid registration algorithm provided in related technologies can be used) to obtain the preset landmark points in the image region in which the position information needs to be determined and the position information of the preset landmark points. The specific principle can be referred to the description in related technologies, which is not described here.

[0092] S103, determine the second scoring information of the image region according to the position information of the preset landmark points; the second scoring information is used to indicate the degree of asymmetry of the part corresponding to the image region on the left and right sides of the maxillofacial part.

[0093] Exemplarily, after the determining apparatus determines the position information of each preset landmark point in the image region of the three-dimensional image, the second scoring information indicating the asymmetry degree of the part indicated by the image region on the left and right sides of the maxillofacial part can be determined according to the position information of each preset landmark point.

[0094] In one example, when the second scoring information of the image region is determined according to the position information of the preset landmark point, at this time, the second scoring information corresponding to the image region can be determined according to parameters such as the line distance between the preset landmark points located on the left and right sides of the maxillofacial part, the area of the planar region formed by the preset landmark points, or the volume of the three-dimensional space formed by the preset landmark points.

[0095] S104, if the request instruction indicates that the user currently does not need expert evaluation service, the asymmetry result information of the part corresponding to the image region is determined according to the complaint information and the second scoring information; and the asymmetry result information is pushed to the user.

[0096] Exemplarily, in the embodiment, when the user inputs the request instruction to the determining apparatus, the request instruction input by the user can be used to indicate whether the user currently needs the asymmetry evaluation (i.e., expert evaluation service) of the part indicated by the image region by the joint expert, and if it is determined that the user currently does not need the expert evaluation service, the determining apparatus can determine the asymmetry result information at the part indicated by the image region according to the complaint information and the second scoring information input by the user. Moreover, after obtaining the asymmetry result information, the above information can also be pushed to the user so that the user can timely know the above asymmetry result information.

[0097] In one example, when the asymmetry result information is determined according to the complaint information and the second scoring information input by the user, at this time, the weight values of the first scoring information and the second scoring information can be determined according to the user information corresponding to the user. For example, in one possible case, the weight of the first scoring information can be determined according to the age information of the user, and when the user is younger, the weight value of the corresponding first scoring information can be set to be slightly smaller, thereby avoiding the phenomenon that children cannot accurately score the facial asymmetry.

[0098] In one example, when the asymmetry result information corresponding to each image region is pushed to the user, the image region corresponding to the asymmetry result information representing the asymmetry can be prominently displayed in the display interface of the determining apparatus so as to be viewed by the user. Alternatively, the determining apparatus can display the obtained asymmetry result information to the user through the communication mode reserved by the user or the user terminal device associated with the user.

[0099] It should be noted that the collection, storage, use, processing, transmission, provision and disclosure of user personal information in the present application comply with relevant laws and regulations and do not violate public order and good customs.

[0100] It can be understood that, in the embodiment, the position information of the preset landmark points contained in the image region is obtained by image processing on each image region in the three-dimensional image of the user's facial surface. Then, the asymmetry of the part indicated by the image region is evaluated according to the obtained position information of the preset landmark points to obtain second scoring information. Then, the final asymmetry result information can be further determined in combination with the request instruction of the user, the chief complaint information of the user and the determined second scoring information. In the embodiment, the image region is divided on the gnathal face to enable the user to obtain the asymmetry result information of the symmetry of each image region in the gnathal face, so that the asymmetry result of the gnathal face is more comprehensive. In addition, the asymmetry result can be determined in combination with the chief complaint information provided by the user and the second scoring information determined by the determining device according to the three-dimensional image, so as to improve the accuracy of the asymmetry result evaluation.

[0101] Figure 2 A flowchart of a second method for determining the symmetry of the gnathal face based on a three-dimensional image provided by an embodiment of the present application is shown in FIG. 2B. The method includes the following steps: Figure 2

[0102] S201, in response to a request instruction input by a user, obtaining a three-dimensional image of the gnathal face of the user and chief complaint information input by the user; wherein the request instruction is used to instruct image processing on the three-dimensional image of the gnathal face of the user, and the three-dimensional image of the gnathal face includes a plurality of image regions; and the chief complaint information includes first scoring information of the user on the asymmetry of the part indicated by the image region and user information.

[0103] For example, the specific principle of step S201 can be referred to step S101, which will not be repeated here.

[0104] In one example, the plurality of image regions of the three-dimensional image of the gnathal face includes at least two of the lip region, the gonial angle region, the cheek region, the chin region and the anthelic eartragus region.

[0105] As shown in FIG. 2B, Figure 3 Figure 3 ​​A structure diagram of an image region provided by an embodiment of the present application. In the diagram, the region corresponding to the two rectangular frames marked as A is a cheek region, which is used to reflect zygomatic asymmetry; the two rectangular frames marked as B are a tragus region, which is used to reflect asymmetry of the mandibular ramus and the tragus; the region marked as C is a lip region, which is used to reflect lip asymmetry; the region corresponding to the two rectangular frames marked as D is a mandibular angle region, which is used to reflect mandibular angle asymmetry; and the region marked as E is a chin region, which is used to reflect chin asymmetry.

[0106] S202, identify position information of a plurality of preset landmark points in the image region.

[0107] By way of example, the specific principle of step S202 can be referred to step S102, which will not be described here again.

[0108] S203, determine first and second angle information composed of preset landmark points having a connection relationship according to the connection relationship of the preset landmark points and the position information of the preset landmark points; the connection relationship is used to indicate the connection order among three different preset landmark points; the first angle information is used to indicate the angle information composed of the preset landmark points located on the left side of the facial region; and the second angle information is used to indicate the angle information composed of the preset landmark points located on the right side of the facial region.

[0109] By way of example, in the embodiment, when the second scoring information is determined according to the position information of the preset landmark points, first, the first and second angle information composed of the preset landmark points can be determined according to the connection relationship among the preset landmark points. The connection relationship among the preset landmark points is the connection order among three different preset landmark points determined in advance, and the angle information of the angle formed after the three preset landmark points are connected can be determined based on the above connection order. The obtained first angle information is the angle composed of the preset landmark points located on the left side of the facial region, and the second angle information is the angle composed of the preset landmark points located on the right side of the facial region.

[0110] In addition, the angle information can be determined according to the position information of the three preset landmark points corresponding to the angle, and the specific principle can be referred to the technical principle in the related art, which will not be described here again.

[0111] In one example, the first angle information has a direction dimension; the second angle information has a direction dimension; the second scoring information is determined by the first angle information in different direction dimensions and the second angle information in different direction dimensions; and the direction dimension is any one of a horizontal dimension, a vertical dimension, and a sagittal dimension.

[0112] Exemplarily, in the embodiment, the first angle information and the second angle information corresponding to the image region each have a respective direction dimension. For an image region, a plurality of first angle information of different direction dimensions and a plurality of second angle information of different direction dimensions can be set, and then for the first angle information and the second angle information under the same direction dimension, the asymmetry degree information under the direction dimension is determined. The direction dimension is any one of a horizontal dimension, a vertical dimension, and a sagittal dimension.

[0113] It can be understood that in the embodiment, the angle information of different direction dimensions can be used to determine the asymmetry degree corresponding to the same image region, which can improve the accuracy of the finally determined asymmetry result information.

[0114] For example, in actual application, the angle information of the horizontal dimension, the vertical dimension, and the sagittal dimension corresponding to the lip region can be represented by the following indexes respectively: Sal-Ch / Ch-Stb (i.e., representing the angle ∠Sal-Ch-Stb); Sal-Go / Go-Ch; Sal-Ch / Ch-As; wherein Sal can be specifically divided into left nasal side point Sal (L) and right nasal side point Sal (R), which can be understood as the leftmost and rightmost convex points of the intersection arc line of the nasal ala arc and the cheek skin; Ch can be specifically divided into left and right oral fissure points Ch (L) and Ch (R), which can be respectively understood as the left and right upper and lower lip intersection points; Stb is the most concave point of the nasolabial sulcus, i.e., the lowest point of the spherical depression in the nasolabial sulcus region; Go specifically includes left and right gonial angle points Go (L) / Go (R), which are the soft tissue turning points of the left and right gonial angle regions, representing the projection of the mandibular angle bone structure on the body surface soft tissue; As specifically includes left and right alar convex points As (L) / As (R), which are the most convex points of the left and right alar arc lines. For the first angle information of the lip region, if the index includes left and right indexes, the position information of the left point is used for angle determination; similarly, for the second angle information of the lip region, if the index includes left and right indexes, the position information of the right point is used for angle determination.

[0115] The angle information corresponding to the transverse dimension, vertical dimension and sagittal dimension of the mandibular angle region can be represented by the following indexes: Me-Go / Go-Mt, Tr-Zg / Zg-Go, Zg-Tr / Tr-Go, wherein Me represents the submental point, which is the lowest point of the soft tissue of the chin; Go specifically includes left and right mandibular angle points Go(L) / Go(R), which are the turning points of the soft tissue of the left and right mandibular angle regions, representing the projection of the bone structure of the mandibular angle on the surface soft tissue. Mt specifically includes left and right mental tubercle points Mt(L) / Mt(R), which are the soft tissue protrusion points on both sides of the chin, representing the transition between the chin and the mandible; Tr specifically includes left and right pretragal points Tr(L) / Tr(R), which are the midpoints of the transition line between the tragus and the skin; and Zg specifically includes left and right zygomatic arch points Zg(L) / Zg(R), which are the most forward protruding points of the soft tissue of the left and right zygomatic regions.

[0116] The angle information corresponding to the transverse dimension, vertical dimension and sagittal dimension of the cheek region can be represented by the following indexes: Ex-Zg / Zg-Sal, Zg-Tr / Tr-He, Tr-Zg / Zg-Ex, wherein Ex specifically includes left and right lateral canthus points Ex(L) / Ex(R), which are the intersection points of the lateral canthus; and He specifically includes left and right brow points He(L) / He(R), which are the highest points of the left and right eyebrows.

[0117] The angle information corresponding to the transverse dimension, vertical dimension and sagittal dimension of the chin region can be represented by the following indexes: Gn-Mt / Mt-Me, Li-Mt / Mt-Gn, Me-Go / Go-Mt, wherein Gn represents the glabella point, which is the most forward protruding point of the soft tissue of the chin; and Li represents the lower lip margin, which is the most protruding point of the lower lip margin.

[0118] The angle information corresponding to the transverse dimension, vertical dimension and sagittal dimension of the joint tragus region can be represented by the following indexes: Ex-Tr / Tr-Go, Tr-Zg / Zg-Go, Tr-Go / Go-Zg.

[0119] In S204, the second scoring information of the image region is determined according to the first angle information and the second angle information; the second scoring information is used to indicate the degree of asymmetry of the part corresponding to the image region on the left and right sides of the maxillofacial region.

[0120] Exemplarily, after the first and second angle information corresponding to the image region is determined, the second scoring information corresponding to the image region can be determined according to the first and second angle information. For example, the difference value corresponding to the first and second angle information can be directly used to determine the value of the second scoring information. The greater the difference value between the first and second angle information, the greater the asymmetry degree of the part indicated by the image region on the left and right sides of the maxillofacial region, and thus the higher the score value or the represented grade of the corresponding second scoring information.

[0121] It can be understood that, in this embodiment, in order to determine the second scoring information corresponding to the image region, the asymmetry of the part indicated by the image region can be determined according to the first and second angle information composed of the preset marking points corresponding to the image region. Compared with the volume of the stereoscopic space in the related art, the angle calculation method in this embodiment is simple, which is beneficial to reduce the required processing resources in the processing process of the determination device and improve the efficiency of the determination device in determining the second scoring information.

[0122] In one example, step S204 includes the following steps: “performing difference processing on the first and second angle information to obtain a difference value; determining the ratio of the difference value to the first angle information, and determining the second scoring information of the image region according to the ratio”.

[0123] Exemplarily, in this embodiment, when the second scoring information is determined according to the first and second angle information, in order to ensure that the second scoring information corresponding to different image regions is in the same dimension, first, the difference processing can be performed on the first and second angle information, and the ratio between the difference value obtained by the difference processing and the first angle information can be used as the second scoring information corresponding to the image region. Alternatively, the second scoring information corresponding to the ratio can be determined according to the corresponding relationship between the ratio and the second scoring information.

[0124] It can be understood that, in this embodiment, in order to ensure that the second scoring information corresponding to different image regions is in the same dimension, after the difference processing is performed on the first and second angle information, the ratio between the difference value obtained by the difference processing and the first angle information can be calculated, so as to further determine the second scoring information through the ratio.

[0125] S205, if the request instruction indicates that the user currently does not need expert evaluation service, determining a first weight value according to the gender information in the user information; wherein the first weight value is used to indicate the feeling degree of the user with respect to the maxillofacial asymmetry under the gender information.

[0126] Exemplarily, in the embodiment, when the device determines that the user currently does not need the expert evaluation service according to the request instruction, at this time, when determining the asymmetric result information according to the obtained second scoring information and the user complaint information, first, the first weight value corresponding to the gender information can be determined according to the gender information contained in the user complaint information.

[0127] The first weight values corresponding to different gender information are different. Because the perception degree (i.e., the recognition ability) of users of different genders to the asymmetry of the maxillofacial part is different, different first weight values can be set for users of different genders.

[0128] In a possible embodiment, for each image region, a first weight value corresponding to each gender can be set. For example, the first weight values of men and women for the lip region can be set to 0.6 and 0.4 respectively; the first weight values of men and women for the mandibular angle region can be set to 0.6 and 0.55 respectively; the first weight values of men and women for the cheek region can be set to 0.5 and 0.55 respectively; the first weight values of men and women for the chin region can be set to 0.6 and 0.5 respectively; and the first weight values of men and women for the joint ear screen region can be set to 0.4 and 0.6 respectively.

[0129] S206, determining a first evaluation result according to the first weight value, a preset second weight value and the first scoring information; the preset second weight value is used to indicate the perception degree of the user to the asymmetry of the part indicated by the image region corresponding to the second scoring information.

[0130] Exemplarily, the preset second weight value can be understood as the perception degree (recognition ability) of the user to the asymmetry of the part indicated by the image region for which the asymmetric result information is to be determined. In actual application, the preset second weight values corresponding to the lip region, the mandibular angle region, the cheek region, the chin region and the joint ear screen region can be 0.6, 0.5, 0.4, 0.6 and 0.3 respectively.

[0131] After the first weight value and the preset second weight value are determined, the first evaluation result can be determined in combination with the first scoring information, wherein the first evaluation result can be understood as the asymmetric evaluation result obtained based on the perception degree of the user.

[0132] Specifically, the first evaluation result can be determined according to the product of the first weight value, the preset second weight value and the first scoring information.

[0133] S207, performing weighted sum processing on the first evaluation result and the second scoring information to obtain the asymmetric result information of the part corresponding to the image region.

[0134] Exemplarily, after obtaining the first evaluation result and the second score information, the first evaluation result and the second score information can be subjected to weighted summation processing, and the result obtained after the weighted summation processing can be taken as the asymmetry result information corresponding to the image region. In one example, when the first evaluation result and the second score information are subjected to weighted summation processing, at this time, the weight value corresponding to the first evaluation result is smaller than the weight value corresponding to the second score information, so as to avoid the problem that the result information obtained when the subjective evaluation result accounts for a high proportion in the asymmetry result information is inaccurate.

[0135] It can be understood that in the embodiment, the gender information of the user, the preset second weight value and the first score information are combined to determine the first evaluation result corresponding to the user side; then, the first evaluation result and the second score information are subjected to weighted summation processing, and then the asymmetry result information is obtained, so as to improve the accuracy of the obtained asymmetry result information.

[0136] S208, if the request instruction indicates that the user currently needs expert evaluation service, third score information is obtained, wherein the third score information is used to indicate the score information of the expert for the asymmetry of the part indicated by the image region.

[0137] Exemplarily, if the request instruction input by the user indicates that the user currently needs some expert to give score service (i.e. expert evaluation service) for the asymmetry of the user's forehead, at this time, the third score information input by the expert can be further obtained, wherein the third score information is used to indicate the score of the expert for the asymmetry of the part indicated by the image region of the forehead.

[0138] In one example, after the third score information is obtained, the determination apparatus can first send the three-dimensional image of the user and the complaint information of the user to the doctor currently in the idle state, so that the doctor can determine the third score information according to the above information and input the third score information into the determination apparatus.

[0139] S209, according to the third score information, the complaint information and the second score information, the asymmetry result information of the part corresponding to the image region is determined.

[0140] Exemplarily, after the third score information is obtained, the complaint information input by the user and the second score information obtained by the determination apparatus according to the three-dimensional image information can be combined to further determine the asymmetry result information corresponding to the image region.

[0141] In one example, when determining the asymmetry result information corresponding to the image region, the first score information, the second score information and the third score information in the complaint information can be weighted and summed, and the sum result corresponding to the weighted sum processing can be taken as the asymmetry result information corresponding to the image region.

[0142] In one example, when determining the asymmetry result information corresponding to the image region, the first evaluation result can be determined according to the gender information in the complaint information, the preset second weight information and the first score information (for details, refer to the specific principle of step S206, which will not be repeated here); then, the first evaluation result, the second score information and the third score information are weighted and summed, and the sum result is taken as the asymmetry result information corresponding to the image region. When the weighted sum processing is performed, the weight value corresponding to the first evaluation result is less than the weight value corresponding to the third score information; and the weight value corresponding to the third score information is less than the weight value corresponding to the second score information.

[0143] It can be understood that when the request instruction corresponding to the user indicates that the current expert evaluation is needed, the asymmetry result information corresponding to the image region can be determined in combination with the third score information, the second score information and the complaint information of the expert evaluation, so as to further improve the accuracy of the asymmetry result.

[0144] S210, push the asymmetry result information to the user.

[0145] For example, the specific principle of step S210 can refer to step S104, which will not be repeated here.

[0146] In one example, when determining the asymmetry result information corresponding to the image region, Figure 1 or Figure 2 On the basis of any of the embodiments shown, the method further comprises the following steps: if the asymmetry result information of the part corresponding to the image region indicates that the part is in an asymmetric state, recommending the user with the medical information according to the preset corresponding relationship between the part corresponding to the image region and the medical information, wherein the medical information includes medical department information and medical doctor information.

[0147] For example, in the present embodiment, on the basis of any of the above embodiments, when the asymmetry result information corresponding to the part indicated by the image region is determined, if the asymmetry result information indicates that the part indicated by the image region is in an asymmetric state, the user can be further recommended with appropriate medical information.

[0148] The medical information can include the medical department suitable for the asymmetric part and the medical doctor information contained in the medical department.

[0149] Specifically, when determining the clinic department, the clinic department pushed to the user can be determined according to the correspondence between the part indicated by the image area and the clinic department at this time. For example, when the lip area and the chin area are asymmetric, the orthodontic department can be recommended to the user; when the mandibular angle area and the joint ear screen area are asymmetric, the orthognathic department can be recommended to the user.

[0150] In actual application, when the clinic doctor information corresponding to the clinic department is pushed to the user, the doctor's scheduling information can be included in the clinic doctor information, so that the user can select a suitable clinic doctor according to the doctor's scheduling information to perform subsequent registration and inquiry.

[0151] It can be understood that in the embodiment, when the asymmetric result information corresponding to the image area is determined, if the asymmetric result information represents that the part corresponding to the image area is asymmetric, the related clinic information can be further pushed to the user at this time, so as to improve the user experience of the determination device and facilitate the subsequent registration and inquiry of the user.

[0152] In the embodiment, in order to determine the second scoring information corresponding to the image area, the asymmetry of the part indicated by the image area can be determined according to the first angle information and the second angle information composed of the preset mark points corresponding to the image area. Compared with the volume of the three-dimensional space in the related art, the angle calculation method in the embodiment is simple, which is beneficial to reduce the required processing resources in the processing process of the determination device and improve the efficiency of the determination device in determining the second scoring information. In addition, the different direction dimensions of the angle information in the same image area can improve the accuracy of the final determined asymmetric result information. In addition, in order to ensure that the second scoring information corresponding to different image areas is located in the same dimension, after the difference processing of the first angle information and the second angle information, the ratio of the difference value obtained by the difference processing to the first angle information can be calculated, so as to further determine the second scoring information through the ratio between the two, and ensure that the second scoring information corresponding to different image areas is located in the same dimension.

[0153] In some embodiments, in Figure 1 or Figure 2 on the basis of any of the embodiments shown, the method further comprises the following steps:

[0154] The first step is to obtain first value information of each of a plurality of preset measurement indexes corresponding to an image region in a preset three-dimensional jaw and face image under the preset three-dimensional jaw and face image, the preset three-dimensional face image includes a plurality of image regions, and each image region indicates a part in a symmetrical state; the preset measurement index is determined by position information of a plurality of initial landmark points in the preset three-dimensional jaw and face image;

[0155] The second step is to perform a simulation moving process on the image region to obtain a moved three-dimensional jaw and face image; the part indicated by the image region in the moved three-dimensional jaw and face image is in an asymmetrical state;

[0156] The third step is to determine second value information of each of the plurality of preset measurement indexes corresponding to the image region under the moved three-dimensional jaw and face image;

[0157] The fourth step is to determine a difference value between the second value information and the first value information;

[0158] The fifth step is to determine an initial landmark point corresponding to a preset measurement index with a difference value greater than a preset value as a preset landmark point.

[0159] Exemplarily, in the embodiment, a determination method of a preset landmark point is provided, so that subsequent jaw and face asymmetry can be determined according to position information of the preset landmark point determined by the above method.

[0160] In determining the preset landmark point, a preset three-dimensional jaw and face image can be obtained first, and the parts indicated by each image region in the preset three-dimensional jaw and face image are in a symmetrical state. In addition, a plurality of initial landmark points are also provided for each image region, and first value information of a plurality of preset measurement indexes corresponding to the initial landmark points can be determined according to position information of the initial landmark points under the preset three-dimensional jaw and face image. In actual application, the plurality of preset measurement indexes corresponding to the initial landmark points can be understood as an angle formed by the initial landmark points, and the value corresponding to the angle is the first value information here.

[0161] Then, a moving process is performed on the image region, so that the moved image region is in an asymmetrical state. Then, second value information of the plurality of preset measurement indexes under the moved three-dimensional jaw and face image is determined.

[0162] Further, a difference value between the first value information and the second value information is determined, and according to the difference value, an initial landmark point corresponding to a preset measurement index with a difference value greater than a preset value is selected as a preset landmark point, and the corresponding relationship between the initial landmark point and the preset measurement index can be used as the corresponding relationship between the preset landmark point and the preset measurement index in the subsequent jaw and face asymmetry determination. Figure 1 and Figure 2The connection relationship of the preset landmarks in the embodiment shown. It can be understood that the greater the difference between the first value information and the second value information corresponding to the measurement index, the more the measurement index can reflect the asymmetry corresponding to the image region.

[0163] In one example, when performing the moving processing, the moving processing can be performed in multiple different direction dimensions, so as to screen out the measurement index with large value change in each direction dimension.

[0164] In this embodiment, by screening the initial landmark corresponding to the measurement index with a value difference between the asymmetry state and the symmetry state greater than a preset value from the multiple preset measurement indexes, as the preset landmark, the change of the index corresponding to the screened preset landmark can better reflect the asymmetry of the face, thereby improving the accuracy of the subsequently determined asymmetry result.

[0165] Figure 4 The structure schematic diagram of a jaw-face symmetry determination device based on a three-dimensional image provided by the embodiment of the present application is shown in Figure 4 The device comprises:

[0166] The first acquisition unit 401 is configured to acquire a three-dimensional image of the user's jaw-face and chief complaint information input by the user in response to a request instruction input by the user, wherein the request instruction is used to instruct image processing on the three-dimensional image of the user's jaw-face, and the three-dimensional image of the jaw-face comprises multiple image regions; and the chief complaint information comprises first scoring information of the user on the asymmetry of the indicated part of the image region and user information.

[0167] The identification unit 402 is configured to identify position information of multiple preset landmarks in the image region.

[0168] The first determination unit 403 is configured to determine second scoring information of the image region according to the position information of the preset landmark; and the second scoring information is used to indicate the asymmetry degree of the part corresponding to the image region on the left and right sides of the jaw-face.

[0169] The second determination unit 404 is configured to determine asymmetry result information of the part corresponding to the image region according to the chief complaint information and the second scoring information if the request instruction indicates that the user currently does not need expert evaluation service.

[0170] The first pushing unit 405 is configured to push the asymmetry result information to the user.

[0171] The device provided by the embodiment is used to realize the technical solutions provided by the above method, and the implementation principle and technical effects are similar, which will not be described in detail.

[0172] Figure 5Another structure diagram of a device for determining jaw-facial symmetry based on a three-dimensional image is provided in an embodiment of the present application, and in Figure 4 Based on the device structure shown in the figure, the first determining unit 403 in the embodiment includes:

[0173] The first determining module 4031 is configured to determine first angle information and second angle information composed of preset landmark points having a connection relationship according to the connection relationship of the preset landmark points and the position information of the preset landmark points; the connection relationship is used to indicate the connection order among three different preset landmark points; the first angle information is used to indicate the angle information composed of the preset landmark points located on the left side of the jaw-facial part in the image region; and the second angle information is used to indicate the angle information composed of the preset landmark points located on the right side of the jaw-facial part in the image region.

[0174] The second determining module 4032 is configured to determine the second scoring information of the image region according to the first angle information and the second angle information.

[0175] In a possible implementation, the first angle information has a direction dimension; the second angle information has a direction dimension; the second scoring information is determined by the first angle information in different direction dimensions and the second angle information in different direction dimensions; and the direction dimension is any one of a horizontal dimension, a vertical dimension, and a sagittal dimension.

[0176] In a possible implementation, the second determining module 4032 is specifically configured to:

[0177] perform difference processing on the first angle information and the second angle information to obtain a difference result.

[0178] determine the ratio of the difference result to the first angle information, and determine the second scoring information of the image region according to the ratio.

[0179] In a possible implementation, the second determining unit 404 includes:

[0180] The third determining module 4041 is configured to determine a first weight value according to gender information in the user information; and the first weight value is used to indicate the degree of feeling of the user to the jaw-facial asymmetry according to the gender information.

[0181] The fourth determining module 4042 is configured to determine a first evaluation result according to the first weight value, a preset second weight value, and the first scoring information; and the preset second weight value is used to indicate the degree of feeling of the user to the asymmetry of the part indicated by the image region corresponding to the second scoring information.

[0182] The processing module 4043 is configured to perform weighted summation processing on the first evaluation result and the second scoring information to obtain the asymmetry result information of the part corresponding to the image region.

[0183] In a possible implementation, the apparatus further includes:

[0184] The second obtaining unit 406 is configured to obtain third scoring information if the request instruction indicates that the user currently needs the expert evaluation service, where the third scoring information is used to indicate scoring information of the expert on the asymmetry of the part indicated by the image region.

[0185] The third determining unit 407 is configured to determine asymmetry result information of the part corresponding to the image region according to the third scoring information, the chief complaint information, and the second scoring information.

[0186] In a possible implementation, the apparatus further includes:

[0187] The second pushing unit 408 is configured to recommend, to the user, treatment information according to a preset correspondence between the part corresponding to the image region and the treatment information if the asymmetry result information of the part corresponding to the image region indicates that the part is in an asymmetric state, where the treatment information includes treatment department information and treatment doctor information.

[0188] In a possible implementation, the plurality of image regions include at least two of a lip region, a gonial angle region, a cheek region, a chin region, and a condylar tragus region.

[0189] In a possible implementation, the apparatus further includes:

[0190] The third obtaining unit 409 is configured to obtain first value information of each of a plurality of preset measurement indexes corresponding to the image region in a preset three-dimensional jaw-face image, where the preset three-dimensional face image includes a plurality of image regions, and the part indicated by each image region is in a symmetric state; and the preset measurement index is determined by position information of a plurality of initial landmark points in the preset three-dimensional jaw-face image.

[0191] The moving unit 410 is configured to perform simulation moving processing on the image region to obtain a moved three-dimensional jaw-face image, where the part indicated by the image region in the moved three-dimensional jaw-face image is in an asymmetric state.

[0192] The fourth determining unit 411 is configured to determine second value information of each of the plurality of preset measurement indexes corresponding to the image region in the moved three-dimensional jaw-face image.

[0193] The fifth determining unit 412 is configured to determine a difference between the second value information and the first value information.

[0194] The sixth determination unit 413 is configured to determine that an initial mark point corresponding to a preset measurement index corresponding to the difference greater than the preset value is the preset mark point.

[0195] The device provided in the embodiment is used for implementing the technical solutions provided by the above method, and has similar implementation principles and technical effects, which will not be described in detail.

[0196] The present application provides an electronic device, comprising: a memory, a processor;

[0197] The memory; the memory for storing the processor executable instruction;

[0198] The processor is used for executing the method according to the executable instruction.

[0199] Figure 6 The structure diagram of the electronic device provided in the embodiment of the present application is shown in the figure, and the electronic device comprises: Figure 6

[0200] The processor (processor) 291, the electronic device also includes a memory (memory) 292; can also include a communication interface (Communication Interface) 293 and a bus 294. Among them, the processor 291, the memory 292, the communication interface 293, can complete the mutual communication through the bus 294. The communication interface 293 can be used for information transmission. The processor 291 can call the logic instruction in the memory 294, to execute the method of the above embodiment.

[0201] In addition, the logic instruction in the memory 292 described above can be realized in the form of a software function unit and sold or used as an independent product, which can be stored in a computer readable storage medium.

[0202] The memory 292 as a kind of computer readable storage medium, can be used to store software program, computer executable program, such as the program instruction / module corresponding to the method in the embodiment of the present application. The processor 291 runs the software program, instruction and module stored in the memory 292, thereby executing function application and data processing, that is, realizing the method in the above method embodiment.

[0203] The memory 292 can include a storage program area and a storage data area, wherein the storage program area can store operating system, at least one application required by a function; The storage data area can store data created according to the use of terminal equipment and the like. In addition, the memory 292 can include a high-speed random access memory, and can also include a nonvolatile memory.

[0204] ​The application provides a computer readable storage medium, and the computer readable storage medium stores computer execution instructions. The computer execution instructions are executed by a processor to implement the method of any one of the items.

[0205] The application provides a computer program product, and the computer program product comprises a computer program. The computer program is executed by a processor to implement the method of any one of the items.

[0206] Other embodiments of the application will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. It is intended that the application be limited only by the scope of the claims, a properly construed, and it is intended that each definition in the claims be understood to embrace all equivalent variations and modifications of the numerous conditions specified. It is intended to cover any and all variations of this application which correspond to the concepts disclosed herein, and which fall within the scope of the present application as defined by the following claims.

[0207] It should be understood that the application is not limited to the precise construction that has been described above and shown in the accompanying drawings, and that various modifications and changes can be made by those skilled in the art without departing from the scope of the application. The scope of the application is limited only by the claims that follow.

Claims

1. A method of determining a jaw-facial symmetry based on a three-dimensional image, characterized by, The method comprises the following steps: in response to a request instruction input by a user, acquiring a three-dimensional image of a maxillofacial part of the user and chief complaint information input by the user; wherein the request instruction is used to instruct image processing of the three-dimensional image of the maxillofacial part of the user, and the three-dimensional image of the maxillofacial part is divided to obtain a plurality of image regions; the chief complaint information comprises first scoring information of asymmetry of a part indicated by the user in the image region and user information; identifying position information of a plurality of preset landmark points in the image region; determining first angle information and second angle information composed of preset landmark points having a connection relationship according to the connection relationship of the preset landmark points and the position information of the preset landmark points; the connection relationship is used to indicate the connection order among three different preset landmark points; the first angle information is used to indicate angle information composed of preset landmark points located on the left side of the maxillofacial part in the image region; the second angle information is used to indicate angle information composed of preset landmark points located on the right side of the maxillofacial part in the image region; performing difference processing on both the first angle information and the second angle information to obtain a difference result; determining the ratio of the difference result to the first angle information, and determining second scoring information of the image region according to the ratio; the second scoring information is used to indicate the degree of asymmetry of the part corresponding to the image region on the left and right sides of the maxillofacial part; if the request instruction indicates that the user currently does not need expert evaluation service, determining asymmetry result information of the part corresponding to the image region according to the chief complaint information and the second scoring information; and pushing the asymmetry result information to the user; The method further comprises: acquiring first value information of a plurality of preset measurement indexes corresponding to the image region in the preset three-dimensional maxillofacial image, the preset three-dimensional maxillofacial image comprising a plurality of image regions, and the parts indicated by each image region being in a symmetrical state; the preset measurement index being determined by position information of a plurality of initial landmark points in the preset three-dimensional maxillofacial image; performing simulation moving processing on the image region in a plurality of different direction dimensions to obtain a moved three-dimensional maxillofacial image; the parts indicated by the image region in the moved three-dimensional maxillofacial image being in an asymmetrical state; determining second value information of the plurality of preset measurement indexes corresponding to the image region in the moved three-dimensional maxillofacial image; determining the difference between the second value information and the first value information; determining the initial landmark point corresponding to the preset measurement index corresponding to the difference value greater than a preset value as a preset landmark point.

2. The method of claim 1, wherein, The first angle information has a direction dimension; the second angle information has a direction dimension; the second scoring information is determined by the first angle information in different direction dimensions and the second angle information in different direction dimensions; the direction dimension is any one of a horizontal dimension, a vertical dimension and a sagittal dimension.

3. The method of claim 1, wherein, According to the chief complaint information and the second scoring information, determine the asymmetry result information of the part corresponding to the image region, comprising: According to the gender information in the user information, determine a first weight value; wherein the first weight value is used to indicate the degree of feeling of the user under the gender information to the asymmetry of the maxillofacial part; According to the first weight value, a preset second weight value and the first scoring information, determine a first evaluation result; the preset second weight value is used to indicate the degree of feeling of the user to the asymmetry of the part indicated by the image region corresponding to the second scoring information; The first evaluation result and the second scoring information are weighted and summed to obtain the asymmetry result information of the part corresponding to the image region.

4. The method of claim 1, wherein, The method further comprises: If the request instruction indicates that the user currently needs expert evaluation service, obtain third scoring information, wherein the third scoring information is used to indicate the scoring information of the expert to the asymmetry of the part indicated by the image region; According to the third scoring information, the chief complaint information and the second scoring information, determine the asymmetry result information of the part corresponding to the image region.

5. The method of claim 1, wherein, The method further comprises: If the asymmetry result information of the part corresponding to the image region represents that the part is in an asymmetric state, according to a preset corresponding relationship between the part corresponding to the image region and the clinic information, recommend the clinic information to the user, wherein the clinic information includes clinic department and clinic doctor information.

6. The method according to any one of claims 1-5, characterized in that, The plurality of image regions comprise at least two of the following: lip region, mandibular angle region, cheek region, chin region, and joint ear screen region.

7. A device for determining the symmetry of the maxillofacial region based on three-dimensional images, characterized in that, Comprise: The first acquisition unit is configured to acquire a three-dimensional image of the maxillofacial part of the user and chief complaint information input by the user in response to a request instruction input by the user; wherein the request instruction is used to indicate image processing of the three-dimensional image of the maxillofacial part of the user, and the three-dimensional image of the maxillofacial part is divided to obtain a plurality of image regions; the chief complaint information comprises first scoring information of the user to the asymmetry of the part indicated by the image region and user information; The recognition unit is configured to recognize position information of a plurality of preset landmark points in the image region; The first determining unit is configured to determine first angle information and second angle information composed of preset landmarks having a connection relationship according to the connection relationship of the preset landmarks and position information of the preset landmarks; the connection relationship is used to indicate a connection sequence among three different preset landmarks; the first angle information is used to indicate angle information composed of preset landmarks located on the left side of the maxillofacial part in the image region; the second angle information is used to indicate angle information composed of preset landmarks located on the right side of the maxillofacial part in the image region; difference processing is performed on both the first angle information and the second angle information to obtain a difference result; a ratio of the difference result to the first angle information is determined, and second scoring information of the image region is determined according to the ratio; the second scoring information is used to indicate an asymmetry degree of the part corresponding to the image region on the left side and the right side of the maxillofacial part. The second determining unit is configured to determine asymmetry result information of the part corresponding to the image region according to the chief complaint information and the second scoring information if the request instruction indicates that the user currently does not need expert evaluation service. The first pushing unit is configured to push the asymmetry result information to the user. The third obtaining unit is configured to obtain first value information of each of a plurality of preset measurement indexes corresponding to an image region in a preset three-dimensional maxillofacial image under the preset three-dimensional maxillofacial image; the preset three-dimensional maxillofacial image includes a plurality of image regions, and parts indicated by each image region are in a symmetric state; the preset measurement index is determined by position information of a plurality of initial landmarks in the preset three-dimensional maxillofacial image. The moving unit is configured to perform simulated moving processing on the image region in a plurality of different direction dimensions to obtain a moved three-dimensional maxillofacial image; parts indicated by the image region in the moved three-dimensional maxillofacial image are in an asymmetric state. The fourth determining unit is configured to determine second value information of each of the plurality of preset measurement indexes corresponding to the image region under the moved three-dimensional maxillofacial image. The fifth determining unit is configured to determine a difference value of the second value information and the first value information. The sixth determining unit is configured to determine that an initial landmark corresponding to a preset measurement index corresponding to a difference value greater than a preset value is a preset landmark.

8. An electronic device, comprising: The memory is configured to store processor-executable instructions. The processor is configured to execute the method according to any one of claims 1-6 according to the executable instructions. The computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by the processor to implement the method according to any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, The computer program is executed by the processor to implement the method according to any one of claims 1-6.

10. A computer program product, characterised in that, ​

Images