Automatic processing method for dental intra-oral and extra-oral photos

Abstract

The invention discloses a method for automatically processing dental intraoral photos; the method comprises the following steps: taking multiple facial and intraoral photos of a patient from different angles according to oral photography standards; opening a software interface with a patient information input column and a photo classification placement column, and dragging multiple photos into different photo classification placement columns; the software program identifies facial and / or oral landmarks contained in each type of photo, generates a rotation reference line, and rotates each type of photo to the correct direction according to the rotation reference line; the software program cuts each type of photo rotated to the correct direction according to a certain proportion according to the facial and / or oral landmarks, and generates intraoral photos of different parts of the photo content that meet the oral photography standards in proportion to each other; the software program generates common dental diagnostic auxiliary lines according to the facial and / or oral landmarks; and the software program automatically creates an electronic review document named after the patient information. Effect: The invention can greatly shorten the time for dentists to sort out intraoral photos of patients, and has strong practicality.

Description

Technical Field

[0001] The present invention relates to the technical field of dental image processing, and in particular to an automatic processing method for dental intra-oral and extra-oral photos. Background Art

[0002] Dental photography is of great significance in clinical work. Dentists use photography to obtain photos of patients' faces and oral cavity from different angles, which is of great significance for case data recording, diagnosis analysis, program design, doctor-patient communication, and comparison of pre- and post-treatment efficacy. Obtaining accurate and repeatable facial and intraoral photos is the prerequisite for everything.

[0003] Currently, routine oral photography data mainly include facial photographs and intraoral photographs. Routine facial photographs include: frontal resting photo of the patient, frontal smiling photo of the patient, frontal resting photo of the patient facing 45 degrees to the left, frontal smiling photo of the patient facing 45 degrees to the left, frontal resting photo of the patient facing 90 degrees to the left, frontal smiling photo of the patient facing 90 degrees to the left, frontal resting photo of the patient facing 45 degrees to the right, frontal smiling photo of the patient facing 45 degrees to the right, frontal resting photo of the patient facing 90 degrees to the right, and frontal smiling photo of the patient facing 90 degrees to the right, a total of 10 photos; routine intraoral photographs include: frontal occlusal photo when cusps are misaligned, left buccal occlusal photo, right buccal occlusal photo, upper dental arch occlusal photo, lower dental arch occlusal photo, right side 90-degree overbite coverage photo of the anterior teeth area, and frontal upward 45-degree overbite coverage photo of the anterior teeth area, a total of 7 photos.

[0004] Among them, among the above-mentioned conventional intraoral photos, the upper dental arch occlusal photos and the lower dental arch occlusal photos can only be taken with a reflector due to angle restrictions, and the resulting images need to be manually flipped later before they can be used correctly. In addition, since multiple intraoral and extraoral photos of patients taken at various angles / parts often have incorrect shooting angles, different sizes, proportions, and heights of the main body of the photo content, and a large proportion of invalid information, dentists need to perform a large amount of manual rotation and cropping of the photo data of each patient in the later stage, which is not only time-consuming (it takes an average of 8-10 minutes for doctors to process intraoral and extraoral photos of each patient / each visit), but also prone to human errors and mistakes (common examples include the inability to accurately correct facial photos to make the pupil line parallel to the ground, the upper dental arch occlusal photos and the lower dental arch occlusal photos not correctly flipped, and the patient's name and shooting date not recorded), which seriously affects the accuracy of diagnosis and treatment, and even makes it difficult to ensure the uniformity of the angles, sizes, and proportions of intraoral and extraoral photos of patients in the same period or even different periods, which seriously hinders the recording of oral disease case data, diagnosis and analysis, program design, doctor-patient communication, and comparison of pre- and post-treatment efficacy.

[0005] In addition, when the patient's oral and intraoral photos are used for diagnosis, doctors often need to use additional tools to make auxiliary lines and perform measurements, which is time-consuming and laborious, and the accuracy of visual inspection alone is greatly reduced. Finally, the oral and intraoral photos processed by the doctor need to be additionally created, drawn, and arranged into JPG, TIF, DOC, PPT or PDF format files for the production of electronic medical records and teaching presentations, etc. The process is cumbersome and inefficient. If the patient's oral and intraoral photos can be automatically and accurately processed and cropped, and common diagnostic information can be automatically generated, and JPG, TIF, DOC, PPT or PDF format files can be automatically created, it will be of great significance to improve the efficiency and accuracy of dentists' diagnosis and treatment, and indirectly benefit the majority of oral patients.

[0006] To this end, the inventor of this patent designed this application based on work experience to solve relevant technical problems. Summary of the invention

[0007] The present invention aims to solve one of the technical problems in the related art at least to a certain extent. To this end, the purpose of the present invention is to provide a method for automatically processing dental intra-oral and extra-oral photographs.

[0008] To achieve the above object, the method for automatically processing dental intra-oral and extra-oral photos according to an embodiment of the present invention comprises the following steps:

[0009] S1. Take and select multiple facial and oral photos of the patient from different angles according to the oral photography standards;

[0010] S2. Opening a software interface having a patient information input column and a photo classification placement column, inputting patient information in the patient information input column, and dragging the selected multiple photo classifications into different photo classification placement columns;

[0011] S3, identifying the facial and / or oral landmarks contained in each type of photo through a software program, automatically generating a rotation reference line, and automatically rotating each type of photo to the correct direction according to the rotation reference line;

[0012] S4. Using a software program, automatically crop each type of photo that has been rotated to the correct direction according to facial and / or oral landmarks at a certain ratio to generate oral and extraoral photos of the same size and proportion of the content of different parts of the photo that meet the oral photography standards;

[0013] S5. Automatically generate commonly used dental diagnostic auxiliary lines based on facial and / or oral landmarks and rotation reference lines through a software program, and calculate commonly used diagnostic values.

[0014] In addition, the method for automatically processing dental intra-oral and extra-oral photos according to the above embodiment of the present invention may also have the following additional technical features:

[0015] According to one embodiment of the present invention, after step S5, the method further includes:

[0016] S6. Automatically create electronic review documents named after the patient information through the software program, and store and export the patient's oral and oral photos of different parts that are rotated and cropped and have commonly used dental diagnostic auxiliary lines in accordance with oral photography standards.

[0017] According to an embodiment of the present invention, the step S1 specifically includes:

[0018] S11. Take multiple photos of the patient's face from different angles and the inside of the oral cavity from different angles according to the oral photography standards;

[0019] S12. Based on each shooting angle, select a plurality of facial photos of the patient with different shooting angles and a plurality of intraoral photos with different shooting angles.

[0020] According to one embodiment of the present invention, the multiple facial photos with different shooting angles selected in step S1 specifically include: a frontal still photo of the patient, a frontal still photo of the patient facing 45 degrees to the left, a frontal still photo of the patient facing 45 degrees to the right, a frontal still photo of the patient facing 90 degrees to the left, a frontal still photo of the patient facing 90 degrees to the right, a frontal smiling photo of the patient, a frontal smiling photo of the patient facing 45 degrees to the left, a frontal smiling photo of the patient facing 45 degrees to the right, a frontal smiling photo of the patient facing 90 degrees to the left, and a frontal smiling photo of the patient facing 90 degrees to the right;

[0021] The multiple intraoral photographs with different shooting angles selected in step S2 specifically include: a front occlusal photograph when the cusps are in an interdigitated position, a left buccal occlusal photograph when the cusps are in an interdigitated position, a right buccal occlusal photograph when the cusps are in an interdigitated position, an upper dental arch occlusal photograph, a lower dental arch occlusal photograph, a right side 90-degree overlay photograph of the anterior teeth area, and a frontal upward 45-degree overlay photograph of the anterior teeth area.

[0022] According to one embodiment of the present invention, the photo classification placement column in step S2 includes a facial photo placement column and an intraoral photo placement column;

[0023] The selected multiple facial photos with different shooting angles are dragged into the facial photo placement column; the selected multiple intraoral photos with different shooting angles are dragged into the intraoral photo placement column.

[0024] According to an embodiment of the present invention, step S3 specifically includes:

[0025] The software identifies the two pupils of the patient in the selected frontal still photo of the patient, the frontal still photo of the patient facing 45 degrees to the left, the frontal still photo of the patient facing 45 degrees to the right, the frontal smiling photo of the patient, the frontal smiling photo of the patient facing 45 degrees to the left, and the frontal smiling photo of the patient facing 45 degrees to the right, automatically generates a connecting line of the center points of the two pupils, and automatically rotates the selected frontal still photo of the patient, the frontal still photo of the patient facing 45 degrees to the left, the frontal still photo of the patient facing 45 degrees to the right, the frontal smiling photo of the patient, the frontal smiling photo of the patient facing 45 degrees to the left, and the frontal smiling photo of the patient facing 45 degrees to the right until the connecting line of the center points of the two pupils is parallel to the horizontal plane;

[0026] The software identifies the outer canthus points of the patient's eye sockets and the apex of the auricle in the selected photos of the patient facing left at 90 degrees, the patient facing right at 90 degrees, the patient smiling at 90 degrees, and the patient smiling at 90 degrees, and automatically generates a connecting line between the center points of the outer canthus of the eye sockets and the apex of the auricle, and automatically rotates the selected photos of the patient facing left at 90 degrees, the patient facing right at 90 degrees, the patient smiling at 90 degrees, and the patient smiling at 90 degrees until the connecting line between the center points of the outer canthus of the eye sockets and the apex of the auricle is parallel to the horizontal plane;

[0027] The software recognizes the dental arch and upper and lower incisors of the patient in the selected frontal occlusal photograph when the cusps are interdigitated, the left buccal occlusal photograph when the cusps are interdigitated, the right buccal occlusal photograph when the cusps are interdigitated, and the right side 90-degree overlay coverage photograph of the anterior teeth area, and automatically generates the horizontal midline of the total contour of the upper and lower dentitions, and automatically rotates the selected frontal occlusal photograph when the cusps are interdigitated, the left buccal occlusal photograph when the cusps are interdigitated, the right buccal occlusal photograph when the cusps are interdigitated, and the right side 90-degree overlay coverage photograph of the anterior teeth area until the horizontal midline of the total contour of the upper and lower dentitions is parallel to the horizontal plane;

[0028] The software identifies the overall contour of the upper dentition and the mid-palatal suture of the patient in the selected upper dental arch occlusal photo, automatically generates a mid-palatal suture line that divides the overall contour of the upper dentition in half and covers the mid-palatal suture, and automatically rotates the selected upper dental arch occlusal photo of the patient so that the mid-palatal suture line is perpendicular to the horizontal plane;

[0029] The software identifies the overall contour of the lower dentition and the lingual frenulum of the patient in the selected lower dental arch occlusal photo of the patient, automatically generates a lingual frenulum connection line that divides the overall contour of the lower dentition in half and covers the lingual frenulum, and automatically rotates the selected lower dental arch occlusal photo of the patient so that the lingual frenulum connection line is perpendicular to the horizontal plane;

[0030] The software identifies the overall contours of the upper and lower dentitions and the attachment points of the upper lip frenulum in the selected frontal, upward 45-degree overlay coverage photograph of the patient's anterior teeth area, automatically generates an upper lip frenulum connection line that divides the overall contour of the upper and lower dentitions in half and covers the attachment points of the upper lip frenulum, and automatically rotates the selected frontal, upward 45-degree overlay coverage photograph of the patient's anterior teeth area so that the upper lip frenulum connection line is perpendicular to the horizontal plane.

[0031] According to an embodiment of the present invention, step S4 specifically includes:

[0032] The software identifies the head contours of the patients in the selected front resting photos of the patients, the front resting photos of the patients facing 45 degrees to the left, the front resting photos of the patients facing 45 degrees to the right, the front resting photos of the patients facing 90 degrees to the left, the front resting photos of the patients facing 90 degrees to the right, the front smiling photos of the patients, the front smiling photos of the patients facing 45 degrees to the left, the front smiling photos of the patients facing 45 degrees to the right, the front smiling photos of the patients facing 90 degrees to the left, and the front smiling photos of the patients facing 90 degrees to the right, which are rotated to the correct direction, and automatically crops them according to the proportion of the head contour of the patients occupying three quarters in the vertical direction and the equal remaining space on the left and right sides in the horizontal direction, so as to crop them into the target photo A with the same length and width ratio and the same position of the head of the patients in the middle;

[0033] The software identifies the patient's upper and lower dental arch contours in the selected front occlusal photograph with cusp interdigitation, left buccal occlusal photograph with cusp interdigitation, right buccal occlusal photograph with cusp interdigitation, upper dental arch occlusal photograph, lower dental arch occlusal photograph, right side 90-degree overlay photograph of the anterior teeth area, and front upward 45-degree overlay photograph of the anterior teeth area that have been rotated to the correct direction, and automatically crops them according to the ratio of the patient's upper and lower dental arch contours occupying four-fifths in the horizontal direction and with equal remaining space in the upper and lower vertical directions, so as to crop them into target photo B with exactly the same length and width ratio and the same position of the patient's upper and lower dental arch contours in the middle.

[0034] According to an embodiment of the present invention, step S5 specifically includes:

[0035] The software program performs symmetry analysis on the rotated and cropped frontal resting photo of the patient or the frontal smiling photo of the patient, automatically generates the midpoint of the line connecting the two pupils, and automatically draws a vertical auxiliary line for diagnosis through the midpoint of the line connecting the two pupils;

[0036] The software program is used to perform a three-court and five-eye analysis on the rotated and cropped frontal resting photos of the patient or the frontal smiling photos of the patient, and the vertical and horizontal cross lines for diagnosis are automatically generated. The generated vertical and horizontal cross lines for diagnosis include the vertical lines of the left and right facial contours, the vertical lines passing through the outer canthus points of the eye sockets, the vertical lines passing through the inner canthus points of the eye sockets, the horizontal lines passing through the top of the hairline, the horizontal lines passing through the midpoints of the left and right eyebrow points, the horizontal lines passing through the lower points of the nose contour, the horizontal lines passing through the midpoints of the left and right corners of the mouth, and the horizontal lines passing through the subchin point, and the spacing ratios between the vertical and horizontal lines are automatically calculated;

[0037] The software program was used to perform lateral resting aesthetic plane (E-Line) analysis on the rotated and cropped frontal right 90-degree resting photo of the patient, and automatically draw a diagnostic oblique auxiliary line passing through the nose tip point and the prechin point.

[0038] According to one embodiment of the present invention, in step S6, the created electronic review document named after the patient information includes a first target photo placement column, a second target photo placement column, and a third target photo placement column;

[0039] Multiple target photos A are stored in the first target photo placement column; multiple target photos B are stored in the second target photo placement column; target photo A with commonly used dental diagnostic auxiliary lines generated is stored in the third target photo placement column.

[0040] According to one embodiment of the present invention, the patient information in step S2 includes at least the patient's name, the time when the patient's corresponding photo was taken, and the diagnosis notes; the electronic review document in step S6 is preferably in JPG format, TIF format, DOC format, PPT format or PDF format.

[0041] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying creative work.

[0043] Figure 1 It is an overall operation flow chart of the method for automatically processing dental intra-oral and extra-oral photos of the present invention;

[0044] Figure 2 is a specific operation flow chart of step S1;

[0045] Figure 3 is a specific operation flow chart of step S3;

[0046] Figure 4 is a specific operation flow chart of step S4;

[0047] Figure 5 is a specific operation flow chart of step S5;

[0048] Figure 6It is a schematic diagram showing a plurality of facial and oral photos of the patient taken and selected from different angles in step S1.

[0049] Figure 7 The method is to classify and drag the multiple facial and oral photos of the patient selected in step S1 from different angles into different photo classification columns on the software interface, and fill in the patient information.

[0050] Figure 8 The process flow chart is a process of identifying two pupils of a patient in a selected frontal resting photo of the patient by software, automatically generating a connecting line of the center points of the two pupils, automatically rotating the selected frontal resting photo of the patient so that the connecting line of the center points of the two pupils is parallel to a horizontal plane, and subsequently cropping the photo into a target photo A that meets the requirements according to cropping standards;

[0051] Fig. 9 The software identifies the two pupils of the patient in the selected patient's front resting photo facing right at 45 degrees, automatically generates a connecting line between the center points of the two pupils, and automatically rotates the selected patient's front resting photo so that the connecting line between the center points of the two pupils is parallel to the horizontal plane, and then crops it into a target photo A that meets the requirements according to the cropping standard;

[0052] Fig.10 The software is used to identify the outer canthus point of the patient's eye socket and the vertex of the auricle in the selected resting photo of the patient facing right at 90 degrees, automatically generate a connection line between the outer canthus point of the eye socket and the center point of the vertex of the auricle, and automatically rotate the selected resting photo of the patient facing right at 90 degrees so that the connection line between the outer canthus point of the eye socket and the center point of the vertex of the auricle is parallel to the horizontal plane, and then crop it into a target photo A that meets the requirements according to the cropping standard;

[0053] Fig.11 The process flow chart is a process of identifying the dental arch and the upper and lower incisors in the front occlusal photograph of the selected patient when the cusps are interdigitated by software, automatically generating the horizontal midline of the total contour of the upper and lower dentition, and automatically rotating the front occlusal photograph of the selected patient when the cusps are interdigitated so that the horizontal midline of the total contour of the upper and lower dentition is parallel to the horizontal plane, and subsequently cutting it into a target photo B that meets the requirements according to the cutting standard;

[0054] Fig.12 The software identifies the overall upper dental arch contour and the mid-palatal suture in the selected patient's upper dental arch occlusal photograph, automatically generates a mid-palatal suture line that divides the overall upper dental arch contour into half and covers the mid-palatal suture, automatically rotates the selected patient's upper dental arch occlusal photograph until the mid-palatal suture line is perpendicular to the horizontal plane, and subsequently crops it into a target photo B that meets the requirements according to cropping standards.

[0055] Fig.13The software identifies the overall contour of the lower dentition and the lingual frenulum in the selected occlusal photograph of the lower dental arch of the patient, automatically generates a lingual frenulum line that divides the overall contour of the lower dentition in half and covers the lingual frenulum, automatically rotates the selected occlusal photograph of the lower dental arch of the patient until the lingual frenulum line is perpendicular to the horizontal plane, and subsequently crops it into a target photo B that meets the requirements according to cropping standards.

[0056] Fig.14 The process flow chart is as follows: the software is used to identify the total contours of the upper and lower dentitions and the attachment points of the upper lip frenulum in the selected frontal upward 45-degree overlay coverage photo of the patient's anterior teeth area, automatically generate an upper lip frenulum connection line that divides the total contours of the upper and lower dentitions in half and covers the attachment points of the upper lip frenulum, and automatically rotate the selected frontal upward 45-degree overlay coverage photo of the patient's anterior teeth area to make the upper lip frenulum connection line perpendicular to the horizontal plane, and subsequently cut it into a target photo B that meets the requirements according to the cutting standard;

[0057] Fig.15 It is a schematic diagram that automatically generates common dental diagnostic auxiliary lines based on facial and / or oral landmarks and rotation reference lines, and calculates common diagnostic values ​​through a software program;

[0058] Fig.16 A software program is used to create a display diagram of an electronic review document named after the patient information and the generated multiple target photos A and multiple target photos B are dragged into the first target photo placement column, the second target photo placement column and the third target photo placement column according to arrangement requirements to form the display diagram of the electronic review document.

[0059] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0060] The embodiments of the present invention are described in detail below, and examples of the embodiments are shown in the drawings of the specification, wherein the same or similar reference numerals throughout represent the same or similar elements or elements with the same or similar functions. The embodiments described below with reference to the drawings are exemplary and are intended to be used to explain the present invention, but cannot be understood as limiting the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present invention.

[0061] In the description of the present invention, it is to be understood that the terms “center”, “longitudinal”, “lateral”, “length”, “width”, “thickness”, “up”, “down”, “front”, “back”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, “clockwise”, “counterclockwise”, “axial”, “circumferential”, “radial”, etc., indicating orientations or positional relationships are based on the orientations or positional relationships shown in the drawings of the specification, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0062] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0063] In the present invention, unless otherwise clearly specified and limited, a first feature being "above" or "below" a second feature may include that the first and second features are in direct contact, or may include that the first and second features are not in direct contact but are in contact through another feature between them. Moreover, a first feature being "above", "above" and "above" a second feature includes that the first feature is directly above and obliquely above the second feature, or simply indicates that the first feature is higher in level than the second feature. A first feature being "below", "below" and "below" a second feature includes that the first feature is directly below and obliquely below the second feature, or simply indicates that the first feature is lower in level than the second feature.

[0064] The following describes in detail the automatic processing method for dental intra-oral and extra-oral photographs according to an embodiment of the present invention with reference to the accompanying drawings.

[0065] Reference Figures 1 to 16 As shown, the method for automatically processing dental intraoral and extraoral photos provided in an embodiment of the present invention comprises the following steps:

[0066] S1. Take and select multiple facial and oral photos of the patient from different angles according to the oral photography standards;

[0067] Specifically, in this technical solution, step S1 specifically includes:

[0068] S11. Take multiple photos of the patient's face from different angles and the inside of the oral cavity from different angles according to the oral photography standards;

[0069] S12. Based on each shooting angle, select a plurality of facial photos of the patient with different shooting angles and a plurality of intraoral photos with different shooting angles.

[0070] It should be noted here that in the above step S1, multiple facial photos and intraoral photos taken from each shooting angle will be taken, so that the photos taken from each shooting angle with high shooting resolution and obvious facial and / or intraoral features can be selected as the photos that need to be processed. In this process, unnecessary photos that are not selected can be deleted.

[0071] Among them, the selected multiple facial photos with different shooting angles specifically include: a frontal resting photo of the patient (a frontal photo of the patient's face with his mouth naturally closed in a resting state), a frontal resting photo of the patient facing 45 degrees to the left (a photo of the patient's face facing 45 degrees to the left with his mouth naturally closed in a resting state), a frontal resting photo of the patient facing 45 degrees to the right (a photo of the patient's face facing 45 degrees to the right with his mouth naturally closed in a resting state), a frontal resting photo of the patient facing 90 degrees to the left (a photo of the patient's face facing 90 degrees to the left with his mouth naturally closed in a resting state), and a frontal resting photo of the patient facing 90 degrees to the right (a photo of the patient's face facing 90 degrees to the right with his mouth naturally closed in a resting state) , a frontal smiling photo of the patient (a frontal photo of the patient's face with his mouth open and his teeth naturally occluded in a smiling state), a frontal smiling photo of the patient facing 45 degrees to the left (a photo of the patient's face facing 45 degrees to the left with his mouth open and his teeth naturally occluded in a smiling state), a frontal smiling photo of the patient facing 45 degrees to the right (a photo of the patient's face facing 45 degrees to the right with his mouth open and his teeth naturally occluded in a smiling state), a frontal smiling photo of the patient facing 90 degrees to the left (a photo of the patient's face facing 90 degrees to the left with his mouth open and his teeth naturally occluded in a smiling state), and a frontal smiling photo of the patient facing 90 degrees to the right (a photo of the patient's face facing 90 degrees to the right with his mouth open and his teeth naturally occluded in a smiling state).

[0072] It can be seen that the multiple facial photos of patients taking dental visits according to the oral photography specifications specifically include the 10 facial photos mentioned above. Figure 6 shown.

[0073] In addition, the selected multiple intraoral photographs with different shooting angles specifically include: frontal occlusal photograph when the cusp is in an interdigitated position (a frontal photograph of the mouth when the mouth is open and the upper and lower teeth are naturally interdigitated and fully exposed), left buccal occlusal photograph when the cusp is in an interdigitated position (a frontal photograph of the mouth facing 45 degrees to the left when the mouth is open and the upper and lower teeth are naturally interdigitated and fully exposed), right buccal occlusal photograph when the cusp is in an interdigitated position (a frontal photograph of the mouth facing 45 degrees to the right when the mouth is open and the upper and lower teeth are naturally interdigitated and fully exposed), upper dental arch occlusal photograph (a frontal photograph of the mouth when the mouth is open and the upper and lower teeth are naturally interdigitated and fully exposed). A 45-degree frontal upward shot of the mouth with the upper teeth fully exposed), a 45-degree frontal downward shot of the lower dental arch (a shot of the mouth facing downward at 45 degrees with the mouth open and the upper and lower teeth naturally open to fully expose the lower teeth facing downward), a 90-degree overbite and coverage shot of the right side of the anterior teeth (a shot of the mouth facing right at 90 degrees with the mouth open and the upper and lower teeth naturally staggered to occlude to fully expose the left sides of the upper and lower teeth), and a 45-degree frontal upward upward shot of the anterior teeth (a shot of the mouth facing upward at 45 degrees with the mouth open and the upper and lower teeth naturally staggered to occlude to fully expose the upper and lower teeth).

[0074] It can be seen that the multiple intraoral photos taken according to the oral photography specifications of the patient's dental treatment specifically include the 7 intraoral photos mentioned above. Figure 6 shown.

[0075] S2. Opening a software interface having a patient information input column and a photo classification placement column, inputting patient information in the patient information input column, and dragging the selected multiple photo classifications into different photo classification placement columns;

[0076] Furthermore, in the present technical solution, the patient information in step S2 at least includes the patient's name, the time when the patient's corresponding photo was taken, and the diagnosis remarks.

[0077] From the above, it can be clearly seen that the patient-related information is associated with the multiple facial photos and the multiple intraoral photos so as to avoid mistakes.

[0078] And in the present technical solution, the photo classification placement column in step S2 includes a facial photo placement column and an intraoral photo placement column;

[0079] Based on this, in this embodiment, multiple facial photos of patients visiting the dentistry taken according to the oral photography specifications are dragged into the facial photo placement column for archiving; multiple intraoral photos of patients visiting the dentistry taken according to the oral photography specifications are dragged into the intraoral photo placement column for archiving. For details, refer to Figure 7 shown.

[0080] S3, identifying the facial and / or oral landmarks contained in each type of photo through a software program, automatically generating a rotation reference line, and automatically rotating each type of photo to the correct direction according to the rotation reference line;

[0081] Specifically, in this technical solution, refer to Figure 3 As shown, the above step S3 specifically includes:

[0082] S31, using software to identify the two pupils of the patient in the selected frontal still photo of the patient, the frontal still photo of the patient facing 45 degrees to the left, the frontal still photo of the patient facing 45 degrees to the right, the frontal smiling photo of the patient, the frontal smiling photo of the patient facing 45 degrees to the left, and the frontal smiling photo of the patient facing 45 degrees to the right, automatically generate a connecting line between the center points of the two pupils, and automatically rotate the selected frontal still photo of the patient, the frontal still photo of the patient facing 45 degrees to the left, the frontal still photo of the patient facing 45 degrees to the right, the frontal smiling photo of the patient, the frontal smiling photo of the patient facing 45 degrees to the left, and the frontal smiling photo of the patient facing 45 degrees to the right until the connecting line between the center points of the two pupils is parallel to the horizontal plane

[0083] It should be noted that, in the above-selected 6 photos, both pupils of the patient can be clearly displayed. Therefore, the software program can use the two pupils of the patient as feature recognition points to construct a connecting line of the center points of the two pupils as a rotation reference line.

[0084] S32, identifying the outer canthus points of the patient's eye sockets and the apex of the auricle in the selected photos of the patient facing left at 90 degrees, the patient facing right at 90 degrees, the patient smiling at 90 degrees, and the patient smiling at 90 degrees, automatically generating a connecting line between the center points of the outer canthus of the eye sockets and the apex of the auricle, and automatically rotating the selected photos of the patient facing left at 90 degrees, the patient facing right at 90 degrees, the patient smiling at 90 degrees, and the patient smiling at 90 degrees until the connecting line between the center points of the outer canthus of the eye sockets and the apex of the auricle is parallel to the horizontal plane

[0085] It should be noted that, in the 4 photos selected above, they can all clearly show the lateral canthus of one of the patient's eyes and one of the vertices of the auricle. Therefore, the software program can use the lateral canthus of one of the patient's eyes and one of the vertices of the auricle as feature identification points to construct a connecting line between the center points of the lateral canthus of the eye and the vertex of the auricle as a rotation reference line.

[0086] S33, using the software to identify the dental arch and upper and lower incisors of the patient in the selected frontal occlusal photograph when the cusps are interdigitated, the left buccal occlusal photograph when the cusps are interdigitated, the right buccal occlusal photograph when the cusps are interdigitated, and the right side 90-degree overlay coverage photograph of the anterior teeth area, automatically generate the horizontal midline of the total contour of the upper and lower dentition, and automatically rotate the selected frontal occlusal photograph when the cusps are interdigitated, the left buccal occlusal photograph when the cusps are interdigitated, the right buccal occlusal photograph when the cusps are interdigitated, and the right side 90-degree overlay coverage photograph of the anterior teeth area until the horizontal midline of the total contour of the upper and lower dentition is parallel to the horizontal plane;

[0087] In the 4 photos selected above, the patient's dental arch and upper and lower incisors can all be clearly displayed. Therefore, the software program can use the patient's corresponding displayed dental arch and upper and lower incisors as feature recognition points to construct the horizontal midline of the upper and lower dental arch overall contour as a rotation reference line.

[0088] S34, identifying the overall contour of the upper dentition and the mid-palatal suture of the patient in the selected upper dental arch occlusal photo of the patient through the software, automatically generating a mid-palatal suture connecting line that divides the overall contour of the upper dentition in half and covers the mid-palatal suture, and automatically rotating the selected upper dental arch occlusal photo of the patient so that the mid-palatal suture connecting line is perpendicular to the horizontal plane;

[0089] It should be noted that in the one photo selected above, the overall outline of the patient's upper dentition and the mid-palatal suture can be clearly displayed. Therefore, the software program can use the patient's corresponding overall outline of the upper dentition and the mid-palatal suture as feature identification points to construct the mid-palatal suture line as a rotation reference line.

[0090] S35, identifying the overall contour of the lower dentition and the lingual frenulum of the patient in the selected lower dental arch occlusal photo of the patient through the software, automatically generating a lingual frenulum line that divides the overall contour of the lower dentition in half and covers the lingual frenulum, and automatically rotating the selected lower dental arch occlusal photo of the patient so that the lingual frenulum line is perpendicular to the horizontal plane;

[0091] It should be noted that in the one photo selected above, the overall contour of the patient's lower dentition and the lingual frenulum can be clearly displayed. Therefore, the software program can use the patient's corresponding overall contour of the lower dentition and the lingual frenulum as feature identification points to construct the lingual frenulum line as a rotation reference line.

[0092] S36, using software to identify the overall contour of the upper and lower dentitions and the attachment point of the upper lip frenulum in the selected frontal upward 45-degree overlay coverage photo of the patient's anterior teeth area, automatically generate an upper lip frenulum connection line that divides the overall contour of the upper and lower dentitions in half and covers the attachment point of the upper lip frenulum, and automatically rotate the selected frontal upward 45-degree overlay coverage photo of the patient's anterior teeth area to make the upper lip frenulum connection line perpendicular to the horizontal plane

[0093] It should be noted that in the one photo selected above, the overall contour of the patient's upper and lower teeth and the attachment point of the upper lip frenulum can be clearly displayed. Therefore, the software program can use the overall contour of the upper and lower teeth and the attachment point of the upper lip frenulum displayed by the patient as feature recognition points to construct the upper lip frenulum line as a rotation reference line.

[0094] It should be supplemented that the above-mentioned steps S31, S32, S33, S34, S35 and S36 are preferably performed in sequence from front to back. Of course, the operation order can also be interchanged during the specific implementation, and no limitation is made here.

[0095] S4. Using a software program, automatically crop each type of photo that has been rotated to the correct direction according to facial and / or oral landmarks at a certain ratio to generate oral and extraoral photos of the same size and proportion of the content of different parts of the photo that meet the oral photography standards;

[0096] Specifically, in this technical solution, refer to Figure 4 As shown, the step S4 specifically includes:

[0097] S41, identifying the head contours of the selected patients in the front resting photo of the patient, the front resting photo of the patient facing 45 degrees to the left, the front resting photo of the patient facing 45 degrees to the right, the front resting photo of the patient facing 90 degrees to the left, the front resting photo of the patient facing 90 degrees to the right, the front smiling photo of the patient, the front smiling photo of the patient facing 45 degrees to the left, the front smiling photo of the patient facing 45 degrees to the right, the front smiling photo of the patient facing 90 degrees to the left, and the front smiling photo of the patient facing 90 degrees to the right, which are rotated to the correct direction, and automatically cropping them according to the proportion that the head contour of the patient occupies three quarters in the vertical direction and the remaining space on the left and right sides in the horizontal direction is equal, so as to crop them into the target photo A with the same length and width ratio and the same position of the patient's head in the middle;

[0098] Obviously, in this embodiment, there are 10 target photos A, specifically, including a frontal still photo of the patient rotated to the correct direction and automatically cropped as required, a frontal still photo of the patient facing 45 degrees to the left, a frontal still photo of the patient facing 45 degrees to the right, a frontal still photo of the patient facing 90 degrees to the left, a frontal still photo of the patient facing 90 degrees to the right, a frontal smiling photo of the patient, a frontal smiling photo of the patient facing 45 degrees to the left, a frontal smiling photo of the patient facing 45 degrees to the right, a frontal smiling photo of the patient facing 90 degrees to the left, and a frontal smiling photo of the patient facing 90 degrees to the right.

[0099] in, Figure 8The flowchart is a step of identifying the two pupils of the patient in the selected patient's front resting photo by software, automatically generating a connecting line between the two pupil centers, automatically rotating the selected patient's front resting photo until the connecting line between the two pupil centers is parallel to the horizontal plane, and subsequently cropping it into a target photo A that meets the requirements according to the cropping standard; and the flowchart of identifying the two pupils of the patient in the selected patient's front smiling photo by software, automatically generating a connecting line between the two pupil centers, and automatically rotating the selected patient's front resting photo until the connecting line between the two pupil centers is parallel to the horizontal plane, and subsequently cropping it into a target photo A that meets the requirements according to the cropping standard is the same as the above flowchart. Figure 8 They are basically the same and are not shown in the figure here.

[0100] and, Fig. 9 The step flow chart is that the software recognizes the two pupils of the patient in the selected resting photo of the patient facing right at 45 degrees, automatically generates a connecting line of the center points of the two pupils, and automatically rotates the selected resting photo of the patient facing frontally so that the connecting line of the center points of the two pupils is parallel to the horizontal plane, and then crops it into the target photo A that meets the requirements according to the cropping standard; and the step flow chart that the software recognizes the two pupils of the patient in the selected resting photo of the patient facing left at 45 degrees, the smiling photo of the patient facing left at 45 degrees, and the smiling photo of the patient facing right at 45 degrees, automatically generates a connecting line of the center points of the two pupils, and automatically rotates the selected resting photo of the patient facing left at 45 degrees, the smiling photo of the patient facing left at 45 degrees, and the smiling photo of the patient facing right at 45 degrees so that the connecting line of the center points of the two pupils is parallel to the horizontal plane, and then crops it into the target photo A that meets the requirements according to the cropping standard is the same as the above Fig. 9 They are basically the same, so no illustration is given here.

[0101] at the same time, Fig.10 The software recognizes the lateral canthus point of the patient's eye socket and the vertex of the auricle in the selected resting photo of the patient facing right at 90 degrees, automatically generates a connection line between the lateral canthus point of the eye socket and the center point of the vertex of the auricle, and automatically rotates the selected resting photo of the patient facing right at 90 degrees so that the connection line between the lateral canthus point of the eye socket and the center point of the vertex of the auricle is parallel to the horizontal plane, and then cuts it into a target photo A that meets the requirements according to the cropping standard; and the software recognizes the lateral canthus point of the eye socket and the vertex of the auricle in the selected resting photo of the patient facing left at 90 degrees, the smiling photo of the patient facing left at 90 degrees, and the smiling photo of the patient facing right at 90 degrees, automatically generates a connection line between the lateral canthus point of the eye socket and the center point of the vertex of the auricle, and automatically rotates the selected resting photo of the patient facing right at 90 degrees so that the connection line between the lateral canthus point of the eye socket and the center point of the vertex of the auricle is parallel to the horizontal plane, and then cuts it into a target photo A that meets the requirements according to the cropping standard. The flowchart of the steps is the same as the above Fig.10 They are basically the same and are not shown in the figure here.

[0102] S42. Identify the selected upper and lower dental arch contours of the patient in the front occlusal photograph with cusp interdigitation, the left buccal occlusal photograph with cusp interdigitation, the right buccal occlusal photograph with cusp interdigitation, the upper dental arch occlusal photograph, the lower dental arch occlusal photograph, the right side 90-degree overlay photograph of the anterior teeth area, and the front upward 45-degree overlay photograph of the anterior teeth area that have been rotated to the correct direction through the software, and automatically crop them according to the proportion of the upper and lower dental arch contours of the patient occupying four-fifths in the horizontal direction and the same remaining space in the upper and lower vertical directions, so as to crop them into the target photo B with exactly the same length and width ratio and the same position of the upper and lower dental arch contours of the patient in the middle.

[0103] Obviously, in this embodiment, there are 7 target photos B, specifically, including the front occlusal photo when the cusps are interdigitated, the left buccal occlusal photo when the cusps are interdigitated, the right buccal occlusal photo when the cusps are interdigitated, the upper dental arch occlusal photo, the lower dental arch occlusal photo, the right side of the anterior teeth area with a 90-degree overlay, and the frontal upward 45-degree overlay photo of the anterior teeth area, which are rotated to the correct direction and automatically cropped as required.

[0104] in, Fig.11 The flowchart is a step of identifying the dental arch and the upper and lower incisors in the frontal occlusal photo of the selected patient when the cusps are interdigitated by the software, automatically generating the horizontal midline of the total contour of the upper and lower dentition, and automatically rotating the selected frontal occlusal photo of the patient when the cusps are interdigitated until the horizontal midline of the total contour of the upper and lower dentition is parallel to the horizontal plane, and subsequently cropping it into a target photo B that meets the requirements according to the cropping standard; and the flowchart of the step of identifying the dental arch and the upper and lower incisors in the left buccal occlusal photo of the selected patient when the cusps are interdigitated, the right buccal occlusal photo when the cusps are interdigitated, and the 90-degree overlay overlay photo of the right side of the anterior teeth area by the software, automatically generating the horizontal midline of the total contour of the upper and lower dentition, and automatically rotating the selected left buccal occlusal photo of the patient when the cusps are interdigitated, the right buccal occlusal photo when the cusps are interdigitated, and the 90-degree overlay overlay photo of the right side of the anterior teeth area until the horizontal midline of the total contour of the upper and lower dentition is parallel to the horizontal plane, and subsequently cropping it into a target photo B that meets the requirements according to the cropping standard is the same as the above Fig.11 They are basically the same, so they are not shown in the figure here.

[0105] and, Fig.12 The software identifies the overall upper dental arch contour and the mid-palatal suture in the selected patient's upper dental arch occlusal photograph, automatically generates a mid-palatal suture line that divides the overall upper dental arch contour into half and covers the mid-palatal suture, automatically rotates the selected patient's upper dental arch occlusal photograph until the mid-palatal suture line is perpendicular to the horizontal plane, and subsequently crops it into a target photo B that meets the requirements according to cropping standards.

[0106] also, Fig.13The software identifies the overall contour of the lower dentition and the lingual frenulum in the selected occlusal photograph of the lower dental arch of the patient, automatically generates a lingual frenulum line that divides the overall contour of the lower dentition in half and covers the lingual frenulum, automatically rotates the selected occlusal photograph of the lower dental arch of the patient until the lingual frenulum line is perpendicular to the horizontal plane, and subsequently crops it into a target photo B that meets the requirements according to cropping standards.

[0107] again, Fig.14 The software identifies the overall contours of the upper and lower dentitions and the attachment points of the upper lip frenulum in the selected frontal, upward 45-degree overlay coverage photo of the patient's anterior teeth area, automatically generates an upper lip frenulum connection line that divides the overall contour of the upper and lower dentitions in half and covers the attachment points of the upper lip frenulum, automatically rotates the selected frontal, upward 45-degree overlay coverage photo of the patient's anterior teeth area to make the upper lip frenulum connection line perpendicular to the horizontal plane, and subsequently crops it into a target photo B that meets the requirements according to cropping standards.

[0108] It should be further supplemented that the above steps S41 and S42 are preferably performed in sequence from front to back. Of course, the operation sequence can also be interchanged during specific implementation, and no limitation is made here.

[0109] S5. Automatically generate commonly used dental diagnostic auxiliary lines based on facial and / or oral landmarks and rotation reference lines through a software program, and calculate commonly used diagnostic values.

[0110] Specifically, in this technical solution, refer to Figure 5 As shown, the step S5 specifically includes:

[0111] S51, performing symmetry analysis on the rotated and cropped frontal resting photograph of the patient or the frontal smiling photograph of the patient through a software program, automatically generating a midpoint of the pupil line, and automatically drawing a vertical auxiliary line for diagnosis through the midpoint of the pupil line;

[0112] S52, performing a three-chamber and five-eyes analysis on the rotated and cropped frontal resting photo of the patient or the frontal smiling photo of the patient through a software program, and automatically generating vertical and horizontal cross lines, wherein the generated vertical and horizontal cross lines include left and right facial contour vertical lines, vertical lines passing through the outer canthus points, vertical lines passing through the inner canthus points, horizontal lines passing through the top of the hairline, horizontal lines passing through the midpoints of the left and right eyebrow points, horizontal lines passing through the lower point of the nose contour, horizontal lines passing through the midpoints of the left and right corners of the mouth, and horizontal lines passing through the subchin point, and automatically calculating the spacing ratios between the vertical and horizontal lines;

[0113] S53. Perform a lateral resting aesthetic plane (E-Line) analysis on the rotated and cropped right-facing 90-degree resting frontal photograph of the patient through a software program, and automatically draw a diagnostic oblique auxiliary line passing through the nose tip point and the prechin point.

[0114] in, Fig.15It is a schematic diagram that automatically generates common dental diagnostic auxiliary lines based on facial and / or oral landmarks and rotation reference lines, and calculates common diagnostic values ​​through a software program;

[0115] exist Fig.15 In the figure, the left photo is a display diagram in which the software program performs symmetry analysis on the rotated and cropped front resting photo of the patient or the front smiling photo of the patient, automatically generates the midpoint of the pupil line, and automatically draws the vertical auxiliary line for diagnosis through the midpoint of the pupil line; the middle photo is a display diagram in which the software program performs three-court and five-eye analysis on the rotated and cropped front resting photo of the patient or the front smiling photo of the patient, automatically generates vertical and horizontal cross lines, and the generated vertical and horizontal cross lines include the left and right facial contour vertical lines, the vertical line passing through the lateral canthus point, the vertical line passing through the inner canthus point, the horizontal line passing through the top of the hairline, the horizontal line passing through the midpoint of the left and right eyebrow points, the horizontal line passing through the lower point of the nose contour, the horizontal line passing through the midpoint of the left and right corners of the mouth, and the horizontal line passing through the chin point, and automatically calculates the spacing ratio between each vertical and horizontal line; the right photo is a display diagram in which the software program performs lateral resting aesthetic plane (E-Line) analysis on the rotated and cropped front right 90-degree resting photo of the patient, and automatically draws the diagnostic oblique auxiliary line passing through the nose tip point and the chin prepoint.

[0116] It should also be added that, in the specific implementation, the above-mentioned step S51, step S52 and step S53 are preferably performed in sequence from front to back. Of course, the operation order can also be interchanged in the specific implementation, and there is no limitation on this.

[0117] Furthermore, according to an embodiment of the present invention, the above step S5 further includes:

[0118] S6. Automatically create electronic review documents named after the patient information through the software program, and store and export the patient's oral and oral photos of different parts that are rotated and cropped and have commonly used dental diagnostic auxiliary lines in accordance with oral photography standards.

[0119] Preferably, in the technical solution, in the specific implementation, the electronic review document named after the patient information created in step S6 includes a first target photo placement column, a second target photo placement column, and a third target photo placement column;

[0120] Among them, multiple target photos A are stored in the first target photo placement column; multiple target photos B are stored in the second target photo placement column; target photo A with commonly used dental diagnostic auxiliary lines generated is stored in the third target photo placement column.

[0121] That is to say, in the specific implementation, the 10 rotated and cropped target photos A are stored in the first target photo placement column according to the arrangement requirements, and the 7 rotated and cropped target photos B are stored in the second target photo placement column according to the arrangement requirements. At the same time, the target photo A with the commonly used dental diagnostic auxiliary lines generated is stored in the third target photo placement column according to the arrangement requirements. In this way, the electronic review document named after the patient information is created.

[0122] in, Fig.16 A software program is used to create a display diagram of an electronic review document named after the patient information and the generated multiple target photos A and multiple target photos B are dragged into the first target photo placement column, the second target photo placement column and the third target photo placement column according to arrangement requirements to form the display diagram of the electronic review document.

[0123] Furthermore, through the real-time application of the above-mentioned technical solution, multiple facial and oral photos of the patient from different angles are taken and selected according to the oral photography specifications, and they are rotated and cropped in turn according to the requirements and implementation standards, so that the target photos that meet the requirements can be finally obtained for the dentist's reference, which makes it easier for the dentist to make a perfect diagnosis plan for the patient.

[0124] From the above, it can be concluded that the automatic processing method for dental intraoral and extraoral photos provided by the present application, during specific implementation, the dentist enters the patient information in the software interface, including the patient's name, the time when the patient's corresponding photos were taken, and the diagnosis notes, and manually drags the multiple facial and intraoral photos of the patient taken and selected according to the oral photography specifications into the corresponding photo classification placement column. Then, the software program can be used to automatically rotate the multiple facial and intraoral photos of the patient selected from different angles so that they are all rotated to the correct direction, and then they are all cropped into intraoral and extraoral photos of different parts of the mouth that are proportional in size to the content of the photos in accordance with the oral photography specifications, and finally through The software program automatically generates commonly used dental diagnostic auxiliary lines according to facial and / or oral landmarks and rotation reference lines, and calculates commonly used diagnostic values. The software program also creates an electronic review document named after the patient information, and stores the generated multiple target photos A and target photos B in the electronic review document according to arrangement requirements. The related operations are quick and time-saving, which can greatly shorten the time for dentists to organize relevant information of patients' oral and extraoral photos. All photos are processed in a unified format, which can facilitate comparison of information of the same patient or even different patients in the future, and common export formats can be selected for computer display or printing, so as to facilitate post-production of patient electronic medical records or sharing.

[0125] Furthermore, the present application is indeed highly practical and has good effects. It can effectively solve the problems of time-consuming and labor-intensive processing of oral doctors in organizing relevant information of patients' oral and intraoral photos, which makes the present application have good market promotion value. The present application will be very popular and will surely be widely popularized in the oral departments of major hospitals and major oral medical clinics on the market.

[0126] It should be further added that, in specific implementation, for individual patients, when there are requirements for taking photos inside and outside the mouth from other shooting angles, rotation and cropping, this application can be further upgraded and optimized to meet higher usage requirements.

[0127] Other embodiments and the like are not described here by way of example.

[0128] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0129] The above description is only a preferred embodiment of the present invention, and does not limit the patent scope of the present invention. All equivalent structural changes made by using the contents of the present invention specification and drawings under the inventive concept of the present invention, or directly / indirectly applied in other related technical fields are included in the patent protection scope of the present invention.

Claims

1. A method for automatically processing dental intra-oral and extra-oral photos, characterized in that: The following steps are involved: S1. Take and select multiple facial and oral photos of the patient from different angles according to the oral photography standards; S2. Opening a software interface having a patient information input column and a photo classification placement column, inputting patient information in the patient information input column, and dragging the selected multiple photo classifications into different photo classification placement columns; S3, identifying the facial and / or oral landmarks contained in each type of photo through a software program, automatically generating a rotation reference line, and automatically rotating each type of photo to the correct direction according to the rotation reference line; S4. Using a software program, automatically crop each type of photo that has been rotated to the correct direction according to facial and / or oral landmarks at a certain ratio to generate oral and extraoral photos of the same size and proportion of the content of different parts of the photo that meet the oral photography standards; S5. Automatically generate common dental diagnostic auxiliary lines based on facial and / or oral landmarks and rotation reference lines through a software program, and calculate common diagnostic values; After step S5, the following steps are also included: S6. Automatically create electronic review documents named after the patient information through a software program, and store and export oral and oral photos of different parts of the patient that have been rotated and cropped and have commonly used dental diagnostic auxiliary lines that meet the oral photography standards; The step S3 specifically includes: The software identifies the two pupils of the patient in the selected frontal still photo of the patient, the frontal still photo of the patient facing 45 degrees to the left, the frontal still photo of the patient facing 45 degrees to the right, the frontal smiling photo of the patient, the frontal smiling photo of the patient facing 45 degrees to the left, and the frontal smiling photo of the patient facing 45 degrees to the right, automatically generates a connecting line of the center points of the two pupils, and automatically rotates the selected frontal still photo of the patient, the frontal still photo of the patient facing 45 degrees to the left, the frontal still photo of the patient facing 45 degrees to the right, the frontal smiling photo of the patient, the frontal smiling photo of the patient facing 45 degrees to the left, and the frontal smiling photo of the patient facing 45 degrees to the right until the connecting line of the center points of the two pupils is parallel to the horizontal plane; The software identifies the outer canthus points of the patient's eye sockets and the apex of the auricle in the selected photos of the patient facing left at 90 degrees, the patient facing right at 90 degrees, the patient smiling at 90 degrees, and the patient smiling at 90 degrees, and automatically generates a connecting line between the center points of the outer canthus of the eye sockets and the apex of the auricle, and automatically rotates the selected photos of the patient facing left at 90 degrees, the patient facing right at 90 degrees, the patient smiling at 90 degrees, and the patient smiling at 90 degrees until the connecting line between the center points of the outer canthus of the eye sockets and the apex of the auricle is parallel to the horizontal plane; The software recognizes the dental arch and upper and lower incisors of the patient in the selected frontal occlusal photograph when the cusps are interdigitated, the left buccal occlusal photograph when the cusps are interdigitated, the right buccal occlusal photograph when the cusps are interdigitated, and the right side 90-degree overlay coverage photograph of the anterior teeth area, and automatically generates the horizontal midline of the total contour of the upper and lower dentitions, and automatically rotates the selected frontal occlusal photograph when the cusps are interdigitated, the left buccal occlusal photograph when the cusps are interdigitated, the right buccal occlusal photograph when the cusps are interdigitated, and the right side 90-degree overlay coverage photograph of the anterior teeth area until the horizontal midline of the total contour of the upper and lower dentitions is parallel to the horizontal plane; The software identifies the overall contour of the upper dentition and the mid-palatal suture of the patient in the selected upper dental arch occlusal photo, automatically generates a mid-palatal suture line that divides the overall contour of the upper dentition in half and covers the mid-palatal suture, and automatically rotates the selected upper dental arch occlusal photo of the patient so that the mid-palatal suture line is perpendicular to the horizontal plane; The software identifies the overall contour of the lower dentition and the lingual frenulum of the patient in the selected lower dental arch occlusal photo of the patient, automatically generates a lingual frenulum connection line that divides the overall contour of the lower dentition in half and covers the lingual frenulum, and automatically rotates the selected lower dental arch occlusal photo of the patient so that the lingual frenulum connection line is perpendicular to the horizontal plane; The software identifies the overall contours of the upper and lower dentitions and the attachment points of the upper lip frenulum in the selected frontal, upward 45-degree overlay coverage photograph of the patient's anterior teeth area, automatically generates an upper lip frenulum connection line that divides the overall contour of the upper and lower dentitions in half and covers the attachment points of the upper lip frenulum, and automatically rotates the selected frontal, upward 45-degree overlay coverage photograph of the patient's anterior teeth area so that the upper lip frenulum connection line is perpendicular to the horizontal plane.

2. The method for automatically processing dental intra-oral and extra-oral photos according to claim 1, characterized in that: The step S1 specifically includes: S11. Take multiple photos of the patient's face from different angles and the inside of the oral cavity from different angles according to the oral photography standards; S12. Based on each shooting angle, select a plurality of facial photos of the patient with different shooting angles and a plurality of intraoral photos with different shooting angles.

3. The method for automatically processing dental intra-oral and extra-oral photos according to claim 2, characterized in that: The multiple facial photos with different shooting angles selected in step S1 specifically include: a frontal still photo of the patient, a frontal still photo of the patient facing 45 degrees to the left, a frontal still photo of the patient facing 45 degrees to the right, a frontal still photo of the patient facing 90 degrees to the left, a frontal still photo of the patient facing 90 degrees to the right, a frontal smiling photo of the patient, a frontal smiling photo of the patient facing 45 degrees to the left, a frontal smiling photo of the patient facing 45 degrees to the right, a frontal smiling photo of the patient facing 90 degrees to the left, and a frontal smiling photo of the patient facing 90 degrees to the right; The multiple intraoral photographs with different shooting angles selected in step S1 specifically include: a front occlusal photograph when the cusps are in an interdigitated position, a left buccal occlusal photograph when the cusps are in an interdigitated position, a right buccal occlusal photograph when the cusps are in an interdigitated position, an upper dental arch occlusal photograph, a lower dental arch occlusal photograph, a right side 90-degree overlay photograph of the anterior teeth area, and a front upward 45-degree overlay photograph of the anterior teeth area.

4. The method for automatically processing dental intra-oral and extra-oral photos according to claim 3, characterized in that: The photo classification placement column in step S2 includes a facial photo placement column and an intraoral photo placement column; The selected multiple facial photos with different shooting angles are dragged into the facial photo placement column; the selected multiple intraoral photos with different shooting angles are dragged into the intraoral photo placement column.

5. The method for automatically processing dental intra-oral and extra-oral photos according to claim 1, characterized in that: The step S4 specifically includes: The software identifies the head contours of the patients in the selected front resting photos of the patients, the front resting photos of the patients facing 45 degrees to the left, the front resting photos of the patients facing 45 degrees to the right, the front resting photos of the patients facing 90 degrees to the left, the front resting photos of the patients facing 90 degrees to the right, the front smiling photos of the patients, the front smiling photos of the patients facing 45 degrees to the left, the front smiling photos of the patients facing 45 degrees to the right, the front smiling photos of the patients facing 90 degrees to the left, and the front smiling photos of the patients facing 90 degrees to the right, which are rotated to the correct direction, and automatically crops them according to the proportion of the head contour of the patients occupying three quarters in the vertical direction and the equal remaining space on the left and right sides in the horizontal direction, so as to crop them into the target photo A with the same length and width ratio and the same position of the head of the patients in the middle; The software identifies the patient's upper and lower dental arch contours in the selected front occlusal photograph with cusp interdigitation, left buccal occlusal photograph with cusp interdigitation, right buccal occlusal photograph with cusp interdigitation, upper dental arch occlusal photograph, lower dental arch occlusal photograph, right side 90-degree overlay photograph of the anterior teeth area, and front upward 45-degree overlay photograph of the anterior teeth area that have been rotated to the correct direction, and automatically crops them according to the ratio of the patient's upper and lower dental arch contours occupying four-fifths in the horizontal direction and with equal remaining space in the upper and lower vertical directions, so as to crop them into target photo B with exactly the same length and width ratio and the same position of the patient's upper and lower dental arch contours in the middle.

6. The method for automatically processing dental intra-oral and extra-oral photos according to claim 5, characterized in that: The step S5 specifically includes: The software program performs symmetry analysis on the rotated and cropped frontal resting photo of the patient or the frontal smiling photo of the patient, automatically generates the midpoint of the line connecting the two pupils, and automatically draws a vertical auxiliary line for diagnosis through the midpoint of the line connecting the two pupils; The software program is used to perform a three-court and five-eye analysis on the rotated and cropped frontal resting photos of the patient or the frontal smiling photos of the patient, and the vertical and horizontal cross lines for diagnosis are automatically generated. The generated vertical and horizontal cross lines for diagnosis include the vertical lines of the left and right facial contours, the vertical lines passing through the outer canthus points of the eye sockets, the vertical lines passing through the inner canthus points of the eye sockets, the horizontal lines passing through the top of the hairline, the horizontal lines passing through the midpoints of the left and right eyebrow points, the horizontal lines passing through the lower points of the nose contour, the horizontal lines passing through the midpoints of the left and right corners of the mouth, and the horizontal lines passing through the subchin point, and the spacing ratios between the vertical and horizontal lines are automatically calculated; The software program was used to perform lateral resting aesthetic plane (E-Line) analysis on the rotated and cropped frontal right 90-degree resting photo of the patient, and automatically draw the diagnostic oblique auxiliary line through the nose tip point and the prechin point.

7. The method for automatically processing dental intra-oral and extra-oral photos according to claim 6, characterized in that: In step S6, the created electronic review document named after the patient information includes a first target photo placement column, a second target photo placement column, and a third target photo placement column; A plurality of target photos A are stored in the first target photo placement column; a plurality of target photos B are stored in the second target photo placement column; The target photo A with the dental common diagnosis auxiliary lines generated thereon is stored in the third target photo placement column.

8. The method for automatically processing dental intra-oral and extra-oral photos according to any one of claims 1 to 7, characterized in that: The patient information in step S2 at least includes the patient's name, the time when the patient's corresponding photo was taken, and the diagnosis notes; the electronic review document in step S6 is preferably in JPG format, TIF format, DOC format, PPT format or PDF format.

Images