Panoramic radiograph display method and apparatus

Abstract

Provided in the embodiments of the present invention are a panoramic radiograph display method and apparatus. The method comprises: displaying a display interface which comprises a plurality of view areas, wherein the plurality of view areas comprise a panoramic radiograph view area and an auxiliary view area; on the basis of the operation of a user on a first object in a first view area, determining dental feature data corresponding to the first object, wherein the first view area is either of the panoramic radiograph view area and the auxiliary view area; on the basis of the dental feature data corresponding to the first object, determining a first display mode group corresponding to the first object in the display interface, wherein the first display mode group represents that the plurality of view areas display the first object in respective set dynamic display modes so as to respond to operations; and on the basis of the first display mode group, displaying the first object in a linkage mode in the plurality of view areas of the display interface, wherein different operations on the same object correspond to different display mode groups, and different types of dental feature data correspond to different display mode groups.

Description

Panoramic radiograph display method and device

[0001] Cross-reference to Related Applications

[0002] The present application claims priority to the Chinese patent application No. 202410628504.1, filed on May 20, 2024, and entitled "Panoramic radiograph display method and device", the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0003] The present application relates to the orthodontic technical field, and in particular to a panoramic radiograph display method and device. BACKGROUND

[0004] Oral panoramic radiograph, also known as curved tomogram, is a very important routine treatment examination method in stomatology examination. Based on the collected panoramic radiograph data, the anatomical structure, density and periodontal condition of the teeth can be further understood.

[0005] At present, medical personnel determine the oral problems of patients by analyzing the results based on the panoramic radiograph. The analysis results are usually displayed in the form of pictures. However, since the pictures contain complex content and a large amount of information, the medical personnel need to spend a lot of time comparing multiple pictures to determine the problem teeth and understand the analysis results corresponding to the problem teeth, which leads to low efficiency of the medical personnel in diagnosing the oral problems of patients and certain diagnostic errors.

[0006] In summary, how to quickly and accurately locate the oral problems and quickly assist the doctors to understand the analysis results of the oral problems is a problem to be solved at present. SUMMARY

[0007] The present application provides a panoramic radiograph display method and device to solve the problem that the prior art cannot quickly and accurately locate the oral problems and quickly assist the doctors to understand the analysis results of the oral problems.

[0008] In a first aspect, an embodiment of the present application provides a panoramic film display method, comprising: displaying a display interface comprising a plurality of view areas; the plurality of view areas comprising a panoramic film view area and an auxiliary view area; the auxiliary view area comprising a dentition view area and / or an analysis view area; determining tooth feature data corresponding to a first object based on a user operation on the first object in a first view area; the first view area being any one of the panoramic film view area and the auxiliary view area; determining a first display mode set corresponding to the first object in the display interface according to the tooth feature data corresponding to the first object; the first display mode set representing that the plurality of view areas display the first object in respective set dynamic display modes to respond to the operation; displaying the first object in the plurality of view areas of the display interface based on the first display mode set; wherein different display mode sets correspond to different operations on the same object, and different display mode sets correspond to different types of tooth feature data.

[0009] In the above technical solution, the user operation on the first object in the first view area of the display interface causes the plurality of view areas of the display interface to display the first object in respective set dynamic display modes, so that the user can quickly locate the first object in different view areas, and the first object can be displayed in the plurality of view areas of the same display interface in respective set dynamic display modes.

[0010] Optionally, determining the first display mode set corresponding to the first object in the display interface according to the tooth feature data corresponding to the first object comprises: for any second view area, determining a second object having an identifier in the second view area according to the identifier of the first object; the second view area being any view area other than the first view area in the plurality of view areas; the first object and the second object being the same object in different view areas; determining a dynamic display mode for the second object in the second view area to respond to the operation on the first object according to the tooth feature data corresponding to the first object, thereby obtaining the first display mode set for display in the plurality of view areas.

[0011] In the above technical solution, when the user operates the first object in the first view area of the display interface, the first display mode set for display in the plurality of view areas is generated, so that subsequent dynamic display of the second object in the second view area according to the operation on the first object in the first view area is realized, and the plurality of view areas of the display interface display the first object in linkage.

[0012] Optionally, before displaying the display interface including the plurality of view areas, the method further includes: obtaining a panoramic image based on an analysis operation triggered by the user; identifying the panoramic image to obtain tooth feature data corresponding to each of the plurality of objects in the panoramic image; determining, for each of the plurality of objects, a second display mode set corresponding to the object in the plurality of view areas; wherein the second display mode set indicates that the plurality of view areas display the plurality of objects in respective static display modes; different types of tooth feature data correspond to different static display mode sets; and displaying the display interface including the plurality of view areas includes: displaying the display interface including the plurality of view areas according to the second display mode set corresponding to each of the plurality of objects in the plurality of view areas.

[0013] In the above technical solution, the display interface is generated based on the panoramic image, and the plurality of view areas in the display interface display the objects with tooth analysis information in different dimensions, so that the user can quickly and clearly view the information required by the user in different view areas in the display interface.

[0014] Optionally, the tooth feature data includes tooth analysis information; and displaying the display interface including the plurality of view areas according to the second display mode set corresponding to each of the plurality of objects in the plurality of view areas includes: displaying the objects with tooth analysis information in the panoramic view area in a first marking mode; the first marking mode marks the region of interest of the object, and different tooth analysis information corresponds to different marking modes; displaying the objects with tooth analysis information in the dentition view area in a second marking mode; the second marking mode indicates different tooth analysis information; and displaying the objects with tooth analysis information in the analysis view area in an entry mode.

[0015] Optionally, displaying the objects with tooth analysis information in the panoramic view area in the first marking mode includes: for any object with tooth analysis information, displaying the object in the panoramic view area based on tooth shape information and tooth analysis information in the tooth feature data of the object, in a color indicating the tooth analysis information and a line frame indicating the tooth shape information.

[0016] Optionally, displaying the objects with tooth analysis information in the dentition view area in the second marking mode includes: for any object with tooth analysis information, displaying a mark indicating the tooth analysis information on the tooth corresponding to the tooth number in the dentition view area based on the tooth number and the tooth analysis information in the tooth feature data of the object, and displaying priority information corresponding to the tooth analysis information; the priority information is used to show the degree of attention of the tooth in the treatment process.

[0017] Optionally, the objects with the tooth analysis information are displayed in the analysis view area in the form of entries, including: taking each object with the tooth analysis information as an entry, and recording the tooth number in the tooth feature data, the tooth analysis information, the tooth analysis result, and the priority information corresponding to the tooth analysis information in the form of text in each entry; the priority information is used to show the degree of attention of the tooth in the treatment process; the tooth analysis result is used to represent the treatment reminder of the tooth in the treatment process.

[0018] Optionally, the panoramic image is identified to obtain the tooth feature data corresponding to each object in the panoramic image, including: identifying the tooth region in the panoramic image; identifying the tooth region with the tooth analysis information and the alveolar bone region with the tooth analysis information through a first sub-image corresponding to the tooth region in the panoramic image; and identifying each object with the tooth analysis information through a second sub-image corresponding to each tooth region and alveolar bone region with the tooth analysis information in the panoramic image.

[0019] In the above technical solution, the panoramic image is processed by multiple models to obtain each object with the tooth analysis information in the panoramic image, which facilitates subsequent display of the objects with the tooth analysis information in the panoramic image on the display interface, and facilitates the user to clearly view the shape of each object with the tooth analysis information and the tooth analysis information of the object.

[0020] Optionally, the operation is a selection operation; and the first object is displayed in the multiple view areas of the display interface based on the first display mode group, including: displaying the object in the panoramic view area in a first selected mode and displaying the tooth analysis information corresponding to the object; the first selected mode is: when the object is a tooth, displaying the tooth in a first set color according to the tooth shape information of the object; and when the object is alveolar bone, displaying the alveolar bone in a second set color according to the alveolar bone region of the object; displaying the object in the dentition view area in a second selected mode and displaying the tooth analysis information and the priority information corresponding to the object; the second selected mode is to display the tooth in a third set color; displaying the object in the analysis view area in a third selected mode and displaying the tooth number corresponding to the object, the tooth analysis information corresponding to the object, the tooth analysis result corresponding to the object, and the priority information; and the third selected mode is to display the object in the form of selecting the entry corresponding to the object.

[0021] Optionally, the operation is a tooth analysis information updating operation; each object corresponds to a display area displaying tooth analysis information in the multiple view areas; the display area is provided with an updating operation component; based on the first display mode group, the first object is displayed in linkage in the multiple view areas of the display interface, including: in the panoramic view area, the object is displayed in the first selected mode and the tooth analysis information of the object after updating is displayed; in the dentition view area, the object is displayed in the second selected mode and the tooth analysis information and priority information of the object after updating are displayed; in the analysis view area, the object is displayed in the third selected mode and the tooth analysis information and priority information of the object after updating are displayed.

[0022] Optionally, the panoramic view area displays the tooth numbers of each tooth, and any tooth number is located in the crown area of the corresponding tooth.

[0023] Optionally, the crown area is determined according to the region close to the shortest side of the connecting line from the vertex of the largest triangle in any tooth to the midpoint of the shortest side.

[0024] In a second aspect, the embodiment of the present application provides a panoramic view display device, including: a display unit, configured to display a display interface including multiple view areas; the multiple view areas include a panoramic view area and an auxiliary view area; the auxiliary view area includes a dentition view area and / or an analysis view area; a processing unit, configured to determine tooth feature data corresponding to a first object based on an operation of the first object in a first view area; the first view area is any one of the panoramic view area and the auxiliary view area; determine a first display mode group corresponding to the first object in the display interface according to the tooth feature data corresponding to the first object; the first display mode group represents that the multiple view areas display the first object in respective set dynamic display modes to respond to the operation; based on the first display mode group, the first object is displayed in linkage in the multiple view areas of the display interface; wherein different display mode groups correspond to different operations of the same object, and different display mode groups correspond to different types of tooth feature data.

[0025] Optionally, the processing unit is specifically configured to: for any second view area, determine a second object with an identifier in the second view area according to the identifier of the first object; the second view area is any view area except the first view area in the multiple view areas; the first object and the second object are the same object in different view areas; determine a dynamic display mode for the second object in the second view area to respond to the operation of the first object according to the tooth feature data corresponding to the first object, so as to obtain the first display mode group displayed in the multiple view areas.

[0026] Optionally, the display unit is further configured to: acquire the panoramic film image based on the user triggered analysis operation; identify the panoramic film image to obtain tooth feature data corresponding to each of the plurality of objects in the panoramic film image; determine, for each of the tooth feature data of the objects, a second display mode set corresponding to the object in the plurality of view areas; wherein the second display mode set represents that the plurality of view areas display the plurality of objects in the respective set static display mode; and different types of tooth feature data correspond to different static display mode sets. The display unit is specifically configured to: display the display interface including the plurality of view areas according to the second display mode set corresponding to each of the plurality of objects in the plurality of view areas.

[0027] Optionally, the tooth feature data includes tooth analysis information; and the display unit is specifically configured to: display the object with the tooth analysis information in the panoramic film view area in a first marking mode; the first marking mode marks the region of the object to be concerned and different tooth analysis information corresponds to different marking modes; display the object with the tooth analysis information in the dentition view area in a second marking mode; the second marking mode represents different tooth analysis information; and display the object with the tooth analysis information in the analysis view area in an entry mode.

[0028] Optionally, the display unit is specifically configured to: for any object with tooth analysis information, display the object in the panoramic film view area based on the tooth shape information in the tooth feature data of the object and the tooth analysis information, in a color representing the tooth analysis information and a line box representing the tooth shape information.

[0029] Optionally, the display unit is specifically configured to: for any object with tooth analysis information, display the object in the dentition view area based on the tooth number in the tooth feature data of the object and the tooth analysis information, in a marking representing the tooth analysis information on the tooth corresponding to the tooth number, and display priority information corresponding to the tooth analysis information; the priority information is used to show the degree of concern of the tooth in the treatment process.

[0030] Optionally, the display unit is specifically configured to: take each object with tooth analysis information as an entry, and record the tooth number, tooth analysis information, tooth analysis result and priority information corresponding to the tooth analysis information in the tooth feature data in each entry in a text mode; the priority information is used to show the degree of concern of the tooth in the treatment process; and the tooth analysis result is used to represent the treatment reminder of the tooth in the treatment process.

[0031] Optionally, the display unit is specifically configured to: identify a tooth region from the panoramic film image; identify a tooth region with tooth analysis information and alveolar bone region with tooth analysis information from a first sub-image corresponding to the tooth region in the panoramic film image; and identify each object with tooth analysis information from a second sub-image corresponding to each tooth region with tooth analysis information and alveolar bone region with tooth analysis information in the panoramic film image.

[0032] Optionally, the processing unit is specifically configured to: display the object and the tooth analysis information corresponding to the object in a first selected mode in the panoramic film view area; the first selected mode is: when the object is a tooth, display the tooth in a first set color according to tooth shape information of the object; and when the object is alveolar bone, display the alveolar bone in a second set color according to the alveolar bone region of the object; display the object, the tooth analysis information corresponding to the object, and the priority information in a second selected mode in the dentition view area; the second selected mode is to display the tooth in a third set color; display the object, the tooth number corresponding to the object, the tooth analysis information corresponding to the object, the tooth analysis result corresponding to the object, and the priority information in a third selected mode in the analysis view area; and the second selected mode is to display the corresponding items in a frame selection mode.

[0033] Optionally, the operation is a tooth analysis information updating operation; each object has a display area for displaying tooth analysis information in the plurality of view areas; and the display area is provided with an updating operation component. The processing unit is specifically configured to: display the object and the updated tooth analysis information of the object in a first selected mode in the panoramic film view area; display the object, the updated tooth analysis information of the object, and the priority information in a second selected mode in the dentition view area; and display the object, the updated tooth analysis information of the object, and the priority information in a third selected mode in the analysis view area.

[0034] Optionally, the panoramic film view area displays tooth numbers of each tooth, and any tooth number is located in a crown region of the corresponding tooth.

[0035] Optionally, the crown region is determined according to a region close to a shortest side of a connecting line from a vertex of a largest triangle inside any tooth to a midpoint of the shortest side.

[0036] In a third aspect, an embodiment of the present application further provides a computing device including at least one processor and at least one memory, wherein the memory stores a computer program, and when the program is executed by the processor, the processor executes the panoramic film display method in the first aspect.

[0037] In a fourth aspect, an embodiment of the present application provides a computer readable storage medium storing a computer program executable by a computer device, and when the program is executed on the computer device, the computer device is enabled to perform the panoramic image display method in the first aspect.

[0038] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes a computer program stored on a computer readable storage medium, and the computer program includes program instructions, and when the program instructions are executed by a computer device, the computer device is enabled to perform the steps of any of the panoramic image display methods in the first aspect. BRIEF DESCRIPTION OF DRAWINGS

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly introduced as follows. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without any creative effort on the basis of these drawings.

[0040] FIG. 1 is a schematic diagram of a panoramic image according to an embodiment of the present application;

[0041] FIG. 2 is a flowchart of a panoramic image display method according to an embodiment of the present application;

[0042] FIG. 3 is a schematic diagram of the position of a tooth number according to an embodiment of the present application;

[0043] FIG. 4 is a flowchart of a method for generating a display interface according to an embodiment of the present application;

[0044] FIG. 5 is a flowchart of a method for determining the dental analysis information of an object in a panoramic image according to an embodiment of the present application;

[0045] FIG. 6 is a schematic diagram of a mask image according to an embodiment of the present application;

[0046] FIG. 7 is a schematic diagram of a display interface including a plurality of view areas according to an embodiment of the present application;

[0047] FIG. 8 is a flowchart of a method for determining a first display mode set corresponding to a first object in a display interface according to an embodiment of the present application;

[0048] FIG. 9 is a schematic diagram of a dentition view area according to an embodiment of the present application;

[0049] FIG. 10 is a schematic diagram of a display interface for selecting a plurality of objects according to an embodiment of the present application;

[0050] FIG. 11 is a schematic diagram of a display interface according to an embodiment of the present application;

[0051] Fig. 12 is a schematic diagram of another display interface provided by an embodiment of the present application;

[0052] Fig. 13 is a schematic diagram of an updating operation component of a panoramic view area provided by an embodiment of the present application;

[0053] Fig. 14 is a schematic diagram of an updating operation component of a dentition view area provided by an embodiment of the present application;

[0054] Fig. 15 is a schematic diagram of an updating operation component of an analysis view area provided by an embodiment of the present application;

[0055] Fig. 16 is a schematic diagram of a panoramic view area provided by an embodiment of the present application;

[0056] Fig. 17 is a schematic diagram of a structure of a panoramic view display device provided by an embodiment of the present application;

[0057] Fig. 18 is a schematic diagram of a structure of a computing device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0058] In order to make the objects, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all the embodiments. Based on the embodiments of the present application, all the other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present application.

[0059] With the continuous development of economy, people pay more and more attention to oral problems. There are many ways to treat oral problems at present. For example, when the oral problem is wisdom tooth, in one possible scenario, when the patient goes to the hospital to treat the wisdom tooth, if the patient is the first visit, the doctor will first let the patient take an oral panoramic radiograph, and the role of taking the oral panoramic radiograph is to make the doctor view the patient's oral problem more clearly. The doctor will diagnose the patient according to the patient's oral panoramic radiograph. See Fig. 1.

[0060] Currently, there are more and more types of oral problems. For example, if the oral problem is that there are multiple wisdom teeth in the oral cavity, the doctor needs to determine the treatment mode of the patient to remove the wisdom teeth according to the oral panoramic film of the patient. If the oral problem is that the teeth are not arranged in an orderly manner, the doctor needs to determine the treatment mode of the patient to correct the teeth according to the oral panoramic film of the patient. It should be noted that in the process of correction, the doctor needs to customize the corresponding tooth corrector for the patient according to the tooth problem, periodontal problem or other oral problem in the oral condition of the patient. Therefore, before the doctor needs to formulate the treatment mode of the oral problem for the patient, the doctor needs to comprehensively analyze and understand the oral problem of the patient, and currently the oral problem of the patient is generally understood by viewing the oral panoramic film of the patient.

[0061] In a possible case, the doctor can diagnose the oral problem of the patient through a panoramic film analysis tool. The panoramic film analysis tool includes a panoramic film image, a dentition image and a problem analysis image. The display of the panoramic film analysis tool is usually static. When the doctor analyzes the oral problem of the patient, the doctor needs to compare the above three images by switching the three images on the interface multiple times, so as to realize that the oral problems in multiple images correspond to each other, and the doctor can locate the oral problem and understand the influencing factors corresponding to the oral problem. However, such a panoramic film analysis tool lacks subjective operability, the doctor cannot quickly locate the oral problem needed to be concerned in multiple images, and therefore the doctor cannot quickly understand the influencing factors corresponding to the oral problem, which leads to low work efficiency of the doctor and certain diagnosis errors.

[0062] In summary, the panoramic film display method provided in the embodiments of the present application solves the problem that the doctor cannot quickly locate the oral problem needed to be concerned in multiple images, and therefore the doctor cannot quickly understand the influencing factors corresponding to the oral problem.

[0063] As shown in FIG. 2, a panoramic film display method flowchart provided by the embodiments of the present application is shown, and the method includes the following steps:

[0064] Step 201, a display interface including multiple view areas is displayed.

[0065] In the embodiments of the present application, the display interface includes multiple view areas. The multiple view areas include a panoramic film view area and an auxiliary view area. The auxiliary view area includes a dentition view area and / or an analysis view area. In a possible case, the display interface includes the panoramic film view area and the dentition view area, in another possible case, the display interface includes the panoramic film view area and the analysis view area, and in still another possible case, the display interface includes the panoramic film view area, the dentition view area and the analysis view area. In order to facilitate understanding of the present scheme, the display interface including the panoramic film view area, the dentition view area and the analysis view area is introduced below, but it is not limited thereto.

[0066] In step 202, the tooth feature data corresponding to the first object is determined based on the operation of the user on the first object in the first view area.

[0067] In the embodiment of the present application, the operation of the user on the first object in the first view area can be a selection operation, an operation of staying in the area where the first object is located in the first view area for more than a set threshold, or other operations, which are not limited herein. In order to facilitate the understanding of the present solution, the operation is taken as a selection operation in the following description. When the user performs a selection operation on the first object in the first view area, the tooth feature data corresponding to the first object can be determined, which is used to display in the plurality of view areas in the display interface. The first view area is any one of the panoramic view area and the auxiliary view area.

[0068] In step 203, the first display mode set corresponding to the first object in the display interface is determined according to the tooth feature data corresponding to the first object.

[0069] In the embodiment of the present application, the first display mode set corresponding to the first object in the display interface can be determined according to the tooth feature data corresponding to the first object, which represents that the plurality of view areas display the first object in the respective set dynamic display mode to respond to the operation of the user on the first object in the first view area.

[0070] In step 204, the first object is displayed in the plurality of view areas in the display interface based on the first display mode set.

[0071] In the embodiment of the present application, the first object is displayed in the plurality of view areas in the display interface based on the first display mode set, so that the plurality of view areas in the display interface display the first object in the respective set dynamic display mode.

[0072] As can be seen from the above steps 201 to 204, according to the operation of the user on the first object in the first view area in the display interface, the first object is displayed in the plurality of view areas in the display interface in the respective set dynamic display mode, so that the user can quickly locate the first object in different view areas, and the first object can be displayed in the respective set dynamic display mode in the plurality of view areas in the same display interface.

[0073] Optionally, the positions of the panoramic view area and the auxiliary view area in the display interface are fixed.

[0074] Optionally, the user can perform an operation in the display interface to move, enlarge and / or reduce the panoramic view area and the auxiliary view area.

[0075] Optionally, the tooth number of each tooth is displayed in the panoramic view area. Since the shapes of the teeth in the panoramic image are various, such as differently shaped roots and missing teeth, if the tooth number is located in the middle part of the entire tooth, the tooth number may block the area of the tooth to be concerned. The crown occupies a large proportion of the tooth. In the panoramic view area, any tooth number is located in the crown area of the corresponding tooth. The crown area is determined according to the area close to the shortest side on the line from the vertex of the largest triangle in the tooth to the midpoint of the shortest side. For example, the position of the tooth number is determined as the position close to 1 / 5 of the shortest side on the line from the vertex of the largest triangle in the tooth to the midpoint of the shortest side, which can be seen in FIG. 3. In FIG. 3, the display of the tooth number in the panoramic view area can be seen.

[0076] Optionally, the tooth number of each tooth can be displayed or hidden in the panoramic view area. In order to introduce the present scheme, the tooth number of each tooth is hidden in the panoramic view area in the following schematic diagram to explain the present scheme, but it is not limited.

[0077] For example, when a patient goes to hospital A for treatment due to oral problems, the patient is treated in hospital A for the first time, therefore, the doctor will first ask the patient to take an oral panoramic image, and then the doctor will subsequently display a display interface including a plurality of view areas on a display device of the doctor according to the oral panoramic image of the patient, wherein the display device of the doctor can be a computer, a tablet, a mobile phone or the like, which is not limited herein. In order to better understand the present scheme, how to generate a display interface is introduced as follows.

[0078] As shown in FIG. 4, a method flowchart for generating a display interface provided by an embodiment of the present application includes the following steps:

[0079] Step 401: based on an analysis operation triggered by a user, an oral panoramic image is acquired.

[0080] In an embodiment of the present application, for example, when a patient goes to hospital A for treatment for the first time, the patient needs to take an oral panoramic image, and then the doctor triggers an analysis operation on a terminal to acquire the oral panoramic image taken by the patient, wherein the terminal can be a computer, a mobile phone, a tablet or the like, which is not limited herein.

[0081] Step 402: the oral panoramic image is recognized to obtain tooth feature data corresponding to a plurality of objects in the oral panoramic image.

[0082] In the embodiment of the present application, the panoramic image is identified to obtain the tooth feature data corresponding to the plurality of objects in the panoramic image, so that the plurality of objects in the panoramic image are displayed in the plurality of view areas of the display interface according to the tooth feature data corresponding to the plurality of objects in the panoramic image. Since the tooth feature data required for display in the plurality of view areas of the display interface is obtained from the panoramic image, the data is unified, and the same object can be clearly viewed in different view areas when displayed on the display interface. The tooth feature data corresponding to the plurality of objects in the panoramic image includes tooth analysis information, and a method for determining the tooth analysis information of the object in the panoramic image is introduced below to introduce how to determine the tooth analysis information of the object in the panoramic image.

[0083] As shown in FIG. 5, it is a flow chart of a method for determining the tooth analysis information of the object in the panoramic image provided by the embodiment of the present application, which includes the following steps:

[0084] Step 501: Identify the tooth region from the panoramic image.

[0085] In the embodiment of the present application, the panoramic image is input into the global tooth segmentation model based on the deep neural network to obtain the mask image of all teeth, which can be referred to FIG. 6. The global tooth segmentation model based on the deep neural network is a fully convolutional deep neural network, the input is the panoramic image, and the output is the mask image. The white part in the mask image represents the tooth, and the black part represents the background. The fully convolutional deep neural network can be a general medical image segmentation network, such as UNet, Atten-UNet, UNet++, etc., which is not limited herein.

[0086] After obtaining the mask image of all teeth, the mask image needs to be cropped to obtain the tooth region. Specifically, according to the mask image, the vertex coordinate values of the minimum rectangular frame containing all teeth in the mask image are determined, wherein the minimum rectangular frame containing all teeth is the green rectangular frame in FIG. 6. However, only the tooth part is contained in the minimum rectangular frame, which is not conducive to subsequent image processing, and the minimum rectangular frame containing all teeth needs to be expanded so that the expanded rectangular frame can cover part of the image of the area around the tooth. The image in which the expanded rectangular frame is located is the tooth region, wherein the tooth region is the area in the red rectangular frame in FIG. 6. For example, according to the mask image, the vertex coordinate values of the minimum rectangular frame containing all teeth in the mask image are determined, x1, y1, x2, y2, which are the green rectangular frame in FIG. 6, wherein (x1, y1) is the x-axis and y-axis coordinate values of the top left vertex of the rectangular frame, and (x2, y2) is the x-axis and y-axis coordinate values of the bottom right vertex of the rectangular frame. The rectangular frame is expanded so that the rectangular frame covers part of the image of the area around the tooth. The left top vertex coordinate values of the expanded rectangular frame are (x1-margin_x, y1-margin_y), and the bottom right vertex coordinate values are (x2+margin_x, y2+margin_y), which are the red rectangular frame in FIG. 6, wherein margin_x and margin_y are the sizes of the expanded regions in the x-axis and y-axis, for example, margin_x=0.1×(x2-x1), margin_y=0.2×(y2-y1), or the values of margin_x and margin_y can be determined according to the actual situation, which are not limited herein.

[0087] In step 502, the tooth region with tooth analysis information and the alveolar bone region with tooth analysis information are identified from the first sub-image corresponding to the panoramic image in the tooth region.

[0088] In the embodiment of the present application, in a possible case, if tooth A and tooth B are both teeth with tooth analysis information, and there is an overlapping area between tooth A and the position next to tooth B in the panoramic image, if the object with tooth analysis information is directly identified according to the panoramic image, the identification result obtained is that the overlapping part between tooth A and tooth B is a whole, and the edge between tooth A and tooth B cannot be obtained. Therefore, first, all tooth regions with tooth analysis information and alveolar bone regions with tooth analysis information in the panoramic image need to be determined, and then the object with tooth analysis information is framed from the panoramic image according to the tooth region with tooth analysis information and the alveolar bone region with tooth analysis information. How to determine all tooth regions with tooth analysis information and alveolar bone regions with tooth analysis information in the panoramic image is introduced below.

[0089] Since the tooth with tooth analysis information and the alveolar bone with tooth analysis information can be regular shape or irregular shape, it is necessary to first frame each tooth region with tooth analysis information and alveolar bone region with tooth analysis information by a rectangular frame to obtain all tooth regions with tooth analysis information and alveolar bone regions with tooth analysis information in the panoramic image.

[0090] According to the coordinate value of the tooth region, a first sub-image is cropped from the panoramic image. The first sub-image is input into a tooth detection model based on a deep neural network. The output is the coordinate value of the tooth to be concerned and the tooth analysis information corresponding to the tooth to be concerned, and the coordinate value of the alveolar bone to be concerned and the tooth analysis information corresponding to the alveolar bone to be concerned. The tooth detection model based on the deep neural network can use a general target detection network, such as Faster-RCNN, YOLO, RetinaNet, etc., which is not limited here. According to the coordinate value of the tooth to be concerned, the rectangular frame of the tooth to be concerned is obtained. According to the coordinate value of the alveolar bone to be concerned, the rectangular frame of the alveolar bone to be concerned is obtained. After obtaining the rectangular frame of the tooth to be concerned and the rectangular frame of the alveolar bone to be concerned, the rectangular frame is expanded.

[0091] Specifically, since the expansion mode of the rectangular frame of the tooth to be concerned and the rectangular frame of the alveolar bone to be concerned is the same, the expansion mode will be introduced below by taking the expansion of the rectangular frame of the tooth to be concerned as an example. For example, if (x1, y1) in the coordinate value of the rectangular frame of the tooth to be concerned is the x-axis and y-axis coordinate value of the top left corner of the rectangular frame, and (x2, y2) is the x-axis and y-axis coordinate value of the top right corner of the rectangular frame. The coordinate value of the top left corner of the expanded rectangular frame is (x1-margin_x, y1-margin_y), and the coordinate value of the bottom right corner is (x2+margin_x, y2+margin_y), where margin_x and margin_y are the sizes of the expansion region of the x-axis and y-axis, for example, margin_x=0.2×(x2-x1), margin_y=0.2×(y2-y1), margin_x and margin_y can also be determined according to specific circumstances, which are not limited here.

[0092] According to the coordinate value of the expanded rectangular frame of the tooth to be concerned and the tooth analysis information corresponding to the tooth to be concerned, the tooth region with tooth analysis information is determined. Similarly, according to the coordinate value of the expanded rectangular frame of the alveolar bone to be concerned and the tooth analysis information corresponding to the alveolar bone to be concerned, the alveolar bone region with tooth analysis information is determined.

[0093] Step 503, through the corresponding second sub-image of each tooth region with tooth analysis information and alveolar bone region with tooth analysis information in the panoramic image, each object with tooth analysis information is identified.

[0094] In the embodiment of the present application, a plurality of second subgraphs are cropped from the panoramic image according to the coordinate values in each tooth region with tooth analysis information and the coordinate values in the alveolar bone region with tooth analysis information. Since the tooth with tooth analysis information and the alveolar bone with tooth analysis information can be regular shapes or irregular shapes, each second subgraph is input into a local tooth segmentation model based on a deep neural network, and each object with tooth analysis information is output, so as to determine the specific shape of each object with tooth analysis information in the panoramic image. The object with tooth analysis information is the tooth with tooth analysis information or the alveolar bone with tooth analysis information, and the local tooth segmentation model based on the deep neural network is a full convolution deep neural network. The full convolution deep neural network can be a general medical image segmentation network such as UNet, Atten-UNet, UNet++, etc., which is not limited herein.

[0095] As can be seen from the above steps 501 to 503, the panoramic image is processed by a plurality of models to obtain each object with tooth analysis information in the panoramic image, which facilitates subsequent display of the object with tooth analysis information in the panoramic image on the display interface, and facilitates the user to view the shape of each object with tooth analysis information and the tooth analysis information of the object more intuitively and clearly.

[0096] In step 403, for the tooth feature data of each object, a second display mode group corresponding to the object in each view region is determined.

[0097] In the embodiment of the present application, for example, if the display interface includes a panoramic view region, a dentition view region and an analysis view region, if the panoramic image is recognized, three objects in the panoramic image are obtained, wherein the three objects correspond to A1, B1 and C1 in the panoramic view region, A2, B2 and C2 in the dentition view region, and A3, B3 and C3 in the analysis view region, respectively. A1, A2 and A3 are the same object in different view regions. B1, B2 and B3 are the same object in different view regions. C1, C2 and C3 are the same object in different view regions. It can be understood that for the tooth feature data of each object, a second display mode group corresponding to the object in each view region can be determined, wherein the second display mode group represents that the plurality of view regions display a plurality of objects in a respective set static display mode. Different static display mode groups correspond to different types of tooth feature data.

[0098] In step 404, the display interface including the plurality of view areas is displayed according to the second display mode set corresponding to the plurality of objects in the plurality of view areas.

[0099] In the embodiment of the present application, as shown in FIG. 7, a schematic diagram of the display interface including the plurality of view areas is shown. If the display interface includes a panoramic view area, a dentition view area and an analysis view area, in the plurality of view areas in the display interface, each view area displays the plurality of objects with dental analysis information according to the second display mode set. For example, object A in any one view area also has object B and object C in the other two view areas, wherein object A, object B and object C are the same object. In the panoramic view area in the display interface, the objects with dental analysis information are displayed in the panoramic view area according to the second display mode set. The first marking mode marks the region of the object to be concerned and the marking mode is different for different dental analysis information. Specifically, for any object with dental analysis information, the object is displayed in the panoramic view area according to the color representing the dental analysis information and the line frame representing the tooth shape information based on the tooth shape information and the dental analysis information in the tooth feature data of the object. For example, the first marking mode can be to frame the region of the object to be concerned with a line frame according to the tooth shape information of the object, wherein the line frame can be a regular line frame or an irregular line frame, which is not limited herein. Different colors are used to frame the objects corresponding to different dental analysis information, so that the objects corresponding to different dental analysis information can be distinguished according to the color, and the objects corresponding to the same dental analysis information can also be determined according to the color. For example, if the objects in the panoramic view area are classified according to the dental analysis information, they can be divided into four types, namely caries, wisdom tooth, filling and apical high density shadow. The caries is framed with an orange line frame, the wisdom tooth is framed with a blue irregular line frame, the filling is framed with a pink line frame, and the apical high density shadow is framed with a blue regular line frame.

[0100] displaying the object with the tooth analysis information in the second marking manner in the dentition view area, wherein the second marking manner is used to represent different tooth analysis information. Specifically, for any object with tooth analysis information, based on the tooth number in the tooth feature data of the object and the tooth analysis information, a mark representing the tooth analysis information is displayed on the tooth corresponding to the tooth number in the dentition view area, and priority information corresponding to the tooth analysis information is displayed; the priority information is used to show the degree of attention of the tooth in the treatment process. For example, if the tooth number in the tooth feature data of the object is 14, the tooth analysis information is wisdom tooth, and the priority of the wisdom tooth is higher, then the 14th tooth is framed with a line in the dentition view area, and an exclamation mark is displayed on the 14th tooth in the dentition view area to display the priority information of the wisdom tooth.

[0101] displaying the object with the tooth analysis information in the analysis view area in the form of entries. Specifically, each object with tooth analysis information is taken as an entry, and the tooth number in the tooth feature data, the tooth analysis information, the tooth analysis result, and the priority information corresponding to the tooth analysis information are recorded in each entry in the form of text; the priority information is used to show the degree of attention of the tooth in the treatment process; and the tooth analysis result is used to represent the treatment reminder of the tooth in the treatment process. For example, if a patient needs to wear a corrector to correct teeth in a hospital, the object with tooth analysis information in the analysis view area in the display interface is the filled object A and the caries object B. The tooth analysis information of the object A is filling, and the tooth analysis information of the object B is caries. The object A is taken as an entry in the analysis view area, and the tooth number 22 of the object A, the filling, the tooth analysis result 22 filling, and the possible influence on the adhesion effect of the accessory are recorded in the entry in the form of text. It should be noted that the priority of the filling is low, so the priority information will not be displayed in the entry in the analysis view area. The object B is taken as another entry in the analysis view area, and the tooth number 26 of the object B, the caries, the exclamation mark beside the caries, the tooth analysis result 26 caries, the possible influence on the tooth movement / accessory adhesion, the treatment of the caries before correction to avoid the aggravation of the caries and the occurrence of problems such as pulp necrosis, and the like are recorded in the entry in the form of text.

[0102] As can be seen from the above steps 401 to 404, by generating a display interface according to the panoramic image, the object with tooth analysis information is displayed in different view areas through different dimensions, so that the user can quickly and clearly view the information required by the user in different view areas in the display interface.

[0103] For the convenience of understanding the present scheme, the following takes the treatment of making a dental appliance for a patient as an example to introduce the present scheme, but does not limit the treatment mode.

[0104] The above describes that the display interface including the plurality of view areas is displayed according to the second display mode group corresponding to the plurality of objects in the plurality of view areas when the user does not perform any operation on the display interface, and the following introduces how the display interface is displayed when the user performs an operation on any object in the display interface.

[0105] In the embodiment of the present application, for step 203, the following introduces how to determine the first display mode group corresponding to the first object in the display interface.

[0106] As shown in FIG. 8, it is a flow chart of a method for determining the first display mode group corresponding to the first object in the display interface provided by the embodiment of the present application, and the method includes the following steps:

[0107] Step 801, for any second view area, according to the identification of the first object, the second object with the identification in the second view area is determined.

[0108] In the embodiment of the present application, since there are the same objects corresponding in different view areas, for any second view area, according to the identification of the first object, the second object with the identification in the second view area can be determined, wherein the second view area is any view area in the plurality of view areas except the first view area. The first object and the second object are the same object in different view areas.

[0109] Step 802, according to the dental feature data corresponding to the first object, the dynamic display mode for the second object in the second view area in response to the operation on the first object is determined, so as to obtain the first display mode group displayed in the plurality of view areas.

[0110] In the embodiment of the present application, according to the dental feature data corresponding to the first object, the dynamic display mode for the second object in the second view area in response to the operation on the first object is determined, so as to obtain the first display mode group displayed in the plurality of view areas.

[0111] It can be seen from the above steps 801 to 802 that when the user performs an operation on the first object in the first view area of the display interface, the first display mode group displayed in the plurality of view areas is generated, so as to realize that not only the first view area dynamically displays the first object according to the operation, but also the second view area dynamically displays the second object according to the operation, and further realizes the linkage display of the plurality of view areas in the display interface for the first object.

[0112] In the embodiment of the present application, if the operation is a selection operation, the first object is displayed in the multiple view areas of the display interface based on the first display mode group. Specifically, in the panoramic view area, the object is displayed in a first selected mode and the dental analysis information corresponding to the object is displayed. The first selected mode is that when the object is a tooth, the tooth is displayed in a first set color according to the tooth shape information of the object. For example, if the dental analysis information of the first object is a caries, the line frame of the caries is filled with blue color to display the caries, and the dental analysis information corresponding to the first object is displayed beside the blue filled area. When the object is alveolar bone, the alveolar bone is displayed in a second set color according to the alveolar bone area of the object. For example, if the dental analysis information of the first object is an apical high-density shadow, the line frame of the apical high-density shadow is displayed in a color that is deepened to display the first object, and the dental analysis information corresponding to the first object is displayed beside the line frame of the apical high-density shadow that is deepened.

[0113] In the dentition view area, the object is displayed in a second selected mode and the dental analysis information and priority information corresponding to the object are displayed. The second selected mode is that the tooth is displayed in a third set color. For example, if the dental analysis information of the first object is a wisdom tooth and the tooth number of the first object is 18, the color of the line frame of the tooth with tooth number 18 in the dentition area in the dentition view area is deepened, an exclamation mark is displayed on the tooth with tooth number 18 in the dentition area to display the priority information corresponding to the wisdom tooth, and the tooth number 18 of the first object, wisdom tooth, is displayed in the entry in the dentition view area. See FIG. 9.

[0114] In the analysis view area, the object is displayed in a third selected mode and the tooth number corresponding to the object, the dental analysis information corresponding to the object, the dental analysis result corresponding to the object, and the priority information are displayed. The second selected mode is that the object corresponding entry is displayed in a frame. For example, if the dental analysis information of the first object is filling and the tooth number of the first object is 22, the entry corresponding to the first object is framed with a blue line frame in the analysis view area. The entry records the tooth number 22 of the first object, filling, and the dental analysis result of the first object as possibly affecting the adhesion effect of the attachment in text form. Since the priority of the first object is low, the priority information of the first object will not be displayed in the entry corresponding to the first object in the analysis view area. It should be noted that when the dental analysis information of the first object is a wisdom tooth, an embedded tooth, an impacted tooth, and a missing tooth, the entry corresponding to the first object is framed with a blue line frame in the analysis view area for the same reason as the above example.

[0115] For example, if the tooth analysis information of the first object is apical high density shadow, and there is no corresponding tooth number, the first object corresponding entry is framed by a blue line box in the analysis view area, the entry records the apical high density shadow in text form, and a exclamation mark is displayed beside the apical high density shadow, wherein the exclamation mark is used to represent the priority information of the first object and the tooth analysis result of the object is apical high density shadow, please pay attention to whether it affects tooth movement.

[0116] Optionally, the user can perform multiple selection operations in the first view area, and the corresponding multiple selected objects are displayed in multiple view areas in the display interface in the manner of the first display group. For example, the user selects two entries in the analysis view area, entry 1 records tooth number 28, wisdom tooth, 28 exists, and may affect tooth movement. Entry 2 records tooth number 42, RCT, there is an exclamation mark beside RCT, 42 root canal treatment, please confirm whether it affects the movement effect, and the corresponding tooth number 28 tooth and tooth number 42 tooth are displayed in the panoramic view and the dentition view. Please refer to FIG. 10.

[0117] For example, the user performs a selection operation on the first object in the analysis view area, and the tooth analysis information of the first object is wisdom tooth. The first object corresponding entry is framed by a blue line box, the entry records the tooth number 18 of the first object, wisdom tooth, and an exclamation mark is displayed beside the wisdom tooth, and the tooth analysis result of the first object is that it may affect tooth movement. Correspondingly, in the panoramic view area, the wisdom tooth is highlighted by blue line box to display the wisdom tooth, and the tooth analysis information corresponding to the first object is displayed beside the blue filled area. Correspondingly, in the dentition area in the dentition view area, the color of the line box of the tooth with tooth number 18 is deepened, an exclamation mark is displayed on the tooth number 18 tooth in the dentition area to display the priority information of the wisdom tooth, and the tooth number 18 of the first object and wisdom tooth are displayed in the entry in the dentition view area. Please refer to FIG. 11.

[0118] For example, if the user performs a selection operation on the first object in the panoramic view area, the tooth analysis information of the first object is wisdom tooth, and the tooth number of the first object is 18. The wisdom tooth is highlighted by blue line box to display the wisdom tooth, and the tooth analysis information corresponding to the first object is displayed beside the blue filled area. Correspondingly, in the dentition area in the dentition view area, the color of the line box of the tooth with tooth number 18 is deepened, an exclamation mark is displayed on the tooth number 18 tooth in the dentition area to display the priority information of the wisdom tooth, and the tooth number 18 of the first object and wisdom tooth are displayed in the entry in the dentition view area. Correspondingly, in the analysis view area, the first object corresponding entry is framed by a blue line box, the entry records the tooth number 18 of the first object, wisdom tooth, and an exclamation mark is displayed beside the wisdom tooth, and the tooth analysis result of the first object is that it may affect tooth movement.

[0119] For example, if the user performs a selection operation on a first object in the analysis view area, the tooth analysis information of the first object is a root shadow, and the first object is surrounded by a blue line frame, the item corresponding to the first object is recorded in text form, and an exclamation mark is displayed beside the root shadow. The tooth analysis result of the first object is a high-density shadow, and attention should be paid to whether it affects tooth movement. Correspondingly, since the root shadow is not a tooth, the dentition view area will not change. Correspondingly, in the panoramic view area, the root shadow is displayed by a line frame that darkens the root shadow, and the tooth analysis information corresponding to the first object is displayed beside the blue line frame. See FIG. 12.

[0120] For example, if the user performs a selection operation on a first object in the analysis view area, the tooth analysis information of the first object is a root shadow, and the first object is surrounded by a blue line frame, the item corresponding to the first object is recorded in text form, and an exclamation mark is displayed beside the root shadow. The tooth analysis result of the first object is a high-density shadow, and attention should be paid to whether it affects tooth movement. Correspondingly, since the root shadow is not a tooth, the dentition view area will not change. Correspondingly, in the analysis view area, the first object is surrounded by a blue line frame, the item corresponding to the first object is recorded in text form, and an exclamation mark is displayed beside the root shadow. The tooth analysis result of the first object is a high-density shadow, and attention should be paid to whether it affects tooth movement. It should be noted that the above is described by taking the user's selection operation in the panoramic view area as an example. Similarly, the user's selection operation in the dentition view area or the analysis view area has the same display as the above example, and will not be described here. It should be noted that the dentition view area cannot select objects such as root high-density shadows in the alveolar bone.

[0121] Optionally, when the operation of the user in the first view area is a tooth analysis information updating operation, each object has a display area displaying tooth analysis information in the multiple view areas; the display area is provided with an updating operation component. The updating operation can be an operation for adding, deleting or modifying the tooth analysis information of the object, or other updating operations, which are not limited herein. Since each object has an updating operation component in the multiple view areas, the second view area is also updated synchronously when the updating operation is performed in the first view area. Specifically, in the panoramic view area, the object is displayed in the first selected mode and the tooth analysis information of the object after updating is displayed. For example, if the user selects the updating operation component of tooth No. 22 in the panoramic view area, refer to FIG. 13. After the updating operation component is selected, the updating operation component in the panoramic view area displays a first window, and the first window includes various types of tooth analysis information to be selected. When the user selects the wisdom tooth, the tooth analysis information of tooth No. 22 is the wisdom tooth, and in the dentition view area, the tooth analysis information of tooth No. 22 is the wisdom tooth, and in the analysis view area, the tooth analysis information of tooth No. 22 is the wisdom tooth.

[0122] In the dentition view area, the object is displayed in the second selected mode and the tooth analysis information and priority information of the object after updating are displayed. The updating operation in the dentition view area is the same as that in the panoramic view area, which is not repeated herein. The updating operation component in the dentition view area can be referred to FIG. 14.

[0123] In the analysis view area, the object is displayed in the third selected mode and the tooth analysis information and priority information of the object after updating are displayed. The updating operation component in the analysis view area can be referred to FIG. 15.

[0124] Optionally, the outlines of all teeth can be displayed in the panoramic view area, refer to FIG. 16. The outlines of the teeth can be displayed or hidden, and the above scheme is introduced by taking the outlines of the teeth as an example.

[0125] Based on the same technical concept, the embodiment of the present application provides a panoramic film display device, as shown in FIG. 17, which comprises: a display unit 1701 configured to display a display interface comprising a plurality of view areas; the plurality of view areas comprise a panoramic film view area and an auxiliary view area; the auxiliary view area comprises a dentition view area and / or an analysis view area; and a processing unit 1702 configured to determine tooth feature data corresponding to a first object based on a user operation on the first object in a first view area; the first view area is any one of the panoramic film view area and the auxiliary view area; determine a first display mode set corresponding to the first object in the display interface according to the tooth feature data corresponding to the first object; the first display mode set represents that the plurality of view areas display the first object in a respective set dynamic display mode in response to the operation; and display the first object in the plurality of view areas of the display interface based on the first display mode set; wherein different display mode sets correspond to different operations on the same object, and different display mode sets correspond to different types of tooth feature data.

[0126] Optionally, the processing unit 1702 is specifically configured to: for any second view area, determine a second object with an identifier in the second view area according to the identifier of the first object; the second view area is any view area other than the first view area in the plurality of view areas; the first object and the second object are the same object in different view areas; and determine a dynamic display mode for the second object in the second view area in response to the operation on the first object according to the tooth feature data corresponding to the first object, thereby obtaining the first display mode set for display in the plurality of view areas.

[0127] Optionally, the display unit 1701 is further configured to: obtain a panoramic film image based on a user triggered analysis operation; identify the panoramic film image to obtain tooth feature data corresponding to a plurality of objects in the panoramic film image; determine a second display mode set corresponding to the plurality of objects in the plurality of view areas for the tooth feature data of each object; wherein the second display mode set represents that the plurality of view areas display the plurality of objects in a respective set static display mode; and different static display mode sets correspond to different types of tooth feature data. The display unit 1701 is specifically configured to display the display interface comprising the plurality of view areas according to the second display mode set corresponding to the plurality of objects in the plurality of view areas.

[0128] Optionally, the tooth feature data comprises tooth analysis information; and the display unit 1701 is specifically configured to: display the object with the tooth analysis information in the panoramic view area in a first marking manner; the first marking manner marks a region of the object to be focused on, and different tooth analysis information corresponds to different marking manners; display the object with the tooth analysis information in the dentition view area in a second marking manner; the second marking manner represents different tooth analysis information; and display the object with the tooth analysis information in the analysis view area in an entry manner.

[0129] Optionally, the display unit 1701 is specifically configured to: for any object with tooth analysis information, display the object in the panoramic view area based on tooth shape information in tooth feature data of the object and the tooth analysis information, in a color representing the tooth analysis information and a line box representing the tooth shape information.

[0130] Optionally, the display unit 1701 is specifically configured to: for any object with tooth analysis information, display a mark representing the tooth analysis information on a tooth corresponding to a tooth number in the dentition view area based on the tooth number in tooth feature data of the object and the tooth analysis information, and display priority information corresponding to the tooth analysis information; the priority information is used to show a degree of attention to be paid to the tooth in a treatment process.

[0131] Optionally, the display unit 1701 is specifically configured to: take each object with tooth analysis information as an entry, and record a tooth number, tooth analysis information, tooth analysis result and priority information corresponding to the tooth analysis information in the tooth feature data in a text manner in each entry; the priority information is used to show a degree of attention to be paid to the tooth in a treatment process; and the tooth analysis result is used to represent a treatment reminder of the tooth in the treatment process.

[0132] Optionally, the display unit 1701 is specifically configured to: identify a tooth region from the panoramic image; identify a tooth region with tooth analysis information and alveolar bone region with tooth analysis information from a first sub-image corresponding to the tooth region in the panoramic image; and identify each object with tooth analysis information from a second sub-image corresponding to each tooth region with tooth analysis information and alveolar bone region with tooth analysis information in the panoramic image.

[0133] Optionally, the processing unit 1702 is specifically configured to: display the object and the tooth analysis information corresponding to the object in a first selected mode in the panoramic view area; the first selected mode is: when the object is a tooth, displaying the tooth according to tooth shape information of the object in a first set color; when the object is alveolar bone, displaying the alveolar bone according to an alveolar bone region of the object in a second set color; display the object and the tooth analysis information and priority information corresponding to the object in a second selected mode in the dentition view area; the second selected mode is to display the tooth in a third set color; display the object and the tooth number corresponding to the object, the tooth analysis information corresponding to the object, the tooth analysis result corresponding to the object and the priority information in a third selected mode in the analysis view area; the second selected mode is to display the corresponding items in a frame selection mode.

[0134] Optionally, the operation is a tooth analysis information updating operation; each object corresponds to a display area for displaying tooth analysis information in the plurality of view areas; the display area is provided with an updating operation component. The processing unit 1702 is specifically configured to: display the object and the updated tooth analysis information of the object in a first selected mode in the panoramic view area; display the object and the updated tooth analysis information and priority information of the object in a second selected mode in the dentition view area; display the object and the updated tooth analysis information and priority information of the object in a third selected mode in the analysis view area.

[0135] Optionally, the panoramic view area displays tooth numbers of each tooth, and any tooth number is located in a crown region of the corresponding tooth.

[0136] Optionally, the crown region is determined according to a region close to a shortest side of a connecting line from a vertex of a largest triangle inside any tooth to a midpoint of the shortest side.

[0137] Based on the same technical concept, an embodiment of the present application provides a computing device, as shown in FIG. 18, which includes at least one processor 1801 and a memory 1802 connected with the at least one processor. In the embodiment of the present application, the specific connection medium between the processor 1801 and the memory 1802 is not limited, and in FIG. 18, the processor 1801 and the memory 1802 are connected through a bus as an example. The bus can be divided into an address bus, a data bus, a control bus and the like.

[0138] In the embodiment of the present application, the memory 1802 stores instructions executable by the at least one processor 1801, and the at least one processor 1801 can execute the steps of the panoramic view display method by executing the instructions stored in the memory 1802.

[0139] The processor 1801 is the control center of the computing device, and can connect various parts of the computing device by using various interfaces and lines, and process the panoramic picture display method by running or executing instructions stored in the memory 1802 and calling data stored in the memory 1802. Optionally, the processor 1801 can include one or more processing units, and the processor 1801 can integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, and an application program, and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor can also be integrated into the processor 1801. In some embodiments, the processor 1801 and the memory 1802 can be implemented on the same chip, and in some embodiments, they can also be respectively implemented on independent chips.

[0140] The processor 1801 can be a general-purpose processor, for example, a central processing unit (CPU), a digital signal processor, an application specific integrated circuit (ASIC), a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, and can implement or execute the methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in the embodiments of the present application can be directly embodied as hardware processor execution or executed by a combination of hardware and software modules in the processor.

[0141] The memory 1802, as a nonvolatile computer readable storage medium, can be used to store nonvolatile software programs, nonvolatile computer executable programs and modules. The memory 1802 can include at least one type of storage medium, for example, can include flash memory, hard disk, multimedia card, card type memory, random access memory (RAM), static random access memory (SRAM), programmable read-only memory (PROM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), magnetic storage, magnetic disk, optical disk, etc. The memory 1802 is any other medium capable of carrying or storing desired program code in the form of instructions or data structures and capable of being accessed by a computer device, but is not limited thereto. The memory 1802 in the embodiments of the present application can also be a circuit or any other device capable of realizing a storage function, used to store program instructions and / or data.

[0142] Based on the same inventive concept, the embodiments of the present application provide a computer readable storage medium storing a computer program executable by a computer device, which, when executed on the computer device, causes the computer device to perform the steps of the panoramic image display method.

[0143] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROMs, optical storage, etc.) containing computer-usable program code.

[0144] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.

[0145] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart block or blocks.

[0146] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.

[0147] Obviously, numerous modifications and variations of the present application are possible in light of the above teachings. It is therefore to be understood that within the scope of the claims and their equivalents, the application can be practiced otherwise than as specifically described.

Claims

1. A panoramic photo display method characterized by comprising: The method comprises the steps of: displaying a display interface comprising a plurality of view areas; the plurality of view areas comprises a panoramic film view area and an auxiliary view area; the auxiliary view area comprises a dentition view area and / or an analysis view area; based on a user's operation on a first object in a first view area, determining the tooth feature data corresponding to the first object; the first view area is any one of the panoramic film view area and the auxiliary view area; determining a first display mode set corresponding to the first object in the display interface according to the tooth feature data corresponding to the first object; the first display mode set represents that the plurality of view areas display the first object in a respective set dynamic display mode in response to the operation; based on the first display mode set, the first object is displayed in the plurality of view areas of the display interface in linkage; wherein different display mode sets correspond to different operations on the same object, and different display mode sets correspond to different types of tooth feature data.

2. The method of claim 1, wherein, determining a first display mode set corresponding to the first object in the display interface according to the tooth feature data corresponding to the first object, comprises: for any second view area, determining a second object with the same identifier as the first object in the second view area according to the identifier of the first object; the second view area is any view area in the plurality of view areas except the first view area; the first object and the second object are the same object in different view areas; determining a dynamic display mode for the second object in the second view area in response to the operation on the first object according to the tooth feature data corresponding to the first object, so as to obtain a first display mode set for display in the plurality of view areas.

3. The method of claim 1, wherein, Before displaying the display interface comprising a plurality of view areas, further comprising: based on a user-triggered analysis operation, obtaining a panoramic film image; identifying the panoramic film image to obtain tooth feature data corresponding to a plurality of objects in the panoramic film image; for the tooth feature data of each object, determining a second display mode set corresponding to the object in the plurality of view areas respectively; wherein the second display mode set represents that the plurality of view areas display the plurality of objects in a respective set static display mode; different static display mode sets correspond to different types of tooth feature data; displaying a display interface comprising a plurality of view areas, comprising: displaying a display interface comprising a plurality of view areas according to the second display mode set corresponding to the plurality of objects in the plurality of view areas respectively.

4. The method of claim 3, wherein, The tooth feature data comprises tooth analysis information; displaying a display interface comprising a plurality of view areas according to the second display mode set corresponding to the plurality of objects in the plurality of view areas respectively, comprises: displaying the object with tooth analysis information in the panoramic film view area in a first marking mode; the first marking mode marks the region of the object to be concerned and the marking mode corresponding to different tooth analysis information is different; displaying, in the dentition view area, objects with tooth analysis information in a second marking manner; the second marking manner represents different tooth analysis information; displaying, in the analysis view area, objects with tooth analysis information in an entry manner.

5. The method of claim 4, wherein, displaying, in the panoramic view area, objects with tooth analysis information in a first marking manner, including: for any object with tooth analysis information, displaying the object in the panoramic view area based on tooth shape information in tooth feature data of the object and the tooth analysis information, in a color representing the tooth analysis information and a line frame representing the tooth shape information.

6. The method of claim 4, wherein, displaying, in the dentition view area, objects with tooth analysis information in a second marking manner, including: for any object with tooth analysis information, displaying a mark representing the tooth analysis information on a tooth corresponding to a tooth number in the tooth feature data of the object in the dentition view area, and displaying priority information corresponding to the tooth analysis information; the priority information is used to show the degree of attention to the tooth in the treatment process.

7. The method of claim 4, wherein, displaying, in the analysis view area, objects with tooth analysis information in an entry manner, including: taking each object with tooth analysis information as an entry, and recording a tooth number, tooth analysis information, tooth analysis result and priority information corresponding to the tooth analysis information in each entry in a text manner; the priority information is used to show the degree of attention to the tooth in the treatment process; the tooth analysis result is used to represent a treatment reminder of the tooth in the treatment process.

8. The method of claim 3, wherein, identifying the panoramic image to obtain tooth feature data corresponding to a plurality of objects in the panoramic image, including: identifying a tooth region from the panoramic image; identifying, from a first sub-image corresponding to the tooth region in the panoramic image, a tooth region with tooth analysis information and an alveolar bone region with tooth analysis information; identifying, from a second sub-image corresponding to each tooth region and alveolar bone region with tooth analysis information in the panoramic image, each object with tooth analysis information.

9. The method according to any one of claims 1 to 8, characterized in that, The operation is a selection operation; based on the first display manner group, displaying the first object in the plurality of view areas of the display interface in linkage, including: displaying the object in the panoramic view area in a first selected mode and displaying tooth analysis information corresponding to the object; the first selected mode is: when the object is a tooth, displaying the tooth in a first set color according to tooth shape information of the object; when the object is alveolar bone, displaying the alveolar bone in a second set color according to the alveolar bone region of the object; displaying the object in the dentition view area in a second selected mode and displaying tooth analysis information and priority information corresponding to the object; the second selected mode is to display the tooth in a third set color; In the analysis view area, the object is displayed in a third selected mode, and the tooth number corresponding to the object, the tooth analysis information corresponding to the object, the tooth analysis result corresponding to the object, and the priority information are displayed; the third selected mode is displayed in the form of box selecting the item corresponding to the object.

10. The method according to any one of claims 1 to 8, wherein, The operation is a tooth analysis information updating operation; each object has a display area displaying tooth analysis information in the multiple view areas; the display area is provided with an updating operation component; Based on the first display mode group, the first object is displayed in the multiple view areas of the display interface, including: In the panoramic view area, the object is displayed in a first selected mode, and the updated tooth analysis information of the object is displayed; In the dentition view area, the object is displayed in a second selected mode, and the updated tooth analysis information and the priority information of the object are displayed; In the analysis view area, the object is displayed in a third selected mode, and the updated tooth analysis information and the priority information of the object are displayed.

11. The method according to any one of claims 1 to 8, wherein The panoramic view area displays the tooth number of each tooth, and any tooth number is located in the crown area of the corresponding tooth.

12. The method of claim 11, wherein, The crown area is determined according to the region close to the shortest side of the line connecting the vertex of the largest triangle inside any tooth to the midpoint of the shortest side.

13. A panoramic film display device, characterized by comprising: Including: A display unit is configured to display a display interface including multiple view areas; The multiple view areas include a panoramic view area and an auxiliary view area; The auxiliary view area includes a dentition view area and / or an analysis view area; A processing unit is configured to determine tooth feature data corresponding to a first object based on an operation of a user on the first object in a first view area; The first view area is any one of the panoramic view area and the auxiliary view area; Based on the tooth feature data corresponding to the first object, a first display mode group corresponding to the first object in the display interface is determined; The first display mode group represents that the multiple view areas display the first object in respective set dynamic display modes to respond to the operation; based on the first display mode group, the first object is displayed in the multiple view areas of the display interface; wherein different display mode groups correspond to different operations of the same object, and different display mode groups correspond to different types of tooth feature data.

14. A computing device, comprising: The computer program is stored in the storage unit and is executed by the processing unit, so that the processing unit executes the method of any one of claims 1-12.

15. A computer-readable storage medium, characterized in that, The computer program is stored in the storage unit and is executed by the processing unit, so that the processing unit executes the method of any one of claims 1-12.

16. A computer program product comprising computer programs / instructions, characterized in that, The computer program / instruction is executed by the processor to realize the steps of the method of any one of claims 1-12.

Images