Panoramic film display method and device

Abstract

The embodiment of the invention provides a panoramic film display method and device. The panoramic film display method comprises the steps that a display interface comprising a plurality of view areas is displayed; the plurality of view areas comprise a panorama view area and an auxiliary view area; tooth feature data corresponding to the first object is determined based on the operation of the user on the first object in the first view area; the first view area is any one of a panorama view area and an auxiliary view area; determining a first display mode group corresponding to the first object on the display interface according to the tooth feature data corresponding to the first object; the first display mode group represents that the plurality of view areas display the first object in respective set dynamic display modes so as to respond to the operation; based on the first display mode group, displaying the first object in a plurality of view areas of the display interface in a linkage manner; wherein different operations for the same object correspond to different display mode groups, and different types of tooth feature data correspond to different display mode groups.

Description

TECHNICAL FIELD

[0001] The present application relates to the orthodontic technical field, and in particular to a panoramic film display method and device. BACKGROUND

[0002] The oral panoramic film, also known as the curved surface tomogram, is a very important routine treatment examination means in the stomatology examination, and based on the collected and photographed oral panoramic film data, the anatomical structure, density and periodontal condition of the teeth can be further understood.

[0003] At present, medical personnel determine the oral problems of patients based on the analysis results of the oral panoramic film. The analysis results are usually displayed in the form of pictures. However, since the pictures contain complex content and a large amount of information, the medical personnel need to spend a lot of time comparing multiple pictures to determine the problem teeth and understand the analysis results corresponding to the problem teeth, thereby causing the efficiency of the medical personnel in diagnosing the oral problems of the patients to be low, and there is a certain diagnosis error.

[0004] In summary, how to quickly and accurately locate the oral problems and quickly assist the doctors in understanding the analysis results of the oral problems is a problem to be solved at present. SUMMARY

[0005] The embodiments of the present application provide an oral panoramic display method and device, to solve the problem in the prior art that the oral problems cannot be quickly and accurately located and the analysis results of the oral problems cannot be quickly assisted for the doctors to understand.

[0006] In a first aspect, the embodiments of the present application provide a panoramic film display method, comprising: displaying a display interface comprising a plurality of view areas; the plurality of view areas comprise a panoramic film view area and an auxiliary view area; the auxiliary view area comprises a dentition view area and / or an analysis view area; determining tooth feature data corresponding to a first object based on a user's operation on the first object in a first view area; the first view area is any one of the panoramic film view area and the auxiliary view area; determining a first display mode set corresponding to the first object in the display interface according to the tooth feature data corresponding to the first object; the first display mode set represents that the plurality of view areas display the first object in a respective set dynamic display mode in response to the operation; based on the first display mode set, the first object is displayed in the plurality of view areas of the display interface in linkage; wherein different display mode sets correspond to different operations of the same object, and different display mode sets correspond to different types of tooth feature data.

[0007] In the technical solution, the first object in the display interface is displayed in the multiple view areas in the display interface in the respective set dynamic display manner in linkage with the operation of the user on the first object in the first view area, so that the user can quickly locate the first object in different view areas, and the first object can be displayed in the same display interface in the respective set dynamic display manner according to the multiple view areas.

[0008] Optionally, the first display manner group corresponding to the first object in the display interface is determined according to the tooth feature data corresponding to the first object, including: for any second view area, a second object having the identifier in the second view area is determined according to the identifier of the first object, the second view area being any view area other than the first view area in the multiple view areas, the first object and the second object being the same object in different view areas, and the dynamic display manner for the second object in the second view area is determined according to the tooth feature data corresponding to the first object in response to the operation on the first object, so as to obtain the first display manner group displayed in the multiple view areas.

[0009] In the technical solution, when the user operates the first object in the first view area of the display interface, the first display manner group displayed in the multiple view areas is generated, so that the second view area displays the second object in the dynamic display manner in response to the operation on the first object in addition to the first view area displaying the first object in the dynamic display manner, and the multiple view areas in the display interface display the first object in linkage.

[0010] Optionally, before the display interface including the multiple view areas is displayed, the panoramic radiograph image is obtained based on the analysis operation triggered by the user, the tooth feature data corresponding to the multiple objects in the panoramic radiograph image is obtained by identifying the panoramic radiograph image, the second display manner group corresponding to each object in the multiple view areas is determined according to the tooth feature data of the object, the second display manner group representing that the multiple view areas display the multiple objects in the respective set static display manner, different static display manner groups corresponding to different types of tooth feature data, and the display interface including the multiple view areas is displayed according to the second display manner group corresponding to the multiple objects in the multiple view areas.

[0011] In the technical solution, the display interface is generated according to the panoramic radiograph image, and the multiple view areas in the display interface display the objects having the tooth analysis information through different dimensions, so that the user can quickly and clearly view the information required by the user in different view areas in the display interface.

[0012] Optionally, the tooth feature data comprises tooth analysis information; and the display interface comprising the plurality of view areas is displayed according to a plurality of second display mode groups corresponding to the plurality of objects respectively, comprising: displaying the objects with the tooth analysis information in the panoramic view area in a first marking mode; the first marking mode marks the regions of the objects to be concerned and different tooth analysis information corresponds to different marking modes; displaying the objects with the tooth analysis information in the dentition view area in a second marking mode; the second marking mode represents different tooth analysis information; and displaying the objects with the tooth analysis information in the analysis view area in an entry mode.

[0013] Optionally, the displaying the objects with the tooth analysis information in the panoramic view area in the first marking mode comprises: for any object with the tooth analysis information, displaying the object in the panoramic view area based on the tooth shape information and the tooth analysis information in the tooth feature data of the object in a color representing the tooth analysis information and a line box representing the tooth shape information.

[0014] Optionally, the displaying the objects with the tooth analysis information in the dentition view area in the second marking mode comprises: for any object with the tooth analysis information, displaying a mark representing the tooth analysis information on the tooth corresponding to the tooth number in the dentition view area based on the tooth number and the tooth analysis information in the tooth feature data of the object, and displaying priority information corresponding to the tooth analysis information; the priority information is used to show the degree of concern of the tooth in the treatment process.

[0015] Optionally, the displaying the objects with the tooth analysis information in the analysis view area in the entry mode comprises: taking each object with the tooth analysis information as an entry, and recording the tooth number, the tooth analysis information, a tooth analysis result and priority information corresponding to the tooth analysis information in the tooth feature data in the text in each entry; the priority information is used to show the degree of concern of the tooth in the treatment process; and the tooth analysis result is used to represent a treatment reminder of the tooth in the treatment process.

[0016] Optionally, the identifying the panoramic image to obtain the tooth feature data corresponding to the plurality of objects in the panoramic image comprises: identifying the tooth region from the panoramic image; identifying the tooth region with the tooth analysis information and the alveolar bone region with the tooth analysis information from a first sub-image corresponding to the tooth region in the panoramic image; and identifying each object with the tooth analysis information from a second sub-image corresponding to each tooth region with the tooth analysis information and the alveolar bone region with the tooth analysis information in the panoramic image.

[0017] In the technical solution, the panoramic film image is processed by multiple models to obtain each object with tooth analysis information in the panoramic film image, so that the object with tooth analysis information can be directly displayed in the panoramic film image on a display interface, and the user can clearly and intuitively view the shape of each object with tooth analysis information and the tooth analysis information of the object.

[0018] Optionally, the operation is a selection operation; and based on the first display mode group, the first object is displayed in linkage in the multiple view areas of the display interface, including: in the panoramic film view area, the object is displayed in a first selected mode and the tooth analysis information corresponding to the object is displayed; the first selected mode is: when the object is a tooth, the tooth is displayed in a first set color according to the tooth shape information of the object; when the object is alveolar bone, the alveolar bone is displayed in a second set color according to the alveolar bone area of the object; in the dentition view area, the object is displayed in a second selected mode and the tooth analysis information and the priority information corresponding to the object are displayed; the second selected mode is to display the tooth in a third set color; in the analysis view area, the object is displayed in a third selected mode and the tooth number corresponding to the object, the tooth analysis information corresponding to the object, the tooth analysis result corresponding to the object and the priority information are displayed; the third selected mode is to display the corresponding items of the object in the form of frame selection.

[0019] Optionally, the operation is a tooth analysis information updating operation; each object has a display area for displaying tooth analysis information in the multiple view areas; the display area is provided with an updating operation component; based on the first display mode group, the first object is displayed in linkage in the multiple view areas of the display interface, including: in the panoramic film view area, the object is displayed in a first selected mode and the updated tooth analysis information of the object is displayed; in the dentition view area, the object is displayed in a second selected mode and the updated tooth analysis information and the priority information of the object are displayed; in the analysis view area, the object is displayed in a third selected mode and the updated tooth analysis information and the priority information of the object are displayed.

[0020] Optionally, the panoramic film view area displays the tooth numbers of each tooth, and any tooth number is located in the crown area of the corresponding tooth.

[0021] Optionally, the crown area is determined according to the region close to the shortest side on the line from the vertex of the largest triangle inside any tooth to the midpoint of the shortest side.

[0022] In a second aspect, the embodiment of the present application provides a panoramic film display device, comprising: a display unit configured to display a display interface comprising a plurality of view areas; the plurality of view areas comprise a panoramic film view area and an auxiliary view area; the auxiliary view area comprises a dentition view area and / or an analysis view area; and a processing unit configured to determine tooth feature data corresponding to a first object based on a user operation on the first object in a first view area; the first view area is any one of the panoramic film view area and the auxiliary view area; determine a first display mode set corresponding to the first object in the display interface according to the tooth feature data corresponding to the first object; the first display mode set represents that the plurality of view areas display the first object in a respective set dynamic display mode in response to the operation; and display the first object in the plurality of view areas of the display interface based on the first display mode set; wherein different display mode sets correspond to different operations on the same object, and different display mode sets correspond to different types of tooth feature data.

[0023] Optionally, the processing unit is specifically configured to: for any second view area, determine a second object having an identifier in the second view area according to the identifier of the first object; the second view area is any view area other than the first view area in the plurality of view areas; the first object and the second object are the same object in different view areas; and determine a dynamic display mode for the second object in the second view area in response to the operation on the first object according to the tooth feature data corresponding to the first object, so as to obtain the first display mode set for display in the plurality of view areas.

[0024] Optionally, the display unit is further configured to: acquire a panoramic film image based on a user triggered analysis operation; identify the panoramic film image to obtain tooth feature data corresponding to a plurality of objects in the panoramic film image; determine a second display mode set corresponding to the plurality of objects in the plurality of view areas for the tooth feature data of each object; wherein the second display mode set represents that the plurality of view areas display the plurality of objects in a respective set static display mode; and different static display mode sets correspond to different types of tooth feature data. The display unit is specifically configured to display the display interface comprising the plurality of view areas according to the second display mode set corresponding to the plurality of objects in the plurality of view areas.

[0025] Optionally, the tooth feature data comprises dental analysis information; and the display unit is specifically configured to: display the object having the dental analysis information in the panoramic film view area in a first marking mode; the first marking mode marks a region of interest of the object, and different marking modes correspond to different dental analysis information; display the object having the dental analysis information in the dentition view area in a second marking mode; the second marking mode represents different dental analysis information; and display the object having the dental analysis information in the analysis view area in an entry mode.

[0026] Optionally, the display unit is specifically configured to: for any object with tooth analysis information, based on the tooth shape information in the tooth feature data of the object and the tooth analysis information, display the object in the panoramic view area with a color representing the tooth analysis information and a line box representing the tooth shape information.

[0027] Optionally, the display unit is specifically configured to: for any object with tooth analysis information, based on the tooth number in the tooth feature data of the object and the tooth analysis information, display a mark representing the tooth analysis information on the tooth corresponding to the tooth number in the dentition view area, and display priority information corresponding to the tooth analysis information; the priority information is used to show the degree of attention of the tooth in the treatment process.

[0028] Optionally, the display unit is specifically configured to: take each object with tooth analysis information as an entry, and record the tooth number, tooth analysis information, tooth analysis result and priority information corresponding to the tooth analysis information in the tooth feature data in the form of text in each entry; the priority information is used to show the degree of attention of the tooth in the treatment process; the tooth analysis result is used to represent the treatment reminder of the tooth in the treatment process.

[0029] Optionally, the display unit is specifically configured to: identify the tooth region from the panoramic image; identify the tooth region with tooth analysis information and the alveolar bone region with tooth analysis information from the first sub-image corresponding to the tooth region in the panoramic image; and identify each object with tooth analysis information from the second sub-image corresponding to each tooth region and alveolar bone region with tooth analysis information in the panoramic image.

[0030] Optionally, the processing unit is specifically configured to: in the panoramic view area, display the object in a first selected mode and display the tooth analysis information corresponding to the object; the first selected mode is: when the object is a tooth, display the tooth in a first set color according to the tooth shape information of the object; when the object is alveolar bone, display the alveolar bone in a second set color according to the alveolar bone region of the object; in the dentition view area, display the object in a second selected mode and display the tooth analysis information and priority information corresponding to the object; the second selected mode is to display the tooth in a third set color; in the analysis view area, display the object in a third selected mode and display the tooth number corresponding to the object, the tooth analysis information corresponding to the object, the tooth analysis result corresponding to the object and the priority information; the second selected mode is to display the form of the object corresponding to the entry in the frame.

[0031] Optionally, the operation is a tooth analysis information updating operation; each object has a display area displaying tooth analysis information in the plurality of view areas; the display area is provided with an updating operation component. The processing unit is specifically configured to: display the object in a first selected mode and display the updated tooth analysis information of the object in the panoramic view area; display the object in a second selected mode and display the updated tooth analysis information and priority information of the object in the dentition view area; and display the object in a third selected mode and display the updated tooth analysis information and priority information of the object in the analysis view area.

[0032] Optionally, the panoramic view area displays tooth numbers of each tooth, and any tooth number is located in a crown area of the corresponding tooth.

[0033] Optionally, the crown area is determined according to a region close to a shortest side of a connecting line from a vertex of a largest triangle inside any tooth to a midpoint of the shortest side.

[0034] In a third aspect, an embodiment of the present application further provides a computing device, comprising at least one processor and at least one memory, wherein the memory stores a computer program, and when the program is executed by the processor, the processor executes the panoramic view display method in the first aspect.

[0035] In a fourth aspect, an embodiment of the present application provides a computer readable storage medium, which stores a computer program executable by a computer device, and when the program is executed on the computer device, the computer device executes the panoramic view display method in the first aspect.

[0036] In a fifth aspect, an embodiment of the present application provides a computer program product, which comprises a computer program stored in a computer readable storage medium, and the computer program comprises program instructions, and when the program instructions are executed by a computer device, the computer device executes the steps of any panoramic view display method in the first aspect. BRIEF DESCRIPTION OF DRAWINGS

[0037] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed in the embodiment description. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0038] Figure 1 A schematic diagram of a panoramic view image is provided for an embodiment of the present application;

[0039] Figure 2 A panoramic view display method flowchart is provided for an embodiment of the present application;

[0040] Figure 3 A position diagram of tooth number provided for an embodiment of the present application;

[0041] Figure 4 A method flowchart for generating a display interface provided for an embodiment of the present application;

[0042] Figure 5 A method flowchart for determining tooth analysis information of an object in a panoramic image provided for an embodiment of the present application;

[0043] Figure 6 A diagram of a mask image provided for an embodiment of the present application;

[0044] Figure 7 A diagram of a display interface including a plurality of view areas;

[0045] Figure 8 A method flowchart for determining a first display mode group corresponding to a first object in a display interface provided for an embodiment of the present application;

[0046] Figure 9 A diagram of a dentition view area provided for an embodiment of the present application;

[0047] Figure 10 A diagram of a display interface for selecting a plurality of objects provided for an embodiment of the present application;

[0048] Figure 11 A diagram of a display interface provided for an embodiment of the present application;

[0049] Figure 12 A diagram of another display interface provided for an embodiment of the present application;

[0050] Figure 13 A diagram of an update operation component of a panoramic view area provided for an embodiment of the present application;

[0051] Figure 14 A diagram of an update operation component of a dentition view area provided for an embodiment of the present application;

[0052] Figure 15 A diagram of an update operation component of an analysis view area provided for an embodiment of the present application;

[0053] Figure 16 A diagram of a panoramic view area provided for an embodiment of the present application;

[0054] Figure 17 A structural diagram of a panoramic display device provided for an embodiment of the present application;

[0055] Figure 18 A structural schematic diagram of a computing device provided for an embodiment of the present application. DETAILED DESCRIPTION

[0056] In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort belong to the scope of the present application.

[0057] With the continuous development of economy, people pay more and more attention to oral problems. At present, there are many ways to treat oral problems. For example, when the oral problem is wisdom tooth, in one possible scenario, when the patient goes to the hospital for wisdom tooth treatment, if the patient is the first time to see a doctor, the doctor will first ask the patient to take an oral panoramic film, and the purpose of taking the oral panoramic film is to enable the doctor to view the patient's oral problem more clearly. The doctor will diagnose the patient according to the patient's oral panoramic film. See Figure 1 .

[0058] At present, the types of oral problems are increasing. For example, if there are multiple wisdom teeth in the oral cavity, the doctor needs to determine the treatment method of the patient according to the patient's oral panoramic film. If the oral problem is that the teeth are not arranged in order, the doctor needs to determine the treatment method of the patient's tooth correction according to the patient's oral panoramic film. It should be noted that during the correction of the teeth, the doctor needs to customize the corresponding tooth corrector for the patient according to the patient's oral problems, periodontal problems or other oral problems. Therefore, before the doctor needs to develop a treatment method for the patient's oral problem, the doctor needs to comprehensively analyze and understand the patient's oral problem. At present, the patient's oral problem is generally understood by viewing the patient's oral panoramic film.

[0059] In one possible case, the doctor can diagnose the patient's oral problem through the panoramic film analysis tool. The panoramic film analysis tool includes a panoramic film image, a tooth array image and a problem analysis image. The display of the panoramic film analysis tool is usually static. When the doctor analyzes the patient's oral problem, the doctor needs to compare the above-mentioned three images by switching them on the interface multiple times, so as to realize the correspondence of the oral problems in multiple images, and then the doctor can locate the oral problem and understand the corresponding influencing factors of the oral problem. However, such a panoramic film analysis tool lacks subjective operability, and the doctor cannot quickly locate the oral problem that needs to be concerned in multiple images, so the doctor cannot quickly understand the corresponding influencing factors of the oral problem, thereby resulting in low work efficiency of the doctor and certain diagnosis errors.

[0060] In summary, the panoramic image display method provided in the embodiment of the present application can solve the problem that doctors cannot quickly locate the oral problem that needs to be focused on in multiple images, and therefore cannot quickly understand the influencing factors of the oral problem.

[0061] As shown in Figure 2 a flowchart of a panoramic image display method provided in the embodiment of the present application, the method comprises the following steps:

[0062] Step 201, display a display interface comprising multiple view areas.

[0063] In the embodiment of the present application, the display interface comprises multiple view areas. The multiple view areas comprise a panoramic image view area and an auxiliary view area. The auxiliary view area comprises a dentition view area and / or an analysis view area. In one possible case, the display interface comprises the panoramic image view area and the dentition view area. In another possible case, the display interface comprises the panoramic image view area and the analysis view area. In yet another possible case, the display interface comprises the panoramic image view area, the dentition view area and the analysis view area. In order to facilitate the understanding of the present solution, the display interface comprising the panoramic image view area, the dentition view area and the analysis view area is used to introduce the present solution, but the present solution is not limited thereto.

[0064] Step 202, based on the operation of a user on a first object in a first view area, determine the tooth feature data corresponding to the first object.

[0065] In the embodiment of the present application, based on the operation of the user on the first object in the first view area, the operation can be a selection operation, an operation of staying in the area where the first object is located in the first view area for more than a set threshold, or other operations, which are not limited herein. In order to facilitate the understanding of the present solution, the operation is taken as the selection operation as an example to introduce the present solution. When the user performs the selection operation on the first object in the first view area, the tooth feature data corresponding to the first object can be determined, which is used to display in the multiple view areas in the display interface. The first view area is any one of the panoramic image view area and the auxiliary view area.

[0066] Step 203, according to the tooth feature data corresponding to the first object, determine a first display mode set corresponding to the first object in the display interface.

[0067] In the embodiment of the present application, according to the tooth feature data corresponding to the first object, the first display mode set of the first object in the display interface can be determined, wherein the first display mode set represents that the multiple view areas display the first object in the respective set dynamic display mode to respond to the operation of the user on the first object in the first view area.

[0068] In step 204, the first object is displayed in linkage in the plurality of view areas of the display interface based on the first display mode group.

[0069] In the embodiment of the present application, the first object is displayed in linkage in the plurality of view areas of the display interface based on the first display mode group, so that the plurality of view areas of the display interface display the first object in the respective dynamic display modes.

[0070] As can be seen from the above steps 201 to 204, according to the operation of the user on the first object in the first view area, the first object is displayed in linkage in the plurality of view areas of the display interface in the respective dynamic display modes, so that the user can quickly locate the first object in different view areas, and the first object can be displayed in the respective dynamic display modes in the plurality of view areas of the same display interface.

[0071] Optionally, the positions of the panoramic film view area and the auxiliary view area in the display interface are fixed.

[0072] Optionally, the user can operate the display interface to move, enlarge and / or reduce the panoramic film view area and the auxiliary view area.

[0073] Optionally, the tooth numbers of the teeth are displayed in the panoramic film view area. Since the shapes of the teeth in the panoramic film are various, such as different shapes of tooth roots and missing teeth, if the tooth number is located in the middle part of the tooth, the tooth number may cover the area to be concerned in the tooth. The crown occupies a large proportion in the tooth. In the panoramic film view area, any tooth number is located in the crown area of the corresponding tooth. The crown area is determined according to the area close to the shortest side on the line from the vertex of the largest triangle in the tooth to the midpoint of the shortest side. For example, the position of the tooth number is determined as the position close to 1 / 5 of the shortest side on the line from the vertex of the largest triangle in the tooth to the midpoint of the shortest side. Please refer to Figure 3 . In Figure 3 , the display of the tooth number in the panoramic film view area can be seen.

[0074] Optionally, the tooth numbers of the teeth can be displayed in the panoramic film view area, or the tooth numbers of the teeth can be hidden. In order to introduce the present scheme, the tooth numbers of the teeth are hidden in the panoramic film view area in the following schematic diagram, but this is not a limitation.

[0075] For example, when a patient goes to hospital A for oral problems, the patient is going to hospital A for the first time, so the doctor will first ask the patient to take an oral panoramic film, and then the doctor will subsequently display a display interface including multiple view areas on the doctor's display device according to the patient's oral panoramic film. The doctor's display device can be a computer, a tablet, a mobile phone, etc. without limitation. In order to better understand the present solution, how to generate a display interface is introduced as follows.

[0076] As shown in Figure 4 , a method flow chart for generating a display interface provided by an embodiment of the present application, the method comprising the following steps:

[0077] Step 401, based on the user triggered analysis operation, obtaining the panoramic film image.

[0078] In an embodiment of the present application, for example, when a patient goes to hospital A for the first time, the patient needs to take a panoramic film image, and then the doctor triggers an analysis operation on the terminal to obtain the panoramic film image taken by the patient. The terminal can be a computer, a mobile phone, a tablet, or other terminals without limitation.

[0079] Step 402, identifying the panoramic film image to obtain the tooth feature data corresponding to the multiple objects in the panoramic film image.

[0080] In an embodiment of the present application, by identifying the panoramic film image, the tooth feature data corresponding to the multiple objects in the panoramic film image is obtained, so that the multiple view areas of the display interface can be displayed according to the tooth feature data corresponding to the multiple objects in the panoramic film image. Since the tooth feature data required for displaying the multiple view areas of the display interface is obtained from the panoramic film image, the data uniformity is achieved, which facilitates clearer viewing of the same object in different view areas when displayed on the display interface. The tooth feature data corresponding to the multiple objects in the panoramic film image includes tooth analysis information, and a method for determining the tooth analysis information of the object in the panoramic film image is introduced below to introduce how to determine the tooth analysis information of the object in the panoramic film image.

[0081] As shown in Figure 5 , a method flow chart for determining the tooth analysis information of the object in the panoramic film image provided by an embodiment of the present application, the method comprising the following steps:

[0082] Step 501, identifying the tooth region from the panoramic film image.

[0083] In an embodiment of the present application, the panoramic film image is input into a global tooth segmentation model based on a deep neural network to obtain a mask image of all teeth, which can be referred to asFigure 6 The global tooth segmentation model based on the deep neural network is a full convolutional deep neural network, the input is the panoramic image, and the output is a mask image. The white part of the mask image represents the tooth, and the black part represents the background. The full convolutional deep neural network can be a general medical image segmentation network, such as UNet, Atten-UNet, UNet++, etc., which is not limited herein.

[0084] After obtaining the mask image of all teeth, the mask image needs to be cropped to obtain the tooth region. Specifically, according to the mask image, the vertex coordinate values of the smallest rectangular frame containing all teeth in the mask image are determined, wherein the smallest rectangular frame containing all teeth is Figure 6 the green rectangular frame in FIG. 6. However, the smallest rectangular frame only contains the tooth part, which is not conducive to subsequent image processing, and the smallest rectangular frame containing all teeth needs to be expanded so that the expanded rectangular frame can cover part of the image of the area around the tooth. The image in the expanded rectangular frame is the tooth region, wherein the tooth region is Figure 6 the area in the red rectangular frame in FIG. 6. For example, according to the mask image, the vertex coordinate values of the smallest rectangular frame containing all teeth in the mask image are determined, x1, y1, x2, y2, which are Figure 6 the green rectangular frame in FIG. 6, wherein (x1, y1) is the x-axis and y-axis coordinate values of the top left vertex of the rectangular frame, and (x2, y2) is the x-axis and y-axis coordinate values of the bottom right vertex of the rectangular frame. The rectangular frame is expanded so that the rectangular frame covers part of the image of the area around the tooth. The left top vertex coordinate values of the expanded rectangular frame are (x1-margin_x, y1-margin_y), and the bottom right vertex coordinate values are (x2+margin_x, y2+margin_y), which are Figure 6 the red rectangular frame in FIG. 6, wherein margin_x and margin_y are the sizes of the expanded area in the x-axis and y-axis, for example, margin_x=0.1×(x2-x1), margin_y=0.2×(y2-y1), or the values of margin_x and margin_y can be determined according to the actual situation, which is not limited herein.

[0085] In step 502, the tooth region with tooth analysis information and the alveolar bone region with tooth analysis information are identified through the first sub-image corresponding to the panoramic image in the tooth region.

[0086] In the embodiment of the present application, in a possible case, if tooth A and tooth B are both teeth with tooth analysis information, there is an overlapping area between tooth A and the position next to tooth B in the panoramic image. If the object with tooth analysis information is directly recognized according to the panoramic image, the recognition result is that the overlapping part between tooth A and tooth B is a whole, and the edge between tooth A and tooth B cannot be obtained. Therefore, it is necessary to first determine all tooth regions with tooth analysis information and alveolar bone regions with tooth analysis information in the panoramic image, and then frame the object with tooth analysis information from the panoramic image according to the tooth region with tooth analysis information and the alveolar bone region with tooth analysis information. Next, how to determine all tooth regions with tooth analysis information and alveolar bone regions with tooth analysis information in the panoramic image is introduced.

[0087] Since the tooth with tooth analysis information and the alveolar bone with tooth analysis information can be regular or irregular, it is necessary to first frame each tooth region with tooth analysis information and alveolar bone region with tooth analysis information by a rectangular frame to obtain all tooth regions with tooth analysis information and alveolar bone regions with tooth analysis information in the panoramic image.

[0088] According to the coordinate value of the tooth region, a first sub-image is cut out from the panoramic image. The first sub-image is input into the tooth detection model based on the deep neural network. The output is the coordinate value of the tooth to be concerned and the tooth analysis information corresponding to the tooth to be concerned, and the coordinate value of the alveolar bone to be concerned and the tooth analysis information corresponding to the alveolar bone to be concerned. The tooth detection model based on the deep neural network can adopt a general target detection network, such as Faster-RCNN, YOLO, RetinaNet, etc., which is not limited here. According to the coordinate value of the tooth to be concerned, a rectangular frame of the tooth to be concerned is obtained. According to the coordinate value of the alveolar bone to be concerned, a rectangular frame of the alveolar bone to be concerned is obtained. After obtaining the rectangular frame of the tooth to be concerned and the rectangular frame of the alveolar bone to be concerned, the rectangular frame is expanded.

[0089] Specifically, since the extending manners of the rectangular frame of the tooth to be concerned and the rectangular frame of the alveolar bone to be concerned are the same, the extending manner is introduced below by taking the rectangular frame of the tooth to be concerned as an example. For example, if (x1, y1) in the coordinate values of the rectangular frame of the tooth to be concerned is the x-axis and y-axis coordinate values of the top left vertex of the rectangular frame, and (x2, y2) is the x-axis and y-axis coordinate values of the top right vertex of the rectangular frame. The coordinate values of the top left vertex of the extended rectangular frame are (x1-margin_x, y1-margin_y), and the coordinate values of the top right vertex are (x2+margin_x, y2+margin_y), wherein margin_x and margin_y are the sizes of the extended regions of the x-axis and y-axis, for example, margin_x=0.2×(x2-x1), margin_y=0.2×(y2-y1), margin_x and margin_y can also be determined according to specific conditions, which are not limited here.

[0090] According to the coordinate values of the extended rectangular frame of the tooth to be concerned and the tooth analysis information corresponding to the tooth to be concerned, the tooth region with tooth analysis information is determined. Similarly, according to the coordinate values of the extended rectangular frame of the alveolar bone to be concerned and the tooth analysis information corresponding to the alveolar bone to be concerned, the alveolar bone region with tooth analysis information is determined.

[0091] In step 503, each object with tooth analysis information is identified through the second sub-image corresponding to each tooth region with tooth analysis information and each alveolar bone region with tooth analysis information in the panoramic film image.

[0092] In the embodiment of the present application, a plurality of second sub-images are obtained by cropping from the panoramic film image according to the coordinate values in each tooth region with tooth analysis information and the coordinate values in each alveolar bone region with tooth analysis information. Since the tooth with tooth analysis information and the alveolar bone with tooth analysis information can be regular or irregular in shape, each second sub-image is input into a local tooth segmentation model based on a deep neural network, and each object with tooth analysis information is output, so as to determine the specific shape of each object with tooth analysis information in the panoramic film image. The object with tooth analysis information is the tooth with tooth analysis information or the alveolar bone with tooth analysis information, and the local tooth segmentation model based on the deep neural network is a full convolution deep neural network. The full convolution deep neural network can be a general medical image segmentation network, such as UNet, Atten-UNet, UNet++, etc., which is not limited here.

[0093] It can be seen through the steps 501 to 503 that the panoramic image is processed by the plurality of models to obtain each object with tooth analysis information in the panoramic image, so that the object with tooth analysis information can be directly displayed in the panoramic image on the display interface, and the user can more intuitively and clearly view the shape of each object with tooth analysis information and the tooth analysis information of the object.

[0094] In step 403, for the tooth feature data of each object, a second display mode group corresponding to the object in the plurality of view areas is determined.

[0095] In the embodiment of the present application, for example, if the display interface includes a panoramic view area, a dentition view area and an analysis view area, if the panoramic image is recognized, three objects in the panoramic image are obtained, wherein the three objects correspond to A1, B1 and C1 in the panoramic view area, correspond to A2, B2 and C2 in the dentition view area, and correspond to A3, B3 and C3 in the analysis view area respectively. A1, A2 and A3 are the same object in different view areas. B1, B2 and B3 are the same object in different view areas. C1, C2 and C3 are the same object in different view areas. It can be understood that for the tooth feature data of each object, a second display mode group corresponding to the object in the plurality of view areas can be determined, wherein the second display mode group represents that the plurality of view areas display a plurality of objects in a respective set static display mode. Different static display mode groups correspond to different types of tooth feature data.

[0096] In step 404, a display interface including a plurality of view areas is displayed according to the second display mode group corresponding to the plurality of objects in the plurality of view areas.

[0097] In the embodiment of the present application, as Figure 7As shown, it is a schematic diagram of a display interface including a plurality of view areas. If the display interface includes a panoramic view area, a dentition view area and an analysis view area, wherein in the plurality of view areas in the display interface, each view area displays a plurality of objects with dental analysis information according to a second display mode group. For example, object A in any one view area, in the other two view areas, there are also object B and object C, wherein object A, object B and object C are the same object. In the panoramic view area in the display interface, according to the second display mode group, the objects with dental analysis information are displayed in the panoramic view area in a first marking mode. The first marking mode marks the region of the object to be concerned and the marking mode corresponding to different dental analysis information is different. Specifically, for any object with dental analysis information, based on the tooth shape information in the tooth feature data of the object and the dental analysis information, the object is displayed in the panoramic view area in a color representing the dental analysis information and a line box representing the tooth shape information. For example, the first marking mode can be to frame the region of the object to be concerned with a line box according to the tooth shape information of the object, wherein the line box can be a regular line box or an irregular line box, which is not limited here. Different colors are used to frame the objects corresponding to different dental analysis information, so that the objects corresponding to different dental analysis information can be distinguished according to the color, and the objects corresponding to the same dental analysis information can also be determined according to the color. For example, if the objects in the panoramic view area are classified according to the dental analysis information, they can be divided into four types, namely caries, wisdom tooth, filling and apical high density shadow. The caries is framed with an orange line box, the wisdom tooth is framed with a blue irregular line box, the filling is framed with a pink line box, and the apical high density shadow is framed with a blue regular line box.

[0098] In the dentition view area, the objects with dental analysis information are displayed in a second marking mode, wherein the second marking mode represents different dental analysis information. Specifically, for any object with dental analysis information, based on the tooth number in the tooth feature data of the object and the dental analysis information, the marking representing the dental analysis information is displayed on the tooth corresponding to the tooth number in the dentition view area, and the priority information corresponding to the dental analysis information is also displayed. The priority information is used to show the degree of concern of the tooth in the treatment process. For example, if the tooth number in the tooth feature data of the object is 14 and the dental analysis information is wisdom tooth, wherein the priority of the wisdom tooth is high, then the 14th tooth is framed with a line box in the dentition view area, and since the priority of the wisdom tooth is high, an exclamation mark is displayed on the 14th tooth in the dentition view area to display the priority information corresponding to the wisdom tooth.

[0099] The objects with the tooth analysis information are displayed in the analysis view area in the form of entries. Specifically, each object with the tooth analysis information is taken as an entry, and the tooth number, tooth analysis information, tooth analysis result, and priority information corresponding to the tooth analysis information in the tooth feature data are recorded in each entry in the form of text. The priority information is used to show the degree of attention to the tooth in the treatment process. The tooth analysis result is used to represent the treatment reminder of the tooth in the treatment process. For example, if a patient goes to a hospital for tooth correction and needs to wear a corrector, in the analysis view area in the display interface, the objects with the tooth analysis information are the filled object A and the caries object B. The tooth analysis information of the object A is filling, and the tooth analysis information of the object B is caries. In the analysis view area, the object A is taken as an entry, and the entry records the tooth number 22, filling, tooth analysis result 22 filling of the object A in the form of text. It should be noted that, since the priority of filling is low, the priority information will not be displayed in the entry in the analysis view area. In the analysis view area, the object B is taken as another entry, and the entry records the tooth number 26, caries, an exclamation mark next to the caries, and the tooth analysis result 26 caries of the object B in the form of text. The exclamation mark is used to represent that the priority of the caries is high, the tooth analysis result 26 caries may affect tooth movement / attachment bonding, and the caries needs to be treated before correction to avoid the caries from being aggravated and causing problems such as pulp necrosis.

[0100] As can be seen from the above steps 401 to 404, by generating the display interface according to the panoramic image, the objects with the tooth analysis information are displayed in different view areas through different dimensions, so that the user can quickly and clearly view the information required by the user in different view areas in the display interface.

[0101] In order to facilitate understanding of the present scheme, the present scheme is introduced below by taking the treatment of the patient with the tooth corrector as an example, but the treatment mode is not limited.

[0102] The above describes that the display interface including the plurality of view areas is displayed according to the plurality of object-second display mode groups corresponding to the plurality of view areas in the case that the user does not perform any operation on the display interface. The following introduces how the display interface is displayed when the user performs an operation on any object in the display interface.

[0103] In the embodiment of the present application, for step 203, the following introduces how to determine the first display mode group corresponding to the first object in the display interface.

[0104] As shown in Figure 8 FIG. 1 is a flow chart of a method for determining the first display mode group corresponding to the first object in the display interface according to an embodiment of the present application. The method includes the following steps.

[0105] Step 801, for any second view area, determining the second object with the identification in the second view area according to the identification of the first object.

[0106] In the embodiment of the present application, since there are the same objects in different view areas, for any second view area, the second object with the identification in the second view area can be determined according to the identification of the first object, wherein the second view area is any view area in the plurality of view areas except the first view area. The first object and the second object are the same object in different view areas.

[0107] Step 802, determining the dynamic display mode for the second object in the second view area in response to the operation on the first object according to the tooth feature data corresponding to the first object, thereby obtaining the first display mode group displayed in the plurality of view areas.

[0108] In the embodiment of the present application, the dynamic display mode for the second object in the second view area in response to the operation on the first object is determined according to the tooth feature data corresponding to the first object, thereby obtaining the first display mode group displayed in the plurality of view areas.

[0109] As can be seen from the above steps 801 to 802, when the user operates the first object in the first view area of the display interface, the first display mode group displayed in the plurality of view areas is generated, thereby realizing that not only the first view area dynamically displays the first object according to the operation, but also the second view area dynamically displays the second object according to the operation, and further realizing that the plurality of view areas in the display interface display the first object in linkage.

[0110] In the embodiment of the present application, if the operation is a selection operation, the first object is displayed in linkage in the plurality of view areas of the display interface based on the first display mode group. Specifically, in the panoramic view area, the object is displayed in a first selected mode and the tooth analysis information corresponding to the object is displayed. The first selected mode is that when the object is a tooth, the tooth is displayed in a first set color according to the tooth shape information of the object. For example, if the tooth analysis information of the first object is a caries, the line frame of the caries is filled with blue color to display the caries, and the tooth analysis information corresponding to the first object is displayed beside the blue filled area. When the object is alveolar bone, the alveolar bone is displayed in a second set color according to the alveolar bone region of the object. For example, if the tooth analysis information of the first object is an apical high-density shadow, the first object is displayed by deepening the color of the line frame of the apical high-density shadow, and the tooth analysis information corresponding to the first object is displayed beside the line frame of the apical high-density shadow.

[0111] In the dentition view area, the object is displayed in a second selected mode and the tooth analysis information and priority information corresponding to the object are displayed; the second selected mode is to display the tooth in a third set color. For example, if the tooth analysis information of the first object is wisdom tooth and the tooth number of the first object is 18, the color of the line frame of the tooth with tooth number 18 in the dentition area in the dentition view area is deepened, an exclamation mark is displayed on the tooth with tooth number 18 in the dentition area to display the priority information corresponding to the wisdom tooth, and the tooth number 18 of the first object, wisdom tooth, is displayed in the entry in the dentition view area. See Figure 9 .

[0112] In the analysis view area, the object is displayed in a third selected mode and the tooth number corresponding to the object, the tooth analysis information corresponding to the object, the tooth analysis result corresponding to the object and the priority information are displayed; the second selected mode is to display the object in the form of framing the entry corresponding to the object. For example, if the tooth analysis information of the first object is filling and the tooth number of the first object is 22, the entry corresponding to the first object is framed with a blue line frame in the analysis view area. The entry records the tooth number 22 of the first object, filling, the tooth analysis result of the first object as possibly affecting the adhesion effect of the accessory in the form of text. Since the priority of the first object is low, the priority information of the first object will not be displayed in the entry corresponding to the first object in the analysis view area. It should be noted that when the tooth analysis information of the first object is wisdom tooth, embedded tooth, impacted tooth, missing tooth, the entry corresponding to the first object is framed with a blue line frame in the analysis view area according to the above example.

[0113] For example, if the tooth analysis information of the first object is apical high density shadow, since the first object has no corresponding tooth number, the entry corresponding to the first object is framed with a blue line frame in the analysis view area, the entry records the apical high density shadow in the form of text and displays an exclamation mark next to the apical high density shadow, wherein the exclamation mark is used to represent the priority information of the first object and the tooth analysis result corresponding to the object as apical high density shadow, please pay attention to whether it affects tooth movement.

[0114] Optionally, the user can perform multiple selection operations in the first view area, and the multiple selected objects will be displayed in multiple view areas in the display interface in the manner of the first display group. For example, the user selects two entries in the analysis view area, entry 1 records tooth number 28, wisdom tooth, 28 exists, and may affect tooth movement. Entry 2 records tooth number 42, RCT, there is an exclamation mark next to RCT, 42 root canal treatment, please confirm whether it affects the movement effect, corresponding to the teeth with tooth number 28 and the teeth with tooth number 42 are displayed in the panoramic view and the dentition view. See Figure 10 .

[0115] For example, if the user performs a selection operation on a first object in the panoramic view area, the tooth analysis information of the first object is wisdom tooth, a blue line frame is used to frame the entry corresponding to the first object, and the entry records the tooth number 18 of the first object, wisdom tooth, an exclamation mark is displayed beside the wisdom tooth, and the tooth analysis result of the first object is that it may affect tooth movement. Correspondingly, in the panoramic view area, a blue highlight is filled in the line frame of the wisdom tooth to display the wisdom tooth, and the tooth analysis information corresponding to the first object is displayed beside the blue filled area. Correspondingly, in the dentition view area, the color of the line frame of the tooth with tooth number 18 is deepened, an exclamation mark is displayed on the tooth with tooth number 18 to display the priority information corresponding to the wisdom tooth, and the tooth number 18 of the first object and wisdom tooth are displayed in the entry in the dentition view area. See Figure 11 .

[0116] For example, if the user performs a selection operation on a first object in the panoramic view area, the tooth analysis information of the first object is wisdom tooth, a blue line frame is used to frame the entry corresponding to the first object, and the entry records the tooth number 18 of the first object, wisdom tooth, an exclamation mark is displayed beside the wisdom tooth, and the tooth analysis result of the first object is that it may affect tooth movement. Correspondingly, in the panoramic view area, a blue highlight is filled in the line frame of the wisdom tooth to display the wisdom tooth, and the tooth analysis information corresponding to the first object is displayed beside the blue filled area. Correspondingly, in the dentition view area, the color of the line frame of the tooth with tooth number 18 is deepened, an exclamation mark is displayed on the tooth with tooth number 18 to display the priority information corresponding to the wisdom tooth, and the tooth number 18 of the first object and wisdom tooth are displayed in the entry in the dentition view area. See

[0117] For example, if the user performs a selection operation on a first object in the panoramic view area, the tooth analysis information of the first object is wisdom tooth, a blue line frame is used to frame the entry corresponding to the first object, and the entry records the tooth number 18 of the first object, wisdom tooth, an exclamation mark is displayed beside the wisdom tooth, and the tooth analysis result of the first object is that it may affect tooth movement. Correspondingly, in the panoramic view area, a blue highlight is filled in the line frame of the wisdom tooth to display the wisdom tooth, and the tooth analysis information corresponding to the first object is displayed beside the blue filled area. Correspondingly, in the dentition view area, the color of the line frame of the tooth with tooth number 18 is deepened, an exclamation mark is displayed on the tooth with tooth number 18 to display the priority information corresponding to the wisdom tooth, and the tooth number 18 of the first object and wisdom tooth are displayed in the entry in the dentition view area. See Figure 12 .

[0118] For example, if the user selects the first object in the panoramic view area, and the tooth analysis information of the first object is a root shadow, a blue line frame is used to display the root shadow, and the tooth analysis information corresponding to the first object is displayed beside the blue line frame. Correspondingly, since the root shadow is not a tooth, the dentition view area does not change, and correspondingly, in the analysis view area, the first object is surrounded by a blue line frame, and the entry corresponding to the first object is recorded in the form of text. The entry displays an exclamation mark beside the root shadow, and the tooth analysis result of the first object is a high-density shadow. Please pay attention to whether it affects tooth movement. It should be noted that the above example is based on the user's selection operation in the panoramic view area. Similarly, the user's selection operation in the dentition view area or the analysis view area has the same display as the above example, and will not be described here. It should be noted that the dentition view area cannot select objects such as root high-density shadows.

[0119] Optionally, when the user's operation in the first view area is a tooth analysis information update operation, each object in the multiple view areas corresponds to a display area for displaying tooth analysis information; the display area is provided with an update operation component. The update operation can be an operation for adding, deleting, or modifying the tooth analysis information of the object, or other update operations, which are not limited here. Since each object in the multiple view areas corresponds to the update operation component, the second view area will be updated synchronously when the update operation is performed in the first view area. Specifically, in the panoramic view area, the object is displayed in the first selection mode, and the updated tooth analysis information of the object is displayed. For example, if the user selects the update operation component of tooth No. 22 in the panoramic view area, please refer to Figure 13 When the update operation component is selected, the update operation component in the panoramic view area displays a first window, and the first window includes various types of tooth analysis information to be selected. When the user selects wisdom teeth, the tooth analysis information of tooth No. 22 is wisdom teeth, and in the dentition view area, the tooth analysis information of tooth No. 22 is wisdom teeth, and in the analysis view area, the tooth analysis information of tooth No. 22 is wisdom teeth.

[0120] In the dentition view area, the object is displayed in the second selection mode, and the updated tooth analysis information and priority information of the object are displayed. The update operation in the dentition view area is the same as the example in the panoramic view area, and will not be described here. The update operation component in the dentition view area can be seen from Figure 14 .

[0121] In the analysis view area, the object is displayed in the third selection mode, and the updated tooth analysis information and priority information of the object are displayed. The update operation component in the analysis view area can be seen fromFigure 15 .

[0122] Optionally, the outline of all teeth can be displayed in the panoramic view area; see [link / reference]. Figure 16 The outline of the teeth can be shown or hidden. This solution uses the option of hiding the outline of the teeth as an example to illustrate the above solution.

[0123] Based on the same technical concept, embodiments of this application provide a panoramic display device, such as... Figure 17 As shown, the device 1700 includes: a display unit 1701 for displaying a display interface including multiple view areas; the multiple view areas include a panoramic view area and an auxiliary view area; the auxiliary view area includes a dental arch view area and / or an analysis view area; a processing unit 1702 for determining the dental feature data corresponding to the first object based on the user's operation on the first object in the first view area; the first view area is either the panoramic view area or the auxiliary view area; determining a first display mode group corresponding to the first object in the display interface according to the dental feature data corresponding to the first object; the first display mode group represents that the multiple view areas display the first object in their respective set dynamic display modes in response to the operation; based on the first display mode group, the first object is displayed in multiple view areas of the display interface in a coordinated manner; wherein, different operations on the same object correspond to different display mode groups, and different types of dental feature data correspond to different display mode groups.

[0124] Optionally, the processing unit 1702 is specifically configured to: for any second view area, determine a second object with an identifier in the second view area based on the identifier of the first object; the second view area is any view area other than the first view area among multiple view areas; the first object and the second object are the same object in different view areas; and determine a dynamic display mode for the second object in the second view area in response to the operation on the first object based on the tooth feature data corresponding to the first object, thereby obtaining a first display mode group for display in multiple view areas.

[0125] Optionally, the display unit 1701 is further configured to: acquire a panoramic image based on a user-triggered analysis operation; identify the panoramic image to obtain tooth feature data corresponding to multiple objects in the panoramic image; and determine a second display mode group corresponding to the object in multiple view areas for each object's tooth feature data; wherein, the second display mode group represents multiple view areas displaying multiple objects in their respective set static display modes; different static display mode groups correspond to different types of tooth feature data. Specifically, the display unit 1701 is configured to: display a display interface including multiple view areas according to the second display mode groups corresponding to multiple objects in multiple view areas.

[0126] Optionally, the tooth feature data includes tooth analysis information; the display unit 1701 is specifically used to: display objects with tooth analysis information in a panoramic view area using a first marking method; the first marking method marks the area of ​​interest of the object and different marking methods correspond to different tooth analysis information; display objects with tooth analysis information in a dentition view area using a second marking method; the second marking method represents different tooth analysis information; and display objects with tooth analysis information in an itemized manner in the analysis view area.

[0127] Optionally, the display unit 1701 is specifically used to: display the object in the panoramic view area based on the tooth shape information and tooth analysis information in the object's tooth feature data, using the color representing the tooth analysis information and the line frame representing the tooth shape information.

[0128] Optionally, the display unit 1701 is specifically used to: for any object with tooth analysis information, based on the tooth number and tooth analysis information in the object's tooth feature data, display the marker representing the tooth analysis information on the tooth corresponding to the tooth number in the dentition view area, and display the priority information corresponding to the tooth analysis information; the priority information is used to show the degree of attention required for the tooth during the treatment process.

[0129] Optionally, the display unit 1701 is specifically used to: treat each object with tooth analysis information as an entry, and record in text form the tooth number, tooth analysis information, tooth analysis results, and priority information corresponding to the tooth analysis information in the tooth feature data; the priority information is used to display the degree of attention required for the tooth during the treatment process; the tooth analysis results are used to characterize the treatment reminders for the tooth during the treatment process.

[0130] Optionally, the display unit 1701 is specifically used to: identify the tooth region through the panoramic image; identify the tooth region with tooth analysis information and the alveolar bone region with tooth analysis information through the first sub-image corresponding to the tooth region in the panoramic image; and identify each object with tooth analysis information through the second sub-image corresponding to each tooth region with tooth analysis information and alveolar bone region in the panoramic image.

[0131] Optionally, the processing unit 1702 is specifically used to: display an object and its corresponding tooth analysis information in a first selection mode in the panoramic view area; the first selection mode is: when the object is a tooth, display the tooth in a first set color according to the tooth shape information of the object; when the object is alveolar bone, display the alveolar bone in a second set color according to the alveolar bone area of ​​the object; in the dentition view area, display the object and its corresponding tooth analysis information and priority information in a second selection mode; the second selection mode is to display the tooth in a third set color; in the analysis view area, display the object and its corresponding tooth number, the corresponding tooth analysis information, the corresponding tooth analysis result, and priority information in a third selection mode; the second selection mode is to display the object by selecting the corresponding item.

[0132] Optionally, the operation is a tooth analysis information update operation; each object has a corresponding display area for displaying tooth analysis information in multiple view areas; the display area is equipped with an update operation component. The processing unit 1702 is specifically used to: display the object in a first selection mode and display the updated tooth analysis information in the panoramic view area; display the object in a second selection mode and display the updated tooth analysis information and priority information in the dentition view area; and display the object in a third selection mode and display the updated tooth analysis information and priority information in the analysis view area.

[0133] Optionally, the tooth number of each tooth is displayed in the panoramic view area, with each tooth number located in the crown area of ​​the corresponding tooth.

[0134] Optionally, the crown region is determined based on the largest triangle inside any tooth, specifically the area closest to the shortest side on the line connecting the vertex of the largest triangle to the midpoint of the shortest side.

[0135] Based on the same technical concept, embodiments of this application provide a computing device, such as... Figure 18 As shown, it includes at least one processor 1801 and a memory 1802 connected to at least one processor. In this embodiment, the specific connection medium between the processor 1801 and the memory 1802 is not limited. Figure 18 Taking the connection between processor 1801 and memory 1802 via a bus as an example, the bus can be divided into address bus, data bus, control bus, etc.

[0136] In this embodiment of the application, the memory 1802 stores instructions that can be executed by at least one processor 1801. By executing the instructions stored in the memory 1802, at least one processor 1801 can perform the steps of the panoramic film display method described above.

[0137] The processor 1801 serves as the control center of the computing device, connecting to various parts of the device via various interfaces and lines. It processes panoramic images by running or executing instructions stored in the memory 1802 and accessing data stored in the memory 1802. Optionally, the processor 1801 may include one or more processing units. The processor 1801 may integrate an application processor and a modem processor. The application processor primarily handles the operating system, user interface, and applications, while the modem processor primarily handles wireless communication. It is understood that the modem processor can also be integrated into the processor 1801. In some embodiments, the processor 1801 and the memory 1802 can be implemented on the same chip; in other embodiments, they can be implemented on separate chips.

[0138] The processor 1801 can be a general-purpose processor, such as a central processing unit (CPU), digital signal processor, application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component, capable of implementing or executing the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly manifested as being executed by a hardware processor, or executed by a combination of hardware and software modules within the processor.

[0139] Memory 1802, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules. Memory 1802 may include at least one type of storage medium, such as flash memory, hard disk, multimedia card, card-type memory, random access memory (RAM), static random access memory (SRAM), programmable read-only memory (PROM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), magnetic storage, magnetic disk, optical disk, etc. Memory 1802 can be any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer device, but is not limited thereto. In the embodiments of this application, memory 1802 can also be a circuit or any other device capable of implementing storage functions for storing program instructions and / or data.

[0140] Based on the same inventive concept, embodiments of this application provide a computer-readable storage medium storing a computer program executable by a computer device, which, when run on the computer device, causes the computer device to perform the steps of the above-described panoramic image display method.

[0141] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0142] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0143] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0144] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0145] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. A method for displaying panoramic images, characterized in that, include: Display interface including multiple view areas; The multiple view areas include a panoramic view area and an auxiliary view area; The auxiliary view area includes a dental arch view area and / or an analysis view area; Based on the user's operation on the first object in the first view area, determine the tooth feature data corresponding to the first object; The first view area is either the panoramic view area or the auxiliary view area; Based on the tooth feature data corresponding to the first object, determine the first display mode group corresponding to the first object on the display interface; The first display mode group represents the plurality of view areas displaying the first object in their respective set dynamic display modes in response to the operation; Based on the first display mode group, the first object is displayed in conjunction with the multiple view areas of the display interface; wherein, different operations on the same object correspond to different display mode groups, and different types of tooth feature data correspond to different display mode groups.

2. The method as described in claim 1, characterized in that, Based on the tooth feature data corresponding to the first object, a first display mode group corresponding to the first object on the display interface is determined, including: For any second view region, a second object with the identifier of the first object is determined in the second view region; the second view region is any view region other than the first view region among the plurality of view regions; the first object and the second object are the same object in different view regions; Based on the tooth feature data corresponding to the first object, a dynamic display mode for the second object in the second view area is determined in response to the operation on the first object, thereby obtaining a first display mode group for display in the plurality of view areas.

3. The method as described in claim 1, characterized in that, Before displaying a screen that includes multiple view areas, the following is also included: Based on user-triggered analysis operations, obtain panoramic images; The panoramic image is identified to obtain the tooth feature data corresponding to multiple objects in the panoramic image; For each object's tooth feature data, a second display mode group is determined for each of the multiple view areas; wherein, the second display mode group represents the multiple view areas displaying the multiple objects in their respective set static display modes; Different static display modes correspond to different types of tooth feature data; The display interface includes multiple view areas, including: A display interface comprising multiple view areas is displayed according to the second display mode group corresponding to the multiple objects in the multiple view areas.

4. The method as described in claim 3, characterized in that, The tooth feature data includes tooth analysis information; According to the second display mode group corresponding to the multiple objects in the multiple view areas, a display interface including multiple view areas is displayed, including: In the panoramic view area, objects with dental analysis information are displayed using a first marking method; the first marking method marks the areas of interest of the object, and different marking methods correspond to different dental analysis information. Objects with tooth analysis information are displayed in the dentition view area using a second marking method; the second marking method represents different types of tooth analysis information. The objects containing tooth analysis information are displayed in an itemized manner in the analysis view area.

5. The method as described in claim 4, characterized in that, Objects with dental analysis information are displayed in the panoramic view area using a first marking method, including: For any object with dental analysis information, the object is displayed in the panoramic view area based on the tooth shape information and dental analysis information in the object's dental feature data, using the color representing the dental analysis information and the line frame representing the tooth shape information.

6. The method as described in claim 4, characterized in that, Objects with tooth analysis information are displayed in the dental arch view area using a second marking method, including: For any object with dental analysis information, based on the tooth number in the object's dental feature data and the dental analysis information, a marker representing the dental analysis information is displayed on the tooth corresponding to the tooth number in the dental arch view area, and priority information corresponding to the dental analysis information is displayed; the priority information is used to show the degree of attention the tooth needs during the treatment process.

7. The method as described in claim 4, characterized in that, The analysis view area displays objects with tooth analysis information in an itemized manner, including: Each object with tooth analysis information is treated as an entry. Each entry records the tooth number, tooth analysis information, tooth analysis results, and priority information corresponding to the tooth analysis information in text format. The priority information is used to indicate the degree of attention required for the tooth during treatment. The tooth analysis results are used to characterize treatment reminders for the tooth during treatment.

8. The method as described in claim 3, characterized in that, The panoramic image is identified to obtain tooth feature data corresponding to multiple objects in the panoramic image, including: The tooth region is identified using the panoramic image; By using the first sub-image corresponding to the tooth region in the panoramic image, the tooth region with tooth analysis information and the alveolar bone region with tooth analysis information are identified. Each object with tooth analysis information is identified by using the second sub-image corresponding to each tooth region and alveolar bone region with tooth analysis information in the panoramic image.

9. The method according to any one of claims 1 to 8, characterized in that, The operation is a selection operation; based on the first display mode group, the first object is displayed in conjunction with the multiple view areas of the display interface, including: In the panoramic view area, the object is displayed in a first selection mode and the corresponding tooth analysis information is displayed; the first selection mode is: when the object is a tooth, the tooth is displayed in a first set color according to the tooth shape information of the object; when the object is alveolar bone, the alveolar bone is displayed in a second set color according to the alveolar bone area of ​​the object. In the dental arch view area, the object is displayed in a second selection mode, along with the corresponding tooth analysis information and priority information; the second selection mode displays the teeth in a third set color. In the analysis view area, the object is displayed in a third selection mode, showing the corresponding tooth number, the corresponding tooth analysis information, the corresponding tooth analysis results, and priority information; the third selection mode is to display the items corresponding to the object by selecting them.

10. The method according to any one of claims 1 to 8, characterized in that, The operation is a tooth analysis information update operation; each object has a corresponding display area in the multiple view areas to display tooth analysis information; the display area is equipped with an update operation component; Based on the first display mode group, the first object is displayed in conjunction with the plurality of view areas of the display interface, including: In the panoramic view area, the object is displayed in a first selection mode, and the updated tooth analysis information of the object is displayed. In the dental arch view area, the object is displayed in a second selection mode, and the updated tooth analysis information and priority information of the object are displayed. In the analysis view area, the object is displayed in a third selection mode, along with updated tooth analysis information and priority information.

11. The method according to any one of claims 1 to 8, characterized in that, The panoramic view area displays the tooth number of each tooth, with each tooth number located in the crown area of ​​the corresponding tooth.

12. The method as described in claim 11, characterized in that, The crown region is determined based on the largest triangle inside any tooth, specifically the area closest to the shortest side on the line connecting the vertex of the largest triangle to the midpoint of the shortest side.

13. A panoramic display device, characterized in that, include: The display unit is used to display an interface that includes multiple view areas; The multiple view areas include a panoramic view area and an auxiliary view area; The auxiliary view area includes a dental arch view area and / or an analysis view area; The processing unit is used to determine the tooth feature data corresponding to the first object based on the user's operation on the first object in the first view area. The first view area is either the panoramic view area or the auxiliary view area; Based on the tooth feature data corresponding to the first object, determine the first display mode group corresponding to the first object on the display interface; The first display mode group represents the multiple view areas displaying the first object in response to the operation by each setting a dynamic display mode; based on the first display mode group, the multiple view areas of the display interface are linked to display the first object; wherein, different operations for the same object correspond to different display mode groups, and different types of tooth feature data correspond to different display mode groups.

14. A computing device, characterized in that, It includes at least one processing unit and at least one storage unit, wherein the storage unit stores a computer program that, when executed by the processing unit, causes the processing unit to perform the method according to any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that, It stores a computer program executable by a computing device, which, when run on the computing device, causes the computing device to perform the method described in any one of claims 1 to 12.

16. A computer program product comprising a computer program / instructions, characterized in that, When the computer program / instructions are executed by the processor, they implement the steps of the method of claim 1.

Images