Oral cavity detection display method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention discloses an oral cavity detection display method and device, electronic equipment and a storage medium. The method comprises the following steps: displaying a shooting preview interface, wherein the shooting preview interface is used for displaying an oral cavity image acquired by a camera in real time; identifying an oral cavity image acquired by the camera in real time to obtain oral cavity detection information corresponding to the oral cavity image; according to oral cavity detection information corresponding to an oral cavity image currently displayed on the shooting preview interface, an indication part is displayed on the currently displayed oral cavity image in an overlapping mode, and the indication part is used for indicating the oral cavity condition corresponding to the currently displayed oral cavity image. The oral condition comprises at least one of an oral cleaning problem, an oral beauty problem and an oral health problem. According to the oral cavity detection display method and device, the electronic equipment and the storage medium, the oral cavity condition corresponding to the oral cavity image displayed in real time can be indicated, the displayed image information is enriched, and the visual effect of oral cavity detection is improved.

Description

Technical Field

[0001] The present application relates to the field of oral care technology, and in particular to a method, device, electronic device and storage medium for displaying oral examinations. Background Art

[0002] As people's awareness of their oral health continues to grow, the demand for convenient and rapid oral health testing is growing. Current oral health testing methods typically use specialized, large-scale equipment, such as dental X-rays, oral CT (Computed Tomography) equipment, and SLR cameras, to capture oral images, which are then analyzed and determined by a professional dentist. Patients wait a while after the test to learn of any oral problems, and the results are typically presented directly, resulting in a limited understanding of their specific oral condition. Summary of the Invention

[0003] The present invention discloses a method, device, electronic device, and storage medium for displaying oral examinations. By superimposing a display indicator on a real-time oral image, the method can indicate the oral condition corresponding to the real-time oral image, enriching the presented image information, helping users to more comprehensively and accurately understand the oral condition, and improving the real-time visualization effect of oral examinations. Furthermore, the method can provide doctors with more intuitive oral auxiliary analysis and facilitate direct communication between doctors and patients regarding oral conditions using oral images.

[0004] The present application discloses an oral cavity detection display method, which is applied to an electronic device. The method includes:

[0005] Displaying a shooting preview interface, wherein the shooting preview interface is used to display the oral cavity image acquired by the camera in real time;

[0006] Identify the oral cavity image acquired by the camera in real time to obtain oral cavity detection information corresponding to the oral cavity image;

[0007] According to the oral detection information corresponding to the oral image currently displayed on the shooting preview interface, an indicator part is superimposed on the currently displayed oral image, and the indicator part is used to indicate the oral condition corresponding to the currently displayed oral image. The oral condition includes at least one of oral cleaning problems, oral aesthetic problems and oral health problems.

[0008] The present application discloses an oral cavity detection display device, which is applied to an electronic device. The device includes:

[0009] A display module is used to display a shooting preview interface, wherein the shooting preview interface is used to display the oral cavity image acquired by the camera in real time;

[0010] An image recognition module is used to recognize the oral cavity image acquired by the camera in real time and obtain oral cavity detection information corresponding to the oral cavity image;

[0011] The display module is further used to superimpose an indicator on the currently displayed oral image based on the oral detection information corresponding to the oral image currently displayed on the shooting preview interface. The indicator is used to indicate the oral condition corresponding to the currently displayed oral image, and the oral condition includes at least one of oral cleaning problems, oral aesthetic problems and oral health problems.

[0012] An embodiment of the present application discloses an electronic device, including a memory and a processor. The memory stores a computer program. When the computer program is executed by the processor, the processor implements the method described in any of the above embodiments.

[0013] An embodiment of the present application discloses a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the processor implements the method described in any of the above embodiments.

[0014] An embodiment of the present application discloses a computer program product, including a computer program. When the computer program is executed by a processor, the processor implements the method described in any of the above embodiments.

[0015] In an embodiment of the present application, a shooting preview interface is displayed, which is used to display the oral image acquired by the camera in real time. The oral image acquired by the camera in real time is identified to obtain oral detection information corresponding to the oral image. Then, based on the oral detection information corresponding to the oral image currently displayed on the shooting preview interface, an indicator is superimposed on the currently displayed oral image. The indicator can be used to indicate the oral condition corresponding to the currently displayed oral image. The oral condition includes at least one of oral cleaning problems, oral aesthetic problems and oral health problems. By superimposing the indicator on the oral image displayed in real time, the oral condition corresponding to the oral image displayed in real time can be indicated, thereby enriching the presented image information, helping users to understand the oral condition more comprehensively and accurately, and improving the visualization effect and accuracy of oral detection. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0017] Figure 1 This is a diagram showing an application scenario of a method for displaying oral cavity detection in one embodiment;

[0018] Figure 2 is a flow chart showing a method for oral cavity detection in one embodiment;

[0019] Figure 3A This is a schematic diagram of a shooting preview interface in one embodiment;

[0020] Figure 3B This is a schematic diagram of a shooting preview interface in another embodiment;

[0021] Figure 4 is a flow chart showing a method for oral cavity detection according to another embodiment;

[0022] Figure 5A This is a schematic diagram of a shooting preview interface in another embodiment;

[0023] Figure 5B This is a schematic diagram of a shooting preview interface in another embodiment;

[0024] Figure 5C This is a schematic diagram of a shooting preview interface in another embodiment;

[0025] Figure 6A This is a schematic diagram of a shooting preview interface in another embodiment;

[0026] Figure 6B This is a schematic diagram of a shooting preview interface in another embodiment;

[0027] Figure 6C This is a schematic diagram of a shooting preview interface in another embodiment;

[0028] Figure 6D This is a schematic diagram of a shooting preview interface in another embodiment;

[0029] Figure 6E This is a schematic diagram of a shooting preview interface in another embodiment;

[0030] Figure 7 A schematic diagram of a question selection list in one embodiment;

[0031] Figure 8 This is a schematic diagram of a shooting preview interface in another embodiment;

[0032] Figure 9 is a flow chart of switching between different oral cavity detection modes in one embodiment;

[0033] Figure 10This is a schematic diagram of a shooting preview interface in another embodiment;

[0034] Figure 11A This is a schematic diagram of a shooting preview interface in another embodiment;

[0035] Figure 11B This is a schematic diagram of a shooting preview interface in another embodiment;

[0036] Figure 11C This is a schematic diagram of a shooting preview interface in another embodiment;

[0037] Figure 12 This is a schematic diagram of a shooting preview interface in another embodiment;

[0038] Figure 13A This is a schematic diagram of a shooting preview interface in another embodiment;

[0039] Figure 13B This is a schematic diagram of a shooting preview interface in another embodiment;

[0040] Figure 14 A block diagram of a display device for oral cavity detection in one embodiment;

[0041] Figure 15 FIG. 1 is a block diagram of an electronic device in one embodiment. DETAILED DESCRIPTION

[0042] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0043] It should be noted that the terms "including," "having," and any variations thereof in the embodiments and drawings of this application are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to the process, method, product, or apparatus.

[0044] It will be understood that the terms "first", "second", etc. used in this application may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish a first element from another element. For example, without departing from the scope of this application, the first sub-element may be referred to as the second sub-element, and similarly, the second sub-element may be referred to as the first sub-element. Both the first sub-element and the second sub-element are sub-elements displayed on the interface, but they are not the same sub-element. The term "plurality" used in this application refers to two or more. The term "and / or" used in this application refers to one of the schemes, or any combination of multiple schemes.

[0045] In related oral examination solutions, the camera of the oral examination device usually captures one or a group of oral images. These images are then printed out and sent to a professional doctor for analysis, or the images are input into an artificial intelligence model for oral analysis to obtain information related to the oral condition. This oral examination solution has a certain degree of lag. During the camera capture process, the user cannot obtain the accurate oral condition in real time, and the shooting angle cannot be adjusted according to the actual oral condition. As a result, the captured oral images are incomplete and the information presented is too little, which seriously affects the results of the oral examination.

[0046] The embodiments of the present application disclose a method, device, electronic device and storage medium for displaying oral examination, which can display images acquired by a camera in real time, and superimpose a display indicator on the real-time displayed oral image, which can indicate the oral condition corresponding to the real-time displayed oral image, enrich the presented image information, help users understand the oral condition more comprehensively and accurately, and improve the visualization effect and accuracy of oral examination.

[0047] Figure 1 FIG. 1 is an application scenario diagram of a method for displaying oral cavity detection in one embodiment. Figure 1 As shown, the oral inspection demonstration method can be applied to electronic devices, including but not limited to oral inspection device 110 and terminal device 120. Oral inspection device 110 may include but not limited to oral cameras, oral endoscopes, oral scanners, etc. Terminal device 120 may include but not limited to mobile phones, tablet computers, PCs (personal computers), central control terminals, etc.

[0048] The oral inspection device 110 may include a handle 112 and a detection unit 114. The detection unit 114 may be provided with a camera that can be used to capture images. When a user uses the oral inspection device 110, the detection unit 114 may be directed toward the interior of the oral cavity, or the detection unit 114 may be inserted into the oral cavity to capture an oral image via the camera. In some embodiments, the oral inspection display method may be applied to the oral inspection device 110. The oral inspection device 110 may further include a display device 116, which may be provided on the handle. The display device 116 may display a shooting preview interface, thereby displaying the oral image captured by the camera and the corresponding oral condition in real time.

[0049] In some embodiments, the oral detection display method can be applied to the terminal device 120. Optionally, the terminal device 120 may include a camera and a display screen. The user can aim the camera of the terminal device 120 at the inside of the mouth and capture the oral image through the camera. The display screen of the terminal device 120 can display a shooting preview interface, thereby displaying the oral image obtained by the camera and the corresponding oral condition in real time.

[0050] As another optional embodiment, the terminal device 120 can establish a communication connection with the oral detection device 110, and the user uses the camera of the oral detection device 110 to capture images and transmit the real-time captured images to the terminal device 120. The display screen of the terminal device 120 can display a shooting preview interface, thereby displaying the oral image captured by the camera of the oral detection device 110 and the corresponding oral condition in real time. By using the oral detection device 110 to capture images and then having the terminal device 120 display the oral image and oral condition in real time, it is possible to simultaneously take into account the convenience of oral image capture and the display effect, allowing users to view oral images and oral conditions while operating, thereby improving the user experience.

[0051] The communication connection established between the terminal device 120 and the oral detection device 110 can be a wired communication connection or a wireless communication connection, such as a Bluetooth communication connection, a Wi-Fi communication connection, etc., and the specific communication connection method is not limited here.

[0052] like Figure 2 As shown, in one embodiment, a method for displaying oral cavity detection is provided, which can be applied to the above-mentioned electronic device. The method may include the following steps:

[0053] Step 210: Display a shooting preview interface, which is used to display the oral cavity image captured by the camera in real time.

[0054] In some embodiments, when the oral cavity detection function is enabled on the electronic device, a shooting preview interface may be displayed. The oral cavity detection function may refer to a function that recognizes an oral cavity image captured by a camera to detect a specific oral condition. The oral cavity image may refer to an image containing at least a portion of the oral cavity. The oral condition may describe any oral problems that exist in the oral cavity.

[0055] Optionally, oral conditions may include but are not limited to at least one of oral hygiene problems, oral aesthetic problems, and oral health problems, wherein oral hygiene problems refer to problems caused by inadequate oral cleaning, such as plaque, foreign matter residue, etc.; oral aesthetic problems refer to problems that affect the aesthetic appearance of teeth, such as uneven teeth, missing teeth, whitening, stained teeth, etc.; oral health problems refer to problems that affect oral health or existing oral health risks, such as oral diseases (such as caries, red and swollen gums, bleeding gums, oral ulcers, gingival wedge-shaped defects), etc. It should be noted that the oral condition indicated by the indicator does not necessarily indicate a negative oral condition, but may also indicate a positive oral condition.

[0056] When the oral cavity detection function is enabled on an electronic device, a camera can be controlled to turn on. This camera can be a camera inside the electronic device or a camera external to the electronic device. After the camera is turned on, it begins capturing images. The electronic device can display the oral cavity images captured by the camera in real time in the shooting preview interface displayed.

[0057] In some embodiments, the shooting preview interface can display each frame of the oral cavity image captured by the camera in real time.

[0058] In some embodiments, in order to ensure the smoothness of the display of the oral image on the shooting preview interface, the oral image displayed on the shooting preview interface can also be updated according to a preset display frame rate, and the preset display frame rate can be lower than the image acquisition frame rate of the camera. That is, the electronic device can obtain the oral image to be displayed from the oral image acquired in real time by the camera every target number of frames (determined by the preset display frame rate) and display it in the shooting preview interface. By skipping frames to display the oral image acquired in real time by the camera, the real-time nature of the oral image displayed on the shooting preview interface is guaranteed, and the display smoothness is also guaranteed.

[0059] As an implementation method, the oral image displayed in the shooting preview interface can be the original oral image captured by the camera in real time. After the camera's image sensor captures the original oral image, it will be directly transmitted to the display device and displayed in the shooting preview interface.

[0060] As another embodiment, the oral image displayed in the shooting preview interface may be a preview image obtained by processing the original oral image captured by the camera in real time. For example, this processing may include, but is not limited to, white balancing, image downsampling, noise reduction, and labeling based on image analysis. After the camera's image sensor captures the original oral image, it may first process the original oral image to generate the oral image to be displayed, which is then transmitted to the display device for display in the shooting preview interface.

[0061] It should be noted that due to delays such as transmission delay and image processing delay in the process of collecting oral images from the camera and then transmitting the oral images to the display device for display, there may be a delayed frame difference between the oral image displayed on the shooting preview interface at the current moment and the oral image collected by the camera at the current moment. The oral image displayed on the shooting preview interface at the current moment is the oral image collected by the camera at the previous historical moment.

[0062] Step 220 , identifying the oral cavity image acquired by the camera in real time, and obtaining oral cavity detection information corresponding to the oral cavity image.

[0063] The electronic device can extract features from the oral image captured in real time by the camera to obtain image features, which may include but are not limited to edge features, color features, texture features, etc. The electronic device can then identify the oral region contained in the oral image based on the extracted image features to obtain oral detection information corresponding to the oral image. Oral detection information may refer to information used to describe the oral condition corresponding to the oral image.

[0064] Optionally, the oral cavity detection information may be used to describe the overall oral condition corresponding to multiple oral regions included in the oral image, and / or may be used to describe the local oral conditions corresponding to each of the multiple oral regions included in the oral image. Furthermore, the oral cavity detection information may describe oral problems existing in the multiple oral regions included in the oral image, and optionally, the oral cavity detection information may also describe the severity of the existing oral problems.

[0065] In some embodiments, the oral detection information may include but is not limited to at least one of oral cleaning information, oral aesthetic information, and oral health information.

[0066] Oral hygiene information can be used to describe the cleanliness of the oral cavity and to analyze oral hygiene issues. Oral hygiene information may include, but is not limited to, at least one of dental plaque information and foreign matter residue information. Plaque information may include one or more of the following: the plaque residue rate in one or more oral regions, the plaque removal rate, and the oral location information corresponding to the oral region with an excessively high plaque residue rate. Foreign matter residue information may include one or more of the following: the presence of foreign matter (such as food residues) and the location of the foreign matter residue.

[0067] Oral aesthetic information can be used to describe the aesthetics of the oral cavity and analyze oral aesthetic issues. Oral aesthetic information may include, but is not limited to, at least one of tooth color information and tooth alignment information. Tooth color information may include one or more of the whitening level corresponding to each tooth, the overall whitening level of multiple teeth, the presence of stained teeth, and the oral location of stained teeth. Tooth alignment information may include one or more of the presence of tooth defects and the overall alignment of teeth.

[0068] Oral health information can be used to describe oral health and analyze oral health issues. Oral health information includes, but is not limited to, at least one of dental health information and gum health information. Dental health information may include, but is not limited to, the presence of caries, the oral location of teeth with caries, and the number of teeth with caries. Gum health information may include, but is not limited to, the presence of bleeding gums, the presence of redness or swelling in the gums, and the oral location of bleeding or redness or swelling in the gums.

[0069] In some embodiments, the electronic device may store an oral detection model, and the oral image acquired by the camera in real time may be input into the oral detection model, and the oral image may be recognized by the oral detection model to obtain oral detection information.

[0070] Furthermore, different oral cavity detection models can be used for different oral conditions. For example, detecting oral hygiene problems can be matched with an oral hygiene detection model. This oral hygiene detection model can be trained based on oral sample images labeled with real oral hygiene information. This oral hygiene detection model can recognize the input oral image and obtain the oral hygiene information corresponding to the oral image.

[0071] For another example, detecting oral aesthetic issues may correspond to an oral aesthetic detection model. The oral aesthetic detection model may be trained based on oral sample images annotated with real oral aesthetic information. The oral aesthetic detection model may recognize the input oral image and obtain the oral aesthetic information corresponding to the oral image.

[0072] For another example, detecting oral health problems can correspond to an oral health detection model. This oral health detection model can be trained based on oral sample images labeled with oral health problem information. This oral health detection model can recognize the input oral image and obtain the oral health information corresponding to the oral image. Furthermore, this oral health detection model can accurately detect whether there are oral health problems in the mouth, and can also detect what type of oral health problems exist in the mouth (for example, it can identify whether there are health problems such as caries, gingival congestion, tooth sensitivity, oral ulcers, etc.). Furthermore, it can also detect the severity of existing oral health problems.

[0073] In the above-mentioned embodiment, oral images can be recognized by using different oral detection models, thereby detecting different oral conditions and improving the accuracy of oral detection.

[0074] In an embodiment of the present application, by analyzing oral images, one or more of oral cleaning information, oral aesthetic information, and oral health information can be obtained as oral detection information, which can help users understand the real oral condition more accurately and comprehensively, and can meet the user's detection needs for different oral problems, enriching the oral detection function.

[0075] As an implementation, the electronic device can identify each frame of oral cavity image captured by the camera and obtain oral cavity detection information corresponding to each frame of oral cavity image. This method can obtain the most complete and accurate oral cavity detection information, improving the accuracy of oral cavity detection and the accuracy of the subsequent display indicator.

[0076] As another embodiment, the electronic device updates the oral image displayed on the shooting preview interface at a preset display frame rate. The electronic device obtains the oral image to be displayed from the oral image captured in real time by the camera at target frame rates. The electronic image to be displayed is then recognized to obtain oral detection information corresponding to the oral image to be displayed. This approach ensures that each frame of the oral image displayed on the shooting preview interface contains accurate oral detection information, improving the accuracy of the indicator displayed subsequently. Furthermore, since the display is performed at the preset display frame rate, the recognition pressure on the oral image is reduced, thereby reducing the resources consumed.

[0077] As another embodiment, the electronic device can obtain a frame of the oral image to be displayed from a sequence of oral images to be displayed (which can be each frame of the oral image captured in real time by a camera, or oral images to be displayed acquired at a preset display frame rate) at a preset time interval for recognition, thereby obtaining oral detection information corresponding to the oral image to be displayed. This approach can reduce the pressure of oral image recognition, reduce the resources occupied, and reduce the power consumption loss of the electronic device.

[0078] Step 230 : Based on the oral detection information corresponding to the oral image currently displayed on the shooting preview interface, an indicator is superimposed on the currently displayed oral image, where the indicator is used to indicate the oral condition corresponding to the currently displayed oral image.

[0079] The electronic device may generate an indicator corresponding to the currently displayed oral image based on the oral detection information corresponding to the oral image currently displayed on the shooting preview interface, and overlay the indicator on the currently displayed oral image. For example, a target layer may be added to the shooting preview interface, and the indicator may be displayed on the target layer.

[0080] For example, the indicator may be represented by one or more of patterns, text, symbols, etc.

[0081] The indicator portion may be used to indicate the overall oral condition corresponding to multiple oral regions included in the currently displayed oral image, and / or may be used to indicate the local oral condition corresponding to one or more oral regions included in the currently displayed oral image. The user's oral cavity may be divided into multiple oral regions, and an oral region may refer to a portion of tissue or structure in the oral cavity.

[0082] Exemplarily, the oral region may include, but is not limited to, one or more of the tooth region, tooth surface, gum region, and tongue region. Furthermore, the tooth region may include one or more teeth, for example, each tooth may be an independent tooth region, or multiple teeth may be considered as a tooth region. The tooth surface may include, but is not limited to, the occlusal surface and the tooth side surface. The occlusal surface is the surface on which the teeth bite, and the tooth side surface may include the inner side surface and the outer side surface. The outer side surface is the surface of the teeth close to the lips, and the inner side surface is the surface of the teeth close to the tongue, etc. The gum region refers to the region corresponding to the gums. The gum region can be divided according to the teeth corresponding to the gums, and the gum portions corresponding to one or more teeth may be considered as a gum region. The tongue region refers to the region in the oral cavity where the tongue is located.

[0083] As an embodiment, the indicator portion can be used to indicate the overall oral condition corresponding to the multiple oral areas contained in the currently displayed oral image. For example, the indicator portion can be used to indicate the overall whitening level corresponding to all oral areas contained in the currently displayed oral image; and / or, can be used to indicate the overall neatness corresponding to all oral areas contained in the currently displayed oral image, etc., but is not limited thereto.

[0084] For example, Figure 3A FIG. 1 is a schematic diagram of a shooting preview interface in an embodiment. Figure 3AAs shown, the electronic device can display a shooting preview interface 300, which can display the oral image 310 obtained by the camera in real time, and superimpose an indicator 320 on the displayed oral image 310, and the indicator 320 can indicate the overall teeth whitening level corresponding to the teeth in the oral image 310.

[0085] As an embodiment, the indicator portion may be used to indicate the local oral conditions corresponding to one or more oral regions included in the currently displayed oral image. For example, the indicator portion may be used to indicate oral regions in the currently displayed oral image that have oral health problems (such as teeth with caries, oral regions with oral ulcers, etc.); and / or, may be used to indicate the whitening levels corresponding to various tooth regions included in the currently displayed oral image; and / or, may be used to indicate oral regions in the currently displayed oral image that have a high level of residual dental plaque, etc., but the present invention is not limited thereto.

[0086] For example, Figure 3B FIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 3B As shown, the electronic device can display a shooting preview interface 300, which can display the oral image 310 obtained by the camera in real time, and superimpose an indicator part 330 on the displayed oral image 310. The indicator part 320 can indicate the teeth whitening levels corresponding to the upper and lower teeth areas in the oral image 310.

[0087] It should be noted that the above-mentioned teeth whitening levels can be set according to actual needs, or can be divided according to tooth color charts.

[0088] In some embodiments, the position where the indicator is superimposed on the currently displayed oral image may be a preset fixed position, that is, the indicator is superimposed and displayed at a preset position on the shooting preview interface.

[0089] In some embodiments, the position where the indicator is superimposed on the currently displayed oral image can be a dynamically changing position, and the superimposed display position can dynamically change according to the oral region corresponding to the oral condition indicated by the indicator. For example, the indicator can be superimposed on the currently displayed oral image around the oral region corresponding to the oral condition indicated by the indicator.

[0090] In some embodiments, the display style of the indicator portion may also dynamically change according to the oral cavity detection information corresponding to the currently displayed oral cavity image.

[0091] As an embodiment, the display style of the indicator unit may be different for different types of oral problems. For example, for teeth whitening problems, the indicator unit may use text to indicate the teeth whitening level; for teeth alignment problems, the indicator unit may use the outer contour lines corresponding to the teeth with poor alignment to indicate the alignment of the teeth; for existing caries problems, the indicator unit may use indicator boxes to indicate the teeth with caries, etc., but the present invention is not limited to these. The display style of the indicator unit displayed in the shooting preview interface can be improved, so that the indicator unit can more intuitively indicate the oral problems existing in the oral image, thereby improving the visual effect of the shooting preview interface.

[0092] By displaying the oral image captured by the camera in real time on the shooting preview interface and superimposing the display indicator on the currently displayed oral image, the detected oral condition can be displayed in real time during the process of the camera shooting the oral image, which facilitates better communication between the user and the doctor based on the real-time displayed shooting preview interface. The camera's shooting angle can also be adjusted instantly according to the real-time displayed shooting preview interface to obtain a more comprehensive oral image.

[0093] In an embodiment of the present application, by superimposing a display indicator on the real-time displayed oral image, the oral condition corresponding to the real-time displayed oral image can be indicated, thereby enriching the presented image information, helping users to understand the oral condition more comprehensively and accurately, and improving the visualization effect and accuracy of oral detection.

[0094] In some embodiments, the indicator portion may include indicator elements corresponding to one or more oral regions in the currently displayed oral image. Figure 4 As shown, a method for displaying oral cavity detection is provided, the method comprising the following steps:

[0095] Step 402: Display a shooting preview interface, which is used to display the oral cavity image captured by the camera in real time.

[0096] Step 404 : Recognize the oral cavity image acquired by the camera in real time to obtain oral cavity detection information corresponding to one or more oral cavity regions in the oral cavity image.

[0097] The electronic device can identify the oral image obtained by the camera in real time and obtain oral detection information corresponding to one or more oral areas in the oral image. The one or more oral areas can be all oral areas in the oral image or part of the oral area in the oral image.

[0098] Optionally, the one or more oral regions may be oral regions with oral problems in the oral image and / or oral regions selected by the user.

[0099] In one embodiment, the electronic device can identify an oral image captured in real time by a camera, determine oral regions in the oral image that have oral problems, and obtain oral detection information corresponding to each oral region in the oral image that has oral problems. Optionally, the oral detection information corresponding to the oral region can include oral position information corresponding to the oral region and corresponding oral problem information.

[0100] Among them, the oral position information is used to indicate the position of the oral area in the oral cavity. Exemplarily, the oral position information can be represented by the image coordinates of the oral area in the oral image, so as to facilitate the subsequent superposition and display of indicator elements on the oral area. Alternatively, the oral position information can be represented by the coordinates of the oral area in the world coordinate system corresponding to the oral cavity. The coordinates of the same oral area in the world coordinate system are the same and are not affected by the position of the oral area in the oral image, so as to facilitate tracking of the same oral area in multiple frames of oral images. Alternatively, the multiple oral areas divided in the oral cavity have corresponding area names, such as the upper teeth area, the lower teeth area, the incisor area, etc. The oral position information can be represented by the corresponding area names of the oral area in the oral cavity, so that the user can more intuitively understand the specific position of the oral area in the oral cavity.

[0101] Oral problem information can be used to describe oral problems present in the oral area. Optionally, the oral problem information may include the problem type and / or problem severity level of the oral problem present in the oral area. The problem type refers to the category of oral problems, such as caries, stained teeth, missing teeth, and excessive dental plaque. The problem severity level indicates the severity of the oral problem present in the oral area. The problem severity level can be set according to actual needs, such as risk, mild problem, moderate problem, severe problem, etc.

[0102] Optionally, the oral problem information may also include a confidence level corresponding to the oral problem existing in the oral area. The confidence level may refer to the probability that the identified oral problem exists in the oral area. The higher the confidence level, the more accurate the identified oral problem.

[0103] As an implementation method, the user can select the oral area that needs to be focused on in the oral image displayed on the shooting preview interface. The electronic device detects the triggered area selection operation, determines the oral area selected by the user, and based on the oral area selected by the user, recognizes the oral image obtained by the camera in real time, and determines the oral detection information corresponding to the oral area selected by the user and the oral image.

[0104] For example, the area selection operation may include, but is not limited to, a click operation, a double-click operation, a slide operation, etc. Taking a click operation as an example, the electronic device may determine the display coordinates corresponding to the triggered click operation, convert the display coordinates to the image coordinate system corresponding to the oral image, determine the image coordinates corresponding to the click operation, and obtain the oral area to which the image coordinates belong as the oral area selected by the user. Taking a slide operation as an example, the electronic device may determine the slide track corresponding to the triggered slide operation, determine the image area of the displayed oral image corresponding to the slide track, and then use the oral area corresponding to the image area as the oral area selected by the user.

[0105] In the above-mentioned embodiment, the user can select the oral area to be tracked according to actual needs. The electronic device can perform real-time tracking and detection of the oral area selected by the user, and display the indicator elements corresponding to the oral area selected by the user in real time on the shooting preview interface to indicate the oral condition corresponding to the oral area selected by the user, thereby meeting the user's needs for real-time tracking and detection of the oral area of focus.

[0106] Step 406: Generate indicator elements corresponding to one or more oral regions based on the oral detection information corresponding to the one or more oral regions in the oral image currently displayed on the shooting preview interface, and overlay the generated indicator elements on the currently displayed oral image.

[0107] The electronic device may overlay an indicator on the currently displayed oral image based on the oral detection information corresponding to the oral image currently displayed on the shooting preview interface. In some embodiments, the oral region may include teeth, and the indicator may be used to indicate the oral condition corresponding to one or more teeth in the currently displayed oral image.

[0108] Optionally, the indicator can be used to indicate the overall oral condition of all teeth in the currently displayed oral image, such as Figure 3A As shown, the teeth whitening levels corresponding to all teeth can be displayed.

[0109] Optionally, the indicator portion can be used to indicate the oral conditions corresponding to all teeth in the currently displayed oral image; or, the indicator portion can be used to indicate the oral conditions corresponding to target teeth in the currently displayed oral image, and the target teeth include teeth with oral problems and / or teeth selected by the user.

[0110] By superimposing the indicator on the oral image currently displayed in the shooting preview interface, the specific conditions of one or more teeth in the currently displayed oral image can be more intuitively indicated, helping users to understand the specific conditions of the teeth more quickly.

[0111] The electronic device can generate indication elements corresponding to one or more oral areas based on the oral detection information corresponding to the one or more oral areas in the oral image currently displayed on the shooting preview interface, and superimpose the generated indication elements on the currently displayed oral image.

[0112] The indicator element can be used to indicate the oral condition of the corresponding oral region. Taking the target oral region among the one or more oral regions as an example, the target oral region can be any oral region among the one or more oral regions, and the indicator element corresponding to the target oral region can be used to indicate the oral condition corresponding to the target oral region in the currently displayed oral image.

[0113] For example, the indicator element may be represented by one or more of a pattern, text, or symbol. The display style of the indicator element corresponding to the target oral region may be determined based on the oral cavity detection information corresponding to the target oral region. If the oral cavity detection information corresponding to the target oral region is different, the display style of the indicator element corresponding to the target oral region may be different.

[0114] The position of the indicator element corresponding to the target oral region, which is superimposed and displayed on the currently displayed oral image, may be related to the image area of the target oral region in the currently displayed oral image. For example, the indicator element corresponding to the target oral region may be superimposed and displayed around the image area corresponding to the target oral region, or the indicator element corresponding to the target oral region may be superimposed and displayed on the image area corresponding to the target oral region.

[0115] In some embodiments, the electronic device may overlay and display an indication element corresponding to the target oral area on the image area corresponding to the target oral area in the currently displayed oral image based on the oral detection information corresponding to the target oral area in the currently displayed oral image.

[0116] After generating the indicator element corresponding to the target oral region, the indicator element corresponding to the target oral region may be superimposed and displayed on the image region corresponding to the target oral region in the currently displayed oral image. Figure 5A FIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 5A As shown, the electronic device can display a shooting preview interface 300, which can display the oral image 310 obtained by the camera in real time, and superimpose an indication element 502 on each tooth in the displayed oral image 310. The indication element 502 may include a number, and the indication element 502 can be used to indicate the teeth whitening level corresponding to the tooth.

[0117] For example, Figure 5B FIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 5BAs shown, the electronic device may display a shooting preview interface 300, which may display an oral image 510 captured by a camera in real time and overlay an indicator element 522 on a tooth detected to have an oral problem in the displayed oral image 510. The indicator element 522 may include an indicator frame, which is overlaid on a tooth detected to have an oral problem in the displayed oral image 510 and may indicate the tooth with the oral problem.

[0118] By superimposing the indicator elements corresponding to the target oral area on the image area corresponding to the target oral area in the currently displayed oral image, the oral condition corresponding to the target oral area can be intuitively displayed on the currently displayed oral image, allowing the user to understand the oral condition of each oral area in the currently displayed oral image more quickly, thereby improving the real-time display effect of oral detection.

[0119] In some embodiments, the electronic device may overlay and display an indication element corresponding to the target oral area on the problem image area corresponding to the target oral area in the currently displayed oral image based on the oral problem information corresponding to the target oral area in the currently displayed oral image.

[0120] In the case where an oral problem exists in the target oral area, the target oral area may only have a partial or complete area with an oral problem. The oral problem information corresponding to the target oral area may include problem location information corresponding to the oral problem existing in the target oral area, and the problem location information may be used to indicate the regional location of the oral problem existing in the target oral area. Based on the problem location information, the problem image area corresponding to the target oral area in the currently displayed oral image may be determined. The problem image area may be the image area corresponding to the area with the oral problem in the target oral area, and the indicator element corresponding to the target oral area may be superimposed on the problem image area corresponding to the target oral area.

[0121] For example, Figure 5C FIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 5C As shown, the electronic device can display a shooting preview interface 300, which can display an oral image 510 captured by a camera in real time and superimpose an indicator element 522 on the problem image area of the tooth detected to have an oral problem on the displayed oral image 510. The indicator element 522 may include an indicator frame, which is superimposed on the problem image area of the tooth with the oral problem and can indicate the specific area or location of the tooth with the oral problem. For example, the indicator element 522 can indicate the location of caries on the tooth, or indicate the specific area of redness or swelling in the gum area, etc.

[0122] By superimposing the indicator elements corresponding to the target oral area on the problem image area corresponding to the target oral area in the currently displayed oral image, the specific area or specific location where the oral problem exists in the target oral area can be accurately and intuitively displayed, allowing the user to more quickly understand the specific area or specific location where the oral problem exists in one or more oral areas in the currently displayed oral image, thereby improving the real-time display effect of oral detection.

[0123] It should be noted that the above-mentioned indicator frame can be a regular geometric shape, such as a square, rectangle, circle, oval, etc., and the indicator frame can also be an irregular geometric shape, which is not limited here. The indicator frame can more intuitively display the oral condition of the oral area, improving the display effect of real-time oral examination.

[0124] In an embodiment of the present application, by superimposing and displaying indicator elements corresponding to one or more oral areas on the currently displayed oral image, the oral conditions corresponding to one or more oral areas in the real-time displayed oral image can be indicated, and the specific oral conditions of each oral area can be intuitively presented, helping users to understand the oral conditions more comprehensively and accurately, thereby improving the display effect of real-time oral detection.

[0125] The display of the indicator elements corresponding to each oral region is described below.

[0126] In some embodiments, the oral detection information corresponding to the target oral area may include information of multiple dimensions, and the indication element includes sub-elements corresponding to the information of the multiple dimensions, and the sub-elements corresponding to information of different dimensions have different display styles.

[0127] For example, the display style corresponding to the sub-element may include, but is not limited to, at least one of a display pattern, display text, display color, display size, and display line thickness corresponding to the sub-element. The display styles of sub-elements corresponding to information of different dimensions are different. For example, the sub-elements corresponding to information of some dimensions may be indicator boxes, the sub-elements corresponding to information of some dimensions may be text, and the sub-elements corresponding to information of some dimensions may be corner points, etc., but the present invention is not limited thereto.

[0128] Optionally, the oral cavity detection information corresponding to the target oral region may include oral position information and oral problem information corresponding to the target oral region. The first sub-element is used to indicate the oral position information corresponding to the target oral region, and the second sub-element is used to indicate the oral problem information corresponding to the target oral region. Furthermore, the display style of the first sub-element is different from that of the second sub-element.

[0129] For example, Figure 6A FIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 6AAs shown, the electronic device can display a shooting preview interface 300, which can display the oral image 510 captured by the camera in real time, and superimpose an indicator element on one or more teeth in the displayed oral image 510. The indicator element may include a first sub-element 604 and a second sub-element 602. The first sub-element 604 may be a corner mark pattern, and the second sub-element 602 may be an indicator frame. The corner mark pattern can be used to indicate the location of the oral area, and the indicator frame can be used to indicate the oral problems present in the oral area. By indicating the location of the oral area and the oral problems present by different sub-elements, the indicator element of the indicator part can present richer information, thereby improving the visual effect of real-time oral detection.

[0130] It should be noted that the first sub-element 604 and the second sub-element 602 can also be other display styles. For example, the first sub-element 604 can be a lead line extending from the oral area to indicate the position of the oral area, and the second sub-element 602 can be text to indicate oral problems existing in the oral area, etc., which is not limited here.

[0131] In the above-mentioned embodiment, the indicator element corresponding to the oral area may include sub-elements corresponding to information of multiple dimensions, so that the indicator element can present information of multiple dimensions, enriching the presented image information. The user can intuitively obtain the information of multiple dimensions detected in real time through the shooting preview interface, helping the user to understand the oral condition more comprehensively and accurately, thereby improving the user experience.

[0132] In some embodiments, the oral problem information may include the type of oral problem and / or the severity level of the problem; the second sub-element corresponding to the target oral area can be used to indicate the type of oral problem and / or the severity level of the problem existing in the target oral area, and the display style of the second sub-elements corresponding to different problem types is different, and / or the display style of the second sub-elements corresponding to different problem severity levels is different.

[0133] The display style of the second sub-element may be different for different types of oral problems; and / or the display style of the second sub-element may be different for different levels of problem severity.

[0134] Optionally, the display style may include, but is not limited to, at least one of a display pattern, a display color, a display size, and a display line thickness. For example, for different types of oral problems, second sub-elements of different colors may be displayed, or for different types of oral problems, second sub-elements of different shapes may be displayed. For another example, for different severity levels of the same oral problem, the line thickness of the displayed second sub-element may be different, with the higher the severity level (indicating a more severe oral problem), the thicker the line of the displayed second sub-element.

[0135] For example, Figure 6B FIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 6B As shown, the electronic device can display a shooting preview interface 300, which can display an oral image 510 captured by the camera in real time and overlay an indicator element on one or more teeth in the displayed oral image 510. The indicator element can include a first sub-element 604 and a second sub-element 602. The second sub-element 602 can be an indicator frame. The indicator frame can have different colors for different types of oral problems. For example, the indicator frame corresponding to a tooth with caries can be displayed in black, and the indicator frame corresponding to a tooth with residual plaque can be displayed in gray, etc., but the present invention is not limited thereto.

[0136] For example, Figure 6C FIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 6C As shown, the electronic device can display a shooting preview interface 300, which can display an oral image 510 captured by a camera in real time and overlay an indicator element on one or more teeth in the displayed oral image 510. The indicator element can include a first sub-element 604 and a second sub-element 602. The second sub-element 602 can be an indicator box. The thickness of the line displayed in the indicator box varies according to the severity of the problem. For example, the thicker the line displayed in the indicator box, the higher the severity of the problem. For example, the line of the indicator box corresponding to a tooth with severe caries is thicker than the line of the indicator box corresponding to a tooth with mild caries.

[0137] In the above-mentioned embodiment, by superimposing the second sub-element corresponding to the oral area on the currently displayed oral image, and the display styles of the second sub-elements corresponding to different types of problems are different, and / or the display styles of the second sub-elements corresponding to different problem severity levels are different, the problem types and / or problem severity levels of the oral problems existing in the oral area can be intuitively presented, thereby improving the information richness displayed on the shooting preview interface and improving the visualization effect of real-time oral detection.

[0138] In some embodiments, when there are at least two oral problems in the target oral area, the indicator element corresponding to the target oral area includes a first sub-element and second sub-elements corresponding to the at least two oral problems respectively. The second sub-elements corresponding to different oral problems have different display styles.

[0139] If at least two oral problems are detected in the target oral area in the currently displayed oral image, the first sub-element corresponding to the target oral area and the second sub-elements corresponding to the various oral problems existing in the target oral area can be superimposed and displayed on the currently displayed oral image, thereby intuitively displaying the various oral problems existing in the target oral area.

[0140] For example, Figure 6D FIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 6D As shown, the electronic device can display a shooting preview interface 300, which can display an oral image 510 captured by a camera in real time, and overlay an indicator element on one or more teeth in the displayed oral image 510. The indicator element may include a first sub-element 604, a second indicator element 612, and a second indicator element 614, wherein the second indicator element 612 and the second indicator element 614 correspond to oral problems of different types, for example, the second indicator element 612 indicates that there is a problem of residual dental plaque on the teeth, and the second indicator element 614 indicates that there is a problem of caries on the teeth, etc., but is not limited thereto. In this way, the oral problems existing in the oral area can be more comprehensively displayed, which improves the richness of information presented in the shooting preview interface, thereby helping users to understand the oral condition more comprehensively and accurately.

[0141] In some embodiments, when there are at least two oral problems in the target oral region, only one second sub-element corresponding to the target oral region may be superimposed and displayed on the currently displayed oral image.

[0142] When there are at least two oral problems in the target oral area, the second sub-element can be used to indicate the oral problem information corresponding to the oral problem with the highest severity level in the target oral area; or, when there are at least two oral problems in the target oral area, the second sub-element can be used to indicate the oral problem information corresponding to the oral problem with the highest priority in the target oral area.

[0143] As an embodiment, if at least two oral problems are detected in the target oral region in the currently displayed oral image, the problem severity levels corresponding to the at least two oral problems can be obtained, and the oral problem with the highest problem severity level can be determined. A corresponding second sub-element can be generated based on the oral problem information of the oral problem with the highest problem severity level. The second sub-element corresponding to the oral problem with the highest problem severity level in the target oral region can be superimposed on the currently displayed oral image, and the second sub-element is used to indicate the oral problem with the highest problem severity level in the target oral region.

[0144] For example, Figure 6EFIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 6E As shown, assuming that a tooth in the displayed oral image 510 has both a dental plaque residue problem and a dental caries problem, wherein the problem severity level of the dental plaque residue problem is mild and the problem severity level of the dental caries problem is severe, then the first sub-element 604 and the second indicator element 614 can be superimposed and displayed on the tooth in the displayed oral image 510. The second indicator element 614 can be used to indicate that the tooth has a dental caries problem, and further, can also indicate that the dental caries problem of the tooth is severe.

[0145] As an embodiment, if at least two oral problems are detected in the target oral region in the currently displayed oral image, the priorities corresponding to the at least two oral problems can be obtained, and the oral problem with the highest priority can be determined. A corresponding second sub-element can be generated based on the oral problem information of the oral problem with the highest priority. The second sub-element corresponding to the oral problem with the highest priority in the target oral region can be superimposed on the currently displayed oral image, and the second sub-element is used to indicate the oral problem with the highest priority in the target oral region.

[0146] Oral problems of different types may have the same or different priorities. Alternatively, oral conditions may include multiple broad categories of oral problems, such as oral hygiene problems, oral aesthetic problems, and oral health problems. These broad categories of oral problems may have different priorities. For example, oral health problems may have a higher priority than oral hygiene problems, which in turn may have a higher priority than oral aesthetic problems.

[0147] For example, oral problems in subcategories within a broad category may have the same priority level. For example, tooth staining and missing teeth may have the same priority level, and gingival swelling and bleeding gums may have the same priority level. It should be noted that subcategories within a broad category may also have different priorities. For example, oral health problems may include dental caries, gingival swelling, and bleeding gums, and dental caries may have a higher priority level than gingival swelling.

[0148] The priorities corresponding to each type of oral problem can be uniformly defined and set by the equipment manufacturer, or can be set by the user according to actual needs. For example, the user can set the oral problems that the user is more concerned about to have a higher priority, which can meet the needs of different users.

[0149] For example, Figure 6EFor example, assuming that a tooth in the displayed oral image 510 has both a dental plaque residue problem and a dental caries problem, wherein the priority of the dental plaque residue problem is lower than the priority of the dental caries problem, the first sub-element 604 and the second indicator element 614 can be superimposed and displayed on the tooth in the displayed oral image 510, and the second indicator element 614 can be used to indicate that the tooth has a dental caries problem.

[0150] In the above-mentioned embodiment, when there are at least two oral problems in the target oral area, only a second sub-element corresponding to the target oral area can be superimposed and displayed on the currently displayed oral image. This can avoid the situation where the displayed second sub-element excessively interferes with the information presentation when there are many oral problems in the oral area. The second sub-element is used to indicate the oral problem with the highest severity level or the highest priority in the oral area, thereby ensuring the validity of the information presented by the second sub-element.

[0151] In some embodiments, the second sub-element corresponding to the target oral region can be used to indicate oral problem information corresponding to the target oral problem in the target oral region. The target oral problem can be determined based on a triggered problem selection operation or based on a currently running target detection mode.

[0152] As an embodiment, the electronic device may display a question selection list, which may include oral problems of various types, and the user may select the target oral problem to be detected according to actual needs. For example, Figure 7 FIG. 7 is a schematic diagram of a question selection list in one embodiment. The electronic device can display the question selection list 700 , and the user can select the target oral problem to be tested in the question selection list 700 according to actual needs.

[0153] The electronic device detects the question selection operation and can respond to the question selection operation to determine the target oral problem selected by the user. Furthermore, based on the target oral problem selected by the user, the electronic device can identify the oral image captured by the camera in real time to obtain oral detection information corresponding to the target oral problem.

[0154] As another embodiment, the electronic device may support multiple oral detection modes, and different oral detection modes support different types of oral problems to be detected. For example, the electronic device may support oral detection modes such as whitening detection mode, orthodontic detection mode, cleanliness detection mode, and dental disease detection mode. Among them, the whitening detection mode can support the detection of teeth whitening level, the orthodontic detection mode can support the detection of teeth neatness, the cleanliness detection mode can support the detection of oral cleanliness, and the dental disease detection mode can support the detection of oral diseases, etc., without limitation here.

[0155] Optionally, the user can select a desired oral detection mode based on actual needs. Upon detecting a mode selection operation, the electronic device can determine the currently running target oral detection mode in response to the mode selection operation. Based on the target oral detection mode, the electronic device can identify the oral image captured by the camera in real time, obtaining oral detection information corresponding to the oral image and the target oral detection mode, thereby obtaining oral detection information corresponding to the target oral problem that the target oral detection mode supports. This approach enables flexible detection of oral images captured by the camera in real time.

[0156] The oral detection information corresponding to the target oral area and the target oral problem may include one or more information such as whether the target oral problem exists in the target oral area, the severity of the problem corresponding to the target oral problem, and the problem location information corresponding to the target oral problem.

[0157] A second sub-element corresponding to the target oral area can be generated based on the oral detection information corresponding to the target oral area and the target oral problem. The second sub-element can be used to indicate the presence of the target oral problem in the target oral area. Further, it can also be used to indicate the severity level of the target oral problem in the target oral area.

[0158] For example, Figure 8 FIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 8 As shown, assuming that the target oral problem is a caries problem, the electronic device can display a shooting preview interface 300. The shooting preview interface 300 can display the oral image 510 obtained by the camera in real time, and superimpose an indication element on the teeth with caries problems in the displayed oral image 510. The indication element may include a first sub-element 604 and a second sub-element 602. The second sub-element 602 is used to indicate that the teeth have caries problems.

[0159] In the above-mentioned embodiment, a second sub-element corresponding to the oral area where the target oral problem exists can be superimposed on the currently displayed oral image, so that the real-time displayed image information is more focused on the oral problem that the user is concerned about, thereby improving the effectiveness of the information presented by the second sub-element.

[0160] In some embodiments, the electronic device may support a first oral cavity detection mode and a second oral cavity detection mode, and the electronic device may switch between the first oral cavity detection mode and the second oral cavity detection mode. The first oral cavity detection mode and the second oral cavity detection mode may be two of the multiple oral cavity detection modes supported by the electronic device. Figure 9 As shown, the above method may further include the following steps:

[0161] Step 902 : Run the first oral cavity detection mode, identify the first oral cavity image corresponding to the first oral cavity detection mode and acquired in real time by the camera, and obtain oral cavity detection information corresponding to the first oral cavity image.

[0162] Step 904: Based on the oral detection information corresponding to the first oral image currently displayed on the shooting preview interface, a first indicator is superimposed on the currently displayed first oral image. The first indicator is used to indicate the oral problem corresponding to the first oral detection mode of the currently displayed first oral image.

[0163] The electronic device may first operate a first oral cavity detection mode and obtain a first oral cavity image captured in real time by a camera in the first oral cavity detection mode. The electronic device may then recognize the first oral cavity image based on the first oral cavity detection mode to obtain oral cavity detection information corresponding to the first oral cavity image. The oral cavity detection information may include oral problem information corresponding to the first oral cavity image and the first oral cavity detection mode. For example, the oral problem information may be used to indicate one or more of the following information: whether a target oral problem supported by the first oral cavity detection mode exists in the oral region of the first oral cavity image, the severity of the problem corresponding to the target oral problem, and the location of the problem corresponding to the target oral problem.

[0164] For example, if the first oral detection mode is a whitening detection mode, the first oral image obtained by the camera in the whitening detection mode can be identified to obtain oral detection information corresponding to the first oral image. The oral detection information may include the tooth whitening level corresponding to one or more teeth.

[0165] Based on the oral cavity detection information corresponding to the first oral cavity image, a first indicator corresponding to the first oral cavity image may be generated and displayed superimposed on the currently displayed first oral cavity image. The first indicator may be used to indicate the overall oral cavity conditions corresponding to the first oral cavity detection mode for multiple oral cavity regions in the first oral cavity image, and / or may be used to indicate the local oral cavity conditions corresponding to the first oral cavity detection mode for one or more oral cavity regions in the first oral cavity image.

[0166] For example, the first oral detection mode is a whitening detection mode. On the currently displayed first oral image, the superimposed first indicator portion can be used to indicate the overall tooth whitening level corresponding to all teeth in the currently displayed first oral image; and / or, the first indicator portion can be used to indicate the local tooth whitening level corresponding to one or more teeth in the currently displayed first oral image, etc., which is not limited here.

[0167] Step 906: When the preset switching conditions are met, switch from the first oral cavity detection mode to the second oral cavity detection mode, identify the second oral cavity image corresponding to the second oral cavity detection mode acquired by the camera in real time, and obtain oral cavity detection information corresponding to the second oral cavity image.

[0168] The electronic device can determine whether a preset switching condition is met, and the preset switching condition may refer to a condition that triggers the switching of the oral cavity detection mode. If the preset switching condition is met, the device can switch from the first oral cavity detection mode to the second oral cavity detection mode.

[0169] In some embodiments, the preset switching condition may include but is not limited to at least one of the following:

[0170] (1) The running time corresponding to the first oral cavity detection mode is greater than or equal to the time threshold.

[0171] The device can start timing the first oral cavity detection mode and record the duration of the first oral cavity detection mode. It can then determine whether the duration is greater than or equal to a duration threshold. If the duration of the first oral cavity detection mode is greater than or equal to the duration threshold, it indicates that the first oral cavity detection mode has been running for a long time, and the device can then switch to the second oral cavity detection mode.

[0172] (2) The number of first oral cavity images acquired by the camera in the first oral cavity detection mode is greater than or equal to a first number threshold.

[0173] The number of first oral cavity images captured by the camera in the first oral cavity detection mode may be counted, and a determination may be made as to whether the number of first oral cavity images is greater than or equal to a first threshold value. If the number of first oral cavity images captured by the camera in the first oral cavity detection mode is greater than or equal to the first threshold value, it indicates that a sufficient number of first oral cavity images have been captured for analysis in the first oral cavity detection mode, and the camera may then switch to the second oral cavity detection mode.

[0174] (3) In the first oral cavity detection mode, no oral cavity area with oral problems is detected.

[0175] If, after identifying the first oral image obtained by the camera in real time in the first oral detection mode, the obtained oral detection information indicates that the target oral problem corresponding to the first oral detection mode is not detected, it means that the target oral problem corresponding to the first oral detection mode does not exist in the mouth, then you can switch to the second oral detection mode.

[0176] For example, the first oral cavity detection mode is a cleanliness detection mode. After identifying the first oral cavity image acquired by the camera in real time in the first oral cavity detection mode, if no oral cavity cleaning problem is detected, the second oral cavity detection mode can be switched.

[0177] To further improve the accuracy of oral cavity detection, a target detection duration or target detection number can be set. If the duration of time in which the camera continuously fails to detect an oral area with an oral problem reaches the target duration, or the number of first oral cavity images in which the camera continuously fails to detect an oral area with an oral problem reaches the target detection number, the system can switch to the second oral cavity detection mode. This ensures that in the first oral cavity detection mode, the camera can perform a more comprehensive oral cavity detection for a sufficient period of time to avoid missed detections.

[0178] (4) A triggered mode switching operation is detected.

[0179] The user can switch to the oral detection mode according to actual needs. If the electronic device detects a triggered mode switching operation, it can respond to the mode switching operation and switch from the first oral detection mode to the second oral detection mode.

[0180] Optionally, the operation method of the mode switching operation may include but is not limited to pressing a designated key, clicking a displayed mode switching button, performing a preset gesture operation, inputting a preset voice command, etc.

[0181] In an embodiment of the present application, by setting one or more preset switching conditions, when the preset switching conditions are met, the switching of the oral detection mode is triggered, thereby improving the flexibility and accuracy of switching between multiple oral detection modes.

[0182] Step 908: Based on the oral detection information corresponding to the second oral image currently displayed on the shooting preview interface, a second indicator is superimposed on the currently displayed second oral image. The second indicator is used to indicate the oral condition of the currently displayed second oral image corresponding to the second oral detection mode.

[0183] After switching to the second oral cavity detection mode, a second oral cavity image captured in real time by the camera in the second oral cavity detection mode is obtained, and the second oral cavity image can be recognized based on the second oral cavity detection mode to obtain oral cavity detection information corresponding to the second oral cavity image. The oral cavity detection information may include oral problem information corresponding to the second oral cavity image and the second oral cavity detection mode. For example, the oral problem information can be used to indicate one or more of the following information: whether the oral cavity area of the second oral cavity image has a target oral problem that can be detected by the second oral cavity detection mode, the severity of the problem corresponding to the target oral problem, and the location of the problem corresponding to the target oral problem.

[0184] Based on the oral cavity detection information corresponding to the second oral cavity image, a second indicator corresponding to the second oral cavity image can be generated and displayed superimposed on the currently displayed first oral cavity image. This second indicator can be used to indicate the overall oral cavity conditions corresponding to the second oral cavity detection mode for multiple oral cavity regions in the second oral cavity image, and / or can be used to indicate the local oral cavity conditions corresponding to the second oral cavity detection mode for one or more oral cavity regions in the second oral cavity image.

[0185] For example, the second oral cavity detection mode is a dental disease detection mode, and the second indication portion can be used to indicate the oral cavity area with dental disease in the currently displayed second oral cavity image, etc., which is not limited here.

[0186] It should be noted that, for the description of the specific display of the first indicator part and the second indicator part in the above embodiment, reference can be made to the relevant description of the indicator part in the above embodiments, and no further repetition will be given here.

[0187] As an implementation method, a first oral cavity detection mode and a second oral cavity detection mode can be selected from a plurality of oral cavity detection modes supported by the electronic device as a mode combination, and flexible switching between the first oral cavity detection mode and the second oral cavity detection mode within the mode combination can be achieved. Optionally, the switching method can also be alternating between the first oral cavity detection mode and the second oral cavity detection mode. After running the second oral cavity detection mode, it can be switched back to the first oral cavity detection mode, and then switched to the second oral cavity detection mode. This can realize the recognition of oral cavity images captured by the camera at the same or similar angles in different oral cavity detection modes, and indicate the oral conditions in different oral cavity detection modes in real time, helping users to understand the oral condition more comprehensively and accurately.

[0188] It should be noted that the mode combination may be pre-selected and set by the device manufacturer, or may be set by the user according to actual needs, and is not limited here.

[0189] As another implementation, multiple oral cavity detection modes supported by the electronic device may be switched in turn. The multiple oral cavity detection modes may be sorted in a certain order and switched in sequence to achieve flexible switching between all oral cavity detection modes.

[0190] In an embodiment of the present application, the electronic device can flexibly switch between different supported oral detection modes, detect corresponding oral conditions in different oral detection modes, and indicate the oral conditions detected in different oral detection modes in real time in the shooting preview interface, enriching the presented image information, helping users to understand the oral condition more comprehensively and accurately, and improving the visualization effect and oral detection performance of oral detection.

[0191] In some embodiments, the above method may further include: displaying, based on the currently displayed oral image, an enlarged image corresponding to one or more local image regions in the currently displayed oral image.

[0192] In addition to displaying the oral image captured by the camera in real time on the shooting preview interface and superimposing an indicator on the displayed oral image, the electronic device can also display an enlarged image corresponding to one or more partial image areas in the currently displayed oral image. Optionally, a partial image area can correspond to an oral area, or can correspond to a portion of an oral area. For example, a partial image area can correspond to an area within the oral area where an oral problem exists.

[0193] In some embodiments, one or more local image regions to be magnified can be determined within the currently displayed oral image. These one or more local image regions can be extracted and magnified to obtain magnified images corresponding to the respective local image regions. The magnified images corresponding to the respective local image regions can then be displayed independently, thereby clearly presenting the magnified images corresponding to the respective local image regions.

[0194] In some embodiments, the above-mentioned local image area can be determined in response to a triggered area magnification operation; and / or, the above-mentioned local image area can be an image area corresponding to the oral area where oral problems exist in the currently displayed oral image.

[0195] As an implementation, the user can select an oral region to be magnified and displayed independently in the oral image displayed on the shooting preview interface, and use the image region corresponding to the selected oral region as the local image region to be magnified. The user can also directly select an image region to be magnified and displayed independently in the oral image displayed on the shooting preview interface as the local image region to be magnified.

[0196] Exemplarily, the area magnification operation may include but is not limited to a click operation, a double-click operation, a sliding operation, etc. Taking the sliding operation as an example, the electronic device may determine the sliding track corresponding to the triggered sliding operation, and determine the image area of the displayed oral image corresponding to the sliding track, and use the image area as the local image area to be magnified. Taking the double-click operation as an example, the electronic device may determine the display coordinates corresponding to the triggered double-click operation, and convert the display coordinates to the image coordinate system corresponding to the oral image, determine the image coordinates corresponding to the double-click operation, thereby determining the oral region to which the image coordinates belong, and then use the image area corresponding to the oral region as the local image region to be magnified.

[0197] In the above embodiment, the user can select the local image area that needs to be enlarged and displayed according to actual needs, and display the enlarged image corresponding to the local image area, thereby presenting more image details of the local image area that the user focuses on, improving the visualization effect, and improving the user experience.

[0198] As an embodiment, the local image area that needs to be enlarged can be the image area corresponding to the oral area with oral problems in the currently displayed oral image. The electronic device can determine the oral area with oral problems based on the oral problem information corresponding to the currently displayed oral image, and obtain the image area corresponding to the oral area with oral problems as the local image area that needs to be enlarged. Optionally, the complete image area corresponding to the oral area with oral problems can be obtained as the local image area that needs to be enlarged, or the problem image area corresponding to the oral area with oral problems can be obtained as the local image area that needs to be enlarged, which is not limited here.

[0199] By enlarging the image area corresponding to the oral area with oral problems and displaying it independently, more details of the oral area with oral problems can be presented, helping users or doctors to better observe and analyze existing oral problems, and improving the visualization effect of real-time oral detection.

[0200] In some embodiments, since the display space of the shooting preview interface is limited, the maximum number N of enlarged images that can be displayed in the shooting preview interface can be set. The maximum number N can be a positive integer. For example, the maximum number N can be 1, 3, 5, 6, etc., but is not limited to this.

[0201] The electronic device may determine whether the number of oral regions with oral problems in the currently displayed oral image is greater than N. In some embodiments, if the number of oral regions with oral problems in the currently displayed oral image is less than or equal to N, enlarged images of the local image regions corresponding to all oral regions with oral problems may be displayed based on the currently displayed oral image.

[0202] If the number of oral regions with oral problems in the currently displayed oral image is less than or equal to the maximum number N, it indicates that the number of oral regions with oral problems in the currently displayed oral image is relatively small. Therefore, the image regions corresponding to all oral regions with oral problems in the currently displayed oral image can be obtained as local image regions, and the local image regions can be enlarged to obtain and display the enlarged images. Using this method, the enlarged images corresponding to the oral regions with oral problems can be more comprehensively displayed, presenting more detailed information about each oral region with oral problems, and improving the display effect of real-time oral detection.

[0203] In some embodiments, if the number of oral areas with oral problems in the currently displayed oral image is greater than N, N oral areas with oral problems can be selected from the currently displayed oral image according to preset rules, and enlarged images of the local image areas corresponding to the N oral areas can be displayed based on the currently displayed oral image.

[0204] Optionally, all oral areas with oral problems in the currently displayed oral image may be selected in descending order of the severity of the oral problems, with the oral areas with the highest severity of the oral problems being ranked in the top N oral areas; or, all oral areas with oral problems in the currently displayed oral image may be selected in descending order of the priority of the oral problems, with the oral areas with the highest priority of the oral problems being ranked in the top N oral areas.

[0205] For example, when the number of oral areas with oral problems in the currently displayed oral image is greater than N, it is impossible to enlarge and display all the image areas corresponding to the oral areas with oral problems in the currently displayed oral image. In this case, the oral areas with oral problems in the currently displayed oral image can be sorted in descending order of the severity of the oral problems, and the image areas corresponding to the first N oral areas can be used as the local image areas that need to be enlarged.

[0206] For example, the oral areas with oral problems in the currently displayed oral image can be sorted in descending order of priority, and the image areas corresponding to the first N oral areas can be used as the local image areas that need to be enlarged.

[0207] For example, Figure 10 FIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 10 As shown, the electronic device can display a shooting preview interface 1000. The shooting preview interface 1000 can display an oral image 510 captured in real time by a camera, and an indicator portion can be superimposed on the currently displayed oral image 510 to indicate the oral area detected to have an oral problem. Assuming that the maximum number N of magnified images that can be displayed in the shooting preview interface is 3, since there are four oral areas with oral problems in the currently displayed oral image 510, the local image areas corresponding to three of the oral areas can be selected for magnification to obtain corresponding magnified images 1020, and the magnified images 1020 corresponding to the three oral areas are displayed in the shooting preview interface 1000.

[0208] In an embodiment of the present application, if there are too many oral regions with oral problems in the currently displayed oral image, the image regions corresponding to the N oral regions that need to be magnified and displayed can be selected according to preset rules to ensure the accuracy and rationality of the magnified image display and avoid information interference caused by too many magnified images being displayed. Furthermore, oral regions with higher problem severity or higher priority can be preferentially selected for magnification and independent display, which not only improves the information richness of the display but also ensures the validity of the information presented by the magnified images.

[0209] In some embodiments, the enlarged image corresponding to the local image area in the currently displayed oral image may be displayed in any of the following ways:

[0210] Method 1: Switch the oral cavity image currently displayed in the shooting preview interface to an enlarged image corresponding to a local image area for display.

[0211] After generating an enlarged image corresponding to a local image area, the currently displayed oral image can be directly switched to the enlarged image for display. Optionally, the displayed enlarged image can be subsequently updated based on the oral image captured in real time by the camera. The displayed enlarged image changes in real time based on the real-time oral image captured, making it easier for the user to track and observe the oral area corresponding to the local image area.

[0212] For example, Figure 11A FIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 11A As shown, the electronic device can display a shooting preview interface 1000, which can display an oral image 510 captured in real time by a camera, and overlay an indicator on the currently displayed oral image 510. After generating an enlarged image corresponding to the local image area, the oral image 510 currently displayed on the shooting preview interface 1000 can be switched to the enlarged image 1020.

[0213] Method 2: Display the currently displayed oral image in the first area of the shooting preview interface, and display the enlarged image corresponding to the local image area in the second area of the shooting preview interface, and the first area and the second area at least partially do not overlap.

[0214] The shooting preview interface can simultaneously display the oral image and a magnified image of the corresponding local image area. The currently displayed oral image can be displayed in the first area of the shooting preview interface, and the magnified image of the corresponding local image area can be displayed in the second area of the shooting preview interface. The first and second areas can be non-overlapping, or they can overlap slightly. More images can be displayed in the same shooting preview interface without occlusion, improving the display quality of the shooting preview interface.

[0215] For example, Figure 10 As shown, the oral image 510 acquired by the camera in real time can be displayed in the first area 1010 of the shooting preview interface 1000 , and the enlarged image 1020 corresponding to the local image area can be displayed in the second area 1030 of the shooting preview interface 1000 .

[0216] Method 3: A floating frame is superimposed on the oral image currently displayed on the shooting preview interface, and an enlarged image corresponding to the local image area is displayed in the floating frame.

[0217] Overlaying a floating frame corresponding to each partial image area on the currently displayed oral image on the shooting preview interface, and displaying a magnified image of each partial image area within the corresponding floating frame. Displaying the magnified image by overlaying the floating frame saves display space.

[0218] For example, Figure 11B FIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 11B As shown, the electronic device can display a shooting preview interface 1000, which can display the oral image 510 acquired by the camera in real time, and superimpose an indicator on the currently displayed oral image 510. One or more floating frames 1100 can be displayed on the currently displayed oral image 510, and an enlarged image 1020 corresponding to a local image area can be displayed in each floating frame 1100. Furthermore, the floating frame 1100 can be superimposed on an image area of the oral region where no cavity problem is detected, or can be superimposed on an image area that does not contain an object of interest. For example, if the object of interest is a tooth, the floating frame 1100 can be superimposed on the image area that does not contain the tooth, thereby avoiding the problem of the floating frame 1100 blocking important image content in the currently displayed oral image 510, further improving the display effect.

[0219] It should be noted that other display methods may also be used to display the magnified image, and are not limited to the above methods, and the embodiments of the present application do not limit this.

[0220] Optionally, when the shooting preview interface simultaneously displays the oral image acquired by the camera in real time and the enlarged image, the image size of the enlarged image can be smaller than the image size of the oral image. By reasonably designing the displayed oral image and the enlarged image, the user can observe more details while accurately understanding the oral condition through the indicator part, which can improve the visualization effect of the shooting preview interface.

[0221] In the above-mentioned embodiment, the enlarged image corresponding to the local image area can be displayed in a variety of ways, which can show richer oral cavity details and improve the display effect of real-time oral cavity detection.

[0222] In some embodiments, when displaying multiple magnified images, the multiple magnified images may also be arranged and displayed according to certain rules. For example, in the case of displaying magnified images of local image areas corresponding to N oral regions, the magnified images of the local image areas corresponding to the N oral regions may be arranged and displayed in descending order of severity of the oral problems corresponding to the N oral regions; or, the magnified images of the local image areas corresponding to the N oral regions may be arranged and displayed in descending order of priority of the oral problems corresponding to the N oral regions.

[0223] by Figure 10 For example, if the shooting preview interface 1000 displays three magnified images 1020, the three magnified images 1020 may be arranged and displayed in descending order of the severity level of the corresponding oral problem, or in descending order of the priority level of the corresponding oral problem. Specifically, from left to right, the severity level (or priority) of the oral problem corresponding to the first magnified image 1020 may be higher than the severity level (or priority) of the oral problem corresponding to the second magnified image 1020, and the severity level (or priority) of the oral problem corresponding to the second magnified image 1020 may be higher than the severity level (or priority) of the oral problem corresponding to the third magnified image 1020.

[0224] By arranging and displaying the enlarged images of each local image area in order of problem severity from high to low or oral problem priority from high to low, it is convenient for users to pay attention to the image details of the oral area with a higher problem severity or a higher priority oral problem, thereby improving the visualization effect of the displayed enlarged image and enhancing the user's observation efficiency.

[0225] In some embodiments, a target tag corresponding to each magnified image may also be displayed on the shooting preview interface, where the target tag is used to indicate the association relationship between the magnified image and the corresponding local image area.

[0226] Optionally, the target label may include, but is not limited to, one or more of a symbol, text, and pattern. By displaying the target label corresponding to each magnified image on the shooting preview interface, the target label can be used to indicate the association between the magnified image and the corresponding local image area. The user can clearly know which local image area of the currently displayed oral region each magnified image corresponds to through the displayed target label, thereby improving the intuitiveness of information presentation and enhancing the visualization effect.

[0227] For example, Figure 11C FIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 11C As shown, the target label 1110 corresponding to each magnified image 1020 may be displayed on the shooting preview interface 1000 . For example, the target label 1110 may be an arrow symbol for indicating the local image area corresponding to each magnified image.

[0228] In an embodiment of the present application, an enlarged image corresponding to one or more local image areas in a previously displayed oral image can be displayed. By enlarging the image, richer and more subtle detail information of the oral area can be displayed, helping users or doctors to understand the oral condition more accurately and comprehensively, thereby improving the visualization effect of real-time oral detection.

[0229] In some embodiments, the above method may further include: displaying a standard oral image corresponding to the currently displayed oral image in the shooting preview interface, where the standard oral image is used to display the oral cavity after eliminating the oral problems existing in the currently displayed oral image.

[0230] As an embodiment, after the electronic device recognizes the oral image acquired by the camera in real time and obtains the oral detection information corresponding to the oral image, it can obtain the standard oral image corresponding to the oral image based on the oral detection information and display the standard oral image.

[0231] Alternatively, standard oral images may be pre-stored. For different types of oral problems, standard oral images corresponding to various oral problems may be pre-stored. The standard oral images may be images of the mouth without the corresponding problem or after the corresponding problem has been cured. For example, for a whitening problem, the corresponding standard oral image may be an oral image of the teeth at the whitest whitening level; for a caries problem, the corresponding standard oral image may be an oral image without caries, etc.

[0232] Optionally, the standard oral image can be obtained by processing an oral image captured in real time by a camera. The electronic device can store a problem elimination model that can be used to eliminate oral problems present in the oral image. After recognizing the oral image captured in real time by the camera and obtaining oral detection information corresponding to the oral image, the oral image and the corresponding oral detection information can be input into the problem elimination model. The problem elimination model then processes the oral image based on the oral detection information to obtain a standard oral image.

[0233] Furthermore, different problem elimination models can be used for different oral problems. For example, a whitening problem can correspond to a teeth whitening model, which can be used to eliminate stained teeth in an oral image and / or adjust the color of the teeth in the oral image to the whitest teeth whitening level. For another example, a neatness problem can correspond to an orthodontic correction model, which can predict the shape of the teeth in the oral image after orthodontic correction and generate a corresponding standard oral image. By processing the oral image captured by the camera in real time through the problem elimination model to obtain the corresponding standard oral image, the accuracy and authenticity of the displayed standard oral image can be improved, thereby improving the display effect.

[0234] In some embodiments, the user can choose whether to perform problem elimination on the oral image displayed in the shooting preview interface according to actual needs. If the electronic device detects a triggered problem elimination operation, it can respond to the triggered problem elimination operation and display a standard oral image corresponding to the currently displayed oral image in the shooting preview interface.

[0235] Optionally, the problem elimination operation may include but is not limited to triggering a set key or button, executing a set gesture, inputting a set voice command, etc. Users can flexibly choose whether to display the standard oral image according to actual needs, meeting different needs of users and improving the user experience.

[0236] In some embodiments, the real-time oral image captured by the camera and the standard oral image can be displayed simultaneously in the shooting preview interface. Furthermore, the currently displayed oral image can be displayed in the first area of the shooting preview interface, and the standard oral image corresponding to the currently displayed oral image can be displayed in the third area of the shooting preview interface, with the first and third areas not overlapping.

[0237] The oral cavity image captured by the camera in real time and the standard oral cavity image can be displayed in the first and third areas of the shooting preview interface, which are completely non-overlapping, respectively, so that the user can better compare the oral cavity image captured by the camera in real time with the standard oral cavity image. Figure 12 FIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 12 As shown, the electronic device can display a shooting preview interface 1000, which can show the oral image 310 captured by the camera in real time and overlay an indicator 320 on the oral image 310. A standard oral image 1210 can also be displayed on the shooting preview interface 1000, for example, an oral image after teeth whitening, to help users better manage their oral health.

[0238] In an embodiment of the present application, by displaying a standard oral image on the shooting preview interface, a positive oral image can be presented to the user, enriching the presented image information and helping the user to better manage the oral condition.

[0239] In some embodiments, the above method may also include: displaying a text portion in the shooting preview interface, the text portion being used to display oral problem information corresponding to at least part of the oral area in the currently displayed oral image and / or being used to display oral care suggestions corresponding to oral problems existing in the oral area.

[0240] In addition to displaying the real-time oral image captured by the camera on the shooting preview interface and overlaying an indicator on the displayed oral image, a text section can also be displayed on the shooting preview interface. This text section can use text, or text and images, to display oral problem information corresponding to at least a portion of the oral region in the currently displayed oral image and / or oral care suggestions corresponding to the oral problem in the oral region.

[0241] For example, Figure 13A FIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 13A As shown, the electronic device displays a shooting preview interface 1300, which displays an oral image 510 captured by the camera in real time, and an indicator portion is superimposed on the displayed oral image 510 to indicate the corresponding oral condition. The shooting preview interface 1300 may also display a text portion 1310, which may display oral problem information corresponding to the oral image 510, such as the number of oral areas detected for various oral problems, the severity of the problems, etc., thereby helping the user to understand the oral condition more intuitively and quickly. The text portion 1310 may also display corresponding oral care suggestions to help the user better manage their oral cavity.

[0242] For example, Figure 13B FIG. 1 is a schematic diagram of a shooting preview interface in another embodiment. Figure 13B As shown, the shooting preview interface 1300 not only displays the oral cavity image 510 captured in real time by the camera, but also displays an indicator portion superimposed on the displayed oral cavity image 510 and a text portion 1310, and can also display an enlarged image 1020 of one or more local image areas. Optionally, a standard oral cavity image (not shown) can also be displayed on the shooting preview interface 1300, enriching the information presented on the shooting preview interface.

[0243] In an embodiment of the present application, text can also be displayed on the shooting preview interface, which improves the richness of the information displayed on the shooting preview interface, thereby helping users to understand oral conditions more intuitively and quickly, and helping users to better manage their oral cavity, thereby improving the visualization effect of real-time oral detection.

[0244] In some embodiments, the electronic device may be provided with a plurality of display modes of the shooting preview interface, and the content displayed on the shooting preview interface may be different in different display modes. For example, a simple display mode may be provided, in which the shooting preview interface only displays the oral image acquired by the camera in real time, and superimposes on the oral image an indicator portion for indicating the most serious problem in the oral image. For another example, a detailed display mode may be provided, in which the shooting preview interface may display the oral image acquired by the camera in real time, and superimposes on the oral image an indicator portion for indicating the oral area of all oral problems present in the oral image. For another example, a professional display mode may be provided, in which the shooting preview interface may display the oral image acquired by the camera in real time, and superimposes on the oral image an indicator portion for indicating the oral area of all oral problems present in the oral image, and may also display an enlarged image of the local image area and a text portion, etc., but is not limited thereto.

[0245] Users can flexibly select the display mode of the shooting preview interface according to actual needs, improve the display flexibility of the shooting preview interface, and meet the different needs of users.

[0246] In some embodiments, the above method may also include the steps of: generating an oral inspection report in response to a triggered shooting operation, the oral inspection report including at least one interface image corresponding to the shooting preview interface, each interface image may include an oral image displayed on the shooting preview interface and an indication portion superimposed on the displayed oral image.

[0247] As an embodiment, while the electronic device is displaying a shooting preview interface, a screenshot operation can be performed on the shooting preview interface to obtain at least one interface image. The interface image can include the oral cavity image displayed on the shooting preview interface at the time of the screenshot operation and a display indicator superimposed on the displayed oral cavity image. The at least one captured interface image can be stored. When the user triggers a shooting operation, the electronic device can generate an oral cavity inspection report based on the oral cavity inspection information corresponding to the multiple oral cavity images identified before the shooting operation was triggered, as well as the at least one stored interface image.

[0248] The oral examination report provides a detailed analysis of the user's oral condition and is accompanied by graphical illustrations, enhancing the presentation of the report. Compared to the real-time preview interface, the oral examination report can present more information. In addition to the real-time graphical interface, it can also display oral care recommendations and explanations of existing oral problems. For example, the oral examination report can display areas of teeth indicating the presence of caries, and further explain the concept of caries, possible causes of caries, and corresponding dental care recommendations.

[0249] Optionally, the operation method of the shooting operation may include but is not limited to triggering a designated shooting button, performing a designated shooting gesture or action, inputting a designated shooting voice command, etc.

[0250] In an embodiment of the present application, an oral examination report can be generated. The oral examination report can display the interface image displayed in real time on the shooting preview interface, and can also display more information content, thereby improving the richness of information presented in the oral examination report and improving the accuracy of the oral examination report, thereby helping users to understand the oral condition more comprehensively and fully and do a good job of oral management.

[0251] like Figure 14 As shown, in one embodiment, a display device 1400 for oral cavity detection is provided, which can be applied to the above-mentioned electronic device. The display device 1400 for oral cavity detection includes a display module 1410 and an image recognition module 1420.

[0252] The display module 1410 is used to display a shooting preview interface, which is used to display the oral cavity image captured by the camera in real time.

[0253] The image recognition module 1420 is used to recognize the oral cavity image acquired by the camera in real time and obtain oral cavity detection information corresponding to the oral cavity image.

[0254] The display module 1410 is also used to superimpose an indicator on the currently displayed oral image based on the oral detection information corresponding to the oral image currently displayed on the shooting preview interface. The indicator is used to indicate the oral condition corresponding to the currently displayed oral image, and the oral condition includes at least one of oral hygiene problems, oral aesthetic problems and oral health problems.

[0255] In one embodiment, the indicator is used to indicate the overall oral conditions corresponding to the multiple oral regions included in the currently displayed oral image;

[0256] and / or,

[0257] The indication part includes indication elements corresponding to one or more oral areas in the currently displayed oral image; the indication element corresponding to the target oral area is used to indicate the oral condition corresponding to the target oral area in the currently displayed oral image, wherein the target oral area is any oral area among the one or more oral areas.

[0258] In one embodiment, the display module 1410 is also used to superimpose an indication element corresponding to the target oral area on the image area corresponding to the target oral area in the currently displayed oral image based on the oral detection information corresponding to the target oral area in the currently displayed oral image.

[0259] In one embodiment, the oral detection information includes oral problem information; the display module 1410 is also used to superimpose and display the indicator element corresponding to the target oral area on the problem image area corresponding to the target oral area in the currently displayed oral image based on the oral problem information corresponding to the target oral area in the currently displayed oral image, and the problem image area is the image area corresponding to the area where the oral problem exists in the target oral area.

[0260] In one embodiment, the oral detection information corresponding to the target oral area includes information of multiple dimensions, and the indicator element includes sub-elements corresponding to the information of the multiple dimensions, and the sub-elements corresponding to information of different dimensions have different display styles.

[0261] In one embodiment, the oral cavity detection information corresponding to the target oral cavity area includes oral cavity position information corresponding to the target oral cavity area and oral cavity problem information;

[0262] The indicator element corresponding to the target oral area includes a first sub-element and a second sub-element. The first sub-element is used to indicate the oral position information corresponding to the target oral area, and the second sub-element is used to indicate the oral problem information corresponding to the target oral area.

[0263] In one embodiment, the oral problem information includes the type of the oral problem and / or the severity level of the problem;

[0264] The second sub-element is used to indicate the problem type and / or problem severity level of the oral problem existing in the target oral area. The display style of the second sub-elements corresponding to different problem types is different, and / or the display style of the second sub-elements corresponding to different problem severity levels is different.

[0265] In one embodiment, the display style includes at least one of a display pattern, a display color, a display size, and a display line thickness.

[0266] In one embodiment, when there are at least two oral problems in the target oral area, the indicator element corresponding to the target oral area includes a first sub-element and second sub-elements corresponding to the at least two oral problems respectively. The second sub-elements corresponding to different oral problems have different display styles.

[0267] In one embodiment, when there are at least two oral problems in the target oral area, the second sub-element is used to indicate the oral problem information corresponding to the oral problem with the highest severity level in the target oral area; or

[0268] In the case that there are at least two oral problems in the target oral area, the second sub-element is used to indicate the oral problem information corresponding to the oral problem with the highest priority in the target oral area.

[0269] In one embodiment, the second sub-element is used to indicate oral problem information corresponding to the target oral problem in the target oral region;

[0270] The target oral problem is determined according to the triggered problem selection operation or according to the currently running target detection mode.

[0271] In one embodiment, the indication element comprises an indication frame.

[0272] In one embodiment, the oral detection information includes at least one of oral cleaning information, oral aesthetic information, and oral health information, wherein:

[0273] The oral hygiene information includes at least one of dental plaque information and foreign matter residue information;

[0274] Oral aesthetic information includes at least one of tooth color information and tooth neatness information;

[0275] The oral health information includes at least one of tooth health information and gum health information.

[0276] In one embodiment, the indicator is used to indicate the oral conditions corresponding to one or more teeth in the currently displayed oral image.

[0277] In one embodiment, the indicator is used to indicate the overall oral condition corresponding to all teeth in the currently displayed oral image; or

[0278] The indication part is used to indicate the oral conditions corresponding to all teeth in the currently displayed oral image; or,

[0279] The indicator portion is used to indicate the oral condition corresponding to the target teeth in the currently displayed oral image. The target teeth include teeth with oral problems and / or teeth selected by the user.

[0280] In one embodiment, the electronic device supports multiple oral cavity detection modes. In different oral cavity detection modes, different types of oral problems can be detected.

[0281] In one embodiment, the oral cavity detection display device 1400 further includes a mode selection module.

[0282] The mode selection module is used to determine the currently running target oral cavity detection mode in response to the mode selection operation.

[0283] The image recognition module 1420 is further configured to recognize the oral cavity image acquired by the camera in real time according to the target oral cavity detection mode, and obtain oral cavity detection information corresponding to the oral cavity image and the target oral cavity detection mode.

[0284] In one embodiment, the electronic device supports a first oral cavity detection mode and a second oral cavity detection mode, and the oral cavity detection display device 1400 further includes a mode switching module.

[0285] The image recognition module 1420 is further configured to run the first oral cavity detection mode, recognize the first oral cavity image corresponding to the first oral cavity detection mode and acquired in real time by the camera, and obtain oral cavity detection information corresponding to the first oral cavity image.

[0286] The display module 1410 is also used to superimpose a first indicator on the currently displayed first oral image based on the oral detection information corresponding to the first oral image currently displayed on the shooting preview interface. The first indicator is used to indicate the oral problem corresponding to the first oral detection mode of the currently displayed first oral image.

[0287] The mode switching module is further configured to switch from the first oral cavity detection mode to the second oral cavity detection mode when a preset switching condition is met.

[0288] The image recognition module 1420 is further configured to recognize the second oral cavity image corresponding to the second oral cavity detection mode and acquired in real time by the camera, and obtain oral cavity detection information corresponding to the second oral cavity image.

[0289] The display module 1410 is also used to superimpose a second indicator on the currently displayed second oral image based on the oral detection information corresponding to the second oral image currently displayed on the shooting preview interface. The second indicator is used to indicate the oral problem corresponding to the second oral detection mode of the currently displayed second oral image.

[0290] In one embodiment, the preset switching condition includes at least one of the following:

[0291] The running time corresponding to the first oral cavity detection mode is greater than or equal to the time threshold;

[0292] The number of first oral cavity images acquired by the camera in the first oral cavity detection mode is greater than or equal to a first number threshold;

[0293] In the first oral detection mode, no oral region with oral problems is detected;

[0294] A triggered mode switch operation is detected.

[0295] In one embodiment, the display module 1410 is further configured to display, based on the currently displayed oral image, an enlarged image corresponding to one or more local image regions in the currently displayed oral image.

[0296] In one embodiment, the local image area is determined in response to a triggered area magnification operation; and / or, the local image area is an image area corresponding to the oral area where the oral problem exists in the currently displayed oral image.

[0297] In one embodiment, the local image region is an image region corresponding to the oral region where the oral problem exists in the currently displayed oral image. The oral examination display device 1400 further includes a region selection module.

[0298] A region selection module is configured to select N oral regions with oral problems from the currently displayed oral image according to a preset rule if the number of oral regions with oral problems in the currently displayed oral image is greater than N; N is a positive integer;

[0299] The display module 1410 is further configured to display magnified images of the local image regions corresponding to the N oral regions, respectively, based on the currently displayed oral image.

[0300] In one embodiment, the region selection module is further used to select, in descending order of the severity of the oral problems, the oral regions with oral problems in all the oral regions in the currently displayed oral image, where the severity of the oral problems is ranked in the top N; or, to select, in descending order of the priority of the oral problems, the oral regions with oral problems in all the oral regions in the currently displayed oral image, where the priority of the oral problems is ranked in the top N.

[0301] In one embodiment, the enlarged images of the local image areas corresponding to the N oral areas are displayed in sequence according to the severity of the oral problems corresponding to the N oral areas from high to low; or, the enlarged images of the local image areas corresponding to the N oral areas are displayed in sequence according to the priority of the oral problems corresponding to the N oral areas from high to low.

[0302] In one embodiment, the local image area is the image area corresponding to the oral area with oral problems in the currently displayed oral image; the display module 1410 is also used to display enlarged images of the local image areas corresponding to all oral areas with oral problems according to the currently displayed oral image if the number of oral areas with oral problems in the currently displayed oral image is less than or equal to N; N is a positive integer.

[0303] In one embodiment, the display module 1410 is also used to switch the oral image currently displayed in the shooting preview interface to an enlarged image corresponding to the local image area for display; or, display the currently displayed oral image in the first area of the shooting preview interface, and display the enlarged image corresponding to the local image area in the second area of the shooting preview interface, and the first area and the second area are at least partially non-overlapping; or, superimpose a floating frame on the oral image currently displayed in the shooting preview interface, and display the enlarged image corresponding to the local image area in the floating frame.

[0304] In one embodiment, the display module 1410 is further configured to display a target tag corresponding to each magnified image on the shooting preview interface, where the target tag is configured to indicate an association relationship between the magnified image and the corresponding local image region.

[0305] In one embodiment, the display module 1410 is also used to display a standard oral image corresponding to the currently displayed oral image in the shooting preview interface. The standard oral image is used to show the oral cavity after eliminating the oral problems existing in the currently displayed oral image.

[0306] In one embodiment, the display module 1410 is further configured to display a standard oral cavity image corresponding to the currently displayed oral cavity image in the shooting preview interface in response to a triggered problem elimination operation;

[0307] The standard oral image is pre-stored, or the standard oral image is obtained by processing the currently displayed oral image through a problem elimination model, and the problem elimination model is used to eliminate oral problems existing in the oral image.

[0308] In one embodiment, the display module 1410 is also used to display the currently displayed oral image in the first area of the shooting preview interface, and to display the standard oral image corresponding to the currently displayed oral image in the third area of the shooting preview interface, and the first area and the third area do not overlap.

[0309] In one embodiment, the oral cavity detection display device 1400 further includes a report generation module.

[0310] A report generation module is used to generate an oral examination report in response to a triggered shooting operation. The oral examination report includes at least one interface image corresponding to the shooting preview interface. Each interface image includes an oral image displayed on the shooting preview interface and an indication portion superimposed on the displayed oral image.

[0311] In one embodiment, the display module 1410 is also used to display a text portion in the shooting preview interface, and the text portion is used to display oral problem information corresponding to at least part of the oral area in the currently displayed oral image and / or to display oral care suggestions corresponding to oral problems existing in the oral area.

[0312] In an embodiment of the present application, by superimposing a display indicator on the real-time displayed oral image, the oral condition corresponding to the real-time displayed oral image can be indicated, thereby enriching the presented image information, helping users to understand the oral condition more comprehensively and accurately, and improving the visualization effect and accuracy of oral detection.

[0313] Figure 15 FIG. 1 is a structural block diagram of an electronic device in one embodiment. Figure 15 As shown, the electronic device 1500 may include one or more of the following components: a processor 1510, and a memory 1520 coupled to the processor 1510, wherein the memory 1520 may store one or more computer programs, and the one or more computer programs may be configured to implement the methods described in the above embodiments when executed by one or more processors 1510.

[0314] The processor 1510 may include one or more processing cores. The processor 1510 utilizes various interfaces and circuits to connect various components within the electronic device 1500. It executes instructions, programs, code sets, or instruction sets stored in the memory 1520, and accesses data stored in the memory 1520 to perform various functions and process data within the electronic device 1500. Optionally, the processor 1510 may be implemented in hardware using at least one of a digital signal processing (DSP), a field-programmable gate array (FPGA), and a programmable logic array (PLA). The processor 1510 may integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. The CPU primarily processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem handles wireless communications. It is understood that the modem may not be integrated into the processor 1510 and may be implemented separately via a communications chip.

[0315] The memory 1520 may include a random access memory (RAM) or a read-only memory (ROM). The memory 1520 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 1520 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. The data storage area may also store data created by the electronic device 1500 during use.

[0316] It can be understood that the electronic device 1500 may include more or fewer structural elements than those in the above structural block diagram, for example, including a display device, a power module, physical buttons, a WiFi (Wireless Fidelity) module, a speaker, a Bluetooth module, a sensor, etc., and is not limited here.

[0317] An embodiment of the present application discloses a computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the methods described in the above embodiments.

[0318] The embodiments of the present application disclose a computer program product, including a computer program, and the computer program can be executed by a processor to implement the methods described in the above embodiments.

[0319] Those skilled in the art will appreciate that all or part of the processes in the above-described method embodiments can be implemented by instructing related hardware through a computer program. The program can be stored in a non-volatile computer-readable storage medium. When executed, the program can include the processes in the above-described method embodiments. The storage medium can be a magnetic disk, an optical disk, a ROM, or the like.

[0320] As used herein, any reference to memory, storage, database, or other medium may include nonvolatile and / or volatile memory. Suitable nonvolatile memory may include ROM, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM), which serves as external cache memory. By way of illustration and not limitation, RAM may be in various forms, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced synchronous DRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus DRAM (RDRAM), and direct Rambus DRAM (DRDRAM).

[0321] It should be understood that the references to "one embodiment" or "an embodiment" throughout the specification mean that the specific features, structures, or characteristics associated with the embodiment are included in at least one embodiment of the present application. Therefore, the references to "in one embodiment" or "in an embodiment" throughout the specification do not necessarily refer to the same embodiment. In addition, these specific features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required for the present application.

[0322] In the various embodiments of the present application, it should be understood that the size of the serial numbers of the above-mentioned processes does not necessarily mean the order of execution. The order of execution of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0323] The units described above as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one place or distributed across multiple network units. Some or all of these units may be selected based on actual needs to achieve the objectives of this embodiment.

[0324] The technical features of the above-mentioned embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above-mentioned embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0325] The above is a detailed introduction to the oral cavity detection display method, device, electronic device and storage medium disclosed in the embodiments of this application. Specific examples are used herein to illustrate the principles and implementation methods of this application. The description of the above embodiments is only used to help understand the method and core concept of this application. At the same time, for those skilled in the art, according to the concept of this application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as limiting this application.

Claims

1. A method for displaying oral cavity detection, characterized in that: Applied to electronic equipment, the method includes: Displaying a shooting preview interface, wherein the shooting preview interface is used to display the oral cavity image acquired by the camera in real time; Identify the oral cavity image acquired by the camera in real time to obtain oral cavity detection information corresponding to the oral cavity image; According to the oral detection information corresponding to the oral image currently displayed on the shooting preview interface, an indicator part is superimposed on the currently displayed oral image, and the indicator part is used to indicate the oral condition corresponding to the currently displayed oral image. The oral condition includes at least one of oral cleaning problems, oral aesthetic problems and oral health problems.

2. The method according to claim 1, characterized in that The indicating portion is used to indicate the overall oral conditions corresponding to the multiple oral regions included in the currently displayed oral image; and / or, The indication portion includes indication elements corresponding to one or more oral areas in the currently displayed oral image; the indication element corresponding to the target oral area is used to indicate the oral condition corresponding to the target oral area in the currently displayed oral image, wherein the target oral area is any oral area among the one or more oral areas.

3. The method according to claim 2, characterized in that The method of displaying an indication portion superimposed on the currently displayed oral image based on the oral detection information corresponding to the currently displayed oral image on the shooting preview interface includes: According to the oral detection information corresponding to the target oral region in the currently displayed oral image, an indication element corresponding to the target oral region is superimposed and displayed on the image region corresponding to the target oral region in the currently displayed oral image.

4. The method according to claim 3, characterized in that The oral cavity detection information includes oral problem information; and the displaying, based on the oral cavity detection information corresponding to the target oral cavity area in the currently displayed oral cavity image, of an indication element corresponding to the target oral cavity area on an image area corresponding to the target oral cavity area in the currently displayed oral cavity image, includes: According to the oral problem information corresponding to the target oral area in the currently displayed oral image, an indicator element corresponding to the target oral area is superimposed and displayed on the problem image area corresponding to the target oral area in the currently displayed oral image, and the problem image area is the image area corresponding to the area where the oral problem exists in the target oral area.

5. The method according to any one of claims 2 to 4, characterized in that The oral detection information corresponding to the target oral area includes information of multiple dimensions, and the indicator element includes sub-elements corresponding to the information of the multiple dimensions respectively. The sub-elements corresponding to information of different dimensions have different display styles.

6. The method according to claim 5, characterized in that The oral cavity detection information corresponding to the target oral cavity area includes oral cavity position information and oral cavity problem information corresponding to the target oral cavity area; The indicator element corresponding to the target oral area includes a first sub-element and a second sub-element, the first sub-element is used to indicate the oral position information corresponding to the target oral area, and the second sub-element is used to indicate the oral problem information corresponding to the target oral area.

7. The method according to claim 6, characterized in that The oral problem information includes the type of oral problem and / or the severity level of the problem; The second sub-element is used to indicate the problem type and / or problem severity level of the oral problem existing in the target oral area. The display style of the second sub-elements corresponding to different problem types is different, and / or the display style of the second sub-elements corresponding to different problem severity levels is different.

8. The method according to claim 7, characterized in that The display style includes at least one of a display pattern, a display color, a display size, and a display line thickness.

9. The method according to claim 6, characterized in that When there are at least two oral problems in the target oral area, the indicator element corresponding to the target oral area includes the first sub-element and second sub-elements corresponding to the at least two oral problems respectively. The second sub-elements corresponding to different oral problems have different display styles.

10. The method according to claim 6, characterized in that In the case where there are at least two oral problems in the target oral area, the second sub-element is used to indicate the oral problem information corresponding to the oral problem with the highest severity level in the target oral area; or, In the case that there are at least two oral problems in the target oral area, the second sub-element is used to indicate oral problem information corresponding to the oral problem with the highest priority in the target oral area.

11. The method according to claim 6, characterized in that The second sub-element is used to indicate the oral problem information corresponding to the target oral problem in the target oral area; The target oral question is determined according to a triggered question selection operation or according to a currently running target detection mode.

12. The method according to any one of claims 2 to 4 and 6 to 11, characterized in that: The indication element includes an indication frame.

13. The method according to claim 1, wherein The oral detection information includes at least one of oral cleaning information, oral aesthetic information and oral health information, wherein: The oral cleaning information includes at least one of dental plaque information and foreign matter residue information; The oral aesthetic information includes at least one of tooth color information and tooth regularity information; The oral health information includes at least one of tooth health information and gum health information.

14. The method according to any one of claims 1 to 4 and 6 to 11, characterized in that The indicating portion is used to indicate the oral conditions corresponding to one or more teeth in the currently displayed oral image.

15. The method according to claim 14, characterized in that The indicating portion is used to indicate the overall oral condition corresponding to all teeth in the currently displayed oral image; or, The indicating portion is used to indicate the oral conditions corresponding to all teeth in the currently displayed oral image; or, The indicating portion is used to indicate the oral condition corresponding to the target teeth in the currently displayed oral image, where the target teeth include teeth with oral problems and / or teeth selected by the user.

16. The method according to claim 1, wherein The electronic device supports multiple oral cavity detection modes, and under different oral cavity detection modes, different types of oral problems can be detected.

17. The method according to claim 16, characterized in that The method further comprises: In response to a mode selection operation, determining a currently running target oral cavity detection mode; The identifying of the oral cavity image acquired by the camera in real time to obtain oral cavity detection information corresponding to the oral cavity image includes: According to the target oral cavity detection mode, the oral cavity image acquired by the camera in real time is recognized to obtain oral cavity detection information corresponding to the oral cavity image and the target oral cavity detection mode.

18. The method according to claim 16, characterized in that The electronic device supports a first oral cavity detection mode and a second oral cavity detection mode, and the method further includes: Running a first oral cavity detection mode, recognizing a first oral cavity image corresponding to the first oral cavity detection mode and acquired in real time by a camera, and obtaining oral cavity detection information corresponding to the first oral cavity image; Based on the oral cavity detection information corresponding to the first oral cavity image currently displayed on the shooting preview interface, a first indicator is superimposed on the first oral cavity image currently displayed, where the first indicator is used to indicate the oral problem corresponding to the first oral cavity detection mode in the first oral cavity image currently displayed; When a preset switching condition is met, switching from the first oral cavity detection mode to the second oral cavity detection mode, recognizing a second oral cavity image corresponding to the second oral cavity detection mode and acquired by the camera in real time, and obtaining oral cavity detection information corresponding to the second oral cavity image; According to the oral detection information corresponding to the second oral image currently displayed on the shooting preview interface, a second indicator is superimposed on the currently displayed second oral image, and the second indicator is used to indicate the oral problem corresponding to the second oral detection mode of the currently displayed second oral image.

19. The method according to claim 18, characterized in that The preset switching condition includes at least one of the following: The running time corresponding to the first oral cavity detection mode is greater than or equal to the time threshold; The number of first oral cavity images acquired by the camera in the first oral cavity detection mode is greater than or equal to a first number threshold; In the first oral cavity detection mode, no oral cavity area with oral problems is detected; A triggered mode switch operation is detected.

20. The method according to claim 1, wherein The method further comprises: According to the currently displayed oral cavity image, an enlarged image corresponding to one or more local image areas in the currently displayed oral cavity image is displayed.

21. The method according to claim 20, characterized in that The local image area is determined in response to a triggered area magnification operation; and / or, The local image area is an image area corresponding to the oral region where the oral problem exists in the currently displayed oral image.

22. The method according to claim 21, characterized in that The local image area is an image area corresponding to an oral region having an oral problem in the currently displayed oral image; and displaying, based on the currently displayed oral image, an enlarged image corresponding to one or more local image areas in the currently displayed oral image includes: If the number of oral regions with oral problems in the currently displayed oral image is greater than N, then selecting N oral regions with oral problems from the currently displayed oral image according to a preset rule; N is a positive integer; According to the currently displayed oral cavity image, enlarged images of the local image areas respectively corresponding to the N oral cavity areas are displayed.

23. The method according to claim 22, characterized in that The step of selecting N oral regions with oral problems from the currently displayed oral image according to a preset rule includes: Selecting, in descending order of severity of the oral problems, the oral regions with the oral problems in the currently displayed oral image, which are ranked in the top N in severity; or All oral regions with oral problems in the currently displayed oral image are selected in descending order of priority of the oral problems, and the oral regions with oral problems are arranged in the top N priority groups.

24. The method according to claim 22, characterized in that The enlarged images of the local image areas corresponding to the N oral regions are displayed in order of severity of the oral problems corresponding to the N oral regions from high to low; or The enlarged images of the local image areas corresponding to the N oral regions are displayed in order of priority from high to low for the oral problems corresponding to the N oral regions.

25. The method according to claim 21, characterized in that The local image area is an image area corresponding to an oral region having an oral problem in the currently displayed oral image; and displaying, based on the currently displayed oral image, an enlarged image corresponding to one or more local image areas in the currently displayed oral image includes: If the number of oral areas with oral problems in the currently displayed oral image is less than or equal to N, then based on the currently displayed oral image, enlarged images of the local image areas corresponding to all oral areas with oral problems are displayed; N is a positive integer.

26. The method according to any one of claims 20 to 25, characterized in that The displaying of the enlarged image corresponding to the local image area in the currently displayed oral image includes: Switch the oral cavity image currently displayed in the shooting preview interface to display the enlarged image corresponding to the local image area; or Displaying the currently displayed oral image in a first area of the shooting preview interface, and displaying an enlarged image corresponding to the local image area in a second area of the shooting preview interface, wherein the first area and the second area at least partially do not overlap; or A floating frame is superimposed on the oral cavity image currently displayed on the shooting preview interface, and an enlarged image corresponding to the local image area is displayed in the floating frame.

27. The method according to claim 26, characterized in that The method further comprises: The target tag corresponding to each of the magnified images is displayed on the shooting preview interface, and the target tag is used to indicate the association relationship between the magnified image and the corresponding local image area.

28. The method according to claim 1, wherein The method further comprises: In the shooting preview interface, a standard oral cavity image corresponding to the currently displayed oral cavity image is displayed, and the standard oral cavity image is used to show the oral cavity after eliminating the oral problems existing in the currently displayed oral cavity image.

29. The method according to claim 28, characterized in that The method of displaying a standard oral cavity image corresponding to the currently displayed oral cavity image in the shooting preview interface includes: In response to the triggered problem elimination operation, displaying a standard oral cavity image corresponding to the currently displayed oral cavity image in the shooting preview interface; The standard oral image is pre-stored, or the standard oral image is obtained by processing the currently displayed oral image through a problem elimination model, and the problem elimination model is used to eliminate oral problems existing in the oral image.

30. The method according to claim 28, wherein The method of displaying a standard oral cavity image corresponding to the currently displayed oral cavity image in the shooting preview interface includes: The first area of the shooting preview interface displays the currently displayed oral image, and the third area of the shooting preview interface displays a standard oral image corresponding to the currently displayed oral image, and the first area and the third area do not overlap.

31. The method according to claim 1, wherein The method further comprises: In response to the triggered shooting operation, an oral inspection report is generated, which includes at least one interface image corresponding to the shooting preview interface, each of which includes an oral image displayed on the shooting preview interface and an indication portion superimposed on the displayed oral image.

32. The method according to claim 1, wherein The method further comprises: A text portion is displayed on the shooting preview interface, and the text portion is used to display oral problem information corresponding to at least part of the oral area in the currently displayed oral image and / or to display oral care suggestions corresponding to oral problems existing in the oral area.

33. An oral cavity detection display device, characterized in that: Applied to electronic equipment, the device comprises: A display module is used to display a shooting preview interface, wherein the shooting preview interface is used to display the oral cavity image acquired by the camera in real time; An image recognition module is used to recognize the oral cavity image acquired by the camera in real time and obtain oral cavity detection information corresponding to the oral cavity image; The display module is further used to superimpose an indicator on the currently displayed oral image based on the oral detection information corresponding to the oral image currently displayed on the shooting preview interface. The indicator is used to indicate the oral condition corresponding to the currently displayed oral image, and the oral condition includes at least one of oral cleaning problems, oral aesthetic problems and oral health problems.

34. An electronic device, characterized in that: The method comprises a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor implements the method according to any one of claims 1 to 32.

35. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 32 is implemented.

Images