Smile simulation interaction method and system, and electronic device

Abstract

The present application provides a smile simulation interaction method and system, and an electronic device. The method comprises: displaying a first interface, wherein the first interface comprises an operation interface for a first user to manage or view dental diagnosis and treatment information, the first interface comprises a first control, and the first control is used for triggering a smile simulation guide function; and in response to an operation on the first control, displaying a second interface, wherein the second interface is used for generating redirect information, the redirect information is used for guiding a second user to use a smile simulation function, and the smile simulation function comprises processing a collected face image of the second user and generating an expected interaction simulation effect graph. The solution can help patients understand orthodontic treatment, facilitate the communication between doctors and the patients, reduce the cost of medical visit of the patients, and improve the medical visit experience of the patients.

Description

Smile simulation interaction method, system and electronic device

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of the People's Republic of China on March 8, 2024, with application number 202410269812.X and application name "A method, system and electronic device for interactive smile simulation", the entire contents of which are incorporated by reference into this application. Technical Field

[0003] The present invention relates to the field of orthodontic technology, and in particular to an interactive method, system and electronic equipment for smile simulation. Background Art

[0004] Orthodontic treatment usually involves resolving problems with misalignment of teeth and / or jaws, and may also include the diagnosis, prevention and / or correction of malocclusion. Currently, more and more people are beginning to understand that orthodontic treatment is not only beneficial to health, but also improves personal image. However, patients who do not understand orthodontic treatment may not realize whether or not they need orthodontic treatment. Currently, the only way to confirm whether orthodontic treatment is needed is to go to the corresponding clinic, make an appointment with a doctor, and have the doctor evaluate the patient's dental condition to confirm. The cost of orthodontic treatment for patients is high. In addition, the cycle of orthodontic treatment is also long, and it is difficult for patients to anticipate the treatment effect and confirm whether orthodontic treatment is necessary. Summary of the Invention

[0005] The embodiments of the present application provide an interactive method, system, and electronic device for smile simulation to help patients establish an understanding of orthodontic treatment, while promoting communication between orthodontists and patients, reducing patients' medical costs, and helping to improve patients' medical experience.

[0006] In a first aspect, an embodiment of the present application provides an interactive method for smile simulation, which is applied to a first terminal device. The method includes: displaying a first interface, the first interface including an operating interface for a first user to manage or view dental treatment information, the first interface including a first control, and the first control is used to trigger a smile simulation guide function; in response to the operation of the first control, a second interface is displayed, the second interface is used to generate jump information, and the jump information is used to guide the second user to use the smile simulation function, and the smile simulation function includes processing a facial image collected from the second user and generating a desired interactive simulation effect diagram.

[0007] In the above scheme, the jump information generated by the first user terminal can guide the second user to trigger the jump to the interface including the guide control, and the guide control can guide the second user to use at least one interactive mode. That is, after the second user terminal receives the dental treatment push message sent by the first user, the dental treatment push message includes the jump information. The second user can use the smile simulation function on the second user terminal by accessing the jump information to process the second user's facial image and generate the desired interactive simulation effect diagram; that is, the second user can see the possible effect diagrams of his own teeth correction process, thereby helping patients to establish an understanding of orthodontic treatment, while promoting communication between orthodontists and patients, reducing patients' medical costs, and helping to improve patients' medical experience.

[0008] In one possible implementation method, the second interface includes a control corresponding to at least one interactive mode, and the at least one interactive mode is used to guide the second user to use the smile simulation function; it also includes: in response to the operation of the control corresponding to at least one interactive mode, generating jump information, the jump information is used to guide the second user to trigger a jump to the interface including the guide control, and the guide control is used to guide the second user to use at least one interactive mode.

[0009] In one possible implementation method, at least one interaction mode includes a first interaction mode, and the first interaction mode is used to guide the second user to use a smile simulation function to process the second user's facial image to generate an interactive simulation effect diagram after correction of the simulated dental correction mode; the method also includes: in response to the operation of the control corresponding to the first interaction mode, selecting the control corresponding to the first interaction mode.

[0010] In one possible implementation method, at least one interaction mode also includes a second interaction mode, and the second interaction mode includes at least one of the following: a fixed correction mode or an invisible correction mode; the second interaction mode is used to guide the second user to use a smile simulation function to process the second user's facial image to generate an interactive simulation effect diagram of wearing a corresponding corrective device; the method also includes: in response to an operation on a control corresponding to the second interaction mode, selecting the control corresponding to the second interaction mode.

[0011] In a possible implementation method, the jump information includes one or more of the following: a network link or a QR code.

[0012] In a possible implementation method, the second interface further includes: at least one of an information guidance item and an information feedback item; the information guidance item is used to obtain guidance information preferred by the first user; and the information feedback item is used to collect feedback information from the second user.

[0013] In one possible implementation method, a fourth interface is displayed, and the fourth interface includes feedback information from at least one second user, and the feedback information includes at least one of the following: an information feedback item with feedback information, a facial image of the second user, or at least one interactive simulation effect diagram corresponding to the facial image of the second user.

[0014] In one possible implementation method, in response to an operation on the fourth interface, the initial diagnosis information is triggered to be shared with the second user; the initial diagnosis information includes preliminary treatment recommendations for the second user based on the feedback information of the second user.

[0015] In one possible implementation method, in response to an update operation on a control corresponding to at least one interaction mode in the second interface, jump information is regenerated, and the regenerated jump information is used to guide the second user to use the updated interaction mode.

[0016] In the second aspect, an embodiment of the present application provides an interactive method for smile simulation, which is applied to a second terminal device, and the method includes: in response to the second user's operation on the jump information, displaying a first interface, the first interface is used to guide the second user to use the smile simulation function; the jump information is generated by the first user based on the operation interface for managing or viewing dental treatment information; in response to the second user's operation on the first interface, displaying a second interface; the second interface is used to obtain the facial image of the second user; displaying a third interface, the third interface includes an interactive simulation effect diagram of the simulated dental correction mode of the facial image after correction, and the interactive simulation effect diagram is the desired smile simulation image generated after image processing of the facial image.

[0017] In the above scheme, the second user can use the smile simulation function on the second user side by accessing the jump information, process the second user's facial image, and generate the desired interactive simulation effect diagram; that is, the second user can see the possible effect diagrams of his or her own teeth correction process, thereby helping patients to establish an understanding of orthodontic treatment, while promoting communication between orthodontists and patients, reducing patients' medical costs, and helping to improve patients' medical experience.

[0018] In one possible implementation method, the first interface includes a guide control for an interactive mode; further comprising: displaying a second interface in response to an operation of the guide control by a second user; and displaying a third interface, the third interface including an interactive simulation effect diagram of a facial image, the interactive simulation effect diagram being a smile simulation image after image processing of the facial image based on the interactive mode.

[0019] In one possible implementation method, the third interface also includes a fourth control; the method also includes: in response to the second user's operation of the fourth control, displaying a fifth interface, the fifth interface including an information feedback item; receiving feedback information entered by the second user in the information feedback item, uploading first information, the first information including at least one of the following: an information feedback item of feedback information, a facial image of the second user, or an interactive simulation effect diagram corresponding to at least one interactive mode corresponding to the facial image of the second user.

[0020] In a possible implementation method, the third interface further includes a sixth control; the method further includes:

[0021] In response to the second user's operation on the sixth control, the sixth interface is displayed, and the sixth interface includes at least one of the following items: an interactive simulation effect diagram corresponding to at least one interactive mode and jump information; the second information is sent, and the second information includes: an interactive simulation effect diagram corresponding to at least one interactive mode and at least one item of jump information.

[0022] In one possible implementation method, initial diagnosis information is received; the initial diagnosis information includes preliminary treatment recommendations for the second user based on the feedback information of the second user; or, diagnosis and treatment inquiry information is sent; the diagnosis and treatment inquiry information includes the treatment needs of the second user.

[0023] In one possible implementation method, in response to the second user's operation on the first control, the method includes: displaying a fourth interface, the fourth interface including a contour box and a second control; the contour box is used to indicate the position of the second user's face and teeth in the image to be captured; and the second control is used to capture the facial image of the second user.

[0024] In one possible implementation method, the third interface further includes a third control, which is used to trigger the display of an interactive simulation effect diagram corresponding to at least one interactive mode; the method further includes at least one of the following:

[0025] In response to the second user's operation on the third control, an interactive simulation effect diagram of the simulated dental correction mode corresponding to the facial image is displayed on the third interface;

[0026] In response to the second user's operation on the third control, displaying an interactive simulation effect diagram corresponding to the fixed correction mode corresponding to the facial image on the third interface;

[0027] In response to the second user's operation on the third control, an interactive simulation effect diagram corresponding to the invisible correction mode corresponding to the facial image is displayed on the third interface.

[0028] In a third aspect, an embodiment of the present application provides an interactive system for smile simulation, comprising a first user terminal, a second user terminal and a background server.

[0029] The first user terminal displays a first interface, the first interface including an operation interface for the first user to manage or view dental treatment information, the first interface including a first control, the first control being used to trigger a smile simulation guidance function;

[0030] The first user terminal displays a second interface in response to the operation of the first control, and the second interface is used to generate jump information, and the jump information is used to guide the second user to use the smile simulation function. The smile simulation function includes processing the facial image of the second user and generating the desired interactive simulation effect diagram.

[0031] The second user terminal obtains the jump information shared by the background server.

[0032] The second user terminal displays a first interface in response to the second user's operation on the jump information, and the first interface is used to guide the second user to use the smile simulation function; the jump information is generated by the first user based on the operation interface for managing or viewing dental treatment information; the second user terminal displays a second interface in response to the second user's operation on the first interface; the second interface is used to obtain the facial image of the second user.

[0033] The second user terminal uploads the facial image of the second user to the background server; the background server generates an interactive simulation effect diagram after correction of the simulated dental correction mode corresponding to the facial image based on the facial image of the second user uploaded by the second user terminal, and sends the interactive simulation effect diagram after correction of the simulated dental correction mode corresponding to the facial image to the second user terminal.

[0034] The second user terminal displays a third interface, which includes an interactive simulation effect diagram of the simulated dental correction mode corresponding to the facial image. The interactive simulation effect diagram is a desired smile simulation image generated after image processing of the facial image.

[0035] In one possible implementation method, the second interface includes at least one control corresponding to an interactive mode, and the at least one interactive mode is used to guide the second user to use the smile simulation function; it also includes: the first user end generates jump information in response to the operation of the control corresponding to the at least one interactive mode, and the jump information is used to guide the second user to trigger a jump to the interface including the guide control, and the guide control is used to guide the second user to use at least one interactive mode.

[0036] In one possible implementation method, at least one interactive mode includes a first interactive mode, which is used to guide the second user to use a smile simulation function to process the second user's facial image to generate an interactive simulation effect diagram after correction of the simulated dental correction model.

[0037] In one possible implementation method, at least one interactive mode also includes a second interactive mode, and the second interactive mode includes at least one of the following: a fixed correction mode or an invisible correction mode; the second interactive mode is used to guide the second user to use the smile simulation function to process the second user's facial image to generate an interactive simulation effect diagram of wearing the corresponding corrective device.

[0038] In a possible implementation method, the jump information includes one or more of the following: a network link or a QR code.

[0039] In a possible implementation method, the second interface further includes: at least one of an information guidance item and an information feedback item; the information guidance item is used to obtain guidance information preferred by the first user; and the information feedback item is used to collect feedback information from the second user.

[0040] In one possible implementation method, the first user terminal displays a fourth interface, and the fourth interface includes feedback information from at least one second user, and the feedback information includes at least one of the following: an information feedback item with feedback information, a facial image of the second user, or at least one interactive simulation effect diagram corresponding to the facial image of the second user.

[0041] In one possible implementation method, the first user terminal triggers the sharing of initial diagnosis information to the second user in response to an operation on the fourth interface; the initial diagnosis information includes preliminary treatment recommendations for the second user based on the feedback information of the second user.

[0042] In one possible implementation method, the first user terminal regenerates jump information in response to an update operation on a control corresponding to at least one interaction mode in the second interface, and the regenerated jump information is used to guide the second user to use the updated interaction mode.

[0043] In one possible implementation method, the first interface includes a guide control for an interactive mode; the second user terminal displays a second interface in response to the second user's operation of the guide control; and the third interface is displayed, the third interface including an interactive simulation effect diagram of a facial image, the interactive simulation effect diagram being a smile simulation image after image processing of the facial image based on the interactive mode.

[0044] In one possible implementation method, the third interface also includes a fourth control; the second user end, in response to the second user's operation of the fourth control, displays a fifth interface, and the fifth interface includes an information feedback item; receives feedback information entered by the second user in the information feedback item, and uploads first information to the background server, and the first information includes at least one of the following: an information feedback item of the feedback information, a facial image of the second user, or an interactive simulation effect diagram corresponding to at least one interactive mode corresponding to the facial image of the second user.

[0045] In one possible implementation method, the third interface also includes a sixth control; the second user end, in response to the second user's operation of the sixth control, displays the sixth interface, and the sixth interface includes at least one of the following items: an interactive simulation effect diagram corresponding to at least one interactive mode, and jump information; and sends the second information, and the second information includes: an interactive simulation effect diagram corresponding to at least one interactive mode and at least one item of jump information.

[0046] In one possible implementation method, the second user terminal receives initial diagnosis information; the initial diagnosis information includes preliminary treatment recommendations for the second user based on the second user's feedback information; or, sends diagnosis and treatment inquiry information; the diagnosis and treatment inquiry information includes the second user's treatment needs.

[0047] In one possible implementation method, the second user terminal displays a fourth interface, which includes a contour box and a second control; the contour box is used to indicate the position of the second user's face and teeth in the image to be captured; the second control is used to capture the user's facial image.

[0048] In one possible implementation method, the third interface further includes a third control, which is used to trigger the display of an interactive simulation effect diagram corresponding to at least one interactive mode; the method further includes at least one of the following:

[0049] The second user terminal, in response to the second user's operation on the third control, displays an interactive simulation effect diagram of the simulated dental correction model corresponding to the facial image on the third interface;

[0050] The second user terminal displays an interactive simulation effect diagram corresponding to the fixed correction mode corresponding to the facial image on the third interface in response to the second user's operation on the third control;

[0051] The second user terminal, in response to the second user's operation on the third control, displays an interactive simulation effect diagram corresponding to the invisible correction mode corresponding to the facial image on the third interface.

[0052] In a fourth aspect, an embodiment of the present application provides an electronic device, including a processor and a memory;

[0053] The memory is used to store a computer program, and the processor executes the computer program to implement the steps of any possible design method of any aspect above.

[0054] In a fifth aspect, an embodiment of the present application further provides a device comprising modules / units for executing any one of the possible design methods of any of the above aspects. These modules / units may be implemented by hardware, or by hardware executing corresponding software implementations.

[0055] In a sixth aspect, an embodiment of the present application further provides a computer-readable storage medium, which stores a computer program or instructions. When the computer program or instructions are executed by a processor, the steps of any possible design method of any of the above aspects are implemented.

[0056] In a seventh aspect, an embodiment of the present application further provides a method comprising a computer program product, which, when the computer program product is run on a terminal, enables an electronic device to execute any possible design of any of the above aspects.

[0057] These and other aspects of the present application will become more readily apparent from the description of the following embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] FIG1 is a schematic structural diagram of a smile simulation interactive system provided by an embodiment of the present application;

[0059] FIG2 is a schematic flow chart of an interactive method for smile simulation provided in an embodiment of the present application;

[0060] FIG3 is a schematic diagram of a first interface provided in an embodiment of the present application;

[0061] FIG4 is a schematic diagram of a second interface provided in an embodiment of the present application;

[0062] FIG5 is a schematic diagram of a third interface provided in an embodiment of the present application;

[0063] FIG6 is a schematic diagram of a sharing link interface provided in an embodiment of the present application;

[0064] FIG7 is a schematic diagram of a poster sharing interface provided in an embodiment of the present application;

[0065] FIG8 is a schematic diagram of a download selection interface provided in an embodiment of the present application;

[0066] FIG9 is a schematic diagram of a fourth interface provided in an embodiment of the present application;

[0067] FIG10 is a flow chart of an interactive method for smile simulation provided in an embodiment of the present application;

[0068] FIG11 is a schematic diagram of a first interface provided in an embodiment of the present application;

[0069] FIG12 is a schematic diagram of an authorization prompt interface provided in an embodiment of the present application;

[0070] FIG13 is a schematic diagram of a second interface provided in an embodiment of the present application;

[0071] FIG14 is a schematic diagram of a fourth interface provided in an embodiment of the present application;

[0072] FIG15 is a schematic diagram of a third interface provided in an embodiment of the present application;

[0073] FIG16 is a schematic diagram of a fifth interface provided in an embodiment of the present application;

[0074] FIG17 is a schematic diagram of a sixth interface provided in an embodiment of the present application;

[0075] FIG18 is a schematic diagram of a third interface provided in an embodiment of the present application;

[0076] FIG19 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0077] To make the objectives, technical solutions, and advantages of this application more clear, the present application will be further described in detail below with reference to the accompanying drawings. The specific operating methods in the method embodiments can also be applied to the device embodiments or system embodiments. In the description of this application, unless otherwise specified, the meaning of "multiple" is two or more.

[0078] It should be noted that the term "and / or" in this document is merely a description of the association relationship between associated objects, indicating that three relationships may exist. For example, A and / or B can represent three situations: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this document, unless otherwise specified, generally indicates that the previous and subsequent associated objects are in an "or" relationship. In the description of the embodiments of the present application, words such as "first" and "second" are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.

[0079] FIG1 is a schematic diagram of the structure of a smile simulation interactive system provided in an embodiment of the present application. The smile simulation interactive system includes a first terminal device, a second terminal device, and a backend server. The user group of the first terminal device, i.e., the first user, may include doctors, operators, designers, or managers, etc. The user group of the second terminal device, i.e., the second user, may include users using the smile simulation function, patients, etc. The backend server is located at the first user end.

[0080] In one possible implementation method, the first user terminal sets up dental treatment push information with a smile simulation guidance function, and the dental treatment push information includes jump information. The background server can share the dental treatment push information with a smile simulation guidance function with the second user. There are many ways to share, for example, the push information can be shared to the platform; the platform can be one or more, and it can also be shared with the second user in other ways, for example, posting posters with jump information in medical institutions, or distributing promotional materials with jump information to the second user.

[0081] For example, a second user discovers a dental treatment push notification with a smile simulation guide on a different platform, accesses the redirect information included in the dental treatment push notification, and uses the smile simulation feature. It should be noted that the smile simulation feature simulates the effect of the second user's orthodontic treatment, not the actual effect after the second user's orthodontic treatment.

[0082] In one possible implementation method, the smile simulation interactive system includes the following specific contents:

[0083] The first terminal device displays a first interface, which includes an operation interface for the first user to manage or view dental treatment information, and the first interface includes a first control, which is used to trigger a smile simulation guidance function; the first terminal device displays a second interface in response to the operation of the first control, and the second interface is used to generate jump information, which is used to guide the second user to use the smile simulation function, and the smile simulation function includes processing a facial image of the second user and generating a desired interactive simulation effect diagram.

[0084] The second terminal device displays a first interface in response to the second user's operation on the jump information, and the first interface is used to guide the second user to use the smile simulation function; the jump information is generated by the first user based on the operation interface for managing or viewing dental treatment information; the second user end displays a second interface in response to the second user's operation on the first interface; the second interface is used to obtain the facial image of the second user; the second user end uploads the facial image of the second user to the background server.

[0085] The backend server generates an interactive simulation effect diagram of the simulated dental correction mode corresponding to the facial image of the second user uploaded by the second user terminal, and sends the interactive simulation effect diagram of the simulated dental correction mode corresponding to the facial image to the second user terminal.

[0086] The second user terminal displays a third interface, which includes an interactive simulation effect diagram of the simulated dental correction mode corresponding to the facial image. The interactive simulation effect diagram is a desired smile simulation image generated after image processing of the facial image.

[0087] In one possible implementation method, the second interface includes at least one control corresponding to an interactive mode, and the at least one interactive mode is used to guide the second user to use the smile simulation function; it also includes: the first terminal device generates jump information in response to the operation of the control corresponding to the at least one interactive mode, and the jump information is used to guide the second user to trigger a jump to the interface including the guide control, and the guide control is used to guide the second user to use at least one interactive mode.

[0088] In one possible implementation method, at least one interactive mode includes a first interactive mode, which is used to guide the second user to use a smile simulation function to process the second user's facial image to generate an interactive simulation effect diagram after correction of the simulated dental correction model.

[0089] In one possible implementation method, at least one interactive mode also includes a second interactive mode, and the second interactive mode includes at least one of the following: a fixed correction mode or an invisible correction mode; the second interactive mode is used to guide the second user to use the smile simulation function to process the second user's facial image to generate an interactive simulation effect diagram of wearing the corresponding braces, or generate an interactive simulation effect diagram of wearing the corresponding shell-shaped dental instrument.

[0090] In a possible implementation method, the jump information includes one or more of the following: a network link or a QR code.

[0091] In a possible implementation method, the second interface further includes: at least one of an information guidance item and an information feedback item; the information guidance item is used to obtain guidance information preferred by the first user; and the information feedback item is used to collect feedback information from the second user.

[0092] In one possible implementation method, the first terminal device displays a fourth interface, and the fourth interface includes feedback information of at least one second user, and the feedback information includes at least one of the following: an information feedback item with feedback information, a facial image of the second user, or at least one interactive simulation effect diagram corresponding to the facial image of the second user.

[0093] In one possible implementation method, the first terminal device triggers the sharing of initial diagnosis information to the second user in response to an operation on the fourth interface; the initial diagnosis information includes preliminary treatment recommendations for the second user based on feedback information from the second user.

[0094] In one possible implementation method, the first terminal device regenerates jump information in response to an update operation on a control corresponding to at least one interaction mode in the second interface, and the regenerated jump information is used to guide the second user to use the updated interaction mode.

[0095] In one possible implementation method, the first interface includes a guide control for an interactive mode; the second terminal device displays the second interface in response to the second user's operation of the guide control; and displays the third interface, which includes an interactive simulation effect diagram of a facial image, wherein the interactive simulation effect diagram is a smile simulation image after image processing of the facial image based on the interactive mode.

[0096] In one possible implementation method, the first interface includes a guide control for an interactive mode; the second terminal device displays the second interface in response to the second user's operation of the guide control; and displays the third interface, which includes an interactive simulation effect diagram of a facial image, wherein the interactive simulation effect diagram is a smile simulation image after image processing of the facial image based on the interactive mode.

[0097] In one possible implementation method, the third interface also includes a fourth control; the second terminal device displays a fifth interface in response to the second user's operation of the fourth control, and the fifth interface includes an information feedback item; receives feedback information entered by the second user in the information feedback item, and uploads the first information to the background server, and the first information includes at least one of the following: an information feedback item of the feedback information, a facial image of the second user, or an interactive simulation effect diagram corresponding to at least one interactive mode corresponding to the facial image of the second user.

[0098] In one possible implementation method, the third interface also includes a sixth control; the second terminal device, in response to the second user's operation of the sixth control, displays the sixth interface, and the sixth interface includes at least one of the following items: an interactive simulation effect diagram corresponding to at least one interactive mode, and jump information; and sends the second information, and the second information includes: an interactive simulation effect diagram corresponding to at least one interactive mode and at least one item of jump information.

[0099] In one possible implementation method, the second terminal device receives initial diagnosis information; the initial diagnosis information includes preliminary treatment recommendations for the second user based on the feedback information of the second user; or sends diagnosis and treatment inquiry information; the diagnosis and treatment inquiry information includes the treatment needs of the second user.

[0100] In one possible implementation method, the second terminal device displays a fourth interface, which includes a contour box and a second control; the contour box is used to indicate the position of the second user's face and teeth in the image to be captured; the second control is used to capture the facial image of the second user.

[0101] In one possible implementation method, the third interface further includes a third control, which is used to trigger the display of an interactive simulation effect diagram corresponding to at least one interactive mode; the method further includes at least one of the following:

[0102] The second terminal device, in response to the second user's operation on the third control, displays on the third interface an interactive simulation effect diagram of the simulated dental correction mode corresponding to the facial image;

[0103] The second terminal device displays, on the third interface, an interactive simulation effect diagram corresponding to the fixed correction mode corresponding to the facial image in response to the second user's operation on the third control;

[0104] The second terminal device, in response to the second user's operation on the third control, displays an interactive simulation effect diagram corresponding to the invisible correction mode corresponding to the facial image on the third interface.

[0105] Figure 2 is a flow chart of an interactive method for smile simulation provided by an embodiment of the present application. The method can be executed by the first terminal device of the first user end or the module of the first terminal device. The present application does not limit the execution subject of the method. In some embodiments of the present application, the electronic device can be a mobile phone, a tablet computer, a notebook computer, or a wearable device with wireless communication function (such as a smart watch or smart glasses, etc.). The electronic device includes a device capable of performing data processing functions (such as a processor, or an application processor, or an image processor, or other processors), and a device capable of displaying a user interface (such as a display screen). Exemplary embodiments of the electronic device include but are not limited to a device equipped with Or devices with other operating systems. The electronic device may also be other portable devices, such as a laptop computer with a touch-sensitive surface (e.g., a touch panel). It should also be understood that in some other embodiments of the present application, the electronic device may not be a portable electronic device, but a desktop computer with a touch-sensitive surface (e.g., a touch panel).

[0106] Based on the different electronic devices, the operations on various controls in this application can be click, drag, double-click, touch, gesture, voice, etc., which are not limited here.

[0107] The method comprises the following steps:

[0108] Step 201: The first terminal device displays a first interface.

[0109] The first interface includes an operating interface for a first user to manage or view dental treatment information. The first interface includes a first control, and the first control is used to trigger the smile simulation guidance function. For example, the first interface can be a webpage, a mini-program, an interface within an application, or other forms of interfaces, which are not limited here. Similarly, the interfaces in this application can be webpages, interfaces within applications, or other forms of interfaces, which are not limited here and will not be further described.

[0110] Optionally, the dental treatment information may include: patient case information, case information of a second user using the smile simulation function, etc. Optionally, the management or viewing method may be a separate viewing or management method, or a combined viewing or combined management method. Optionally, the operation interface may be an operation interface for managing or viewing patient case information, or may include a function for managing or viewing case information of a second user using the smile simulation function.

[0111] In one possible implementation method, the first interface 300 is shown in Figure 3, and the first interface 300 includes a first control 301. For example, the name of the first control 301 can be "Create Smile Simulation" or "New Smile Simulation". This application does not limit the specific name of the first control 301.

[0112] Step 202: The first terminal device displays a second interface in response to an operation on the first control.

[0113] Among them, the second interface is used to generate jump information, and the jump information is used to guide the second user to use the smile simulation function. The smile simulation function includes processing the facial image of the second user and generating the desired interactive simulation effect diagram.

[0114] In one possible implementation method, in response to the first user's operation on the first control 301, such as a click operation, the second interface 400 is displayed, as shown in FIG4 ; wherein the click operation can be a mouse click operation or a touch screen click operation. The operation can also be other operations, such as dragging, double-clicking, tapping, gestures, voice, etc., which are not limited in this application.

[0115] In one possible implementation method, the jump information includes but is not limited to one or more of the following: a network link or a QR code. Of course, it can also be other ways, and this application does not limit this. In one possible implementation method, the second interface 400 includes a control corresponding to at least one interactive mode, and at least one interactive mode is used to guide the second user to use the smile simulation function; wherein, generating the jump information specifically includes: in response to the operation of the control corresponding to at least one interactive mode, generating the jump information, the jump information is used to guide the second user to trigger the jump to the interface including the guide control, and the guide control is used to guide the second user to use at least one interactive mode.

[0116] In one possible implementation method, at least one interactive mode includes a first interactive mode 402, which is used to guide the second user to use a smile simulation function to process the second user's facial image to generate an interactive simulation effect image after correction using a simulated orthodontic model. For example, the name of the first interactive mode 402 can be "Smile Simulation" or "Orthodontic Model." This application does not limit the name of the first interactive mode 402.

[0117] In one possible implementation method, the control corresponding to the first interaction mode 402 is a multiple-selection box. In response to the first user's operation (such as clicking) on ​​the control corresponding to the first interaction mode 402, the control corresponding to the first interaction mode 402 is selected, that is, the control corresponding to the first interaction mode 402 is in a selected state.

[0118] In one possible implementation method, the control corresponding to the first interaction mode 402 is in a selected state by default.

[0119] In one possible implementation method, at least one interaction mode includes a second interaction mode 403, and the second interaction mode 403 includes at least one of the following: a fixed correction mode or an invisible correction mode; the second interaction mode 403 is used to guide the second user to use the smile simulation function to process the second user's facial image to generate an interactive simulation effect diagram of wearing a corresponding brace; exemplarily, if the second interaction mode 403 is a fixed correction mode, then after processing the second user's facial image, an interactive simulation effect diagram of wearing braces is generated; if the second interaction mode 403 is an invisible correction mode, then after processing the second user's facial image, an interactive simulation effect diagram of wearing invisible braces is generated.

[0120] In one possible implementation method, the control corresponding to the second interaction mode 403 is a multiple-selection box. In response to the first user's operation (such as clicking) on ​​the control corresponding to the second interaction mode 403, the control corresponding to the second interaction mode 403 is selected, that is, the control corresponding to the second interaction mode 403 is in a selected state.

[0121] In one possible implementation method, the second interface 400 further includes a creation control 401, which is used to trigger the generation of jump information. The name of the creation control 401 can be "Create Smile Simulation", "Next", or "OK", and this application does not limit the name of the creation control 401.

[0122] In one possible implementation method, jump information is generated in response to the first user's operation on the creation control 401. The operation may be click, drag, double-click, touch, gesture, voice, etc., which are not limited here.

[0123] In the above scheme, the jump information generated by the first user terminal can guide the second user to trigger the jump to the interface including the guide control, and the guide control can guide the second user to use at least one interactive mode. That is, after the second user terminal receives the dental treatment push message sent by the first user, the dental treatment push message includes the jump information. The second user can use the smile simulation function on the second user terminal by accessing the jump information to process the second user's facial image and generate the desired interactive simulation effect diagram; that is, the second user can see the possible effect diagrams of his own teeth correction process, thereby helping patients to establish an understanding of orthodontic treatment, while promoting communication between orthodontists and patients, reducing patients' medical costs, and helping to improve patients' medical experience.

[0124] The following will take the tablet computer 10 as an example of the first terminal device, and describe in detail the smile simulation interaction method provided in steps 201 to 202 in conjunction with the accompanying drawings.

[0125] FIG. 3 exemplarily shows a first interface 300 corresponding to step 201 displayed by the tablet computer 10 .

[0126] In a possible implementation method, the first interface 300 is a function guide interface. In addition to the first control 301, the first interface 300 may also include at least one of the following: an introduction module 302, a link creation module 303, a web page sharing module 304, a data statistics module 305, and a function demonstration module 306. The introduction module 302 is used to introduce the smile simulation function, including "You can create a smile simulation link and share it. The second user can experience the smile simulation through the link you shared"; the link creation module 303 is used to instruct the user to fill in the smile simulation form, fill in the first user's information and the information required for the second user's feedback; the web page sharing module 304 is used to share the information of the second user. The sharing function is introduced, specifically, after saving the filled-in form, a web page is generated, which can be shared to other platforms to attract a second user experience; the web page sharing module 304 also includes a learn details control, which responds to the first user's operation on the learn details control (such as clicking) to display the third interface 500; the data statistics module 305 is used to introduce the statistical function, specifically, the number of users and the number of people who uploaded feedback information can be viewed; the data statistics module 305 also includes a learn details control, which responds to the first user's operation on the learn details control (such as clicking) to display the third interface 500; the function demonstration module 306 is used to display the usage process of the smile simulation in the form of video or picture.

[0127] In a possible implementation method, in response to the first user's operation on the first control 301 , such as a click operation, the second interface 400 is displayed; FIG4 exemplarily shows the second interface 400 displayed on the tablet computer 10 .

[0128] In one possible implementation method, a second interface 400 with at least one interactive mode is displayed on the tablet computer 10. As shown in Figure 4, the second interface 400 includes three interactive modes and a creation control 401, wherein the three interactive modes are smile simulation, invisible correction simulation, and fixed correction simulation; each interactive mode includes corresponding controls and text descriptions, and the control corresponding to each interactive mode is a multiple-choice box, and each multiple-choice box is in a selected state or an unselected state; exemplarily, if the multiple-choice box corresponding to the smile simulation is in an unselected state, when the tablet computer 10 detects an operation acting on the multiple-choice box corresponding to the smile simulation, in response to the operation, the multiple-choice box corresponding to the smile simulation is in a selected state; if the multiple-choice box corresponding to the smile simulation is in a selected state, when the tablet computer 10 detects an operation acting on the multiple-choice box corresponding to the smile simulation, in response to the operation, the multiple-choice box corresponding to the smile simulation is in an unselected state, that is, after selecting the multiple-choice box corresponding to the smile simulation, performing the operation again can unselect the multiple-choice box corresponding to the smile simulation.

[0129] In one possible implementation method, the multiple-selection box corresponding to the smile simulation is selected by default, the multiple-selection box corresponding to the invisible correction simulation is unselected by default, and the multiple-selection box corresponding to the fixed correction simulation is unselected by default.

[0130] In one possible implementation method, the first user selects a control corresponding to at least one interactive mode; illustratively, before the first user clicks to create control 401, the multiple-check box corresponding to the smile simulation and the multiple-check box corresponding to the invisible correction simulation are in a selected state; or, before the first user clicks to create control 401, the multiple-check box corresponding to the smile simulation, the multiple-check box corresponding to the invisible correction simulation, and the multiple-check box corresponding to the fixed correction simulation are all in a selected state.

[0131] In one possible implementation, second interface 400 may further include an information guidance item 404 for obtaining guidance information preferred by the first user. Information guidance item 404 may include, but is not limited to, one or more of the following: the name of the first user's institution, the first user's name, or other information. Other information may include an institution logo and the region where the institution is located. Information guidance item 404 may also include other content, which is not limited in this application.

[0132] In one possible implementation method, the name of the first user's organization is a required item.

[0133] In one possible implementation method, the second interface 400 may also include an information feedback item 405, which is used to collect feedback information from the second user; the information feedback item 405 includes a preset information feedback item and a custom information feedback item; wherein the preset information feedback item is the system default information feedback item. The preset information feedback item includes but is not limited to one or more of the following contents: name, date of birth, contact information, etc. Of course, the preset information feedback item may also include other content, which is not limited in this application. The custom information feedback item is an information feedback item customized by the first user, such as the first user can customize the correction request, correction amount, etc. Of course, the first user can also customize other content, which is not limited in this application.

[0134] In one possible implementation method, when the tablet computer 10 detects an operation (such as a click) on a custom information feedback item, in response to the operation, a custom information feedback item window is displayed, and the custom information feedback item window is displayed floating above the second interface 400.

[0135] In one possible implementation, the custom information feedback item window includes multiple preset definition question modules and a confirmation control. Each preset definition question module includes a checkbox and a text description, and each checkbox is initially unchecked. A first user can click on the checkbox corresponding to each preset definition question module. In response to the first user's operation, the checkbox corresponding to each preset definition question module is selected or unchecked. When the tablet computer 10 detects an operation (e.g., a click) on the confirmation control, it closes the custom information feedback item window and displays the second interface 400 in response to the operation. The feedback item on the second interface 400 is newly added with the preset definition question selected in the custom information feedback item window.

[0136] In one possible implementation method, the custom information feedback item window includes a text box, an add control, and a confirmation control. When the tablet computer 10 detects an operation on the text box (such as input), the text information entered by the first user is displayed in the text box in response to the operation; when the tablet computer 10 detects an operation on the add control (such as a click), the tablet computer 10 adds a new text box to the custom information feedback item window in response to the operation; when the tablet computer 10 detects an operation on the confirmation control (such as a click), the tablet computer 10 closes the custom information feedback item window and displays the second interface 400, with the information feedback item on the second interface 400 adding the content entered in the text box of the custom information feedback item window.

[0137] In a possible implementation method, the second interface 400 may further include a preview information module 406, and the preview information module 406 is used to preview the effect of the second user terminal using the smile simulation function.

[0138] In a possible implementation method, the preview information module 406 is embedded in the second interface 400 in a mobile phone interface mode. The preview information module 406 includes text, pictures embedded in the text, and corresponding controls.

[0139] In one possible implementation method, the second interface 400 may further include a note module 407, which is used for the first user to mark some indication information, such as a sharing platform, etc. For example, the first user can use the note module 407 to note that the newly created smile simulation link will be shared to the XX platform.

[0140] In one possible implementation, in response to the first user's operation (e.g., a click) on the create control in the second interface 400, the third interface 500 is displayed. The third interface can also be redirected in other ways, such as from the first interface, without limitation. FIG5 shows an example of the third interface.

[0141] In one possible implementation, the third interface 500 may include a creation function module 508, which has the same function as the first control 301 in the first interface 300 and is used to indicate an entrance to the second interface 400. When the tablet computer 10 detects an operation (such as a click) on the creation function module 508, the second interface 400 is displayed in response to the operation.

[0142] In one possible implementation method, the third interface 500 may include at least one sharing link module 501, at least one sharing link module 501 is embedded in the third interface 500, and each sharing link module 501 includes one or more of the following: a sharing platform module 502, a creation time module 503, a status module 504, a medical institution information module 505, a statistical information sub-module 506 or a function module 507. This application does not limit the layout of different modules corresponding to the sharing link module 501 in the sharing link module 501.

[0143] The following uses the sharing link module A as an example to specifically illustrate the content and layout of the sharing information. Figure 5 exemplifies the layout of the various modules that may be included in the sharing link module A. Specifically, the sharing platform module 502, the creation time module 503, and the status module 504 are located at the top of the sharing link module A. The medical institution information module 505 and the statistical information submodule 506 are located in the middle of the sharing link module A. The function module 507 is located at the bottom of the sharing link module A. Specifically, the sharing platform module 502 is used to indicate the platform corresponding to the publishing of the sharing link module 501, that is, the content entered by the first user in the notes module 407 in the second interface 400; the creation time module 503 is used to indicate the time when the sharing link module A was created; and the status module 504 is used to indicate the status of the sharing link module A, which can be sharing in progress or closed.

[0144] The medical institution information module 505 includes information about the first user, such as the name of the first user and the name of the medical institution where the first user is located; of course, it may also include other content, which is not limited in this application.

[0145] The statistical information submodule 506 includes the number of people who have newly uploaded feedback information today, the total number of uploaded feedback information, a download control 5061, and a view report control 5062. The view report control 5062 is the second control corresponding to the third interface 500. When the tablet computer 10 detects an action on the download control 5061 (e.g., a click), the download selection interface 800 is displayed in response to the action. When the tablet computer 10 detects an action on the view report control 5062 (e.g., a click), the fourth interface 900 is displayed in response to the action. Of course, the fourth interface 900 can also be displayed in other ways, such as displaying the fourth interface 900 in response to a click on the data statistics module 305 shown in FIG. 3 , or displaying the fourth interface 900 in response to a click on the function demonstration module 306 shown in FIG. 3 , and this application does not limit this.

[0146] The functional module 507 includes but is not limited to one or more of the following: a view count module 5071, an edit control 5072, a delete control 5073 or a share control 5074, wherein the view count module 5071 refers to the number of people who have browsed the share link module A; the edit control 5072 can modify the corresponding content of the share link module A. Specifically, when the tablet computer 10 detects an operation (such as a click) on the edit control 5072, the second interface 400 corresponding to the share link module A is displayed in response to the operation; the delete control 5073 can delete the share link module A; specifically, when the tablet computer 10 detects an operation (such as a click) on the delete control 5073, the share link module A is deleted in response to the operation; the share control 5074 can generate a share link for the share link module A; specifically, when the tablet computer 10 detects an operation (such as a click) on the share control 5074, the share link interface 600 is displayed in response to the operation. The share link interface 600 includes text and a share link 601 embedded in the text, as shown in Figure 6.

[0147] In one possible implementation method, after receiving feedback from a second user, the first user re-edits the shared link module A based on the second user's suggestions for the smile simulation function in the feedback, and republishes the shared link module A. Alternatively, the first user analyzes problems with the shared link module A based on the content of the fourth interface 900 corresponding to the shared link module A, re-edits the shared link module A, and republishes the shared link module A. The first user analyzes problems with the shared link module A based on the content of the fourth interface 900 corresponding to the shared link module A. For example, if the statistics of the fourth interface 900 show a large number of visitors, but only a few or no second users have left feedback, the first user analyzes that the push effect of the shared link module A is poor and re-edits the shared link module A. Alternatively, the first user adjusts the sharing of the interactive mode based on feedback data from different interactive modes. For example, based on the feedback data from different interactive modes, the first user analyzes which interactive mode is more popular and increases the sharing frequency of the interactive mode. Alternatively, the first user adjusts the sharing priority of the interactive mode, or preferentially displays the rendering corresponding to the interactive mode on the second user terminal.

[0148] In one possible implementation method, when the tablet computer 10 detects an operation (such as a click) on the editing control 5072, which is the fourth control, the second interface 400 is displayed in response to the operation on the fourth control, and the first user edits the existing information or adds new information on the second interface 400. For example, the previous sharing link module A only includes one interaction mode, and the sharing link module A after editing includes three interaction modes. After the editing is completed, the sharing link module A is republished in response to the first user's operation on the creation control (such as a click operation), and the third interface 500 is displayed.

[0149] In one possible implementation, the share link interface 600 also includes a download share poster control and a copy control. When the tablet computer 10 detects an operation (e.g., a click) on the download share poster control, the tablet computer 10 closes the share link interface 600 and displays the share poster interface 700 in response to the operation. When the tablet computer 10 detects an operation (e.g., a click) on the copy button, the tablet computer 10 closes the share link interface 600 and copies the share link 601 contained in the share link interface 600 in response to the operation.

[0150] In one possible implementation method, as shown in Figure 7, the sharing poster interface 700 includes but is not limited to one or more of the following: text, pictures embedded in the text, and QR codes, etc., and the QR code contains the content of the sharing link module A; exemplarily, when the first user A clicks the sharing control 5074 of the sharing link module A, the sharing link interface 600 is displayed, and the first user A further clicks to download the sharing poster control. The tablet computer 10 generates a sharing poster interface 700 in response to the operation of the first user A. The QR code in the sharing poster interface 700 contains the content of the sharing link module A. The second user can scan the QR code in the sharing poster interface 700 to jump to the interface including the guide control.

[0151] In one possible implementation method, the above-mentioned sharing link 601 and the QR code in the sharing poster interface 700 are collectively referred to as jump information. The jump information is used to trigger a jump to an interface including a guide control, and the guide control is used to guide the second user to use at least one interactive mode.

[0152] In one possible implementation method, after generating the sharing poster interface 700 or sharing link 601, the staff can publish the sharing poster interface 700 and / or sharing link 601 on different platforms, where the different platforms include but are not limited to one or more of the following: Zhihu, mini-programs, Xiaohongshu, QQ Space, Moments, Weibo, or Taobao, etc., which are not limited in this application. When a second user finds the sharing poster interface 700 and / or sharing link 601 on a different platform, they can scan the QR code in the sharing poster interface 700 or click on the sharing link 601 to obtain the corresponding sharing information and display the corresponding orthodontic effect image according to at least one interactive mode in the sharing information.

[0153] In a possible implementation method, the third interface 500 shown in FIG5 further includes a statistical information module 509. For example, the statistical information module 509 may include at least one item: a feedback statistics module 5091 and an access statistics module 5092. Of course, it may also include other modules, which are not limited in this application. Among them, the feedback statistics module 5091 includes a new feedback number submodule and a total feedback number submodule; the new feedback number refers to the number of new second users who have uploaded feedback information; the total feedback number refers to the total number of second users who have uploaded feedback information; the new feedback number submodule includes a display module and a time label module. The time label module is a single-selection control. The display module is a text box. For example, the time tag module can be divided into today, the past 7 days, and the past 30 days. If the tablet computer 10 detects an operation (e.g., a click) on the today selection control of the time tag module, the number of new feedbacks added today will be displayed on the display module in response to the operation. If the tablet computer 10 detects an operation (e.g., a click) on the past 7 days selection control of the time tag module, the number of new feedbacks added in the past 7 days will be displayed on the display module in response to the operation. If the tablet computer 10 detects an operation (e.g., a click) on the past 30 days selection control of the time tag module, the number of new feedbacks added in the past 30 days will be displayed on the display module in response to the operation. The total feedback count submodule includes a display module and a download control 5093. The display module is used to display the total number of second users who have uploaded feedback information; the download control 5093 is used to download the information of the second users who have uploaded feedback information in total. If the tablet computer 10 detects an operation (e.g., a click) on the download control 5093, the download selection interface 800 will be displayed in response to the operation.

[0154] In one possible implementation, the access statistics module 5092 includes a new access count submodule and a total access count submodule. The new access count refers to the number of new second users who have accessed the shared information; the total access count refers to the total number of second users who have accessed the shared information. The new access count submodule includes a display module and a time tag module. The time tag module is a single-select control and the display module is a text box. For example, the time tag module can be divided into today, the past 7 days, and the past 30 days. If the tablet computer 10 detects an operation (e.g., a click) on the today select control of the time tag module, the display module displays the number of new accesses for today in response to the operation. If the tablet computer 10 detects an operation (e.g., a click) on the past 7 days select control of the time tag module, the display module displays the number of new accesses for the past 7 days in response to the operation. If the tablet computer 10 detects an operation (e.g., a click) on the past 30 days select control of the time tag module, the display module displays the number of new accesses for the past 30 days in response to the operation. The total access count submodule includes a display module, wherein the display module is used to display the total number of second users who have accessed.

[0155] In one possible implementation method, when the tablet computer 10 detects an operation (e.g., a click) on the download control 5093, the tablet computer 10 displays a download selection interface 800 in response to the operation. As shown in FIG8 , the download selection interface 800 is suspended above the third interface 500. The download selection interface 800 includes, but is not limited to, one or more of the following: a time selection module 801, a status selection module 802, a prompt module 803, a download control 804, and a close control 805. The time selection module 801 is used to indicate the time period for downloading the feedback information uploaded by the second user. For example, the time selection module 801 includes options for the last month, the last three months, and a custom time period. Each option includes text and a corresponding control, and the control corresponding to each option is a radio button. The custom time period option is used to customize the start and end times for downloading the feedback information uploaded by the second user. The status selection module 802 includes all options, communicated options, and uncommunicated options. Each option includes text and a corresponding control, and the control corresponding to each option is a radio control. If the radio button corresponding to the all options is selected, it means downloading all the second user's information within the specified time. If the radio button corresponding to the communicated option is selected, it means downloading the information of the second user who has communicated within the specified time. Communicated means that the medical institution has contacted the second user. If the radio button corresponding to the uncommunicated option is selected, it means downloading the information of the second user who has not communicated within the specified time. Uncommunicated means that the medical institution has not contacted the second user. Among the multiple options corresponding to the status selection module 802, only one option is selected, and all options are selected by default.

[0156] In one possible implementation, if the tablet computer 10 detects an operation (e.g., a click) on the download control 804 in FIG8 , the tablet computer 10 downloads the corresponding feedback information in response to the operation and closes the download selection interface 800. If the tablet computer 10 detects an operation (e.g., a click) on the close control 805, the tablet computer 10 closes the download selection interface 800 in response to the operation.

[0157] In one possible implementation method, in the download selection interface 800, clicking any time in the time selection module 801 displays the time period corresponding to the time. For example, clicking the most recent month in the time selection module 801 displays 2023.11.25-2023.12.25 below the most recent month.

[0158] In one possible implementation method, when the tablet computer 10 detects an operation (such as a click) on a custom module in the time selection module 801, a calendar window is displayed in response to the operation, and the second user can select the start time and end time in the calendar window.

[0159] In one possible implementation method, the download selection interface 800 also includes a state transition module 806, which is used to indicate the download of information of the second user who has been communicated within a specified time; exemplarily, the uncommunicated option of the state selection module 802 is in a selected state, and when the download control 804 is clicked, the information of the second user who has not been communicated within the specified time should be downloaded; but if the control corresponding to the state transition module 806 is also in a selected state at this time, the information of the second user who has been communicated within the specified time will be downloaded.

[0160] In one possible implementation method, when the tablet computer 10 detects an operation (such as a click) on the view report control 5062 of the third interface 500 , the fourth interface 900 is displayed in response to the operation.

[0161] It should be noted that there are many ways to jump to the fourth interface, which can be from the first interface to the fourth interface, from the third interface to the fourth interface, or other ways, which will not be repeated here.

[0162] FIG. 9 exemplarily shows a fourth interface 900 displayed on the tablet computer 10 .

[0163] In one possible implementation, the fourth interface 900 includes, but is not limited to, one or more of the following: an information display module 901, a function module 902, or a report module 903. Of course, other modules may also be included, and this application does not limit this. This application also does not limit the layout of the modules on the fourth interface 900.

[0164] The information display module 901 includes one or more of the first user's related information, creation time, number of new feedbacks today, total number of feedbacks, number of new visits today or total number of visitors. Each relevant content in the information display module is displayed in the fourth interface 900 in the form of a text box.

[0165] The functional module 902 includes one or more of an editing control, a copy control, a sharing control, a time selection control, a download control, or a batch status change control.

[0166] Report module 903 includes, but is not limited to, header information, form content corresponding to the header information, and page number. The header information includes the time the second user uploaded the feedback information, name, date of birth, contact information, correction request, and one or more of a status control 9031 or an initial diagnosis control 9032. Status control 9031 is a drop-down selection control that allows selection of either communicated or uncommunicated. In other words, the first user can edit the status of each row of data in the form content. For example, if the initial status of the data is uncommunicated, the data status can be changed to communicated.

[0167] In one possible implementation method, the initial diagnosis control 9032 is also called the third control. When the tablet computer 10 detects an operation (such as a click) acting on the initial diagnosis control 9032, in response to the operation, it triggers the sharing of the initial diagnosis information to the second user; the initial diagnosis information includes preliminary treatment recommendations for the second user based on the feedback information of the second user. For example, if the first terminal device is a tablet computer 10, after the first user clicks on the initial diagnosis control 9032, the contact information of the second user is displayed on the fourth interface 900. The contact information can be a phone number or an email address, etc. The first user can call or send a text message to the second user based on the phone number to communicate with the second user for the initial diagnosis; the first user can also send an email to the second user based on the email address to communicate with the second user for the initial diagnosis. If the first terminal device is a mobile phone, after the first user clicks on the initial diagnosis control 9032, the second user's mobile phone number is directly dialed, or a text message is sent to the second user's mobile phone to communicate with the second user for the initial diagnosis.

[0168] In one possible implementation method, the name information corresponding to each row of data in the report module 903 includes, in addition to text information, a picture control; when the tablet computer 10 detects an operation acting on the picture control (such as a click), in response to the operation, the image uploaded by the second user is displayed on the fourth interface 900; wherein, the image uploaded by the second user includes but is not limited to one or more of the following: a facial image of the second user or an interactive simulation effect diagram corresponding to at least one interactive mode corresponding to the facial image of the second user.

[0169] In one possible implementation, the report module 903 displays up to 10 pieces of data and page numbers on the fourth interface 900. When the tablet computer 10 detects an operation on a page (e.g., a click), the report module 903 displays the data for the corresponding page in response to the operation. For example, when the second user clicks on page 2, the data for the second user corresponding to page 2 is displayed.

[0170] In one possible implementation method, when the second user clicks on the edit function control in the function module 902, in response to the operation, a multiple-choice box will appear in front of each row of data in the form content of the report module 903. The second user can click on the multiple-choice box to select each corresponding row of data and perform editing operations on the selected data, for example, the selected data can be deleted.

[0171] In one possible implementation method, when the second user clicks the copy function control in the function module 902, in response to the operation, a multiple-choice box will appear in front of each row of data in the form content of the report module 903. The second user can click the multiple-choice box to select each corresponding row of data and copy the selected data.

[0172] In a possible implementation method, when the second user clicks on the sharing function control in the function module 902 , the sharing link interface 600 is displayed in response to the operation.

[0173] In one possible implementation method, after the second user clicks the time selection control in the function module 902 and selects the start time and the end time, in response to the operation, the report module 903 refreshes the form content and displays the feedback information corresponding to the time period selected by the second user.

[0174] In a possible implementation method, when the second user clicks the download control in the function module 902, the download selection interface 800 is displayed in response to the operation.

[0175] In one possible implementation method, when the second user clicks on the batch change status control in the function module 902, in response to the operation, a multiple-choice box will appear in front of each row of data in the form content of the report module 903. The second user can click on the multiple-choice box to select each corresponding row of data and perform batch modification status operations on the selected data, such as changing the status of the selected data from an uncommunicated state to a communicated state.

[0176] Figure 10 is a flow chart of a smile simulation interaction method provided in an embodiment of the present application. The method can be executed by the second terminal device of the second user end or a module of the second terminal device. The present application does not limit the execution subject of the method.

[0177] The method comprises the following steps:

[0178] Step 1001: The second terminal device displays a first interface in response to a second user's operation on jump information.

[0179] Among them, the first interface is used to guide the second user to use the smile simulation function; the jump information is generated by the first user based on the operation interface for managing or viewing dental treatment information.

[0180] In one possible implementation method, when the second user finds the share poster interface 700 shown in Figure 7 and / or the share link 601 shown in Figure 6 on a different platform, he or she can scan the QR code in the share poster interface 700 or click the share link 601 to display the first interface 1100 shown in Figure 11. The jump information in step 1001 refers to the share poster interface 700 and / or the share link 601.

[0181] In one possible implementation method, the second user A sees the sharing poster interface 700 on his second terminal device, such as a mobile phone, uses his mobile phone to scan the QR code in the sharing poster interface 700, and displays the first interface 1100 on the second user A's mobile phone.

[0182] In another possible implementation method, the sharing poster interface 700 is displayed on the mobile phone of the second user B, and the second user A uses his own mobile phone to scan the QR code in the sharing poster interface 700 on the mobile phone of the second user B, and displays the first interface 1100 on the mobile phone of the second user A.

[0183] Step 1002: The second terminal device displays a second interface in response to an operation of the second user on the first interface.

[0184] The second interface is used to obtain a facial image of the second user.

[0185] In a possible implementation method, the first interface 1000 includes a guide control 1101 in an interactive mode.

[0186] In one possible implementation method, in response to the second user's operation of the guide control 1101, a second interface is displayed; in response to the operation of the second interface, a third interface is displayed, and the third interface includes an interactive simulation effect diagram of a facial image, and the interactive simulation effect diagram is a smile simulation image after the facial image is processed based on the interactive mode.

[0187] In a possible implementation method, the name of the guide control 1101 can be "Use smile simulation" or "Next step". This application does not limit the name of the guide control 1101.

[0188] In one possible implementation method, in response to the second user's operation (such as clicking) on ​​the guide control 1101 in the first interface 1100, a second interface is displayed, and the second interface includes a first control, wherein the first control includes but is not limited to one or more of the following: a photo taking control or a photo upload control.

[0189] In a possible implementation method, in response to the second user's operation on the first control (such as clicking), a shooting mode is entered to shoot a facial image of the second user.

[0190] In another possible implementation method, in response to the second user's operation on the first control (such as clicking), an album is displayed, and the album includes the second user's facial image; in response to the second user's operation on the album, the second user's facial image is obtained.

[0191] Step 1003: The second terminal device displays the third interface.

[0192] Among them, the third interface includes an interactive simulation effect diagram of the face image after correction of the simulated dental correction mode, and the interactive simulation effect diagram is a desired smile simulation image generated after image processing of the face image.

[0193] In the above scheme, the second user can use the smile simulation function on the second user side by accessing the jump information, process the second user's facial image, and generate the desired interactive simulation effect diagram; that is, the second user can see the possible effect diagrams of his or her own teeth correction process, thereby helping patients to establish an understanding of orthodontic treatment, while promoting communication between the first orthodontic user and the patient, reducing the patient's medical costs, and helping to improve the patient's medical experience.

[0194] The following will take the first terminal device as a mobile phone 20 as an example, and with reference to the accompanying drawings, describe in detail the smile simulation interaction method provided in steps 1001 to 1003.

[0195] FIG. 11 exemplarily shows a first interface 1100 displayed by the mobile phone 20 .

[0196] In a possible implementation method, the first interface 1100 includes text, a picture embedded in the text, and a guide control 1101.

[0197] In one possible implementation, when mobile phone 20 detects an operation (e.g., a click) on guidance control 1101, in response to the operation, first interface 1100 is closed and authorization prompt interface 1200 is displayed. Authorization prompt interface 1200 is used to prompt the second user to grant permission for the smile simulation function to access the camera and / or the photo album. Authorization prompt interface 1200 includes, but is not limited to, one or more of the following: a photo request module, a waiver module, or an authorization consent control 1201. The photo request module and the waiver module include text and images embedded in the text, as shown in FIG12 .

[0198] In one possible implementation method, the authorization prompt interface 1200 also includes a close control. When the mobile phone 20 detects an operation acting on the close control (such as a click), in response to the operation, the authorization prompt interface 1200 is closed and the first interface 1100 is displayed.

[0199] In one possible implementation method, when the mobile phone 20 detects an operation (such as a click) on the consent authorization control 1201, in response to the operation, the authorization prompt interface 1200 is closed, and the second interface 1300 is displayed, as shown in Figure 13. Among them, the second interface 1300 includes a first control 1301, and the first control 1301 can be one or more of a photo control and an upload picture control. When the mobile phone 20 detects an operation (such as a click) on the photo control, in response to the operation, the second interface 1300 is closed, and the fourth interface 1400 as shown in Figure 14 is displayed. When the mobile phone 20 detects an operation (such as a click) on the upload picture control, in response to the operation, the second interface 1300 is closed, and the album system is entered. Based on the operation of the second user, at least one picture is uploaded to the background server, a first face image with a first dental correction mode is generated, and a third interface 1500 with the first face image is displayed.

[0200] In one possible implementation method, the second interface 1300 also includes a cancel control. When the mobile phone 20 detects an operation acting on the cancel control (such as a click), in response to the operation, the second interface 1300 is closed and the first interface 1100 is displayed.

[0201] In one possible implementation, the fourth interface 1400 includes a second control 1401, a camera conversion control 1402, and a contour frame 1403, as shown in FIG14. The contour frame 1403 includes a head prompt area and a teeth prompt area, wherein the head prompt area is used to indicate the position of the second user's head on the fourth interface 1400, and the teeth prompt area is used to indicate the exposed teeth of the second user and the range of the exposed teeth.

[0202] In one possible implementation method, when the second user determines that the requirements of the smile prompt are met, he clicks the second control 1401, and the mobile phone 20 detects the operation (such as clicking) acting on the second control 1401. In response to the operation, the fourth interface 1400 is closed, and the captured facial image is uploaded to the background server, the desired interactive simulation effect diagram is generated, and the third interface 1500 with the interactive simulation effect diagram is displayed, as shown in Figure 15.

[0203] In one possible implementation method, when the mobile phone 20 detects that the second user meets the requirements of the smile prompt, in response to the operation, the third interface 1500 is closed, the facial image of the second user is automatically taken and uploaded to the background server, a first facial image with a first dental correction mode is generated and the third interface 1500 with the first facial image is displayed, as shown in Figure 15.

[0204] In one possible implementation method, based on the needs of the second user, the camera switching control 1402 is used to determine whether to use the front camera or the rear camera of the mobile phone 20 to capture the facial image of the second user. For example, the mobile phone 20 currently uses the front camera to capture the facial image of the second user. The mobile phone 20 detects an operation (such as a click) on the camera switching control 1402, and in response to the operation, switches to the rear camera to capture the facial image of the second user.

[0205] FIG. 15 exemplarily shows a third interface 1500 displayed by the mobile phone 20 .

[0206] In one possible implementation method, the third interface 1500 includes but is not limited to one or more of the following: a third control 1501, a sixth control 1502, a fourth control 1503 or a simulation effect display module 1504. Of course, it may also include other modules, which is not limited in this application.

[0207] In one possible implementation method, the number of third controls 1501 displayed on the third interface 1500 is limited by the first user terminal. For example, the first user terminal selects two interaction modes on the second interface 400, such as smile simulation mode and invisible correction simulation mode, then the number of third controls 1501 is 2, corresponding to two interaction modes, namely smile simulation mode and invisible correction simulation mode.

[0208] In one possible implementation method, the number of third controls 1501 displayed on the third interface 1500 is independent of the interaction mode selected by the first user terminal. That is, no matter how many interaction modes the first user terminal selects, the controls corresponding to all interaction modes are displayed on the third interface 1500. For example, if the first user terminal selects two interaction modes, the third interface 1500 displays controls corresponding to three interaction modes.

[0209] In one possible implementation method, the simulation effect display module 1504 only displays the interactive simulation effect diagram corresponding to one interactive mode; for example, the third interface 1500 includes a third control 1501 corresponding to the smile simulation, a third control 1501 corresponding to the invisible correction simulation, and a third control 1501 corresponding to the fixed correction simulation. The mobile phone 20 detects an operation (such as a click) on the third control 1501 corresponding to the smile simulation, and in response to the operation, the simulation effect display module 1504 of the third interface 1500 displays the dental effect diagram of the face image just collected by the second user. The effect picture after tooth correction; the mobile phone 20 detects the operation (such as clicking) of the third control 1501 corresponding to the invisible correction simulation, and in response to the operation, the simulation effect display module 1504 of the third interface 1500 displays the effect picture of the face image just collected by the second user wearing invisible braces; the mobile phone 20 detects the operation (such as clicking) of the third control 1501 corresponding to the fixed correction simulation, and in response to the operation, the simulation effect display module 1504 of the third interface 1500 displays the effect picture of the face image just collected by the second user wearing braces.

[0210] In another possible implementation method, the simulation effect display module 1504 displays an interactive simulation effect diagram corresponding to at least one interactive mode; the present application does not limit the layout of the interactive simulation effect diagram corresponding to at least one interactive mode on the simulation effect display module 1504. For example, the interactive simulation effect diagram corresponding to at least one interactive mode is displayed in a horizontal layout on the simulation effect display module 1504, or the interactive simulation effect diagram corresponding to at least one interactive mode is displayed in a vertical layout on the simulation effect display module 1504. The present application does not limit the display order of the interactive simulation effect diagram corresponding to at least one interactive mode on the simulation effect display module 1504. For example, the interactive simulation effect diagram corresponding to the first interactive mode is displayed first in the simulation effect display module 1504, and the interactive simulation effect diagram corresponding to the second interactive mode is arranged in sequence behind.

[0211] In one possible implementation method, the second user determines the arrangement order of the interactive simulation renderings corresponding to at least one interactive mode in the simulation rendering display module 1504 based on their needs or preferences. For example, after acquiring the second user's image, a pop-up window is displayed, which is used to instruct the second user to select the arrangement order of the interactive simulation renderings corresponding to at least one interactive mode. In response to the second user's selection operation, the interactive simulation renderings corresponding to at least one interactive mode in the specified arrangement order are displayed in the simulation rendering display module 1504.

[0212] The following is a brief introduction to the tooth correction algorithm.

[0213] In one possible implementation method, the lip region in the facial image is identified, and an image of the second user's teeth region is processed through a neural network model to generate an image of the teeth region with a simulated effect. Furthermore, the generated image of the teeth region with a simulated effect and the collected facial image are combined to obtain an image of the simulated effect. The neural network model can be a convolutional neural network (CNN) or a deep neural network (DNN), and this application does not limit the neural network model.

[0214] This application does not limit the training method of the neural network model. The samples of the neural network model can be from multiple sources, and can be samples obtained based on a standard tooth model, samples obtained based on a second user's tooth model, or samples obtained by comprehensive processing of a standard tooth model and a second user's tooth model; wherein, the samples obtained based on the second user's tooth model can be the second user's tooth model before and after correction collected on the Internet; or, the patient's tooth model before and after correction stored by a medical institution. The data source of the tooth model can be 2D data or 3D data.

[0215] One possible implementation method is to train the neural network model by processing and simulating the entire face image. This means using the entire face image as input for the neural network model, training it, and outputting an interactive simulation image corresponding to the interaction mode.

[0216] In another possible implementation method, the training method of the neural network model is based on lip area calculations. For example, the lip area of ​​the entire facial image is extracted through an image detection algorithm, and the extracted lip area is used as the input of the neural network model. The neural network model is trained to output a lip effect image corresponding to the interactive mode; the lip effect image corresponding to the interactive mode is then combined with the collected facial image to obtain an interactive simulation effect image corresponding to the interactive mode. This application does not limit the image detection algorithm, and any algorithm that can detect the lip area of ​​a facial image can be used.

[0217] In one possible implementation method, the third interface 1500 also includes a fourth control 1503, as shown in Figure 15, wherein the name of the fourth control 1503 can be "Contact Us" or "Upload User Information", and this application does not limit the name of the fourth control 1503. The mobile phone 20 detects an operation (such as a click) on the fourth control 1503, and in response to the operation, displays the fifth interface 1600, as shown in Figure 16. The fifth interface 1600 includes an information feedback item 1602 and a fifth control 1601, wherein the name of the fifth control 1601 can be "Submit" or "Upload", and this application does not limit the name of the fifth control 1601. The information feedback item 1602 includes one or more of name, date of birth, contact information, and correction request. This application does not limit the content included in the information feedback item 1602. Each information feedback item 1602 corresponds to a text input box for receiving feedback information input by the second user. The mobile phone 20 detects an operation on the fifth control 1601 (such as a click), uploads an information feedback item including the above-mentioned feedback information, the facial image of the second user or a rendering corresponding to at least one interactive mode corresponding to the facial image of the second user, closes the fifth interface 1600, and displays the third interface 1500, wherein the third interface 1500 includes a submission success prompt information 1505, and the submission success prompt information 1505 is displayed in the form of a pop-up window at the top of the third interface 1500, as shown in Figure 18.

[0218] In one possible implementation, after the second user agrees to share a facial photo with the first user, the second user's photo is uploaded. For example, the fifth interface 1600 also includes an image sharing control that indicates that the second user can upload the second user's facial image or a rendering corresponding to at least one interactive mode corresponding to the second user's facial image to the first user. The image sharing control is a selection control. Exemplarily, in response to the second user's operation on the image sharing control, the image sharing control is selected. When the second user clicks the fifth control 1601, the content corresponding to the information feedback item 1602, the second user's facial image, and the rendering corresponding to at least one interactive mode corresponding to the second user's facial image are uploaded to the first user's backend server. In response to the second user's operation on the image sharing control, the image sharing control is unselected. When the second user clicks the fifth control 1601, the content corresponding to the information feedback item 1602 is uploaded to the first user's backend server.

[0219] In a possible implementation method, after the successful submission prompt message 1505 is displayed for a specified time, such as 2 seconds, the successful submission prompt message 1505 is automatically closed.

[0220] In another possible implementation method, the submission success prompt information 1505 includes a close control, and the submission success prompt information 1505 is closed in response to the second user's operation (such as a click).

[0221] In one possible implementation, the information feedback items corresponding to name, date of birth, and contact information include a required field indicator, such as the "*" shown in FIG16 . This required field indicator serves to indicate to the second user that the information feedback items corresponding to name, date of birth, and contact information are required fields. When mobile phone 20 detects that at least one required field is not filled in, for example, if the text box corresponding to name is empty, in response to this action, "Name is required" is displayed at the corresponding position on fifth interface 1600 . This application does not limit the specific content of this prompt information.

[0222] In one possible implementation, fifth interface 1600 further includes a cancel control 1603, where the name of cancel control 1603 can be "Cancel" or "Close." This application does not limit the name of cancel control 1603. Mobile phone 20 detects an operation (such as a click) on cancel control 1603 and, in response to the operation, closes fifth interface 1600 and displays third interface 1500 as shown in FIG15 .

[0223] In one possible implementation method, the fifth interface 1600 also includes introduction information, which includes information corresponding to the first user. Specifically, the information corresponding to the first user includes but is not limited to one or more of the following: the name of the first user, the name of the hospital where the first user is located, the address or introduction of the hospital where the first user is located, etc.

[0224] In one possible implementation, the third interface 1500 also includes a sixth control 1502, which can be named "Share" or "Forward." This application does not limit the name of the sixth control 1502. When the mobile phone 20 detects an operation (e.g., a click) on the sixth control 1502, it displays the sixth interface 1700 in response to the operation, as shown in FIG17. The sixth interface 1700 includes a display module 1701 and a sharing platform module 1702. The display module 1701 includes an effect display module 17011 and jump information 17012, as shown in FIG17. The sixth interface 1700 is suspended above the third interface 1500, but can also be displayed on the mobile phone 20 in other ways, which is not limited by this application. The effect display module 17011 is used to display the effect image corresponding to at least one interactive mode. The jump information 17012 includes a jump link, which can be a QR code or a web link. Of course, the jump information 17012 can also include other content, which is not limited by this application. Other users can access the smile simulation link pushed by the first user according to the jump link.

[0225] In one possible implementation method, the first interface 1100 is displayed in response to other users' operation on the jump link (such as clicking).

[0226] In a possible implementation method, the effect display module 17011 displays effect diagrams corresponding to multiple interaction modes. That is, the effect diagrams corresponding to multiple interaction modes are uniformly displayed in the effect display module 17011 in a certain specified layout.

[0227] In one possible implementation method, based on the interaction mode selected by the second user, in response to the second user's operation (such as a click) on the sixth control 1502, the effect display module 17011 displays the effect diagram corresponding to the corresponding interaction mode. For example, when the mobile phone 20 detects an operation (such as a click) on the third control 1501 corresponding to the smile simulation mode, in response to the operation, the simulation effect display module 1504 of the third interface 1500 displays the effect diagram of the teeth of the facial image just collected by the second user after correction, and then when the mobile phone 20 detects an operation (such as a click) on the sixth control 1502, in response to the operation, the sixth interface 1700 is displayed, wherein the effect display module 17011 corresponding to the sixth interface 1700 displays the effect diagram of the teeth of the facial image just collected by the second user after correction. For another example, when the mobile phone 20 detects an operation (such as a click) on the third control 1501 corresponding to the invisible orthodontic simulation mode, in response to the operation, the simulation effect display module 1504 on the third interface 1500 displays the effect picture of the second user's facial image just collected wearing invisible braces, and then when the mobile phone 20 detects an operation (such as a click) on the sixth control 1502, in response to the operation, the sixth interface 1700 is displayed, wherein the effect display module 17011 corresponding to the sixth interface 1700 displays the effect picture of the second user's facial image just collected wearing invisible braces.

[0228] In one possible implementation method, the sharing platform module 1702 includes one or more of a local save control, a WeChat control, a QQ space control, a Moments control, or a Weibo control; wherein the seventh control is any control in the sharing platform module 1702. When the mobile phone 20 detects an operation (such as a click) acting on the seventh control, in response to the operation, the display module 1701 is sent to the platform corresponding to the seventh control. Exemplarily, when the mobile phone 20 detects an operation (such as a click) acting on a local save, in response to the operation, the content corresponding to the display module 1701 is saved locally in the form of an image.

[0229] In one possible implementation method, the sixth interface 1700 also includes a cancel control. When the mobile phone 20 detects an operation acting on the cancel control (such as a click), in response to the operation, the sixth interface 1700 is closed and the third interface 1500 is displayed.

[0230] In one possible implementation, a second user receives the first user's initial diagnosis information; the initial diagnosis information includes the first user's preliminary treatment recommendations for the second user based on the second user's feedback. Receiving the first user's initial diagnosis information includes answering a phone call from the first user, checking a text message from the first user, or checking an email from the first user. Of course, receiving the first user's initial diagnosis information may also be done in other ways, and this application does not limit this.

[0231] In another possible implementation method, the second user sends a medical inquiry message to the first user; the medical inquiry message includes the second user's treatment needs. The methods for sending the medical inquiry message to the first user include, but are not limited to, one or more of the following: calling the first user to inquire about the medical treatment, sending a text message to the first user to inquire about the medical treatment, or sending an email to the first user to inquire about the medical treatment. Of course, the method for sending the medical inquiry message to the first user may also be other methods, and this application does not limit this.

[0232] In the embodiments provided in the present application above, the methods provided in the embodiments of the present application are introduced from the perspective of an electronic device as an execution subject. In order to implement the various functions in the methods provided in the embodiments of the present application above, the electronic device may include a hardware structure and / or a software module, and implement the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether a function of the above functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

[0233] When hardware implementation is adopted, the hardware implementation of the electronic device can refer to Figure 19 and its related description.

[0234] 19 , an electronic device includes: a touch screen 1901, wherein the touch screen 1901 includes a touch panel 1907 and a display screen 1908; one or more processors 1902; a memory 1903; one or more application programs (not shown); and one or more computer programs 1904. A sensor 1905 and the aforementioned components may be connected via one or more communication buses 1906. The one or more computer programs 1904 are stored in the aforementioned memory 1903 and configured to be executed by the one or more processors 1902. The one or more computer programs 1904 include instructions, which may be used to execute the method in any of the aforementioned embodiments.

[0235] An embodiment of the present application also provides a computer storage medium, which stores computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the interactive method of smile simulation in the above-mentioned embodiment.

[0236] An embodiment of the present application further provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement the interactive method of smile simulation in the above-mentioned embodiment.

[0237] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory to enable the chip to execute the smile simulation interaction method in the above-mentioned method embodiments.

[0238] Among them, the electronic device, computer storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0239] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0240] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0241] Units described as separate components may or may not be physically separate, and components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0242] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0243] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0244] The above content is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A smile simulation interaction method, characterized in that: Applied to a first terminal device, the method includes: Displaying a first interface, the first interface including an operation interface for a first user to manage or view dental treatment information, the first interface including a first control, the first control being used to trigger a smile simulation guidance function; In response to the operation of the first control, a second interface is displayed, and the second interface is used to generate jump information. The jump information is used to guide the second user to use the smile simulation function. The smile simulation function includes processing the facial image of the second user and generating the desired interactive simulation effect diagram.

2. The method according to claim 1, wherein The second interface includes a control corresponding to at least one interactive mode, wherein the at least one interactive mode is used to guide the second user to use the smile simulation function; and further includes: In response to an operation on a control corresponding to the at least one interactive mode, jump information is generated, and the jump information is used to guide the second user to trigger a jump to an interface including a guide control, and the guide control is used to guide the second user to use the at least one interactive mode.

3. The method according to claim 1 or 2, wherein: The at least one interactive mode includes a first interactive mode, which is used to guide the second user to use a smile simulation function to process the facial image of the second user to generate an interactive simulation effect diagram after correction of the simulated dental correction model.

4. The method according to any one of claims 1 to 3, wherein The at least one interactive mode also includes a second interactive mode, and the second interactive mode includes at least one of the following: a fixed correction mode or an invisible correction mode; the second interactive mode is used to guide the second user to use the smile simulation function to process the facial image of the second user to generate an interactive simulation effect diagram of the user wearing the corresponding corrective device.

5. The method according to any one of claims 1 to 4, characterized in that The jump information includes one or more of the following: a network link or a QR code.

6. The method according to claim 5, wherein The second interface further includes: at least one of an information guidance item and an information feedback item; the information guidance item is used to obtain guidance information preferred by the first user; and the information feedback item is used to collect feedback information of the second user.

7. The method according to any one of claims 1 to 6, wherein: The method further comprises: A fourth interface is displayed, wherein the fourth interface includes feedback information of at least one second user, and the feedback information includes at least one of the following: an information feedback item with feedback information, a facial image of the second user, or at least one interactive simulation effect diagram corresponding to the facial image of the second user.

8. The method according to claim 7, wherein The method further comprises: In response to the operation of the fourth interface, the initial diagnosis information is shared with the second user; the initial diagnosis information includes preliminary treatment recommendations for the second user based on the feedback information of the second user.

9. The method according to any one of claims 7 to 8, wherein: The method further comprises: In response to an update operation on a control corresponding to the at least one interaction mode in the second interface, jump information is regenerated, and the regenerated jump information is used to guide the second user to use the updated interaction mode.

10. An interactive method for smile simulation, characterized in that: Applicable to the second terminal device, including: In response to the second user's operation on the jump information, a first interface is displayed, where the first interface is used to guide the second user to use the smile simulation function; the jump information is generated by the first user based on the operation interface for managing or viewing dental treatment information; In response to the second user's operation on the first interface, displaying a second interface; the second interface is used to obtain a facial image of the second user; The third interface is displayed, and the third interface includes an interactive simulation effect diagram of the face image after correction of the simulated dental correction mode. The interactive simulation effect diagram is a desired smile simulation image generated after image processing of the face image.

11. The method according to claim 10, wherein The first interface includes a guide control for an interactive mode; and further includes: In response to the second user's operation on the guide control, displaying the second interface; The third interface is displayed, and the third interface includes an interactive simulation effect diagram of the facial image, and the interactive simulation effect diagram is a smile simulation image after the facial image is processed based on the interactive mode.

12. The method according to claim 10 or 11, characterized in that The third interface further includes a fourth control; and the method further includes: In response to the second user's operation on the fourth control, displaying a fifth interface, wherein the fifth interface includes an information feedback item; Receive feedback information entered by the second user in the information feedback item, and upload first information, where the first information includes at least one of the following: the information feedback item of the feedback information, the facial image of the second user, or an interactive simulation effect diagram corresponding to at least one interactive mode corresponding to the facial image of the second user.

13. The method according to claim 10 or 11, characterized in that The third interface also includes a sixth control; The method further comprises: In response to the second user's operation on the sixth control, a sixth interface is displayed, wherein the sixth interface includes at least one of the following: an interactive simulation effect diagram corresponding to at least one interactive mode and jump information; Sending second information, where the second information includes: an interactive simulation effect diagram corresponding to the at least one interactive mode and at least one of the jump information.

14. The method according to any one of claims 10 to 13, wherein: The method further comprises: receiving initial diagnosis information, wherein the initial diagnosis information includes preliminary treatment recommendations for the second user based on the feedback information of the second user; or Sending medical consultation information; the medical consultation information includes the treatment needs of the second user.

15. The method according to any one of claims 10 to 14, wherein: The responding to the second user's operation on the first control includes: A fourth interface is displayed, wherein the fourth interface includes a contour box and a second control; the contour box is used to indicate the position of the second user's face and teeth in the image to be captured; and the second control is used to capture the facial image of the second user.

16. The method according to any one of claims 10 to 14, wherein: The third interface further includes a third control, and the third control is used to trigger the display of an interactive simulation effect diagram corresponding to at least one interactive mode; the method further includes at least one of the following: In response to the second user's operation on the third control, displaying on the third interface an interactive simulation effect diagram of the simulated dental correction mode corresponding to the facial image; In response to the second user's operation on the third control, displaying on the third interface an interactive simulation effect diagram corresponding to the fixed correction mode corresponding to the facial image; In response to the second user's operation on the third control, an interactive simulation effect diagram corresponding to the invisible correction mode corresponding to the facial image is displayed on the third interface.

17. An interactive system for smile simulation, characterized in that: It includes a first user terminal, a second user terminal and a backend server; The first user terminal displays a first interface, the first interface including an operation interface for the first user to manage or view dental treatment information, the first interface including a first control, the first control being used to trigger a smile simulation guidance function; The first user terminal displays a second interface in response to an operation of the first control, wherein the second interface is used to generate jump information, and the jump information is used to guide the second user to use a smile simulation function, wherein the smile simulation function includes processing a facial image of the second user and generating a desired interactive simulation effect diagram; The second user terminal obtains the jump information shared by the backend server; The second user terminal displays a first interface in response to the user's operation on the jump information, wherein the first interface is used to guide the second user to use the smile simulation function; the jump information is generated by the first user based on the operation interface for managing or viewing dental treatment information; The second user terminal displays a second interface in response to the second user's operation on the first interface; the second interface is used to obtain a facial image of the second user; The second user terminal uploads the facial image of the second user to the backend server; The backend server generates, based on the facial image of the second user uploaded by the second user terminal, an interactive simulation effect diagram of the simulated dental correction model corresponding to the facial image, and sends the interactive simulation effect diagram of the simulated dental correction model corresponding to the facial image to the second user terminal; The second user terminal displays a third interface, which includes an interactive simulation effect diagram of the simulated dental correction mode corresponding to the facial image after correction. The interactive simulation effect diagram is a desired smile simulation image generated after image processing of the facial image.

18. An electronic device, characterized in that: including processor and memory; The memory is used to store a computer program, and the processor executes the computer program to implement the method according to any one of claims 1 to 9 or the steps of the method according to any one of claims 10 to 16.

19. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program or instructions. When the computer program or instructions are executed by a processor, the method according to any one of claims 1 to 9 or the steps of the method according to any one of claims 10 to 16 are implemented.

Images