Problem explanation interaction method and device, medium, electronic equipment and program product

Abstract

The invention discloses a question explanation interaction method and device, a medium, electronic equipment and a program product, and relates to the technical field of computers, the method comprises the steps that first explanation content and first blackboard writing content corresponding to the first explanation content are displayed in an interaction interface by responding to a first question, and the first explanation content comprises multiple segments of sub explanation content; the first blackboard-writing content comprises a plurality of sub-blackboard-writing content, each segment of sub-explanation content corresponds to at least one sub-blackboard-writing content, and the sub-explanation content and the sub-blackboard-writing content corresponding to the sub-explanation content are sequentially displayed in the interactive interface, so that the corresponding first explanation content and the first blackboard-writing content can be generated in real time, the content production period is shortened, and the cost is reduced; and each process of question explanation can be dynamically displayed, so that the user can clearly understand the construction process of the knowledge points. Moreover, the teaching rhythm, thought presentation and visual guidance process of a real teacher in a real classroom can be simulated, and immersive learning experience is provided for the user.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to an interactive method, device, medium, electronic device, and program product for question explanation. Background Art

[0002] In related technologies, traditional online education or question answering is generally conducted in the form of pre-recorded videos, static graphics or simple animations. These methods often lack real-time interaction and a step-by-step teaching process, lack a sense of reality, and are difficult to achieve effective knowledge explanation. Summary of the Invention

[0003] This summary is provided to briefly introduce concepts that will be described in detail in the detailed description below. This summary is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0004] In a first aspect, the present disclosure provides an interactive method for explaining a question, comprising: In response to the first question sent by the object, the first explanation content corresponding to the first question and the first blackboard content corresponding to the first explanation content are displayed in the interactive interface; the first explanation content includes multiple sections of sub-explanation content, and the first blackboard content includes multiple sub-blackboard content, each section of the sub-explanation content corresponds to at least one sub-blackboard content, and the sub-explanation content and the sub-blackboard content corresponding to the sub-explanation content are displayed in sequence in the interactive interface.

[0005] In a second aspect, the present disclosure provides an interactive device for explaining a question, comprising: The display module is configured to respond to the first question sent by the object, and display the first explanation content corresponding to the first question and the first blackboard content corresponding to the first explanation content in the interactive interface; the first explanation content includes multiple sections of sub-explanation content, and the first blackboard content includes multiple sub-blackboard content, each section of the sub-explanation content corresponds to at least one sub-blackboard content, and the sub-explanation content and the sub-blackboard content corresponding to the sub-explanation content are displayed in sequence in the interactive interface.

[0006] In a third aspect, the present disclosure provides a computer-readable medium having a computer program stored thereon, which, when executed by a processing device, implements the steps of the method described in the first aspect.

[0007] In a fourth aspect, the present disclosure provides an electronic device, comprising: a storage device having a computer program stored thereon; A processing device is used to execute the computer program in the storage device to implement the steps of the method described in the first aspect.

[0008] In a fifth aspect, the present disclosure provides a computer program product, comprising a computer program, which implements the steps of the method described in the first aspect when executed by a processor.

[0009] Based on the above technical solution, by responding to the first question sent by the object, the first explanation content corresponding to the first question and the first blackboard content corresponding to the first explanation content are displayed in the interactive interface, and the first explanation content includes multiple sub-explanation contents, the first blackboard content includes multiple sub-blackboard contents, and each sub-explanation content corresponds to at least one sub-blackboard content. The sub-explanation content and the sub-blackboard content corresponding to the sub-explanation content are displayed in sequence in the interactive interface. Not only can the corresponding first explanation content and first blackboard content be generated in real time, shortening the content production cycle and reducing costs, but also each process of the question explanation can be dynamically displayed, so that users can clearly understand the process of constructing knowledge points. Moreover, through the first explanation content and the first blackboard content, the teaching rhythm, idea presentation and visual guidance process of a real teacher in a real classroom can be simulated, providing users with an immersive learning experience that far exceeds pre-recorded videos, static graphics or simple animations.

[0010] Other features and advantages of the present disclosure will be described in detail in the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The above and other features, advantages and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale. In the drawings: Figure 1 The figure is a flowchart of an interactive method for explaining a problem according to an exemplary embodiment.

[0012] Figure 2 is a schematic diagram of an input problem according to an exemplary embodiment.

[0013] Figure 3 It is a schematic diagram showing a first explanation content and a first blackboard content according to an exemplary embodiment.

[0014] Figure 4 It is a schematic diagram showing a first explanation content and a first blackboard content according to another exemplary embodiment.

[0015] Figure 5 It is a schematic diagram showing a first explanation content and a first blackboard content according to another exemplary embodiment.

[0016] Figure 6 is a schematic diagram showing sending a second question according to an exemplary embodiment.

[0017] Figure 7 is a schematic diagram of sending a second question according to another exemplary embodiment.

[0018] Figure 8 It is a schematic diagram showing the second explanation content and the second blackboard content according to an exemplary embodiment.

[0019] Figure 9 is a schematic diagram showing an instruction flow according to an exemplary embodiment.

[0020] Figure 10 It is a structural diagram of an interactive device for explaining a question according to an exemplary embodiment.

[0021] Figure 11 It is a schematic structural diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0022] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0023] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0024] As used herein, the term "including" and its variations are open-ended, i.e., "including but not limited to." The term "based on" means "based, at least in part, on." The term "one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one additional embodiment," and the term "some embodiments" means "at least some embodiments." Other terms are defined in the following description.

[0025] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0026] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".

[0027] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0028] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0029] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the operation requested will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operations of the disclosed technical solution based on the prompt message.

[0030] As an optional but non-limiting implementation, in response to receiving a user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. Furthermore, the pop-up window may also contain a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0031] It is understandable that the above notification and user authorization process are merely illustrative and do not limit the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0032] At the same time, it is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0033] Figure 1 FIG. 1 is a flow chart of an interactive method for explaining a problem according to an exemplary embodiment. Figure 1 As shown, the embodiment of the present disclosure provides an interactive method for explaining a question, which can be specifically performed by an interactive device for explaining a question, and the device can be implemented by software and / or hardware. Figure 1 As shown, the method may include the following steps.

[0034] S110, in response to the first question sent by the object, the first explanation content corresponding to the first question and the first blackboard content corresponding to the first explanation content are displayed in the interactive interface; the first explanation content includes multiple sections of sub-explanation content, the first blackboard content includes multiple sub-blackboard content, each section of sub-explanation content corresponds to at least one sub-blackboard content, and the sub-explanation content and the sub-blackboard content corresponding to the sub-explanation content are displayed in sequence in the interactive interface.

[0035] Here, the object may send a first question through the interactive interface, and the first question may be a specific question or a broad teaching topic, etc. In the embodiment of the present disclosure, the object may refer to a user.

[0036] The interactive system can receive a first question input by the object, and the interactive system inputs the first question into the trained machine learning model to obtain the first explanation content and the first blackboard content output by the machine learning model.

[0037] For example, the trained machine learning model can be an artificial intelligence (AI) model that can act as an expert in a specific field and output a first explanation and a first blackboard content corresponding to the first question. The trained machine learning model can analyze the first question based on a corresponding knowledge base and plan a step-by-step explanation and corresponding blackboard content.

[0038] It should be understood that the specific type of the machine learning model is not limited in the embodiments of the present disclosure, and the machine learning model may include but is not limited to a large language model (LLM).

[0039] In the embodiment of the present disclosure, the manner in which the subject sends the first question includes but is not limited to text form, voice form, picture form, etc. Figure 2 is a schematic diagram of an input problem according to an exemplary embodiment. Figure 2 As shown, the subject can input the first question through a text box or input the first question in the form of an image through a button for uploading an image. Figure 2 The question input method shown is only for illustration and is not intended to limit the question input method of the embodiment of the present disclosure.

[0040] The interactive interface may refer to a user interface, which may be a user interface for interacting with a virtual teacher. The first explanation content corresponding to the first question may be an explanation idea for explaining the first question obtained through a trained machine learning model, and the first explanation content may be a natural language explanation. The first explanation content corresponding to the first question may be displayed in the interactive interface in the form of voice and / or text.

[0041] Exemplarily, the sub-explanatory content can be sent to a text-to-speech (TTS) engine to obtain speech content output by the TTS engine. Presenting the first explanation content in text form can include presenting the first explanation content in text or subtitle form on an interactive interface. Exemplarily, the interactive interface can include a first area for presenting the first explanation content, and accordingly, the first explanation content can be presented in text form in the first area.

[0042] The blackboard content may refer to the text, symbols, images and other content written or displayed on the interactive interface. The first blackboard content corresponding to the first explanation content may refer to the blackboard content used to assist in understanding the first explanation content. Of course, the first blackboard content may also be the blackboard content indicated by the first explanation content. For example, if the first explanation content instructs to draw a long strip on the drawing board of the interactive interface, the corresponding first blackboard content is to draw a long strip. In other words, the first explanation content and the first blackboard content complement each other, and are used to assist in understanding the first explanation content output by the virtual teacher through the first blackboard content.

[0043] Exemplarily, the interactive interface may include a second area, and the corresponding first blackboard content may be displayed in the second area.

[0044] It is worth noting that, in the embodiment of the present disclosure, the image of a virtual teacher can also be displayed in the interactive interface. The image of the virtual teacher can be a cartoon image, a three-dimensional virtual image, a real virtual image, etc.

[0045] In the disclosed embodiment, the first explanation content includes a plurality of sequentially arranged sub-explanation contents, and the first blackboard content includes a plurality of sequentially arranged sub-blackboard contents. Moreover, each sub-explanation content corresponds to one or more sub-blackboard contents. For example, "Hello everyone! Today we are going to solve an interesting math word problem. Please look at the question on the blackboard." This sub-explanation content corresponds to a sub-blackboard content. For another example, "The question tells us two important pieces of information: First, the oldest torchbearer is 94 years old. Second, there is a relationship between the maximum age and the minimum age: "10 years older than 6 times the youngest age." To make this relationship clearer, let's draw a picture. First, we use a long bar to represent the oldest torchbearer, marked with 94 years old. This orange long bar represents 94 years old." This sub-explanation content corresponds to a sub-blackboard content.

[0046] Accordingly, the interactive interface can display the sub-explanatory content and the corresponding sub-blackboard content in sequence. In other words, while displaying multiple sub-explanatory content in sequence, the corresponding sub-blackboard content can be displayed synchronously to simulate the natural teaching process of a real teacher speaking and writing on the blackboard.

[0047] Figure 3 It is a schematic diagram showing a first explanation content and a first blackboard content according to an exemplary embodiment. Figure 4 It is a schematic diagram showing a first explanation content and a first blackboard content according to another exemplary embodiment. Figure 5 is a schematic diagram showing the first explanation content and the first blackboard content according to another exemplary embodiment. Figure 3 、 Figure 4 and Figure 5 As shown, the first explanation content is displayed in the first area 301 of the interactive interface 300 and the first blackboard content is displayed in the second area 302. As the virtual teacher outputs the first explanation content, the virtual teacher continuously updates the first blackboard content displayed in the second area 302, as shown in FIG. Figures 3 and 4 As shown, the first blackboard content is continuously updated. Finally, the virtual teacher finishes explaining the first question, and the first blackboard content displayed in the second area 302 is updated as shown. Figure 5 The first blackboard content is shown.

[0048] That is to say, for users, they can hear the voice corresponding to the first explanation content through the interactive interface, and at the same time see the gradual increase, change and erasure of the first blackboard content on the virtual blackboard, just like watching a real teacher teaching on the spot.

[0049] Thus, in response to the first question sent by the object, the first explanation content corresponding to the first question and the first blackboard content corresponding to the first explanation content are displayed in the interactive interface, and the first explanation content includes multiple sub-explanation contents, the first blackboard content includes multiple sub-blackboard contents, and each sub-explanation content corresponds to at least one sub-blackboard content. The sub-explanation content and the sub-blackboard content corresponding to the sub-explanation content are displayed in sequence in the interactive interface. Not only can the corresponding first explanation content and first blackboard content be generated in real time, shortening the content production cycle and reducing costs, but each process of the question explanation can also be dynamically displayed, allowing users to clearly understand the process of constructing knowledge points. Moreover, through the first explanation content and the first blackboard content, the teaching rhythm, idea presentation and visual guidance process of a real teacher in a real classroom can be simulated, providing users with an immersive learning experience that far exceeds pre-recorded videos, static graphics or simple animations.

[0050] In some feasible implementations, in the process of displaying the first explanation content and the first blackboard content, it is also possible to respond to a second question sent by the object and display the second explanation content corresponding to the second question and the second blackboard content corresponding to the second explanation content in the interactive interface, wherein the second blackboard content is obtained based on the displayed first blackboard content.

[0051] Here, during the display of the first explanation content and the first blackboard content, the subject can interrupt the virtual teacher's output at any time and ask a new second question at any time. It should be understood that the second question sent by the subject can be a question generated based on the first explanation content and the first blackboard content. For example, Figure 5 As shown, in the process of the virtual teacher outputting how to solve the minimum age, the second question sent by the subject may be "Why is the minimum age 84 divided by 6?"

[0052] After the interactive system receives the second question input by the object, the interactive system inputs the second question into the trained machine learning model so that the machine learning model obtains the second explanation content for explaining the second question and the second blackboard content corresponding to the second explanation content based on the context of the second question and the first question.

[0053] It should be noted that the second blackboard content is obtained based on the displayed first blackboard content. For example, the displayed first blackboard content can be modified based on the second question to obtain the second blackboard content.

[0054] It is worth noting that when the virtual teacher is outputting the first explanation content and the first blackboard content, the second question sent by the subject will be sent to the machine learning model. The machine learning model will dynamically adjust the first explanation content and the first blackboard content to the second explanation content and the second blackboard content used to explain the second question based on the context (including the first explanation content, the first blackboard content, and the first question, etc.) and the second question sent by the subject, so as to return to the second question sent by the subject in a targeted manner and achieve a one-on-one explanation effect. Of course, after completing the explanation of the second question, if the first explanation content and the first blackboard content have not been output yet, the first explanation content and the first blackboard content can also be output to complete the explanation of the first question.

[0055] In some embodiments, the second question can be determined in response to an annotation operation on the first blackboard content triggered by an object in the interactive interface and / or an input operation triggered by an object in the interactive interface, based on the annotation content corresponding to the annotation operation and / or the input content corresponding to the input operation.

[0056] The input operation triggered by the object in the interactive interface may be a text input operation or a voice input operation. Accordingly, the input content corresponding to the input operation may be text content or voice content. The corresponding text content or voice content may be used as the second question, or the second question may be extracted from the text content or voice content.

[0057] Figure 6 FIG. 1 is a schematic diagram showing sending the second question according to an exemplary embodiment. Figure 6As shown, the interactive interface 300 includes a text input box 303, and the subject can send a second question through the text input box 303. For example, the second question "Why is the minimum age 84 divided by 6?" is sent through the text input box 303.

[0058] The annotation operation triggered by the object on the interactive interface on the first blackboard content can refer to a graphical interaction method performed by the object on the first blackboard content in the interactive interface, wherein the first blackboard content can be generated by the machine learning model based on the first question. Accordingly, the annotation content corresponding to the annotation operation can serve as the second question. Of course, the implicit second question can also be extracted from the annotation content.

[0059] Figure 7 FIG. 1 is a schematic diagram showing sending a second question according to another exemplary embodiment. Figure 7 As shown, the annotation operation can be a circling operation performed on the first blackboard content. The object can circle at least part of the first blackboard content and input the corresponding question through the circling operation to form the corresponding annotation content 304. Accordingly, the machine learning model can extract the corresponding second question through the annotation content 304.

[0060] It is worth mentioning that you can take a screenshot of the interactive interface and then get the annotation content corresponding to the annotation operation from the screenshot.

[0061] Of course, in the embodiment of the present disclosure, the second question can be sent through input operation and annotation operation. For example, the question is input through input operation and the circle is circled in the first blackboard content through annotation operation. Accordingly, the question and the circled content together constitute the second question.

[0062] Figure 8 : is a schematic diagram showing the second explanation content and the second blackboard content according to an exemplary embodiment. Figure 8 As shown, the first area 301 of the interactive interface 300 is changed to display the second explanation content corresponding to the second question, and the second area 302 of the interactive interface 300 is changed to display the corresponding second blackboard content.

[0063] Thus, through the above implementation, during the teaching process, users can engage in interactive Q&A with the virtual teacher, providing the ability to answer user questions at any time, thereby increasing user participation and improving user learning attention. Moreover, the teaching content and blackboard content can be adjusted at any time based on user feedback.

[0064] In some feasible implementations, when the first question is a question in a picture, if the picture includes graphic content, the first blackboard content is obtained according to the graphic content.

[0065] Here, the object may send the first question in the form of a picture. In this case, if the picture used to carry the first question includes graphic content for assisting in understanding the first question, For example, if the first problem included in the picture is a mathematical geometry problem, the picture may also include illustrations for assisting in intuitively understanding the mathematical geometry problem. Accordingly, the illustrations may be understood as graphic content for assisting in understanding the first problem.

[0066] In an embodiment of the present disclosure, the first blackboard content can be obtained based on the graphic content included in the picture. For example, the machine learning model can reference the graphic content included in the picture of the first question and process the graphic content to obtain the first blackboard content.

[0067] Therefore, through the above implementation, graphic content outside the interactive interface can be interactively integrated into the interactive interface to display more information.

[0068] In some possible implementations, in step S110, the first question may be input into a machine learning model to obtain an instruction stream output by the machine learning model, wherein the instruction stream includes multiple sub-explanatory content and multiple sub-blackboard content arranged in sequence, and at least one sub-blackboard content corresponding to a sub-explanatory content is arranged after or before the corresponding sub-explanatory content. Then, the sub-explanatory content and sub-blackboard content included in the instruction stream are sequentially executed, and the first explanation content and the first blackboard content are displayed in the interactive interface.

[0069] Here, the instruction stream includes multiple sub-explanatory contents and multiple sub-blackboard writing contents arranged in sequence, and at least one sub-blackboard writing content corresponding to the sub-explanatory content is arranged after or before the corresponding sub-explanatory content. For example, after a sub-explanatory content of the instruction stream, at least one sub-blackboard writing content corresponding to the sub-explanatory content may be included. For another example, after at least one sub-blackboard writing content of the instruction stream, one or more sub-explanatory contents corresponding to at least one sub-blackboard writing content may be included.

[0070] That is to say, the instruction stream includes the sub-explanation content and the sub-blackboard writing content. In the instruction stream, the sub-explanation content and the sub-blackboard writing content are presented as an interlaced and structured arrangement.

[0071] Figure 9 FIG. 1 is a schematic diagram showing an instruction flow according to an exemplary embodiment. Figure 9As shown, in the instruction stream, after a sub-explanation content, at least one sub-blackboard content corresponding to the sub-explanation content can follow. It should be noted that all sub-explanation contents in the instruction stream constitute the first explanation content of the first question, and all sub-explanation contents in the instruction stream constitute the first blackboard content corresponding to the first explanation content. It should be noted that the sub-explanation content can be understood as the virtual teacher's explanation words in plain text form, and the sub-blackboard content can be understood as a single operation instruction for the second area of ​​the interactive interface encapsulated in a custom format.

[0072] In some embodiments, the instruction stream includes multiple operation instructions for the interactive interface, and each operation instruction is used to describe a sub-blackboard content corresponding to the operation instruction through a preset code.

[0073] Among them, each operation instruction actually corresponds to a sub-blackboard content. Each operation instruction essentially defines a set of standardized actions for the interactive interface. The operation of the operation instruction on the interactive interface can be described based on the preset code, so that a corresponding sub-blackboard content can be drawn in the interactive interface through the operation instruction.

[0074] Exemplarily, the preset code may be JSON (JavaScript Object Notation, JavaScript (a lightweight, interpreted or just-in-time compiled programming language) object representation) code. That is, the corresponding sub-blackboard content can be described by encapsulating SVG (Scalable Vector Graphics) instructions through JSON code. Of course, in the embodiment of the present disclosure, other programming languages ​​besides JSON code may also be used to describe the sub-blackboard content, which is not specifically limited in the embodiment of the present disclosure.

[0075] It should be understood that since the instruction stream is formed by the interweaving of sub-explanation content and sub-blackboard writing content, when the sub-explanation content and sub-blackboard writing content included in the instruction stream are executed sequentially, the natural teaching process of a real teacher speaking and writing on the blackboard can be simulated.

[0076] It is worth noting that the instruction stream output by the machine learning model can be streamed to the front end of the interactive system. Therefore, the front end can start receiving and processing the sub-explanation content and sub-blackboard content in the instruction stream without waiting for all the first explanation content and the first blackboard content to be generated, thereby achieving low-latency startup and gradual loading.

[0077] Thus, through the instruction stream formed by the interweaving of the sub-explanation content and the sub-blackboard content, the natural teaching process of a real teacher writing on the blackboard while speaking can be simulated, thereby highly restoring the teaching rhythm, idea presentation and visual guidance process of the real teacher in the real classroom, and providing users with an immersive learning experience. In some achievable implementations, in step S110, for the text content in the first blackboard content, the text content is rendered in the interactive interface by a renderer based on hypertext markup language. For the image content in the first blackboard content, the image content is rendered in the interactive interface by a renderer based on scalable vector graphics.

[0078] Here, the text content in the first blackboard content may refer to the text portion included in the first blackboard content. Of course, the text content in the first blackboard content may also refer to the text portion in the first blackboard content that exceeds a preset number of words. That is to say, when the first blackboard content includes a large paragraph of text exceeding a preset number of words, the large paragraph of text can be rendered in the second area of ​​the interactive interface by a renderer based on Hyper Text Markup Language (HTML) to achieve a better typesetting effect.

[0079] Continuing with the above implementation, since each operation instruction is used to describe a sub-blackboard content corresponding to the operation instruction through a preset code, the hypertext markup language-based renderer can execute the corresponding operation instruction, control the DOM (Document Object Model) tree of the HTML page (interactive interface), and load the corresponding sub-blackboard content in the interactive interface.

[0080] For the image content included in the first blackboard content, the image content can be drawn on the interactive interface through a renderer based on scalable vector graphics, thereby achieving more flexible and rich image presentation.

[0081] Continuing with the above implementation, since each operation instruction is used to describe a sub-blackboard content corresponding to the operation instruction through a preset code, the operation instruction can be executed by a renderer based on scalable vector graphics to render the image content in the interactive interface.

[0082] Therefore, through the renderer based on Hypertext Markup Language and the renderer based on Scalable Vector Graphics, the blackboard content can be displayed dynamically and controllably, and the layout can be more beautiful.

[0083] In some feasible implementations, during the display of the first explanation content, a photographic image of the subject can be obtained, and then the expression and / or body movements of the subject can be determined based on the photographic image, and then the first explanation content and / or the first blackboard content can be adjusted based on the expression and / or body movements.

[0084] Here, during the display of the first explanation content, a camera can be used to capture a real-time image of a subject. The subject's facial expression and / or body movements while viewing the first explanation content can then be determined based on the captured image. The first explanation content and / or the first blackboard content can then be adjusted based on the determined facial expression and / or body movements of the subject, resulting in the adjusted first explanation content and / or the adjusted first blackboard content. The adjusted first explanation content and / or the adjusted first blackboard content can then be output on the interactive interface.

[0085] It should be understood that the object's facial expression and / or body movement can be obtained through the trained machine learning model, and then the adjusted first explanation content and / or the adjusted first blackboard content can be obtained based on the context corresponding to the first question and the object's facial expression and / or body movement through the machine learning model.

[0086] Adjusting the first explanation content and / or the first blackboard content may be adjusting the explanation method of the first explanation content and / or the adjusted first blackboard content. For example, the explanation may be adjusted to be conducted in the form of interactive questions.

[0087] It should be noted that by acquiring the subject's facial expressions and / or body movements, the virtual teacher can understand the subject's status in real time through these expressions and / or body movements. For example, through these expressions and / or body movements, the virtual teacher can understand the subject's status feedback, such as whether they understand, are interested, or are confused when viewing the explanation. Accordingly, the machine learning model can adjust the first explanation content and / or the first blackboard content in real time based on the subject's status feedback, so that the user can achieve better learning results.

[0088] Therefore, by adjusting the first explanation content and / or the first blackboard content according to facial expressions and / or body movements, the first explanation content and / or the first blackboard content can be adjusted in time according to the user's status feedback, so that the user can obtain better learning results.

[0089] In some feasible implementations, the learning status of the object can be determined based on the historical learning data of the object, and then the first explanation content and / or the first blackboard content can be generated based on the learning status and the first question.

[0090] Here, the subject's historical learning data can include historical answer records, question content, learning time, learning frequency, and other information. The subject's learning status can be used to reflect the subject's learning style, cognitive approach, and knowledge background. By summarizing the subject's historical learning data, the subject's learning status can be derived, enabling machine learning models to understand the subject's knowledge mastery in real time.

[0091] It should be noted that, since each subject has different learning styles, cognitive methods, and knowledge backgrounds, and has different understanding and acceptance abilities for problems, by generating the first explanation content and / or the first blackboard content based on the learning status and the first problem, the first explanation content and / or the first blackboard content that conforms to the learning status of the subject can be generated. For example, for subjects with a good learning status, the first explanation content and / or the first blackboard content formed by a relatively simple explanation method can be used to explain the first problem. For subjects with a poor learning status, the first explanation content and / or the first blackboard content formed by a relatively detailed explanation method can be used to explain the first problem.

[0092] Therefore, through the above implementation, the first explanation content and / or the first blackboard content can be generated through the historical learning data of the object, so as to adapt the difficulty and explanation method of the first explanation content and / or the first blackboard content according to the learning status of different objects, and provide users with a personalized learning experience.

[0093] Figure 10 FIG. 1 is a schematic diagram of a structure of an interactive device for explaining a problem according to an exemplary embodiment. Figure 10 As shown, the embodiment of the present disclosure provides an interactive device 1000 for explaining a question, and the interactive device 1000 for explaining a question includes: The display module 1001 is configured to respond to the first question sent by the object, and display the first explanation content corresponding to the first question and the first blackboard content corresponding to the first explanation content in the interactive interface; the first explanation content includes multiple sections of sub-explanation content, and the first blackboard content includes multiple sub-blackboard content, each section of the sub-explanation content corresponds to at least one sub-blackboard content, and the sub-explanation content and the sub-blackboard content corresponding to the sub-explanation content are displayed in sequence in the interactive interface.

[0094] Optionally, the interactive device 1000 for explaining a question further includes: The response module is configured to respond to the second question sent by the object during the process of displaying the first explanation content and the first blackboard content, and display the second explanation content corresponding to the second question and the second blackboard content corresponding to the second explanation content in the interactive interface, wherein the second blackboard content is obtained based on the first blackboard content that has been displayed.

[0095] Optionally, the interactive device 1000 for explaining a question further includes: The first determination module is configured to respond to the annotation operation on the first blackboard content triggered by the object on the interactive interface and / or the input operation triggered by the object on the interactive interface, and determine the second question according to the annotation content corresponding to the annotation operation and / or the input content corresponding to the input operation, and the first blackboard content is generated by the machine learning model based on the first question.

[0096] Optionally, the interactive device 1000 for explaining a question further includes: The content acquisition module is configured to, when the first question is a question in a picture, obtain the first blackboard content based on the graphic content if the picture includes graphic content for assisting understanding of the first question.

[0097] Optionally, the display module 1001 is specifically configured as follows: Inputting the first question into a machine learning model to obtain an instruction stream output by the machine learning model, wherein the instruction stream includes the plurality of sub-explanatory contents and the plurality of sub-blackboard contents arranged in sequence, and at least one sub-blackboard content corresponding to the sub-explanatory content is arranged after or before the corresponding sub-explanatory content; The sub-explanation content and the sub-blackboard writing content included in the instruction stream are executed sequentially, and the first explanation content and the first blackboard writing content are displayed in the interactive interface.

[0098] Optionally, the instruction stream includes multiple operation instructions for the interactive interface, and each operation instruction is used to describe a sub-blackboard content corresponding to the operation instruction through a preset code.

[0099] Optionally, the display module 1001 is specifically configured as follows: For the text content in the first blackboard content, rendering the text content in the interactive interface through a renderer based on Hypertext Markup Language; With respect to the image content in the first blackboard writing content, the image content is rendered in the interactive interface through a renderer based on scalable vector graphics.

[0100] Optionally, the interactive device 1000 for explaining a question further includes: an acquisition unit, configured to acquire a photographed image of the object during the process of presenting the first explanation content; a second determining module, configured to determine the facial expression and / or body movement of the subject based on the captured image; The adjustment determination module is configured to adjust the first explanation content and / or the first blackboard content according to the facial expression and / or body movement.

[0101] Optionally, the interactive device 1000 for explaining a question further includes: a third determining module, configured to determine a learning state of the object based on historical learning data of the object; A generation module is configured to generate the first explanation content and / or the first blackboard content according to the learning status and the first question.

[0102] Regarding the interactive device 1000 explained in the above embodiment, the method logic executed by each functional module has been described in detail in the part about the method, which will not be repeated here.

[0103] Reference below Figure 11 , which shows a schematic diagram of the structure of an electronic device (terminal device or server) 1100 suitable for implementing the embodiments of the present disclosure. The terminal device in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (such as in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 11 The electronic device shown is only an example and should not limit the functions and scope of use of the embodiments of the present disclosure.

[0104] like Figure 11 As shown, electronic device 1100 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 1101, which can perform various appropriate actions and processes based on programs stored in a read-only memory (ROM) 1102 or programs loaded from a storage device 1108 into a random access memory (RAM) 1103. RAM 1103 also stores various programs and data required for the operation of electronic device 1100. Processing device 1101, ROM 1102, and RAM 1103 are connected to each other via a bus 1104. An input / output (I / O) interface 1105 is also connected to bus 1104.

[0105] Typically, the following devices may be connected to the I / O interface 1105: an input device 1106 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 1107 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1108 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1109. The communication device 1109 may allow the electronic device 1100 to communicate with other devices wirelessly or by wire to exchange data. Figure 11The electronic device 1100 is shown with various devices, but it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed instead.

[0106] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 1109, or installed from the storage device 1108, or installed from the ROM 1102. When the computer program is executed by the processing device 1101, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0107] It should be noted that the computer-readable medium described above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. Computer-readable storage media may include, for example, but not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or components, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such a propagated data signal may take a variety of forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to wire, optical cable, RF (radio frequency), or any suitable combination thereof.

[0108] In some embodiments, communications may be conducted using any currently known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or later developed network.

[0109] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0110] The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: responds to the first question sent by the object, and displays the first explanation content corresponding to the first question and the first blackboard content corresponding to the first explanation content in the interactive interface; the first explanation content includes multiple sections of sub-explanation content, and the first blackboard content includes multiple sub-blackboard content, each section of the sub-explanation content corresponds to at least one sub-blackboard content, and the sub-explanation content and the sub-blackboard content corresponding to the sub-explanation content are displayed in sequence in the interactive interface.

[0111] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0112] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0113] The modules described in the embodiments of the present disclosure may be implemented in software or hardware, wherein the name of a module does not necessarily limit the module itself.

[0114] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0115] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of machine-readable storage media may include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fibers, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0116] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of the present disclosure is not limited to technical solutions formed by specific combinations of the aforementioned technical features. It also encompasses other technical solutions formed by any combination of the aforementioned technical features or their equivalents, without departing from the scope of the above disclosure. For example, a technical solution formed by replacing the aforementioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0117] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0118] Although the subject matter has been described using language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims. Regarding the apparatus in the above-described embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method and will not be elaborated upon here.

Claims

1. An interactive method for explaining a problem, characterized in that: include: In response to the first question sent by the object, a first explanation content corresponding to the first question and a first blackboard content corresponding to the first explanation content are displayed in the interactive interface; The first explanation content includes multiple sections of sub-explanation content, and the first blackboard content includes multiple sub-blackboard content. Each section of the sub-explanation content corresponds to at least one sub-blackboard content. The sub-explanation content and the sub-blackboard content corresponding to the sub-explanation content are displayed in sequence in the interactive interface.

2. The method according to claim 1, characterized in that The method further comprises: In the process of displaying the first explanation content and the first blackboard content, in response to the second question sent by the object, the second explanation content corresponding to the second question and the second blackboard content corresponding to the second explanation content are displayed in the interactive interface, wherein the second blackboard content is obtained based on the displayed first blackboard content.

3. The method according to claim 2, characterized in that The second problem is obtained by the following steps: In response to the annotation operation triggered by the object on the interactive interface on the first blackboard content and / or the input operation triggered by the object on the interactive interface, the second question is determined according to the annotation content corresponding to the annotation operation and / or the input content corresponding to the input operation, and the first blackboard content is generated by the machine learning model based on the first question.

4. The method according to claim 1, wherein The first blackboard content is obtained by the following steps: In the case where the first question is a question in a picture, if the picture includes graphic content for assisting understanding of the first question, the first blackboard content is obtained based on the graphic content.

5. The method according to any one of claims 1 to 4, characterized in that The first question sent by the responding object and displaying the first explanation content corresponding to the first question and the first blackboard content corresponding to the first explanation content in the interactive interface include: Inputting the first question into a machine learning model to obtain an instruction stream output by the machine learning model, wherein the instruction stream includes the plurality of sub-explanatory contents and the plurality of sub-blackboard contents arranged in sequence, and at least one sub-blackboard content corresponding to the sub-explanatory content is arranged after or before the corresponding sub-explanatory content; The sub-explanation content and the sub-blackboard writing content included in the instruction stream are executed sequentially, and the first explanation content and the first blackboard writing content are displayed in the interactive interface.

6. The method according to claim 5, characterized in that The instruction stream includes a plurality of operation instructions for the interactive interface, and each of the operation instructions is used to describe a sub-blackboard content corresponding to the operation instruction through a preset code.

7. The method according to any one of claims 1 to 4, characterized in that Displaying the first blackboard content corresponding to the first explanation content in the interactive interface includes: For the text content in the first blackboard content, rendering the text content in the interactive interface through a renderer based on Hypertext Markup Language; With respect to the image content in the first blackboard writing content, the image content is rendered in the interactive interface through a renderer based on scalable vector graphics.

8. The method according to any one of claims 1 to 4, characterized in that The method further comprises: During the process of presenting the first explanation content, obtaining a photographed image of the object; determining the facial expression and / or body movement of the subject based on the captured image; Adjust the first explanation content and / or the first blackboard content according to the facial expression and / or body movement.

9. The method according to any one of claims 1 to 4, characterized in that The first explanation content and / or the first blackboard content are obtained by the following steps: determining a learning state of the object based on historical learning data of the object; The first explanation content and / or the first blackboard writing content are generated according to the learning status and the first question.

10. An interactive device for explaining a question, characterized in that: include: a display module configured to respond to a first question sent by an object and display a first explanation content corresponding to the first question and a first blackboard content corresponding to the first explanation content in an interactive interface; The first explanation content includes multiple sections of sub-explanation content, and the first blackboard content includes multiple sub-blackboard content. Each section of the sub-explanation content corresponds to at least one sub-blackboard content. The sub-explanation content and the sub-blackboard content corresponding to the sub-explanation content are displayed in sequence in the interactive interface.

11. A computer-readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processing device, the steps of the method according to any one of claims 1 to 9 are implemented.

12. An electronic device, characterized in that: include: a storage device having a computer program stored thereon; A processing device, configured to execute the computer program in the storage device to implement the steps of the method according to any one of claims 1 to 9.

13. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.

Images