Emotion accompanying type children education interaction method and device, medium and program product
By using virtual digital avatars to guide young users in selecting teaching scenarios and completing interactive processes, the problem of existing children's education products having monotonous interfaces and lacking emotional companionship is solved, achieving immersive interactive teaching and enhancing children's learning interest and participation.
Patent Information
- Application Number
- CN202511535231.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2025-09-11
- Filing Date
- 2025-10-24
- Publication Date
- 2026-01-20
AI Technical Summary
Existing children's educational products have simple interfaces and interactive forms, lack interactive fun, make it difficult to improve children's learning interest, and lack emotional companionship, resulting in poor interactive effects.
By using virtual digital humans to guide users in selecting teaching scenarios and completing interactive processes, immersive and engaging teaching is provided, enhancing the interactive experience.
It achieves an immersive interactive teaching effect for children, increasing children's participation and learning interest in the teaching process.
Smart Images

Figure CN121365130A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to the field of artificial intelligence, and in particular to a method, device, medium and program product for emotional accompanying type children's education interaction. BACKGROUND
[0002] With the development of large language model technology in the field of artificial intelligence, AI services such as AI chat, AI search, AI consultation, AI education, etc. have emerged, which are centered on large language models. In particular, products in the field of AI education for children's education have developed rapidly.
[0003] However, the interfaces and interaction forms of such children's education products currently exhibit singularity and convergence. Common interaction interface forms include question and answer interaction interfaces and voice dialogue interaction interfaces. The interaction forms are single, most of them are chat type dialogue teaching, and the one-question-one-answer dialogue function interface is also programmed and lacks interactive interest, which is difficult to improve the interest of children in learning. SUMMARY
[0004] Therefore, the present disclosure provides a method, device, medium and program product for emotional accompanying type children's education interaction, which can achieve an immersive accompanying type children's interactive teaching effect, has good interactive interest, and enables children to immerse in the teaching process and understand and receive the teaching content.
[0005] According to an aspect of the present disclosure, a method for children's education interaction is provided, which includes: in response to a user selecting a children's education module in a client, displaying a children's education interface, the children's education interface including a virtual digital person and a selection control of at least one teaching scene, the virtual digital person being configured to provide guidance services; in response to the user selecting any teaching scene, entering an interactive page of the selected teaching scene and performing an interactive process corresponding to the selected teaching scene in the interactive page, the interactive page further including the virtual digital person, the virtual digital person in the interactive page being configured to guide the user to complete the interactive process corresponding to the selected teaching scene.
[0006] According to another aspect of the present disclosure, a children's education interaction device is provided, which includes: a main interface display module configured to, in response to a user selecting a children's education module in a client, display a children's education interface, the children's education interface including a virtual digital person and a selection control of at least one teaching scene, the virtual digital person being configured to provide guidance services; an interactive page display module configured to, in response to the user selecting any teaching scene, enter an interactive page of the selected teaching scene and perform an interactive process corresponding to the selected teaching scene in the interactive page, the interactive page further including the virtual digital person, the virtual digital person in the interactive page being configured to guide the user to complete the interactive process corresponding to the selected teaching scene.
[0007] According to another aspect of the present disclosure, an electronic device is provided, comprising a memory, a processor, and a computer program stored on the memory, the processor executing the computer program to implement the steps of the above method.
[0008] According to another aspect of the present disclosure, a non-volatile computer readable storage medium is provided, having a computer program stored thereon, the computer program being executed by a processor to implement the steps of the above method.
[0009] According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program, or a non-volatile computer readable storage medium carrying the computer program, the computer program being executed by a processor to implement the steps of the above method.
[0010] According to aspects of the present disclosure, by guiding a user (such as a child user) to select a teaching scene and complete a corresponding interactive process through a virtual digital person, it is equivalent to accompanying a child to complete teaching through a virtual digital person, which can achieve an immersive and accompanying type of children's interactive teaching effect, has good interactive interest, and enables a child user to immerse in a teaching process and understand and receive teaching content.
[0011] Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the drawings. BRIEF DESCRIPTION OF DRAWINGS
[0012] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments, features, and aspects of the present disclosure and serve to explain the principles of the present disclosure.
[0013] Figure 1 A flowchart of a children's education interactive method according to an embodiment of the present disclosure is shown.
[0014] Figure 2 、 Figure 3 、 Figure 4 、 Figure 5a and Figure 5b Schematic diagrams of some children's education interfaces according to an embodiment of the present disclosure are shown.
[0015] Figure 6 A schematic diagram of a digital person setting page according to an embodiment of the present disclosure is shown.
[0016] Figure 7 A schematic diagram of a children's education interface according to an embodiment of the present disclosure is shown.
[0017] Figure 8 A schematic diagram of a child lock setting page according to an embodiment of the present disclosure is shown.
[0018] Figure 9 FIG. 6 shows a schematic diagram of a guide prompt page displayed when a child exits the children education module for the first time according to an embodiment of the present disclosure.
[0019] Figure 10a and Figure 10b FIG. 7 shows a schematic diagram of some children education interfaces according to an embodiment of the present disclosure.
[0020] Figure 11 FIG. 8 shows a schematic diagram of a child lock verification page according to an embodiment of the present disclosure.
[0021] Figure 12 FIG. 9 shows a schematic diagram of a guide prompt page displayed when a child clicks the child lock control in a locked state according to an embodiment of the present disclosure.
[0022] Figure 13 FIG. 10 shows a schematic diagram of a children education interface according to an embodiment of the present disclosure.
[0023] Figure 14 FIG. 11 shows a schematic diagram of a parent identity verification page according to an embodiment of the present disclosure.
[0024] Figure 15 FIG. 12 shows a schematic diagram of a children education interface according to an embodiment of the present disclosure.
[0025] Figure 16 FIG. 13 shows a schematic diagram of an interactive page of an AI chat scene according to an embodiment of the present disclosure.
[0026] Figure 17 , Figure 18 , Figure 19 FIGS. 14 to 16 respectively show schematic diagrams of some interactive pages in a science learning scene according to an embodiment of the present disclosure.
[0027] Figure 20 and Figure 21 FIGS. 17 to 19 respectively show schematic diagrams of some interactive pages in a free conversation mode in a foreign language teaching scene according to an embodiment of the present disclosure.
[0028] Figure 22 , Figure 23 , Figure 24 , Figure 25 , Figure 26 and Figure 27 FIGS. 21 to 23 respectively show schematic diagrams of some interactive pages in a word practice flow in a conversation practice mode in a foreign language teaching scene according to an embodiment of the present disclosure.
[0029] Figure 28 , Figure 29 , Figure 30 , Figure 31 , Figure 32 , Figure 33Schematic diagrams respectively showing some interaction pages in a sentence practice flow in a conversation practice mode of a foreign language teaching scene according to an embodiment of the present disclosure.
[0030] Figure 34 Schematic diagrams showing some dynamic effect emoticons matched with interaction flows according to an embodiment of the present disclosure.
[0031] Figure 35 Schematic diagrams showing some interaction interfaces in a landscape mode and a portrait mode according to an embodiment of the present disclosure.
[0032] Figure 36 A block diagram of an electronic device according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION
[0033] Various exemplary embodiments, features, and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numbers in the drawings represent the same elements or features having the same or similar functions. Although various aspects of embodiments are illustrated in the drawings, the drawings are not necessarily drawn to scale unless specifically noted.
[0034] As used herein, the terms "comprise", "comprising", "have", "having", "include", "including", "contain", "containing", or variants thereof are open-ended, and include one or more stated features, integers, elements, steps, components, or functions but do not preclude the presence or addition of one or more other features, integers, elements, steps, components, functions, or groups thereof.
[0035] When an element is referred to as being "connected", "coupled", "responsive", or "related" to another element, it can be directly connected, coupled, responsive, or related to the other element, or intervening elements can be present.
[0036] Although the terms first, second, third, etc. can be used herein to describe various elements / operations, these elements / operations should not be limited by these terms. These terms are only used to distinguish one element / operation from another element / operation. Thus, a first element / operation in some embodiments could be termed a second element / operation in other embodiments without departing from the teachings of the present inventive concept.
[0037] The word "exemplary" is used herein to mean "serving as an example, instance, or illustration." Any implementation described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other implementations.
[0038] In addition, for the purpose of convenience and brevity, detailed descriptions of well-known functions and structures incorporated herein can not be described in detail. It should be appreciated that the present disclosure can be practiced with the exact details as other implementations can omit, add, or modify.
[0039] As mentioned above, current children's educational products based on large language models exhibit a uniformity and convergence in their interfaces and interactions. For example, some large language model-based products, while capable of simulating real dialogue, prioritize task efficiency and lack overall engagement and emotional appeal for children. Some smart assistant products have complex functional frameworks and interaction paths, lacking customized services tailored to children's education. Furthermore, some AI educational interaction systems on television products suffer from mechanical task feedback, lacking emotional warmth, and when AI educational capabilities are migrated to the large-screen ecosystem, the interface and interaction are indistinguishable from similar mobile products.
[0040] In the current era of large-scale model technology, AI education products on the market are largely homogenized, and their user interfaces generally follow the industry-standard dialogue window design framework, with voice dialogue lists and functional controls as the main components. In particular, existing smart TVs lack independent digital avatars for children, and their interfaces are conventional, lacking in fun and interactivity.
[0041] Furthermore, major hardware manufacturers are attempting to delve deeper into the AI education field, developing new intelligent education products through smart hardware service models to attract user word-of-mouth. Smart screens serve as the primary window for family users to consume video content, with children being one of the most important content consumers. Therefore, this disclosure proposes an interactive educational method for children, aiming to customize unique AI education services for children. Through a virtual digital human avatar, children are guided to establish an emotional connection with the virtual digital human through voice interaction, completing interactive scenarios such as fun foreign language teaching.
[0042] Figure 1 A flowchart illustrating an embodiment of the interactive educational method for children, as shown below. Figure 1 As shown, the method includes:
[0043] Step S11: In response to the user selecting the children's education module in the client, the children's education interface is displayed. The children's education interface includes a virtual digital human and at least one selection control for a teaching scenario. The virtual digital human is used to provide guidance services.
[0044] Step S12: In response to the user selecting any teaching scenario, the user enters the interactive page of the selected teaching scenario and performs the interactive process corresponding to the selected teaching scenario on the interactive page. The interactive page also includes the virtual digital human, which is used to guide the user to complete the interactive process corresponding to the selected teaching scenario.
[0045] According to the interaction method of the embodiment of the present disclosure, the user (e.g., a child user) is guided by the virtual digital person to select a teaching scene and complete a corresponding interaction process, which is equivalent to accompanying the child to complete the teaching through the virtual digital person, and an immersive and accompanying type of children's interaction teaching effect can be achieved, which has good interaction interest and enables the child user to immerse in the teaching process and understand and receive the teaching content.
[0046] In some embodiments, the client of the embodiment of the present disclosure can be an application deployed on a mobile terminal (e.g., a mobile phone, a tablet computer, a notebook computer, a desktop computer, etc.) or an application deployed on a television terminal (i.e., a TV terminal). The client can be integrated with various functional modules, such as a children's education module, a game module, a social module, etc., and of course, the children's education module can be integrated alone, which is not limited in the embodiment of the present disclosure. It should be understood that when the user expects to enter the children's education module for learning, the client can be started and the children's education module can be selected to enter, and when the user selects the children's education module, a children's education interface of the children's education module is displayed, which can be understood as a home page or a main interface of the children's education module.
[0047] In some embodiments, the virtual digital person can be understood as a digital or virtual role or individual existing in a virtual environment, which can be an animated role, a virtual assistant, or an artificially intelligent generated character. After the virtual digital person is designed, the virtual digital person needs to be rendered and driven. The rendered virtual digital person is static, and the driving of the digital person is to make the rendered static digital person move like a real human being, so that the digital person has a very realistic and detailed restoration of the super-realistic human image in the real world, which includes facial expressions, skin texture, eye gloss, etc. details, aiming to make the audience feel real in vision. It should be understood that a person skilled in the art can customize the image of the virtual digital person and realize the rendering and driving of the virtual digital person based on actual needs, so as to enable the virtual digital person to realize accompanying and intelligent guiding service in the entire children's education module.
[0048] In some embodiments, the children's education module can set at least one teaching scene (i.e., teaching function) suitable for children, for example, the children's education module can set one or more of foreign language teaching scenes, AI chat scenes, and science learning scenes, which are not limited in the embodiment of the present disclosure. It should be understood that the children's education interface can set a selection control for selecting any teaching scene, and different terminals can adopt an interactive mode suitable for the terminal, for example, for a mobile terminal, the interactive mode can be touch control, mouse selection, voice instruction, etc., and for a television terminal, the interactive mode can be a physical button instruction and / or a voice instruction of a television remote control, which is not limited in the embodiment of the present disclosure.
[0049] Exemplarily, Figure 2The diagram illustrates a children's educational interface according to an embodiment of the present disclosure, such as... Figure 2 As shown, the children's education interface may include: a global navigation bar at the top ①, an interface navigation bar at the bottom ②, and a virtual digital human ③ in the middle area; the global navigation bar includes entry buttons for various functional modules. Users can switch left and right on the top navigation bar to select the desired functional module. When the user selects the entry button for the children's education module, i.e., "Children", the following will be displayed: Figure 2 The interface shown is a children's education interface. The interface navigation bar includes selection controls for three teaching scenarios: buttons for "Learn English," "Chat," and "Learn Encyclopedia." As mentioned above, different interaction methods can be used to select teaching scenarios for different terminals. For example, if the client is deployed on a TV terminal, the user can select the children's education module in the global navigation bar using physical buttons on the TV remote. When the remote control's focus is on the "Children's" button and the user clicks the confirmation button (such as the "OK" button or the "Down" button), it is considered that the user has confirmed entering the children's education module. At this time, the focus can be on the selection control for the default teaching scenario in the interface navigation bar, such as... Figure 3 As shown, the control focus can default to "Chat". At this time, the "Chat" button ⑧ can be highlighted and display the prompt "Press OK to enter chat". At the same time, the virtual digital human ③ can provide guidance prompts ④ through voice and / or text, such as "Little friend, welcome to your exclusive space. Select to chat with me and click the 'OK' button. I will accompany you and interact with you~".
[0050] Furthermore, users can control the focus by clicking the "left" or "right" button on the remote control to switch teaching scenarios. For example, if the focus is switched to "Learn English," the following will be displayed: Figure 4 In the children's education interface shown, the "Learn English" button ⑧ can be highlighted and display the prompt "Press OK to learn English," while the virtual digital human ③ outputs guidance prompts ④ to allow the user to select a learning mode; if the control focus is switched to "Learn Encyclopedia," it can display... Figure 5a The children's education interface shown features a "Learn Encyclopedia" button ⑧ that can be highlighted and display the prompt "Press OK to learn encyclopedia." Simultaneously, the virtual digital human ③ provides guidance prompts ④ to allow the user to select encyclopedia knowledge. It should be understood that when the user controls the focus on any teaching scenario selection control using the remote, they can confirm the selection of that teaching scenario by clicking the confirmation button (such as the "OK" button) on the remote. For example, when the user... Figure 4 Clicking the "OK" button on the remote control in the children's education interface will take you to the "Learn English" interactive page, allowing you to engage in interactive foreign language teaching scenarios.
[0051] Optionally, such as Figure 3, Figure 4 and Figure 5a As shown, the interface background and guidance prompts ④ can be different in different teaching scenarios, and they can switch as the teaching scenario changes.
[0052] For example, Figure 5b A schematic diagram illustrating another children's educational interface according to an embodiment of the present disclosure is shown, such as... Figure 5b As shown, the children's education interface may include: a navigation bar at the top and a virtual digital human in the middle area. The navigation bar includes selection controls for four teaching scenarios, namely buttons for "Encyclopedia", "Chat Room", "English Teacher" and "Picture Book Library", which can respectively realize the interactive process of learning encyclopedia, AI chat, learning English and reading picture books. Similarly, when the client is deployed on a TV terminal, the teaching scenario can be switched and selected through physical buttons on the remote control. Alternatively, if the TV terminal supports voice interaction, the teaching scenario can also be switched and selected through voice commands. This embodiment of the present disclosure does not limit this.
[0053] As described above, those skilled in the art can design virtual digital human images according to actual needs. Considering that different users have different preferences for virtual digital human images, multiple images of virtual digital humans can be designed to allow users to choose their favorite image, thereby improving the user experience. Therefore, in some embodiments, the children's education interface also includes a virtual digital human switching control. The method may further include: responding to clicking the virtual digital human switching control to enter a digital human settings page, which includes multiple images of virtual digital humans; responding to the user selecting any image of a virtual digital human to return to the children's education interface and display the selected virtual digital human in the children's education interface.
[0054] For example, the above Figure 2 The "Change Partner" button (⑤) shown at the bottom left of the middle section. Figure 5b The "Change Partner" button shown at the top left can be a virtual digital human switching control. When the user, for example, controls the virtual digital human switching control with the focus via a remote control and clicks the confirmation button (such as the OK button), they can enter... Figure 6 The digital human settings page shown displays three virtual digital human avatars. Users can select any avatar using a remote control. After confirming the selection, users can return to the previous page. Figure 2 or Figure 5b The interface shown is an educational interface for children, displaying the virtual digital person selected by the user.
[0055] As mentioned above, the client can integrate multiple functional modules. Parents may not want their children to access certain functional modules (such as game modules), or they may expect their children to continuously engage in educational interactions within the children's education module. Therefore, in one possible implementation, the children's education interface also includes a child lock control. This child lock control is used to set a child lock, which locks the client within the children's education module when the module is locked. For example, as... Figure 2 The lock-style button shown at point ⑥ could be a child lock control. This child lock control can also use different styles to indicate whether the current child lock state is locked or unlocked. For example... Figure 2 The child lock control shown is in an unlocked state. Figure 7 In the children's education interface shown, the child lock control ⑥ is in a locked state.
[0056] Therefore, in some embodiments, the method further includes:
[0057] When the child lock is unlocked, in response to the user clicking the child lock control to enter the child lock settings page, or in response to the user's first operation to exit the children's education module, a virtual digital avatar will guide the user to set up the child lock, so that the user can enter the child lock settings page under the guidance of the virtual digital avatar.
[0058] In this scenario, upon completing the child lock settings on the child lock settings page, the system returns to the children's education interface and switches the child lock to the locked state; alternatively, upon completing the child lock settings on the child lock settings page, the system exits the children's education module.
[0059] The operation of exiting the children's education module can include: switching to other functional modules of the client, such as through... Figure 2 The operation of switching to other functional modules via the top navigation bar; or the operation of exiting the entire client, such as the user exiting the entire client by clicking the "Home" button on the remote control, is not limited in this embodiment. Therefore, exiting the children's education module can be either switching to other functional modules of the client or exiting the entire client.
[0060] For example, when click Figure 2 The child lock control shown in the image (⑥) allows access to... Figure 8 The child lock settings page shown allows users to set a 4-digit password to enable the child lock; alternatively, when a user enters the children's education module for the first time and exits it for the first time, they can use a virtual digital human to output text and voice commands. Figure 9 The displayed guidance prompts are used to guide users in setting up child locks, such as... Figure 9As shown, the guide prompt can provide "not to set" and "set child lock" buttons, and the user can select to set the child lock or not to set the child lock through the guide prompt. When the user selects "set child lock" by controlling the focus through the remote controller, for example, the child lock setting page shown in the figure can be entered. Figure 8 As shown, the child lock setting page, when the user selects "not to set" by controlling the focus through the remote controller, can directly exit the children education module, or can also output a guide prompt to welcome the user in the form of text or voice through the virtual digital person before exiting the children education module, or can also return to the children education interface. In this case, the user needs to perform the operation of exiting the children education module again to exit the children education module, and the embodiments of the present disclosure do not limit this.
[0061] It should be understood that the above Figure 8 As shown, the child lock setting page sets the child lock in the form of setting a 4-digit password, which is one possible implementation provided by the embodiments of the present disclosure. In fact, a 6-digit password, an 8-digit password, or a gesture lock can also be used, and the embodiments of the present disclosure do not limit this. When the user enters the child lock setting page by performing the operation of exiting the children education module for the first time and being guided by the virtual digital person, and completes the setting operation of the child lock in the child lock setting page, the user can return to Figure 10a As shown, the children education interface, and the guide prompt to welcome the user in the form of text or voice through the virtual digital person before exiting the children education module, Figure 10a The child lock control in the figure is in a locked state, or the child lock setting page can directly exit the children education module after completing the setting operation of the child lock. When the user enters the child lock setting page by clicking the child lock control and completes the setting operation of the child lock, the user can return to Figure 10b As shown, the children education interface, prompting the user that the child lock is started, and then guiding the user to select any teaching scene to enter the interactive process. When the user enters the children education module again in the case of setting the child lock, the child lock can be in a locked state by default.
[0062] As described above, the child lock is used to lock the client in the children education module in the locked state. Therefore, in some embodiments, the method further includes:
[0063] In the case that the child lock is in the locked state, in response to the user performing the operation of exiting the children education module, the child lock verification page is entered to make the user perform a verification operation in the child lock verification page;
[0064] In the case that the verification operation performed in the child lock verification page is successful, the children education module is exited; or in the case that the verification operation performed in the child lock verification page fails, the children education module is stayed.
[0065] For example, when the user controls the focus to perform the operation of switching to other function modules (for example, moves the focus to the entry button of other function modules and clicks the confirmation button) through the remote controller in the case where the child lock is in the locked state, the child lock verification page shown in FIG. 8 can be entered. Figure 11 The child lock verification page shown in FIG. 8 is used to perform the verification operation by inputting a 4-digit password. If the 4-digit password is input correctly, it means that the verification operation is successful, and in this case, the main interface of other function modules can be directly jumped to, or the main interface of the child education module shown in FIG. 7 can be returned to first and then automatically switched to the main interface of other function modules. Figure 10a When the user exits the child education module by performing the operation of exiting the entire client through the remote controller, if the verification operation performed in the child verification page shown in FIG. 8 is successful, the entire client can be directly exited, or the child education page shown in FIG. 7 can be returned to first and then the entire client is exited. Figure 11 When the user exits the child education module by performing the operation of exiting the entire client through the remote controller, if the verification operation performed in the child verification page shown in FIG. 8 is successful, the entire client can be directly exited, or the child education page shown in FIG. 7 can be returned to first and then the entire client is exited. Figure 10a When the user exits the child education module by performing the operation of exiting the entire client through the remote controller, if the verification operation performed in the child verification page shown in FIG. 8 is successful, the entire client can be directly exited, or the child education page shown in FIG. 7 can be returned to first and then the entire client is exited. Figure 11 When the user exits the child education module by performing the operation of exiting the entire client through the remote controller, if the verification operation performed in the child verification page shown in FIG. 8 is successful, the entire client can be directly exited, or the child education page shown in FIG. 7 can be returned to first and then the entire client is exited. Figure 7 When the user exits the child education module by performing the operation of exiting the entire client through the remote controller, if the verification operation performed in the child verification page shown in FIG. 8 is successful, the entire client can be directly exited, or the child education page shown in FIG. 7 can be returned to first and then the entire client is exited. Figure 7 When the user exits the child education module by performing the operation of exiting the entire client through the remote controller, if the verification operation performed in the child verification page shown in FIG. 8 is successful, the entire client can be directly exited, or the child education page shown in FIG. 7 can be returned to first and then the entire client is exited. Figure 7 When the user exits the child education module by performing the operation of exiting the entire client through the remote controller, if the verification operation performed in the child verification page shown in FIG. 8 is successful, the entire client can be directly exited, or the child education page shown in FIG. 7 can be returned to first and then the entire client is exited.
[0066] Considering that the user can also have the need to close or reset the child lock, in some embodiments, the method further includes:
[0067] In the case where the child lock is in the locked state, in response to the user clicking the child lock control, the guidance prompt of closing and / or resetting the child lock is performed through the virtual digital person;
[0068] In response to the user selecting to close the child lock under the guidance of the virtual digital person, the child lock verification page is entered, and in the case where the verification operation performed in the child lock verification page is successful, the child education interface is returned to and the child lock is switched to the unlocked state;
[0069] Alternatively, in response to a user selecting to reset the child lock under the guidance of the virtual digital persona, the system will enter the parent authentication page. After successful verification on the parent authentication page, the user will enter the child lock reset page to perform the child lock reset operation. If the child lock reset is successful, the user will return to the children's education interface and keep the child lock locked.
[0070] For example, when the child lock is in the locked state, when the user clicks, for example... Figure 7 The child lock control shown can be operated via a virtual digital human, such as... Figure 12 The guidance prompt shown includes buttons for "Disable Child Lock" and "Reset Child Lock Password," allowing users to choose to disable or reset the child lock. If the user chooses to disable the child lock (for example, by controlling the remote control to focus on "Disable Child Lock" and clicking the OK button), they can proceed to the above... Figure 11 The child lock verification page shown will return the following if the user successfully completes the verification process (i.e., enters the correct 4-digit password): Figure 13 The children's education page shown reminds the user that the child lock is off and switched to an unlocked state. Here, "off" means disabling the child lock, leaving it in an unlocked state. If the verification operation on the child lock verification page fails (i.e., the 4-digit password is entered correctly), the user can refer to the specific implementation method described in the above-described embodiments of this disclosure to remain in the children's education module. If the user... Figure 12 Selecting "Reset Child Lock" in the provided guidance (e.g., using the remote control to focus on "Reset Child Lock Password" and clicking the "OK" button) will allow you to enter... Figure 14 The parent identity verification page shown allows parents to verify their identity via QR code scanning (or facial recognition, or other methods); alternatively, the above... Figure 11 The child lock verification page shown serves as the parent authentication page, verifying the parent's identity by entering a password. Upon successful parent authentication (e.g., successful QR code scanning or correct password), the user is redirected to the child lock reset page. The child lock reset operation performed on this page can refer to the specific implementation of the child lock settings operation performed on the aforementioned child lock settings page. Alternatively, it can be implemented using existing password reset procedures; this embodiment does not impose any limitations on this approach. If the child lock reset is successful, the user can return to the aforementioned page. Figure 7 The interface shown is an educational interface for children, and the child lock is kept engaged.
[0071] As described above, the children education module can set at least one teaching scene (i.e., teaching function) suitable for children, for example, the children education module can set one or more of a foreign language teaching scene, an AI chat scene, and a science learning scene; wherein the interactive process of the AI chat scene can be a process of carrying on a dialogue with the virtual digital person through voice interaction, for example, if the user confirms to select "chat" in the children education interface as shown in Figure 3 or confirms to select "cottage chat" in the children education interface as shown in Figure 15 , the user can enter the interactive page of the AI chat scene as shown in Figure 16 In the interactive page as shown in Figure 16 , the virtual digital person can guide and prompt through voice and text, for example, the virtual digital person can output "long press
voice key
[0072] Wherein the interactive process of the science learning scene can be an interactive process of learning small science knowledge suitable for children, for example, when the user controls the focus to fall on the "learn science" entry button in the children education interface as shown in Figure 5a , the virtual digital person can guide the user to select a small science knowledge through a guide prompt, the guide prompt (4) includes a plurality of small science knowledge suitable for children (such as "eating walnuts makes you smart", etc.), when the user selects any small science knowledge, the user can enter the interactive page of the science learning scene to introduce the interactive process of the small science knowledge in the interactive page, which can be understood as guiding the user to select the small science knowledge in the children education interface, and then directly carrying out the interactive process of science learning in the interactive page of the science learning scene; or, the user can first enter the interactive page of the science learning scene and then guide the user to select the small science knowledge, for example, when the user confirms to select "science library" in the children education interface as shown in Figure 5b , the user can enter the interactive page as shown in Figure 17 , which can display a plurality of small science knowledge suitable for children under any theme type in a plurality of theme types, the user can select the small science knowledge under the theme type that the user wants to learn in the interactive page, for example, the user selects "long-necked snake-necked dragon" under the dinosaur theme, the virtual digital person can introduce the related knowledge about the long-necked snake-necked dragon as shown in Figure 18 , and then recommend a video program related to the theme type (such as the dinosaur theme) selected by the user to the user as shown in Figure 19 , the user can select any video program to watch, of course, the user can also return to the children education interface or the interactive page as shown in Figure 17 , and the present embodiment of the present disclosure does not limit this.
[0073] The interactive process of the foreign language teaching scene can be an interactive process of learning foreign language words and foreign language sentences by the user. The foreign language learned by the user can be, for example, English, Japanese, Korean, and various foreign languages, and the present disclosure is not limited in this regard. The foreign language teaching scene can include at least one learning mode, which can include a dialogue practice mode and a free dialogue mode. The dialogue practice mode can be a mode for practicing foreign language words and foreign language sentences on a certain topic, and the free dialogue mode can be a mode for free dialogue with the virtual digital person in a foreign language. Thus, in some embodiments, in step S12, in response to the user selecting any teaching scene, the interactive page corresponding to the selected teaching scene is entered, and the interactive process of the selected teaching scene is performed on the interactive page, including:
[0074] In step S121, in response to the user selecting a foreign language teaching scene, an interactive page of the foreign language teaching scene is entered, and the interactive page of the foreign language teaching scene includes a selection control of at least one learning mode corresponding to the foreign language teaching scene.
[0075] In step S122, in response to the user selecting any learning mode, an interactive process corresponding to the selected learning mode is performed, and the virtual digital person in the interactive page is further used to guide the user to complete the interactive process corresponding to the selected learning mode.
[0076] For example, when the user controls the focus to fall on the "Learn English" entry button in the children's education interface as shown in Figure 4 , the user can be guided to select any learning mode through the entry button of "free dialogue" or "dialogue practice" in the guidance prompt output by the virtual digital person. If the user selects the free dialogue mode, for example, by selecting "free dialogue" and clicking the confirmation button through the remote control, the interactive process of the free dialogue mode is performed, for example, the user's age, preferences, and other user information can be collected through voice dialogue with the virtual digital person as shown in Figure 20 , and then a plurality of dialogues (i.e., one question and one answer dialogue) can be performed with the user. After the plurality of dialogues, a guidance prompt as shown in Figure 21 can be displayed to recommend part of the recommended topics suitable for the user's age and preferences to the user, to guide the user to enter the dialogue practice mode by selecting a recommended topic, and to perform the dialogue practice process under the recommended topic, i.e., to learn foreign language words or foreign language sentences under the recommended topic.
[0077] For example, if the user selects the dialogue practice mode in the free dialogue mode, for example, by selecting "dialogue practice" and clicking the confirmation button through the remote control, the interactive process of the dialogue practice mode is performed, for example, the user can be guided to select a recommended topic through a guidance prompt as shown in Figure 4The user selects a dialogue practice mode in the child education interface shown, for example, by using the remote controller to control the focus to select "dialogue practice" and click the confirmation button, then the interactive process of the dialogue practice mode is performed, for example, the user's age, preferences and other user information can also be collected by the virtual digital person in a voice dialogue manner, and after collecting the user information, the user is directly recommended a plurality of recommended topics suitable for the user's age and preferences, and then the dialogue practice process under a recommended topic is performed. Thus, in some embodiments, in step S122, in response to the user selecting any learning mode, the interactive process corresponding to the selected learning mode is performed, including:
[0078] In step S1221, in response to the user selecting the dialogue practice mode, the virtual digital person in the interactive page guides the user to provide user information. The user information can include one or more of age, preferences, foreign language learning level (such as a few years of grade level), and the like. The user information can be input in a voice manner, or input in other manners such as options, text, and the like.
[0079] In step S1222, in response to the user having provided the user information, a selection control of a plurality of recommended topics is displayed, the recommended topics being determined based on the user information.
[0080] In step S1223, in response to the user selecting any recommended topic, a dialogue practice process corresponding to the selected recommended topic is performed, and the virtual digital person is further used to guide the user to complete the dialogue practice process.
[0081] The dialogue practice process includes a word practice process and a sentence practice process, the word practice process being used to perform a follow-up reading practice on foreign language words corresponding to the selected recommended topic, and the sentence practice process being used to perform a follow-up reading practice on foreign language sentences corresponding to the foreign language words.
[0082] In step S1221, when the user selects the dialogue practice mode, the user's age, preferences and other user information can be first collected by the virtual digital person in a voice dialogue manner, as shown in Figure 22 The user can express the age and preferences and other user information in Chinese or in English, and the virtual digital person can use English to ask the user's age and preferences throughout the process.
[0083] In step S1222, after the user has provided the user information by voice input, that is, after the user's age and preferences have been collected, the interactive page shown in Figure 23 can be entered to display selection controls of a plurality of recommended topics, such as "Animals", "color & Shape", "Our Body", and the like. The recommended topics can be topic types suitable for the user determined based on the user's age and preferences. Since the aboveFigure 21 Only part of the recommended themes are displayed in the shown interactive page, when the user selects to display all the recommended themes in the shown guide prompt, for example, after clicking “All Themes”, the user can also enter the interactive page shown below to display all the recommended themes. Figure 21 Figure 23 The user can also change the currently displayed recommended theme or correct the user information to display the recommended theme according to the new user information through the interactive mode such as voice input instruction or remote control key operation, and the present embodiment of the present disclosure does not limit this.
[0084] In step S1223, when the user selects a recommended theme through the interactive mode such as remote control key operation or voice input instruction, the user can enter the conversation practice flow of foreign language words and foreign language sentences under the recommended theme, for example, when the user selects the animal theme, the conversation practice flow is practiced with the foreign language words and foreign language sentences related to the animal, and the present embodiment of the present disclosure does not limit this.
[0085] In some embodiments, the word practice flow can include:
[0086] The selected foreign language words corresponding to the recommended theme are explained by the virtual digital person;
[0087] The virtual digital person guides the user to read the foreign language words through voice input mode to obtain the reading voice of the foreign language words, and evaluates the reading voice of the foreign language words to obtain a word evaluation result, the word evaluation result representing the completeness and accuracy of the reading voice of the foreign language words;
[0088] The virtual digital person outputs a word evaluation prompt, the word evaluation prompt being prompt information determined based on the word evaluation result;
[0089] The word evaluation prompt is used to guide the user to re-read the foreign language words when the word evaluation result represents that the reading voice of the foreign language words is not passed, or to guide the user to enter the sentence practice flow when the word evaluation result represents that the reading voice of the foreign language words is passed.
[0090] Exemplarily, as shown in the following figure, the virtual digital person guides the user to read the foreign language words through voice input mode. Figure 24 The interactive page shown can output the pronunciation and meaning of a foreign word (such as elephant) in text and voice through a virtual digital person, and simultaneously guide the user to read the foreign word, and the right side of the page can also display a word card ②, which can include a word picture, a Chinese-English explanation of the word, and a repeat button ④. When the user clicks the repeat button, the pronunciation of the foreign word can be played repeatedly. The interactive interface also displays an evaluation prompt ③ to inform the user to use the "long-press voice key to read the word, and release the voice key to submit the evaluation" operation mode. Of course, the user can also be prompted to use the "long-press voice key" to input the read voice of the foreign word through the guide prompt ①. When the user long-presses the voice key, for example, the following can be displayed: Figure 25 The interactive page of the recording mode shown can record the read voice of the word input by the user, thereby guiding the user to read the foreign word through voice input. When the user releases the recording key, the recording stops, and the read voice of the foreign word is obtained.
[0091] After obtaining the read voice of the foreign word, a pre-trained evaluation model can be used to evaluate the read voice of the foreign word to obtain a word evaluation result. The evaluation model can be any known artificial intelligence model in the art as long as it can evaluate the completeness and accuracy of the read voice. The completeness of the read voice can be evaluated from whether the audio of the read voice is complete and whether it has sound, etc. The accuracy of the read voice can be evaluated from whether the pronunciation, tone, stress, etc. of the read voice are accurate, i.e., whether they are the same as or similar to the standard pronunciation of the foreign word, etc. The evaluation method and evaluation dimension of the read voice are not limited in the embodiments of the present disclosure.
[0092] The judgment of whether the read voice of the foreign word passes or not, for example, can be the judgment of whether the accuracy and completeness of the read voice exceed certain thresholds, respectively. If the accuracy and completeness of the read voice exceed certain thresholds, respectively, the read voice is considered to pass. Otherwise, if either the accuracy or the completeness of the read voice exceeds the threshold, the read voice is considered to fail. Further, a word evaluation prompt generated based on the word evaluation result can be output through the virtual digital person, and the word evaluation prompt can be expressed in an encouraging manner to enhance the enthusiasm of the user.
[0093] In some embodiments, the output of the word evaluation prompt through the virtual digital person includes:
[0094] In a case where the word evaluation result represents that the read-aloud pronunciation of the foreign language word fails, the pace of the lead pronunciation of the foreign language word is adjusted, and / or the user is encouraged to read aloud again by the virtual digital person and a correction suggestion for the read-aloud pronunciation of the foreign language word is output to guide the user to read aloud the foreign language word again; and / or in a case where the number of times of failure of the read-aloud pronunciation of the foreign language word reaches a specified threshold, the user is guided to enter a sentence practice procedure; or the user is guided to replace the foreign language word with a foreign language word of lower difficulty for practice.
[0095] For example, if the word evaluation result represents that the read-aloud pronunciation of the foreign language word fails, the virtual digital person can give a correction suggestion for the read-aloud pronunciation and encourage the user to read aloud again, as shown in Figure 26 For example, if the word evaluation result represents that the read-aloud pronunciation of the foreign language word fails, the virtual digital person can give a correction suggestion for the read-aloud pronunciation and encourage the user to read aloud again, as shown in Figure 27 For example, if the word evaluation result represents that the read-aloud pronunciation of the foreign language word fails, the virtual digital person can give a correction suggestion for the read-aloud pronunciation and encourage the user to read aloud again, as shown in Figure 27 For example, if the word evaluation result represents that the read-aloud pronunciation of the foreign language word fails, the virtual digital person can give a correction suggestion for the read-aloud pronunciation and encourage the user to read aloud again, as shown in
[0096] For example, if the word evaluation result represents that the read-aloud pronunciation of the foreign language word fails, the virtual digital person can give a correction suggestion for the read-aloud pronunciation and encourage the user to read aloud again, as shown in Figure 27 For example, if the word evaluation result represents that the read-aloud pronunciation of the foreign language word fails, the virtual digital person can give a correction suggestion for the read-aloud pronunciation and encourage the user to read aloud again, as shown in
[0097] In some embodiments, the sentence practice procedure comprises:
[0098] explaining, by the virtual digital human, an foreign language sentence corresponding to the foreign language word passed in the reading-along voice evaluation;
[0099] guiding the user to read along the foreign language sentence through voice input, to obtain a reading-along voice of the foreign language sentence, and evaluating the reading-along voice of the foreign language sentence to obtain a sentence evaluation result, the sentence evaluation result representing completeness and accuracy of the reading-along voice of the foreign language sentence;
[0100] outputting, by the virtual digital human, a sentence evaluation prompt, the sentence evaluation prompt being prompt information determined based on the sentence evaluation result;
[0101] The sentence evaluation prompt is used to guide the user to re-read the foreign language sentence when the sentence evaluation result represents that the reading-along voice of the foreign language sentence fails, or to guide the user to return to the word practice procedure to learn new foreign language words when the sentence evaluation result represents that the reading-along voice of the foreign language sentence passes, or to guide the user to watch a video program related to the selected recommended theme.
[0102] For example, as shown in the interactive page Figure 28 , the virtual digital human can output the explanation of the foreign language sentence in text and voice and guide the user to read along the foreign language sentence through the guide prompt ① at the same time. The sentence card ② can also be displayed on the right side of the page, which can include sentence pictures, Chinese and English explanations of the sentence, and a repeat listening button ④. When the user clicks the repeat listening button, the reading-along voice of the foreign language sentence can be played repeatedly. The evaluation prompt ③ is also displayed in the interactive interface, which informs the user to use the operation mode of "long-pressing the voice key to read along the sentence and releasing the voice key to submit the evaluation". Of course, the user can also be prompted to use the "long-pressing the voice key" mode to input the reading-along voice of the foreign language sentence through the guide prompt ①. When the user long-presses the voice key, the recording mode interactive page as shown in Figure 29 can be displayed, which can record the sentence reading-along voice input by the user and provide a progress prompt of the reading-along voice in a highlighted manner during the recording process, so as to guide the user to read along the foreign language sentence through voice input. When the user releases the recording key, the recording is stopped, and the reading-along voice of the foreign language sentence is obtained.
[0103] After obtaining the follow-up speech of the foreign language sentence, a pre-trained evaluation model can be used to evaluate the follow-up speech of the foreign language sentence to obtain a sentence evaluation result. The evaluation model may, for example, adopt any known artificial intelligence model in the art as long as it can evaluate the completeness and accuracy of the follow-up sentence, and the present disclosure does not limit the evaluation model. The completeness of the follow-up speech can be evaluated from the dimensions of whether the follow-up speech is complete and whether it has sound, etc. The accuracy of the follow-up speech may, for example, be evaluated from the dimensions of whether the pronunciation and intonation of the follow-up speech are accurate, i.e., whether they are the same as or similar to the standard pronunciation of the foreign language sentence, etc. The present disclosure does not limit the evaluation method and evaluation dimensions of the follow-up sentence.
[0104] The judgment of whether the follow-up speech of the foreign language sentence passes may, for example, be a judgment of whether the accuracy and completeness of the follow-up speech exceed certain thresholds, respectively. If the accuracy and completeness of the follow-up speech exceed certain thresholds, respectively, it is considered that the follow-up speech of the foreign language sentence passes. Conversely, if either the accuracy or the completeness of the follow-up speech does not exceed the threshold, it is considered that the follow-up speech of the foreign language sentence does not pass. The virtual digital human can then output a sentence evaluation prompt determined based on the sentence evaluation result, and the sentence evaluation prompt may, for example, adopt an encouraging expression to enhance the user's enthusiasm.
[0105] In some embodiments, the virtual digital human outputs the sentence evaluation prompt, including:
[0106] In the case where the sentence evaluation result indicates that the follow-up speech of the foreign language sentence does not pass, the reading speed of the foreign language sentence is adjusted, and / or the virtual digital human encourages the user to re-read and outputs a correction suggestion for the follow-up speech of the foreign language sentence to guide the user to re-read the foreign language sentence; and / or in the case where the number of times that the follow-up speech of the foreign language sentence does not pass reaches a specified threshold, the user is guided to watch a video program related to the selected recommended theme; or the user is guided to replace the foreign language sentence with a lower difficulty and containing the same foreign language word to practice the replaced foreign language sentence.
[0107] For example, if the sentence evaluation result indicates that the follow-up speech of the foreign language sentence does not pass, the virtual digital human may, for example, Figure 30As shown, the virtual digital human gives the correction suggestion of the read sentence while encouraging the user to read again, that is, "You did a great job Aeron, just try again the phoneme of "Phant", read it again, it's an elephant in Africa~" and the like, and at the same time, the speed of the leading reading of the foreign language sentence can be adjusted (for example, the speed of the leading reading voice is slowed down), or the virtual digital human can demonstrate the correction of pronunciation by exaggerated mouth movements, and the like, to guide the user to read the foreign language sentence again. If the number of times of not passing the read voice of the same foreign language sentence reaches a specified threshold (for example, the read voice of the sentence input for 3 times is not passed), the user can be guided to watch the video program related to the selected recommended theme without reading the same foreign language sentence again, for example, the interactive page as shown in Figure 31 The guide prompt as shown, that is, "You did a great job today~……" and the like, can be displayed at the same time Figure 31 The sentence card area in the above-mentioned interactive page can also display the evaluation star, and the prompt information of "more programs", and the interactive page as shown in Figure 32 The interactive page can include a plurality of video programs related to the selected recommended theme (for example, the video programs related to the animal theme and the like), and at the same time, the virtual digital human in the interactive interface outputs the guide prompt to guide the user to select any video program for watching.
[0108] Optionally, if the number of times of not passing the read voice of the same foreign language sentence reaches a specified threshold, the user can also be guided to replace the foreign language sentence with lower difficulty and containing the same foreign language word (for example, replacing it's an elephant in Africa with I like elephant), to practice the replaced foreign language sentence, and it should be understood that the practice process of the replaced foreign language sentence can refer to the above-mentioned sentence practice process, except that the practiced foreign language sentence is different.
[0109] If the word evaluation result represents that the read voice of the foreign language word is passed, the interactive page as shown in Figure 32 can be directly displayed to guide the user to watch the video program related to the selected recommended theme; or the interactive page as shown in Figure 33 can be displayed to guide the user to return to the above-mentioned word practice process to learn new foreign language words, and the Figure 33 The interactive page as shown can display the prompt information of "next word", and the user can return to the above-mentioned Figure 24The displayed interactive page, i.e., returning to the above word practice process again, and then entering the above sentence practice process again, to learn new foreign language words and foreign language sentences; optionally, when a specified number of foreign language words and foreign language sentences have been learned, the interactive page as shown in Figure 31 The displayed interactive page guides the user to watch a video program related to the selected recommended theme, and the embodiments of the present disclosure do not make any limitation in this regard.
[0110] In some embodiments, the above guiding the user to watch a video program related to the selected recommended theme can include: displaying a selection control of a plurality of video programs, the plurality of video programs being related to the selected recommended theme; and in response to the user selecting any video program, playing the selected video program. Exemplarily, the selection control of a plurality of video programs in the displayed interactive page can be displayed, and when the user selects any video program, the video playing interface is performed to play the selected video program. Figure 32 The displayed interactive page guides the user to watch a video program related to the selected recommended theme, and the embodiments of the present disclosure do not make any limitation in this regard.
[0111] In some embodiments, the user can also be encouraged to complete the interactive process through the entity image of the virtual digital person + emoji dynamic effect expression, thereby increasing the interest and emotionalization and improving the product experience. Therefore, the method further includes: displaying a dynamic effect expression symbol matched with the interactive process in the interactive page of the foreign language teaching scene, to encourage the user to complete the interactive process corresponding to the selected learning mode through the virtual digital person. The dynamic effect expression symbol can show an emotion matched with the current interactive process, for example, which can be consistent with the emotion of the user in the current interactive process. Exemplarily, the dynamic effect expression symbol can be displayed in the interactive page of the foreign language teaching scene, and when the user selects the learning mode, the dynamic effect expression symbol matched with the selected learning mode is displayed in the interactive page. Figure 34 Some dynamic effect expression symbols matched with the interactive process are shown, wherein, Figure 34 (1) in the above can be a dynamic effect expression symbol displayed when the follow-up pronunciation evaluation of the foreign language word fails and the user is guided to re-practice the word follow-up pronunciation, Figure 34 (2) in the above can be a dynamic effect expression symbol displayed when the user is guided to input the follow-up pronunciation by the voice input method, Figure 34 (3) or (4) in the above can be a dynamic effect expression symbol displayed when the follow-up pronunciation evaluation of the foreign language word passes. It should be understood that those skilled in the art can customize the form of the dynamic effect expression symbol in different situations in the interactive process according to actual needs, and the embodiments of the present disclosure do not make any limitation in this regard.
[0112] In order to provide an immersive companion experience for users by the virtual digital person, and improve the user experience, in some embodiments, the virtual digital person has at least one of the following forms in the process of providing the guidance service: speaking state, waiting state, loading speaking state, listening state, and evaluation feedback state. The speaking state is a state of broadcasting a guidance prompt (e.g., a voice broadcast of a prompt for explaining a foreign language word). The waiting state is a state of waiting for user feedback (e.g., after a round of reading aloud voice broadcast is completed, the user has no feedback, i.e., the user has no operation) or loading a page (i.e., waiting for a new interactive page to load). The loading speaking state is a state of switching a guidance prompt and loading (i.e., switching from the current guidance prompt to the next guidance prompt and loading the next guidance prompt). The listening state is a state of listening to user input of a follow-up reading voice. The evaluation feedback state is a state of broadcasting an evaluation prompt (i.e., broadcasting a sentence evaluation prompt or a word evaluation prompt).
[0113] Exemplarily, the virtual digital person in the speaking state can be in a form of mouth opening, small limb action amplitude, and front-facing screen viewing. The virtual digital person in the waiting state can be in a form of mouth closing, small limb action amplitude, deep thinking, or micro-motion (e.g., scratching head). The virtual digital person in the loading speaking state can be in a form of mouth closing, small limb action amplitude, and front-facing screen viewing. The virtual digital person in the listening state can be in a form of mouth closing, small limb action amplitude, and ear stretching and micro-nodding. The virtual digital person in the evaluation feedback state can be in a form of mouth opening, small limb action amplitude, and front-facing screen viewing. It should be understood that a person skilled in the art can design the form of the virtual digital person in different scenarios according to actual needs, and the embodiments of the present disclosure do not limit the form of the virtual digital person.
[0114] As described above, the client can be deployed on a television terminal. Considering that parents may want their children to enter the client's children's education module for learning at a specified time (e.g., 8 pm every day), without the parents' reminder or the parents' personally starting the client. Therefore, in some embodiments, the client further has a children's education reservation function, which is used to enable the television terminal to start the client and enter the children's education module at a specified time and complete an interactive process in a specified teaching scenario. The method further includes:
[0115] In a case where the client has enabled the children's education reservation function, the television terminal does not currently display the children's education interface, and the current time reaches the specified time, entering the children's education module of the client to make the television terminal display the children's education interface.
[0116] In response to the user completing the interactive process in the specified teaching scenario in the children's education module, switching back to the television interface originally displayed by the television terminal.
[0117] In actual application, an entry button of the children education reservation function can be provided in the client, and the parent user can enter the children education reservation page through the entry button, and in the children education reservation page, the parent user can set a specified time (for example, 8:00 pm every day) at which the child wants to learn, and also set a teaching scene (for example, a foreign language learning scene) at which the child wants to learn, to complete the setting of the children education reservation function. The embodiments of the present disclosure do not limit the setting interface and setting manner of the children education reservation function.
[0118] The current time reaching the specified time means that the current time of the television terminal reaches the specified time set by the user. The television terminal not currently displaying the children education interface can be that the television terminal does not start the client (for example, the television terminal currently displays a television channel interface), or that the client is started but currently displays an interface of another function module. Therefore, in the case that the user confirms to enable the children education reservation function, the television terminal currently does not display the children education interface, and the current time reaches the specified time, the entering of the children education module of the client can include: starting the client and entering the children education module, or switching from the interface of another function module of the client to the children education interface of the children education module, and the embodiments of the present disclosure do not limit this.
[0119] The television interface originally displayed by the television terminal can be understood as the television interface before entering the children education module of the client. For example, after the user completes the interaction process in the specified teaching scene (for example, completes the interaction process in the foreign language teaching scene) in the children education module, the television terminal switches back to the television channel interface originally displayed, or switches back to the interface of another function module of the client originally displayed by the television terminal, and the embodiments of the present disclosure do not limit this.
[0120] In the embodiments of the present disclosure, the children education reservation function can conveniently make the children user complete the specified teaching scene at a specified time, and improve the use experience of the parent user.
[0121] In some embodiments, the client can be respectively deployed on the television terminal and the mobile terminal (for example, the mobile phone of the parent user) of the specified user, and the clients respectively deployed on the television terminal and the mobile terminal can log in to the same user account. Therefore, in order to facilitate the parent user to view the learning progress of the child on the television terminal, or to enable the child to also learn on the mobile terminal, the method can further include:
[0122] Synchronizing the learning progress of the user in the client deployed on the television terminal to the client of the mobile terminal based on the same user account; and / or, synchronizing the learning progress of the user in the client deployed on the mobile terminal to the client of the television terminal; wherein the learning progress represents the learning situation of the user in the children education module.
[0123] It should be understood that when the clients respectively deployed on the television terminal and the mobile terminal are logged in the same user account, the data synchronization of the clients on the television terminal and the mobile terminal can be realized based on the user account, and thus the learning progress can be synchronized. For example, if the user completes some interactive processes of foreign words and foreign sentences on the client of the television terminal, the foreign words and foreign sentences on the mobile terminal are also in the state of completed interactive processes. The embodiments of the present disclosure do not make any limitation in this regard.
[0124] The picture and sound synchronized with the television terminal can also be displayed in real time on the mobile terminal, so that the parent can remotely and synchronously supervise the learning situation of the child through the mobile terminal.
[0125] In some embodiments, the client can also periodically count the learning situation of the child, for example, the accuracy of the follow-up reading voice, the practice time length of the words or sentences, the learning quantity of the words or sentences, the learning score, and the like, and generate a report for the parent to view.
[0126] In some embodiments, Figure 2 The child education interface shown in FIG. 9 can also include an "animation" entry button at ⑦, and the user can enter the interactive page of watching animation by clicking the entry button. The embodiments of the present disclosure do not make any limitation in this regard.
[0127] Figure 35 The schematic diagrams of the interactive interfaces in the horizontal screen mode or the vertical screen mode are also shown. It should be understood that the layout of different interfaces or pages in the child education module can be adjusted by the person skilled in the art according to the display ratio of the terminal device. The embodiments of the present disclosure do not make any limitation in this regard.
[0128] It should be noted that the above Figure 2 to Figure 35 The various interfaces or pages shown are some possible implementation manners provided by the embodiments of the present disclosure, and the embodiments of the present disclosure do not make any limitation on the specific layout, form style, and contained function modules in the interfaces or pages.
[0129] The children education interaction method according to the embodiment of the present disclosure supports multiple teaching scenes, namely, an AI chat scene, a science learning scene and a foreign language teaching scene, supports expansion, and also supports customizing a virtual digital person image. The foreign language teaching scene is further divided into two learning modes, namely, free conversation and conversation practice. The interaction process of the conversation practice mode includes a learning preparation process and a conversation practice teaching whole process. The learning preparation process includes processes such as learning mode selection, age information collection and theme preference selection. The conversation practice teaching whole process includes word explanation, word follow-up reading, whether word follow-up reading passes an evaluation model, word evaluation feedback if the word evaluation does not pass, sentence / scenario explanation if the word evaluation passes, sentence follow-up reading, whether sentence follow-up reading passes the evaluation model, sentence evaluation feedback if the sentence evaluation does not pass, and recommendation of related programs if the sentence evaluation passes.
[0130] The children education interaction method according to the embodiment of the present disclosure realizes an AI education intelligent agent system solution, collects situational, simple interaction and multi-modal characteristics, breaks through the traditional industry understanding, has an interesting and innovative interface, can sustainably extend different new service scenes through unique virtual digital person image interaction for children, and has growth and imagination space. The new foreign language teaching scene creates a whole new theme conversation English teaching link, provides English tutorial services in the form of immersive interaction with a virtual digital person, improves the user experience of the product through an evaluation model and emotional visual feedback (which can also be combined with emoji expression animation effects), and forms a unique children education service.
[0131] The children education interaction method according to the embodiment of the present disclosure has the following key technical innovations:
[0132] 1. Supporting customizing an AI digital person image (including a digital person image main body-animated star, IP action and IP voiceprint), having a personalized personality base, collecting user information through dialogue and question and answer, and continuously growing the dialogue and emotional expression ability through algorithm learning. There is no similar product in the industry at present, supporting commercial cooperation access of any copyright image, and having strong commercial value.
[0133] 2. Breaking through the industry understanding, building a whole new children education module with children emotional accompaniment as a demand, directly reaching the consumption through three simple levels, experiencing the link and product function through multi-scene immersive voice interaction, role-playing of a children intelligent model (the experience link and the product function correspond), meeting the interaction interest while the children easily understand.
[0134] 3. The first foreign language teaching scene is the theme of the dialogue teaching link, through the teaching knowledge-guiding evaluation-emotional learning feedback, with the "English teacher" role of the virtual digital person, the immersion of the English guide service is put forward, through the evaluation model, the visual emotional feedback is carried out, the digital person image has the characteristics of personality and dialogue expression ability, so as to improve the user experience and form the unique children's education service.
[0135] The embodiment of the present disclosure further provides a children's education interactive device, which comprises:
[0136] The main interface display module is used for displaying a children's education interface in response to the user selecting a children's education module in the client, the children's education interface comprising a virtual digital person and a selection control of at least one teaching scene, and the virtual digital person is used for providing guidance service;
[0137] The interactive page display module is used for entering an interactive page of the selected teaching scene in response to the user selecting any teaching scene, and performing an interactive process corresponding to the selected teaching scene in the interactive page, wherein the interactive page further comprises the virtual digital person, and the virtual digital person in the interactive page is used for guiding the user to complete the interactive process corresponding to the selected teaching scene.
[0138] In a possible implementation manner, the children's education interface further comprises a child lock control, the child lock control is used for setting a child lock, the child lock is used for locking the client in the children's education module in the locked state, and the device further comprises a child lock setting module, which is used for: in the case that the child lock is in the unlocked state, in response to the user clicking the child lock control, entering a child lock setting page, or in response to the user first performing an operation of exiting the children's education module, guiding the user to set the child lock through the virtual digital person, and entering the child lock setting page under the guidance of the virtual digital person.
[0139] In a possible implementation manner, the device further comprises a child lock verification module, which is used for: in the case that the child lock is in the locked state, in response to the user performing an operation of exiting the children's education module, entering a child lock verification page, so that the user performs a verification operation in the child lock verification page; in the case that the verification operation performed in the child lock verification page is successful, exiting the children's education module; or in the case that the verification operation performed in the child lock verification page fails, staying in the children's education module.
[0140] In a possible implementation, the apparatus further includes: a child lock closing and resetting module, configured to: in response to a user clicking the child lock control in a case where the child lock is in a locked state, perform, by the virtual digital human, a guided prompt for closing and / or resetting the child lock; in response to the user selecting to close the child lock under the guidance of the virtual digital human, enter a child lock verification page, and in a case where a verification operation performed on the child lock verification page is successful, return to the children education interface and switch the child lock to an unlocked state; or, in response to the user selecting to reset the child lock under the guidance of the virtual digital human, enter a parent identity verification page, and after verification on the parent identity verification page is successful, enter a child lock resetting page to perform a resetting operation on the child lock on the child lock resetting page, and in a case where the child lock is successfully reset, return to the children education interface and keep the child lock in the locked state.
[0141] In a possible implementation, the teaching scene includes a foreign language teaching scene, and the foreign language teaching scene includes at least one learning mode, and wherein the response to the user selecting any teaching scene includes: in response to the user selecting the foreign language teaching scene, entering an interactive page of the foreign language teaching scene, the interactive page of the foreign language teaching scene including a selection control of the at least one learning mode corresponding to the foreign language teaching scene; and in response to the user selecting any learning mode, performing an interactive process corresponding to the selected learning mode, and wherein the virtual digital human in the interactive page is further configured to guide the user to complete the interactive process corresponding to the selected learning mode.
[0142] In a possible implementation, the learning mode includes a dialogue practice mode, and the response to the user selecting any learning mode includes: in response to the user selecting the dialogue practice mode, the virtual digital human in the interactive page guiding the user to provide user information; in response to the user providing the user information, displaying a selection control of a plurality of recommended topics, the recommended topics being determined based on the user information; in response to the user selecting any recommended topic, performing a dialogue practice process corresponding to the selected recommended topic, the virtual digital human further guiding the user to complete the dialogue practice process; and wherein the dialogue practice process includes: a word practice process for practicing reading of foreign language words corresponding to the selected recommended topic, and a sentence practice process for practicing reading of foreign language sentences corresponding to the foreign language words.
[0143] In a possible implementation, the word practice procedure comprises: explaining, by the virtual digital human, foreign language words corresponding to the selected recommended theme; guiding, by the virtual digital human, the user to read the foreign language words by voice input, to obtain read voice of the foreign language words, and to evaluate the read voice of the foreign language words, to obtain a word evaluation result, the word evaluation result representing completeness and accuracy of the read voice of the foreign language words; outputting, by the virtual digital human, a word evaluation prompt, the word evaluation prompt being prompt information described in an encouraging expression manner and determined based on the word evaluation result; and wherein the word evaluation prompt is used to guide the user to re-read the foreign language words in a case where the word evaluation result represents that the read voice of the foreign language words fails, or to guide the user to enter the sentence practice procedure in a case where the word evaluation result represents that the read voice of the foreign language words passes.
[0144] In a possible implementation, the outputting, by the virtual digital human, of the word evaluation prompt comprises: adjusting a reading speed of the foreign language words in a case where the word evaluation result represents that the read voice of the foreign language words fails, and / or encouraging the user to re-read the foreign language words and outputting a correction suggestion for the read voice of the foreign language words, to guide the user to re-read the foreign language words; and / or guiding the user to enter the sentence practice procedure in a case where a number of times of failure of the read voice of the foreign language words reaches a specified threshold; or guiding the user to replace the foreign language words with foreign language words of a lower difficulty, to practice the replaced foreign language words.
[0145] In a possible implementation, the sentence practice procedure comprises: explaining, by the virtual digital human, a foreign language sentence corresponding to the foreign language words whose read voice passes the evaluation; guiding, by the virtual digital human, the user to read the foreign language sentence by voice input, to obtain read voice of the foreign language sentence, and to evaluate the read voice of the foreign language sentence, to obtain a sentence evaluation result, the sentence evaluation result representing completeness and accuracy of the read voice of the foreign language sentence; outputting, by the virtual digital human, a sentence evaluation prompt, the sentence evaluation prompt being prompt information determined based on the sentence evaluation result; and wherein the sentence evaluation prompt is used to guide the user to re-read the foreign language sentence in a case where the sentence evaluation result represents that the read voice of the foreign language sentence fails, or to guide the user to return to the word practice procedure to learn new foreign language words or to watch a video program related to the selected recommended theme in a case where the sentence evaluation result represents that the read voice of the foreign language sentence passes.
[0146] In a possible implementation, the outputting, by the virtual digital human, of the sentence evaluation prompt comprises: in a case where the sentence evaluation result indicates that the read-aloud speech of the foreign language sentence fails, adjusting the speed of the leading reading of the foreign language sentence, and / or encouraging the user to re-read the foreign language sentence and outputting a correction suggestion for the read-aloud speech of the foreign language sentence to guide the user to re-read the foreign language sentence; and / or in a case where the number of times of failure of the read-aloud speech of the foreign language sentence reaches a specified threshold, guiding the user to watch a video program related to the selected recommended theme; or guiding the user to replace the foreign language sentence with a lower difficulty and containing the same foreign language word, and practicing the replaced foreign language sentence.
[0147] In a possible implementation, the guiding the user to watch the video program related to the selected recommended theme comprises: displaying a selection control of a plurality of video programs, the plurality of video programs being related to the selected recommended theme; and in response to the user selecting any video program, playing the selected video program.
[0148] In a possible implementation, the apparatus further comprises an expression display module, configured to: display an animated expression symbol matched with an interactive process in an interactive page of the foreign language teaching scene, to cooperate with the virtual digital human to encourage the user to complete the interactive process corresponding to the selected learning mode.
[0149] In a possible implementation, the children education interface further comprises a virtual digital human switching control; and the apparatus further comprises a digital human setting module, configured to: in response to the virtual digital human switching control being clicked, enter a digital human setting page, the digital human setting page comprising virtual digital humans in a plurality of images; and in response to the user selecting any virtual digital human in an image, return to the children education interface and display the virtual digital human selected by the user in the children education interface.
[0150] In a possible implementation, the virtual digital human has at least one of the following states in the process of providing the guiding service: a speaking state, a waiting state, a loading speaking state, a listening state, and an evaluation feedback state. The speaking state represents a state of broadcasting a guiding prompt, the waiting state represents a state of waiting for user feedback or loading a page, the loading speaking state represents a state of switching a guiding prompt and loading, the listening state represents a state of listening to a read-aloud speech input by the user, and the evaluation feedback state represents a state of broadcasting an evaluation prompt.
[0151] In a possible implementation, the client is deployed on a television terminal, and the client further has a children education reservation function, which is configured to enable the television terminal to start the client and enter the children education module and complete an interactive process in a specified teaching scene at a specified time in an enabled state. The device further includes a children education reservation module, configured to: in a case where the client has enabled the children education reservation function, the television terminal does not currently display the children education interface, and the current time reaches the specified time, enter the children education module of the client to enable the television terminal to display the children education interface; and in response to a user completing an interactive process in a specified teaching scene in the children education module, switch back to a television interface originally displayed by the television terminal.
[0152] In a possible implementation, the client is respectively deployed on a television terminal and a mobile terminal of a specified user, and the clients respectively deployed on the television terminal and the mobile terminal are logged in a same user account. The device further includes a learning progress synchronization module, configured to: synchronize, based on the same user account, a learning progress of a user in the client deployed on the television terminal to the client of the mobile terminal, and / or synchronize a learning progress of a user in the client deployed on the mobile terminal to the client of the television terminal, where the learning progress represents a learning situation of the user in the children education module.
[0153] In some embodiments, the device provided by the embodiments of the present disclosure has functions or includes modules that can be used to execute the methods described in the above method embodiments, and the specific implementation can be referred to the description of the above method embodiments. For brevity, details are not described here.
[0154] The embodiments of the present disclosure further provide an electronic device, including a memory, a processor and a computer program stored in the memory, and the processor executes the computer program to implement the steps of the above method.
[0155] The embodiments of the present disclosure further provide a non-volatile computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the steps of the above method.
[0156] The embodiments of the present disclosure further provide a computer program product, including a computer program or a non-volatile computer readable storage medium carrying the computer program, and the computer program is executed by a processor to implement the steps of the above method.
[0157] Figure 36 A block diagram of an electronic device according to an embodiment of the present disclosure is shown. For example, the electronic device 1900 can be provided as a server or a terminal device. Referring to FIG. 19, the electronic device 1900 includes one or more processors 1910, memory 1920 and a bus 1940. Figure 36The electronic device 1900 includes a processing component 1922, which is further composed of one or more processors, and a memory resource represented by the memory 1932, for storing instructions executable by the processing component 1922, such as an application program. The application program stored in the memory 1932 can include one or more than one module each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute the instructions to perform the above method.
[0158] The electronic device 1900 can further include a power supply component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input / output interface 1958 (I / O interface). The electronic device 1900 can operate based on an operating system stored in the memory 1932, such as Windows Server TM , Mac OS X TM , Unix TM , Linux TM , FreeBSD TM or the like.
[0159] In an exemplary embodiment, a non-transitory computer readable storage medium, such as the memory 1932 including computer program instructions, is also provided, which can be executed by the processing component 1922 of the electronic device 1900 to complete the above method.
[0160] The computer readable storage medium can be a tangible device that can retain and store programs (instructions) for use by an instruction execution device. The computer readable storage medium, for example, can be, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium include: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanism that encodes instructions on a punch card or a hole in a punch card, and any suitable combination of the foregoing. The computer readable storage medium used here is not to be interpreted as a transitory signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission media (e.g., an optical pulse through a fiber-optic cable), or an electrical signal through a wire.
[0161] The computer program (or computer-readable program instructions) described herein can be downloaded from a computer-readable storage medium to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage medium in the respective computing / processing device.
[0162] The computer program (or computer program instructions) used to perform the operations of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages such as Smalltalk, C++, etc., and conventional procedural programming languages such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing state information from the computer-readable program instructions to implement various aspects of this disclosure.
[0163] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.
[0164] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium that can be a computer- readable storage medium having no data storage cycles that change state. The instructions can be executed by one or more processors of a computer, to cause a series of operational steps to be performed on the computer to produce a computer-implemented process. The instructions can also cause one or more processors of a computer or other programmable data processing apparatus to
[0165] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0166] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0167] Embodiments of the present disclosure have been described above, and the description is intended to be illustrative of the embodiments and not restrictive of the disclosure. Many modifications and variations of the described embodiments are possible in light of this disclosure. It is contemplated that the use of the terms "including," "comprising," "incorporating," "consisting of," "consisting essentially of," and the like, are intended to be open-ended. That is, the use of these terms is intended to encompass the presence of one or more elements or steps, but not exclude the presence of other elements or steps. It is also contemplated that the use of the terms "first," "second," "third," and the like, are intended to be descriptive and not to be limiting. That is, the use of these terms is intended to indicate the presence of one or more elements or steps, but not exclude the presence of other elements or steps.
Claims
1. A method for children's education interaction, characterized in that, The method comprises: in response to a user selecting a children's education module in a client, displaying a children's education interface, the children's education interface comprising a virtual digital human and a selection control of at least one teaching scene, the virtual digital human being configured to provide guidance services; in response to the user selecting any teaching scene, entering an interactive page of the selected teaching scene and performing an interactive process corresponding to the selected teaching scene in the interactive page, the interactive page further comprising the virtual digital human, the virtual digital human in the interactive page being configured to guide the user to complete the interactive process corresponding to the selected teaching scene.
2. The method of claim 1, wherein, The children's education interface further comprises a child lock control, the child lock control being configured to set a child lock, the child lock being configured to lock the client in the children's education module in a locked state, and the method further comprises: in a case where the child lock is in an unlocked state, in response to the user clicking the child lock control, entering a child lock setting page, or in response to the user first performing an operation of exiting the children's education module, the method further comprises:
3. The method of claim 2, wherein, in a case where the child lock is in the locked state, in response to the user performing an operation of exiting the children's education module, the method further comprises: in a case where the verification operation performed in the child lock verification page is successful, exiting the children's education module; or in a case where the verification operation performed in the child lock verification page fails, staying in the children's education module. The method further comprises:
4. The method of claim 2, wherein, in a case where the child lock is in the locked state, in response to the user clicking the child lock control, the method further comprises: in response to the user selecting to close the child lock under the guidance of the virtual digital human, entering the child lock verification page, and in a case where the verification operation performed in the child lock verification page is successful, returning to the children's education interface and switching the child lock to the unlocked state; or in response to the user selecting to reset the child lock under the guidance of the virtual digital human, entering a parent identity verification page, and after successful verification in the parent identity verification page, entering a child lock resetting page to perform a resetting operation of the child lock in the child lock resetting page, and in a case where the child lock is successfully reset, returning to the children's education interface and keeping the child lock in the locked state. The teaching scene comprises a foreign language teaching scene, and the foreign language teaching scene comprises at least one learning mode, and the method further comprises:
5. The method according to any one of claims 1 to 4, characterized in that, in response to the user selecting the foreign language teaching scene, entering an interactive page of the foreign language teaching scene, the interactive page of the foreign language teaching scene comprising selection controls of at least one learning mode corresponding to the foreign language teaching scene. In response to the user selecting any learning mode, an interactive process corresponding to the selected learning mode is performed, wherein the virtual digital person in the interactive page is further configured to guide the user to complete the interactive process corresponding to the selected learning mode.
6. The method of claim 5, wherein, The learning mode includes a dialogue practice mode, and the response to the user selecting any learning mode, the interactive process corresponding to the selected learning mode is performed, including: In response to the user selecting the dialogue practice mode, the virtual digital person in the interactive page guides the user to provide user information; In response to the user having provided the user information, a selection control of multiple recommended topics is displayed, the recommended topics being determined based on the user information; In response to the user selecting any recommended topic, a dialogue practice process corresponding to the selected recommended topic is performed, and the virtual digital person is further configured to guide the user to complete the dialogue practice process; The dialogue practice process includes a word practice process and a sentence practice process, the word practice process being configured to perform a follow-up reading practice on foreign language words corresponding to the selected recommended topic, and the sentence practice process being configured to perform a follow-up reading practice on foreign language sentences corresponding to the foreign language words.
7. The method of claim 6, wherein, The word practice process includes: The virtual digital person explains the foreign language words corresponding to the selected recommended topic; The virtual digital person guides the user to perform a follow-up reading of the foreign language words through a voice input mode to obtain a follow-up reading voice of the foreign language words, and evaluates the follow-up reading voice of the foreign language words to obtain a word evaluation result, the word evaluation result representing completeness and accuracy of the follow-up reading voice of the foreign language words; The virtual digital person outputs a word evaluation prompt, the word evaluation prompt being prompt information determined based on the word evaluation result; The word evaluation prompt is configured to guide the user to re-perform the follow-up reading of the foreign language words in a case where the word evaluation result represents that the follow-up reading voice of the foreign language words fails, or guide the user to enter the sentence practice process in a case where the word evaluation result represents that the follow-up reading voice of the foreign language words passes.
8. The method of claim 7, wherein, The virtual digital person outputs a word evaluation prompt includes: In a case where the word evaluation result represents that the follow-up reading voice of the foreign language words fails, adjusting a reading speed of the foreign language words, and / or encouraging the user to re-read the foreign language words and outputting a correction suggestion for the follow-up reading voice of the foreign language words to guide the user to re-perform the follow-up reading of the foreign language words; and / or In a case where a number of times of failure of the follow-up reading voice of the foreign language words reaches a specified threshold, guiding the user to enter the sentence practice process, or guiding the user to replace the foreign language words with foreign language words of a lower difficulty for practice.
9. The method of claim 6, wherein, The sentence practice process includes: The virtual digital person explains the foreign language sentences corresponding to the foreign language words whose follow-up reading voice passes; The virtual digital human guides a user to follow a foreign language sentence through voice input to obtain a follow-up voice of the foreign language sentence, and evaluates the follow-up voice of the foreign language sentence to obtain a sentence evaluation result, the sentence evaluation result representing completeness and accuracy of the follow-up voice of the foreign language sentence; The virtual digital human outputs a sentence evaluation prompt, the sentence evaluation prompt being prompt information determined based on the sentence evaluation result; The sentence evaluation prompt is used to guide the user to re-practice the foreign language sentence in a case where the sentence evaluation result represents that the follow-up voice of the foreign language sentence fails, or guide the user to return to the word practice process to learn new foreign language words, or guide the user to watch a video program related to a selected recommended theme in a case where the sentence evaluation result represents that the follow-up voice of the foreign language sentence passes.
10. The method of claim 9, wherein, The virtual digital human outputs a sentence evaluation prompt, the sentence evaluation prompt being prompt information determined based on the sentence evaluation result; In a case where the sentence evaluation result represents that the follow-up voice of the foreign language sentence fails, the speed of leading reading of the foreign language sentence is adjusted, and / or the user is encouraged to re-practice the foreign language sentence and a correction suggestion of the follow-up voice of the foreign language sentence is output to guide the user to re-practice the foreign language sentence; and / or, In a case where the number of times of failure of the follow-up voice of the foreign language sentence reaches a specified threshold, the user is guided to watch a video program related to a selected recommended theme, or the user is guided to replace the foreign language sentence with a lower difficulty and containing the same foreign language word to practice the replaced foreign language sentence.
11. The method according to any one of claims 5 to 10, characterized in that, The method further comprises: Displaying a dynamic emoji matching the interactive process in the interactive page of the foreign language teaching scene to cooperate with the virtual digital human to encourage the user to complete the interactive process corresponding to the selected learning mode.
12. The method of claim 1, wherein, The client is deployed on a television terminal, and the client further has a children education reservation function, the children education reservation function being used to enable the television terminal to start the client and enter the children education module and complete an interactive process in a specified teaching scene at a specified time in an enabled state, and the method further comprises: In a case where the client has enabled the children education reservation function, the television terminal does not currently display the children education interface, and the current time reaches the specified time, entering the children education module of the client to make the television terminal display the children education interface; In response to the user completing the interactive process in the specified teaching scene in the children education module, switching back to a television interface originally displayed by the television terminal.
13. The method of claim 1 or 12, wherein, The client is respectively deployed on a television terminal and a mobile terminal of a specified user, and the clients respectively deployed on the television terminal and the mobile terminal log in a same user account, and the method further comprises: Synchronizing, based on the same user account, learning progress of the user in the client deployed on the television terminal to the client of the mobile terminal, and / or synchronizing learning progress of the user in the client deployed on the mobile terminal to the client of the television terminal; The learning schedule represents a learning condition of the user in the children education module.
14. An electronic device comprising a memory, a processor, and a computer program stored on the memory, wherein the computer program, when executed by the processor, is arranged to perform the method of any one of claims 1 to 13. The processor executes the computer program to implement the steps of the method of any one of claims 1 to 13.
15. A non-transitory computer readable storage medium having stored thereon a computer program, characterized in that, The computer program, when executed by the processor, implements the steps of the method of any one of claims 1 to 13.
16. A computer program product comprising a computer program or a non-transitory computer readable storage medium bearing a computer program, characterized in that, The computer program, when executed by the processor, implements the steps of the method of any one of claims 1 to 13. The computer program, when executed by the processor, implements the steps of the method of any one of claims 1 to 13.
Citation Information
Patent Citations
Television presenting mode switching method and system
CN103796067A
Multimedia data synchronization method and device
CN106998490A
AI-based user interactive reading support method and system
CN113610681A
English word learning tool and use method thereof
CN118982947A
Reading ability improving device for children with reading disorder based on intelligent interactive design
CN119807117A