A virtual character teaching method, device, equipment and storage medium

Abstract

The present invention discloses a virtual character teaching method, apparatus, device, and storage medium, relating to the field of internet teaching technology. The method includes: determining a target teaching task matching the student based on the student's identity information; generating a virtual character mirror associated with the instructor based on the instructor's identity information and the target teaching task; and providing interactive instruction to the student on the target teaching task through the virtual character mirror. The technical solutions of the embodiments of the present invention can provide personalized instruction for each student through the virtual character mirror, enhancing the interest and learning effectiveness of online teaching.

Description

Technical Field

[0001] The present invention relates to the field of Internet teaching technology, and in particular to a virtual character teaching method, device, equipment and storage medium. Background Art

[0002] With the rapid development of internet technology, online teaching is becoming increasingly common. A common method of online teaching involves teachers conducting lectures through recorded or live broadcasts on a teacher client. Teachers often appear in real-life video, while students watch the lectures on a student client.

[0003] The above-mentioned online teaching method uses real-life video, so the course is less interesting. In addition, online courses are often taught uniformly by one teacher to multiple students, which cannot meet the personalized teaching needs of different students. Summary of the Invention

[0004] The present invention provides a virtual character teaching method, device, equipment and storage medium to solve the problem that online teaching is not interesting and cannot meet students' personalized teaching needs.

[0005] According to one aspect of the present invention, a virtual character teaching method is provided, comprising:

[0006] Determining target teaching tasks that match the students based on their identity information;

[0007] generating a virtual character image associated with the teacher based on the teacher's identity information and the target teaching task;

[0008] Through the virtual character mirror, the students are given interactive teaching for the target teaching task.

[0009] According to another aspect of the present invention, there is provided a virtual character teaching device, comprising:

[0010] A teaching task determination module, configured to determine a target teaching task that matches the student based on the student's identity information;

[0011] A virtual character image generation module is used to generate a virtual character image associated with the teacher based on the teacher's identity information and the target teaching task;

[0012] The virtual character teaching module is used to provide interactive teaching for the students on target teaching tasks through the virtual character mirror.

[0013] According to another aspect of the present invention, an electronic device is provided, comprising:

[0014] at least one processor; and

[0015] a memory communicatively connected to the at least one processor; wherein,

[0016] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the virtual character teaching method according to any embodiment of the present invention.

[0017] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the virtual character teaching method according to any embodiment of the present invention when executed.

[0018] The technical solution of the embodiment of the present invention determines the target teaching task corresponding to the student based on the identity information of the current student, and then generates a virtual character mirror corresponding to the teacher based on the identity information and the target teaching task. Finally, the virtual character mirror is used to provide interactive teaching for the students for the target teaching task. On the one hand, online teaching is conducted through the virtual character mirror, thereby improving the fun of online teaching. On the other hand, teaching tasks that match different students can be determined for each student, which can meet the different teaching needs of different students and realize personalized teaching.

[0019] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present invention, nor is it intended to limit the scope of the present invention. Other features of the present invention will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0021] Figure 1a is a flow chart of a virtual character teaching method provided according to an embodiment of the present invention;

[0022] Figure 1b This is a flowchart of a virtual character teaching method provided according to an embodiment of the present invention;

[0023] Figure 1c 1 is a schematic diagram of a virtual character teaching scenario provided by an embodiment of the present invention;

[0024] Figure 1d This is a schematic diagram of executing a practice task provided by an embodiment of the present invention;

[0025] Figure 2a is a flow chart of a virtual character teaching method provided according to an embodiment of the present invention;

[0026] Figure 2b is a schematic diagram of generating a virtual character model according to an embodiment of the present invention;

[0027] Figure 3 is a flow chart of a virtual character teaching method provided according to an embodiment of the present invention;

[0028] Figure 4 2 is a schematic structural diagram of a virtual character teaching system provided according to an embodiment of the present invention;

[0029] Figure 5 2 is a schematic structural diagram of a virtual character teaching device provided according to an embodiment of the present invention;

[0030] Figure 6 It is a structural diagram of an electronic device for implementing the virtual character teaching method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0031] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.

[0032] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0033] Figure 1aA flowchart of a virtual character teaching method is provided for an embodiment of the present invention. This embodiment is applicable to the case of providing personalized teaching to students through virtual character images. The method can be executed by a virtual character teaching device, which can be implemented in the form of hardware and / or software. The virtual character teaching device can be configured in various general-purpose computing devices, for example, the general-purpose computing device is a teacher client. Figure 1a As shown, the method includes:

[0034] S110. Based on the student's identity information, determine the target teaching task that matches the student.

[0035] Student identity information is used to identify students. This information is entered when students register for an account on the virtual character teaching platform. For example, this information includes the student's grade, required subjects, and student identity document (ID). It is important to note that the collection, storage, and use of student identity information are all authorized by the students, comply with relevant laws and regulations, and do not violate public order and good morals.

[0036] Targeted teaching tasks are teaching tasks that match students' current learning progress. Examples include upcoming courses, practice tasks, timed challenges, and task incentives. Before class, matching target teaching tasks are determined based on students' identity information, allowing for personalized instruction tailored to their specific needs.

[0037] In the embodiment of the present invention, Figure 1b As shown, when a student logs into the virtual character teaching platform, the identity information of the currently logged-in student is obtained, and then the target teaching task that matches the student is determined based on the identity information. Specifically, the student's learning progress data is searched in the learning situation database based on the student's identity information, and then the teaching task database is searched for a teaching task that matches the student's learning progress data based on the learning progress data as the target teaching task.

[0038] For the student side, after the student logs in to the virtual teaching platform, the student's identity information is obtained, and based on the identity information, the virtual role model that matches the current student is obtained from the virtual role database, and the teaching progress data is read through the student's matching academic situation database.

[0039] In a specific example, a student logs in to the virtual character teaching platform using an account and password, where the account can be a student ID. After the student successfully logs in, the student's learning progress data can be searched in the learning database based on the student ID. For example, if the student's selected subject is mathematics, the student's mathematics learning progress, including course progress and exercise progress, can be searched. After obtaining the student's learning progress data, the target teaching task that matches the learning progress data is determined in the teaching task database. For example, if the course progress is Chapter 2, Section 1, the course to be taught in the target teaching task is Chapter 2, Section 2.

[0040] S120: Generate a virtual character image associated with the teacher based on the teacher's identity information and target teaching tasks.

[0041] The virtual character mirror is a redundant copy generated based on the teacher's virtual character model. Figure 1c As shown, a teacher can copy multiple virtual character images through code, each virtual character image faces one student, and personalized teaching can be achieved for students.

[0042] A virtual character model is a three-dimensional image data generated based on the teacher's biometrics. Each teacher can generate multiple different virtual character models, each based on the teacher's biometrics with additional user customization. For example, virtual character model 1 is a cartoon version of the teacher wearing summer clothing, while virtual character model 2 is a cartoon version of the teacher wearing winter clothing and accessories such as a hat.

[0043] After the virtual character model is established, multiple teaching tasks can be matched with the virtual character models one by one to determine the corresponding relationship between the teaching tasks and the virtual character models. For example, in the mathematics subject, Chapters 1 to 4 correspond to Virtual Character Model 1, and Chapters 5 to 8 correspond to Virtual Character Model 2.

[0044] In an embodiment of the present invention, when a teacher logs into a virtual character teaching platform, the teacher's identity information is obtained, and then a virtual character image is generated based on the teacher's identity information and the target teaching task. Specifically, first, based on the teacher's identity information, at least one virtual character model that matches the teacher is determined. Further, based on the current target teaching task, a target virtual character model that matches the current target teaching task is determined from at least one virtual character model. Finally, rendering is performed based on the target virtual character model to generate a virtual character image associated with the teacher. Each virtual character image corresponds to a student, which facilitates targeted teaching for each student.

[0045] In a specific example, teacher A logs into the virtual teaching platform using an account and password, where the account is teacher A's ID. Based on this ID, a virtual character database is searched for at least one virtual character model that matches teacher A. Furthermore, if the current target teaching task is Chapter 1, Section 1 of a mathematics subject, then a target virtual character model that matches the target teaching task can be selected from the multiple virtual character models that match teacher A based on the correspondence between teaching tasks and virtual character models.

[0046] S130. Provide students with interactive teaching targeting target teaching tasks through virtual character mirroring.

[0047] In an embodiment of the present invention, after generating a virtual character image, interactive teaching is conducted with students based on the target teaching task. Specifically, interactive content associated with the target teaching task can be pre-read. For example, the target teaching task may include specific interactive content corresponding to the set course content in the course to be taught. During the course to be taught, if the set course content is triggered, interaction with students is conducted based on the interactive content that matches the set course content, thereby enhancing the fun of the class.

[0048] In addition to the courses to be taught, the target teaching tasks can also include practice tasks, such as Figure 1d As shown in the figure, according to the student's learning progress, the corresponding practice tasks are read from the practice task system database and published to the student client. After completing the practice, the student submits the practice results to the teacher's client, and the teacher can provide feedback and modify the student's completed practice results.

[0049] In a specific example, when explaining mathematics subjects through a virtual character mirror, after explaining the set course content, corresponding example pictures can be displayed, and interactive voice can be played to interact with students.

[0050] In addition, after receiving an interactive operation initiated by a student, the interactive content associated with the interactive operation can be executed. For example, if a student actively asks "I didn't understand question 3", the interactive operation of repeating question 3 can be executed based on this interactive operation.

[0051] In addition, the teacher can also control the virtual character mirror to execute the interactive content that matches the control command based on the control command issued by the teacher. For example, the teacher can send a control command to the virtual character mirror through facial expressions or gestures to control the virtual character mirror to execute the corresponding interactive operation.

[0052] The technical solution of the embodiment of the present invention determines the target teaching task corresponding to the student based on the identity information of the current student, and then generates a virtual character mirror corresponding to the teacher based on the identity information and the target teaching task. Finally, the virtual character mirror is used to provide interactive teaching for the students for the target teaching task. On the one hand, online teaching is conducted through the virtual character mirror, thereby improving the fun of online teaching. On the other hand, teaching tasks that match different students can be determined for each student, which can meet the different teaching needs of different students and realize personalized teaching.

[0053] Figure 2a This is a flowchart of a virtual character teaching method provided by an embodiment of the present invention. This embodiment further refines the above embodiment and provides specific steps for generating a virtual character image associated with the teacher based on the teacher's identity information and target teaching tasks, as well as specific steps before generating the virtual character image associated with the teacher. Figure 2a As shown, the method includes:

[0054] S210: Generate at least one virtual character model associated with the teacher based on the teacher's head image, and store the virtual character model and the teacher's identity information in a virtual character database in correspondence.

[0055] In this embodiment of the present invention, to create a virtual character model of an instructor, an image of the instructor's head is first captured. Furthermore, feature extraction is performed on the head image to obtain the instructor's head features. Finally, these head features are processed using 3D modeling software to generate 3D image data of the instructor.

[0056] After generating the 3D avatar data, the user can further initiate adjustments to facial details or accessories, such as enlarging the eyes, changing clothing, or adding accessories like glasses, hats, or scarves. Based on these user-initiated adjustments, at least one virtual character model corresponding to the instructor is generated. Finally, the at least one virtual character model and the instructor's identity information are stored in a virtual character database for subsequent online teaching.

[0057] Optionally, generating at least one virtual character model associated with the instructor based on the instructor's head image includes:

[0058] Extract features from the teacher's head image to obtain the teacher's facial feature data and action feature data;

[0059] Generate the three-dimensional image data of the teacher based on the facial feature data, and generate the teacher's action performance data based on the action feature data;

[0060] Generate virtual character data corresponding to the teacher based on the three-dimensional image data and action performance data;

[0061] In response to the user's data matching instruction, the virtual character data is adjusted to obtain at least one virtual character model associated with the teacher.

[0062] In this optional embodiment, a specific method of generating at least one virtual role model associated with the teacher based on the teacher's head image is provided: Figure 2b As shown, first, a three-dimensional structured light scan is performed on the instructor's head and movements. For example, images of the instructor's head and facial images with different expressions are captured at different angles, or 360-degree video images are captured around the instructor's head. Furthermore, feature extraction is performed on the head information captured by the head image to obtain the instructor's head features and movement feature data. Movement feature data primarily refers to facial expression data. Finally, mesh data is drawn based on the head feature data using three-dimensional modeling software to generate the instructor's three-dimensional image data. Based on the movement feature data, various movement performance data for the instructor are generated, such as smiling and blinking. Ultimately, the three-dimensional image data and movement performance data together constitute the instructor's virtual character data.

[0063] After generating the virtual character data, the user can further initiate data matching instructions to adjust the virtual character data. For example, fine-tuning the virtual character's facial features or adding accessories can be done to obtain multiple virtual character models associated with the teacher.

[0064] In addition, multiple virtual role models corresponding to the teacher can be further bound to the teaching tasks to facilitate the implementation of different teaching tasks, use different virtual role models for explanations, and improve the fun of online teaching.

[0065] S220. Based on the student's identity information, determine the target teaching task that matches the student.

[0066] S230: Determine, based on the identity information of the instructor, at least one virtual role model associated with the instructor in the virtual role database as a candidate virtual role model.

[0067] In an embodiment of the present invention, after a teacher logs into a virtual character teaching platform, at least one virtual character model associated with the teacher can be identified in a virtual character database as a candidate virtual character model based on the teacher's identity information. The virtual character database stores virtual character models associated with multiple teachers, with each teacher corresponding to one or more virtual character models, each of which is stored in association with the teacher's identity information.

[0068] S240: Determine a target virtual role model from at least one candidate virtual role model based on the target teaching task.

[0069] In an embodiment of the present invention, after determining at least one candidate virtual character model associated with the current teaching subject, a target virtual character model that matches the target teaching task is further determined from the at least one candidate virtual character model based on the target teaching task matched by the current student. Specifically, the correspondence between the teaching task and the virtual character model can be queried to determine the target virtual character model that matches the target teaching task.

[0070] S250: Generate a virtual role image associated with the teacher based on the target virtual role model; each virtual role image corresponds to one student.

[0071] In the embodiment of the present invention, a virtual character image associated with a teacher is generated based on a target virtual character model, wherein each virtual character image corresponds to a student, and a teacher can be associated with multiple virtual character images, thereby achieving personalized teaching for different students.

[0072] S260. Through virtual character mirroring, students are given interactive teaching targeting target teaching tasks.

[0073] The technical solution of the embodiment of the present invention extracts features from the teacher's head image and constructs a virtual character model corresponding to the teacher. Compared with the online teaching method with real people appearing on camera, it is more interesting. In addition, the virtual character image is jointly generated according to the teacher's identity information and the target teaching task. Different virtual character models can be used when conducting interactive teaching for different teaching tasks, thereby further improving the liveliness and interest of online classes.

[0074] Figure 3 This is a flowchart of a virtual character teaching method provided by an embodiment of the present invention. This embodiment further refines the above embodiment and provides specific steps for interactive teaching of the student for the target teaching task through the virtual character mirror, as well as specific steps for determining the target teaching task that matches the student based on the student's identity information. Figure 3 As shown, the method includes:

[0075] S310. Based on the student's identity information, read the student's course progress data from the learning database that matches the student.

[0076] A learning database is a database used to store students' learning progress. A learning database can be created for each student to facilitate personalized teaching based on the learning database. For example, the learning database can include learning data such as the student's course progress data, exercise progress, and exercise accuracy rate.

[0077] In an embodiment of the present invention, when a student logs into the virtual role teaching model, the student's identity information can be obtained, and then based on the student's identity information, the student's course progress data can be read from the learning situation database that matches the student.

[0078] S320. Determine target teaching tasks that match the students in the teaching task database based on the course progress data.

[0079] In an embodiment of the present invention, after reading a student's course progress data, a target teaching task that matches the student's course progress is determined in the teaching task database. For example, if the student's mathematics course progress is read as Chapter 1, Section 2, then the target teaching task that matches the student's course progress can be determined in the teaching task database as Chapter 1, Section 3.

[0080] S330: Generate a virtual character image associated with the teacher based on the teacher's identity information and target teaching tasks.

[0081] S340. Determine interactive content that matches the target teaching task.

[0082] In an embodiment of the present invention, before interactive teaching is conducted for a target teaching task, interactive content that matches the target teaching task may first be determined. For example, interactive content that matches the set course content may be determined based on the courses to be taught included in the target teaching task. For another example, interactive content that matches the interactive operation may be determined based on an interactive operation initiated by a student during online teaching of the target teaching task.

[0083] S350. Based on the interactive content, interactive teaching targeting target teaching tasks is provided to students through virtual character mirroring.

[0084] In an embodiment of the present invention, after determining interactive content that matches the target teaching task, the virtual character is rendered through a virtual character mirror and displayed on the screen, thereby providing students with interactive teaching targeted at the target teaching task. Specifically, during the interactive teaching process targeted at the target teaching task, if the set teaching content is triggered, interactive content that matches the set teaching content is searched, and interactive explanation of the set teaching content is provided based on the interactive content.

[0085] It is worth noting that after completing the interactive teaching of the target teaching task, the course progress data in the student’s matching learning database will be updated to avoid repeated explanations of the same course and to achieve personalized teaching based on each student’s learning progress.

[0086] Optionally, based on the interactive content, students can be provided with interactive instruction on the target teaching task through virtual character mirroring, including at least one of the following:

[0087] In the interactive teaching process for the target teaching task, in response to triggering the set teaching content, searching for interactive content that matches the set teaching content, and interactively explaining the set teaching content based on the interactive content;

[0088] In response to an interactive operation initiated by a student, executing interactive content associated with the interactive operation and providing feedback on the student's interactive operation;

[0089] In response to a control instruction initiated by the teacher for the virtual character image, the virtual character image is controlled to execute interactive content matching the control instruction.

[0090] This optional embodiment provides three specific methods for interactive teaching for students on target teaching tasks through virtual character mirroring based on interactive content: During the interactive teaching process for the target teaching task, if the set teaching content is triggered, interactive content that matches the set teaching content is searched. Then, interactive explanations of the set teaching content are conducted based on the interactive content. For example, the interactive content can be asking students questions and then providing targeted explanations based on their answers. It can also be corresponding teaching movements, voice, and background music.

[0091] In addition, during the interactive explanation of the target task, if an interactive action is received from a student, the interactive content associated with the interactive action is executed, and feedback on the student's interactive action is provided. For example, during the explanation, if a student initiates the interactive action "I didn't understand the third exercise" through voice, the interactive content associated with the interactive action can be determined to be the repeated explanation of the third exercise. At this time, the interactive content can be executed, and feedback on the student's interactive action can be provided.

[0092] In addition, when the teacher issues a control command to the virtual character image, the virtual character image is controlled to execute the interactive content that matches the control command. For example, the teacher can control the virtual character image to execute the interactive content that matches the control command through facial expressions or gestures.

[0093] Optionally, the embodiment of the present invention further includes: conducting an online conversation with at least one student by creating a virtual classroom.

[0094] In this optional embodiment, it is also possible to have an online conversation with at least one student by creating a virtual classroom. Specifically, communication is carried out through network transmission technology, for example, network transmission technology includes Hyper Text Transfer Protocol (HTTP) based on short links, and Transmission Control Protocol (TCP) based on long links. Specifically, a global chat server is established, and the data of each student is sent to the global chat server, which forwards the data to the terminals of other students to form an instant chat system. It is also possible to support one-on-one chat or establish a virtual classroom mode of chatting, which can be achieved by only requiring the global chat server to forward the data in groups.

[0095] The technical solution of the embodiment of the present invention determines the target teaching tasks that match the students based on the students' identity information, and then determines the interactive content that matches the target teaching tasks. Based on the interactive content, interactive teaching for the target teaching tasks is provided to the students through virtual character mirrors. Personalized teaching can be achieved based on the learning conditions of different students. Interactive teaching for students through virtual character mirrors can increase students' classroom participation, enhance learning interest, and optimize learning effects.

[0096] Figure 4 This is a schematic diagram of the structure of a virtual role teaching system provided by an embodiment of the present invention. Figure 4 As shown, the virtual character teaching system includes a virtual character generation module 1, a virtual character interaction module 2, a personalized teaching module 3 and a supporting communication component 4.

[0097] The virtual character generation module 1 is used to generate at least one virtual character model associated with the teacher according to the teacher's head image, and store the virtual character model and the teacher's identity information in a virtual character database in correspondence.

[0098] In addition, the virtual character generation module 1 communicates with the student's learning database and determines the student's target teaching task based on the student's learning progress data. It then generates a virtual character image associated with the teacher based on the teacher's identity information and the student's target teaching task; and it also generates a virtual character image associated with the student based on the student's identity information and the target teaching task.

[0099] The virtual character interaction model 2 is connected to the student's learning situation database and is used to provide students with interactive teaching for target teaching tasks through virtual character mirroring.

[0100] The personalized teaching module 3 includes a learning situation database associated with multiple students, which is used to record the learning situation of each student to achieve personalized teaching.

[0101] The supporting communication component 4 is used to conduct a threaded conversation with at least one student by creating a virtual teaching method.

[0102] The technical solution of the embodiment of the present invention determines the target teaching task corresponding to the student based on the identity information of the current student, and then generates a virtual character mirror corresponding to the teacher based on the identity information and target teaching task of the teacher. Finally, the virtual character mirror is used to provide interactive teaching for the students for the target teaching task. On the one hand, threaded teaching is carried out through the virtual character mirror to improve the fun of online teaching. On the other hand, teaching tasks matching different students can be determined for the students, which can meet the different teaching needs of different societies and realize personalized teaching.

[0103] Figure 5 This is a structural diagram of a virtual character teaching device provided by an embodiment of the present invention. Figure 5 As shown, the device includes:

[0104] A teaching task determination module 510 is configured to determine a target teaching task that matches the student based on the student's identity information;

[0105] A virtual character image generation module 520 is configured to generate a virtual character image associated with the teacher based on the teacher's identity information and the target teaching task;

[0106] The virtual character teaching module 530 is used to provide interactive teaching for the students on target teaching tasks through the virtual character image.

[0107] The technical solution of the embodiment of the present invention determines the target teaching task corresponding to the student based on the identity information of the current student, and then generates a virtual character mirror corresponding to the teacher based on the identity information and target teaching task of the teacher. Finally, the virtual character mirror is used to provide interactive teaching for the students for the target teaching task. On the one hand, threaded teaching is carried out through the virtual character mirror to improve the fun of online teaching. On the other hand, teaching tasks matching different students can be determined for the students, which can meet the different teaching needs of different societies and realize personalized teaching.

[0108] Optionally, the virtual character teaching device also includes:

[0109] A virtual character model building module is used to generate at least one virtual character model associated with the teacher based on the teacher's head image before generating the virtual character image associated with the teacher, and store the virtual character model and the teacher's identity information in a virtual character database in a corresponding manner;

[0110] The virtual character image generation module 520 is specifically used to:

[0111] determining, based on the identity information of the instructor, at least one virtual role model associated with the instructor in a virtual role database as a candidate virtual role model;

[0112] Based on the target teaching task, determining a target virtual character model from the at least one candidate virtual character model;

[0113] Based on the target virtual role model, a virtual role image associated with the teacher is generated; each virtual role image corresponds to a student.

[0114] Optional virtual character model building module, specifically used for:

[0115] Extract features from the teacher's head image to obtain the teacher's facial feature data and action feature data;

[0116] generating three-dimensional image data of the instructor based on the facial feature data, and generating action performance data of the instructor based on the action feature data;

[0117] Generating virtual character data corresponding to the teacher based on the three-dimensional image data and the action performance data;

[0118] In response to the user's data matching instruction, the virtual character data is adjusted to obtain at least one virtual character model associated with the teacher.

[0119] Optionally, the virtual character teaching module 530 includes:

[0120] An interactive content determination unit, configured to determine interactive content that matches the target teaching task;

[0121] The virtual character teaching unit is used to provide the students with interactive teaching for the target teaching task through the virtual character mirror according to the interactive content.

[0122] Optionally, the virtual character teaching unit is specifically configured to perform at least one of the following operations:

[0123] In the interactive teaching process for the target teaching task, in response to triggering the set teaching content, searching for interactive content matching the set teaching content, and interactively explaining the set teaching content based on the interactive content;

[0124] In response to an interactive operation initiated by a student, executing interactive content associated with the interactive operation and providing feedback on the student's interactive operation;

[0125] In response to a control instruction initiated by the teacher for the virtual character image, the virtual character image is controlled to execute interactive content matching the control instruction.

[0126] Optionally, the teaching task determination module 510 is specifically configured to:

[0127] Based on the student's identity information, read the student's course progress data from the learning database matching the student;

[0128] According to the course progress data, a target teaching task matching the student is determined in a teaching task database.

[0129] Optionally, the virtual character teaching device also includes:

[0130] The threaded conversation module is used to conduct a threaded conversation with at least one student by creating a virtual classroom.

[0131] The virtual character teaching device provided in the embodiment of the present invention can execute the virtual character teaching method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0132] In the technical solutions disclosed herein, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved comply with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0133] Figure 6 A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0134] like Figure 6As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., which is communicatively connected to the at least one processor 11. The memory stores a computer program that can be executed by the at least one processor. The processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 into the random access memory (RAM) 13. Various programs and data required for the operation of the electronic device 10 can also be stored in the RAM 13. The processor 11, ROM 12, and RAM 13 are connected to each other via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0135] Multiple components in the electronic device 10 are connected to the I / O interface 15, including an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0136] The processor 11 can be any general-purpose and / or specialized processing component with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the virtual character teaching method.

[0137] In some embodiments, the virtual character teaching method can be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the virtual character teaching method described above can be performed. Alternatively, in other embodiments, processor 11 can be configured to execute the virtual character teaching method in any other suitable manner (e.g., via firmware).

[0138] Various embodiments of the systems and techniques described above can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0139] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer program may be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0140] In the context of the present invention, computer-readable storage media can be tangible media that can contain or store a computer program for use with an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. Computer-readable storage media can include but are not limited to electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, computer-readable storage media can be machine-readable signal media. More specific examples of machine-readable storage media can include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0141] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0142] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0143] A computing system may include clients and servers. The clients and servers are typically remote from each other and typically interact via a communication network. This client-server relationship arises through computer programs running on the respective computers, creating a client-server relationship. The server may be a cloud server, also known as a cloud computing server or cloud host. This server is a hosting product within the cloud computing service ecosystem that addresses the management difficulties and limited scalability of traditional physical hosting and VPS services.

[0144] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in the present invention can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present invention can be achieved. This is not limited herein.

[0145] The above specific embodiments do not limit the scope of protection of the present invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention are intended to be included within the scope of protection of the present invention.

Claims

1. A virtual character teaching method, characterized in that: include: Determining target teaching tasks that match the students based on their identity information; generating a virtual character image associated with the teacher based on the teacher's identity information and the target teaching task; Conducting interactive teaching for target teaching tasks for the students through the virtual character mirror; Before generating the virtual character image associated with the teacher, the method further includes: generating at least one virtual character model associated with the teacher based on the teacher's head image, and storing the virtual character model and the teacher's identity information in a virtual character database in correspondence; the virtual character model is pre-bound to the teaching task; Generating a virtual character image associated with the teacher based on the teacher's identity information and the target teaching task, including: determining, based on the identity information of the instructor, at least one virtual role model associated with the instructor in a virtual role database as a candidate virtual role model; Based on the target teaching task, determining a target virtual character model from the at least one candidate virtual character model; Based on the target virtual role model, a virtual role mirror image associated with the teacher is generated; the virtual role mirror image is a redundant copy generated based on the teacher's virtual role model; each virtual role mirror image corresponds to one student; The interactive teaching for the target teaching task is carried out for the student through the virtual character mirror, including: Determine interactive content that matches the target teaching task; Based on the interactive content, interactive teaching for the target teaching task is provided to the student through the virtual character mirror; According to the interactive content, interactive teaching for the target teaching task is provided to the student through the virtual character mirror, including: In response to a control instruction initiated by the teacher for the virtual character image, the virtual character image is controlled to execute interactive content matching the control instruction.

2. The method according to claim 1, characterized in that Generating at least one virtual character model associated with the teacher according to the teacher's head image, including: Extract features from the teacher's head image to obtain the teacher's facial feature data and action feature data; generating three-dimensional image data of the instructor based on the facial feature data, and generating action performance data of the instructor based on the action feature data; Generating virtual character data corresponding to the teacher based on the three-dimensional image data and the action performance data; In response to the user's data matching instruction, the virtual character data is adjusted to obtain at least one virtual character model associated with the teacher.

3. The method according to claim 1, characterized in that Based on the interactive content, interactive teaching for the target teaching task is provided to the student through the virtual character mirror, including at least one of the following: In the interactive teaching process for the target teaching task, in response to triggering the set teaching content, searching for interactive content matching the set teaching content, and interactively explaining the set teaching content based on the interactive content; In response to an interactive operation initiated by a student, the interactive content associated with the interactive operation is executed, and feedback is provided to the student's interactive operation.

4. The method according to claim 1, wherein Based on the student's identity information, determine the target teaching task that matches the student, including: Based on the student's identity information, read the student's course progress data from the learning database matching the student; According to the course progress data, a target teaching task matching the student is determined in a teaching task database.

5. The method according to any one of claims 1 to 4, characterized in that: Also includes: Start a threaded conversation with at least one student by creating a virtual classroom.

6. A virtual character teaching device, characterized in that: include: A teaching task determination module, configured to determine a target teaching task that matches the student based on the student's identity information; A virtual character image generation module is used to generate a virtual character image associated with the teacher based on the teacher's identity information and the target teaching task; A virtual character teaching module is used to provide interactive teaching for the students on target teaching tasks through the virtual character mirror; The virtual character teaching device also includes: A virtual character model construction module is configured to generate at least one virtual character model associated with the teacher based on the teacher's head image before generating the virtual character image associated with the teacher, and store the virtual character model and the teacher's identity information in a virtual character database in a corresponding manner; the virtual character model is pre-bound to the teaching task; The virtual character image generation module is specifically used for: According to the identity information of the instructor, determining at least one virtual role model associated with the instructor in a virtual role database as a candidate virtual role model; Based on the target teaching task, determining a target virtual character model from the at least one candidate virtual character model; Based on the target virtual role model, a virtual role mirror image associated with the teacher is generated; the virtual role mirror image is a redundant copy generated based on the teacher's virtual role model; each virtual role mirror image corresponds to one student; The virtual character teaching module includes: An interactive content determination unit, configured to determine interactive content that matches the target teaching task; A virtual character teaching unit, configured to provide the student with interactive teaching for the target teaching task through the virtual character image based on the interactive content; The virtual character teaching unit is specifically used for: In response to a control instruction initiated by the teacher for the virtual character image, the virtual character image is controlled to execute interactive content matching the control instruction.

7. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor. The computer program is executed by the at least one processor so that the at least one processor can execute the virtual character teaching method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the virtual character teaching method according to any one of claims 1 to 5 when executed.

Images