Distance learning system, distance learning providing method, and distance learning providing program

Abstract

To provide a distance learning system, a distance learning providing method, and a distance learning providing program capable of improving visual effects for intercommunication via an avatar.SOLUTION: A distance learning system provides distance learning using learning content developed on a virtual space. At least one processor of the distance learning system is configured to: set an avatar object of a user who is an instructor or a student; obtain motion information of the user from a user terminal connected to the virtual space over a network; create actual motion animation of the avatar object based on the obtained motion information; and display the actual motion animation together with the learning content on the virtual space.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to a correspondence course system, a correspondence course providing method, and a correspondence course providing program. [Background technology]

[0002] In recent years, in the field of distance learning using virtual spaces, the introduction of highly effective educational methods that take advantage of the freedom of expression in virtual spaces has been considered. For example, it is known that by allowing students to participate in virtual spaces using avatars dressed as their favorite characters, active participation in classes is encouraged and learning outcomes are improved. Furthermore, in the field of early childhood education such as "intellectual training," it is expected that by giving instructors' avatars a unique appearance that attracts children's attention, children will be able to overcome their shyness and improve their learning outcomes.

[0003] Patent document 1 discloses a content control system that acquires original image data of a teacher teaching a lesson in front of a blackboard, creates motion data showing the teacher's movements based on the original image data, and determines the specifications of an avatar corresponding to the teacher based on the motion data. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-06977 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the technology described in Patent Document 1 outputs educational content data in which an avatar is positioned differently from the teacher during a lesson. Therefore, the student user is presented with both the image of the teacher teaching in real space and an image of the avatar, which may make it difficult for the user to achieve a visual effect of communicating through the avatar object.

[0006] The present invention has been made to solve the above-mentioned problems, and aims to provide a distance learning system, a distance learning provision method, and a distance learning provision program that can enhance the visual effect for users to communicate through avatar objects when taking distance learning courses using learning content deployed in a virtual space. [Means for solving the problem]

[0007] A correspondence education system according to a first aspect of the present invention is a correspondence education system that provides correspondence education using learning content deployed in a virtual space, and is equipped with at least one processor, which sets an avatar object of a user on the instructor's side or the student's side, acquires movement information of the user from a user terminal connected to the virtual space via a network, creates a real-life movement animation of the avatar object based on the acquired movement information, and displays the real-life movement animation in the virtual space together with the learning content.

[0008] According to a first aspect of the distance learning system, user movements are acquired from a user terminal connected to a virtual space via a network, and an animation of the actual movements of an avatar object is created based on the acquired movements. The animation of the actual movements of the avatar object based on the movements of the user on the instructor's or student's side is then displayed in the virtual space along with the learning content. This enhances the visual effect of users communicating through the avatar object when participating in a distance learning course using learning content deployed in the virtual space.

[0009] In a distance learning system according to a second aspect of the present invention, in the configuration described in the first aspect, the at least one processor creates a planned action animation of the avatar object relating to a predetermined planned action, and when a predetermined operation is performed on the user terminal, the avatar object in the virtual space is switched from the actual action animation to the planned action animation and displayed.

[0010] According to the distance learning system of the second aspect, when a predetermined operation is performed on a user terminal, the avatar object in the virtual space is switched from an actual action animation to a scheduled action animation. Therefore, for the scheduled actions set in advance, a part of the communication can be substituted by an animation with a high dramatic effect. This enhances the visual effect of the user communicating through the avatar object.

[0011] A correspondence education system according to a third aspect of the present invention is configured as described in the second aspect, wherein the at least one processor switches the avatar object back to the actual action animation when the planned action animation ends.

[0012] According to the distance learning system of the third aspect, when the planned movement animation of the avatar image ends in the virtual space, it switches back to the actual movement animation, thereby allowing the avatar object's movements to naturally incorporate not only the user's actual movements but also the preset planned movements.

[0013] A correspondence education system according to a fourth aspect of the present invention has the configuration according to the second or third aspect, wherein the scheduled actions include a reaction action indicating an emotion of the user.

[0014] According to the correspondence education system of the fourth aspect, by setting reaction actions that indicate the user's emotions as scheduled actions, it is possible to richly express the user's emotions through the avatar object in the virtual space.

[0015] A correspondence education system according to a fifth aspect of the present invention has the configuration described in the second or third aspect, in which the scheduled action includes an action of operating a specified object included in the study content.

[0016] According to the correspondence education system of the fifth aspect, by setting an action of operating a specific object included in learning content as a scheduled action, communication using objects in a virtual space can be facilitated.

[0017] A correspondence education system according to a sixth aspect of the present invention has the configuration according to the second or third aspect, wherein the scheduled motion includes a repetitive motion that repeats a predetermined motion pattern.

[0018] According to the sixth aspect of the distance learning system, by setting a repetitive action that repeats a predetermined movement pattern as a scheduled action, it is possible to have the avatar object repeat the predetermined movement pattern and wait, for example, in situations where active mutual communication is not required, thereby reducing the user's fatigue caused by the user's actual movements always being reflected in the movements of the avatar object.

[0019] A correspondence education system according to a seventh aspect of the present invention has the configuration according to the first or second aspect, wherein the avatar object is an arbitrary object set in advance by the user.

[0020] According to the correspondence course system of the seventh aspect, a user can set any object as an avatar object and communicate in a virtual space.

[0021] The distance learning system according to the eighth aspect of the present invention has the configuration described in the first or second aspect, in which the avatar object is one of the objects pre-set as objects included in the learning content.

[0022] According to the correspondence education system of the eighth aspect, a user can set one of the objects that are preset as objects included in study content as an avatar object, and communicate in a virtual space.

[0023] A ninth aspect of the present invention is a method for providing distance learning using learning content deployed in a virtual space, which method includes setting an avatar object of a user on the instructor's side or the student's side, acquiring movement information of the user from a user terminal connected to the virtual space via a network, creating a real-life movement animation of the avatar object based on the acquired movement information, and displaying the real-life movement animation together with the learning content in the virtual space.

[0024] A correspondence education provision program according to a tenth aspect of the present invention is a correspondence education provision program for providing correspondence education using learning content deployed in a virtual space, which causes a computer to execute the following processes: setting an avatar object of a user on the instructor's side or the student's side, acquiring movement information of the user from a user terminal connected to the virtual space via a network, creating a real-life movement animation of the avatar object based on the acquired movement information, and displaying the real-life movement animation together with the learning content in the virtual space. [Effects of the Invention]

[0025] As described above, the distance learning system, distance learning provision method, and distance learning provision program of the present invention can enhance the visual effect of users communicating through avatar objects when taking distance learning courses using learning content deployed in a virtual space. [Brief explanation of the drawings]

[0026] [Figure 1] 1 is a diagram illustrating an example of a correspondence education system according to an embodiment of the present invention. [Figure 2] FIG. 1 is a diagram illustrating an example of a hardware configuration related to a correspondence education system according to an embodiment of the present invention. [Figure 3] FIG. 2 is a diagram illustrating an example of a functional configuration related to content creation processing of the correspondence education system according to the present embodiment. [Figure 4] FIG. 2 is a diagram showing an example of a display screen of the content production device according to the present embodiment. [Figure 5] FIG. 2 is a diagram illustrating an example of a functional configuration related to an avatar object display process and a content execution process of the correspondence education system according to the present embodiment. [Figure 6] FIG. 10 is a flowchart illustrating an example of the operation of an avatar object display process in the correspondence education system according to the present embodiment. [Figure 7] FIG. 10 is a flowchart illustrating an example of the operation of a content execution process of the correspondence education system according to the present embodiment. [Figure 8] FIG. 10 is a diagram showing an example in which an avatar object is displayed together with learning content deployed in a virtual space. [Figure 9] FIG. 9 is a diagram showing an example of the progression of a scenario in the study content of FIG. 8.

[0027] A distance learning system 1 according to this embodiment will be described below with reference to FIGS. 1 to 9. The distance learning system 1 according to this embodiment is a computer system that distributes learning content to users. Content is information provided by a computer or computer system that can be recognized by humans. Electronic data representing the content is called content data. The content may be expressed in any format. The content may be expressed, for example, as an image (e.g., a photograph, a video, etc.), a document, audio, music, or a combination of any two or more of these elements. Learning content can be used for various forms of information transmission or communication used for learning. Learning content can be used in various situations or for various purposes, such as entertainment, news, intellectual training, education, medical care, games, chat, business transactions, lectures, seminars, and training. Learning content is content distributed by instructor users to student users. An instructor is someone who teaches academics, arts, etc., and a student is someone who receives that instruction. An instructor is an example of a distributor, and a student is an example of a viewer. An instructor may or may not have a teaching license. The age and affiliation of the instructor and the student are not limited, and therefore the purpose and usage of the learning content are not limited. For example, the learning content may be used in various schools, such as nursery schools, kindergartens, elementary schools, junior high schools, high schools, universities, graduate schools, vocational schools, preparatory schools, and online schools, or may be used in places or situations other than schools, such as at home. In this regard, the learning content may be used for various purposes, such as intellectual development, early childhood education, compulsory education, higher education, and lifelong learning. Distribution is the process of transmitting information to users via a communication network or a broadcasting network.

[0028] The distance learning system 1 provides study content to users by transmitting content data to user terminals 30 (30A, 30B). In this embodiment, the study content is expressed using at least images displayed in a virtual space. That is, the content data includes at least a content image representing the study content. A content image is an image that allows a person to recognize some information through their eyesight. The content image may be a moving image (video) or a still image.

[0029] In one example, the content image represents a virtual space in which multiple objects exist. The multiple objects are virtual objects. A virtual object is an object that does not exist in the real world and is represented only on a computer system. A virtual object is represented by two-dimensional or three-dimensional computer graphics (CG) using image materials independent of live-action images. The method of representing a virtual object is not limited. For example, a virtual object may be represented using animation materials, or may be represented based on live-action images to resemble the real thing. A virtual space is a virtual two-dimensional or three-dimensional space represented by an image displayed on a computer. A content image is, for example, an image showing a landscape seen from a virtual camera set in the virtual space.

[0030] In this embodiment, an example of a virtual object is an avatar object, which represents a user. The avatar object is not the actual person photographed, but is represented by two-dimensional or three-dimensional computer graphics (CG) using image materials independent of the original image. The method of representing the avatar object is not limited. For example, the avatar object may be represented with a unique appearance using animation materials, or may be represented in a realistic manner based on a live-action image. The avatar object may be any object preset by the user, or may be one of the objects preset as objects included in the learning content. Users can communicate information to other users and communicate with them via avatars placed in a virtual space. Users can also experience augmented reality (AR), virtual reality (VR), or mixed reality (MR) by viewing content images of the learning content displayed in the virtual space.

[0031] (Overall system overview) FIG. 1 is a diagram showing an example of application of the correspondence education system 1 according to the embodiment of FIG. In this embodiment, the correspondence education system 1 includes a server 10, a content creation device 20, and user terminals 30 (30A, 30B). In the correspondence education system 1, the server 10, the content creation device 20, and the user terminals 30 are connected via a network N.

[0032] Server 10 is a server computer and has a content database 14B in which study content is registered. Server 10 also has a user database 14C in which various user information is registered. Server 10 distributes study content to user terminal 30 in response to a request from the user terminal 30. Server 10 also creates animations of avatar objects corresponding to the user's movements in response to a request from the user terminal, and displays the animations in the virtual space together with the study content.

[0033] Content creation device 20 is a computer used to create study content. The content created by content creation device 20 is transmitted to server 10 and registered in content database 14B.

[0034] User terminal 30 is a computer used by a user who uses content. In one example of this embodiment, the users correspond to an instructor who distributes study content and a student who uses the study content under the instructor's guidance. In FIG. 1, the terminal used by the instructor's user is shown as user terminal 30A, and the terminal used by the student's user is shown as user terminal 30B.

[0035] (System hardware configuration) FIG. 2 is a diagram showing an example of a hardware configuration related to the correspondence education system 1. As shown in FIG.

[0036] (Server 10) As an example, the server 10 includes, as its hardware configuration, a CPU (Central Processing Unit: processor) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a storage unit 14, an input unit 15, a display unit 16, and a communication unit 17. Each component is connected to each other via a bus 18 so as to be able to communicate with each other.

[0037] The CPU 11 as a processor is a central processing unit that executes an operating system and application programs. The CPU 11 reads the programs from the ROM 12 or the storage unit 14 and executes the programs using the RAM 13 as a work area. The CPU 11 controls the above components and performs various arithmetic operations in accordance with the programs recorded in the ROM 12 or the storage unit 14.

[0038] The ROM 12 stores various programs and various data. The RAM 13 serves as a working area for temporarily storing programs or data.

[0039] The storage unit 14 is configured with a storage device such as a hard disk drive (HDD), a solid state drive (SSD), or flash memory, and stores various programs and data. The storage unit 14 stores a server program 14A that causes the CPU 11 to execute an avatar display process and a content execution process, which will be described later. The storage unit 14 also stores a content database 14B in which study content is registered, and a user database 14C in which images of avatar objects corresponding to users are registered.

[0040] The input unit 15 includes a pointing device such as a mouse, a keyboard, a microphone, a camera, and the like, and is used to perform various inputs.

[0041] The display unit 16 is, for example, a liquid crystal display, and displays various information. The display unit 16 may function as the input unit 15 by adopting a touch panel system.

[0042] The communication unit 17 is an interface for communicating with other devices. For this communication, for example, a wired communication standard such as Ethernet (registered trademark) or FDDI, or a wireless communication standard such as 4G, 5G, Bluetooth (registered trademark), or Wi-Fi (registered trademark) is used. The communication unit 17 is connected to a network N.

[0043] (Content creation device 20) The content creation device 20 includes, as its hardware configuration, a CPU 21, a ROM 22, a RAM 23, a storage unit 24, an input unit 25, a display unit 26, and a communication unit 27. Each component is connected via a bus 28 so as to be able to communicate with each other.

[0044] The CPU 21 is a central processing unit that executes an operating system and application programs. The CPU 21 reads the programs from the ROM 22 or the storage unit 24, and executes the programs using the RAM 23 as a working area.

[0045] The ROM 22 stores various programs and various data. The RAM 23 serves as a working area for temporarily storing programs or data.

[0046] The storage unit 24 is configured with a storage device such as an HDD, SSD, or flash memory, and stores various programs and various data. The storage unit 24 stores a creator program 24A that causes the CPU 21 to execute a content creation process, which will be described later.

[0047] The input unit 25 includes a pointing device such as a mouse, a keyboard, a microphone, a camera, and the like, and is used to perform various inputs.

[0048] The display unit 26 is, for example, a liquid crystal display, and displays various information. The display unit 26 may function as the input unit 25 by adopting a touch panel system.

[0049] The communication unit 27 is an interface for communicating with other devices and is connected to a network N.

[0050] (User terminal 30) The user terminal 30 includes, as its hardware configuration, a CPU 31, a ROM 32, a RAM 33, a storage unit 34, an input unit 35, a display unit 36, and a communication unit 37. Each component is connected to each other via a bus 38 so as to be able to communicate with each other.

[0051] The CPU 31 is a central processing unit that executes an operating system and application programs. The CPU 31 reads the programs from the ROM 32 or the storage unit 34, and executes the programs using the RAM 33 as a working area.

[0052] The ROM 32 stores various programs and various data. The RAM 33 serves as a working area for temporarily storing programs or data.

[0053] The storage unit 34 is configured by a storage device such as an HDD, an SSD, or a flash memory, and stores various programs and various data.

[0054] In the user terminal 30A used by the instructor-side user, an instructor-side application 34A executed by the CPU 31 is stored in the storage unit 34. That is, the user becomes the instructor-side user by executing the instructor-side application 34A on the user terminal 30A.

[0055] In the user terminal 30B used by the student user, a student application 34B executed by the CPU 31 is stored in the storage unit 34. That is, the user becomes a student user by executing the student application 34B on the user terminal 30A.

[0056] The instructor-side application 34A and the student-side application 34B may be referred to as a program.

[0057] The input unit 35 includes a pointing device such as a mouse, a keyboard, a microphone, a sensor, a camera, etc., and is used to perform various inputs. In this embodiment, as an example, the camera included in the input unit 35 captures an image of the user, and based on the captured image, motion information of the user (for example, line of sight, movement of the user's head, movement of parts of the user's body other than the head (for example, hands, etc.) (so-called gestures), facial expressions, etc.) is obtained. Note that this motion information may be user motion data detected by a sensor such as a gyro sensor or an acceleration sensor.

[0058] The display unit 36 is, for example, a liquid crystal display, and displays various information. The display unit 26 may function as the input unit 35 by adopting a touch panel system.

[0059] The communication unit 37 is an interface for communicating with other devices and is connected to a network N.

[0060] (System functional configuration related to content creation processing) 3 is a diagram showing an example of a functional configuration related to content creation processing of the correspondence education system 1. The content creation processing is processing in which learning content is created by the content creation device 20 and transmitted to the server 10.

[0061] The server 10 includes, as functional components related to the content creation process, a receiving unit 101 and a content registration unit 102. The receiving unit 101 receives learning content data transmitted from the content creation device 20. The content registration unit 102 stores (registers) the received learning content data in the content database 14B.

[0062] The content creating device 20 includes a content element registration unit 201, an operation information acquisition unit 202, a content setting unit 203, and a transmission unit 204 as functional components related to content creating processing.

[0063] The content element registration unit 201 stores (registers) data of content elements that make up study content in the storage unit 24. Content elements include, for example, data of objects deployed in a virtual space, text data, background data, etc.

[0064] The operation information acquisition unit 202 acquires operation information of a user on the content creator side. Specifically, the operation information acquisition unit 202 acquires input information input to the input unit 25 of the content creating device 20 as operation information.

[0065] The content setting unit 203 sets the study content based on the operation information acquired by the operation information acquisition unit 202 .

[0066] In one example of this embodiment, the study content can be configured to include multiple chapters associated with specific study scenes. The study content progresses by switching study scenes, for example, by moving from one chapter to another. The definition of a study scene is not limited. For example, in study content that provides fairy tales to read aloud in early childhood education, a study scene may constitute one scene from the fairy tale. Furthermore, in study content that provides an experience in a virtual space themed around a specific era or a specific worldview, each study scene may constitute a specific location on a map within the virtual space. Furthermore, in study content that provides learning materials provided by a test-taking institution such as a cram school, each study scene may correspond to a study item in the learning materials.

[0067] The content setting unit 203 has a function of setting at least one event for each chapter. Each event is an event related to the progress of the learning content, and includes, for example, switching between learning scenes. Furthermore, an event related to the progress of the learning content may be an event that is triggered within the same learning scene to elicit a response from the student user. In this case, the instructor user is provided with the student user's response as information for making decisions about the progress of the learning content.

[0068] The content setting unit 203 also has the function of setting the order of chapters in the study content and the required time for each chapter. The study content can switch study scenes by moving to the next chapter when a preset required time for the current chapter has elapsed.

[0069] The content setting unit 203 can set multiple objects and backgrounds included in each chapter. The content setting unit 203 also has a function of setting a specific object, among the objects included in the learning content as a virtual object, as an execution object that will trigger an event.

[0070] The content setting unit 203 also has a function of setting a predetermined object, which is included in the learning content as a virtual object, as an avatar object. The object set as an avatar object is displayed by animation based on the corresponding user's motion information by executing an avatar object display process described later.

[0071] The execution objects and avatar objects included in the learning content are set in advance by a user on the content creator side.

[0072] The content setting unit 203 has a function of setting a predetermined condition for triggering an event. For example, the event may be triggered when an execution object included in the learning content is operated via the user terminal 30 of the instructor or the student.

[0073] Note that operations on an execution object performed via the user terminal 30 include touch operations, position movement operations, and display orientation change operations, and one or a combination of these operations can be set as a predetermined condition for triggering an event. That is, an event can be triggered by an operation directly performed on an object in the virtual space via the user terminal 30.

[0074] In this embodiment, it is possible to set an instructor object, a student object, and a mutual object as the execution object. The instructor object is an object that can be operated via the instructor-side application 34A, and can initiate an event triggered by an operation by a user on the instructor side. The student object is an object that can be operated via the student-side application 34B, and can initiate an event triggered by an operation by a user on the student side. The mutual object is an object that can be operated from both the instructor-side application 34A and the student-side application 34B.

[0075] The content setting unit 203 can also set a predetermined time on the timeline within a chapter at which an event is to be triggered, and set the event to be triggered when the predetermined time has passed within the chapter. This allows the scenario to progress even if no operation is performed on the execution object.

[0076] In this way, the study content of this embodiment can set multiple conditions for triggering events using the functions of the content setting unit 203. This allows the progress of the study content to be actively changed depending on the involvement of the instructor or student in the study content.

[0077] The transmitting unit 204 transmits the study content created by the content setting unit 203 to the server 10.

[0078] (Content creation process behavior) An example of the operation of the content creation process will be described with reference to Fig. 4. Fig. 4 shows an example of a display screen displayed on content creation device 20 when creating study content. The content creation process is performed by CPU 21 reading creator program 24A from storage unit 24, expanding it in RAM 23, and executing it.

[0079] 4, a chapter selection section 401 for selecting a chapter being created is provided at the top of the display screen 400. The user selects an arbitrary chapter from the chapters displayed in the chapter selection section 401 by performing an input operation on the input section 25, and sets the selected chapter.

[0080] The display screen 400 also has a first operation field F1 to a third operation field F3 as operation areas. The first operation field F1 displays content elements 402 registered in advance by a user on the content creator side. The second operation field F2 displays a learning scene of the learning content corresponding to the selected chapter. In the content creation process, for example, by a drag-and-drop operation using a pointing device such as a mouse, any content element 402 moved from the first operation field F1 to the second operation field F2 is set as an object or event included in the selected chapter. In the example shown in the figure, a first balloon Q1, a second balloon Q2, a character object P1, and other content elements 402 are displayed in the first operation field F1. The example shows a case where the first balloon Q1 is moved from the first operation field F1 to the second operation field F2 by a drag-and-drop operation and set as an object included in chapter 1.

[0081] As shown in FIG. 4, the content element 402 (shown as the first balloon Q1 in the figure) moved to the second operation field F2 is displayed as a list in the third operation field F3. The user can select any content element in the third operation field F3 and set the details of the selected content element. For example, by operating the third operation field F3, a specific object included in any learning content can be set as an execution object that triggers an event or as an avatar object for the instructor or student user. When an execution object is set, a specific operation that triggers the event can be set for the execution object from among operations that can be performed via the student or instructor's user terminal. Furthermore, the user can select any event in the third operation field F3 and set a specific time at which the selected event will be triggered on the timeline within the chapter.

[0082] After completing the setting work for the multiple chapters included in the study content, the user performs an operation to instruct the sending of the study content, whereby the created study content is sent to the server 10, and the content creation process is completed.

[0083] (System functional configuration related to avatar display processing and content execution processing) 5 is a diagram showing an example of the functional configuration related to the avatar object display process and content execution process of the correspondence education system 1. The avatar object display process is a process of displaying an avatar object of a user on the instructor's side or the student's side together with learning content in a virtual space. The content execution process is a process of progressing through the learning content based on operation information received from the user terminal 30.

[0084] The server 10 includes a receiving unit 101, an animation creating unit 103, a content executing unit 104, an image processing unit 105, and a transmitting unit 106 as functional components related to the avatar display process and the content execution process. The receiving unit 101 receives a data signal transmitted from the user terminal 30. The data signal transmitted from the user terminal 30 includes user movement information acquired by the user terminal 30 and operation information performed by the user on the user terminal 30. The operation information includes information related to operations performed on the virtual space via the user terminal 30. The user movement information is not limited to movement information of the user's entire body, but may also be movement information of a part of the user's body. For example, the user's head movement and changes in facial expression may be transmitted as user information.

[0085] The animation creation unit 103 creates an actual movement animation of an avatar object corresponding to the user based on the user movement information received by the receiving unit 101. This actual movement animation is an animation that reproduces the user's movement in real space using an image of the avatar object (hereinafter also referred to as an avatar image). The animation creation unit 103 also creates a planned movement animation of the avatar image related to a predetermined planned movement. When the receiving unit 101 receives operation information indicating that a predetermined operation has been performed on the user terminal 30, the animation creation unit 103 creates a planned movement animation corresponding to the received operation.

[0086] The avatar object may be any object preset by a student or instructor user, or may be one of the objects preset as objects included in the study content. In this embodiment, as an example, the avatar object of the student user is any object preset by the user. On the other hand, the avatar object of the instructor user is one of the objects preset as objects included in the study content.

[0087] The scheduled actions include reaction actions that indicate the user's emotions. For example, when a predetermined operation associated with "happy" is performed via user terminal 30, an animation of the avatar character jumping up in joy is created.

[0088] The scheduled actions also include actions of manipulating predetermined objects included in the learning content. For example, if a scheduled action is associated with "popping a red balloon" and is set as a trigger action by touching or clicking on a red balloon displayed as an object in a virtual space, when the user performs the scheduled action, an animation of the user's avatar popping the red balloon in the virtual space is created.

[0089] The scheduled actions also include repetitive actions that repeat a predetermined movement pattern. For example, when a predetermined operation associated with a "standby state" is performed via user terminal 30, an animation is created in which the character of the avatar image waits while swaying in a certain movement pattern.

[0090] Note that the scheduled action is not limited to the above examples, and various operations can be set as scheduled actions. For example, the scheduled action may be a predetermined action that the instructor's avatar performs on the student's avatar, or a predetermined action that the student's avatar performs on the instructor's avatar. The scheduled action may also be an action in which the instructor's avatar explains the content of the learning content.

[0091] The content execution unit 104 executes processing according to the operation information received from the receiving unit 101. For example, when a user on the instructor's side or the student's side performs an operation to start using predetermined study content (an operation indicating the start of viewing the content) (i.e., when operation information indicating the operation to start using the content is received), the operation execution unit 13 distributes the study content to the user terminals 30 on the instructor's side and the student's side. This allows the user terminals 30 to view a content image in which the study content is displayed in a virtual space. Furthermore, the content execution unit 104 executes processing to progress the content according to the settings of the study content.

[0092] Image processing unit 105 generates data for displaying animation of avatar objects along with learning content deployed in a virtual space on user terminal 30. This data may be the image itself or data for rendering the image. Furthermore, the data generated by image processing unit 105 may include data other than images, such as audio.

[0093] The transmission unit 106 transmits the data generated by the image processing unit 105 to the user terminal 30 .

[0094] The user terminal 30 includes a motion information acquisition unit 301, an operation information acquisition unit 302, a transmission unit 303, a reception unit 304, and a display control unit 305 as functional components related to avatar object display processing and content execution processing.

[0095] The motion information acquisition unit 301 acquires motion information of the user. For example, the operation information acquisition unit 302 photographs the user using a camera included in the input unit 35, and acquires motion information of the user (for example, line of sight, movement of the user's head, movement of a part of the user's body other than the head (for example, hands, etc.) (so-called gestures), facial expressions, etc.) based on the photographed image. The operation information acquisition unit 302 acquires operation information input by the user. For example, it acquires operation information input by the user via a pointing device such as a mouse, a keyboard, a microphone, a camera, a sensor, etc.

[0096] The operation information acquisition unit 302 acquires operation information input by a user, for example, via a pointing device such as a mouse, a keyboard, a microphone, a sensor, a camera, etc. included in the input unit 35.

[0097] The transmitting unit 303 transmits the user's motion information acquired by the motion information acquiring unit 301 and the operation information acquired by the operation information acquiring unit 302 to the server 10. The receiving unit 304 receives data for displaying animation of the avatar object together with the study content being distributed from the server 10. The display control unit 305 displays the data received by the receiving unit 304 on the display unit 36 of the user terminal 30.

[0098] (Avatar object display processing operation) An example of the operation of the avatar display process will be described with reference to Fig. 6. The avatar object display process is started, for example, when an input operation for starting display of an avatar object is performed on user terminal 30 while a predetermined virtual space is being viewed on user terminal 30 via network N. The avatar object display process is performed by CPU 11 reading server program 14A from storage unit 14, expanding it into RAM 13, and executing it.

[0099] 6, in step S10, CPU 11 receives an avatar object display start operation indicating the start of displaying an avatar object from user terminal 30. Specifically, the user performs the start operation to start displaying the avatar object in the virtual space by inputting an operation via input unit 35 of user terminal 30.

[0100] In step S11, the CPU 11 receives, from the user terminal 30, motion information indicating a user's motion.

[0101] In step S12, CPU 11 creates an animation of the actual movements of the corresponding avatar image based on the acquired user movement information, and displays the animation together with the learning content in the virtual space.

[0102] A specific example of the display of learning content will now be described with reference to FIG. 8. FIG. 8 shows learning content that provides an educational picture book to read aloud, deployed in a virtual space. The illustrated display screen 500 is an example of learning content displayed on the display unit 36 of the user terminal 30. This display screen 500 displays chapters that constitute one scene in a picture book as a learning scene, deployed in a virtual space. In the illustrated example, a plurality of balloons Q (Q1, Q2, Q3) and a tree R are displayed as objects included in the learning content against a background image representing a field. In addition, as avatar objects, a first avatar P1 corresponding to a user on the instructor side who reads the picture book aloud and a second avatar P2 corresponding to a user on the student side are displayed at predetermined positions in the virtual space.

[0103] The first avatar P1 on the instructor's side is an object that is set in advance by the user on the content creator side as an object included in the learning content. This first avatar P1 is also an object for the instructor that the user on the instructor side has the right to operate, and an actual movement animation of the first avatar P1 is displayed when an input operation is performed on the user terminal 30 of the instructor side user to start displaying the avatar object.

[0104] The second avatar P2 of the student is an arbitrary object preset by the student user. This second avatar P1 is also a student object for which the student user has operation authority. For example, the student user may set an arbitrary avatar image and store it in the user database 14C in advance. Then, when an input operation to start displaying the avatar object is performed on the user terminal 30 of the student user, an animation of the second avatar P2 moving in real life is displayed at a predetermined position in the virtual space.

[0105] The display position of the avatar object may be a preset position in the virtual space represented by the learning content, or may be any position based on operation information from the user terminal. The display position of the avatar object may also be controlled so that it does not overlap with other objects in the learning content.

[0106] In step S13, the CPU 11 determines whether predetermined operation information corresponding to a preset scheduled action has been received from the user terminal 30. If the predetermined operation information has been received, the determination in step S13 is affirmative, and the process proceeds to step S14. On the other hand, if the predetermined operation information has not been received, the determination in step S13 is negative, and the process proceeds to step S16.

[0107] In step S14, the CPU 11 creates a planned action animation using the user's avatar object for the planned action associated with the received predetermined operation information, and switches the avatar object from the actual action animation to the planned action animation, and then proceeds to the process of step S15.

[0108] In step S15, the CPU 11 switches the avatar object from the expected action animation to the actual action animation again. Specifically, when the playback of the expected action animation ends, the CPU 11 switches the display back to the actual action animation based on the user's action information.

[0109] In step S16, CPU 11 determines whether operation information indicating the end of avatar display has been received. Specifically, when the user performs an end operation to end the display of the avatar object by inputting an operation via input unit 35 of user terminal 30 and this operation information is received, the determination in step S16 is affirmative. If the determination in step S16 is affirmative, CPU 11 ends the avatar object display process. On the other hand, if the determination in step S16 is negative, CPU 11 returns to the process of step S11.

[0110] (Content execution process operation) Next, an example of the operation of the content execution process will be described with reference to Figure 7. The content execution process is started, for example, when a predetermined virtual space is being viewed on user terminal 30 via network N and an operation is performed on user terminal 30 to request the start of distribution of predetermined study content. When distribution of the study content starts, for example, a study scene corresponding to chapter 1 is unfolded in the virtual space.

[0111] In step S20, the CPU 11 determines whether a predetermined operation has been performed on the execution object. Specifically, the CPU 11 determines whether a predetermined operation has been performed on an object that has been set in advance as an execution object in association with a predetermined event in the chapter being distributed, from the user terminal 30 that has the authority to operate the object. If a predetermined operation has been performed on the execution object by a user that has the authority to operate the object, the determination in step S20 is affirmative, and the CPU 11 proceeds to processing in step S23. On the other hand, if a predetermined operation has not been performed on the execution object, the determination in step S20 is negative, and the CPU 11 proceeds to processing in step S21. Note that the case where a predetermined operation has not been performed on the execution object also includes the case where no execution object is set in the chapter.

[0112] In step S21, the CPU 11 determines whether a predetermined event activation time has passed. If the predetermined time has passed, the determination in step S22 is affirmative, and the CPU 11 proceeds to processing in step S23. On the other hand, if the predetermined time has not passed, the determination in step S21 is negative, and the CPU 11 proceeds to processing in step S22. Note that if the predetermined time for event activation has not passed, this also includes the case where no predetermined time is set for the event.

[0113] In step S22, the CPU 11 determines whether a predetermined required time has elapsed for the chapter being distributed. If the required time for the chapter has elapsed, the determination in step S22 is affirmative, and the CPU 11 proceeds to the process of step S23. On the other hand, if the required time for the chapter has not elapsed, the determination in step S22 is negative, and the CPU 11 returns to the process of step S20. Note that the case where the required time for the chapter has not elapsed also includes the case where no required time has been set for the chapter.

[0114] In step S23, CPU 11 initiates an event. This event is an event that is involved in the progress of the study content, and for example, the study scene is switched by the activation of the event. When the execution of the event ends, CPU 11 proceeds to the process of step S24.

[0115] In step S24, the CPU 11 determines whether the distribution of the study content has ended. Specifically, the CPU 11 determines whether an operation has been performed on the user terminal 30 to request that the distribution of the study content be ended. If operation information requesting that the distribution of the study content be ended has been received, the determination in step S24 is affirmative, and the CPU 11 ends the content execution process. On the other hand, if operation information requesting that the distribution of the study content be ended has not been received, the determination in step S24 is negative, and the CPU 11 returns to the process of step S20.

[0116] An example of the progress of learning content through the content execution process will now be described with reference to FIGS.

[0117] In the example of FIG. 8, in educational content that provides an educational picture book for reading aloud, three balloon objects Q (Q1, Q2, Q3) are displayed in a virtual space showing one scene from the picture book. The three balloons are, for example, a first balloon Q1 containing a kitten, a second red balloon Q2, and a third blue balloon Q3. Here, in this educational content, the first balloon Q1 containing the kitten and the second red balloon Q2 are set as execution objects. Furthermore, the first balloon Q1 and the second balloon Q2 are mutual objects, and the instructor user and the student user are given the authority to operate them.

[0118] As shown in FIG. 9, when the user operates the object of the first balloon Q1 in the virtual space within the time required for the chapter, an event associated with the first balloon Q1 is triggered. In the illustrated example, the event is triggered when the user's hand H touches the first balloon Q1 on the display screen 500 of a touch panel display. When the event associated with the first balloon Q1 is triggered, scenario A progresses, in which the first balloon Q1 pops and a trapped kitten appears. Note that, as scenario A progresses, when a learning scene featuring a kitten appears, the kitten object is set as the avatar object of the instructor user. Therefore, by executing the avatar object display process described above, the instructor user can display the kitten object with any animation.

[0119] On the other hand, if the user performs an operation on the object of the second balloon Q2 in the virtual space within the time required for the chapter, an event associated with the second balloon Q2 is triggered. In the illustrated example, the event is triggered by the user's hand H performing a touch operation on the second balloon Q2 on the display screen 500 of the touch panel display. When the event associated with the second balloon Q2 is triggered, the second balloon Q2 bursts and falls onto the field. Then, scenario B progresses, in which the first balloon Q1 containing the kitten is blown away by the wind.

[0120] On the other hand, if no operation is performed on any of the execution objects and the required time for the chapter has elapsed, an event is triggered on the condition that the required time for the chapter has elapsed. In the example shown in the figure, when an event associated with the elapse of the required time for the chapter is triggered, scenario C progresses in which the first balloon Q1 in which the kitten is trapped gets caught on an object on tree R, making it impossible for the kitten to get down from tree R. In this scenario C, when switching to a learning scene in which the kitten is unable to get down from tree R, the game moves to another chapter.

[0121] As described above, in one example, the progression of the learning content branches into multiple patterns depending on the user's operations on the learning content. As a result, in the above example, the storybook provided by the learning content constitutes a multi-scenario. Furthermore, each event set in the learning content may occur within the same chapter, or may occur after moving to a different chapter.

[0122] (Action and effect) As described above, in the correspondence education system 1 according to this embodiment, user movement information is acquired from the user terminals 30 (30A, 30B) connected to the virtual space via the network N, and an animation of the actual movements of the avatar objects is created based on the acquired movement information. As shown in FIG. 8, in the virtual space, animation of the actual movements of the first avatar P1 and the second avatar P2 (avatar objects) based on the movements of the instructor and student users is displayed together with the learning content. In this way, the movements of the users in the real space are reproduced by the movements of the avatars P1 and P2 in the virtual space. This enhances the visual effect of users communicating through the avatar objects when participating in a correspondence education using learning content deployed in the virtual space.

[0123] In the distance learning system 1, when a predetermined operation is performed on the user terminal 30, the avatar object in the virtual space is switched from an actual action animation to a planned action animation. Therefore, for a predetermined planned action, a part of the communication can be substituted by an animation with a high dramatic effect. This enhances the visual effect of the user communicating through the avatar object.

[0124] In the correspondence education system 1, when the planned movement animation of the avatar object in the virtual space ends, it switches back to the actual movement animation, which allows the avatar object to naturally incorporate the user's actual movement as well as the preset planned movement.

[0125] For example, the scheduled actions include reaction actions that indicate the user's emotions, which allows the user to express their emotions more effectively through the avatar object in the virtual space.

[0126] Furthermore, for example, the scheduled actions may include actions to manipulate predetermined objects included in the learning content, which facilitates communication using objects in the virtual space via the avatar object.

[0127] Furthermore, for example, the scheduled actions include repetitive actions that repeat a predetermined movement pattern. This allows the avatar to wait by repeating a predetermined movement pattern in situations where active mutual communication is not required. This reduces the user's fatigue caused by the avatar's movements constantly reflecting the user's actual movements.

[0128] In this embodiment, the user can set any object as an avatar object. In the example shown in Fig. 8, the second avatar P2 corresponding to the student user can be set arbitrarily by the student user. This allows the user to set any object as an avatar object and communicate in the virtual space.

[0129] In this embodiment, the user can set one of the objects preset as an object included in the study content as an avatar object. In the example shown in Fig. 8, the first avatar P1 corresponding to the user on the instructor side is composed of one of the objects preset as an object included in the study content. This allows the user to set one of the objects preset as an object included in the study content as an avatar object and communicate in the virtual space.

[0130] Furthermore, according to the distance learning system 1 of this embodiment, operation information regarding operations performed in the virtual space is acquired via the user terminal 30 (30A, 30B) of the instructor or student user connected via the network N. Furthermore, in the study content, predetermined objects included in the study content are set as execution objects. Here, as shown in FIG. 9 , in the study content, an event related to the progress of the study content can be triggered on the condition that the execution object (Q1, Q2) is operated via the user terminal 30. This allows the progress of the study content to be actively changed by the user's operation of the object, thereby enhancing the user's sense of immersion in the study content.

[0131] Specifically, operations on execution objects performed via the user terminal 30 include at least one of touch operations, position movement operations, and display orientation change operations. In this way, the learning content can trigger events by directly operating objects in the virtual space, thereby enhancing the user's immersion in the learning content.

[0132] Furthermore, in a distance learning system, learning content can be configured to include multiple learning scenes. Here, events configured in the learning content include switching between learning scenes. This allows the user to switch between learning scenes by operating on an object, thereby enhancing the user's sense of immersion in the learning content. Furthermore, the learning content can be configured as multiple scenarios by switching between learning scenes. Therefore, the user's sense of immersion can be maintained even when the same learning content is used repeatedly.

[0133] Furthermore, the learning scene of the learning content can be configured to transition to another learning scene after a preset time has elapsed. This allows the learning content to progress as the required time elapses, preventing the student user from feeling stuck, even if the student user's level of participation or understanding is insufficient. Furthermore, the automatic switching of learning scenes reduces the burden on the instructor.

[0134] Furthermore, since events can be set for each learning scene in the learning content, it becomes easier to create and improve the learning content.

[0135] Furthermore, the learning content allows users to set a specific time for an event to be triggered in a specific learning scene. This allows events to be triggered at a specific time in a specific learning scene, independent of the operation of the execution object. As a result, even if users' levels of participation and understanding vary, the progression of the learning content can be prevented from becoming redundant.

[0136] Furthermore, the learning content can set any object from among multiple pre-registered objects as the execution object. Therefore, for example, it is possible to change the execution object from among multiple objects included in the learning content to match the target age of the student user. This makes it possible to create multiple variations of the learning content using common content elements depending on the target age, level of understanding, etc. of the student user. Note that, although the present embodiment describes an example in which the execution object can be set by the content creator user, the execution object may also be set by operation of the instructor user.

[0137] Furthermore, the above-mentioned execution objects can be set as teacher objects, student objects, and interactive objects. This allows the operation authority of events to be changed depending on the execution object. Therefore, for example, in the case of educational content for young users, such as for children, the execution objects can be set as instructor objects, making it possible to create content that can be viewed by student users without operating a terminal. On the other hand, in educational content for adults, the number of student objects and interactive objects can be increased to make it easier for student users to actively participate in the progression of the scenario.

[0138] In the above embodiment, the number of instructor users and student users accessing the virtual section is not particularly limited. There may be multiple instructor users, multiple student users, or only student users.

[0139] In the above embodiment, avatar objects of the instructor and student users are displayed in the virtual space, but this is not limiting, and only the avatar image of the teacher user may be displayed.

[0140] In the above embodiment, the avatar object of the instructor user is one of the objects included in the study content, but the present invention is not limited to this. An object arbitrarily set by the instructor user may be used as the avatar object. Furthermore, the avatar object of the student user may be one of the objects included in the study content.

[0141] Furthermore, the processes executed by the CPUs 11, 21, and 31 after reading the software (programs) in the above embodiments may be executed by various processors other than the CPU. Examples of processors in this case include PLDs, such as FPGAs, whose circuit configuration can be changed after manufacture, and dedicated electrical circuits, such as ASICs, which are processors with circuit configurations specifically designed to execute specific processes. The provided process may be executed by one of these various processors, or by a combination of two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). The hardware structure of these various processors is, more specifically, an electrical circuit that combines circuit elements such as semiconductor devices.

[0142] Although the server program 14A and the creator program 24A are pre-stored (installed) in the storage unit 14 and the storage unit 24, respectively, the present invention is not limited to this. Each program may be provided in a form recorded on a non-transitory recording medium such as a CD (Compact Disk), a DVD (Digital Versatile Disk), or a USB (Universal Serial Bus) memory. Each program may also be downloaded from an external device via the network N. [Explanation of symbols]

[0143] 1. Correspondence education system 11 CPU (processor) 14A Server Program (Correspondence Education Program) 30 User terminals P1 First avatar (instructor user's avatar object) P2 Second avatar (student user's avatar object) Q Balloon (Object) R-tree (objects) N Network

Claims

1. A distance learning system that provides distance learning using learning content deployed in a virtual space, at least one processor; The at least one processor: Set the avatar object of the instructor or student user, acquiring operation information of the user from a user terminal connected to the virtual space via a network; creating a real-motion animation of the avatar object based on the acquired motion information; displaying the learning content and the actual movement animation in the virtual space; Distance learning system.

2. the at least one processor generates a predetermined action animation of the avatar object relating to a predetermined predetermined action; The distance learning system according to claim 1 , wherein the avatar object in the virtual space is switched from the actual movement animation to the planned movement animation and displayed when a predetermined operation is performed on the user terminal.

3. When the scheduled action animation ends, the at least one processor: The distance learning system according to claim 2 , wherein the avatar object is switched back to the actual movement animation and displayed.

4. The distance learning system according to claim 2 or 3, wherein the scheduled actions include a reaction action indicating an emotion of the user.

5. The distance learning system according to claim 2 or 3, wherein the scheduled action includes an action of operating a predetermined object included in the learning content.

6. 4. The distance learning system according to claim 2, wherein the scheduled motion includes a repetitive motion that repeats a predetermined motion pattern.

7. The distance learning system according to claim 1 , wherein the avatar object is an arbitrary object preset by the user.

8. 3. The distance learning system according to claim 1, wherein the avatar object is one of objects preset as objects included in the learning content.

9. A method for providing distance learning using learning content deployed in a virtual space, comprising: Set the avatar object of the instructor or student user, acquiring operation information of the user from a user terminal connected to the virtual space via a network; creating a real-motion animation of the avatar object based on the acquired motion information; displaying the learning content and the actual movement animation in the virtual space; Distance learning delivery method.

10. A correspondence education program for providing correspondence education using learning content developed in a virtual space, Set the avatar object of the instructor or student user, acquiring operation information of the user from a user terminal connected to the virtual space via a network; creating a real-motion animation of the avatar object based on the acquired motion information; causing a computer to execute a process of displaying the actual movement animation together with the learning content in the virtual space; Distance learning offering programs.

Images