Reproduction control system, reproduction control method, and program

Abstract

To provide a reproduction control system that appropriately conveys information about an absence period of a user in a virtual space to the user.SOLUTION: A reproduction control system according to the present disclosure includes: a content acquisition unit that acquires signed-out content in which a surrounding situation of an avatar corresponding to a user who is signed out of a virtual space is recorded; an activity amount acquisition unit that acquires an activity amount of a user based on biological information of the user; and a reproduction control unit that plays back at least a part of the signed-out content after the user signs in to the virtual space again. The reproduction control unit controls the playback time of the content during the signed-out period according to the activity amount of the user after signing in to the virtual space again.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to a playback control system, a playback control method, and a program. [Background technology]

[0002] A technology is known in which an avatar is used in a computer-generated virtual space, corresponding to a user who signs in to the virtual space. The avatar can act as the user's alter ego in the virtual space through the user's operation. The avatar can, for example, converse with the avatars of other users.

[0003] Recently, technology has become known that allows an avatar to automatically behave between the time a user signs out of a virtual space and the time the user signs back in. For example, an avatar can automatically respond or react when spoken to by another user's avatar. After signing back in, the user can understand the avatar's behavior while signed out by, for example, viewing a video of the avatar's behavior while signed out. This allows the user to operate the avatar after signing in, taking into account the avatar's behavior while signed out.

[0004] As a related technique, Patent Document 1 discloses a server that provides a game in which multiple users can collaborate by logging in through their own terminals. The server records progress information indicating the progress of the collaborative work performed by the users who collaborate in the game. When a user logs in to the game, the server extracts progress information on the collaborative work performed by other users who collaborate with the user during the logout period before the user logged in, and presents the information to the user's terminal. This allows the user to take over unfinished work steps from other users after logging in to the game. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent No. 7344522 Summary of the Invention [Problem to be solved by the invention]

[0006] If a user is signed out of a virtual space for a long period of time, the amount of information that must be communicated to the user when the user signs in again increases, placing a greater burden on the user.

[0007] In view of the above-mentioned problems, an object of the present disclosure is to provide a playback control system, a playback control method, and a program that appropriately convey information about a period during which a user is absent from a virtual space to the user. [Means for solving the problem]

[0008] The playback control system according to the present disclosure includes: a content acquisition unit that acquires signed-out content that records the surrounding situation of an avatar corresponding to a user who is signed out of the virtual space; an activity amount acquisition unit that acquires an activity amount of the user based on biological information of the user; a playback control unit that plays back at least a part of the signed-out content after the user signs in to the virtual space again, The playback control unit controls a playback time of the signed-out content in accordance with an amount of activity of the user after signing in to the virtual space again.

[0009] The playback control method according to the present disclosure includes: The computer a content acquisition step of acquiring signed-out content that records the surrounding situation of an avatar corresponding to a user who is signed out of the virtual space; an activity amount acquiring step of acquiring an activity amount of the user based on biological information of the user; a playback control step of playing back at least a part of the signed-out content after the user signs in to the virtual space again, The playback control step controls a playback time of the signed-out content in accordance with an amount of activity of the user after signing in to the virtual space again.

[0010] The program according to the present disclosure is a content acquisition step of acquiring signed-out content that records the surrounding situation of an avatar corresponding to a user who is signed out of the virtual space; an activity amount acquiring step of acquiring an activity amount of the user based on biological information of the user; a playback control step of playing back at least a part of the signed-out content after the user signs in to the virtual space again, The playback control step causes a computer to execute a playback control method for controlling a playback time of the signed-out content in accordance with an amount of activity of the user after signing in to the virtual space again. [Effects of the Invention]

[0011] The playback control system, playback control method, and program according to the present disclosure can appropriately convey information about the period during which the user is absent from the virtual space to the user. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a block diagram showing the configuration of a playback control system. [Figure 2] FIG. 2 is a block diagram showing the configuration of the VR goggles. [Figure 3] FIG. 3 is a block diagram showing the configuration of the VR server. [Figure 4] FIG. 4 is a flowchart showing the processing of the VR server when the user who is currently signed out signs in. [Figure 5]FIG. 5 is a flowchart showing the processing of the VR server when a signed-in user signs out. [Figure 6] FIG. 6 is a flowchart showing the process performed by the VR goggles when a user who has signed out signs in again. [Figure 7] FIG. 7 is a flowchart showing the digest playback content generation process using the first method. [Figure 8] FIG. 8 is a flowchart showing the digest playback content generation process using the second method. [Figure 9] FIG. 9 is a flowchart showing the digest playback content generation process using the third method. [Figure 10] FIG. 10 is a flowchart showing the digest playback content generation process using the fourth method. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals. For clarity of explanation, duplicated explanations will be omitted as necessary.

[0014] 1 to 3 simply indicate the flow of information (data, signals, etc.). The flow of information indicated by a unidirectional arrow in each drawing does not exclude the two-way flow of information.

[0015] (Configuration of playback control system 100) An overview of a playback control system 100 according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of the playback control system 100. The playback control system 100 includes VR goggles 1-1, 1-2, ..., 1-n and a VR server 2. n is an integer equal to or greater than 1. Each of the VR goggles 1-1, 1-2, ..., 1-n and the VR server 2 communicate with each other via a network N. The network N is a wired or wireless communication line.

[0016] Each of the VR goggles 1-1, 1-2, ..., 1-n may have the same configuration. In the following, when there is no need to particularly distinguish between the VR goggles 1-1, 1-2, ..., 1-n, they will be simply referred to as "VR goggles 1." The number of components included in the playback control system 100 is not limited to those shown in the figure. For example, the playback control system 100 may include multiple VR servers 2.

[0017] The playback control system 100 is a system that controls playback of content that represents a virtual space. Here, the playback control system 100 will be described as being used in a VR space providing service that provides images of a VR (Virtual Reality) space to a user using VR goggles 1. However, the playback control system 100 may also be used in a service that provides images of an AR (Augmented Reality) space or an MR (Mixed Reality) space, for example. In that case, the playback control system 100 may include a device corresponding to each virtual space instead of the VR goggles 1. Note that a virtual space is a three-dimensional space constructed on a computer.

[0018] The VR server 2 is a server that provides the user with images of the VR space. The VR server 2 transmits content that represents the VR space to the VR goggles 1. The content includes at least images. Here, an example will be described in which the content includes images and audio.

[0019] The VR goggles 1 are an output device that receives content from a VR server 2 and outputs the content. When the VR goggles 1 output the content, a VR space is displayed in the user's field of vision. This allows the user to virtually experience the VR space as if it were reality.

[0020] By signing in to the VR space provided by the VR server 2, a user can operate an avatar, which is the user's alter ego, within the VR space. The user controls the avatar, for example, via an operation unit (not shown) of the VR goggles 1 that controls the avatar. The operation unit may be, for example, a separate controller that can communicate with the VR goggles 1. It may also be a sensor such as a gyro sensor built into the VR goggles 1. The avatar can act within the VR space according to the user's operation. For example, the avatar moves within the VR space by walking, running, etc. The avatar can also converse with other avatars that are alter egos of other users. Note that signing in refers to a state in which the user directly controls their own avatar during connection. An avatar is a character that acts on behalf of the user.

[0021] For the sake of explanation below, the user of interest may be referred to as the "own user", and the avatar corresponding to the own user may be referred to as the "own avatar". Furthermore, users other than the own user may be referred to as "other users", and the avatars corresponding to other users may be referred to as "other avatars". When it is not necessary to particularly distinguish between the own user and other users in the explanation, they may be simply referred to as "users", and when it is not necessary to particularly distinguish between the own avatar and other avatars, they may be simply referred to as "avatars".

[0022] For example, when a user's avatar is spoken to by another avatar, the user can respond or react to the other avatar through the user's operation. When the user signs out of the VR space, the user is unable to operate the user's avatar, but the user's avatar is set to act automatically without the user's operation. This allows the user's avatar to act in place of the user who is signed out. The VR server 2 records the user's avatar's actions while signed out and stores this as signed-out content. Note that signed out refers to a state in which the user is not directly operating the user's avatar. Signing out includes, for example, a disconnected state and a state in which the user has enabled automatic response without directly operating the user's avatar while connected.

[0023] When the user signs in again, the VR goggles 1 obtains the signed-out content from the VR server 2 and generates digest playback content using the signed-out content. The VR goggles 1 output the digest playback content, allowing the user to understand the actions of their avatar while signed out. Note that, below, when a user signs out and then signs in again, this may be simply referred to as "signing in."

[0024] The VR goggles 1 control the playback time of digest playback content according to the state of the user after signing in. For example, the VR goggles 1 obtain the amount of activity of the user after signing in using a sensor capable of measuring the amount of activity of the user. The amount of activity of the user after signing in is related to the degree of busyness or tension of the user up until just before signing in. The VR goggles 1 control the playback time of signed-out content according to the amount of activity of the user after signing in. For example, "after signing in" may be a period of up to five minutes from the time of signing in.

[0025] For example, if the amount of activity of the user after signing in is less than a predetermined amount, the VR goggles 1 will play all of the signed-out content as digest playback content. Furthermore, if the amount of activity of the user after signing in is equal to or greater than a predetermined amount, the VR goggles 1 will play part of the signed-out content as digest playback content. In this way, the VR goggles 1 can play digest playback content with a long playback time when the amount of activity of the user after signing in is relatively low, and can play digest playback content with a short playback time when the amount of activity of the user after signing in is relatively high.

[0026] (VR goggles 1 configuration) Next, the configuration of the VR goggles 1 will be described. The VR goggles 1 are an output device that outputs content that expresses a VR space. The VR goggles 1 are formed in a goggle shape and are worn on the user's head. Note that, although the VR goggles 1 are used here as the output device, this is not limiting. The output device may also be a head-mounted display, VR glasses, smart glasses, a glass display, a glass device, or the like.

[0027] 2 is a block diagram showing the configuration of the VR goggles 1. The VR goggles 1 include a camera 11, an output unit 12, a control unit 13, a contact sensor 14, a communication unit 15, and a biosensor 16.

[0028] The VR goggles 1 include a processor, memory, and storage device (not shown). The storage device stores a computer program that implements the processing according to this embodiment. The processor can load the computer program from the storage device into the memory and execute the computer program. In this way, the processor realizes the functions of the detection unit 131, information processing unit 132, playback control unit 133, and measurement unit 134 provided in the control unit 13.

[0029] Alternatively, the detection unit 131, the information processing unit 132, the playback control unit 133, and the measurement unit 134 may each be realized by dedicated hardware. Furthermore, some or all of the components may be realized by a general-purpose or dedicated circuit, processor, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components may be realized by a combination of the above-mentioned circuits, etc., and a program. Furthermore, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), a quantum processor (quantum computer control chip), etc., may be used as the processor.

[0030] The camera 11 is an imaging device that captures an image of a user wearing the VR goggles 1. Here, the camera 11 scans the user's retina and acquires retinal information as data acquired by the scan. The retinal information is used to authenticate the user when signing in to the VR space. The camera 11 sends the retinal information to the detection unit 131. Note that other cameras may also be used as the camera 11. For example, the camera 11 may be an infrared camera capable of scanning the iris. However, the camera 11 is not limited to this and may be any camera that can acquire an image from which the user's features can be extracted.

[0031] Note that a fingerprint may be used for user authentication. For example, if a fingerprint is used for user authentication, the VR goggles 1 may be provided with a fingerprint sensor (not shown) instead of the camera 11. Also, a password may be used for user authentication. For example, if a password is used for user authentication, the VR goggles 1 may be provided with an input unit (not shown) instead of the camera 11. In these cases, the fingerprint sensor and the input unit may be provided in a separate device, such as a smartphone that can communicate with the VR goggles 1.

[0032] The output unit 12 is an output device that outputs content. The output unit 12 outputs content received from the VR server 2. For example, the output unit 12 outputs an image of a virtual world in a VR space. The output unit 12 also outputs digest playback content generated by the information processing unit 132.

[0033] For example, the output unit 12 is a display device such as a display that outputs video. For example, the output unit 12 may be configured as an organic EL display, a liquid crystal display, or the like. The output unit 12 may also include an audio output device such as a speaker that outputs audio. The output unit 12 may be configured to output video and audio to a terminal such as a smartphone used by a user, and to cause the terminal to output the video and audio.

[0034] The control unit 13 is a control device that controls the operation of the VR goggles 1. The control unit 13 includes a detection unit 131, an information processing unit 132, a playback control unit 133, and a measurement unit .

[0035] The detection unit 131 acquires detection results from the contact sensor 14 and detects when the user puts on the VR goggles 1 and when the user removes the VR goggles 1. The detection unit 131 also controls a timer for measuring a predetermined time period during which the user is not wearing the VR goggles 1. The detection unit 131 also acquires retinal information from the camera 11.

[0036] The information processing unit 132 receives data from the detection unit 131 and measurement unit 134 and performs predetermined processing. The information processing unit 132 also uses data received from the VR server 2 via the communication unit 15 to perform predetermined processing.

[0037] For example, the information processing unit 132 functions as a control unit for authentication communication for signing in or out the user of the user to the VR space.

[0038] For example, the information processing unit 132 functions as a content acquisition unit that acquires signed-out content that records the surrounding situation of the user's own avatar corresponding to the user who is signing out of the VR space. The signed-out content may include various information that indicates the surrounding situation of the user's own avatar while the user is signing out.

[0039] The content during sign-out may include, for example, information about other avatars that have communicated with the user's avatar. The content during sign-out may include, for example, information about other avatars that spoke to the user's avatar during sign-out, information about other avatars that the user's avatar spoke to, the content of conversations between the user's avatar and other avatars, the duration of the conversations, or the number of conversations.

[0040] The content during sign-out may include the actions of the user's avatar while the user is signed out. The content during sign-out may include, for example, the actions of the user's avatar, whether the user's avatar has moved, and if so, the distance or route of movement of the user's avatar.

[0041] The format of the sign-out content is arbitrary. For example, the sign-out content may be video footage of the area around the user's avatar and audio around the user's avatar. The sign-out content may include video footage of other avatars that have communicated with the user's avatar and audio around the other avatars. The video footage may include still images and videos. The sign-out content may include text information that describes the status of the user's avatar and other avatars. For example, the sign-out content may include text information such as who the user spoke to while signing out.

[0042] The information processing unit 132 also functions as an activity amount acquiring unit that acquires the activity amount of the user based on the biological information of the user. The information processing unit 132 acquires the activity amount of the user from the measurement unit .

[0043] Furthermore, the information processing unit 132 summarizes the currently signed-out content received from the VR server 2, and generates digest playback content. The information processing unit 132 sends the generated digest playback content to the playback control unit 133.

[0044] The digest playback content includes at least a part of the currently signed-out content received from the VR server 2. The information processing unit 132 generates the digest playback content so that the digest playback content is shorter than the currently signed-out content.

[0045] The information processing unit 132 may generate digest playback content with different playback times depending on the amount of activity of the user after signing in to the VR space again. The amount of activity of the user after signing in is related to how busy the user was immediately before signing in. The greater the amount of activity, the busier the user is expected to be. The amount of activity of the user is also related to the level of tension of the user. The greater the amount of activity, the more tension the user is expected to be.

[0046] Therefore, when the user's activity level after signing in is less than a predetermined level, the information processing unit 132 generates digest playback content that is longer than when the user's activity level is equal to or greater than a predetermined level. In this way, when the user's activity level after signing in is large, the information processing unit 132 can generate digest playback content that is shorter than when the user's activity level is small.

[0047] The information processing unit 132 may determine whether the activity amount is less than a predetermined amount using a predetermined threshold. The threshold may be set in advance. The information processing unit 132 may compare the activity amount during normal times with the activity amount at the time of signing in again to determine whether the activity amount is less than a predetermined amount. For example, the information processing unit 132 acquires the activity amount of the user during normal times and stores it in a storage unit (not shown). The activity amount during normal times may be expressed using a statistical value (e.g., an average value) of the activity amount of the user while signed in.

[0048] For example, if the amount of activity of the user after signing in is less than a predetermined amount, the information processing unit 132 generates digest playback content so that signed-out content is sequentially played back from content recorded after the time the user signed out. The information processing unit 132 generates digest playback content by removing, for example, video from a period in which the user's surroundings did not change from the signed-out content, and leaving only video from a period in which there was a change. The information processing unit 132 may adjust the length of the digest playback content depending on the length of the sign-out period.

[0049] Furthermore, if the amount of activity of the user is equal to or greater than a predetermined amount, the information processing unit 132 selects from the signed-out content the content that was recorded within a predetermined time period prior to the time the user signed in again. The information processing unit 132 generates digest playback content using the selected content.

[0050] The information processing unit 132 may select different content depending on whether or not the user's own avatar has communicated with another avatar during the sign-out period.

[0051] For example, if the user's own avatar automatically responds to another avatar while signed out, the information processing unit 132 selects content related to the other avatar from the signed-out content with priority. The content related to the other avatar may be content related to another user corresponding to the other avatar. If the user's own avatar does not automatically respond to another avatar while signed out, the information processing unit 132 selects content without prioritizing content related to the other avatar. The information processing unit 132 generates digest playback content using the selected content. Note that the content related to the other avatar is content in which at least one of video of the other avatar and audio around the other avatar is recorded.

[0052] In this way, if there is another avatar to which the user's avatar has automatically responded while the user is signed out, the information processing unit 132 can generate digest playback content including content related to the other avatar, making it easier for the user to communicate with the other user corresponding to the other avatar.

[0053] The information processing unit 132 may further generate digest playback content according to the distance between the user's own avatar and the other avatar. For example, if the user's own avatar automatically responds to the other avatar while the user is signed out, the information processing unit 132 determines whether the distance between the user's own avatar and the other avatar is less than a predetermined distance. The distance between the user's own avatar and the other avatar may be measured when the user signs in again. Note that the predetermined distance is preferably about twice the distance typically used when having a conversation using an avatar, such as a distance equivalent to 5.0 m in real space or a distance equivalent to 5.0 m in a virtual space defined based on coordinates in the virtual space, for example, when the avatar is in the form of a person approximately 1.5 m to 1.8 m tall.

[0054] If it is determined that the distance between the user's avatar and the other avatar is less than a predetermined distance, the information processing unit 132 preferentially selects content related to the other avatar from among the signed-out content. The information processing unit 132 generates digest playback content using the selected content. In this way, the user's avatar automatically responds while signed out, and when the user signs in again, digest playback content including content related to the other avatar that is close to the user's avatar can be generated. This makes it easier for the user to communicate with the other user corresponding to the other avatar.

[0055] The playback control unit 133 controls playback of content in the VR goggles 1. After the user who has signed out signs in again to the VR space, the playback control unit 133 plays back at least a part of the signed-out content.

[0056] For example, the playback control unit 133 may provide a summary of the signed-out content to the user by playing back a portion of the signed-out content. For example, if the sign-out period is short, the playback control unit 133 may play back the entire signed-out content. Here, the playback control unit 133 causes the output unit 12 to output the digest playback content generated by the information processing unit 132.

[0057] As described above, the information processing unit 132 generates digest playback content based on the amount of activity of the user after signing in, whether or not the user's avatar communicates with other avatars while signed out, the distance between the user's avatar and other avatars, etc. The playback control unit 133 can control the playback time of the content by outputting the digest playback content generated by the information processing unit 132.

[0058] Alternatively, the playback control unit 133 may play back the signed-out content received from the VR server 2 without going through the information processing unit 132. In this case, when playing back the signed-out content, the playback control unit 133 controls the playback time of the signed-out content. For example, the playback control unit 133 selects a portion of the content included in the signed-out content and plays back the selected content. This allows the playback control unit 133 to play back content that summarizes the signed-out content. The playback control unit 133 can achieve the same effect as playing back digest playback content.

[0059] For example, the playback control unit 133 controls the playback time of the signed-out content according to the activity amount of the user after signing in to the VR space again. For example, when the activity amount of the user is less than a predetermined amount, the playback control unit 133 controls the playback time so that the playback time of the signed-out content is longer than when the activity amount of the user is equal to or greater than the predetermined amount. The playback control unit 133 may determine whether the activity amount is less than the predetermined amount using a predetermined threshold, similar to the information processing unit 132 described above.

[0060] For example, if the amount of activity of the user after signing in is less than a predetermined amount, the playback control unit 133 sequentially plays back signed-out content from content recorded after the time the user signed out. Also, if the amount of activity of the user after signing in is greater than or equal to a predetermined amount, the playback control unit 133 selects and plays back from the signed-out content that was recorded within a predetermined time period prior to the time the user signed in again.

[0061] Furthermore, the playback control unit 133 may control the playback time of the signed-out content depending on whether or not the user's own avatar has communicated with another avatar during the signed-out period.

[0062] For example, if the user's own avatar automatically responds to another avatar while signed out, the playback control unit 133 selects content related to the other avatar from the signed-out content, with priority given to that content. The content related to the other avatar may be content related to another user corresponding to the other avatar. If the user's own avatar does not automatically respond to another avatar while signed out, the playback control unit 133 selects content without giving priority to content related to the other avatar. The playback control unit 133 plays the signed-out content using the selected content.

[0063] The playback control unit 133 may further play back content during sign-out depending on the distance between the user's own avatar and the other avatar. For example, if the user's own avatar automatically responds to an avatar corresponding to another user while the user is signed out, the playback control unit 133 determines whether the distance between the user's own avatar and the other avatar is less than a predetermined distance. The distance between the user's own avatar and the other avatar may be measured when the user signs in again.

[0064] If it is determined that the distance between the user's own avatar and the other avatar is less than a predetermined distance, the playback control unit 133 preferentially selects content related to the other avatar from among the signed-out content, and plays back the signed-out content using the selected content.

[0065] The measurement unit 134 acquires the detection result from the biosensor 16 and measures the activity level of the user based on the detection result. For example, the measurement unit 134 acquires heart rate information indicating the heart rate of the user from a heart rate sensor (pulse wave sensor). The measurement unit 134 also acquires sweat information indicating the degree of sweating of the user from a sweat sensor. The measurement unit 134 measures the activity level of the user based on the acquired heart rate information and sweat information. For example, the measurement unit 134 expresses the activity level of the user as a numerical value. The measurement unit 134 sends the measurement result to the information processing unit 132. The heart rate sensor may be a reflective pulse wave sensor that uses photoplethysmography. The sweat sensor may be a ventilated capsule-type sweat meter.

[0066] The contact sensor 14 detects contact between the user and the VR goggles 1. The contact sensor 14 sends the detection result to the detection unit 131. For example, the contact sensor 14 is a capacitance proximity sensor.

[0067] The communication unit 15 performs authentication communication with the VR server 2 and transmits retinal information acquired by the camera 11. The communication unit 15 communicates with the VR server 2 and receives content from the VR server 2. The communication unit 15 may also transmit to the VR server 2 the operation details of the user's own avatar performed by the operation unit of the VR goggles 1. The communication unit 15 may be configured with a communication interface for performing communication via wired or wireless means.

[0068] The biosensor 16 detects biometric information of the user. For example, the biosensor 16 is a heart rate sensor that measures the user's heart rate. The biosensor 16 may also be a sweat sensor that measures the user's sweat. However, the biosensor 16 is not limited to this, and may be any of various sensors that can detect the amount of activity of the user. The biosensor 16 may be composed of multiple sensors. For example, the biosensor 16 may include both a heart rate sensor and a sweat sensor. The biosensor 16 sends the detection results to the measurement unit 134.

[0069] (VR Server 2 Configuration) Next, the configuration of the VR server 2 will be explained. The VR server 2 is a server that provides images of the VR space. The VR server 2 provides images of the VR space to the user by transmitting content that represents the VR space to the VR goggles 1. The VR server 2 may also provide audio along with the images of the VR space. The VR server 2 also authenticates the user when the user signs in to the VR space, and signs the user in if the authentication is successful. The VR server 2 also signs the user out of the VR space.

[0070] 3 is a block diagram showing the configuration of the VR server 2. The VR server 2 includes a communication unit 21, a control unit 22, and a storage unit 23.

[0071] The VR server 2 includes a processor and a memory, which are not shown in the figure. A computer program implementing the processing according to this embodiment is stored in a storage unit 23, which is a storage device. The processor can load the computer program from the storage device into the memory and execute the computer program. In this way, the processor realizes the functions of the automatic response unit 221, authentication unit 222, situation detection unit 223, recording control unit 224, playback control unit 225, and content generation unit 226 provided in the control unit 22.

[0072] The communication unit 21 performs authentication communication with the VR goggles 1 and receives retinal information acquired by the camera 11. The communication unit 21 controls the establishment, connection, and disconnection of communication for communicating content generated by the content generation unit 226. The communication unit 21 communicates with the VR goggles 1 and transmits the content generated by the content generation unit 226 to the VR goggles 1. The communication unit 21 may also receive the operation details of the user's own avatar performed by the operation unit of the VR goggles 1. The communication unit 21 may be configured with a communication interface for performing communication via wired or wireless means.

[0073] The control unit 22 is a control device that controls the operation of the VR server 2. The control unit 22 includes an automatic response unit 221, an authentication unit 222, a situation detection unit 223, a recording control unit 224, a playback control unit 225, and a content generation unit 226.

[0074] The automatic response unit 221 performs an automatic response of the user's own avatar during a period when the user is signed out of the VR space, in accordance with instructions from the authentication unit 222. For example, when the authentication unit 222 instructs the user to start an automatic response, the automatic response unit 221 performs an automatic response of the user's own avatar in accordance with a change in the surrounding situation of the user's own avatar detected by the situation detection unit 223. Examples of changes in the surrounding situation include the user's own avatar being spoken to by another avatar, or the other avatar approaching the user's own avatar, etc. The automatic response unit 221 instructs the content generation unit 226 on the control content of the user's own avatar's automatic response.

[0075] For example, when another avatar speaks to the user's avatar, the automatic response unit 221 causes the user's avatar to respond to the other avatar. For example, the automatic response unit 221 may select a response sentence that matches the user's avatar's surrounding circumstances from a plurality of pre-stored response sentences, and cause the user's avatar to respond using the selected response sentence. The automatic response unit 221 may also cause the user's avatar to react to the other avatar. Examples of reactions include turning the face or body toward the other avatar, shaking the head, or nodding. However, the reactions are not limited to these, and any action may be used as a reaction.

[0076] The automatic response unit 221 may automatically respond so that the user's avatar behaves or speaks in a manner similar to that of the user based on the user's tendencies in behavior and thinking in response to changes in the surrounding situation of the user's avatar detected by the situation detection unit 223. For example, the automatic response unit 221 may cause the user's avatar to respond to utterances of other avatars using a trained model trained using any machine learning method.

[0077] The authentication unit 222 authenticates the user using retinal information. The authentication unit 222 receives an authentication request from the VR goggles 1 via the communication unit 21. The authentication unit 222 also transmits the authentication result to the VR goggles 1 via the communication unit 21. The authentication unit 222 instructs the automatic response unit 221 and the situation detection unit 223 to perform processing according to the authentication result. If the authentication is successful, the authentication unit 222 signs the user into the VR space.

[0078] The situation detection unit 223 detects the surrounding situation of the user's avatar in accordance with an instruction from the authentication unit 222. For example, when the authentication unit 222 instructs the user to start situation detection, the situation detection unit 223 detects communication that has occurred between the user's avatar and another avatar in the VR space, which is the content generated by the content generation unit 226. For example, the situation detection unit 223 detects that the user's avatar has been spoken to by the other avatar. The situation detection unit 223 may use any image recognition technology or voice recognition technology to detect communication from video and audio that record the surrounding situation, or may detect communication based on the distance or positional relationship between the user's avatar and another avatar.

[0079] Furthermore, the situation detection unit 223 detects whether the user's avatar has automatically responded to or reacted to another avatar. The situation detection unit 223 may also detect any change in the situation surrounding the user's avatar. The situation detection unit 223 instructs the recording control unit 224 to perform processing according to the detection result.

[0080] The recording control unit 224 controls the recording of the surrounding situation of the user's avatar during the period when the user is signed out of the VR space, in accordance with instructions from the situation detection unit 223. For example, when the authentication unit 222 instructs the start of recording video and audio around the user's avatar, the recording control unit 224 records the surrounding situation of the user's avatar in the content generated by the content generation unit 226 during that period as signed-out content in the signed-out content DB 232 of the storage unit 23. The signed-out content may take any format. Here, as an example, the signed-out content will be described as including video captured around the user's avatar and audio around the user's avatar.

[0081] The signed-out content DB 232 is information that associates, for example, a content ID, a recording date and time, a user's own avatar ID, other avatar IDs, response content, and content. The content ID is information that identifies the signed-out content. The recording date and time is the date and time when the signed-out content was recorded.

[0082] The own avatar ID is information for identifying the own avatar. The other avatar ID is information for identifying the other avatar that has communicated with the own avatar. Note that instead of the own avatar ID, a own user ID for identifying the own user may be used. Also, instead of the other avatar ID, a other user ID for identifying the other user may be used.

[0083] The response content is information indicating the content of the response made by the user's avatar to the other avatar. The content is video and audio recorded during sign-out. The content may include, for example, video and audio from the time of sign-out until re-sign-in, as well as a few seconds before and after that time.

[0084] The playback control unit 225 controls playback of content in the VR server 2 in accordance with instructions from the recording control unit 224. Furthermore, the playback control unit 225 acquires signed-out content from the signed-out content DB 232 in response to a request from the VR goggles 1. The playback control unit 225 transmits the acquired signed-out content to the VR goggles 1 via the communication unit 21.

[0085] The content generation unit 226 generates content for the VR space. The content generation unit 226 sends the content generated in response to requests from the situation detection unit 223, the recording control unit 224, and the playback control unit 225 to each processing unit that has made the request. The content generation unit 226 also controls the content of the VR space generated in response to instructions from the automatic response unit 221 and the operation details of the user's own avatar performed by the operation unit of the VR goggles 1 received by the communication unit 21.

[0086] The storage unit 23 stores various data and programs. At least a part of the storage unit 23 is configured with a non-volatile memory so that data is retained even when the power to the VR server 2 is turned off. For example, the storage unit 23 stores programs for realizing each function of the control unit 22.

[0087] The storage unit 23 also stores a user information DB 231 and the above-described signed-out content DB 232. The user information DB 231 stores user information. The user information is information about a user. The user information includes biometric information of the user used for authentication of sign-in and sign-out.

[0088] The user information DB231 is information that associates, for example, a user ID, an account name, and authentication information. The user ID is information that identifies a user. The account name is information that indicates the user's account name. The authentication information is information that identifies a user and is used to authenticate the user. The authentication information is, for example, retinal information of the user, but is not limited to this. The authentication information may be various information that is used to authenticate the user. Furthermore, the authentication information may store features extracted from biometric information. The signed-out content DB232 is as described above, so a description thereof will be omitted.

[0089] The above describes each component of the playback control system 100. The above-described configurations of the VR goggles 1 and the VR server 2 are merely examples and may be modified as appropriate. For example, when some or all of the components of the VR goggles 1 and the VR server 2 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, or the like, each connected via a communication network. Furthermore, for example, the functions of the VR server 2 may be provided in a SaaS (Software as a Service) format.

[0090] Furthermore, for example, in the above description, an example was described in which the information processing unit 132 of the VR goggles 1 has the functions of a content acquisition unit and an activity amount acquisition unit, but the VR server 2 may have these functions. Also, the VR server 2 may have the function of the playback control unit 133 of the VR goggles 1. For example, digest playback content may be generated in the VR server 2. Similarly, the VR goggles 1 may have some of the functions of the VR server 2 described above.

[0091] (VR Server 2 processing) Next, the processing performed by the VR server 2 will be described with reference to Fig. 4 and Fig. 5. Fig. 4 is a flowchart showing the processing of the VR server 2 when the user who is currently signed out signs in. Fig. 5 is a flowchart showing the processing of the VR server 2 when the user who is currently signed in signs out.

[0092] [When a signed-out user signs in] First, with reference to FIG. 4, the process of the VR server 2 when the user who is currently signed out signs in will be described.

[0093] First, the communication unit 21 determines whether or not a sign-in authentication communication has been received from the VR goggles 1 (S1). The authentication communication is a communication for requesting authentication of the user. The authentication communication includes authentication information of the user. Here, the authentication communication includes retinal information acquired by scanning the user's retina as authentication information. The authentication information may be information other than retinal information. Furthermore, instead of retinal information, a feature of the user extracted from biometric information or a password entered by the user may be used.

[0094] If it is determined that the sign-in authentication communication has not been received (NO in S1), the communication unit 21 repeats step S1. If it is determined that the sign-in authentication communication has been received (YES in S1), the communication unit 21 acquires retinal information from the authentication communication (S2). The communication unit 21 sends the retinal information to the authentication unit 222.

[0095] Next, the authentication unit 222 performs sign-in authentication using the retinal information (S3). When the authentication unit 222 acquires the retinal information from the communication unit 21, it acquires the retinal information included in the user information DB 231 stored in the storage unit 23. The authentication unit 222 compares the retinal information acquired from the communication unit 21 with the retinal information acquired from the user information DB 231.

[0096] If the retinal information acquired from the communication unit 21 matches the retinal information acquired from the user information DB 231, the authentication unit 222 determines that the sign-in authentication has been successful for the user having the user ID associated with the retinal information. If the retinal information acquired from the communication unit 21 does not match the retinal information included in the user information DB 231, the authentication unit 222 determines that the sign-in authentication has failed. Note that the authentication unit 222 repeatedly acquires the retinal information included in the user information DB 231 until the retinal information acquired from the communication unit 21 matches the retinal information acquired from the user information DB 231 or until all of the retinal information stored in the user information DB 231 has been compared. The authentication unit 222 transmits the result of the sign-in authentication to the VR goggles 1 via the communication unit 21 (S4).

[0097] Next, the authentication unit 222 determines whether the authentication was successful (S5). If it is determined that the authentication was unsuccessful (NO in S5), the processing ends. If it is determined that the authentication was successful (YES in S5), the authentication unit 222 signs the user into the VR space (S6). Specifically, the authentication unit 222 instructs the communication unit 21 to establish a communication connection between the VR goggles 1 and the VR server 2 in response to the success of the authentication. Next, the authentication unit 222 instructs the playback control unit 225 to start providing the content generated by the content generation unit 226 to the VR goggles 1, and the playback control unit 225 sends the content of the surrounding situation of the user's avatar generated by the content generation unit 226 via the communication unit 21.

[0098] Next, the authentication unit 222 instructs the automatic response unit 221 to stop automatic responses by the user's own avatar corresponding to the user (S7). The authentication unit 222 also instructs the situation detection unit 223 to stop situation detection (S8). The situation detection unit 223 then instructs the recording control unit 224 to stop recording video and audio around the user's own avatar (S9).

[0099] When the recording control unit 224 stops recording the content, it instructs the playback control unit 225 to play the signed-out content. The playback control unit 225 acquires the signed-out content that has been recorded since the last time the user signed out from the signed-out content DB 232 in the storage unit 23 (S10). The playback control unit 225 sends the acquired signed-out content to the communication unit 21. When the communication unit 21 acquires the signed-out content, it transmits the signed-out content to the VR goggles 1 that have been authenticated for sign-in (S11).

[0100] [When a signed-in user signs out] Next, with reference to FIG. 5, the process of the VR server 2 when the signed-in user signs out will be described.

[0101] First, the communication unit 21 determines whether or not a sign-out authentication communication has been received from the VR goggles 1 (S21). If it is determined that a sign-out authentication communication has not been received (NO in S21), the communication unit 21 repeats step S21. If it is determined that a sign-out authentication communication has been received (YES in S21), the communication unit 21 instructs the authentication unit 222 to sign out the user who has made the sign-out authentication communication. The authentication unit 222 signs out the user from the VR space (S22). Specifically, the authentication unit 222 disconnects communication for communicating content generated by the content generation unit 226 in accordance with the sign-out authentication communication.

[0102] Next, the authentication unit 222 instructs the automatic response unit 221 to start an automatic response by the user's own avatar corresponding to the user (S23). As a result, when another avatar communicates with the user's own avatar in the VR space, the automatic response unit 221 causes the user's own avatar to automatically respond to the other avatar. For example, when the user's own avatar is spoken to by the other avatar, the automatic response unit 221 causes the user's own avatar to respond using a response sentence. The automatic response unit 221 may cause the user's own avatar to respond by reacting to the other avatar, such as nodding.

[0103] The authentication unit 222 also instructs the situation detection unit 223 to start situation detection (S24). As a result, the situation detection unit 223 detects the surrounding situation of the user's own avatar while the user is signing out. For example, the situation detection unit 223 detects an automatic response made by the user's own avatar to another avatar. The situation detection unit 223 also detects the movement of another avatar within a predetermined distance from the user's own avatar.

[0104] Then, the situation detection unit 223 instructs the recording control unit 224 to start recording video and audio around the user's avatar (S25). The recording control unit 224 constantly records video and audio around the user's avatar in a memory (not shown) in a round-robin format.

[0105] Next, the situation detection unit 223 determines whether or not there has been a change in the surrounding situation (S26). If it is determined that there has been no change in the surrounding situation (NO in S26), the situation detection unit 223 repeats step S26.

[0106] If it is determined that there is a change in the surrounding situation (YES in S26), the situation detection unit 223 instructs the recording control unit 224 to record the signed-out content (S27). For example, if the user's own avatar starts an automatic response or if the movement of another avatar within a predetermined distance from the user's own avatar is detected, the situation detection unit 223 instructs the recording control unit 224 to start recording the signed-out content. If the user's own avatar ends the automatic response or if the movement of another avatar within a predetermined distance from the user's own avatar stops, the situation detection unit 223 instructs the recording control unit 224 to end recording the signed-out content.

[0107] The recording control unit 224 records the signed-out content in the signed-out content DB 232 of the storage unit 23 based on instructions to start and stop recording issued by the situation detection unit 223. Specifically, the recording control unit 224 records, from among the content recorded in the memory, video for a predetermined recording period as the signed-out content in the signed-out content DB 232.

[0108] The recording period may start from a predetermined time before the timing when the situation detection unit 223 instructs the user to start recording the signed-out content, and end from a predetermined time after the timing when the situation detection unit 223 instructs the user to stop recording the signed-out content. The predetermined time may be set arbitrarily. The predetermined time may be, for example, several seconds.

[0109] By setting the start point of the recording period to a predetermined time before the instruction to start recording, the recording control unit 224 can record, for example, a video of one's own avatar being spoken to by another avatar, from the beginning of the conversation without missing anything. Also, by setting the end point of the recording period to a predetermined time after the instruction to stop recording, the recording control unit 224 can record, for example, a video of one's own avatar automatically responding to another avatar, from the end of the automatic response without missing anything.

[0110] Next, the communication unit 21 determines whether or not a sign-in authentication communication has been received from the VR goggles 1 (S28). If it is determined that a sign-in authentication communication has not been received (NO in S28), the communication unit 21 returns to step S26 and repeats the subsequent processing. If it is determined that a sign-in authentication communication has been received (YES in S28), the processing ends. Note that the VR server 2 starts the processing described in FIG. 4.

[0111] (VR goggles 1 processing) Next, the processing performed by the VR goggles 1 will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the processing performed by the VR goggles 1 when the user who has signed out signs in again. Note that the description of the processing when the user who is currently signed in signs out will be omitted.

[0112] First, the detection unit 131 determines whether or not the user is wearing the VR goggles 1 via the contact sensor 14 (S31). The detection unit 131 also starts counting a timer that measures a predetermined time during which the user is not wearing the VR goggles 1. The predetermined time may be set arbitrarily.

[0113] If it is determined that the VR goggles 1 are not being worn (NO in S31), the detection unit 131 determines whether the timer has timed out (S32). If it is determined that the timer has timed out (YES in S32), the processing ends. If it is determined that the timer has not timed out (NO in S32), the detection unit 131 returns to the processing of step S31 and repeats the subsequent processing.

[0114] If it is determined in step S31 that the VR goggles 1 are worn (YES in S31), the detection unit 131 stops counting the timer that measures the predetermined time during which the user is not wearing the VR goggles 1, and scans the user's retina via the camera 11 (S33). The detection unit 131 sends retinal information acquired by scanning the retina to the information processing unit 132.

[0115] When the information processing unit 132 acquires the retinal information from the detection unit 131, it transmits the retinal information to the VR server 2 via the communication unit 21 (S34). As a result, the information processing unit 132 performs authentication communication for the sign-in of the user himself / herself using the retinal information acquired from the detection unit 131. When the communication unit 21 receives a notification of the result of the sign-in authentication of the user himself / herself from the VR server 2, it sends the result of the sign-in authentication to the information processing unit 132.

[0116] The information processing unit 132 determines whether the sign-in authentication has been successful (S35). The information processing unit 132 also starts counting a timer that measures a predetermined time until notification of the result of the sign-in authentication of the user itself is received. The predetermined time until notification of the result of the sign-in authentication of the user itself may be set arbitrarily. If it is determined that the sign-in authentication has not been successful (NO in S35), the information processing unit 132 determines whether the timer has timed out (S36). If it is determined that the timer has timed out (YES in S36), the processing ends. If it is determined that the timer has not timed out (NO in S36), the information processing unit 132 returns to the processing of step S35 and repeats the subsequent processing.

[0117] If it is determined in step S35 that the sign-in authentication is successful (YES in S35), the information processing unit 132 stops counting the timer that measures the predetermined time until it receives notification of the result of the sign-in authentication for its own user, and starts communication with the VR server 2 to receive the content of the VR space via the communication unit 21 (S37).

[0118] Next, the communication unit 21 determines whether or not the signed-out content has been received from the VR server 2 (S38). The communication unit 21 also starts counting a timer that measures a predetermined time until the signed-out content is received. The predetermined time until the signed-out content is received may be set arbitrarily. If it is determined that the signed-out content has been received (YES in S38), the communication unit 21 sends the received signed-out content to the information processing unit 132.

[0119] If it is determined that the content has not been received during the sign-out period (NO in S38), the communication unit 21 determines whether the timer has timed out (S39). If it is determined that the timer has timed out (YES in S39), the processing ends. If it is determined that the timer has not timed out (NO in S39), the communication unit 21 returns to the processing of step S38 and repeats the subsequent processing.

[0120] When the information processing unit 132 acquires the signed-out content, it instructs the measurement unit 134 to measure biometric information. The measurement unit 134 acquires the detection results of the biometric information of the user from the biometric sensor 16. The biometric information may include, for example, information on the user's heart rate and sweating. The measurement unit 134 measures the amount of activity of the user based on the detection results. The measurement unit 134 sends the amount of activity of the user to the information processing unit 132.

[0121] The information processing unit 132 acquires the activity amount of the user from the measurement unit 134 (S40). Upon acquiring the activity amount of the user, the information processing unit 132 generates digest playback content according to the activity amount of the user from the acquired signed-out content (S41). For example, the information processing unit 132 generates digest playback content with different playback times according to the activity amount of the user acquired in step S40.

[0122] For example, if the user's activity level is equal to or greater than a predetermined level, it is assumed that the user is busy. Specifically, the user may be determined to be busy if the user's heart rate is equal to or greater than 100 beats per minute, which is the upper limit of the number of heartbeats per minute during normal resting state. Furthermore, the user may be determined to be busy if the user's sweat rate is equal to or greater than 0.5 mg per square centimeter per minute during normal resting state. In this case, the information processing unit 132 generates digest playback content with a shorter playback time than when the user's activity level is less than a predetermined level. This allows the information processing unit 132 to generate digest playback content that is shorter when the user is busy than when the user is not, thereby reducing the burden on the user. The information processing unit 132 may generate digest playback content by selecting one or more of the digest playback content generation methods described below.

[0123] Next, the information processing unit 132 instructs the output unit 12 to output the generated digest playback content (S42). The output unit 12 acquires the digest playback content from the playback control unit 133 and plays back the digest playback content, for example, by a Picture-In-Picture display in which the digest playback content is displayed superimposed on the display area of ​​the content in the VR space.

[0124] If the detection unit 131 detects that the VR goggles 1 are not being worn while the user is signing in, the information processing unit 132 transmits the user information acquired at the time of sign-in authentication to the VR server 2. As a result, the information processing unit 132 performs authentication communication for signing out of the user.

[0125] In the above description, the information processing unit 132 generates digest playback content with different playback times according to the amount of activity acquired at the time of sign-in, but the present invention is not limited to this. The information processing unit 132 may generate digest playback content according to the amount of activity after a predetermined time has elapsed since sign-in. This allows the information processing unit 132 to generate digest playback content according to the amount of activity acquired at a time when the user's condition is stable.

[0126] The following describes in detail the method for generating digest playback content in step S41 shown in Fig. 6. Four methods will be described as examples.

[0127] (First method) The first method will be described with reference to Fig. 7. Fig. 7 is a flowchart showing a digest playback content generation process using the first method. In the first method, the information processing unit 132 sets the playback time of the signed-out content according to the activity level of the user when the user who has signed out signs in to the VR space again. The information processing unit 132 generates the signed-out content for the set playback time.

[0128] First, the information processing unit 132 determines whether the activity amount of the user is equal to or greater than a predetermined amount (S51). If it is determined that the activity amount of the user is equal to or greater than the predetermined amount (YES in S51), the information processing unit 132 sets the playback time to a shorter value (S52). For example, the information processing unit 132 sets the playback time to a shorter value than the playback time of the digest playback content that would be generated if it was determined that the activity amount of the user is less than the predetermined amount.

[0129] When it is determined that the activity amount of the user is less than a predetermined amount (NO in S51), the information processing unit 132 sets the playback time to a longer value (S53). For example, the information processing unit 132 sets the playback time to a longer value than the playback time of the digest playback content that is generated when it is determined that the activity amount of the user is equal to or greater than a predetermined amount.

[0130] The playback times for when the activity amount is equal to or greater than a predetermined amount and when it is less than the predetermined amount may be set in advance according to the user's preference. For example, the user may set the playback time to one minute when the activity amount is equal to or greater than a predetermined amount and two minutes when the activity amount is less than the predetermined amount. The information processing unit 132 generates digest playback content based on the playback times set in step S52 or S53 (S54).

[0131] In this way, the information processing unit 132 generates short digest playback content when the amount of activity is equal to or greater than a predetermined amount, so that when the user is not ready to accept information, it is possible to provide the user with information with less burden.Furthermore, when the amount of activity is less than a predetermined amount, the information processing unit 132 generates long digest playback content, so that when the user is ready to accept information, it is possible to provide the user with more information.

[0132] (Second method) The second method will be described with reference to Fig. 8. Fig. 8 is a flowchart showing a digest playback content generation process using the second method. In the second method, the information processing unit 132 selects content to be used for generating digest playback content from signed-out content according to the amount of activity of the user when the user signs in again.

[0133] First, the information processing unit 132 determines whether the activity amount of the user is equal to or greater than a predetermined amount (S61). If it is determined that the activity amount of the user is equal to or greater than the predetermined amount (YES in S61), the information processing unit 132 selects content that was recorded within a predetermined time period prior to the time the user signed in again (S62). In other words, the information processing unit 132 selects only content that was recorded at a timing close to the time the user signed in again.

[0134] When it is determined that the activity amount of the user is less than a predetermined amount (NO in S61), the information processing unit 132 selects content that has been recorded after the user signed out (S63). For example, the information processing unit 132 selects all of the signed-out content that has been recorded from the time the user signed out until the time the user signed in again.

[0135] The information processing unit 132 generates digest playback content using the content selected in step S62 or S63 (S64). For example, the information processing unit 132 generates digest playback content by connecting the selected content.

[0136] In this way, when the amount of activity is equal to or greater than a predetermined amount, the information processing unit 132 generates digest playback content using only content recorded at timings close to the time the user signed in again. This allows the information processing unit 132 to generate digest playback content that includes information close to the current time the user signed in. Furthermore, when the amount of activity is less than a predetermined amount, the information processing unit 132 generates digest playback content using content recorded after the user signed out. This allows the information processing unit 132 to generate digest playback content in which recordings from the time the user signed out to the time the user signed in again are sequentially played back.

[0137] In this way, the information processing unit 132 can generate digest playback content with a short playback time when the amount of activity is equal to or greater than a predetermined amount, and a long playback time when the amount of activity is less than the predetermined amount, similar to the first method. When the user is not ready to accept information, the information processing unit 132 provides the user with information with less burden, and when the user is ready to accept information, the information processing unit 132 allows the user to carefully view the situation during sign-out from the beginning.

[0138] (Third Method) The third method will be described with reference to Fig. 9. Fig. 9 is a flowchart showing a digest playback content generation process using the third method. In the third method, the information processing unit 132 selects content to be used for generating digest playback content from the signed-out content depending on whether the user's own avatar automatically responded to another avatar during sign-out.

[0139] First, the information processing unit 132 analyzes the signed-out content received from the communication unit 21 and determines whether or not the user's own avatar has automatically responded to the other avatar (S71). If it is determined that the user's own avatar has automatically responded (YES in S71), the information processing unit 132 preferentially selects content related to the other avatar (S72). For example, the information processing unit 132 selects content including a video of the user's own avatar and the other avatar having a conversation from the signed-out content. The content related to the other avatar may be content related to the other user corresponding to the other avatar. The information processing unit 132 may add information related to the other avatar or the other user to the selected content.

[0140] If it is determined that an automatic response has not been made (NO in S71), the information processing unit 132 selects content without giving priority to content related to other avatars (S73). The information processing unit 132 may select content from the signed-out content using any condition.

[0141] The information processing unit 132 generates digest playback content using the content selected in step S72 or S73 (S74). For example, the information processing unit 132 generates digest playback content by connecting the selected content.

[0142] In this way, when the user's avatar automatically responds to another avatar, the information processing unit 132 preferentially selects content related to the other avatar and generates digest playback content using the selected content. This allows the information processing unit 132 to preferentially provide the user with information about another avatar that the user is likely to talk to in the near future, enabling the user to respond immediately after signing in.

[0143] Furthermore, when the user's own avatar has not automatically responded to other avatars, the information processing unit 132 generates digest playback content by selecting content related to other avatars without giving priority to it. This allows the information processing unit 132 to provide information about other avatars that are unlikely to be spoken to in the near future without giving priority to it, thereby enabling efficient information provision.

[0144] (Fourth Method) The fourth method will be described with reference to Fig. 10. Fig. 10 is a flowchart showing a digest playback content generation process using the fourth method. The fourth method is obtained by adding a determination of the distance between the user's own avatar and other avatars to the third method. Steps S81 and S83 to S85 shown in Fig. 10 correspond to steps S71 to S74 described with reference to Fig. 9, respectively. Therefore, the description will be simplified as appropriate here.

[0145] First, the information processing unit 132 analyzes the signed-out content received from the communication unit 21 and determines whether the user's own avatar has automatically responded to the other avatar (S81). If it is determined that the user's own avatar has automatically responded (YES in S81), the information processing unit 132 analyzes the content in the VR space and measures the current distance between the user's own avatar and the other avatar. Next, the information processing unit 132 determines whether the current distance between the user's own avatar and the other avatar is less than a predetermined distance (S82). If it is determined that the user has not automatically responded (NO in S81), the information processing unit 132 selects content without prioritizing content related to the other avatar (S84).

[0146] If it is determined that the distance between the current avatar and the other avatar is less than a predetermined distance (YES in S82), the information processing unit 132 selects content related to the other avatar with priority (S83). If it is determined that the distance to the other avatar is equal to or greater than a predetermined distance (NO in S82), the information processing unit 132 selects content without prioritizing content related to the other avatar (S84). The information processing unit 132 generates digest playback content using the content selected in step S83 or S84 (S85).

[0147] In this way, the information processing unit 132 not only automatically responds to the other avatar, but also preferentially selects content related to the other avatar when the other avatar is located within a predetermined distance from the own avatar in the VR space. This allows the information processing unit 132 to provide the own user with preferential information about the other avatar that the own avatar is likely to talk to in the near future and that is nearby at the time of sign-in. This allows the own user to respond immediately after signing in.

[0148] Furthermore, when the user's own avatar does not automatically respond to another avatar or when the two avatars are not within a predetermined distance, the information processing unit 132 selects content related to the other avatar without giving priority to it and generates digest playback content. This allows the information processing unit 132 to provide information about another avatar that is unlikely to be spoken to in the near future without giving priority to it, thereby enabling efficient information provision.

[0149] As described above, in the playback control system 100 according to this embodiment, the VR goggles 1 acquire signed-out content that records the surrounding situation of an avatar corresponding to a user who is signed out of the VR space. The VR goggles 1 also acquire the amount of activity of the user based on the user's biological information. After the user signs in to the VR space again, the VR goggles 1 control the playback time of the signed-out content according to the amount of activity of the user after signing in to the VR space again.

[0150] For example, if the user's activity level is less than a predetermined level, the VR goggles 1 sequentially play back signed-out content starting from content recorded at the time the user signed out. Also, if the user's activity level is greater than or equal to a predetermined level, the VR goggles 1 select and play back from signed-out content that was recorded within a predetermined time period prior to the time the user signed in again.

[0151] Furthermore, if the user's avatar automatically responds to another avatar corresponding to another user while the user is signed out, the VR goggles 1 prioritizes playback of content related to the other avatar. Furthermore, if the distance between the other avatar and the user's avatar is less than a predetermined distance, the VR goggles 1 prioritizes playback of content related to the other avatar among the signed-out content.

[0152] With this configuration, when a signed-out user signs back into the VR space, the VR goggles 1 can appropriately summarize the signed-out content and transmit information to the user. Therefore, the playback control system 100 can appropriately transmit information about the user's absence from the virtual space to the user.

[0153] Furthermore, when the VR goggles 1 detect by the contact sensor 14 that the user is wearing the VR goggles 1, the VR goggles 1 scan the user's retina to perform authentication communication to sign in to the VR space, and automatically sign the user in. Furthermore, when the VR goggles 1 detect that the user is not wearing the VR goggles 1, the VR goggles 1 perform authentication communication to sign out of the VR space, and automatically sign the user out. This allows the user to easily sign in or out by wearing or not wearing the VR goggles 1.

[0154] Each functional component of the VR goggles 1 and the VR server 2 described above may be realized by hardware (e.g., hardwired electronic circuits, etc.) that realizes each functional component, or may be realized by a combination of hardware and software (e.g., a combination of an electronic circuit and a program that controls it, etc.). For example, any process in the present disclosure can be realized by having a CPU execute a computer program.

[0155] The program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on various types of non-transitory computer-readable media or tangible storage media. By way of example and not limitation, non-transitory computer-readable media or tangible storage media include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on various types of transitory computer-readable media or communication media. By way of example and not limitation, transitory computer-readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.

[0156] The present disclosure is not limited to the above-described embodiments, and can be modified as appropriate within the scope of the present disclosure. [Explanation of symbols]

[0157] 1 VR goggles 2 VR Server 11 Camera 12 Output section 13 Control Unit 14 Contact Sensor 15 Communications Department 16 Biometric sensors 21 Communications Department 22 Control Unit 23 Memory section 100 Regeneration Control System 131 Detection unit 132 Information Processing Department 133 Playback control unit 134 Measuring section 221 Auto Answering Unit 222 Authentication Department 223 Situation Detection Unit 224 Recording control section 225 Playback control unit 226 Content Generation Unit 231 User Information DB 232 Signed out Content DB N Network

Claims

1. a content acquisition unit that acquires signed-out content that records the surrounding situation of an avatar corresponding to a user who is signed out of the virtual space; an activity amount acquisition unit that acquires an activity amount of the user based on biological information of the user; a playback control unit that plays back at least a part of the signed-out content after the user signs in to the virtual space again, The playback control unit controls a playback time of the signed-out content according to an amount of activity of the user after signing in to the virtual space again. Playback control system.

2. The playback control unit If the amount of activity of the user is less than a predetermined amount, the signed-out content is sequentially played back from the content recorded after the time the user signed out; If the amount of activity of the user is equal to or greater than a predetermined amount, content recorded within a predetermined time period prior to the time the user signs in again is selected from the signed-out content and played back. The regeneration control system of claim 1 .

3. The playback control unit When the avatar automatically responds to another avatar corresponding to another user while the user is signed out, content related to the other avatar is preferentially played back from among the content during the sign-out period.

3. The regeneration control system according to claim 1 or 2.

4. The playback control unit When the distance between the avatar and the other avatar is less than a predetermined distance, the content related to the other avatar among the signed-out contents is preferentially reproduced. The regeneration control system of claim 3 .

5. The computer a content acquisition step of acquiring signed-out content that records the surrounding situation of an avatar corresponding to a user who is signed out of the virtual space; an activity amount acquiring step of acquiring an activity amount of the user based on biological information of the user; a playback control step of playing back at least a part of the signed-out content after the user signs in to the virtual space again, In the playback control step, a playback time of the signed-out content is controlled in accordance with an amount of activity of the user after signing in to the virtual space again. Playback control method.

6. a content acquisition step of acquiring signed-out content that records the surrounding situation of an avatar corresponding to a user who is signed out of the virtual space; an activity amount acquiring step of acquiring an activity amount of the user based on biological information of the user; a playback control step of playing back at least a part of the signed-out content after the user signs in to the virtual space again, In the playback control step, a playback control method is executed by a computer to control a playback time of the signed-out content in accordance with an amount of activity of the user after signing in to the virtual space again. program.

Images