Reproduction device and reproduction method

Abstract

To further improve a satisfaction level of a user in a virtual space.SOLUTION: A reproduction device 20 comprises: a recording control section 21 for recording in a recording section 23 first class information for which history information of an avatar is classified in accordance with an area or second class information for which the history information of the avatar is classified in accordance with a conversation content together with an action log of the avatar in a virtual space; and a reproduction section 22 by which, when reproducing an action of the avatar in the virtual space, a predetermined priority is applied to an action log in which a class to which the history information of the avatar operated by a user belongs matches the first class information or the second class information, an action log of which the priority is equal to or higher than a predetermined threshold is selected and the action of the avatar is reproduced on the basis of the selected action log.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present invention relates to a playback device and a playback method. [Background technology]

[0002] In recent years, virtual spaces, especially those called metaverse spaces, which allow an unspecified number of users to log in from various locations around the world and interact with each other, have evolved and attracted attention. However, due to the flexibility of users' login times in metaverse spaces, there can be times when only a small number of users are logged in. Users who log in during such times may have the impression that the metaverse space is a lifeless and boring space, which raises concerns about a decline in user satisfaction with the metaverse space.

[0003] Therefore, in order to improve user satisfaction in virtual spaces such as the Metaverse, techniques have recently been proposed for creating a lively virtual space. For example, according to the technique described in Patent Document 1, a log of the actions of a first avatar operated by a first user while the first user is viewing content is generated, and when a second user views the content after the first user has viewed the content, the content is played back and the actions of the first avatar are played back based on the log. This makes it possible to create the impression that the second user is viewing the content together with the first user in the virtual space. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2022-184724 Summary of the Invention [Problem to be solved by the invention]

[0005] In a virtual space such as the Metaverse, it is possible to reproduce past avatars by applying the technology described in the above-mentioned Patent Document 1. However, if there are many past avatars behaving completely differently from the avatar operated by the user (for example, avatars moving through completely different areas), the user may feel alienated, which may actually reduce satisfaction in the virtual space.

[0006] The present invention has been made in view of the above-mentioned problems, and an object of the present invention is to provide a playback device and a playback method that can further improve user satisfaction in virtual space. [Means for solving the problem]

[0007] A playback device according to one aspect includes: a recording control unit that records, in the virtual space, first class information in which the avatar's history information is classified according to area or second class information in which the avatar's history information is classified according to conversation content, together with an avatar's action log; The system is equipped with a playback unit that, when playing back the actions of an avatar in the virtual space, assigns a predetermined priority to the action logs whose first class information or second class information matches the class to which the history information of the avatar operated by the user belongs, selects the action logs whose priority is equal to or greater than a predetermined threshold, and plays back the actions of the avatar based on the selected action logs.

[0008] A reproducing method according to one aspect includes: A playback method executed by a playback device, comprising: a recording control step of recording, in the virtual space, first class information in which the avatar's history information is classified according to area or second class information in which the avatar's history information is classified according to conversation content, together with an avatar's action log, in a recording unit; and a playback step of assigning a predetermined priority to the action logs whose first class information or second class information matches the class to which the history information of the avatar operated by the user belongs when playing back the actions of the avatar in the virtual space, selecting the action logs whose priority is equal to or greater than a predetermined threshold, and playing back the actions of the avatar based on the selected action logs. [Effects of the Invention]

[0009] According to the above-described aspect, it is possible to provide a playback device and a playback method that can further improve the user's satisfaction in the virtual space. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 10 is a diagram illustrating an example of an image of a metaverse space when a large number of users are logged in. [Figure 2] FIG. 10 is a diagram illustrating an example of an image of a metaverse space when the number of logged-in users is extremely small. [Figure 3] 1 is a block diagram showing an example of the configuration of a playback device according to the first embodiment. [Figure 4] 1 is a flowchart illustrating an example of a schematic operation flow when the movement of an avatar is reproduced in the reproduction device according to the first embodiment. [Figure 5] FIG. 10 is a block diagram showing an example of the configuration of a playback device according to a second embodiment. [Figure 6] 10 is a flowchart illustrating an example of a schematic operation flow when the movement of an avatar is reproduced in the reproduction device according to the second embodiment. FIG. [Figure 7] FIG. 11 is a block diagram showing an example of the configuration of a playback device according to a third embodiment. [Figure 8] FIG. 11 is a flowchart illustrating an example of a schematic operation flow when the movement of an avatar is reproduced in the reproduction device according to the third embodiment. [Figure 9] FIG. 11 is a block diagram showing an example of the configuration of a playback device according to a fourth embodiment. [Figure 10]FIG. 13 is a flowchart illustrating an example of a schematic operation flow when the movement of an avatar is reproduced in the reproduction device according to the fourth embodiment. [Figure 11] FIG. 10 is a block diagram showing an example of the hardware configuration of a computer that implements all or part of the functions of the playback devices according to the first to fourth embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the following description and drawings have been omitted and simplified as appropriate for clarity of explanation. In addition, in the following drawings, the same elements are given the same reference numerals, and duplicate explanations are omitted as necessary.

[0012] <First Embodiment> First, before describing the playback device 10 according to the first embodiment, differences in the impression of the metaverse space depending on the number of logged-in users will be described.

[0013] Figure 1 shows an example of what the metaverse space looks like when there are many logged-in users. In the metaverse space shown in Figure 1, there are many avatars other than the avatars operated by the users. This gives the user the impression that the metaverse space is lively and bustling.

[0014] On the other hand, Figure 2 shows an example of what the metaverse space looks like when there are extremely few logged-in users. In the metaverse space shown in Figure 2, there is only one avatar other than the avatar operated by the user. This gives the user the impression that the metaverse space is lifeless and boring. As a result, there is a concern that user satisfaction with the metaverse space will decrease.

[0015] The playback device 10 of this embodiment 1 is configured as follows to play back past avatars in the metaverse space that behave in a similar manner to the avatar operated by the user.

[0016] FIG. 3 is a block diagram showing an example of the configuration of the playback device 10 according to the first embodiment. 3, the playback device 10 according to the first embodiment includes an avatar movement input unit 11, an avatar movement control unit 12, a classification unit 13, a recording unit 14, a selection unit 15, an avatar drawing unit 16, and a display unit 17. However, the recording unit 14 and the display unit 17 are not essential components of the playback device 10, and may be provided outside the playback device 10.

[0017] The avatar action input unit 11 receives instructions from a user who has logged in to the metaverse space regarding the action of the avatar that the user will operate. The avatar movement control unit 12 generates avatar movement control data, which is data for controlling the movement of the avatar in the metaverse space, based on instructions input to the avatar movement input unit 11. The avatar movement control data indicates the joint movements, facial expressions, movement path, conversation content, etc. of the avatar.

[0018] The classification unit 13 determines the area in the metaverse where the avatar is located based on the avatar movement control data generated by the avatar movement control unit 12, and classifies the area where the avatar is located into a class. The classes are, for example, genre-specific classes such as fashion, sports, travel, movies, music, and beauty / health. For example, if the area where the avatar is located is a fashion-related area, the classification unit 13 determines that the user operating the avatar has a taste for fashion, and classifies the area where the avatar is located into a class corresponding to fashion. Note that if the avatar is located in multiple areas of different genres, or if the avatar is located in areas related to multiple genres, the classification unit 13 may classify the area where the avatar is located into multiple classes.

[0019] The classification unit 13 may classify the area into classes based on objects placed in the area where the avatar is located or events being held in the area. The classification unit 13 may include a machine learning model that classifies images into one of a plurality of predetermined classes, and may classify the area into classes by having the machine learning model infer images of objects placed in the area or events being held. The classification unit 13 may store in advance which genre a predetermined area in the virtual space corresponds to. If the area where the avatar is located matches the stored predetermined area, the classification unit 13 may classify the area into the corresponding genre. The classification unit 13 may store in advance the association between genres and classes. The classification unit 13 may associate one genre with one class on a one-to-one basis, or may associate two or more genres with one class, or may associate one genre with two or more classes. The classification unit 13 may classify the classified genre into the corresponding class.

[0020] The avatar movement control unit 12 records a movement log (e.g., the avatar's joint movements, facial expressions, movement path, conversation content, etc.) corresponding to the avatar's movement control data in the recording unit 14 together with first class information indicating the class into which the classification unit 13 classifies the area.

[0021] When a user logs in to the metaverse space, selection unit 15 selects the movement control data of the avatar to be operated by the user, which data was generated by avatar movement control unit 12, and passes the selected movement control data to avatar drawing unit 16. Avatar drawing unit 16 draws the movement of the avatar on display unit 17 based on the movement control data passed from selection unit 15.

[0022] In addition, when a user logs in to the metaverse space, the selection unit 15 compares the number of avatars currently present in the metaverse space (i.e., the number of users logged in to the metaverse space) with a first threshold value, in parallel with or before performing the above-mentioned operation.

[0023] As a result, if the number of avatars existing in the metaverse space is equal to or greater than the first threshold, the avatar's actions are not played back. In other words, the selection unit 15 does not select an action log from the recording unit 14 that records the past avatar actions operated by users who had previously logged in to the metaverse space.

[0024] On the other hand, if the number of avatars existing in the metaverse space is less than the first threshold, the actions of the avatars are played back. That is, the selection unit 15 selects an action log from the recording unit 14 in which past avatar actions operated by users who had previously logged in to the metaverse space are recorded. To this end, the selection unit 15 subsequently performs the following operations.

[0025] The selection unit 15 continuously determines the area in the metaverse space where the avatar being drawn is located, based on the motion control data of the avatar being drawn operated by the user, until a predetermined timing is reached. The predetermined timing may be, for example, the timing when a predetermined time has elapsed since the drawing of the avatar being drawn started, or the timing when the avatar being drawn has moved through a predetermined number of areas or more.

[0026] At a predetermined timing, the selection unit 15 determines the class to which the area in which the avatar being drawn operated by the user has been located up to that point belongs. The class determination at this time may be the same as that by the classification unit 13. Furthermore, when the avatar being drawn is located in multiple areas of different genres or when the avatar being drawn is located in areas related to multiple genres, the selection unit 15 may determine that the area in which the avatar being drawn is located belongs to multiple classes. The selection unit 15 may use the class into which the classification unit 13 has classified the history information of the avatar operated by the user as the class to which the history information (areas in which the avatar has been located up to that point) of the avatar being drawn and operated by the user belongs. The selection unit 15 may use the class to which the historical information of the avatar being drawn by the user (the area in which it has been located up to that point) belongs, which is classified by the classification unit 13 and recorded in the recording unit 14 by the avatar action control unit 12.

[0027] Next, the selection unit 15 compares the class to which the area where the avatar being drawn operated by the user is located with the class indicated by the first class information recorded in the recording unit 14 together with the avatar's action log. The selection unit 15 then assigns a high priority (e.g., a priority equal to or greater than a first reference value) to an action log in which the class to which the area where the avatar being drawn belongs matches the class indicated by the first class information. For example, assume that the class to which the area where the avatar being drawn belongs is #1, #2, or #3. In this case, the selection unit 15 may assign a high priority to an action log in which the first class information indicates any of #1, #2, or #3, or may assign a high priority only to an action log in which the first class information indicates all of #1, #2, and #3. The selection unit 15 may assign different priorities depending on whether the first class information partially matches, as in the former case, or completely matches, as in the latter case.

[0028] If an action log with a priority equal to or higher than the second threshold exists in the recording unit 14, the selection unit 15 selects that action log. At this time, the selection unit 15 may exclude action logs of avatars previously operated by a user logged in to the metaverse space, i.e., select action logs of avatars previously operated by a user other than the logged-in user. The selection unit 15 may also limit the number of action logs to a predetermined number. When selecting a predetermined number of action logs from multiple action logs, the selection unit 15 may compare the date and time of the action log with the date and time of playback and select the action logs in descending order of the date and time of the action log closest to the date and time of playback. Here, the playback may be the current date and time, or the date and time at which the selection unit 15 selects the action log. Alternatively, the selection unit 15 may compare the date and time of the action log with a specific date and time specified by the user and select the action logs in descending order of the date and time of the action log closest to the specific date and time. The specific date and time may be, for example, the user's birthday, Christmas, New Year's, or the date and time of a specific event.

[0029] The selection unit 15 passes the motion control data of the motion log selected from the recording unit 14 to the avatar drawing unit 16. The avatar drawing unit 16 draws (plays) the motion of the avatar on the display unit 17 based on the motion control data passed from the selection unit 15.

[0030] On the other hand, if there is no action log with a priority equal to or higher than the second threshold in recording unit 14, selection unit 15 may select no action log and avatar drawing unit 16 may not play back the avatar's actions. Alternatively, selection unit 15 may set a new threshold lower than the second threshold, select an action log with a priority equal to or higher than the new threshold, and avatar drawing unit 16 may play back the avatar's actions.

[0031] The avatar movement input unit 11 may be realized by, for example, a controller for moving an avatar, a mouse, a keyboard, a touch panel, a sensor attached to an HMD (Head Mounted Display), a motion capture system, or the like. The recording unit 14 may be realized by, for example, a memory configured by combining a volatile memory and a non-volatile memory. The avatar movement control unit 12, the classification unit 13, the selection unit 15, and the avatar drawing unit 16 may be realized by, for example, a processor such as a microprocessor, an MPU (Micro Processing Unit), or a CPU (Central Processing Unit). The avatar movement control unit 12, the classification unit 13, the selection unit 15, and the avatar drawing unit 16 may be realized by, for example, a processor reading and executing a program stored in a memory that realizes the recording unit 14. The display unit 17 may be realized by, for example, a display device.

[0032] Fig. 4 is a flow diagram illustrating an example of a schematic operation flow when reproducing the actions of an avatar in the reproduction device 10 according to the present embodiment 1. Note that Fig. 4 assumes that the action logs of past avatars that previously existed in the metaverse space have already been recorded in the recording unit 14 together with first class information indicating classes classified according to the areas in which the past avatars were located.

[0033] 4, the selection unit 15 determines whether or not a user has logged in to the metaverse space (step S11). If a user has not logged in (No in step S11), the process returns to step S11.

[0034] In step S11, when a user logs in to the metaverse space (Yes in step S11), the avatar movement control unit 12 generates movement control data for the avatar to be operated by the user, the selection unit 15 selects the movement control data generated by the avatar movement control unit 12, and the avatar drawing unit 16 draws the movement of the avatar on the display unit 17 based on the movement control data selected by the selection unit 15 (step S12).

[0035] In addition, in parallel with the operation of step S12, the selection unit 15 compares the number of avatars currently existing in the metaverse space with a first threshold value (step S13). Note that the operation of step S13 may be performed before the operation of step S12.

[0036] In step S13, if the number of avatars is less than the first threshold (Yes in step S13), the selection unit 15 selects past avatar action logs from the recording unit 14, and performs the following operation.

[0037] At a later predetermined timing, the selection unit 15 determines the class to which the area in which the avatar being drawn operated by the user has been located up to that point belongs. Then, the selection unit 15 assigns a high priority (for example, a priority equal to or higher than a first reference value) to an action log in which the class determined for the avatar being drawn matches the class indicated by the first class information recorded together with the action log in the recording unit 14 (step S14).

[0038] Next, the selection unit 15 selects from the recording unit 14 an operation log whose priority is equal to or higher than the second threshold (step S15).

[0039] Thereafter, avatar drawing unit 16 draws (plays) the avatar's movements on display unit 17 based on the movement control data corresponding to the movement log of the avatar selected by selection unit 15 (step S16).

[0040] On the other hand, in step S13, if the number of avatars is equal to or greater than the first threshold (No in step S13), the selection unit 15 decides not to select any past avatar action logs, and ends the process.

[0041] As described above, according to the first embodiment, avatar action control unit 12 records in recording unit 14 action logs of past avatars operated by users who previously logged in to the metaverse space, along with first class information indicating classes classified according to areas where the past avatars were located. When a user subsequently logs in to the metaverse space, avatar drawing unit 16 draws the action of the avatar operated by the user. Furthermore, if the number of avatars currently existing in the metaverse space is less than a first threshold, selection unit 15 assigns a high priority (e.g., a priority equal to or greater than a first reference value) to an action log in which the class to which the area in which the avatar currently being drawn by the user was previously located matches the class indicated by the first class information recorded together with the action log in recording unit 14. Then, selection unit 15 selects, from recording unit 14, action logs with a priority equal to or greater than a second threshold. Then, avatar drawing unit 16 plays back the action of the avatar based on the action log of the selected avatar.

[0042] This allows for a lively metaverse space to be created even during times when there are few logged-in users. Furthermore, the avatar operating according to the operation log at this time is expected to be located in the same area as the avatar being drawn and operated by the user, and to be an avatar behaving in a similar manner. Therefore, when a user sees an avatar operating according to the operation log, they will feel as if there are other users besides the user operating the avatar in real time whose avatars are behaving in a similar manner. This further improves user satisfaction in the metaverse space.

[0043] <Embodiment 2> FIG. 5 is a block diagram showing an example of the configuration of a playback device 10A according to the second embodiment. As shown in FIG. 5, playback device 10A according to the second embodiment differs from playback device 10 according to the first embodiment described above in that avatar movement control unit 12, classification unit 13, and selection unit 15 are replaced with avatar movement control unit 12A, classification unit 13A, and selection unit 15A, respectively.

[0044] Note that avatar movement control unit 12A, classification unit 13A, and selection unit 15A only partially differ in their operations from avatar movement control unit 12, classification unit 13, and selection unit 15. Therefore, the following description will focus on the operations of avatar movement control unit 12A, classification unit 13A, and selection unit 15A that differ from those of avatar movement control unit 12, classification unit 13, and selection unit 15.

[0045] The classification unit 13A classifies the areas in which avatars are located in the metaverse space into classes, similar to the first embodiment described above. In addition, the classification unit 13A determines the content of the conversation that the avatar had in the metaverse space based on the avatar movement control data generated by the avatar movement control unit 12A, and classifies the content of the avatar's conversation into classes. The classes are, for example, genre-specific classes such as fashion, sports, travel, movies, music, and beauty / health. For example, if the content of the avatar's conversation is fashion-related, the classification unit 13A determines that the user operating the avatar has a taste for fashion, and classifies the content of the avatar's conversation into a class corresponding to fashion. Note that if the avatar has conversations related to multiple genres, the classification unit 13A may classify the content of the avatar's conversation into multiple classes.

[0046] The playback device 10A may further include an operation unit 18 (not shown) connected to the classification unit 13A, and the operation unit 18 may receive a conversation from a user via a microphone. The classification unit 13A may use the conversation from the user as the conversation content of the avatar. The classification unit 13A may include a machine learning model that classifies the conversation content into one of a plurality of predetermined classes, and may classify the conversation content into a class by having the machine learning model infer the conversation content of the avatar. The classification unit 13A may store in advance which genre a predetermined word corresponds to. The classification unit 13A may extract words by performing voice recognition on the content of the conversation, and if any of the words matches the stored predetermined words, classify the conversation into the corresponding genre. The classification unit 13A may store in advance the association between genres and classes. The classification unit 13A may associate one genre with one class on a one-to-one basis, or may associate two or more genres with one class, or may associate one genre with two or more classes. The classification unit 13A may classify the classified genres into corresponding classes.

[0047] The avatar movement control unit 12A records the movement log corresponding to the avatar movement control data in the recording unit 14 together with first class information indicating the class classified by the classification unit 13A according to the area, and second class information indicating the class classified by the classification unit 13A according to the conversation content.

[0048] As in the first embodiment described above, when a user logs in to the metaverse space, if the number of avatars present in the metaverse space is less than a first threshold, at a later specified timing, the selection unit 15A assigns a high priority (for example, a priority equal to or greater than a first reference value) to an operation log in which the class to which the area in which the avatar being drawn by the user has been located up to that point matches the class indicated by the first class information recorded in the recording unit 14 together with the avatar's operation log.

[0049] In addition, at the predetermined timing, the selection unit 15A determines the class to which the conversation content of the avatar being drawn operated by the user belongs. The class determination at this time may be the same as that of the classification unit 13A. Furthermore, if the avatar being drawn has had conversations related to multiple genres, the selection unit 15A may classify the conversation content of the avatar being drawn into multiple classes. The selection unit 15A may use the class into which the classification unit 13A classifies the historical information of the avatar operated by the user as the class to which the historical information (areas in which the avatar has been located or conversations that have taken place up to that point) of the avatar being drawn and operated by the user belongs. The selection unit 15A may use the class to which the historical information of the avatar being drawn by the user (the area in which the avatar has been located or the content of the conversation that has taken place up to that point) belongs, which is classified by the classification unit 13A and recorded in the recording unit 14 by the avatar action control unit 12A. Next, the selection unit 15A assigns a high priority (for example, a priority equal to or greater than the second reference value) to an action log whose class corresponds to the class to which the conversational content of the avatar being drawn belongs and the class indicated by the second class information recorded together with the avatar's action log in the recording unit 14. In this case, the first reference value and the second reference value may be the same value or different values.

[0050] As a result, the total priority value is a value according to the area in which the avatar being drawn is located and the content of the conversation. The selection unit 15A calculates the total priority value of the priority assigned based on the class indicated by the first class information and the priority assigned based on the class indicated by the second class information. Then, the selection unit 15A selects the action logs whose total priority value is equal to or greater than the second threshold value. In the second embodiment, the configuration other than the above is the same as that of the first embodiment.

[0051] Avatar movement control unit 12A, classification unit 13A, and selection unit 15A may be realized by a processor such as a microprocessor, an MPU, or a CPU. Avatar movement control unit 12A, classification unit 13A, and selection unit 15A may also be realized by a processor reading and executing a program stored in a memory that realizes recording unit 14.

[0052] Fig. 6 is a flow diagram illustrating an example of a schematic operation flow when reproducing the actions of an avatar in reproduction device 10A according to Embodiment 2. Note that Fig. 6 assumes that the action logs of past avatars that previously existed in the metaverse space have already been recorded in recording unit 14 together with first class information indicating classes classified according to the areas in which the past avatars were located and second class information indicating classes classified according to the content of conversations that the past avatars had.

[0053] As shown in FIG. 6, first, the processes of steps S11 to S13 similar to steps S11 to S13 in FIG. 4 in the first embodiment are performed.

[0054] In step S13, if the number of avatars is less than the first threshold (Yes in step S13), the selection unit 15A selects past avatar action logs from the recording unit 14, and performs the following operation.

[0055] At a later predetermined timing, the selection unit 15A determines the class to which the area in which the avatar being drawn operated by the user has been located up to that point belongs. Then, the selection unit 15A assigns a high priority (for example, a priority equal to or higher than the first reference value) to an action log in which the class determined for the avatar being drawn matches the class indicated by the first class information recorded together with the action log in the recording unit 14 (step S24).

[0056] Furthermore, the selection unit 15A determines the class to which the conversation content that the avatar being drawn operated by the user has so far belongs. Then, the selection unit 15A assigns a high priority (for example, a priority equal to or higher than the second reference value) to an action log in which the class determined for the avatar being drawn matches the class indicated by the second class information recorded together with the action log in the recording unit 14 (step S25). Note that the operation of step S25 may be performed in parallel with the operation of step S24, or may be performed before the operation of step S24.

[0057] Next, the selection unit 15A calculates the sum of the priority assigned based on the class indicated by the first class information and the priority assigned based on the class indicated by the second class information (step S26).The selection unit 15A also selects, from the recording unit 14, operation logs whose sum of priorities is equal to or greater than a second threshold (step S27).

[0058] Thereafter, avatar drawing unit 16 draws (plays) the avatar's movements on display unit 17 based on the movement control data corresponding to the movement log of the avatar selected by selection unit 15A (step S28).

[0059] On the other hand, in step S13, if the number of avatars is equal to or greater than the first threshold (No in step S13), the selection unit 15A decides not to select any past avatar action logs, and ends the process.

[0060] As described above, according to the second embodiment, avatar action control unit 12A records in recording unit 14 action logs of past avatars operated by users who previously logged in to the metaverse space, together with first class information indicating classes classified according to areas where the past avatars were located and second class information indicating classes classified according to conversations that the past avatars had. When a user subsequently logs in to the metaverse space, avatar drawing unit 16 draws the actions of the avatars operated by the users. Furthermore, if the number of avatars currently present in the metaverse space is less than a first threshold, selection unit 15A assigns a high priority (e.g., a priority equal to or greater than a first reference value) to an action log in which the class to which the area in which the avatar being drawn operated by the user was previously located belongs matches the class indicated by the first class information recorded in recording unit 14 together with the action log. Furthermore, the selection unit 15A assigns a high priority (e.g., a priority equal to or greater than a second reference value) to an action log in which the class to which the conversation content of the avatar being drawn and operated by the user belongs matches the class indicated by the second class information recorded together with the action log in the recording unit 14. The selection unit 15A then selects action logs from the recording unit 14 whose total priority value is equal to or greater than a second threshold value. Thereafter, the avatar drawing unit 16 plays back the action of the avatar based on the action log of the selected avatar.

[0061] At this time, the avatar operating according to the action log is an avatar located in the same area as the avatar being drawn and operated by the user, and is having a conversation with similar content. Therefore, compared to the first embodiment described above, the avatar operating according to the action log is expected to behave more similarly to the avatar being drawn and operated by the user. As a result, the user can obtain a higher level of satisfaction in the metaverse space. Other effects are the same as those of the first embodiment described above.

[0062] In the second embodiment, avatar movement control unit 12A records two types of class information, one classified according to area and the other classified according to conversation content, along with past avatar movement logs. However, this is not limiting. Classification unit 13A may classify past avatars into one class according to area and conversation content. Avatar movement control unit 12A may record one type of class information classified according to area and conversation content along with past avatar movement logs.

[0063] Furthermore, classification unit 13A may classify past avatars into classes according to the content of the conversation (regardless of the area). Avatar movement control unit 12A may record second class information indicating the class into which the avatars have been classified according to the content of the conversation (regardless of the area) along with past avatar movement logs. Selector 15A may select movement logs whose priority, assigned based on the class indicated by the second class information, is equal to or greater than a second threshold.

[0064] <Third Embodiment> FIG. 7 is a block diagram showing an example of the configuration of a playback device 10B according to the third embodiment. As shown in FIG. 7, playback device 10B according to the third embodiment differs from playback device 10 according to the first embodiment described above in that avatar movement control unit 12, classification unit 13, and selection unit 15 are replaced with avatar movement control unit 12B, classification unit 13B, and selection unit 15B, respectively.

[0065] Note that avatar movement control unit 12B, classification unit 13B, and selection unit 15B only partially differ in their operations from avatar movement control unit 12, classification unit 13, and selection unit 15. Therefore, the following description will focus on the operations of avatar movement control unit 12B, classification unit 13B, and selection unit 15B that differ from those of avatar movement control unit 12, classification unit 13, and selection unit 15.

[0066] The classification unit 13B classifies the areas in which avatars are located in the metaverse space into classes, similar to the first embodiment described above. In addition, the classification unit 13B classifies the attributes of users who operate avatars in the metaverse space into classes. User attributes may be, for example, age, gender, address / place of residence, family structure, occupation, etc. Furthermore, if the user attribute is age, for example, the class may be an age group. In other words, the class to which the user's attributes belong is a classification of the user's attributes. The classification unit 13B may classify users into a plurality of classes. For example, if the user is a 25-year-old male, the classification unit 13B may classify the user into a class for those in their twenties and a class for men as classes to which the user's attributes belong. In this case, for example, the classification unit 13B may determine the attributes of the user operating the avatar based on the movement of the avatar. Alternatively, if user information including the user attributes is obtained in advance, such as by recording the user attributes in the recording unit 14, the classification unit 13B may determine the user attributes from the user information.

[0067] The playback device 10B further includes an operation unit 18 (not shown) connected to the recording unit 14. The operation unit 18 may accept various operations from the user via a touch panel display surface, or may accept various operations from the user using various buttons, a keyboard, or a mouse. The operation unit 18 may be displayed on the display unit 17 instead of on the display surface of the touch panel. The user may input user attributes via the operation unit 18, and the playback device 10B may record the input user attributes in the recording unit 14. The classification unit 13B may include a machine learning model that classifies attributes into one of a plurality of predetermined classes, and may classify the user attributes into classes by having the machine learning model infer the user attributes. The classification unit 13B may store in advance which user attributes correspond to which predetermined ages. When the user's age matches the stored predetermined age, the classification unit 13B may classify the user into the corresponding user attribute. The classification unit 13B may store in advance which predetermined combinations of age, sex, address / place of residence, family structure, and occupation correspond to which user attributes. When some combinations of the user's age, sex, address / place of residence, family structure, and occupation match the stored predetermined combinations, the classification unit 13B may classify the user into the corresponding user attribute. The classification unit 13B may store in advance the association between user attributes and classes. The classification unit 13B may associate one user attribute with one class on a one-to-one basis, or may associate two or more user attributes with one class, or may associate one user attribute with two or more classes. The classification unit 13B may classify users into corresponding classes based on the classified user attributes.

[0068] The avatar movement control unit 12B records the movement log corresponding to the avatar movement control data in the recording unit 14 together with first class information indicating the class classified by the classification unit 13B according to the area, and third class information indicating the class classified by the classification unit 13B according to the attributes of the user operating the avatar.

[0069] As in the first embodiment described above, when a user logs in to the metaverse space, if the number of avatars present in the metaverse space is less than a first threshold, at a later specified timing, the selection unit 15B assigns a high priority (for example, a priority equal to or greater than a first reference value) to an operation log in which the class to which the area in which the avatar being drawn by the user has been located up to that point matches the class indicated by the first class information recorded in the recording unit 14 together with the avatar's operation log.

[0070] In addition, at the predetermined timing, the selection unit 15B assigns a high priority (for example, a priority equal to or greater than the third reference value) to an action log in which the attributes of the user operating the avatar being drawn match the class indicated by the third class information recorded together with the avatar's action log in the recording unit 14. In this case, the first reference value and the third reference value may be the same value or different values.

[0071] As a result, the total priority value becomes a value according to the area in which the drawn avatar is located and the attributes of the user operating the drawn avatar. The selection unit 15B calculates the total priority value of the priority assigned based on the class indicated by the first class information and the priority assigned based on the class indicated by the third class information. Then, the selection unit 15B selects operation logs whose total priority value is equal to or greater than the second threshold. In the third embodiment, the configuration other than the above is the same as that of the first embodiment.

[0072] Avatar movement control unit 12B, classification unit 13B, and selection unit 15B may be realized by a processor such as a microprocessor, an MPU, or a CPU. Avatar movement control unit 12B, classification unit 13B, and selection unit 15B may also be realized by a processor reading and executing a program stored in a memory that realizes recording unit 14.

[0073] Fig. 8 is a flow diagram illustrating an example of a schematic operation flow when reproducing the actions of an avatar in reproduction device 10B according to Embodiment 3. Note that Fig. 8 assumes that the action logs of past avatars that previously existed in the metaverse space have already been recorded in recording unit 14 together with first class information indicating classes classified according to the areas in which the past avatars were located, and third class information indicating classes classified according to the attributes of the users operating the past avatars.

[0074] As shown in FIG. 8, first, the processes of steps S11 to S13 similar to steps S11 to S13 in FIG. 4 in the first embodiment are performed.

[0075] In step S13, if the number of avatars is less than the first threshold (Yes in step S13), the selection unit 15B selects past avatar action logs from the recording unit 14, and performs the following operation.

[0076] At a later predetermined timing, the selection unit 15B determines the class to which the area in which the avatar being drawn operated by the user has been located up to that point belongs. Then, the selection unit 15B assigns a high priority (for example, a priority equal to or higher than the first reference value) to an action log in which the class determined for the avatar being drawn matches the class indicated by the first class information recorded together with the action log in the recording unit 14 (step S34).

[0077] Furthermore, the selection unit 15B determines the class to which the attributes of the user operating the avatar being drawn belong. Then, the selection unit 15B assigns a high priority (for example, a priority equal to or greater than the third reference value) to an action log in which the class determined for the avatar being drawn matches the class indicated by the third class information recorded together with the action log in the recording unit 14 (step S35). Note that the operation of step S35 may be performed in parallel with the operation of step S34, or may be performed before the operation of step S34.

[0078] Next, the selector 15B calculates the sum of the priority assigned based on the class indicated by the first class information and the priority assigned based on the class indicated by the third class information (step S36).The selector 15B also selects, from the recorder 14, operation logs whose sum of priorities is equal to or greater than a second threshold (step S37).

[0079] Thereafter, avatar drawing unit 16 draws (plays) the avatar's movements on display unit 17 based on the movement control data corresponding to the movement log of the avatar selected by selection unit 15B (step S38).

[0080] On the other hand, in step S13, if the number of avatars is equal to or greater than the first threshold (No in step S13), the selection unit 15B decides not to select any past avatar action logs, and ends the process.

[0081] As described above, according to the third embodiment, avatar action control unit 12B records in recording unit 14 action logs of past avatars operated by users who previously logged in to the metaverse space, together with first class information indicating classes classified according to the areas in which the past avatars were located and third class information indicating classes classified according to the attributes of the users who operated the past avatars. When a user subsequently logs in to the metaverse space, avatar drawing unit 16 draws the action of the avatar operated by the user. Furthermore, if the number of avatars currently existing in the metaverse space is less than a first threshold, selection unit 15B assigns a high priority (e.g., a priority equal to or greater than a first reference value) to an action log in which the class to which the area in which the avatar being drawn and operated by the user was previously located belongs matches the class indicated by the first class information recorded in recording unit 14 together with the action log. Furthermore, the selection unit 15B assigns a high priority (e.g., a priority equal to or greater than a third reference value) to an action log whose class corresponds to the attribute of the user operating the avatar being drawn and the class indicated by the third class information recorded together with the action log in the recording unit 14. The selection unit 15B then selects action logs from the recording unit 14 whose total priority value is equal to or greater than a second threshold value. The avatar drawing unit 16 then plays back the action of the avatar based on the action log of the selected avatar.

[0082] At this time, the avatar operating according to the operation log is located in the same area as the avatar being drawn and operated by the user, and is an avatar operated by a user with similar attributes to the user operating the avatar being drawn. Therefore, compared to the first embodiment described above, the avatar operating according to the operation log is expected to behave more similarly to the avatar being drawn and operated by the user. As a result, the user can obtain a higher level of satisfaction in the metaverse space. Other effects are the same as those of the first embodiment described above.

[0083] Although the third embodiment is based on the first embodiment described above, it is not limited to this and may be based on the second embodiment described above. That is, in the third embodiment, the classification unit 13B may classify past avatars into classes according to the content of their conversations, and the avatar movement control unit 12B may record the class information classified according to the content of their conversations along with the movement logs of the past avatars. Furthermore, the selection unit 15B may assign a high priority to a movement log that matches the class to which the conversation content of the avatar currently being drawn belongs.

[0084] Furthermore, classification unit 13B may classify past avatars into classes according to the content of the conversation (regardless of the area). Avatar movement control unit 12B may record second class information indicating the class into which the avatars are classified according to the content of the conversation (regardless of the area), along with the movement logs of past avatars. Selector 15A may select movement logs for which the sum of the priority assigned based on the class indicated by the second class information and the priority assigned based on the class indicated by the third class information is equal to or greater than a second threshold. Furthermore, classification unit 13B may classify past avatars into classes according to user attributes (regardless of area or conversation content). Avatar movement control unit 12B may record third class information indicating classes classified according to user attributes (regardless of area or conversation content) along with past avatar movement logs. Selector 15A may select movement logs whose priority, assigned based on the class indicated by the third class information, is equal to or greater than a second threshold.

[0085] <Fourth Embodiment> 9 is a block diagram showing an example of the configuration of a playback device 20 according to the fourth embodiment. The fourth embodiment corresponds to an embodiment that is a superordinate concept of the first to third embodiments described above. As shown in FIG. 9, a playback device 20 according to the fourth embodiment includes a recording control unit 21 and a playback unit 22.

[0086] The recording control unit 21 corresponds to the avatar movement control units 12, 12A, and 12B and the classification units 13, 13A, and 13B in the above-described embodiments 1 to 3. The playback unit 22 corresponds to the selection units 15, 15A, and 15B and the avatar drawing unit 16 in the above-described embodiments 1 to 3.

[0087] The recording control unit 21 records, in the virtual space, first class information in which avatar history information is classified according to area, or second class information in which avatar history information is classified according to conversation content, together with an avatar's action log, in the recording unit 23 outside the playback device 20. The history information may include at least the area in which the avatar was located or the conversation content of the avatar. The classes are, for example, genre-specific classes such as fashion, sports, travel, movies, music, beauty and health, etc. The recording control unit 21 may record, in the recording unit 23, first class information classified according to area information for information on the area in which the avatar was located, included in the avatar history information. The recording control unit 21 may record, in the recording unit 23, second class information classified according to conversation content information for information on conversation content of the avatar, included in the avatar history information. The recording unit 23 corresponds to the recording unit 14 according to the first to third embodiments described above, but is not limited to being provided outside the playback device 20, and may be provided inside the playback device 20. The recording control unit 21 may store in advance which genre a predetermined area in the virtual space corresponds to. If the area where the avatar is located matches the stored predetermined area, the recording control unit 21 may classify the area into the corresponding genre. The recording control unit 21 may store in advance the association between genres and classes. The recording control unit 21 may associate one genre with one class on a one-to-one basis, or may associate two or more genres with one class, or may associate one genre with two or more classes. The recording control unit 21 may classify the classified genres into corresponding classes. The recording control unit 21 may store in advance which genre a predetermined word corresponds to. The recording control unit 21 may extract words by performing voice recognition on the content of the conversation, and if any of the words matches the stored predetermined words, classify the conversation into the corresponding genre. If the area in which the avatar contained in the history information is located matches a stored predetermined area, the recording control unit 21 may classify the avatar into the corresponding genre, or may classify the classified genre into a class. The recording control unit 21 performs voice recognition on the conversation content included in the history information to extract words, and if any of the words matches a stored predetermined word, it may classify it into the corresponding genre, or it may classify the classified genre into a class.

[0088] The playback unit 22 plays back the actions of the avatar on a display unit 24 outside the playback device 20, based on the action log and the first class information or the second class information recorded in the recording unit 23. The display unit 24 corresponds to the display unit 17 according to the first to third embodiments described above, but is not limited to being provided outside the playback device 20, and may be provided inside the playback device 20.

[0089] When reproducing the actions of an avatar in a virtual space, the reproduction unit 22 assigns a predetermined priority to an action log in which the class to which the history information of the avatar operated by the user belongs matches the class indicated by the first class information or the second class information recorded together with the action log in the recording unit 23. Then, the reproduction unit 22 selects an action log whose priority is equal to or higher than a predetermined threshold, and reproduces the actions of the avatar based on the selected action log. The playback unit 22 may use the classes into which the history information of the avatar operated by the user is classified by the recording control unit 21 as the class to which the history information of the avatar operated by the user belongs. The playback unit 22 may use the class into which the history information of the avatar operated by the user belongs, which is classified by the recording control unit 21 and recorded in the recording unit 23. The playback unit 22 may select the operation logs excluding the user's operation log. The recording control unit 21 may record the user ID indicating who the action log belongs to together with the avatar's action log in the recording unit 23. The playback unit 22 may determine whether the user ID in the action log indicates the user himself or herself, and select the action logs excluding the action logs in which the user ID indicates the user himself or herself. The playback unit 22 may select an operation log other than the current operation log. The recording control unit 21 may record the date and time of the avatar's action log together with the action log in the recording unit 23. The playback unit 22 may determine whether the difference between the date and time of the action log and the current time is smaller than a predetermined value, and select action logs excluding those in which the difference between the date and time of the action log and the current time is smaller than the predetermined value. The playback unit 22 may select an operation log other than the user's current operation log. The playback unit 22 may select an operation log excluding an operation log whose user ID indicates the user himself / herself and whose difference between the date and time of the operation log and the current time is smaller than a predetermined value.

[0090] At this time, the reproduction unit 22 may compare the number of avatars present in the virtual space with a first threshold, and if the number is less than the first threshold, reproduce the movements of the avatars. If the number of avatars present in the virtual space is equal to or greater than the first threshold, the reproduction unit 22 may not reproduce the movements of the avatars.

[0091] Alternatively, the reproduction unit 22 may compare the degree of congestion in the virtual space with a second threshold, and reproduce the avatar's movements if the degree is less than the second threshold. The reproduction unit 22 may not reproduce the avatar's movements if the degree of congestion in the virtual space is equal to or greater than the second threshold. Here, the degree of congestion refers to the number of avatars located per unit area of ​​the virtual space.

[0092] Fig. 10 is a flow diagram illustrating an example of a schematic operation flow when reproducing the actions of an avatar in reproduction device 20 according to Embodiment 4. Note that in Fig. 10, it is assumed that the action logs of past avatars that previously existed in the virtual space have already been recorded in recording unit 23 together with first class information indicating classes into which the past avatar's history information has been classified according to the area, or second class information indicating classes into which the past avatar's history information has been classified according to the content of the conversation.

[0093] As shown in Figure 10, when reproducing the actions of an avatar in a virtual space, the playback unit 22 assigns a predetermined priority to an action log in which the class to which the history information of the avatar operated by the user belongs matches the class indicated by the first class information or the second class information recorded together with the action log in the recording unit 23 (step S41).

[0094] Next, the reproducing unit 22 selects from the recording unit 23 an operation log whose priority is equal to or higher than a predetermined threshold (step S42). Thereafter, the reproducing unit 22 reproduces the movements of the avatar based on the movement log selected in step S22 (step S43).

[0095] As described above, according to the fourth embodiment, the recording control unit 21 records, in the recording unit 23, first class information in which avatar history information is classified according to area in the virtual space or second class information in which avatar history information is classified according to conversation content, together with the avatar's action log. When reproducing the avatar's actions in the virtual space, the playback unit 22 assigns a predetermined priority to an action log in which the class to which the avatar's history information operated by the user belongs matches the class indicated by the first class information or the second class information recorded together with the action log in the recording unit 23. Then, the playback unit 22 selects an action log with a priority equal to or higher than a predetermined threshold, and reproduces the avatar's actions based on the selected action log.

[0096] This allows for the creation of a lively virtual space even during times when there are few logged-in users. Furthermore, the avatar operating according to the operation log at this time is expected to have a history similar to that of the avatar currently being drawn and operated by the user, and to be an avatar behaving in a similar manner. This allows the user to feel as if there are other users besides the user operating the avatar in real time whose avatars are behaving in a similar manner. This further improves user satisfaction in the virtual space.

[0097] Furthermore, the recording control unit 21 may further record third class information indicating a class classified according to the attributes of the user operating the avatar in the virtual space together with the avatar's action log in the recording unit 23. In this case, when reproducing the avatar's actions in the virtual space, the reproduction unit 22 may assign a predetermined priority to an action log in which the class to which the user's attributes belong matches the class indicated by the third class information recorded together with the action log in the recording unit 23. Then, the reproduction unit 22 may calculate a total priority value, select action logs whose total priority value is equal to or greater than a predetermined threshold, and reproduce the avatar's actions based on the selected action log.

[0098] The recording control unit 21 may also record, together with the avatar's action log, recording date and time information indicating the date and time the action log was recorded in the recording unit 23. In this case, when reproducing the avatar's actions in the virtual space, the reproduction unit 22 may assign a predetermined priority to action logs for which the difference between the recording date and time indicated by the recording date and time information recorded together with the action log in the recording unit 23 and a predetermined date and time is less than a predetermined threshold. The reproduction unit 22 may then calculate a total priority value, select action logs whose total priority value is equal to or greater than the predetermined threshold, and reproduce the avatar's actions based on the selected action log. The predetermined date and time may be the date and time of reproduction of the avatar, or a specific date and time specified by the user. The specific date and time may be, for example, the user's birthday, Christmas, New Year's, or the date and time of a specific event.

[0099] <Computer that realizes the playback device according to the embodiment> FIG. 11 is a diagram showing an example of the hardware configuration of a computer 30 that implements all or part of the functions of the playback devices 10, 10A, 10B, and 20 according to the first to fourth embodiments described above. As shown in FIG. 11, a computer 30 includes a processor 31 and a memory 32 .

[0100] The processor 31 may be, for example, a microprocessor, an MPU, or a CPU. The processor 31 may include multiple processors.

[0101] The memory 32 is configured by a combination of volatile memory and non-volatile memory. The memory 32 may include storage located remotely from the processor 31. In this case, the processor 31 may access the memory 32 via an I (Input) / O (Output) interface (not shown).

[0102] A program is stored in the memory 32. When the program is loaded into the computer 30, the program includes a set of instructions (or software code) that causes the computer 30 to perform all or part of the functions of the playback devices 10, 10A, 10B, and 20 according to the first to fourth embodiments. The components of the playback devices 10, 10A, 10B, and 20 described above may be realized by the processor 31 reading and executing the program stored in the memory 32. Furthermore, the storage function of the playback devices 10, 10A, 10B, and 20 described above may be realized by the memory 32.

[0103] The above-described programs may also be stored on non-transitory computer-readable media or tangible storage media. By way of example and not limitation, computer-readable media or tangible storage media include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray® disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The programs may also be transmitted on transitory computer-readable media or communication media. By way of example and not limitation, transitory computer-readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.

[0104] The present invention is not limited to the above-described embodiment, and can be modified as appropriate within the scope of the invention. [Explanation of symbols]

[0105] 10,10A,10B playback device 11 Avatar movement input unit 12, 12A, 12B Avatar movement control section 13,13A,13B Classification section 14 Recording section 15, 15A, 15B selection section 16 Avatar Drawing Section 17 Display 20 Playback device 21 Recording control section 22 Playback Department 23 Recording Section 24 Display 30 Computer 31 processors 32 memory

Claims

1. a recording control unit that records, in the virtual space, first class information in which avatar history information is classified according to area or second class information in which avatar history information is classified according to conversation content, together with an avatar action log; a playback unit that, when playing back the actions of an avatar in the virtual space, assigns a predetermined priority to the action logs whose first class information or second class information matches a class to which history information of the avatar operated by the user belongs, selects the action logs whose priority is equal to or greater than a predetermined threshold, and plays back the actions of the avatar based on the selected action logs. playback device.

2. The history information includes at least the area where the avatar was located or the content of the conversation that the avatar had. The playback device according to claim 1 .

3. a recording control unit that records third class information classified according to attributes of a user operating an avatar in a virtual space together with an action log of the avatar in a recording unit; a playback unit that, when playing back the actions of an avatar in the virtual space, assigns a predetermined priority to the action logs whose third class information matches a class to which the attribute of the user belongs, selects action logs whose priority is equal to or higher than a predetermined threshold, and plays back the actions of the avatar based on the selected action logs. playback device.

4. the recording control unit further records, in the recording unit, recording date and time information indicating a recording date and time of the action log together with the action log of the avatar; When reproducing the actions of the avatar in the virtual space, the reproduction unit assigns a predetermined priority to the action logs for which the difference between the recording date and time indicated by the recording date and time information recorded together with the action log in the recording unit and a predetermined date and time is less than a predetermined threshold, calculates a total value of the priorities, selects action logs for which the total value of the priorities is equal to or greater than the predetermined threshold, and reproduces the actions of the avatar based on the selected action logs.

3. The playback device according to claim 1 or 2.

5. A playback method executed by a playback device, comprising: a recording control step of recording, in the virtual space, first class information in which the avatar's history information is classified according to area or second class information in which the avatar's history information is classified according to conversation content, together with an avatar's action log, in a recording unit; a reproducing step of, when reproducing the actions of an avatar in the virtual space, assigning a predetermined priority to the action logs whose first class information or second class information matches a class to which history information of the avatar operated by the user belongs, selecting the action logs whose priority is equal to or higher than a predetermined threshold, and reproducing the actions of the avatar based on the selected action logs, How to play.

Images