Avatar analysis system and avatar analysis method of avatar analysis system

Abstract

To grasp a psychological state based on the action of an avatar as an easy-to-understand index including a school education site, a site for receiving consultation from school children and students, and a site for planning an exhibition without disclosing any private information in phases having different attributes such as school education * Metaverse, withdrawal consultation * Metaverse, and exhibition * Metaverse.SOLUTION: In the avatar analysis method of the avatar analysis system, the server device 1 includes the acquisition unit 16-1 that acquires information on each avatar drawn in the Metaverse, and accumulates the information on each avatar acquired by the acquisition unit 16-1 in the database 14. Then, the index unit 16-2 analyzes the reaction of each avatar accumulated in the database 14 and indexes the change in feeling of each avatar.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present invention relates to an avatar analysis system and an avatar analysis method for an avatar analysis system that enables communication between a server device that provides a service that provides specified events on the metaverse and multiple data terminals that operate avatars that enter the metaverse via a specified communication medium. [Background technology]

[0002] Traditionally, when users operate a data terminal to participate in the Metaverse, they can display their avatar as an avatar and take part in various experiential events. As this system becomes more widespread, exhibitors are increasingly analyzing the behavior of participating avatars to explore new business opportunities.

[0003] The following Patent Document 1 states that "In order to provide an advertising management system that can output effective advertisements to multiple users who use a virtual space, the advertising management system 10 comprises a detection unit 12, an analysis unit 13, a selection unit 14, and an output unit 15. The detection unit 12 detects avatars that are related to each other in the virtual space to which advertisements are output. The analysis unit 13 analyzes at least one of the behavior common to the avatars detected by the detection unit 12 and the content of the conversation between the avatars. Based on the analysis results, the selection unit 14 selects advertisements for multiple users who are participating in the virtual space by operating each avatar. Based on the selection results, the output unit 15 outputs advertisements to be displayed in the virtual space."

[0004] Furthermore, paragraph 0076 of the following Patent Document 2 states, "The avatar operation control unit 30 realizes communication between the absent user's avatar and another user in the real world according to a program that reflects a personal analysis of the absent user. In other words, communication with the absent user is realized in a simulated manner. The communication is primarily assumed to be conversation, but also includes changes in facial expressions and gestures." [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 2024-087892 [Patent Document 2] Japanese Patent Application Laid-Open No. 2012-168863 Summary of the Invention [Problem to be solved by the invention]

[0006] However, when considering the future usage environment of the metaverse, if the desired direction of analysis is treated centrally based on the usage attributes (for example, school education, counseling, exhibitions) that the required avatar analysis method focuses on, the validity of the analysis results cannot be guaranteed, and there is a high possibility that incorrect views and perceptions will arise.

[0007] In particular, in phases with different attributes, such as school education x Metaverse, hikikomori consultation x Metaverse, and exhibition x Metaverse, the goals of each user entering the Metaverse are different, and it has been pointed out that an analysis that only deals with the movements of the avatar itself cannot obtain various information that indicates appropriate mental fluctuations from the avatar in question.

[0008] In addition, when multiple users operating avatars enter the Metaverse in phases with different attributes, such as the above-mentioned school education x Metaverse, hikikomori consultation x Metaverse, and exhibition x Metaverse, it has been pointed out that it is not possible to accurately capture changes in the behavioral patterns and psychological state of each avatar, and that the operator will not be able to respond to each avatar with appropriate information at the appropriate time based on the results of analyzing each avatar's behavior.

[0009] The present invention has been made to solve the above-mentioned problems, and provides an avatar analysis system and an avatar analysis method for an avatar analysis system that obtains information that specifies the behavior of an avatar linked to a user on the metaverse, and responds by indexing the user's emotional ups and downs, allowing the avatar of a user who wants support to use the metaverse to grasp the psychological state based on the avatar's behavior as an easy-to-understand index in phases with different attributes, such as school education x metaverse, social withdrawal consultation x metaverse, and exhibition x metaverse, without disclosing any private information, including in school education settings, settings where consultations are accepted from school children and students, and settings where exhibitions are planned. [Means for solving the problem]

[0010] The avatar analysis system of the present invention that achieves the above object has the following configuration.

[0011] The avatar analysis system of the present invention is an avatar analysis system that allows communication between a server device that provides a service of providing specified events on the metaverse and multiple data terminals that operate avatars that enter the metaverse via a specified communication medium, and is characterized in that the server device is equipped with an acquisition means that acquires information about each avatar drawn in the metaverse, a storage means that stores the information about each avatar acquired by the acquisition means, and an indexing means that analyzes the information about each avatar stored in the storage means and indexes changes in the feelings of each avatar. [Effects of the Invention]

[0012] According to the present invention, in phases with different attributes, such as school education x Metaverse, social withdrawal consultation x Metaverse, and exhibition x Metaverse, the psychological state based on the behavior of an avatar can be grasped as an easy-to-understand indicator without disclosing any private information, including in school education settings, settings where consultations are accepted from schoolchildren and students, and settings where exhibitions are planned. [Brief explanation of the drawings]

[0013] The drawings illustrate particular embodiments of the present invention, including essential features of the invention as well as alternative and preferred embodiments. [Figure 1] FIG. 1 is a block diagram illustrating the configuration of an avatar analysis system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram illustrating the configuration of the server device shown in FIG. [Figure 3] 2A is a block diagram illustrating the configuration of first to fourth data terminals connected to the server device shown in FIG. 1, and FIG. 2B is a diagram showing the configuration of programs stored in the RAM shown in FIG. 2A. [Figure 4] 2 is a diagram showing an example of reaction buttons that can be selected by first to third users who operate the first to third data terminals shown in FIG. 1. FIG. [Figure 5] 1. FIG. 4 is a characteristic diagram showing the audio information of an avatar displayed on the fourth data terminal shown in FIG. [Figure 6] 1. FIG. 4 is a diagram showing a screen on which voice information of each user operating the first to third data terminals shown in FIG. [Figure 7] 2 is a diagram showing an example of an indexed message that the server device shown in FIG. 1 responds to the first to third data terminals; FIG. [Figure 8] 1 is a flowchart showing an example of an avatar analysis method of the avatar analysis system according to the present embodiment. [Figure 9] 1 is a flowchart showing an example of an avatar analysis method of the avatar analysis system according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0014] Next, the best mode for carrying out the present invention will be described with reference to the drawings.

[0015] <System configuration description> [First embodiment] FIG. 1 is a block diagram illustrating the configuration of an avatar analysis system according to this embodiment.

[0016] This example is an avatar analysis system in which a server device 1 that provides a service of providing a specified event on the metaverse can communicate with multiple data terminals (in this embodiment, first to fourth data terminals 3-1 to 3-N, 4-1 to 4-N, 5-1 to 5-N, 2-1 to 2-N) that operate avatars that enter the metaverse via a specified communication medium (network 21).

[0017] In Figure 1, the first to fourth data terminals 3-1 to 3-N, 4-1 to 4-N, 5-1 to 5-N, and 2-1 to 2-N can receive various metaverse services (including communication services) provided by the server device 1 by launching a browser or the like, connecting to the metaverse platform 1A made public by the server device 1, and registering a user ID and password with the server device 1.

[0018] The first to fourth data terminals 3-1 to 3-N, 4-1 to 4-N, 5-1 to 5-N, and 2-1 to 2-N are equipped with hardware resources as shown in FIG. 3, and are connected to the metaverse platform 1A via the network 21 to receive communication services from the server device 1.

[0019] The server device 1 also provides a service in which a metaverse for communication services appears, in which avatars corresponding to multiple users operating the first to fourth data terminals 3-1 to 3-N, 4-1 to 4-N, 5-1 to 5-N, and 2-1 to 2-N appear, allowing the avatars to converse with each other or chat with the AI ​​avatars that the server device 1 makes appear. In this embodiment, the avatar information includes behavior, voice tone and volume, chat, and reaction, but other information that symbolizes emotions (for example, vital signs information (blood pressure, pulse rate, respiratory rate)) may also be combined.

[0020] FIG. 2 is a block diagram for explaining the configuration of the server device 1 shown in FIG. 1, and the same components as those in FIG. 1 are assigned the same reference numerals.

[0021] In FIG. 2, 11 is a communication unit that controls communication processing between first data terminals 3-1 to 3-N, second data terminals 4-1 to 4-N, third data terminals 5-1 to 5-N, and fourth data terminals 2-1 to 2-N, all of which are connected to a network 21 as a communication medium.

[0022] A CPU 13 starts an operating system (OS) stored in an external memory 18 connected to the internal bus 12, and starts various applications installed via the API. It also executes the processing of various programs deployed on the RAM 16.

[0023] Reference numeral 14 denotes a database which stores prototype models of avatars used to make the virtual space appear, various items to be placed in the virtual space, and also stores account information for the first to fourth users operating the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N to connect to the metaverse platform 1A.

[0024] The database 14 also includes a dictionary of words that indicate the positive and negative feelings of the avatars, and the administrator operating the fourth data terminals 2-1 to 2-N refers to this dictionary when analyzing the actions, voice, chat, and reactions of each avatar to relatively evaluate the feelings (mental state) of each avatar. Here, the dictionary stores "That's impossible" and "That's impossible" for all things as examples of starting with negation.

[0025] Similarly, words that refer to past failures (no good, it's useless) are remembered as examples of dragging on mistakes and failures.

[0026] Similarly, examples of excuses that are remembered include words like "but" and "because" that try to avoid responsibility.

[0027] In addition to the above, other words that lower self-esteem include "Let's give up" and "I might as well fail."

[0028] Furthermore, since the language used changes depending on the times and circumstances, the dictionary stored in the database 14 is updated as needed.

[0029] On the other hand, words that encourage one's own actions, such as "You can do it!", "Let's give it a try", "The possibilities are endless", "Let's move forward one step at a time", "Failure is part of growth" and similar words, are stored in a database 14 in an updatable manner. In this embodiment, suitable examples are shown for school education x Metaverse and social withdrawal consultation x Metaverse, but in the case of exhibition x Metaverse, keywords indicating positive or negative orientations used in business negotiations and related words are stored in database 14 in an updatable manner.

[0030] The system may also employ a process of linking the keywords with the numerical rankings and performing an addition process.

[0031] 15 is a keyboard, which is used to input numbers, text, and icon commands for running applications.

[0032] Reference numeral 16 denotes an expandable RAM, which expands and stores the basic program of the metaverse platform 1A installed in the external memory 18. Reference numeral 17 denotes a display, which displays the program's running status via various UI screens (not shown).

[0033] The basic programs in this embodiment include an acquisition unit 16-1 that acquires the reactions of each avatar to be drawn in the metaverse, a storage unit that stores the reactions of each avatar acquired by the acquisition unit 16-1 in database 14, an indexing unit 16-2 that analyzes the reactions of each avatar stored in database 14 and indexes the changes in the feelings of each avatar, a regeneration unit 16-3 that extracts from the reactions of each avatar analyzed by the indexing unit 16-2 and plays back the chat content as a video, a generation unit 16-4 that generates a message in response to any of the logged-in avatars based on the numerical information indexed by the indexing unit 16-2, and an avatar drawing unit 16-5 that draws on the metaverse the avatars of the first to fourth users operating the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N. These programs are deployed on RAM 16 and executed by CPU 13.

[0034] As shown in a flowchart to be described later, avatar drawing unit 16-5 performs parallel processing to simultaneously draw multiple avatars on one metaverse.

[0035] Reference numeral 19 denotes an AI support unit, which starts a predetermined generation AI program, generates an appropriate message in response to a question or inquiry from an avatar, and executes a process (including text response and voice response) to respond to one of the avatars associated with each user drawn on the metaverse platform 1A. Note that a configuration may be adopted in which a message is sent to each avatar via a generated AI avatar. In the avatar analysis system configured in this manner, the index unit 16-2 compares the average value of the voice information uttered by each avatar within a predetermined time period among the information of each avatar stored in the storage means with the previous value stored in the database 14, and indexes the first amount of change in the feeling of each avatar as numerical information.

[0036] The indicator unit 16-2 is configured to be able to perform a process of comparing the average speed value of the movement speed at which each avatar moves on the metaverse, calculated in predetermined time units, among the information of each avatar stored in the database 14, with the previous speed value stored in the database 14, and indexing the second change in the feeling of each avatar as numerical information.

[0037] In addition, the indicator unit 16-2 is configured to be able to execute a process of determining whether the change characteristics based on the voice information that each avatar acquires on the metaverse from the information of each avatar stored in the database 14 are positive or negative, and indexing the third change amount of each avatar's feelings as numerical information.

[0038] Furthermore, the indicator unit 16-2 is configured to be able to execute a process of determining whether the change characteristics based on the voice information each avatar acquires on the metaverse from the information of each avatar stored in the database 14 are positive or negative, and indexing the third change amount of each avatar's feelings as numerical information.

[0039] In addition, the indicator unit 16-2 is configured to be able to execute a process of determining whether the change characteristics based on the voice information each avatar acquires on the metaverse from the information of each avatar stored in the database 14 are positive or negative based on the attributes of the stored keywords and their frequency of use, and indexing the third change amount of each avatar's feelings as numerical information.

[0040] The indicator unit 16-2 is configured to be able to execute a process of indexing the level of displacement in a positive or negative direction when each avatar changes its movement pattern to appeal to the user based on the indication of an icon indicating the behavioral attribute displayed on the metaverse.

[0041] The generation unit 16-4 executes a process of generating a message to be sent in response to any of the logged-in avatars, based on the numerical information indexed by the index unit 16-2.

[0042] In addition, the generation unit 16-4 is configured to calculate the rate of change of the difference between the positive area and the negative area integrated by the indicator unit 16-2, and then generate a message that displays the relative change in percentage between the current level of positivity and the previous level of positivity in response to each avatar.

[0043] Fig. 3 is a block diagram illustrating the configurations of first data terminals 3-1 to 3-N, second data terminals 4-1 to 4-N, third data terminals 5-1 to 5-N, and fourth data terminals 2-1 to 2-N connected to server device 1 shown in Fig. 1. Note that the first data terminals 3-1 to 3-N, second data terminals 4-1 to 4-N, third data terminals 5-1 to 5-N, and fourth data terminals 2-1 to 2-N are assumed to be pad devices, PC devices, smartphones, etc. Note that in this embodiment, a user operating the fourth data terminals 2-1 to 2-N is assumed to be an administrator who manages the metaverse.

[0044] 3(a), 301 denotes a CPU, which executes various applications by loading an OS and control programs stored in a ROM 302 into a RAM 303 and executing them. 304 denotes a communication unit, which controls communication for connecting to a server device 1 connected to a network 21. 310A denotes a first input unit, for example, a keyboard, which is configured to be able to input text onto a screen displayed on a display device 311 in cooperation with a pointing device (not shown) and to select tabs and icons on the displayed screen.

[0045] 310B is a second input unit, such as a microphone device, which collects analog sound representing the actual voice of the user operating the avatar, and then transfers the audio signal to a predetermined audio processor (DSP) and the server device 1. At this time, when converting the analog sound into a digital signal, the audio processor (DSP) adds information indicating the user's sound intensity (sound pressure (dB)) and transfers it to the server device 1.

[0046] In RAM 303 shown in (b) of Figure 3, 303-1 is a UI control unit that controls the display of UI screens presented from the metaverse platform 1A provided by the server device 1 shown in Figure 1 on display devices 311 provided in the first data terminals 3-1 to 3-N, second data terminals 4-1 to 4-N, third data terminals 5-1 to 5-N, and fourth data terminals 2-1 to 2-N.

[0047] The CPU 301 manages account information (user ID, password) registered by a user in the metaverse platform 1A that the server device 1 makes public on the web, using an external storage device such as an SSD (not shown).

[0048] FIG. 4 is a diagram showing an example of reaction buttons that can be selected by the first to third users who operate the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, and the third data terminals 5-1 to 5-N shown in FIG. 1.

[0049] In Figure 4, (a) corresponds to an emotion icon indicating an avatar in a normal state, (b) corresponds to an emotion icon indicating an avatar in a good state where the mood is higher than (a), and (c) corresponds to an emotion icon indicating an avatar in a depressed state where the mood is lower than (a). Here, by selecting an icon on the bottom side, each logged-in user will adopt the above (a) to (c) as their facial expression on the Metaverse.

[0050] Furthermore, each user can select their preferred facial color for the avatar's facial expression, making it appear more lively.

[0051] Figure 5 is a characteristic diagram showing the voice information of the avatars displayed on the fourth data terminals 2-1 to 2-N shown in Figure 1, where the vertical axis shows (+) and (-) orientations indicating emotional fluctuations, and the horizontal axis shows time (t).

[0052] In Figure 5, F(AB1)n indicates the voice characteristics at the time of this login (solid line), and F(AB1)b indicates the voice characteristics at the time of the previous login (dashed line). Here, n indicates the present (the first letter of "now" [n]), and b indicates the first letter of "before" [b].

[0053] As shown in this figure, avatar AB1 (see FIG. 6) had been showing a pronounced (-) orientation (oriented function F(AB1)b), but this time it has shifted to a (+) orientation (oriented function F(AB1)n), and the server device 1 will respond with a positive orientation evaluation to the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, and the third data terminals 5-1 to 5-N in the indexing process.

[0054] FIG. 6 is a diagram showing a screen on which voice information of each user operating the first data terminals 3-1 to 3-N, second data terminals 4-1 to 4-N, and third data terminals 5-1 to 5-N shown in FIG. 1 is reproduced.

[0055] The administrator operating the fourth data terminals 2-1 to 2-N shown in Figure 1 can move the button BT to select and play the audio information of each avatar stored as connection history in the database 14 at the time when the (+) orientation shown in Figure 5 is displayed.

[0056] At the same time, the chat section CT shown in FIG. 6 is used when the avatar AB1 chats with other avatars.

[0057] FIG. 7 is a diagram showing an example of an indexed message that the server device 1 shown in FIG. 1 responds to the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, and the third data terminals 5-1 to 5-N.

[0058] In this example, the indicator unit 16-2 compares the average value of the voice information uttered by each avatar within a predetermined time period among the information of each avatar stored in the database 14 with the previous value stored in the storage means, and indexes the first amount of change in the feeling of each avatar as numerical information (67%, 5%).

[0059] 8 and 9 are flowcharts showing an example of an avatar analysis method of the avatar analysis system according to this embodiment. (1) to (18) indicate steps, which are realized by CPU 13 of server device 1 shown in FIG. 1 executing a stored program. Hereinafter, data processing will be described using a first user operating first data terminals 3-1 to 3-N as an example, but the same applies to a second user operating second data terminals 4-1 to 4-N and a third user operating third data terminals 5-1 to 5-N shown in FIG. 1.

[0060] When a first user operating the first data terminal 3-1 to 3-N connects to a URL published on the cloud via the network 21, an account input screen (not shown) is displayed on the display device 311.

[0061] Here, when the first user operates the first input unit 310A to input a user ID and password to instruct logon, the CPU 13 refers to the registered user library in the database 14, authenticates whether the first user is already registered, and determines whether the authentication is OK (1). Here, if the CPU 13 determines that the authentication is not OK, a screen prompting the user to register is displayed on the display device 311, and when the user ID and password are input, the CPU 13 registers a user account consisting of the input user ID and password in the registered user library in the database 14 (2), and returns the process to step (1).

[0062] On the other hand, if the CPU 13 determines in step (1) that the account authentication is successful, it reads out an avatar associated with the registered user from the registered user library and draws the avatar on the metaverse (3). The avatar is configured to be able to freely move and instruct its movement on the metaverse by following a pointing device (not shown) operated by the first user.

[0063] Next, CPU 13 determines whether the first user is operating the pointing device to instruct the avatar to move in the metaverse (4). If CPU 13 determines that the first user is instructing the avatar to move, it further determines whether the speed and distance of movement are large (5). If it determines that the speed and distance of movement are not large, CPU 13 stores the avatar linked to the avatar in the registered user library and the behavioral pattern (pattern indicating a normal state) in the database 14 in a data format following a time series (6), and returns to step (4).

[0064] On the other hand, if it is determined in step (5) that the moving speed and distance are large, the CPU 13 determines whether a predetermined time has elapsed (7). If it determines that the predetermined time has not elapsed, the CPU 13 proceeds to step (6), where the CPU 13 stores the avatar linked to the avatar in the registered user library and the behavioral patterns (+patterns indicating directionality) in the database 14 in a time-series data format (6), and returns to step (4).

[0065] On the other hand, in step (7), if the CPU 13 determines that a predetermined time has elapsed, it determines whether the message (for example, text displayed on a speech bubble icon) to be issued from the avatar associated with the first user is (+) oriented (8), and if it determines that it does not indicate a (+) orientation, it returns to step (6).If it determines that it indicates a (+) orientation, the CPU 13 further determines (9) whether the number of times the avatar associated with the first user has spoken (uttered) exceeds a preset threshold, and if it determines that the number of times the avatar has spoken (uttered) does not exceed the preset threshold, it returns to step (6).

[0066] On the other hand, if in step (9) the CPU 13 determines that the number of times the avatar has spoken (uttered) exceeds a preset threshold, the CPU 13 determines whether the keyword uttered by the first user matches a (+) keyword stored in the database 14 (10).

[0067] Here, if the CPU 13 determines that the keyword uttered by the first user matches the (+) keyword stored in the database 14, the CPU 13 evaluates the current state of the first user as (+) oriented (12) and proceeds to step (13).

[0068] On the other hand, if in step (10) the CPU 13 determines that the keyword spoken by the first user matches a (-) keyword stored in the database 14, it evaluates the current state of the first user as (-) oriented (11) and proceeds to step (13).

[0069] Then, the CPU 13 calculates the first user's level of initiative based on the processing of steps (11) and (12) (13).

[0070] It is assumed that the calculation process involves adding an index to each keyword and performing arithmetic averaging instead of simple addition, but the calculation process is not limited to this as long as it can be indexed.

[0071] Next, CPU 13 reads the previous positive attitude (previous value) associated with the first user from database 14, and determines whether the value obtained by dividing the current positive attitude (current value) calculated in step (14) by the previous positive attitude (current value) is less than 1 (<1) (14). If it determines that the value is greater than 1, CPU 13 generates a (-) message (15) and draws it on the metaverse for the first user's avatar, so that the first user displays a (-) message, for example, "I feel depressed," on display device 311.

[0072] On the other hand, if it is determined that the number is smaller than 1, the CPU 13 generates a (+) message (16) and draws it on the metaverse for the first user's avatar, so that the first user can see the (+) message, such as "Good job!", on the display device 311.

[0073] Next, the CPU 13 updates the information on the avatar of the first user managed in the database 14 (17).

[0074] Next, the CPU 13 determines whether the first user has logged out on the URL screen displayed on the display device 311 (18), and if it determines that the first user has not logged out, it returns to step (4), and if it determines that the first user has logged out, it ends this process.

[0075] In addition, by executing a control to display emotions other than voice or chat during a conversation with a logged-in avatar on the metaverse hosted by the server device 1, the changes in the avatar's own psychological state are visualized with one of the emotion icons representing the emotions (a) to (c) in Figure 4. This allows the user of the data terminal operating the avatar to indirectly recognize the emotional ups and downs of the avatar by looking at the emotion-indicating icons that flash on the screen.

[0076] [Effects of the first embodiment] According to this embodiment, when a first user connects to the metaverse and takes some action, the first user receives some kind of message response (indexed information including the message shown in Figure 7) on the metaverse platform 1A, thereby gaining an opportunity to guide the current psychological state toward a (+) orientation.

[0077] Second Embodiment In the above embodiment, an example has been described in which CPU 13 calculates the degree of enthusiasm of the first user in step (13) shown in FIG. 9 , but indicator unit 16-2 may be configured to compare an average value of voice information uttered by each avatar within a predetermined time period among the information of each avatar stored in database 14 with the previous value stored in database 14, and index the first amount of change in the feeling of each avatar as numerical information.

[0078] [Effects of the second embodiment] According to this embodiment, it is possible to index the amount of change in the avatar, including psychological analysis that focuses on information obtained by averaging the voice information uttered by the avatar.

[0079] Third Embodiment In the above embodiment, an example was described in which CPU 13 calculates the first user's degree of enthusiasm in step (13) shown in Figure 9, but indicator unit 16-2 may be configured to compare the average speed value of the movement speed at which each avatar moves on the metaverse, calculated in predetermined time units, from the information of each avatar stored in database 14, with the previous speed value stored in database 14, and index the second change in the feeling of each avatar as numerical information.

[0080] [Effects of the third embodiment] According to this embodiment, it is possible to index the amount of change in the avatar, including psychological analysis that focuses on the speed at which the avatar moves.

[0081] [Fourth embodiment] In the above embodiment, an example was described in which CPU 13 calculates the first user's degree of enthusiasm in step (13) shown in Figure 9, but indicator unit 16-2 may be configured to determine whether the change characteristics based on the voice information each avatar acquires on the metaverse from the information of each avatar stored in database 14 are positive or negative, and index the third change amount of each avatar's feelings as numerical information.

[0082] [Effects of the fourth embodiment] According to this embodiment, the amount of change in the avatar can be indexed based on the voice information uttered by the avatar, particularly including psychological analysis focusing on whether the change characteristics are positive or negative.

[0083] Fifth Embodiment In the above embodiment, an example was described in which CPU 13 calculates the first user's degree of enthusiasm in step (13) shown in Figure 9, but indicator unit 16-2 may be configured to determine whether the change characteristics based on the voice information each avatar acquires on the metaverse from the information of each avatar stored in database 14 are positive or negative, and index the third change amount of each avatar's feelings as numerical information.

[0084] [Effects of the fifth embodiment] According to this embodiment, the amount of change in the avatar can be indexed based on the voice information uttered by the avatar, particularly including psychological analysis focusing on whether the change characteristics are positive or negative.

[0085] Sixth Embodiment In the above embodiment, an example has been described in which CPU 13 calculates the first user's degree of enthusiasm in step (13) shown in Figure 9, but indicator unit 16-2 may be configured to determine whether the change characteristics based on the voice information each avatar acquires on the metaverse, among the information of each avatar accumulated in database 14, are positive or negative based on the attributes of the stored keywords and their frequency of use, and to index the third change amount of each avatar's feelings as numerical information.

[0086] [Effects of the Sixth Embodiment] According to this embodiment, the amount of change in an avatar can be indexed, including psychological analysis based on the attributes of keywords that store whether the change characteristics based on the voice information that each avatar acquires on the metaverse are positive or negative, and the frequency of their use.

[0087] Seventh Embodiment In the above embodiment, in step (13) shown in Figure 9, an example was described in which the CPU 13 calculates the first user's level of initiative. However, the indicator unit 16-2 may be configured to index the level of positive or negative displacement of each avatar when the avatar changes its movement pattern to appeal to the user based on the indication of an icon indicating the behavioral attribute displayed on the metaverse.

[0088] [Effects of the Seventh Embodiment] According to this embodiment, when each avatar's movement pattern is changed to appeal to the user, the level of change can be expressed as an index of the level of displacement in the positive or negative direction.

[0089] The present invention can also be realized by supplying a program that realizes one or more functions of the above-mentioned embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (for example, an ASIC) that realizes one or more functions.

[0090] The disclosure of the present invention described above can be summarized at least as follows.

[0091] (1) An avatar analysis system capable of communicating via a predetermined communication medium between a server device that provides a service of providing a predetermined event on the metaverse and a plurality of data terminals that operate avatars that enter the metaverse, wherein the server device is characterized by having an acquisition means for acquiring information about each avatar drawn on the metaverse, a storage means for storing the information about each avatar acquired by the acquisition means, and an indexing means for analyzing the information about each avatar stored in the storage means and indexing changes in the feelings of each avatar.

[0092] (2) The avatar information includes behavior, tone and volume of voice, chat, and reactions.

[0093] (3) The indexing means compares the average value of the voice information uttered by each avatar within a predetermined time period among the information of each avatar stored in the storage means with the previous value stored in the storage means, and indexes the first change in the feeling of each avatar as numerical information.

[0094] (4) The indexing means is characterized in that it compares the average speed value of the movement speed of each avatar moving on the metaverse calculated in a predetermined time unit among the information of each avatar stored in the storage means with the previous speed value stored in the storage means, and indexes the second change in the feelings of each avatar as numerical information.

[0095] (5) The indexing means is characterized in that it determines whether the change characteristics based on the voice information that each avatar acquires on the metaverse among the information of each avatar stored in the storage means are positive or negative, and indexes the third change amount of each avatar's feelings as numerical information.

[0096] (6) The indexing means is characterized in that it determines whether the change characteristics based on the voice information that each avatar acquires on the metaverse among the information of each avatar stored in the storage means are positive or negative, and indexes the third change amount of each avatar's feelings as numerical information.

[0097] (7) The indexing means is characterized in that it determines whether the change characteristics based on the voice information acquired by each avatar on the metaverse from the information of each avatar stored in the storage means are positive or negative based on the attributes of the stored keywords and their frequency of use, and indexes the third change amount of each avatar's feelings as numerical information.

[0098] (8) The indexing means is characterized in that when each avatar changes its movement pattern to appeal based on the indication of an icon indicating a behavioral attribute displayed on the metaverse, the level of that change is indexed as a level of displacement in a positive or negative direction.

[0099] (9) The system is characterized by including a generating means for generating a message to be sent in response to any of the logged-in avatars based on the numerical information indexed by the indexing means.

[0100] (10) The generating means calculates the rate of change of the difference between the positive area and the negative area integrated by the indexing means, and then generates a message that displays the relative change in percentage between the current level of positivity and the previous level of positivity in response to each avatar.

[0101] (11) An avatar analysis method for an avatar analysis system in which a server device that provides a service to provide a predetermined event on a metaverse via a predetermined communication medium and a plurality of data terminals that operate avatars that enter the metaverse can communicate, wherein the server device comprises an acquisition step of acquiring information about each avatar drawn in the metaverse, a storage step of storing the information about each avatar acquired in the acquisition step in a storage unit, and an indexing step of analyzing the reactions of each avatar stored in the storage unit in the storage step and indexing changes in the feelings of each avatar. [Industrial Applicability]

[0102] In this embodiment, we have used as an example a system that indexes behavior within the metaverse after a general user connects to the metaverse provided by the metaverse platform 1A published on the cloud.However, this system can also be used in education (language services that use the metaverse, metaverse lecture services, etc.), medical care, nursing care, games held in the metaverse, art, music events, and online sales of exhibition events, further enhancing the possibilities of the metaverse.

[0103] It is also possible to create a system that hybridizes a configuration in which a fourth user operating a fourth data terminal 2-1 to 2-N issues a message to the first to third users operating the first data terminals 3-1 to 3-N, second data terminals 4-1 to 4-N, and third data terminals 5-1 to 5-N on the metaverse, and a configuration in which an AI avatar issues a message to the first to third users operating the first data terminals 3-1 to 3-N, second data terminals 4-1 to 4-N, and third data terminals 5-1 to 5-N. [Explanation of symbols]

[0104] 1. Server device 1A Metaverse Platform 2-1~2-N 4th data terminal 3-1~3-N First data terminal 4-1~4-N Second data terminal 5-1~5-N Third Data Terminal

Claims

1. An avatar analysis system in which a server device that provides a service of providing a predetermined event on a metaverse and a plurality of data terminals that operate avatars that enter the metaverse can communicate with each other via a predetermined communication medium, The server device An acquisition means for acquiring information on each avatar to be drawn in the metaverse; a storage means for storing information about each avatar acquired by the acquisition means; an indexing means for analyzing the information of each avatar stored in the storage means and indexing changes in the feelings of each avatar; An avatar analysis system comprising:

2. The avatar analysis system of claim 1 , wherein the avatar information includes behavior, tone and volume of voice, chat, and reaction.

3. The avatar analysis system of claim 1, wherein the indexing means compares an average value of the voice information uttered by each avatar within a predetermined time period among the information of each avatar stored in the storage means with the previous value stored in the storage means, and indexes a first amount of change in the feeling of each avatar as numerical information.

4. The avatar analysis system of claim 1, characterized in that the indexing means compares the average speed value of the movement speed at which each avatar moves on the metaverse, calculated in predetermined time units, among the information of each avatar stored in the storage means, with the previous speed value stored in the storage means, and indexes the second change in the mood of each avatar as numerical information.

5. The avatar analysis system of claim 1, characterized in that the indexing means determines whether the change characteristics based on the voice information each avatar acquires on the metaverse from the information of each avatar stored in the storage means are positive or negative, and indexes a third change in the feelings of each avatar as numerical information.

6. The avatar analysis system of claim 1, characterized in that the indexing means determines whether the change characteristics based on the voice information each avatar acquires on the metaverse from the information of each avatar stored in the storage means are positive or negative, and indexes a third change in the feelings of each avatar as numerical information.

7. The avatar analysis system of claim 1, characterized in that the indexing means determines whether the change characteristics based on the voice information each avatar acquires on the metaverse from the information of each avatar stored in the storage means are positive or negative based on the attributes of stored keywords and their frequency of use, and indexes a third change in the feelings of each avatar as numerical information.

8. The avatar analysis system of claim 1, characterized in that the indexing means indexes the level of positive or negative displacement of each avatar's movement pattern when the avatar changes its movement pattern to appeal to others based on the indication of an icon indicating a behavioral attribute displayed on the metaverse.

9. 2. The avatar analysis system according to claim 1, further comprising: a generating means for generating a message to be sent in response to any of the logged-in avatars based on the numerical information indexed by the indexing means.

10. The generating means The avatar analysis system of claim 9, wherein the indexing means calculates the rate of change of the difference between the integrated positive and negative areas, and then generates a message indicating the relative change in percentage between the current level of enthusiasm and the previous level of enthusiasm in response to each avatar.

11. An avatar analysis method for an avatar analysis system in which a server device that provides a service of providing a predetermined event on a metaverse and a plurality of data terminals that operate avatars that enter the metaverse can communicate with each other via a predetermined communication medium, comprising: The server device an acquisition step of acquiring information about each avatar to be drawn in the metaverse; a storage step of storing the information of each avatar acquired in the acquisition step in a storage unit; an indexing step of analyzing the reactions of each avatar stored in the storage unit in the storing step and indexing changes in the feelings of each avatar; An avatar analysis method for an avatar analysis system, comprising:

Images