Avatar analysis system and avatar analysis method therefor
The avatar analysis system effectively captures and responds to emotional changes of users in diverse Metaverse contexts by indexing emotional changes through voice and movement analysis, ensuring accurate psychological state assessment.
Patent Information
- Application Number
- JP2024129051
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-08-05
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2044-08-05
AI Technical Summary
Existing avatar analysis methods in the Metaverse fail to accurately capture and respond to the diverse behavioral changes and emotional states of users with different purposes, leading to invalid results and potential misinterpretation, especially in contexts like school education, withdrawal counseling, and exhibitions.
An avatar analysis system that includes a server device and data terminals communicating via a communication medium, acquiring, accumulating, and indexing emotional changes of avatars through voice tone, volume, chat, and reactions, generating messages based on numerical information to reflect relative emotional changes.
Enables accurate psychological state analysis of avatars without disclosing private information, allowing timely and appropriate responses in diverse Metaverse environments.
Smart Images

Figure 0007593704000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an avatar analysis system and an avatar analysis method for the avatar analysis system, which enable communication between a server device that provides a service of providing a specified event on the metaverse via a specified communication medium and multiple data terminals that operate avatars that enter the metaverse. [Background technology]
[0002] Conventionally, when users operate a data terminal to participate in the metaverse, they can display their own avatar and take part in a variety of experiential events. As this system becomes more common, exhibitors are actively analyzing the behavior of participating avatars to explore new business developments.
[0003] The following Patent Document 1 states that "In order to provide an advertising management system capable of outputting effective advertisements to multiple users who use a virtual space, an advertising management system 10 includes a detection unit 12, an analysis unit 13, a selection unit 14, and an output unit 15. The detection unit 12 detects avatars related to each other in the virtual space to which advertisements are output. The analysis unit 13 analyzes at least one of the behavior common to the avatars detected by the detection unit 12 and the content of the conversation between the avatars. Based on the analysis results, the selection unit 14 selects advertisements for multiple users who are participating in the virtual space by operating each avatar. The output unit 15 outputs advertisements to be displayed in the virtual space based on the selection results."
[0004] Furthermore, paragraph 0076 of the following Patent Document 2 states that "the avatar action control unit 30 realizes communication between the absent user's avatar and another user in the real world in accordance with a program that reflects a personal analysis of the absent user. In other words, communication with the absent user is simulated. The communication is primarily assumed to take the form of conversation, but also includes changes in facial expressions and gestures." [Prior art documents] [Patent documents]
[0005] [Patent Document 1] JP 2024-087892 A [Patent Document 2] JP 2012-168863 A Summary of the Invention [Problem to be solved by the invention]
[0006] However, when considering future metaverse usage environments, if the desired analysis direction is treated centrally based on the usage attributes that the required avatar analysis method focuses on (e.g., school education, counseling, exhibitions), the validity of the analysis results cannot be guaranteed, and there is a high possibility that erroneous views or perceptions will arise.
[0007] In particular, in phases with different attributes, such as school education x metaverse, hikikomori counseling x metaverse, and exhibitions x metaverse, the goals of each user entering the metaverse are different, so it was pointed out that an analysis that only deals with the movements of the avatar itself cannot obtain various information that indicates appropriate mental fluctuations from the avatar in question.
[0008] In addition, when multiple users operating avatars enter the metaverse in phases with different attributes, such as the above-mentioned school education x metaverse, hikikomori consultation x metaverse, and exhibition x metaverse, it was pointed out that it would be impossible to accurately capture changes in the behavioral patterns and psychological state of each avatar, and that the operator would not be able to respond at the appropriate time with appropriate information for each avatar based on the results of analyzing the behavior of each avatar.
[0009] The present invention has been made to solve the above-mentioned problems, and provides an avatar analysis system and an avatar analysis method for the avatar analysis system, which obtains information specifying the behavior of an avatar linked to a user on the metaverse, and responds by indexing the ups and downs of the user's emotions, allowing the avatar of a user who wants support to use the metaverse to grasp the psychological state based on the avatar's behavior as an easy-to-understand index, including in school education settings, settings where consultations are accepted from school children and students, and settings where exhibitions are planned, without disclosing any private information, in phases with different attributes such as school education x metaverse, social withdrawal consultation x metaverse, and exhibition x metaverse. [Means for solving the problem]
[0010] To achieve the above object, an avatar analysis system according to the present invention has the following configuration.
[0011] The avatar analysis system according to the present invention is an avatar analysis system capable of communicating, via a predetermined communication medium, between a server device that provides a service of providing a predetermined event on a metaverse and a plurality of data terminals that operate avatars entering the metaverse, the server device comprising: an acquisition means for acquiring information on each avatar depicted in the metaverse; a storage means for storing the information on each avatar acquired by the acquisition means; and an indexing means for analyzing the information on each avatar stored in the storage means and indexing changes in the feelings of each avatar. and a generating means for generating a message in response to any of the logged-in avatars based on the numerical information indexed by the indexing means, wherein the generating means calculates a rate of change in the difference between the positive area and the negative area integrated by the indexing means, and then generates a message indicating a relative change in percentage between the current positive level and the previous positive level in response to each avatar. It is characterized by: Effect of the Invention
[0012] According to the present invention, in phases with different attributes, such as school education x metaverse, social withdrawal consultation x metaverse, and exhibition x metaverse, the psychological state based on the behavior of an avatar can be grasped as an easy-to-understand indicator without disclosing any private information, including in school education settings, settings where consultations are accepted from schoolchildren and students, and settings where exhibitions are planned. [Brief description of the drawings]
[0013] The drawings show specific embodiments of the present invention, including essential features of the invention as well as alternative and preferred embodiments. [Figure 1] FIG. 1 is a block diagram illustrating a configuration of an avatar analysis system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram illustrating the configuration of a server device shown in FIG. [Diagram 3] 2A is a block diagram for explaining the configuration of first to fourth data terminals connected to the server device shown in FIG. 1, and FIG. 2B is a diagram showing the configuration of a program stored in a RAM shown in FIG. [Figure 4] 2 is a diagram showing an example of reaction buttons selectable by first to third users who operate the first to third data terminals shown in FIG. 1. [Diagram 5] 1. FIG. 4 is a characteristic diagram showing the voice information of an avatar displayed on the fourth data terminal shown in FIG. [Figure 6] 2 is a diagram showing a screen on which voice information of each user operating the first to third data terminals shown in FIG. 1 is reproduced. [Figure 7] 2 is a diagram showing an example of an indexed message sent by the server device shown in FIG. 1 in response to the first to third data terminals; FIG. [Figure 8] 4 is a flowchart showing an example of an avatar analysis method of the avatar analysis system according to the present embodiment. [Figure 9] 4 is a flowchart showing an example of an avatar analysis method of the avatar analysis system according to the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] Next, the best mode for carrying out the present invention will be described with reference to the drawings.
[0015] <System configuration> [First embodiment] FIG. 1 is a block diagram illustrating the configuration of an avatar analysis system according to the present embodiment.
[0016] This example is an avatar analysis system in which a server device 1 that provides a service of providing a specified event on the metaverse and a plurality of data terminals (in this embodiment, first to fourth data terminals 3-1 to 3-N, 4-1 to 4-N, 5-1 to 5-N, 2-1 to 2-N) that operate avatars that enter the metaverse can communicate via a specified communication medium (network 21).
[0017] In FIG. 1, the first to fourth data terminals 3-1 to 3-N, 4-1 to 4-N, 5-1 to 5-N, and 2-1 to 2-N can receive various metaverse services (including communication services) provided by the server device 1 by launching a browser or the like, connecting to the metaverse platform 1A published by the server device 1, and registering a user ID and password with the server device 1.
[0018] The first to fourth data terminals 3-1 to 3-N, 4-1 to 4-N, 5-1 to 5-N, and 2-1 to 2-N are equipped with hardware resources as shown in FIG. 3, and are connected to the metaverse platform 1A via the network 21 to receive communication services from the server device 1.
[0019] In addition, the server device 1 creates a metaverse for communication services, creates avatars corresponding to a plurality of users operating the first to fourth data terminals 3-1 to 3-N, 4-1 to 4-N, 5-1 to 5-N, and 2-1 to 2-N, and provides a service in which the avatars can converse with each other or chat with the AI avatars created by the server device 1. In this embodiment, the avatar information includes behavior, voice tone and volume, chat, and reactions, but it may also be combined with other information that symbolizes emotions (for example, vital signs information (blood pressure, pulse rate, respiratory rate)).
[0020] FIG. 2 is a block diagram for explaining the configuration of the server device 1 shown in FIG. 1, and the same components as those in FIG. 1 are given the same reference numerals.
[0021] In FIG. 2, reference numeral 11 denotes a communication unit which controls communication processing between first data terminals 3-1 to 3-N, second data terminals 4-1 to 4-N, third data terminals 5-1 to 5-N, and fourth data terminals 2-1 to 2-N which are connected to a network 21 as a communication medium.
[0022] A CPU 13 starts an operating system (OS) stored in an external memory 18 connected to the internal bus 12, and starts various applications installed via an API. It also executes the processing of various programs deployed on the RAM 16.
[0023] Reference numeral 14 denotes a database which stores prototype models of avatars used to make the virtual space appear, various items to be placed in the virtual space, and also stores account information for the first to fourth users operating the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N to connect to the metaverse platform 1A.
[0024] The database 14 is provided with a word dictionary section for the positive and negative feelings of the avatars, and the administrator operating the fourth data terminals 2-1 to 2-N refers to this when analyzing the actions, voices, chats, and reactions of each avatar to relatively evaluate the feelings (mental state) of each avatar. Here, the word dictionary section stores "That's impossible" and "I can't do that" for everything as examples of starting with negation.
[0025] Similarly, words that talk about past failures (it's no good, it's useless) are remembered as an example of how we dwell on mistakes and failures.
[0026] Similarly, examples of excuses that are remembered include words like "but" and "because" that attempt to avoid responsibility.
[0027] In addition to the above, other words that lower self-esteem include "Let's give up" and "It's better to fail than to fail."
[0028] Furthermore, since the words and phrases used change depending on the times and circumstances, the dictionary stored in the database 14 is updated from time to time.
[0029] On the other hand, words that improve one's own actions, such as "You can do it!", "Let's give it a try", "The possibilities are endless", "Let's move forward one step at a time", "Failure is part of growth" and similar words, are stored in a database 14 in an updateable manner. In this embodiment, suitable examples are shown for school education x metaverse and social withdrawal counseling x metaverse, but in the case of exhibition x metaverse, keywords indicating a positive or negative orientation used in business negotiations and related words are stored in database 14 in an updatable manner.
[0030] The system may also employ a process of linking the keywords with ranked numerical values and performing an addition process.
[0031] Reference numeral 15 denotes a keyboard, which is used to input numbers, text, and icon commands for running applications.
[0032] Reference numeral 16 denotes an expandable RAM, which expands and stores the basic program of the metaverse platform 1A installed in the external memory 18. Reference numeral 17 denotes a display, which displays the program's running status via various UI screens (not shown).
[0033] The basic programs in this embodiment include an acquisition unit 16-1 that acquires the reactions of each avatar to be drawn in the metaverse, a storage unit that accumulates the reactions of each avatar acquired by the acquisition unit 16-1 in database 14, an indexing unit 16-2 that analyzes the reactions of each avatar accumulated in database 14 and indexes the changes in the feelings of each avatar, a reproduction unit 16-3 that extracts chat content from the reactions of each avatar analyzed by the indexing unit 16-2 and plays it as a video, a generation unit 16-4 that generates a message in response to any of the logged-in avatars based on the numerical information indexed by the indexing unit 16-2, and an avatar drawing unit 16-5 that draws avatars of the first to fourth users operating the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N on the metaverse. These are deployed on RAM 16 and executed by CPU 13.
[0034] As shown in a flow chart to be described later, avatar drawing unit 16-5 performs parallel processing to simultaneously draw a plurality of avatars on one metaverse.
[0035] Reference numeral 19 denotes an AI support unit, which starts a predetermined generation AI program to generate an appropriate message in response to a question or inquiry from an avatar, and executes a process (including a text response and a voice response) to respond to any of the avatars associated with each user depicted on the metaverse platform 1A. Note that a configuration may be adopted in which a message is responded to each avatar via a generated AI avatar. In the avatar analysis system configured in this manner, the index unit 16-2 compares an average value of the voice information uttered by each avatar within a predetermined time period among the information of each avatar stored in the storage means with the previous value stored in database 14, and indexes a first amount of change in the feeling of each avatar as numerical information.
[0036] The indicator unit 16-2 is configured to execute a process of comparing a speed value obtained by averaging the movement speed at which each avatar moves on the metaverse, calculated in a predetermined time unit, from the information of each avatar stored in the database 14, with the previous speed value stored in the database 14, and indexing a second amount of change in the feelings of each avatar as numerical information.
[0037] In addition, the indicator unit 16-2 is configured to execute a process of determining whether the change characteristics based on the voice information that each avatar acquires on the metaverse from the information of each avatar stored in the database 14 are positive or negative, and indexing a third change amount of the feelings of each avatar as numerical information.
[0038] Furthermore, the indicator unit 16-2 is configured to execute a process of determining whether the change characteristics based on the voice information that each avatar acquires on the metaverse from the information of each avatar stored in the database 14 are positive or negative, and indexing a third change amount of the feelings of each avatar as numerical information.
[0039] In addition, the indicator unit 16-2 is configured to execute a process of determining whether the change characteristics based on the voice information that each avatar acquires on the metaverse from the information of each avatar stored in the database 14 are positive or negative based on the attributes of the stored keywords and their frequency of use, and indexing a third change amount of the feelings of each avatar as numerical information.
[0040] The indicator unit 16-2 is configured to execute a process of indexing the level of displacement in a positive or negative direction when each avatar changes its movement pattern to appeal based on an indication of an icon indicating a behavioral attribute displayed on the metaverse.
[0041] The generation unit 16-4 executes a process of generating a message to be sent in response to any one of the logged-in avatars, based on the numerical information indexed by the index unit 16-2.
[0042] In addition, the generation unit 16-4 is configured to execute a process of calculating the rate of change of the difference between the positive area and the negative area integrated by the indicator unit 16-2, and then generating a message displaying the relative change in percentage between the current level of positivity and the previous level of positivity in response to each avatar.
[0043] Fig. 3 is a block diagram for explaining the configuration of the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N connected to the server device 1 shown in Fig. 1. Note that the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N are assumed to be pad devices, PC devices, smartphones, etc. Note that in this embodiment, the user who operates the fourth data terminals 2-1 to 2-N is assumed to be an administrator who manages the metaverse.
[0044] 3(a), 301 denotes a CPU, which executes various applications by loading an OS and a control program stored in a ROM 302 into a RAM 303 and executing them. 304 denotes a communication unit, which controls communication for connecting to a server device 1 connected to a network 21. 310A denotes a first input unit, for example a keyboard, which is configured to be able to input text onto a screen displayed on a display device 311 in cooperation with a pointing device (not shown) and to select tabs and icons on the displayed screen.
[0045] 310B is a second input unit, for example a microphone device, which collects analog sound representing the actual voice of the user operating the avatar, and then transmits the audio signal to a predetermined audio processor (DSP) and the server device 1. At this time, when converting the analog sound into a digital signal, the audio processor (DSP) adds information indicating the user's sound intensity (sound pressure (dB)) and transmits the digital signal to the server device 1.
[0046] In the RAM 303 shown in (b) of Figure 3, 303-1 is a UI control unit that executes control to display UI screens presented from the metaverse platform 1A provided by the server device 1 shown in Figure 1 on display devices 311 provided in the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N.
[0047] The CPU 301 manages account information (user ID, password) registered by a user in the metaverse platform 1A that the server device 1 makes public on the Web, by using an external storage device such as an SSD (not shown).
[0048] FIG. 4 is a diagram showing an example of reaction buttons that can be selected by the first to third users operating the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, and the third data terminals 5-1 to 5-N shown in FIG. 1.
[0049] In Fig. 4, (a) corresponds to an emotion icon indicating an avatar in a normal state, (b) corresponds to an emotion icon indicating an avatar in a good state whose mood is higher than (a), and (c) corresponds to an emotion icon indicating an avatar in a depressed state whose mood is lower than (a). Here, by each logged-in user selecting an icon on the lower side, the above (a) to (c) are adopted as facial expressions on the metaverse.
[0050] Furthermore, each user can select their preferred facial color for the avatar's facial expression, making it appear more lively.
[0051] FIG. 5 is a characteristic diagram showing the voice information of the avatars displayed on the fourth data terminals 2-1 to 2-N shown in FIG. 1, in which the vertical axis shows emotional fluctuations (+) and (-) orientations, and the horizontal axis shows time (t).
[0052] In Figure 5, F(AB1)n indicates the voice characteristics at the time of this login (solid line), and F(AB1)b indicates the voice characteristics at the time of the previous login (dashed line). Here, n indicates the present (the first letter of "now" [n]) and b indicates the first letter of "before" [b].
[0053] As shown in this figure, avatar AB1 (see FIG. 6) previously exhibited a pronounced (-) orientation (oriented function F(AB1)b), but this time has shifted to a (+) orientation (oriented function F(AB1)n), and the server device 1 will respond with a positive oriented evaluation to the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, and the third data terminals 5-1 to 5-N in the indexing process.
[0054] FIG. 6 is a diagram showing a screen on which voice information of each user operating the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, and the third data terminals 5-1 to 5-N shown in FIG. 1 is reproduced.
[0055] An administrator operating the fourth data terminals 2-1 to 2-N shown in FIG. 1 can move the button BT to select and play the audio information of each avatar stored as a connection history in the database 14 at the time when the (+) orientation shown in FIG. 5 is indicated.
[0056] At the same time, the chat section CT shown in FIG. 6 is used when the avatar AB1 chats with other avatars.
[0057] FIG. 7 is a diagram showing an example of an indexed message that the server device 1 shown in FIG. 1 responds to the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, and the third data terminals 5-1 to 5-N.
[0058] In this example, the indicator unit 16-2 compares the average value of the voice information uttered by each avatar within a specified time period among the information of each avatar stored in the database 14 with the previous value stored in the storage means, and indexes the first amount of change in the feeling of each avatar as numerical information (67%, 5%).
[0059] 8 and 9 are flow charts showing an example of an avatar analysis method of the avatar analysis system according to the present embodiment. Note that (1) to (18) indicate each step, and each step is realized by CPU 13 of server device 1 shown in FIG. 1 executing a stored program. Hereinafter, data processing will be described using a first user operating first data terminals 3-1 to 3-N as an example, but the same applies to a second user operating second data terminals 4-1 to 4-N and a third user operating third data terminals 5-1 to 5-N shown in FIG. 1.
[0060] When a first user who operates the first data terminals 3-1 to 3-N connects to a URL published on the cloud via the network 21, an account input screen (not shown) is displayed on the display device 311.
[0061] When the first user operates the first input unit 310A to input a user ID and password to instruct logon, the CPU 13 refers to the registered user library in the database 14 to authenticate whether the first user is already registered and judges whether the authentication is OK (1). If the CPU 13 judges that the authentication is not OK, a screen prompting the user to register is displayed on the display device 311, and when a user ID and password are input, the CPU 13 registers a user account consisting of the input user ID and password in the registered user library in the database 14 (2) and returns the process to step (1).
[0062] On the other hand, if the CPU 13 determines in step (1) that the account authentication is OK, the CPU 13 reads an avatar associated with the registered user from the registered user library and draws the avatar on the metaverse (3). The avatar is configured to be able to freely move and instruct the avatar on the metaverse by following a pointing device (not shown) operated by the first user.
[0063] Next, CPU 13 determines whether the first user has operated the pointing device to instruct the avatar to move in the metaverse (4). If CPU 13 determines that the first user has instructed the avatar to move, it further determines whether the speed and distance of movement are large (5). If it determines that the speed and distance of movement are not large, CPU 13 stores the avatar linked to the avatar in a registered user library and the behavior pattern (a pattern indicating a normal state) in a chronological data format in database 14 (6), and returns to step (4).
[0064] On the other hand, if it is determined in step (5) that the moving speed and distance are large, the CPU 13 determines whether a predetermined time has elapsed (7). If it is determined that the predetermined time has not elapsed, the process proceeds to step (6), where the CPU 13 registers the avatar associated with the avatar in a registered user library and accumulates the behavioral pattern (+ a pattern indicating directional) in a time-series data format in the database 14 (6), and the process returns to step (4).
[0065] On the other hand, in step (7), if the CPU 13 determines that a predetermined time has elapsed, it determines whether the message (e.g., text displayed on a speech bubble icon) to be issued from the avatar associated with the first user is oriented in a (+) direction (8), and if it determines that it does not indicate a (+) direction, it returns to step (6). If it determines that it does indicate a (+) direction, the CPU 13 further determines (9) whether the number of times the avatar associated with the first user has spoken (uttered) exceeds a preset threshold, and if it determines that the number of times the avatar has spoken (uttered) does not exceed the preset threshold, it returns to step (6).
[0066] On the other hand, if in step (9) the CPU 13 determines that the number of times the avatar has spoken (uttered) exceeds a preset threshold, the CPU 13 determines (10) whether the keyword uttered by the first user matches a (+) keyword stored in the database 14.
[0067] Here, if the CPU 13 determines that the keyword uttered by the first user matches a (+) keyword stored in the database 14, the CPU 13 evaluates the current state of the first user as being (+) oriented (12) and proceeds to step (13).
[0068] On the other hand, if in step (10) CPU 13 determines that the keyword uttered by the first user matches a (-) keyword stored in database 14, it evaluates the first user's current situation as (-) oriented (11) and proceeds to step (13).
[0069] Then, the CPU 13 calculates the first user's initiative level based on the processes of steps (11) and (12) (13).
[0070] It is assumed that the calculation process involves adding an index to each keyword and performing arithmetic averaging instead of simple addition, but the calculation process is not limited to this as long as the index can be obtained.
[0071] Next, CPU 13 reads out the previous enthusiasm (previous value) associated with the first user from database 14, and determines (14) whether the product of this and the current enthusiasm (current value) calculated in step (14) is less than 1 (<1). If CPU 13 determines that the product is greater than 1, CPU 13 generates a (-) message (15) and draws it on the metaverse for the first user's avatar, so that the first user displays a (-) message, for example, "I feel depressed," on display device 311.
[0072] On the other hand, if it is determined that the count is less than 1, the CPU 13 generates a (+) message (16) and draws the (+) message on the metaverse for the first user's avatar, so that the first user displays the (+) message, such as "Good job!", on the display device 311.
[0073] Next, the CPU 13 updates the information on the avatar of the first user managed in the database 14 (17).
[0074] Next, CPU 13 determines whether the first user has logged out on the URL screen displayed on display device 311 (18), and if it determines that the first user has not logged out, returns to step (4), and if it determines that the first user has logged out, ends this process.
[0075] In addition, by executing control to display emotions other than voice or chat during a conversation with a logged-in avatar on the metaverse hosted by the server device 1, the changes in the avatar's own psychological state are visualized with one of the emotion icons indicating the emotions (a) to (c) in Figure 4. This allows a user of a data terminal operating an avatar to indirectly recognize emotional ups and downs by looking at icons indicating emotions that flash on the screen.
[0076] [Effects of the first embodiment] According to this embodiment, when a first user connects to the metaverse and takes some action, the first user receives some kind of message response (indexed information including the message shown in Figure 7) on the metaverse platform 1A, thereby gaining an opportunity to guide the current psychological state toward a (+) orientation.
[0077] Second Embodiment In the above embodiment, in step (13) shown in FIG. 9, an example has been described in which CPU 13 calculates the degree of enthusiasm of the first user. However, indicator unit 16-2 may be configured to compare an average value of voice information uttered by each avatar within a predetermined time period among the information of each avatar stored in database 14 with the previous value stored in database 14, and index the first amount of change in the feeling of each avatar as numerical information.
[0078] [Effects of the second embodiment] According to this embodiment, it is possible to index the amount of change in the avatar, including a psychological analysis that focuses on the averaged information of the voice information uttered by the avatar.
[0079] Third Embodiment In the above embodiment, in step (13) shown in FIG. 9, an example has been described in which CPU 13 calculates the first user's degree of enthusiasm. However, indicator unit 16-2 may be configured to compare a speed value obtained by averaging the movement speed at which each avatar moves on the metaverse, calculated in a predetermined time unit, among the information on each avatar stored in database 14, with the previous speed value stored in database 14, and index the second amount of change in the feelings of each avatar as numerical information.
[0080] [Effects of the third embodiment] According to this embodiment, it is possible to index the amount of change in the avatar, including a psychological analysis focused on the speed at which the avatar moves.
[0081] [Fourth embodiment] In the above embodiment, in step (13) shown in FIG. 9, an example has been described in which CPU 13 calculates the first user's degree of enthusiasm. However, indicator unit 16-2 may be configured to determine whether the change characteristic based on the voice information acquired by each avatar on the metaverse from the information of each avatar stored in database 14 is positive or negative, and index a third change amount in the feelings of each avatar as numerical information.
[0082] [Effects of the fourth embodiment] According to this embodiment, the amount of change in the avatar can be indexed based on voice information uttered by the avatar, particularly including psychological analysis focusing on whether the change characteristics are positive or negative.
[0083] Fifth embodiment In the above embodiment, in step (13) shown in FIG. 9, an example has been described in which CPU 13 calculates the first user's degree of enthusiasm. However, indicator unit 16-2 may be configured to determine whether the change characteristic based on the voice information acquired by each avatar on the metaverse from the information of each avatar stored in database 14 is positive or negative, and index a third change amount in the feelings of each avatar as numerical information.
[0084] [Effects of the fifth embodiment] According to this embodiment, the amount of change in the avatar can be indexed based on voice information uttered by the avatar, particularly including psychological analysis focusing on whether the change characteristics are positive or negative.
[0085] Sixth Embodiment In the above embodiment, in step (13) shown in FIG. 9, an example has been described in which CPU 13 calculates the degree of enthusiasm of the first user. However, indicator unit 16-2 may be configured to determine whether the change characteristics based on the voice information acquired by each avatar on the metaverse from the information of each avatar stored in database 14 are positive or negative based on the attributes of stored keywords and their frequency of use, and to index a third change amount in the feelings of each avatar as numerical information.
[0086] [Effects of the sixth embodiment] According to this embodiment, the amount of change in an avatar can be indexed, including a psychological analysis determined from the attributes of keywords that store whether the change characteristics based on the voice information that each avatar acquires on the metaverse are positive or negative, and their frequency of use.
[0087] Seventh embodiment In the above embodiment, in step (13) shown in FIG. 9, an example has been described in which the CPU 13 calculates the first user's level of initiative. However, the indicator unit 16-2 may be configured to index the level of positive or negative displacement of each avatar when the avatar changes its movement pattern to appeal based on an indication of an icon indicating a behavioral attribute displayed on the metaverse.
[0088] [Effects of the Seventh Embodiment] According to this embodiment, when the movement pattern of each avatar is changed to appeal, the level of the change can be expressed as an index of the level of displacement in the positive or negative direction.
[0089] The present invention can also be realized by supplying a program that realizes one or more functions of the above-mentioned embodiments to a system or device via a network or a storage medium, and having one or more processors in a computer of the system or device read and execute the program. It may also be realized by a circuit (such as an ASIC) that realizes one or more functions.
[0090] The disclosure regarding the present invention described above can be summarized at least as follows.
[0091] (1) An avatar analysis system in which a server device that provides a service of providing a predetermined event on a metaverse and a plurality of data terminals that operate avatars entering the metaverse can communicate via a predetermined communication medium, the server device comprising: an acquisition means for acquiring information on each avatar depicted in the metaverse; a storage means for storing the information on each avatar acquired by the acquisition means; and an indexing means for analyzing the information on each avatar stored in the storage means and indexing changes in the feelings of each avatar. and a generating means for generating a message in response to any of the logged-in avatars based on the numerical information indexed by the indexing means, wherein the generating means calculates a rate of change in the difference between the positive area and the negative area integrated by the indexing means, and then generates a message indicating a relative change in percentage between the current positive level and the previous positive level in response to each avatar. It is characterized by:
[0092] (2) The avatar information includes actions, voice tone and volume, chat, and reactions.
[0093] (3) The indexing means compares an average value of voice information uttered by each avatar within a predetermined time period among the information of each avatar stored in the storage means with the previous value stored in the storage means, and indexes a first amount of change in the feeling of each avatar as numerical information.
[0094] (4) The indexing means is characterized in that it compares the average speed value of the movement speed at which each avatar moves on the metaverse, calculated in predetermined time units, among the information of each avatar stored in the storage means, with the previous speed value stored in the storage means, and indexes the second amount of change in the feelings of each avatar as numerical information.
[0095] (5) The indexing means is characterized in that it determines whether the change characteristics based on the voice information that each avatar acquires on the metaverse, among the information of each avatar stored in the storage means, are positive or negative, and indexes a third change in the feelings of each avatar as numerical information.
[0097] ( 6 ) The indexing means is characterized in that it determines whether the change characteristics based on the voice information each avatar acquires on the metaverse from the information of each avatar stored in the storage means are positive or negative based on the attributes of stored keywords and their frequency of use, and indexes a third change in the feelings of each avatar as numerical information.
[0098] ( 7 The indexing means changes the movement pattern of each avatar to appeal based on the indication of an icon indicating a behavior attribute displayed on the metaverse. , P The feature of this method is that it indexes the level of displacement in the positive or negative direction.
[0101] ( 8 ) An avatar analysis method for an avatar analysis system in which a server device that provides a service of providing a predetermined event on a metaverse and a plurality of data terminals that operate avatars entering the metaverse can communicate with each other via a predetermined communication medium, the server device having an acquisition step of acquiring information on each avatar drawn in the metaverse, a storage step of storing the information on each avatar acquired in the acquisition step in a storage unit, and an indexing step of analyzing the reaction of each avatar stored in the storage unit in the storage step and indexing changes in the feelings of each avatar; and a generating step of generating a message to be responded to any of the logged-in avatars based on the numerical information indexed in the indexing step, in which the generating step calculates a rate of change of the difference between the positive area and the negative area integrated in the indexing step, and then generates a message indicating a relative change amount between the current positive degree and the previous positive degree in response to each avatar as a percentage. It is characterized by: [Industrial Applicability]
[0102] In this embodiment, a system is used as an example in which general users connect to a metaverse provided by a metaverse platform 1A published on the cloud, and then their behavior within the metaverse is indexed. However, this system can also be used to further enhance the possibilities of the metaverse in education (language services that use the metaverse, metaverse lecture services, etc.), medical care, nursing care, games held in the metaverse, art, music events, and online sales of exhibition events.
[0103] It is also possible to create a system that hybridizes a configuration in which a fourth user operating a fourth data terminal 2-1 to 2-N issues a message to the first to third users operating the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, and the third data terminals 5-1 to 5-N on the metaverse, and a configuration in which an AI avatar issues a message to the first to third users operating the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, and the third data terminals 5-1 to 5-N. [Explanation of symbols]
[0104] 1. Server device 1A Metaverse Platform 2-1~2-N 4th data terminal 3-1~3-N 1st data terminal 4-1~4-N Second Data Terminal 5-1~5-N 3rd Data Terminal
Claims
1. An avatar analysis system in which a server device that provides a service of providing a predetermined event on a metaverse and a plurality of data terminals that operate avatars that enter the metaverse can communicate with each other via a predetermined communication medium, The server device includes: An acquisition means for acquiring information on each avatar to be drawn in the metaverse; a storage means for storing information on each avatar acquired by the acquisition means; an indexing means for analyzing the information on each avatar stored in the storage means and indexing a change in the feeling of each avatar; a generating means for generating a message to be sent to any one of the avatars currently logged in based on the numerical information indexed by the indexing means, The generation means calculates the rate of change of the difference between the positive area and the negative area integrated by the indexing means, and then generates a message indicating the relative change in percentage between the current level of enthusiasm and the previous level of enthusiasm in response to each avatar.
2. 2. The avatar analysis system of claim 1, wherein the avatar information includes actions, tone and volume of voice, chat, and reactions.
3. The avatar analysis system according to claim 1, characterized in that the indexing means compares an average value of voice information uttered by each avatar within a predetermined time period, among the information of each avatar stored in the storage means, with the previous value stored in the storage means, and indexes a first amount of change in the feeling of each avatar as numerical information.
4. The avatar analysis system of claim 1, characterized in that the indexing means compares an average speed value of the movement speed at which each avatar moves on the metaverse, calculated in predetermined time units, among the information of each avatar stored in the storage means, with the previous speed value stored in the storage means, and indexes a second change in the feeling of each avatar as numerical information.
5. The avatar analysis system of claim 1, characterized in that the indexing means determines whether the change characteristics based on the voice information that each avatar acquires on the metaverse, among the information of each avatar stored in the storage means, are positive or negative, and indexes a third change in the feelings of each avatar as numerical information.
6. The avatar analysis system of claim 1, characterized in that the indexing means determines whether the change characteristics based on the voice information each avatar acquires on the metaverse from the information of each avatar stored in the storage means are positive or negative based on the attributes of stored keywords and their frequency of use, and indexes a third change in the feelings of each avatar as numerical information.
7. The avatar analysis system of claim 1, characterized in that the indexing means indexes the level of displacement in a positive or negative direction when each avatar changes its movement pattern to appeal based on the indication of an icon indicating a behavioral attribute displayed on the metaverse.
8. An avatar analysis method for an avatar analysis system in which a server device that provides a service of providing a predetermined event on a metaverse and a plurality of data terminals that operate avatars entering the metaverse can communicate with each other via a predetermined communication medium, comprising: The server device includes: An acquisition step of acquiring information of each avatar to be drawn in the metaverse; a storage step of storing the information of each avatar acquired in the acquisition step in a storage unit; an indexing step of analyzing the reaction of each avatar stored in the storage unit in the storage step and indexing a change in the feeling of each avatar; a generating step of generating a message to be sent to any one of the avatars currently logged in based on the numerical information indexed in the indexing step; The generating step calculates a rate of change of the difference between the positive area and the negative area integrated in the indexing step, and then generates a message indicating a relative change in percentage between the current level of positivity and the previous level of positivity in response to each avatar.
Citation Information
Patent Citations
Behavior information recording apparatus
JP2012168863A
Interactive program, device, and method for expressing sense of listening of character in accordance with user's emotion
JP2022054326A
Advertisement management system, advertisement management method, and advertisement management program
JP2024087892A
System and method for automatic generation of interactive synchronized discrete avatars in real time
JP2024525119A
Information processing device and information processing method
WO2021161841A1
