Information management device, information management method, and program

Abstract

An information management device is provided that can promote the growth of participants who operate terminal devices and take part in activities in a virtual space. [Solution] An information management device (11) has a processor (16) that executes processing and is communicatively connected to a terminal device (12) used by a user (15), wherein the processor (16) is configured to execute a process of providing the terminal device (12) with information including the activity environment in which the user (15) is active, and a process of providing the terminal device (12) with a virtual actor that is active in the activity environment and performs activities that contribute to the growth of the user (15).

Description

[Technical Field]

[0001] The present disclosure relates to an information management device, an information management method, and a program that provide information including a virtual space in which a user can operate a terminal device and perform an activity over a network. [Background technology]

[0002] Patent Document 1 discloses an example of a video conference analysis system (information management device) that provides a virtual space on a network where users can operate terminal devices to conduct activities such as conferences. In the video conference analysis system disclosed in Patent Document 1, terminal devices operated by video conference participants are connected to the video conference analysis system via a network, allowing the participants to participate in the video conference via the network. The video conference analysis system disclosed in Patent Document 1 includes an image and audio receiving unit that receives audio data of participants' speech via the network, and a voice-to-text conversion unit that converts the audio data received by the image and audio receiving unit into text.

[0003] The video conference analysis system also has a text analysis unit that analyzes text indicating the content of participants' remarks, which are composed of characters converted from audio data by the speech-to-text conversion unit, to obtain a remark analysis result, and a screen configuration unit that configures a display screen that displays the text and the remark analysis result obtained by the text analysis unit.

[0004] Furthermore, the video conference analysis system includes a screen providing unit that transmits the display screen constructed by the screen construction unit to the participants in the video conference via a network, and a control unit that converts the audio data received by the image and audio receiving unit into text using a speech-to-text conversion unit to obtain text sentences, analyzes the text sentences using a text sentence analysis unit to obtain the utterance analysis results, constructs the display screen using the screen construction unit, and controls the operation of transmitting the display screen from the screen providing unit.

[0005] The text analysis unit of the video conference analysis system then performs an analysis based on the text indicating the content of the participants' remarks, estimates the emotional level indicating the emotional state and the harassment level indicating the degree of harassment, and obtains the remark analysis results. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Publication No. 2023-97789 Summary of the Invention [Problem to be solved by the invention]

[0007] The inventors of the present application recognized the problem that in the video conference analysis system described in Patent Document 1, actual participants hold conferences in an upper conference room via a network, which makes it difficult to promote the growth of each participant due to situations such as a lack of motivation for each participant to be active.

[0008] An object of the present disclosure is to provide an information management device, an information management method, and a program that are capable of promoting the growth of participants who operate terminal devices and engage in activities in a virtual space. [Means for solving the problem]

[0009] This embodiment discloses an information management device that has a processor that executes processing and is communicatively connected to a terminal device used by a user, wherein the processor is configured to execute the following processes: providing information including the activity environment in which the user is active to the terminal device; and providing a virtual actor that is active in the activity environment and performs activities that contribute to the user's growth to the terminal device. [Effects of the Invention]

[0010] According to this embodiment, it is possible to promote the growth of participants who are active in the activity environment. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a conceptual diagram illustrating an example of the configuration of an information management system including an information management device. [Figure 2] FIG. 1 is a conceptual diagram illustrating an example of the configuration of an information management device. [Figure 3] FIG. 2 is a conceptual diagram illustrating an example of the configuration of a terminal device included in the information management system. [Figure 4] FIG. 1 is a schematic diagram illustrating a display device as an example of an output device of a terminal device. [Figure 5] 1 is a flowchart illustrating an example of an information management method executed in an information management system. DETAILED DESCRIPTION OF THE INVENTION

[0012] (Overview of the information management system) In this embodiment, several specific examples of an information management system, an information management device, an information management method, and a program are described with reference to the drawings. Fig. 1 shows an example of an information management system 10. The information management system 10 is composed of an information management device 11, a terminal device 12, an external computer 13, etc. The information management device 11 is connected to the terminal device 12 and the external computer 13 via a network 14. The external computer 13 has a processor, a storage device, a communication device, etc., and provides a website to the network 14.

[0013] The information management device 11 is managed and operated by an administrator who manages the information management system 10. The terminal devices 12 are operated and used by users 15. A plurality of terminal devices 12 operated by different users may be provided. The external computer 13 is managed by an administrator different from the administrator of the information management device 11. A plurality of external computers 13 managed by different administrators may be realized.

[0014] The network 14 is a communication line that transmits signals, and is composed of base stations, communication satellites, communication antennas, communication equipment (access points), repeaters, communication circuits, communication cables (copper wires, optical fibers), etc. Repeaters include modems (devices that convert analog signals into digital signals), hubs (concentrators), routers (devices that connect terminals to the Internet), etc. The communication line includes one or more communication means of wireless communication or wired communication. Wireless communication includes short-range wireless communication. Short-range wireless communication includes, for example, wireless LAN (Wi-Fi (registered trademark)) and Bluetooth (registered trademark). Wireless communication includes electrical signals, optical signals, radio waves, infrared rays, satellite communication, etc. Signals used for communication include digital signals and analog signals.

[0015] (Configuration of information management device) The information management device 11 is a computer implemented by various hardware and software. The software includes an operating system and applications. The information management device 11 has hardware such as a main body (casing), a processor 16, a main memory device 17, an auxiliary memory device 18, a disk drive 19, and a communication device 20. The processor 16 may be provided inside the main body and configured as a central processing unit (CPU) that integrates an arithmetic unit (arithmetic circuit) and a control device (control circuit). The processor 16 is communicatively connected to the main memory device 17, the auxiliary memory device 18, the disk drive 19, the communication device 20, etc. via a communication bus 21. The processor 16 comprehensively controls other devices and circuits provided inside the main body as well as devices and circuits provided outside the main body.

[0016] Furthermore, instead of or in addition to a central processing unit, the processor 16 may include a processing circuit such as a digital signal processor, an application specific integrated circuit (ASIC), or a graphics processing unit (GPU). The GPU processes image data and audio data.

[0017] The processor 16 executes various processes by running programs. The processes executed by the processor 16 include calculation, judgment, learning, comparison, identification, classification, control, generation, etc. The processes executed by the processor 16 include reading information and data from the auxiliary storage device 18, processing information and data acquired via the network 14, processing information and data to be transmitted to terminal devices, adding, changing, and updating information and data stored in the auxiliary storage device 18, etc.

[0018] The main memory device 17 is a volatile memory device and a non-transitory storage medium. The main memory device 17 is realized, for example, by RAM (Random Access Memory). A volatile memory device holds information, data, instructions, etc. when power is supplied, and erases the information, data, instructions, etc. when power is not supplied. The main memory device 17 functions as a work area and a buffer area when the processor 16 executes the processing of programs, data, instructions, etc. In other words, the main memory device 17 is configured to temporarily store programs, information, data, etc.

[0019] The auxiliary storage device 18 is a non-volatile storage device and a non-transitory storage medium. The auxiliary storage device 18 may also be considered as storage. The auxiliary storage device 18 has a larger capacity than the main storage device 17 and operates in response to input and output commands from the processor 16. The auxiliary storage device 18 is realized, for example, by a head and a storage medium 18A. The head reads data and information from the storage medium 18A and writes data and information to the storage medium. The storage medium 18A may be realized by a magnetic disk, an optical disk, a flash memory, or the like. An example of a magnetic disk is a hard disk drive. An example of an optical disk is a compact disk, a digital video disk, a Blu-ray disk, or the like. A flash memory is a type of semiconductor memory, and examples of flash memory include an SD memory card, a USB flash drive, and a solid-state drive. The storage medium 18A may also be configured to be attachable to and detachable from the head.

[0020] The processor 16 runs non-transitory programs and cooperates with hardware such as the main memory device 17 and a communication device to realize the various functional components shown in Fig. 2. The processor 16 realizes, for example, a website management unit 23, an acquired information processing unit 24, an output information processing unit 25, a user information processing unit 26, an activity environment management unit 27, an activity information processing unit 28, an evaluation information processing unit 29, an artificial intelligence unit 30, and the like.

[0021] When a web application is run by processor 16, website management unit 23 provides a website at a predetermined uniform resource locator (URL) on network 14. When terminal device 12 accesses information management device 11 via a website, website management unit 23 realizes the functions of transmitting a web page written in HTML (Hyper Text Markup Language) or the like to terminal device 12, acquiring information and data transmitted from terminal device 12, and transmitting information and data to terminal device 12.

[0022] The acquired information processing unit 24 has a function of converting information and data acquired from the terminal device 12 and the external computer 13 into a data format that can be processed by the information management device 11. The output information processing unit 25 has a function of converting information and data processed by the information management device 11 into a data format that can be transmitted to the terminal device 12 via the network 14.

[0023] The user information processing unit 26 processes the user information acquired from the terminal device 12, performs user registration, and stores the user information and the results of the user registration in the auxiliary storage device 18.

[0024] The activity environment management unit 27 has a function of generating a virtual space in which the user operates the terminal device 12 to carry out activities, and of managing the virtual space. In this embodiment, a virtual space is exemplified as the virtual space. The virtual space may also be understood as cyberspace or a virtual world. The activity environment management unit 27 also has a function of generating a screen and a virtual space to be displayed on the display unit of the output device of the terminal device 12, from among the information and data sent from the information management device 11 to the terminal device 12.

[0025] The activity information processing unit 28 has the function of processing image information, image data, sound information and sound data, text data, etc. included in the activity information acquired from the terminal device 12 and storing the processing results in the auxiliary storage device 18. Furthermore, the activity information processing unit 28 cooperates with the artificial intelligence unit 30 and the auxiliary storage device 18 to generate activity information about activities performed by the virtual participants and virtual instructors in the virtual space and stores the generated activity information in the auxiliary storage device 18. Furthermore, the activity information processing unit 28 has the function of translating between languages ​​included in the image information, image data, sound information and sound data, and text data and other languages. The translation function of the activity information processing unit 28 allows the language included in the auxiliary information acquired from the external computer 13 to be translated into the language included in the activity information in the virtual space. The activity information processing unit 28 may be configured to process information acquired from the terminal device 12 and cooperate with the artificial intelligence unit 30 and the auxiliary storage device 18 to determine the type and purpose of the activity performed by the user 50 in the virtual space B1. For example, the activity information processing unit 28 can determine the type and purpose of the activity of the participant in response to the operation of the input device 43. The activity information processing unit 28 may also determine the purpose of the activity based on information such as audio, text, images, and video included in the activity information performed in the virtual space.

[0026] The activity information processing unit 28 determines the content of the activities that the virtual participants and virtual instructors will perform in the virtual space B1 based on one or more items of the user 15's growth level, the user's characteristics, and the progress of the activity. For example, the higher the user 15's growth level, the more frequently the virtual participants and virtual instructors will make statements opposing the user 15's statements. Also, compared to when the user 15 is cautious and proactive, the more frequently the virtual participants and virtual instructors will make statements agreeing with the user 15's statements. Furthermore, the higher the progress of the user 15's activities, the less frequently the virtual participants and virtual instructors will make statements responding to the user 15's statements. Note that a relatively higher number of activities means a relatively higher progress of the activity.

[0027] The activity information processing unit 28 also has a function of sending the activity information processed by the information management device 11 to the terminal device 12. Furthermore, the activity information processing unit 28 has a function of acquiring auxiliary information necessary for various processes and generation performed by the activity information processing unit 28, the evaluation information processing unit 29, and the artificial intelligence unit 30 from the external computer 13. The auxiliary information includes image information and image data, sound information and sound data, text data, etc.

[0028] Furthermore, the activity information processing unit 28 has a function of converting, into text data, the sound information and words contained in the sound data of the activity information acquired from the terminal device 12 in cooperation with the artificial intelligence unit 30. Furthermore, the activity information processing unit 28 has a function of converting, into text data, the sound information and words contained in the sound data of the activity information performed by the virtual participants and virtual instructor in the virtual space in cooperation with the artificial intelligence unit 30.

[0029] Furthermore, the activity information processing unit 28, in cooperation with the artificial intelligence unit 30, has the function of estimating the emotions of the user 15 from the image information and image data of the activity information acquired from the terminal device 12 and converting the estimated emotions into text data. The user's emotions include joy, satisfaction, anger, sadness, calmness, composure, enjoyment, surprise, concentration, boredom, sleepiness, excitement, interest, comfort, discomfort, relief, relaxation, agreement, disagreement, objection, doubt, confusion, etc. These emotions can be estimated by processing the eyelid opening, gaze, eyebrow movement, presence or absence of nose wrinkles, mouth movement, mouth opening, pupil opening, etc., contained in an image of the user's upper body, including their face. These emotions can also be estimated from the subject's upper body movements, such as whether or not they tilt their head, nod, hand movements, etc. The estimated emotions are each quantified, and a table or graph can be generated.

[0030] In addition, the technology for analyzing the emotions of a subject (user) based on image information including the subject's face is a publicly known technology, as shown in, for example, Patent No. 6868422, Patent No. 6703893, Patent No. 6042015, Patent No. 3953024, Patent No. 4458888, JP 2015-229040, JP 2018-32164, JP 2022-139436, JP 2020-184216, etc., and therefore detailed explanations thereof will be omitted.

[0031] The evaluation information processing unit 29 works in cooperation with the artificial intelligence unit 30 to determine the degree of growth of the user 15 based on the activity information acquired from the terminal device 12, the activity information performed by the virtual participants and virtual instructor, various information acquired from the external computer 13, and the information and data stored in the auxiliary storage device 18, and is configured to generate relatively higher evaluation information as the degree of growth becomes relatively higher. The degree of growth of the user 15 is determined based on the number of activities, the duration of the activity, the number of comments made during the activity, the number of times the virtual participants agreed during the activity, the number of times the virtual participants nodded during the activity, the number of times the virtual participants gave hints from the virtual instructor during the activity, etc.

[0032] For example, the relatively more the number of times user 15 engages in activity, the higher the degree of growth of user 15 is determined to be. Also, the relatively longer the period of activity of user 15, the higher the degree of growth of user 15 is determined to be. Also, the relatively more times user 15 speaks during each activity, the higher the degree of growth of user 15 is determined to be. The relatively more times the virtual participants agree during each activity, the higher the degree of growth of user 15 is determined to be. The relatively more times the virtual participants nod during each activity, the higher the degree of growth of user 15 is determined to be.

[0033] The degree of growth of the user 15 is judged to increase as the number of times the virtual instructor gives hints during each activity decreases. The evaluation information processing unit 29 can also provide the terminal device 12 with tests according to the characteristics, progress of the activity, and content of the activity of the user 15, obtain the answers to the tests taken by the user 15, and judge the degree of growth of the user 15 based on the results. The degree of growth of the user 15 is judged to increase as the score obtained on the test increases. The evaluation information processing unit 29 can display the evaluation information as a score. The evaluation information processing unit 29 also has the function of storing the generated evaluation information in the auxiliary storage device 18 and sending the evaluation information to the terminal device 12.

[0034] When the program is run, the artificial intelligence unit 30 executes various processes in cooperation with the activity information processing unit 28, the evaluation information processing unit 29, and the auxiliary storage device 18. The processes executed by the artificial intelligence unit 30 include a learning stage, an inference stage, etc. The information and data used by the artificial intelligence unit 30 to execute the processes include image information, sound information, image data, sound data, text data, models, etc.

[0035] In the learning stage, i.e., the machine learning stage, the artificial intelligence unit 30 processes input learning target data with a learning model and outputs a processing result. The artificial intelligence unit 30 also compares the processing result with correct answer data, and trains the learning model based on the error to generate a trained model. In the inference stage, the artificial intelligence unit 30 processes inference target data with the trained model and outputs an inference result.

[0036] The processing of input data performed by machine learning includes extracting features from the input data. The features of the input data include classification and regression. Classification involves classifying and identifying features. Regression involves grasping the trends of classified features. The trained model is stored in the auxiliary storage device 18, and as machine learning is repeated, the trained model is modified as needed.

[0037] The machine learning performed by the artificial intelligence unit 30 includes three types: supervised learning, unsupervised learning, and reinforcement learning. In supervised learning, a learning model is trained by comparing output data with correct answer data, and a learned model is generated. Unsupervised learning is a learning method that uses learning data that does not contain correct answers, and classifies the learning data into groups of data with similar characteristics (such as regularity). Reinforcement learning is a method that uses trial and error based on output data to acquire optimal guidelines for action, such as "this is what you should do in this case," in order to achieve the goal of an activity.

[0038] Furthermore, when the processor 16 runs the program, the artificial intelligence unit 30 in this embodiment has the function of automatically generating promotional information to promote the growth of the user 15 by using various information and data used in the learning and inference stages, the inference results, various information and data obtained from the terminal device 12, various information and data obtained from the external computer 13, and various information and data stored in the auxiliary storage device 18.

[0039] Based on the prompts input to the trained model, the artificial intelligence unit 30 automatically generates promotion information, such as activity information recommended to the user 15 to promote the growth of the user 15, and activity information performed by the virtual participants 51 and virtual instructors 52 in the virtual space B1 to promote the growth of the user 15. The prompts input to the trained model include the type of activity performed in the virtual space B1, the purpose and task of the activity, the user 15's occupation, occupational tasks, occupational title and position, years of occupational experience, hobbies and interests, etc. The prompts input to the trained model may be input by the user 15 on the terminal device 12 and sent to the information management device 11, or may be automatically generated by the artificial intelligence unit 30.

[0040] The artificial intelligence unit 30 can output information about activities that are desirable for the virtual participants to perform, output activities and guidance that are desirable for the virtual instructor to perform, output information and data that are useful for promoting the user's growth, etc., based on various information and data obtained from the terminal device 12 and the external computer 13 and various information and data stored in the auxiliary storage device 18. Here, desirable activities mean activities that are expected to be useful for the user's growth.

[0041] The artificial intelligence unit 30 also stores promotion information for promoting the growth of the user 15 in the auxiliary storage device 18. Furthermore, the machine learning performed by the artificial intelligence unit 30 aims to improve the quality of the activity information performed by the virtual consultant and virtual instructor, and the quality of the generated evaluation information. The higher the quality of the information, the higher the contribution rate to the user's growth.

[0042] In this embodiment, the information and data included in the activity information correspond to input data. For example, reinforcement learning can be performed in which the information management device 11 generates activity information of the virtual participants and virtual instructors, sends the activity information to a terminal device, and only when the user's level of growth has relatively increased, points (reward) are awarded to the artificial intelligence unit 30. By performing such reinforcement learning, the learning accuracy of the artificial intelligence unit 30 is further improved. Whether the user's growth has been promoted is determined, for example, by whether the score included in the evaluation information has increased. The score included in the evaluation information will be described later.

[0043] The artificial intelligence unit 30 can use a neural network as a learning model to achieve machine learning. A neural network has an input layer, an intermediate layer (hidden layer), and an output layer. The intermediate layer is configured to convert input information into a form that is useful for the output layer. The artificial intelligence unit 30 can also perform deep learning to realize the neural network intermediate layer. In deep learning, the intermediate layer is multi-layered with multiple types of stages (nodes), and weights and biases are assigned to functions (features) contained in the information. Deep learning automatically specifies the functions (features) that the intermediate layer focuses on, thereby reducing noise in the information and data input to the learning model.

[0044] Furthermore, the artificial intelligence unit 30 includes a general-purpose natural language processing learning model, such as a large-scale language model that has learned from a huge amount of data. Natural language processing allows a computer to understand text data and audio information written in natural language and perform processing according to the purpose of activities taking place in a virtual space. Natural language processing combines processes such as morphological analysis, syntactic analysis, semantic analysis, context analysis, and intent analysis to process natural language, enabling machine translation, text summarization, speech recognition, and the like.

[0045] A language model is a type of probabilistic model used in natural language processing, and is a model for probabilistically predicting under what conditions given words and sentences are likely to be used in natural language. A language model is used to calculate the occurrence probability of a given word string or sentence, or to compare the occurrence probabilities of multiple word strings or sentences, to automatically generate words and sentences that are likely to appear based on the context when predicting the next word or sentence. The artificial intelligence unit 30 processes the language contained in the sound information and sound data acquired from the terminal device 12 using a large-scale language model to generate text data.

[0046] Furthermore, the artificial intelligence unit 30 repeats learning by itself through deep learning in the process of machine learning, and functions as a generative artificial intelligence that automatically generates new information and data based on the characteristics of information and data, relationships between pieces of information, and relationships between pieces of data discovered in the learning process. The relationships between pieces of information and relationships between pieces of data include correlations and causal relationships.

[0047] When functioning as a generative artificial intelligence unit, the artificial intelligence unit 30 can realize text generation, image generation, video generation, and voice generation. Text generation is a function that, when a prompt (in text format), such as a question or command, is input, analyzes the content and intent of the prompt and uses information and data stored in an auxiliary storage device to automatically generate a response (in text format) to the prompt. By using a large-scale language model, natural and highly accurate responses can be obtained.

[0048] Image generation is a function that automatically generates an original image that is close to the image of the input prompt (text format) using information and data stored in an auxiliary storage device. Examples of image generation AI include Stable Diffusion, Mid Journey, and Dali Two.

[0049] Video generation is a function that automatically generates an original video that closely matches the image of the input prompt (text format) by using information and data stored in an auxiliary storage device. For example, a video generation AI called Gentoo is known.

[0050] Speech generation is a function that automatically generates original voice data (answers, music, etc.) in response to an input prompt (voice or text format) using information and data stored in an auxiliary storage device. Furthermore, by training a large amount of voice data from a specific person, it can read various sentences in a voice that is identical to that person's voice, even if that person is not present. For example, a voice generation AI called Barui is known.

[0051] Auxiliary storage device 18 is realized by one or more of a configuration provided inside the main body of information management device 11 and a configuration provided outside the main body. Auxiliary storage device 18 stores applications run by processor 16, information and data before being processed by processor 16, and information and data resulting from processing by processor 16. Applications stored in auxiliary storage device 18 include non-transitory programs, manuals, setting files, files for storing data, data, various libraries, etc. Information stored in auxiliary storage device 18 also includes hypertext data that constitutes web pages on a website, etc.

[0052] 2, the auxiliary storage device 18 is realized by including an image information storage unit 31, a sound information storage unit 32, a text data storage unit 33, an evaluation information storage unit 34, a supplementary information storage unit 35, a user information storage unit 36, a learning data storage unit 37, an activity information storage unit 38, etc. The image information storage unit 31 stores image information and image data included in the activity information acquired from the terminal device 12, image information and image data included in the activity information generated by the information management device 11, and image information and image data included in the information acquired from the external computer 13.

[0053] The sound information storage unit 32 stores sound information and sound data contained in activity information acquired from the terminal device 12, sound information and sound data contained in activity information generated by the information management device 11, and sound information and sound data contained in information acquired from the external computer 13.

[0054] The text data storage unit 33 stores text data contained in the activity information acquired from the terminal device 12, sound information contained in the activity information acquired from the terminal device 12 and text data obtained by converting the sound data into text, text data contained in the activity information generated by the information management device 11, and text data contained in the information acquired from the external computer 13.

[0055] The evaluation information storage unit 34 stores the evaluation information generated by the evaluation information processing unit 29. The supplemental information storage unit 35 stores various information and data acquired from the external computer 13.

[0056] The user information storage unit 36 ​​stores user information and user registration information acquired from the terminal device 12. The user information stored in the user information storage unit 36 ​​may also include an activity history of activities that the user 15 has previously performed in the virtual space. The activity history includes the date each activity was performed, the number of times the activity was performed, the activity period, the time required for each activity, the purpose and objectives of each activity, evaluation information for each activity by the user 15, changes in the evaluation information, etc. The activity period is the period that has elapsed since the first time the activity was performed.

[0057] The learning data storage unit 37 stores various information used in machine learning by the artificial intelligence unit 30, as well as information and data processed and output in the learning and inference stages of machine learning. For example, learning data and correct answer data, learning models, trained models, large amounts of data for natural language processing, large-scale language models, etc.

[0058] The activity information storage unit 38 stores activity information obtained from the terminal device 12, activity information of the virtual participants and activity information of the virtual instructor generated by the information management device 11, screen data to be provided to the terminal device 12, characteristics and features of the virtual participants and virtual instructor, avatar images of the virtual participants and virtual instructor, image data for generating the virtual space, etc.

[0059] The communication device 20 includes devices, equipment, and standards that connect the information management device 11 to the network 14 via at least one of a wireless communication system and a wired communication system. The hardware that constitutes the communication device 20 includes, for example, a LAN card, a network adapter, a network interface card, a communication cable, a communication antenna, a communication port, and the like.

[0060] (Terminal device configuration) The terminal device 12 is a computer used and operated by a user 15. The terminal device 12 includes, for example, a portable computer and a fixed computer. The portable computer includes a smartphone and a tablet computer. The fixed computer includes a desktop computer, a notebook computer, and the like.

[0061] The terminal device 12 is connected to the information management device 11 and the external computer 13 via a network 14. As shown in FIG. 3, the terminal device 12 includes a main body (casing), a processor 40, a main storage device 41, an auxiliary storage device 42, an input device 43, an output device 44, a communication device 45, and the like. The processor 40 may be provided inside the main body and configured as a central processing unit (CPU (Central Processing Unit)) that integrates an arithmetic device (arithmetic circuit) and a control device (control circuit). The processor 40 is communicably connected to the main storage device 41, the auxiliary storage device 42, the input device 43, the output device 44, the communication device 45, and the like via a communication bus 46. The processor 40 is configured to comprehensively control other devices and circuits provided inside the main body and devices and circuits provided outside the main body.

[0062] The processor 40 processes information by running non-transitory programs. The information processed by the processor 40 includes image information and image data, sound information and sound data, text data, signals, etc. Text includes letters, numbers, sentences, symbols, figures, etc. Images include videos, videos, still images, photographs, etc. The processing performed by the processor 40 includes calculations, judgments, comparisons, controls, etc.

[0063] The processing executed by the processor 40 includes processing for reading information from the auxiliary storage device 42, executing applications obtained from the information management device 11 and the external computer 13, processing and judging information obtained from the information management device 11 and the external computer 13, adding, changing and updating information stored in the auxiliary storage device 42, and sending information and data processed by the processor 40 to the information management device 11.

[0064] The main memory device 41 is a volatile memory device and a non-transitory storage medium. The main memory device 41 is realized, for example, by RAM (Random Access Memory). A volatile memory device retains information, data, instructions, etc. when power is supplied, and erases the information, data, instructions, etc. when power is cut off. The main memory device 41 functions as a work area and a buffer area when the processor 40 executes processing of programs, data, instructions, etc. The auxiliary memory device 42 is a non-volatile memory device and a non-transitory storage medium. A non-volatile memory device retains information, data, instructions, etc. when power is supplied, and can retain the information, data, instructions, etc. even when power is cut off. The auxiliary memory device 42 stores non-transitory applications, programs, instructions, information, and data. The auxiliary memory device 42 also stores information and data to be processed by the processor 40. The information and data stored in the auxiliary memory device 42 include processing results of the processor 40, various data, operation contents of the input device 43, control signals to the output device 44, etc.

[0065] The processor 40 reads and executes non-temporary programs stored in the auxiliary storage device 422, processes the operation content of the input device 43, the data and information obtained by operating the input device 43, the content output by the output device 44, the signals output via the communication device 45, and the signals input via the communication device 45, and performs processing to store information in the auxiliary storage device 42.

[0066] The auxiliary storage device 42 has a larger capacity than the main storage device 41, and operates in response to input and output commands from the processor 40. The auxiliary storage device 42 is realized, for example, by a head and a non-transitory storage medium 42A. The head writes information and data to the storage medium 42A and reads information and data from the storage medium 42A. The storage medium 42A is realized by a magnetic disk, an optical disk, a flash memory, etc. An example of a magnetic disk is a hard disk drive. An example of an optical disk is a compact disk, a digital video disk, a Blu-ray disk, etc. A flash memory is a type of semiconductor memory, and examples of flash memory include an SD memory card, a USB flash drive, a solid-state drive, etc. The storage medium 42A may be configured to be attachable to and detachable from the main body.

[0067] The input device 43 is a device operated by the user 15, and may be composed of devices such as a display device 47, a keyboard, a mouse, a touchpad, operation buttons, a microphone, an image capture device, etc. The display device 47 is realized by a display, for example, a liquid crystal display or an organic electroluminescence display. The display device 47 displays a screen 48 as shown in FIG. 4. The screen 48 displays images, operation buttons, operation tabs, etc. The microphone is an electronic component that converts acquired sound data into an electrical signal and outputs it. The microphone may be structured either to be directly attached to the main body or to be connected to the main body via a cable.

[0068] The image acquisition device captures an object to generate an image, converts the generated image into an electrical signal, and outputs the image. Examples of the image acquisition device include a camera, a scanner, a barcode reader, and the like. The image acquisition device may be either directly attached to the main body or connected to the main body via a cable. Objects captured by the image acquisition device include landscapes, people, documents, barcodes, QR Codes (registered trademark), and the like. Images include videos, still images, photographs, and the like. Images generated by the image acquisition device are stored in an auxiliary storage device. The camera of the image acquisition device also captures an image of the user 15, and the image information captured by the camera is sent from the terminal device 12 to the information management device 11.

[0069] The devices included in the input device 43 are selected appropriately depending on whether the terminal device 12 is a mobile terminal or a fixed terminal, and the attachment structure to the main body is also selected appropriately. That is, the input device 43 has a structure that allows it to be attached directly to the main body, or a structure that allows it to be connected to the main body via a cable.

[0070] The input device 43 is operated when inputting information and data to the terminal device 12, when causing the terminal device 12 to execute various processes, when sending various information and data from the terminal device 12 to the network 14, when the terminal device 12 obtains various information and data via the network 14, etc. The information and data input to the terminal device 12 by the input device 43 includes text data, image data, sound data, etc. The information obtained by the terminal device 12 via the auxiliary storage device 42 and the network 14 includes non-transitory programs, text data, image data, sound data, etc.

[0071] The output device 44 includes devices such as a display device 47, a printer, and a speaker. The display device 47 is the same as the display device 47 in the input device 43. The speaker is a device that converts electrical signals contained in information and data into sound information and outputs it. The speaker may be either a structure that is directly attached to the main body or a structure that is connected to the main body by a cable. The printer prints information and data on paper using toner or ink and outputs it.

[0072] The communication device 45 includes devices, equipment, and standards that connect the terminal device 12 to the network 14 via at least one of a wireless communication system and a wired communication system. Devices and equipment that connect the terminal device 12 to the network 14 include cables, antennas, routers, communication circuits, communication ports, communication connectors, communication hubs, etc.

[0073] (An example of information management method)

[0074] (1) Operations and processes performed on terminal devices The information management system 10 may execute an information management method as shown in FIG. 5. In step S10, a user (a real person) 15 operates a web browser by operating the terminal device 12 and can access a website by selecting a specific URL. The user 15 can transmit user information from the terminal device 12 to the information management device 11. The user information includes the user's 15 name, the user's occupation, occupational duties, occupational title and position, years of occupational experience, hobbies and interests, gender, date of birth, address, email address, identification number, password, etc. The identification number is unique information that distinguishes multiple users 15 from each other.

[0075] When a user 15 transmits user information from terminal device 12 to information management device 11, user registration is performed in information management device 11. Once user registration is performed in information management device 11, terminal device 12 can be connected to information management device 11 via network 14, and services provided by information management device 11 can be used on terminal device 12. There may be one user 15 or multiple users 15. When multiple users 15 each operate a different terminal device 12, each terminal device 12 can be connected to information management device 11.

[0076] When the terminal device 12 is connected to the information management device 11, in step S11, it can acquire information about the virtual space from the information management device 11. The information about the virtual space includes, for example, an image of the virtual space. In step S11, the terminal device 12 displays display areas A1, A2, and A3 on the screen 48 of the display device 47, for example, as shown in FIG. 4. In the display area A1, an image of the virtual space B1 is displayed. Therefore, by operating the terminal device 12, the user 15 can enter and exit the virtual space B1.

[0077] When user 15 enters virtual space B1, user 50, an avatar (character) that personifies user 15, is displayed in virtual space B1. In this embodiment, users 15 and 50 will be collectively referred to as user 15. User 15 can be active within virtual space B1. Various activities can be carried out within virtual space B1. Types of activities include meetings, training, consultations, etc. User 15 may operate input device 43 to input the type and purpose of the activity. The purpose of a meeting may be information sharing, idea generation, decision-making, etc. The purpose of training may be self-development, increasing knowledge, organizational growth, etc. The purpose of consultation may be for participants to ask questions about unclear points, to organize and confirm their thoughts, to discuss anxieties and worries, etc.

[0078] Furthermore, the activity environment management unit 27 of the information management device 11 may be configured to automatically set the type of activity, the purpose of the activity, etc. In this case, the activity environment management unit 27 may automatically set the type of activity, the purpose of the activity, etc. based on the past activity history of the user 15. For example, the activity environment management unit 27 may set the type of activity, the purpose of the activity, etc. that can contribute to the growth of the user 15 based on the past activity history of the user 15.

[0079] In the display area A2, for example, a comment frame 60 is displayed. Within the comment frame 60, comments of the user 15, virtual participant 51, virtual instructor 52, etc. are displayed as text data. In the display area A3, for example, an evaluation frame 61 is displayed. Within the evaluation frame 61, for example, evaluation information is displayed as text data. Information such as the display areas A1, A2, A3, virtual space B1, user 50, virtual participant 51, virtual instructor 52, etc. displayed on the screen 48 is provided from the information management device 11 to the terminal device 12.

[0080] The terminal device 12 can store activity information of the activities performed by the user 15 in the virtual space B1 in the auxiliary storage device 42 in step S11. The activity information includes text data, sound information and sound data, image information and image data, etc. Text data includes characters, sentences, etc. Sound information and sound data includes voice, music, and sound. Image information and image data includes photographs, illustrations, still images, and videos.

[0081] While the user 15 is active in the virtual space B1, the terminal device 12 can send activity information to the information management device 11 in step S12. Also, when the user 15 is active in the virtual space B1, the terminal device 12 can acquire the activity information from the information management device 11 in step S13. The activity information acquired by the terminal device 12 from the information management device 11 includes text data, sound information and sound data, and image information and image data.

[0082] When the user 15 is active in the virtual space B1, in step S14, the activity information can be output from the output device 44 of the terminal device 12. For example, text data and image data included in the activity information can be displayed in any of the display areas A1, A2, and A3 of the display device 47. In addition, sound information and sound data included in the activity information can be output from the speaker or earphones of the output device 44. In step S14, the activity information output from the output device 44 includes one or more pieces of activity information sent from the terminal device 12 to the information management device 11 and activity information acquired by the terminal device 12 from the information management device 11.

[0083] (2) Processing performed by the information management device 5, the information management device 11 provides a website at a predetermined URL on the network 14. When the terminal device 12 accesses the website, the information management device 11 provides the web pages and display areas A1, A2, and A3 included in the website to the terminal device 12 in step S21. The information management device 11 may allow the virtual participant 51 and the virtual instructor 52 to enter and exit the virtual space B1 while the user 15 is in the virtual space B1. The virtual participant 51 and the virtual instructor 52 are both displayed as avatars within the virtual space B1.

[0084] The virtual participant 51 can act within the virtual space B1 in step S22. The virtual participant 51 can make statements, gestures, etc. together with the user 15 while participating in a meeting, attending a training course, etc. The statements and gestures made by the virtual participant 51 include statements in support of the activity of the user 15, statements opposing the activity of the user 15, statements supporting the activity of the user 15, and statements giving hints to the activity of the user 15.

[0085] The virtual instructor 52 can also act within the virtual space B1 in step S22. The virtual instructor 52 plays roles such as encouraging the user 15 and the virtual participants 51 to speak, understanding their opinions and expanding the discussion, and converging the discussion to support consensus building. Specifically, the virtual instructor 52 can instruct the user 15 and the virtual participants 51 in a meeting, lecture the user 15 and the virtual participants 51 in training, and converse, make statements, gestures, etc. with the user 15 and the virtual participants 51. The conversations, statements, and gestures performed by the virtual instructor 52 include content supporting the user 15's activities, content opposing the user 15's activities, content supporting the user 15's activities, content giving hints for the user 15's activities, and content evaluating the user 15's activities.

[0086] Furthermore, when the virtual participant 51 is active in the virtual space B1, in step S23, the information management device 11 can acquire activity information from the terminal device 12. Furthermore, either while the virtual participant 51 is active in the virtual space B1 (in real time) or after the virtual participant 51 has finished their activity in the virtual space B1, in step S24, the information management device 11 can send the activity information to the terminal device 12. The activity information sent from the information management device 11 to the terminal device 12 includes text data, sound information and sound data, and image information and image data. The activity information sent from the information management device 11 to the terminal device 12 may be either information corresponding to the activity information acquired from the terminal device 12 or information independently generated by the information management device 11 regardless of the activity information acquired from the terminal device 12.

[0087] Furthermore, the activity information sent from the information management device 11 to the terminal device 12 includes evaluation information that evaluates the activity performed by the user 15 in the virtual space B1. In other words, the information management device 11 can acquire, specifically generate, evaluation information that evaluates the activity performed by the user 15 in the virtual space B1 in step S24, and feed the generated evaluation information back to the terminal device 12.

[0088] The information management device 11 processes the activity information etc. acquired from the terminal device 12 in step S25 while the user 15, the virtual participant 51, and the virtual instructor 52 are active in the virtual space B1, or after the user 15, the virtual participant 51, and the virtual instructor 52 have completed their activities in the virtual space B1, and stores the information in the auxiliary storage device 18. The information management device 11 can store the activity information of the activities performed by the virtual participant 51 and the virtual instructor 52 in the virtual space B1 in step S25 in the auxiliary storage device 18. Furthermore, the information management device 11 stores the activity information sent to the terminal device 12 in step S24 in the auxiliary storage device 18.

[0089] (Example) The evaluation information acquired by the information management device 11 in step S24 is the activity of the user 15 in the virtual space B1, or more precisely, an evaluation of the activity of the user 15. The evaluation information includes items such as an overall evaluation of the activity of the user 15, listening and empathy skills, good points, points for improvement, provision of new perspectives, and hints for improving the overall evaluation. The items included in each piece of evaluation information are generated as text data together with a score. Furthermore, if the type of activity is training, the evaluation information may also include whether the user 15 passed or failed a comprehension test in the training in which the user 15 participated.

[0090] The information management device 11 generates evaluation information based on the evaluation criteria, the purpose (objective) of the activity in the virtual space B1, and the activity information of the user 15. The evaluation criteria for generating the evaluation information are stored in the auxiliary storage device 42. The evaluation criteria may be the same regardless of the type of activity or the purpose of the activity, or may be different. The evaluation criteria may also differ depending on the age of the user 15, the number of times the activity is performed, the duration of the activity, etc. For example, the level of the evaluation criteria may be set relatively higher as the user 15's age increases, the number of times the user 15's activity increases, or the duration of the user 15's activity increases. The age of the user 15 is determined from the user information. The number of times the user 15's activity and the duration of the activity are determined from the history of the user 15's activities in the virtual space B1.

[0091] The technology for evaluating subjects and meetings by processing information obtained from the subjects (users) of evaluation, such as image data, audio data, text data, etc., is a publicly known technology, as described in WO2009-144811, JP2011-66794A, etc., and therefore a detailed description thereof will be omitted.

[0092] The statements of the user 15 are judged based on whether or not there is a logical leap in the content of the statement, whether or not the statement is only about the subject of the activity, whether or not the user 15 has his or her own opinion about the subject of the activity, etc. The attitude, gestures, and emotions of the user 15 are judged from the information and data sent from the terminal device 12 to the information management device 11.

[0093] Furthermore, if user 15's statements include phrases such as "I agree" or "I think so too," user 15's ability to listen and empathize is evaluated as being relatively high. If user 15 nods at the statements of virtual participant 51 or virtual instructor 52, user 15's ability to listen and empathize is evaluated as being relatively high. If user 15's statements include phrases such as "I disagree" or "I don't think so," user 15's ability to listen and empathize is evaluated as being relatively low. If user 15 tilts his or her head while listening to the statements of virtual participant 51 or virtual instructor 52, user 15's ability to listen and empathize is evaluated as being relatively low.

[0094] Furthermore, if the number of times the user 15 speaks within a given time is equal to or greater than a predetermined number, it is evaluated as good. If the number of times the user 15 speaks within a given time is less than a predetermined number, it is evaluated as something that needs improvement.

[0095] The technology for analyzing and evaluating the speech of a subject based on sound information and sound data obtained from the subject is publicly known, as shown in, for example, Patent No. 4763028, Patent No. 5255464, Patent No. 5267269, etc., and therefore a detailed description thereof will be omitted. A new perspective is the provision of topics suggested by users 15 in their activities, etc.

[0096] The information management device 11 can randomly change the characteristics, attitude, remarks, etc. of the virtual participants 51 depending on the type and purpose of the activity performed in the virtual space B1. Furthermore, the information management device 11 can randomly change the characteristics, attitude, remarks, etc. of the virtual participants 51 even if the type and purpose of the activity performed in the virtual space B1 is the same. Furthermore, the information management device 11 can randomly change the characteristics, attitude, remarks, etc. of the virtual participants 51 depending on the characteristics, attitude, remarks, etc. of the users 15 participating in the virtual space B1. In other words, the information management device 11 can change the difficulty level of the activities performed by the users 15 in the virtual space B1. Therefore, the users 15 can improve their level of adaptability to activities performed in the virtual space B1.

[0097] The information management device 11 can determine the reason why the evaluation information for the user 15 was generated by statistically processing the activity information acquired from the terminal device 12 based on the information and data stored in the auxiliary storage device 18. Furthermore, the information management device 11 can infer how the evaluation information for the user 15 will change by performing machine learning on the activity information acquired from the terminal device 12.

[0098] The information management device 11 also has a function of suggesting lectures that the user 15 should take in the next stage, videos that the user 15 should watch in the next stage, etc., based on inference results included in the evaluation information for the user 15. The desirable lectures and desirable videos are lectures and videos that are estimated to be useful in relatively improving the evaluation of the user 15. The desirable lectures and desirable videos are stored in the auxiliary storage device 18, and are, for example, lectures and videos related to DE&I. D stands for Diversity, E stands for Equity, and I stands for Inclusion. DE&I means "accepting and including" "diversity" and aiming to create an environment where people can grow while respecting each other by providing "fair" opportunities to each person.

[0099] Furthermore, the information management device 11 can include the following items in the evaluation information generated at a stage where the data included in the activity information acquired from the terminal device 12 and the inference results have been accumulated over a predetermined period of time: Examples of items that can be included in the evaluation information include the allocation of TODOs (tasks, tasks, etc. that the user must do) in the user's 15 daily life, an action plan for the user 15 to do next in the virtual space B1, characteristics of the virtual participant that the user 15 would like to interact with next in the virtual space B1, and a discussion topic that the user 15 would like to discuss next in the virtual space B1.

[0100] The items of evaluation information generated by the information management device 11 may include biases that the user 15 is unaware of, for example, normalization bias. The bias may include, for example, an item such as, "Your characteristics tend to be normalization bias." Normalization bias is a mental mechanism in which, when a subject (user) encounters an unexpected situation, the subject automatically recognizes that "the situation is within the normal range" by using preconceived notions and prejudices such as "that can't happen."

[0101] The items of evaluation information generated by the information management device 11 may include rankings given to a plurality of different users 15 for activities performed within a predetermined period. For example, the evaluations given for each activity may be totaled as evaluations for a predetermined period or a predetermined number of times, and the total evaluations may be compared to give rankings to a plurality of different users 15. The predetermined period may be, for example, a month, a year, or the like.

[0102] The information management device 11 may have a function to adjust the ranking given to the user 15 based on the number of times the user 15 has engaged in an activity and the period of time the user 15 has engaged in the activity. For example, it is possible to adjust the ranking so that the relatively more the number of times the user 15 has engaged in an activity, the less likely the user 15 is to be ranked, or the relatively longer the period of time the user 15 has engaged in an activity, the less likely the user 15 is to be ranked. Furthermore, a ranking may be given to a user 15 who has engaged in an activity a predetermined number of times or more. The evaluation information generated by the information management device 11 may include awarding a trophy to a user 15 who has earned an evaluation score equal to or greater than a predetermined number of points. Furthermore, the cumulative number of activities (sessions) performed in the virtual space B1 may be displayed on the screen 48.

[0103] The evaluation information generated by the information management device 11 may include information quantifying the degree to which the self-efficacy of the virtual participant 51 has increased. Self-efficacy is the recognition that one has the ability to achieve a goal. The information management device 11 can estimate the self-efficacy of the virtual participant 51 based on the history and records of the interaction between the virtual participant 51 and the user 15.

[0104] The information management device 11 estimates the self-efficacy of the virtual participant 51 based on the behavior of the virtual participant 51 toward the user 15, such as the user's utterances and attitudes, and can quantify the estimated result of the virtual participant's self-efficacy and estimate the transition of emotions over time. Reference data for quantifying the estimated result of the virtual participant's self-efficacy is stored in the auxiliary storage device 18. The reference data has a characteristic that, for example, the more times the user 15 behaves positively in response to the behavior of the virtual participant 51 within a predetermined period of time, the higher the numerical value indicating the virtual participant's self-efficacy.

[0105] Furthermore, the information management device 11 may have a function of automatically updating and adjusting parameters that affect the behavior of the virtual participant 51 in real time while the virtual participant 51 and the user 15 are engaged in an activity, so that the estimated result of the virtual participant's 51 self-efficacy becomes a relatively high numerical value.

[0106] The information management device 11 may have a function for setting the characteristics of the virtual participant 51 as a person who does not exist at the time the user 15 is active, a historical figure, a person with outstanding achievements in the field of training, etc. For example, if the training field is management, the information management device 11 can set Drucker as the virtual participant 51. Then, the information management device 11 can generate characteristics in line with Drucker's management ability as the characteristics of the activity of the virtual participant 51. In other words, the virtual participant 51 has a higher level of management experience than the user 15. By working with the virtual participant 51 modeled after Drucker, the user 15 can expect to develop their management ability.

[0107] Furthermore, the user 15 may operate the terminal device 12 in step S12 to upload auxiliary activity information about activities that the user 15 and the user's boss performed in real space (the real world) to the information management device 11. The auxiliary activity information includes text data, image data, and sound data. The information management device 11 may acquire the auxiliary activity information from the terminal device 12 in step S23.

[0108] The information management device 11 may process the auxiliary activity information acquired in step S23 in step S24 to generate auxiliary evaluation information for evaluating the auxiliary activity information. The auxiliary evaluation information includes items such as the actions of the user and the superior included in the auxiliary activity information, such as remarks, attitudes, gestures, etc. The criteria for evaluating the auxiliary activity information include criteria for evaluating the activities of the superior in addition to the criteria for evaluating the activity information described above.

[0109] Then, the information management device 11 can send the auxiliary evaluation information to the terminal device 12 in step S24. The terminal device 12 can acquire the auxiliary evaluation information in step S13. The terminal device 12 can output the auxiliary evaluation information on the output device 44 in step S14.

[0110] The information management device 11 may be configured to be able to set the characteristics of the virtual participant 51 and the virtual instructor 52 according to the characteristics of the user 15. The characteristics of the user 15 include the personality of the user 15, the level of growth of the user 15, the position of the user 15, the progress of the lecture, etc. For example, if the user 15 has a cautious characteristic, the characteristics of the virtual participant 51 and the virtual instructor 52 can be set so that the virtual participant 51 and the virtual instructor 52 will each speak more frequently than if the user 15 has an aggressive characteristic.

[0111] In addition, when the user 15 has a position below managerial level, the characteristics and personalities of the virtual participant 51 and the virtual instructor 52 can be set so that the number of times that the comments of the virtual participant 51 and the virtual instructor 52 include content encouraging the user 15 is relatively higher than when the user 15 has a position of manager.

[0112] Furthermore, the characteristics and personalities of the virtual participants 51 and the virtual instructor 52 can be set so that as the progress of the lecture received by the user 15 becomes relatively high, the number of times that the statements of the virtual participants 51 and the virtual instructor 52 contain content that is different from the intent of the statements of the user 15 becomes relatively high.

[0113] Furthermore, the characteristics of the virtual participants 51 and the virtual instructor 52 can be set so that as the level of growth of the user 15 becomes relatively higher, the number of times the virtual participants 51 and the virtual instructor 52 give hints to the user becomes relatively lower.

[0114] Furthermore, the virtual space B1 may be a consultation room. The user 15 may operate the terminal device 12 to ask various kinds of consultations (questions) to various virtual participants 51 in the consultation room. The consultations that the user 15 asks the virtual participants 51 include love advice, job change advice, investment advice, etc. For example, when the user 15 asks for love advice, the user 15 may ask the virtual participants 51 about what actions they should take between themselves and a love interest to develop or achieve a relationship, which will ultimately lead to the user 15's personal growth.

[0115] Furthermore, when user 15 seeks career change advice, he or she can consult with virtual participant 51 about what kind of career change activities and new jobs would be most likely to lead to the development of user 15's career skills, based on his or her past work experience and years of experience, age, skills, etc.

[0116] Furthermore, when user 15 seeks investment advice, he or she can consult with virtual participant 51 about what investment policy, investment amount, investment stocks, investment period, etc. to choose based on the user's age, investment experience, annual income, investment funds, etc., which will likely lead to the development of user 15's investment skills.

[0117] Various consultations that the user 15 makes with various virtual participants in the consultation room are sent from the terminal device 12 to the information management device 11 as activity information in step S12.

[0118] In step S23, the information management device 11 acquires various types of consultations acquired from the terminal device 12 as activity information and processes the information to generate evaluation information corresponding to the consultations. If the consultation is about love, the information management device 11 infers what kind of behavior between the user 15 and a love interest will help the user 15 grow as a person, and generates evaluation information.

[0119] If the consultation is about a job change, the information management device 11 generates evaluation information by inferring what kind of job change activities and new jobs will likely lead to the growth of the user's 15's job skills based on the user's 15's past work experience and years of experience, age, skills, etc. If the consultation is about an investment consultation, the information management device 11 generates evaluation information by inferring what kind of investment policy, investment amount, investment brand, investment period, etc. will likely lead to the growth of the user's 15's investment skills based on the user's 15's age, investment experience, annual income, investment funds, etc.

[0120] In step S24, information management device 11 sends the evaluation information generated in response to the consultation to terminal device 12. Terminal device 12 acquires the evaluation information generated in response to the consultation from information management device 11 in step S13.

[0121] (Effects of the embodiment) In this embodiment, information including a virtual space B1 in which the user 15 is active is provided from the information management device 11 to the terminal device 12. Therefore, the user 15 and virtual participants 51 are active in the virtual space B1, and the growth of the user 15 is promoted. In addition, participants and instructors who interact with the user 15 in the real world are not required. Therefore, schedule adjustment is not required, and low costs can be achieved.

[0122] Furthermore, the content of the activities that the virtual participants 51 and the virtual instructor 52 will perform in the virtual space B1 is determined based on one or more of the growth level of the user 15, the characteristics of the user 15, and the progress of the activities. Therefore, the growth of the user 15 in the virtual space B1 is further facilitated.

[0123] Furthermore, the information management device 11 provides evaluation information that evaluates the activity of the user 50 in the virtual space B1 to the terminal device 12. Therefore, the user 15 can easily recognize the degree of growth due to the activity.

[0124] Furthermore, the information management device 11 is configured to provide the terminal device 12 with virtual participants 51 with higher experience points in the field of activity than the user 15. This further facilitates the growth of the user 15 in the virtual space B1.

[0125] Furthermore, the information management device 11 acquires information including real-world activities performed by multiple users 15 in the real world from the terminal device 12, and provides evaluation information generated by evaluating the real-world activities included in the acquired information to the terminal device 12. Therefore, an evaluation of the activities of the users 15 in the real world can be obtained.

[0126] 5 is being executed and a conference is being held in the virtual space, the information management device 11 can also perform the following processing. For example, if the number of times the same term is used within a predetermined time period is equal to or greater than a predetermined number, the activity information processing unit 28 can determine that the same conversation has been repeated, and send the determination result to the terminal device 12 or store it as evaluation information in the auxiliary storage device 18. Also, if the number of times a term matching the purpose of the conference is used within a predetermined time period is less than a predetermined number, the activity information processing unit 28 can send the determination result to the terminal device 12 that the conference is not lively, or store it as evaluation information in the auxiliary storage device 18.

[0127] Furthermore, when the activity information processing unit 28 determines that there are no participants suitable for the purpose of the current conference based on the past conference history and the participant evaluations, it can send the determination result to the terminal device 12 or store it as evaluation information in the auxiliary storage device 18. The activity information processing unit 28 can make the above determination, for example, based on whether the voices of participants who received relatively high past conference evaluations are included among the participants of the current conference.

[0128] Furthermore, if a participant not on the participant list is present in the virtual space, the activity information processing unit 28 can send the determination result to the terminal device 12. The activity information processing unit 28 can make a determination by comparing the name and voice of a past participant with the name and voice of the current participant. This can prevent impersonation.

[0129] (Other explanations) An example of the technical meaning of the matters disclosed in this embodiment is as follows: The information management device 11 is an example of an information management device and a computer. The processor 16 is an example of a processor. The processor 16 may be understood as a controller. The controller is an electronic device having a known configuration. The terminal device 12 is an example of a terminal device. The virtual space B1 and the display areas A1, A2, and A3 are examples of an activity environment. Text data, image information and image data, and sound information and sound data are examples of information including an activity environment. The virtual participant 51 and the virtual instructor 52 are examples of a virtual actor.

[0130] The computers that make up the information management device include a single computer and a distributed computer made up of multiple devices. The distributed computers may all be located within the same country, or may be located separately and distributed in different countries. The distributed computers are connected to each other via a network so that they can communicate with each other.

[0131] Furthermore, the computer that acquires information and data from the terminal device and the computer that processes and generates the information and data to be sent to the terminal device may be located in the same country as the terminal device. Alternatively, the computer that acquires information and data from the terminal device may be located in the same country as the terminal device, and the computer that processes and generates the information and data to be sent to the terminal device may be located in a different country from the country in which the terminal device is located. For example, the computer that processes and generates the information and data to be sent to the terminal device may be external computer 13 shown in FIG. 1. Then, information management device 11 receives the information and data generated by external computer 13, and information management device 11 can provide the received information and data to terminal device 12.

[0132] The computer that constitutes the information management device is composed of one or more computers selected from the group consisting of supercomputers, mainframes, servers, workstations, etc. The information management device can also be defined as an information management computer.

[0133] In this embodiment, the program that operates the information management device 11 may be stored in the auxiliary storage device 18. Alternatively, the program may be downloaded from the information management device 11 to the terminal device 12, installed in the auxiliary storage device 42, and run on the terminal device 12. Furthermore, the virtual space may not be displayed on the display device 47 of the terminal device, but rather the display area may be displayed on the display device 47 of the terminal device.

[0134] This embodiment describes the following characteristic configuration. For example, a non-transitory storage medium storing a non-transitory program that causes a computer communicatively connected to a terminal device used by a user to execute a process, the program causing the computer to execute a process of providing the terminal device with information including an activity environment in which the user is active, and a process of providing the terminal device with a virtual actor that is active in the activity environment and that performs activities that contribute to the user's growth. Note that the program can also be understood as a program product. [Industrial Applicability]

[0135] The present embodiment can be used as an information management device, an information management method, and a program that provide a virtual space on a network where users can operate terminal devices to carry out activities such as meetings. [Explanation of symbols]

[0136] 10...information management system, 11...information management device, 12...terminal device, 15, 50...user, 16...processor, 51...virtual participant, 52...virtual instructor, A1, A2, A3...display area, B1...virtual space

Claims

1. An information management device having a processor that executes processing and that is communicably connected to a terminal device used by a user, The processor: A process of providing information including an activity environment in which a user is active to the terminal device; A process of determining characteristics of a user based on information including at least one of image data, sound data, and text data in the activity environment in which the user is active, which information is acquired from the terminal device; generating a virtual actor who will speak during an activity in the activity environment and who has characteristics that contribute to the user's growth in accordance with the user's characteristics; providing information including the generated virtual actor to the terminal device; This is a configuration that runs The characteristic of the user determined by the processor is the user's personality; An information management device in which the processor's process of generating the virtual actor is a process of generating a virtual actor with characteristics that will result in a greater number of statements when the user's characteristics are cautious than when the user's characteristics are proactive.

2. 2. The information management device according to claim 1, the characteristic of the user determined by the processor is the user's job title; The process by which the processor generates the virtual activist is an information management device that generates a virtual activist with the characteristic that when the user's position is lower than managerial, the number of times that the user's comments include content encouraging the user is higher than when the user's position is managerial.

3. 2. The information management device according to claim 1, The characteristic of the user determined by the processor is the progress of the user in the lecture received from the virtual actor; The process by which the processor generates the virtual actor is an information management device that generates a virtual actor with the characteristic that as the user progresses in the lectures they receive from the virtual actor, the number of times the virtual actor's statements contain content that is different from the intent of the user's statements increases.

4. 2. The information management device according to claim 1, the characteristic of the user determined by the processor is the degree of growth of the user; An information management device in which the processor's process of generating the virtual actor is a process of generating a virtual actor with the characteristic that as the user's level of growth increases, the virtual actor will speak less and give the user hints about activities.

5. An information management method executed by a computer communicably connected to a terminal device used by a user, comprising: The computer A process of providing information including an activity environment in which a user is active to the terminal device; A process of determining characteristics of a user based on information including at least one of image data, sound data, and text data in the activity environment in which the user is active, which information is acquired from the terminal device; generating a virtual actor who will speak during an activity in the activity environment and who has characteristics that contribute to the user's growth in accordance with the user's characteristics; providing information including the generated virtual actor to the terminal device; Run The user characteristic determined by the computer is the user's personality, An information management method in which the process by the computer to generate the virtual actor is a process to generate the virtual actor with characteristics that will make more comments if the user's characteristics are cautious than if the user's characteristics are proactive.

6. A program that causes a computer that is communicably connected to a terminal device used by a user to execute a process, The computer, A process of providing information including an activity environment in which a user is active to the terminal device; A process of determining characteristics of a user based on information including at least one of image data, sound data, and text data in the activity environment in which the user is active, which information is acquired from the terminal device; generating a virtual actor who will speak during an activity in the activity environment and who has characteristics that contribute to the user's growth in accordance with the user's characteristics; providing information including the generated virtual actor to the terminal device; Execute The user characteristic that the computer determines is the user's personality, The process of causing the computer to generate the virtual actor is a program that generates the virtual actor with characteristics that make more statements when the user's characteristics are cautious than when the user's characteristics are proactive.

Images