Clone information providing device, clone information providing method, and program

Abstract

To provide a clone information providing device capable of providing AI clone information, which makes clear the environment in which the subject from whom the AI ​​clone is generated is active, to a user terminal. [Solution] A management computer 11 has a processor 18 that executes processing and provides clone information including an AI clone to a user terminal 12, wherein the processor 18 is configured to execute a first process of generating first clone information including an AI clone of a subject P2 based on subject information of the subject P2 who actually exists in the real world; a second process of acquiring entertainment information including entertainment that is held at a venue that actually exists in the real world and in which the subject P2 is active; a third process of generating second clone information that causes the AI ​​clone to act in a virtual space in accordance with the activities of the subject P2 included in the entertainment information; and a fourth process of providing the second clone information to the user terminal 12.

Description

[Technical Field]

[0001] The present disclosure relates to a clone information providing device, a clone information providing method, and a program that provide clone information including AI clones to a user terminal. [Background technology]

[0002] An example of a method for generating an AI clone is described in Patent Document 1. The avatar authenticity registration method described in Patent Document 1 includes a verification step in which, when a user registers an AI avatar that looks exactly like the user, the entire identity verification process, which involves verifying the user's identity using original identity verification documents, is performed in the user's presence, and an AI avatar generation step in which, if the user is verified and confirmed to be the user in the verification step, an AI avatar that looks exactly like the user is generated.

[0003] The avatar authenticity registration method described in Patent Document 1 includes a biometric information acquisition step of acquiring biometric information of the user of the AI ​​avatar generated in the AI ​​avatar generation step, and an NFT conversion step of linking the biometric information acquired in the biometric information acquisition step, the AI ​​avatar information, and the information of the identity verification result in the matching confirmation step to convert the whole into an NFT. Furthermore, Patent Document 1 describes that when the user generates an AI avatar that looks exactly like them, the user's appearance and / or voiceprint are acquired.

[0004] In addition, technology for generating AI avatars based on real people is also described in Patent Documents 2 and 3. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2023-182552 [Patent Document 2] Patent No. 7587330 [Patent Document 3] Patent No. 7202045 Summary of the Invention [Problem to be solved by the invention]

[0006] The inventors of the present application recognized that the technologies described in Patent Documents 1-3 do not make clear the environment in which the subject from whom the AI ​​clone is generated is active, and that there is room for improvement in this regard.

[0007] The object of the present disclosure is to provide a clone information providing device, a clone information providing method, and a program that can provide AI clone information to a user terminal, which makes clear the environment in which the subject from which the AI ​​clone was generated is active. [Means for solving the problem]

[0008] This embodiment discloses a clone information providing device that has a processor that executes processing and provides clone information including AI clones to a user terminal used by a user, wherein the processor executes the following processes: a first process of generating first clone information including an AI clone of a subject based on subject information of the subject who actually exists in the real world; a second process of acquiring entertainment information including entertainment that is held at a venue that actually exists in the real world and in which the subject is active; a third process of generating second clone information that causes the AI ​​clone to act in a virtual space in accordance with the subject's activities included in the entertainment information; and a fourth process of providing the second clone information to the user terminal. [Effects of the Invention]

[0009] According to this embodiment, it is possible to provide AI clone information to a user terminal that clearly indicates the environment in which the subject from whom the AI ​​clone was generated is active. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a clone information providing system including a management computer that is a specific example of a clone information providing device. [Figure 2] FIG. 2 is a conceptual diagram illustrating an example of the configuration of a management computer. [Figure 3] 1 is a flowchart illustrating an example of a clone information providing method executed in an AI clone providing system. [Figure 4] FIG. 10 is a conceptual diagram showing an example in which a subject holds entertainment on stage. [Figure 5] FIG. 10 is a conceptual diagram showing an example of a usage screen displayed on a display of a user terminal. DETAILED DESCRIPTION OF THE INVENTION

[0011] (Overview of the AI ​​clone provision system) In this embodiment, several specific examples of a clone information providing system, a clone information providing device, a clone information providing method, and a program are disclosed with reference to the drawings. FIG. 1 shows an example of a clone information providing system 10. The clone information providing system 10 may be realized by a management computer 11, a user terminal 12, a first external computer 13, and a second external computer 14. The management computer 11 may be communicably connected to the user terminal 12, the first external computer 13, and the second external computer 14 via a network 16. The clone information providing system 10, the management computer 11, the user terminal 12, the first external computer 13, and the second external computer 14 all exist in the real world.

[0012] The management computer 11 may obtain information about the subject for generating an AI clone from the first external computer 13. The management computer 11 may process the subject information to generate an AI clone. The management computer 11 may provide AI clone information including AI clones 80 and 80A shown in FIG. 5 to the user terminal 12. The AI ​​clones 80 and 80A are capable of operating in a virtual space. The management computer 11 may obtain entertainment information including entertainment from the second external computer 14. The entertainment information will be described later.

[0013] The network 16 is a communication line for transmitting information and data, and is composed of base stations, communication satellites, communication antennas, communication equipment (access points), repeaters, communication circuits, communication cables (copper wires, optical fibers), etc. Repeaters include modems (devices that convert analog signals into digital signals), hubs (line concentrators), routers (devices that connect terminals to the Internet), etc. The communication line includes one or more communication means of wireless communication or wired communication. Wireless communication includes short-range wireless communication. Short-range wireless communication includes, for example, wireless LAN (Local Area Network) and Bluetooth (registered trademark). Wireless communication includes electrical signals, optical signals, radio waves, infrared rays, satellite communication, etc. Signals used for communication include digital signals and analog signals.

[0014] (Management Computer Configuration) The management computer 11 is managed and operated by an administrator P1 who builds the clone information providing system 10. The management computer 11 is a computer implemented by various hardware and software. The software includes an operating system and applications. The management computer 11 may have hardware such as a main body (casing), a ROM (Read Only Memory) 17, a processor 18, a main memory device 19, an auxiliary memory device 20, an input device 21, an output device 22, and a communication device 23.

[0015] The ROM 17 is a non-volatile storage device provided inside the main body. The ROM 17 is a memory for reading data only, and data is written to the ROM 17 at the time of manufacturing and is not changed afterwards. The ROM 17 stores programs such as an IPL (Initial Program Loader) that are executed first when the management computer 11 is started up.

[0016] The processor 18 may be provided inside the main body of the management computer 11 and may be configured as a central processing unit (CPU (Central Processing Unit)) that integrates an arithmetic unit (arithmetic circuit) and a control unit (control circuit). The processor 18 is communicably connected to the ROM 17, the main memory device 19, the auxiliary memory device 20, the input device 21, the output device 22, and the communication device 23 via a communication bus 24. The processor 18 comprehensively controls other devices and circuits provided inside the main body and devices and circuits provided outside the main body.

[0017] Furthermore, in addition to a central processing unit, the processor 18 may also include processing circuits such as a digital signal processor, an application specific integrated circuit (ASIC), a graphics processing unit (GPU), and a micro processing unit (MPU). The GPU processes image information and sound information.

[0018] The processor 18 executes various processes by running programs. The processes executed by the processor 18 include calculation, judgment, learning, comparison, identification, classification, control, generation, etc. The information processed by the processor 18 includes data, files, instructions, etc.

[0019] The main memory device 19 is a volatile memory device, and is realized by, for example, RAM (Random Access Memory). When the processor 18 runs a program read from the auxiliary memory device 20 and executes various processes, the main memory device 19 functions as a work area and a buffer area for storing the program and information to be processed. The main memory device 19 is a non-transitory storage medium.

[0020] The auxiliary storage device 20 is a non-transitory storage medium. The auxiliary storage device 20 may also be understood as storage. The auxiliary storage device 20 may be provided inside the main body, or may be provided outside the main body and connected to the communication bus 24 via wireless or wired communication. The auxiliary storage device 20 has a larger capacity than the main storage device 19. The auxiliary storage device 20 operates in response to input and output commands from the processor 18.

[0021] The auxiliary storage device 20 is configured using one or more of the following methods: magnetic storage, optical storage, magneto-optical storage, semiconductor storage, etc. The magnetic storage method is realized by a hard disk, floppy disk, magnetic tape, etc. The optical storage method is configured to irradiate the surface of the storage medium 29A with laser light to record data using light or heat, and read the reflected laser light with an optical head.

[0022] The optical storage method is realized by an optical drive and storage medium 20A. Optical drives include a Combo drive, a Super Combo drive, a Multi drive, a Super Multi drive, a Hyper drive, etc. Storage medium 19A includes a Compact Disc, a Digital Video Disc, a Blu-ray Disc, etc. The magneto-optical method is realized by, for example, a magneto-optical disc.

[0023] The magnetic storage method and the optical storage method have a head and a storage medium 20A. The storage medium 20A may be configured to be attachable to and detachable from the main body. The semiconductor storage method may be defined as a flash memory. Examples of flash memory include an SD memory card, a USB flash drive, and a solid state drive. The flash memory can also be understood as a storage medium 20A configured to be attachable to and detachable from the main body. The auxiliary storage device 20 stores non-transitory programs, various information, and data.

[0024] The input device 21 is operated when inputting information and data into the management computer 11, when executing various processes on the management computer 11, when sending various information and data from the management computer 11 to the network 16, when acquiring various information and data via the network 16, when outputting information from the output device 22, etc.

[0025] The input device 21 is a device operated by the administrator P1, and may be configured with devices such as a keyboard, a mouse, a microphone, a camera, etc. The output device 22 includes devices such as a display and an audio information output device. The display is realized by, for example, a liquid crystal display or an organic electroluminescence display. The audio information output device is a device that outputs audio information, and may be realized by a speaker, headphones, earphones, etc.

[0026] The communication device 23 includes devices, equipment, and standards that connect the management computer 11 to the network 16 via at least one of a wireless communication system and a wired communication system. The hardware that constitutes the communication device 23 may be configured, for example, by a LAN card, a network adapter, a network interface card, a communication cable, a communication antenna, a communication port, a modem, a hub (line concentrator), a router, etc.

[0027] 2 by running non-transitory programs and cooperating with various pieces of hardware that make up the management computer 11. The processor 18 realizes, for example, a website management unit 25, a target person information processing unit 26, a user information processing unit 27, an AI clone information processing unit 28, an entertainment information processing unit 29, a miscellaneous information processing unit 30, an artificial intelligence unit 31, and the like.

[0028] When a web application is run by the processor 18, the website management unit 25 provides a website at a predetermined URL (Uniform Resource Locator) on the network 16. The user terminal 12 and the second external computer 14 may access the management computer 11 via the website. The website management unit 25 may transmit web pages written in HTML (Hyper Text Markup Language) format to the user terminal 12 and the second external computer 14. The website management unit 25 may provide a login screen, a usage screen, various information and data, and image files to the user terminal 12 and the second external computer 14.

[0029] Furthermore, the website management unit 25 may acquire information and data transmitted from the user terminal 12, the first external computer 13, and the second external computer 14. The website management unit 25 may manage the browsing history of websites by the user terminal 12 and the second external computer 14, the usage history of login screens and usage screens, etc.

[0030] The subject information processing unit 26 may process the subject information acquired from the first external computer 13 and store the processed subject information in the auxiliary storage device 20. The subject information is personal information of the subject P2 from whom the AI ​​clone 80 is generated. The subject P2 is a person who exists in the real world. The subject information may include various information and data related to the subject P2, such as the subject P2's unique identification number, nationality, place of origin, date of birth, gender, height, weight, clothing, knowledge, personality, preferences, hobbies, voice, speech, behavior, attitude, appearance, etc. The various information and data may be composed of text data, image information, and sound information.

[0031] Nationality, birthplace, date of birth, gender, height, weight, knowledge, personality, preferences, hobbies, voice, language usage, and the like that cannot be expressed by image information may be obtained from the subject P2's own voice information, or questions may be asked of the subject P2 in text data and responses may be obtained from the subject P2 in text data. Image information may include video, moving images, still images, photographs, and illustrations. Sound information may include human-generated voices and sounds produced by musical instruments.

[0032] The user information processing unit 27 processes the user information acquired from the user terminal 12 to perform user registration, and may store the user information and the registration date in the auxiliary storage device 20. The user information includes the name, nationality, address, date of birth, gender, telephone number, email address, name of financial institution and account number, user account, types of entertainment in which the user is interested, real-life entertainers in which the user is interested, the user's hobbies and preferences, etc. Types of entertainment include performances, live shows, concerts, musical performances, dramas, songs, entertainment, movies, sports, events, etc. The user account includes a user identification number and password unique to user P3.

[0033] The AI ​​clone information processing unit 28 may generate AI clone information in cooperation with the artificial intelligence unit 31 and the auxiliary storage device 20, and store the processed AI clone information in the auxiliary storage device 20. The AI ​​clone information may include subject information about the subject P2 from whom the AI ​​clone 80 was generated, an identification number unique to the generated AI clone, image information about the generated AI clone 80 itself, sound information emitted by the generated AI clone 80, text data of the voice emitted by the AI ​​clone 80 generated based on the subject P2, text data other than the voice emitted by the generated AI clone 80, and image information of the virtual space 82 in which the AI ​​clone 80 acts, as shown in FIG. 5. The image information of the virtual space 82 may include the background design, background pattern, background color, etc.

[0034] In this embodiment, the real-life subject P2 from which the AI ​​clone 80 is generated may include entertainers, such as idols, cosplayers, singers, musicians, comedians, actors, dancers, kabuki actors, and athletes. Entertainers provide entertainment to audiences by showcasing and performing various forms of entertainment, such as singing, music, live performances, concerts, special skills, acting, tricks, performances, magic, events, techniques, and competitions. The subject P2 may be a single person or multiple people. When there are multiple subjects P2, the subjects P2 may form a group that works together.

[0035] The entertainment information processing unit 29 may process the entertainment information acquired from the second external computer 14 and store the processing results in the auxiliary storage device 20. The entertainment information is information acquired by the second external computer 14 when entertainment is being held at a predetermined location in which the subject P2 will participate. The entertainment information may include the type of entertainment, the entertainment venue B1 as shown in FIG. 4, the date and time of the event, the identification number of the subject P2 who is the entertainer, and image information, sound information, and text data of the entertainment acquired at the venue B1.

[0036] The entertainment venue B1 may be either indoors or outdoors, and may be a stage, a dome, a music studio, an auditorium, a multipurpose hall, a gymnasium, a stadium, a field, or the like.

[0037] The various information processing unit 30 may process various information and data acquired by the management computer 11 and store the processed information and data in the auxiliary storage device 20. The various information processing unit 30 may execute a process of translating a language included in the various information and data into another language by working in cooperation with the artificial intelligence unit 31 and the auxiliary storage device 20. The translation performed by the various information processing unit 30 may be either text data or audio data. Languages ​​are used by humans in the real world and vary depending on nationality, region, etc. The different languages ​​may include, for example, Japanese, Chinese, English, Korean, French, German, Italian, Arabic, Spanish, Portuguese, Swahili, Russian, Vietnamese, Hindi, etc.

[0038] The various information processing units 30 may receive a request to purchase AI clone information from the user terminal 12 and process the payment of the purchase price for the AI ​​clone information. The various information processing units 30 may receive a request to purchase AI clone information and process the AI ​​clone information, after payment of the purchase price, to provide it to the user terminal 12. The AI ​​clone information provided to the user terminal 12 may be in a data format that can be processed and customized as desired by the user terminal 12. The various information processing units 30 may send the AI ​​clone information to the third external computer 110 and request that the AI ​​clone information be registered as a non-fungible token (NFT). The third external computer 110 exists in the real world.

[0039] The various information processing unit 30 may execute a process of requesting a vendor to manufacture and sell related products such as cosplay costumes, apparel, and miscellaneous goods related to the subject P2 or the AI ​​clone 80. The user P3 may use the related products in the real world. The various information processing unit 30 may also realize a function of acquiring from the user terminal 12 a purchase application for related products that can be used in the real world, such as cosplay costumes, apparel, and miscellaneous goods related to the subject P2 or the AI ​​clone 80.

[0040] When the program is executed, the artificial intelligence unit 31 cooperates with the auxiliary storage device 20 to execute various processes. The processes executed by the artificial intelligence unit 31 include a learning process (learning stage) and an inference process (inference stage). In the learning process, for example, in machine learning processing, the artificial intelligence unit 31 processes input learning target data using a learning model, thereby outputting a processing result (output data). The artificial intelligence unit 31 also calculates the error between the processing result and correct data using a loss function, and trains the learning model based on the error. Specifically, the artificial intelligence unit 31 adjusts weights, biases, etc. to reduce the error. In the inference process, the artificial intelligence unit 31 processes the inference target data using the learning model, thereby outputting an inference result. The inference target data may include information and data input to the management computer 11 and a prompt generated by the management computer 11.

[0041] The processing of input data performed by machine learning includes extracting features from the input data. The features of the input data include classification and regression. Classification involves classifying and identifying features. Regression involves grasping the trends of classified features. The learning model is stored in the auxiliary storage device 20, and as machine learning is repeated, the learning model is trained as needed.

[0042] The machine learning performed by the artificial intelligence unit 31 may include three types: supervised learning, unsupervised learning, and reinforcement learning. In supervised learning, the learning model is trained by comparing output data obtained by processing learning data (training data) with correct labels prepared in advance.

[0043] When learning data is input, the learning model processes the learning data using the large amount of data stored in the auxiliary storage device 20 and outputs an inference result. Then, the artificial intelligence unit 31 compares the inference result with the correct label and trains the learning model based on the error.

[0044] Unsupervised learning is a method of learning using learning data that does not contain correct answers, and classifies the learning data into groups of data with similar characteristics (regularity, etc.). In unsupervised learning, for example, the type, tendency, characteristics, etc. of the learning data are classified and stored in the auxiliary storage device 20.

[0045] Reinforcement learning generates "actions to achieve this goal" by repeatedly processing input data with a learning model to obtain output data. Specifically, it may generate optimal actions to achieve the goal.

[0046] Furthermore, when the processor 18 runs the program, the artificial intelligence unit 31, in the inference stage, uses various information acquired by the management computer 11 and various information stored in the auxiliary storage device 20 to have the learning model perform inference processing and output the inference results.

[0047] The artificial intelligence unit 31 can use a convolutional neural network as a learning model to achieve machine learning. A neural network has an input layer, an intermediate layer (hidden layer), and an output layer. The intermediate layer is configured to convert input information into a form that is useful for the output layer. The artificial intelligence unit 31 can also perform deep learning to realize the intermediate layer of the neural network. In deep learning, the intermediate layer is multi-layered with multiple types of stages (nodes), and weights and biases are assigned to functions (features) contained in the information. Deep learning automatically indicates the functions (features) to be focused on by the intermediate layer, thereby reducing noise in the information and data input to the learning model.

[0048] Furthermore, the artificial intelligence unit 31 may process sound information, voice data, and text data contained in input information, and process prompts, using the functions of a large-scale language model. Large-scale language models (LLMs) are a type of generative artificial intelligence specialized for natural language processing (NLP). Large-scale language models are language models that are constructed by deep learning of massive amounts of text data and realize advanced natural language generation (LNG).

[0049] Natural language processing processes natural language by combining processes such as morphological analysis, syntactic analysis, semantic analysis, context analysis, and intent analysis, enabling machine translation, text summarization, speech recognition, and the like. Machine translation allows for mutual translation of text data between different languages. Furthermore, the artificial intelligence unit 31 can convert audio data and text data mutually using the functionality of a large-scale language model. Specifically, it can convert language contained in audio data into text data, and convert language contained in text data into audio data such as conversations and songs.

[0050] The artificial intelligence unit 31 may function as a generative artificial intelligence unit by running a program that generates AI clone information. The artificial intelligence unit 31 may, for example, automatically create prompts for generating AI clone information and input them to a learning model. The learning model generates AI clone information, such as text generation, image generation, video generation, and audio generation, based on the prompts.

[0051] Text generation is a function that, when a prompt (in text format) is input, analyzes the content and intent of the prompt and uses information and data stored in the auxiliary storage device 20 to automatically generate a response to the prompt in text format. Because a large-scale language model is used, natural and highly accurate responses can be obtained. In this embodiment, when a prompt for generating AI clone information is input, text data of the voice and conversation generated by the AI ​​clone 80 is generated based on the target person information and entertainment information.

[0052] Image generation is a function that automatically generates an original image that is close to the image of the input prompt using information and data stored in the auxiliary storage device 20. For example, image generation AIs such as Stable Diffusion, Mid Journey, and Dali-2 are known. In this embodiment, when a prompt to generate AI clone information is input, an image including an AI clone 80 is generated based on target information and entertainment information.

[0053] Video generation is a function that automatically generates an original video that closely matches the image of an input prompt, using information and data stored in the auxiliary storage device 20. For example, a video generation AI called Gentoo is known. In this embodiment, when a prompt for generating AI clone information is input, a video including an AI clone 80 is generated based on the target person information and entertainment information.

[0054] Speech generation is a function that automatically generates original voice data (answers, music, etc.) in response to an input prompt using information and data stored in the auxiliary storage device 20. Furthermore, by learning the voice data of the subject P2, it is possible to read various sentences in a voice that is identical to the subject's voice quality, even if the subject is not present. For example, a voice generation AI called "Barui" is known. In this embodiment, when a prompt to generate an AI clone 80 is input, voice data for the AI ​​clone 80 is generated based on subject information and entertainment information.

[0055] The technology for generating AI clone information, including AI clones 80 of real people, by obtaining subject information of real people in the real world and processing various information using a computer with artificial intelligence is a well-known technology as described in Patent Publication No. 2002-269589, Patent Publication No. 2023-182552, Patent Publication No. 6382359, Patent Publication No. 7587330, etc., and therefore detailed explanation will be omitted.

[0056] The auxiliary storage device 20 stores information and data acquired from the user terminal 12, the first external computer 13, and the second external computer 14, programs for causing the processor 18 to perform various processes, information and data used to execute the processes by the processor 18, information and data resulting from the execution of the processes by the processor 18, data constituting web pages on a website, etc. As shown in FIG. 2 , the auxiliary storage device 20 realizes a website information storage unit 32, a subject information storage unit 33, a user information storage unit 34, an AI clone information storage unit 35, an entertainment information storage unit 36, a various information storage unit 37, a program storage unit 38, and a model storage unit 39.

[0057] The website information storage unit 32 stores HTML files that make up website pages, login screens and usage screens to be provided to the user terminal 12, and information and data to be provided to the user terminal 12. The user information storage unit 34 stores user information processed by the user information processing unit 27.

[0058] The AI ​​clone information storage unit 35 stores information and data for generating AI clone information, and the generated AI clone information. The entertainment information storage unit 36 ​​stores information and data to be processed by the entertainment information processing unit 29, and information and data processed by the entertainment information processing unit 29.

[0059] The various information storage unit 37 may store various information and data, such as information and data used to generate the AI ​​clone 80 and language-translated information and data. The program storage unit 38 stores applications run by the processor 18 and various programs run by the processor 18, such as a program for generating AI clone information, a program for translating between different languages, a program for converting language contained in audio data into text data, and a program for converting text data into audio data. The applications stored in the program storage unit 38 include non-transitory programs, manuals, setting files, files for storing data, data, various libraries, and the like. The model storage unit 39 stores various models and the like used by the artificial intelligence unit 31.

[0060] (Blockchain explanation) As shown in FIG. 1, a blockchain 100 may be connected to the network 16. The blockchain 100 is maintained by a plurality of distributed computers connected to the network 16. The blockchain 100 is a public blockchain that allows an unspecified number of participants to participate using computers connected to the network 16. The blockchain 100 may record data included in the AI ​​clone information obtained from the third external computer 110 as a transaction history of a non-fungible token (NFT).

[0061] The blockchain 100 is a distributed database organized into multiple blocks 101, 102, and 103, each connected like a single chain. The third external computer 110 is communicatively connected to the network 16. The third external computer 110 may receive a request from the management computer 11 to register data included in the AI ​​clone information as a transaction history of a non-fungible token. The blockchain 100 registers (authenticates) the non-fungible token issued by the third external computer 110 and retains (stores) the non-fungible token in a rewritable state. The blockchain 100 contains smart contracts as autonomously operating programs.

[0062] Furthermore, computers connected to the network 16 act as an issuing unit, a rewriting unit, and a non-fungible token granting unit. The issuing unit has the function of issuing non-fungible tokens requested for issuance by the issuing computer on the blockchain 100.

[0063] The technology for registering digital content used in virtual space 82 as non-fungible tokens is publicly known, as described in Japanese Patent No. 7180933, Japanese Patent No. 7129579, Japanese Patent No. 7202045, Japanese Patent Application Laid-Open No. 2023-182552, etc., and therefore detailed description thereof will be omitted. Digital content includes AI clones, avatars, characters, etc.

[0064] (Example of user terminal configuration) The user terminal 12 is a computer used and operated by the user P3. The user terminal 12 may acquire AI clone information from the management computer 11. The user P3 is a viewer who uses the user terminal 12 to view the image information and sound information included in the AI ​​clone information. A plurality of user terminals 12 may be provided corresponding to different users P3. The user terminal 12 may be used at a location different from the entertainment venue, or may be used at the entertainment venue.

[0065] The user terminal 12 includes, for example, a portable computer and a fixed computer. Portable computers include smartphones, tablet computers, and goggle-type computers. Goggle-type computers can be worn on and removed from the face or head of the user P3. Fixed computers include desktop computers, notebook computers, and the like. The user terminal 12 may include a main body (casing), a ROM 40, a processor 41, a main memory device 42, an auxiliary memory device 43, an input device 44, an output device 45, and a communication device 46.

[0066] The ROM 40 is a non-volatile storage device provided inside the main body. The processor 41 is provided inside the main body and may be configured as a central processing unit (CPU (Central Processing Unit)) that integrates an arithmetic unit (arithmetic circuit) and a control unit (control circuit). The processor 41 is communicably connected to the ROM 40, main storage unit 42, auxiliary storage unit 43, input unit 44, output unit 45, and communication unit 46 via a communication bus.

[0067] The main memory device 42 is a volatile memory device, and functions as a work area and a buffer area for storing programs, data, instructions, etc. retrieved from the auxiliary memory device 43 when the processor 41 executes processing of programs, data, instructions, etc. The main memory device 42 is a non-transitory storage medium.

[0068] The auxiliary storage device 43 is a non-transitory storage medium. Non-transitory applications and programs are stored in the auxiliary storage device 43. The auxiliary storage device 43 may also store information and data to be processed by the processor 41 and information and data processed by the processor 41. The processor 41 performs various processes by reading and executing the non-transitory programs stored in the auxiliary storage device 43.

[0069] The auxiliary storage device 43 is realized by, for example, a head and a non-transitory storage medium. The head writes information and data to the storage medium and reads information and data from the storage medium. The storage medium is realized by a magnetic disk, an optical disk, a flash memory, etc.

[0070] The input device 44 is operated when inputting information and data to the user terminal 12, when causing the user terminal 12 to execute various processes, when sending various information and data from the user terminal 12 to the management computer 11, when the user terminal 12 obtains various information and data from the management computer 11, when outputting information from the output device 45, etc. The input device 44 is a device operated by the user P3, and may be composed of devices such as a keyboard, a mouse, a microphone, a camera, etc.

[0071] The output device 45 includes devices such as a display 45A and a sound information output device as shown in FIG. 5. The display 45A displays a web page, a login screen and a usage screen obtained from the management computer 11, image information included in the AI ​​clone information, etc. The sound information output device is a device that outputs sound information. The sound information output device is realized by a speaker, headphones, earphones, etc. The sound information output device is connected to the communication bus by wireless communication or wired communication. The sound information output device may output sound information obtained from the management computer 11 and sound information stored in the auxiliary storage device 43.

[0072] The communication device 46 includes devices, equipment, and standards that connect the user terminal 12 to the management computer 11 via at least one of a wireless communication system and a wired communication system. The devices and equipment that connect the user terminal 12 to the management computer 11 may include cables, antennas, routers, communication circuits, communication ports, communication connectors, communication hubs, etc. The communication device 46 transmits and receives various types of information and data.

[0073] (Example of configuration of the first external computer) The first external computer 13 is a computer to which subject information of the subject P2, who is the source of the AI ​​clone 80, is input. The subject information input to the first external computer 13 is sent to the management computer 11. The first external computer 13 may be operated by the subject P2 or an operator other than the subject P2. A plurality of first external computers 13 may be provided corresponding to different subjects P2.

[0074] The first external computer 13 includes, for example, a portable computer or a fixed computer. Portable computers include smartphones and tablet computers. Fixed computers include desktop computers, notebook computers, etc. The first external computer 13 may include a main body (casing), a processor 50, a storage device 51, an input device 52, and a communication device 53.

[0075] The processor 50 may be provided inside the main body and may be configured as a central processing unit (CPU) that integrates an arithmetic unit (arithmetic circuit) and a control unit (control circuit). The processor 50 is communicably connected to a storage device 51, an input device 52, and a communication device 53 via a communication bus.

[0076] The processor 50 executes non-transitory programs to process information and data. The storage device 51 is a non-transitory storage medium. Non-transitory applications and programs are stored in the storage device 51. The storage device 51 also stores various types of information and data input by the input device 52.

[0077] The input device 52 may be composed of devices such as a keyboard, a mouse, a microphone, a display, a camera, etc. The subject P2 or another operator may input subject information about the subject P2 using the input device 52. For example, text data of the subject information may be input using a keyboard or a mouse. Also, sound information of the subject P2, such as voice, conversation, etc., may be input using a microphone. Furthermore, image information of the subject P2, such as a video of the face, a video of the entire body, a video of clothing, a video of movements, etc., may be input using a camera.

[0078] The communication device 53 includes devices, equipment, and standards that connect the first external computer 13 to the management computer 11 via at least one of a wireless communication system and a wired communication system. The devices and equipment that connect the first external computer 13 to the management computer 11 may include cables, antennas, routers, communication circuits, communication ports, communication connectors, communication hubs, etc. The communication device 53 transmits and receives various types of information and data.

[0079] (Example of configuration of second external computer) The second external computer 14 is used, for example, at the entertainment venue. The second external computer 14 is a computer used and operated by an operator P4. The operator P4 may include an entertainment manager, operator, staff member, or event manager.

[0080] Viewers at the venue can directly view the entertainment being held at the venue. Meanwhile, second external computer 14 may provide entertainment information to viewers at the venue who are in positions that make it difficult for them to see the entertainment, or to viewers at the venue who are in positions that make it difficult for them to hear audio information about the entertainment. Second external computer 14 may also provide entertainment information to user terminal 12 via management computer 11.

[0081] The second external computer 14 may be, for example, a portable computer or a fixed computer. Portable computers include smartphones and tablet computers. Fixed computers include desktop computers, notebook computers, etc. The second external computer 14 may include a main body (casing), a processor 60, a storage device 61, an input device 62, an output device 63, and a communication device 64.

[0082] The processor 60 may be provided inside the main body and may be configured as a central processing unit (CPU) that integrates an arithmetic unit (arithmetic circuit) and a control unit (control circuit). The processor 60 is communicably connected to a storage device 61, an input device 62, an output device 63, and a communication device 64 via a communication bus.

[0083] The processor 60 processes information and data by running non-transitory programs. The storage device 61 is a non-transitory storage medium. Non-transitory applications and programs are stored in the storage device 61. The storage device 61 may also store information and data to be processed by the processor 60 and information and data processed by the processor 60. The processor 60 performs various processes by reading and executing the non-transitory programs stored in the storage device 61.

[0084] The storage device 61 is realized by, for example, a head and a non-transitory storage medium. The head writes information and data to the storage medium and reads information and data from the storage medium. The storage medium is realized by a magnetic disk, an optical disk, a flash memory, etc.

[0085] The input device 62 is operated when inputting information and data to the second external computer 14, when causing the second external computer 14 to execute various processes, when sending various information and data from the second external computer 14 to the management computer 11, when the second external computer 14 obtains various information and data from the management computer 11, when outputting information from the output device 63, etc.

[0086] The input device 62 is a device operated by the operator P4, and may be configured with devices such as a keyboard, a mouse, a microphone, a display, a camera, etc. The input device 62 may be used to input the date and time of the entertainment, the venue where the entertainment is held, the type of entertainment, image information and video information about the venue, and target information about the target P2 who is the entertainer.

[0087] The output device 63 includes devices such as a display and a sound information output device. The display may display image information of the entertainment venue, etc. The sound information output device is a device that outputs sound information. The sound information output device may be realized by a speaker, headphones, earphones, etc. The sound information output device is connected to the communication bus by wireless communication or wired communication. The sound information output device may output sound information, etc., acquired at the entertainment venue.

[0088] The communication device 64 includes devices, equipment, and standards that connect the second external computer 14 to the management computer 11 via at least one of a wireless communication system and a wired communication system. The devices and equipment that connect the second external computer 14 to the management computer 11 may include cables, antennas, routers, communication circuits, communication ports, communication connectors, communication hubs, etc. The communication device 64 transmits and receives various types of information and data.

[0089] (Example of processing by the clone information system) 3 shows an example of processing of the clone information providing system 10. The example of processing of the AI ​​clone information providing system 10 may include processing of the management computer 11, processing of the user terminal 12, processing of the first external computer 13, processing of the second external computer 14, and processing of the third external computer 15.

[0090] (1) Processing of the management computer In step S10, the management computer 11 acquires subject information. The subject information may be input to the management computer 11 by operating the input device 21. The subject information may be transmitted to the management computer 11 from the first external computer 13. The management computer 11 stores the acquired subject information in the auxiliary storage device 20. Note that the subject information may be stored in advance in a non-transitory storage medium 20A included in the auxiliary storage device 20.

[0091] In step S11, the management computer 11 automatically generates a prompt for generating AI clone information based on the subject information and the information and data stored in the auxiliary storage device 20. The management computer 11 processes the prompt to generate AI clone information (first clone information) including the AI ​​clone 80. The AI ​​clone 80 may be understood as a digital clone. The AI ​​clone 80 is a replica generated by executing learning and inference processes in the artificial intelligence unit 31 using the subject information and various information and data stored in the auxiliary storage device 20. The AI ​​clone 80 may be either a two-dimensional image or a three-dimensional image. Three-dimensional images include holograms.

[0092] Furthermore, after generating the AI ​​clone information, the management computer 11 may acquire new subject information and input the acquired subject information into the artificial intelligence unit 31 to train the learning model. Furthermore, the management computer 11 may update the generated AI clone information. The generated AI clone 80 can act in the virtual space 82 of the usage screen provided to the user terminal 12. The actions of the AI ​​clone 80 in the virtual space 82 may include the AI ​​clone 80 moving and stopping in the virtual space 82, emitting sound information, conversing using text data, etc.

[0093] In this embodiment, the real-life subject P2 from which the AI ​​clone 80 is generated may include entertainers, such as idols, cosplayers, singers, musicians, comedians, actors, dancers, kabuki actors, and athletes. Entertainers provide entertainment to audiences by showcasing their singing, music, special skills, acting, tricks, performances, magic, and the like. The subject may be a single person or multiple people. If there are multiple subjects, they may be a group working together.

[0094] In step S12, the management computer 11 provides a website at a predetermined URL on the network 16. This website may provide a login screen and a usage screen to the user terminal 12.

[0095] In step S13, the management computer 11 may acquire various pieces of information from the user terminal 12 and the second external computer 14, and process the acquired information. In step S13, the management computer 11 acquires user information from the user terminal 12 that has accessed the website, for example, and performs user registration. The number of user terminals 12 may be either one or more.

[0096] The management computer 11 may also process entertainment information acquired from the second external computer 14. Furthermore, the management computer 11 may store in the auxiliary storage device 20 the results of processing the various types of information in step S13.

[0097] In step S13, the management computer 11 may perform a first process of linking the AI ​​clone information to be provided to the user terminal 12 with entertainment information, or a second process of differentiating the AI ​​clone information from the entertainment information.

[0098] The first processing executed by management computer 11 may include processing for matching the scenery of venue B1 included in the entertainment information with the background of virtual spaces 82, 82A included in the AI ​​clone information, processing for real subject P2 acting at entertainment venue B1 and AI clones 80, 80A included in the AI ​​clone information to wear the same clothes and perform the same actions, processing for real subject P2 acting in the entertainment and AI clones 80, 80A included in the AI ​​clone information to sing the same song in the same language, etc. When management computer 11 executes the first processing, second clone information is generated that causes AI clones 80, 80A to act in virtual spaces 82, 82A in accordance with the activity of subject P2 included in the entertainment information.

[0099] The second processing executed by the management computer 11 may include processing for differentiating the scenery of the entertainment venue B1 from the background of the virtual spaces 82, 82A included in the AI ​​clone information, processing for the real subject P2 acting in the entertainment and the AI ​​clones 80, 80A included in the AI ​​clone information to wear different clothes and perform different actions, processing for the real subject P2 acting in the entertainment and the AI ​​clones 80, 80A included in the AI ​​clone information to sing the same song in different languages, etc.

[0100] The second process executed by management computer 11 may include a process of setting the language, actions, music, songs, conversations, remarks, catchphrases, clothing, etc. of AI clones 80, 80A included in the AI ​​clone information in accordance with user information of user P3, such as nationality, language corresponding to nationality, address, name, date of birth, preferences, hobbies, etc. For example, if the language used by target person P2 at event venue B1 is different from the language user P3 can use (understand), management computer 11 may execute a process of making the language used by AI clones 80, 80A included in the AI ​​clone information the same as the language used by user P3. The AI ​​clone information generated by management computer 11 when it executes the second process is third clone information.

[0101] The AI ​​clone information generated by management computer 11 in step S13 may include image information of AI clone 80 itself, sound information emitted by AI clone 80, text data of the voices emitted by AI clones 80 and 80A, text data other than the voices emitted by AI clones 80 and 80A, and image information of virtual spaces 82 and 82A in which AI clones 80 and 80A act. Image information of virtual spaces 82 and 82A may include background design, background pattern, background color, etc. The AI ​​clone information generated by management computer 11 in step S13 is in a data format that allows the design, size, color, etc. of AI clones 80 and 80A to be freely processed and customized on user terminal 12.

[0102] In step S14 following step S13, the management computer 11 may provide the AI ​​clone information to the user terminal 12. In addition, in step S14, the management computer 11 may provide the AI ​​clone information and entertainment information to the user terminal 12. In step S14, the management computer 11 may issue a request to the third external computer 110 to register the data included in the AI ​​clone information as a non-fungible token.

[0103] In step S14, the management computer 11 may provide the user terminal 12 with a usage screen that sells related products that can be used in the real world, such as cosplay costumes, apparel, and miscellaneous goods related to the subject P2 or the AI ​​clone 80.

[0104] In step S15 following step S14, the management computer 11 may acquire first interaction information from the user terminal 12, including interactions between user P3 and the AI ​​clone 80. The first interaction information will be described later. In step S15, the management computer 11 may acquire second interaction information between the AI ​​clone 80 and a user avatar 81 shown in FIG. 5 from the user terminal 12. The user avatar 81 will be described later. The second interaction information will be described later. In step S15, the management computer 11 may acquire third interaction information from multiple user terminals 12, including interactions between the user avatars 81. The third interaction information will be described later. In step S15, the management computer 11 may process each piece of interaction information and store the processing results of each piece of interaction information in the auxiliary storage device 20. In addition, the management computer 11 may train a learning model stored in the auxiliary storage device 20 based on each piece of interaction information, and update the AI ​​clone information based on each piece of interaction information.

[0105] (2) User terminal processing The user terminal 12 may access a website provided by the management computer 11 in step S20 and send user information to the management computer 11. When the user information is sent from the user terminal 12 to the management computer 11, the user is registered in the management computer 11. The user terminal 12 may also select the subject P2 on a usage screen provided by the management computer 11 and submit a request to the management computer 11 to obtain, for example, purchase, AI clone information of the selected subject P2.

[0106] After user registration is performed in the management computer 11, the user terminal 12 may obtain AI clone information from the management computer 11 in step S21. As shown in FIG. 5, the user terminal 12 can display a virtual space 82 on the usage screen 83 of the display 45A. An AI clone 80 may be displayed in the virtual space 82. Note that FIG. 5 shows an example in which the virtual spaces 82 and 82A are displayed side by side on the usage screen 83. The virtual spaces 82 and 82A may be switched to and displayed on the usage screen 83.

[0107] Also, a virtual space 82A may be displayed on the usage screen 83. A user avatar 81 and an AI clone 80A may act in the virtual space 82A. The user avatar 81 may be either one generated by the user terminal 12 before acquiring AI clone information from the management computer 11, or one generated in the virtual space 82A provided by the management computer 11. The user avatar 81 is a replica that allows the user P3 to act in the virtual space 82A. The user avatar 81 may be a unique character.

[0108] Furthermore, in step S21, in the user terminal 12, sound information may be input to a microphone, thereby allowing interaction between the user P3 and the AI ​​clone 80 through sound information. Information including the interaction between the user P3 and the AI ​​clone 80 is the first interaction information.

[0109] Furthermore, in step S21, in the user terminal 12, the user avatar 81 and the AI ​​clone 80A may act together in the virtual space 82A and may interact by any one or more means of sound information or text data. Information including the interaction between the user avatar 81 and the AI ​​clone 80A is second interaction information. The AI ​​clones 80, 80A may perform the same activity as the subject P2 who is providing entertainment at the event venue B1, or may perform a different activity from the subject P2 who is providing entertainment at the event venue B1.

[0110] As for activities different from those of the target person P2 providing entertainment at venue B1, the AI ​​clones 80 and 80A may be behaving in accordance with user information including the preferences and hobbies of user P3. Behaviors in accordance with user information may include, for example, singing, playing an instrument, talking, posing, dressing, taking photos, etc., in accordance with the preferences and hobbies of user P3. Furthermore, the AI ​​clone 80 displayed on display 45A may speak to user P3 using text data or voice, such as "Mr. / Ms. X, let's sing together," and user P3 may respond to the AI ​​clone 80 using input device 44 using text data or voice, such as "OK, I've been waiting."

[0111] Furthermore, the user P3 may operate the keyboard and mouse of the user terminal 12 to input text data, thereby allowing a conversation to take place between the AI ​​clones 80, 80A and the user P3.

[0112] In step S21, user terminal 12 may display both the AI ​​clone information and the entertainment information being held at venue B1 on display 45A. In this case, user terminal 12 may cause the sound information output device to output either the sound information included in the AI ​​clone information or the sound information included in the entertainment information.

[0113] Furthermore, when multiple user terminals 12 are connected to the management computer 11, in step S21, the user avatars 81 of different users P3 may interact with each other in the virtual space 82 by using one or more of sound information, image information, and text data. The information about the interaction between the user avatars 81 of different users P3 in the virtual space 82 is third interaction information.

[0114] It should be noted that each piece of interaction information, including the various interactions that took place in step S21, is transmitted from the user terminal 12 to the management computer 11. Furthermore, the user terminal 12 may display a usage screen on the display in step S21 and make a purchase application to the management computer 11 for related products that can be used in the real world, such as cosplay costumes, apparel, and miscellaneous goods related to the subject P2 or the AI ​​clone 80.

[0115] (3) Processing of the first external computer The first external computer 13 may acquire subject information of the subject P2, such as sound information, image information, and text data, in step S30, and transmit the subject information to the management computer 11.

[0116] (4) Processing of the second external computer The second external computer 14 may acquire entertainment information, such as sound information and image information, about entertainment to be held at venue B1 as shown in Fig. 4, and in step S40, transmit the entertainment information to the management computer 11. The entertainment information includes image information, sound information, and text data acquired by the second external computer 14 at venue B1. The venue B1 shown in Fig. 4 is, for example, a stage, and a target person P2 is holding an event on the stage.

[0117] (5) Processing of the third external computer The third external computer 110 may receive a request to register the data included in the AI ​​clone information as a non-fungible token in step S50, and may execute the process of registering the data included in the AI ​​clone information as a non-fungible token on the blockchain 100.

[0118] (Effects of this embodiment) In this embodiment, AI clone information including AI clones 80, 80A that can operate in virtual spaces 82, 82A is generated in accordance with entertainment information that includes entertainment that is being held at venue B1 that actually exists in the real world and in which subject P2 is active. The generated AI clone information is then provided to user terminal 12. Therefore, it is possible to provide user terminal 12 with AI clone information that makes clear the environment in which subject P2, the source of the generation of AI clones 80, 80A, is operating.

[0119] Furthermore, when storing the AI ​​clone information generated in step S13 in the auxiliary storage device 20, the management computer 11 may classify the information based on conditions such as the type of entertainment engaged in by the subject P2, the preferences and hobbies of the user P3 included in the user information, etc. Therefore, the process of providing the AI ​​clone information from the management computer 11 to the user terminal 12 can be performed accurately and quickly, improving the accuracy of the providing process.

[0120] In this embodiment, the language used by AI clones 80 and 80A included in the AI ​​clone information can be made different from the language used by subject P2. Therefore, if the language used by subject P2 is different from the language used by user P3, the convenience for user P3 who uses user terminal 12 can be improved by making the language used by AI clones 80 and 80A included in the AI ​​clone information the same as the language used by user P3.

[0121] In this embodiment, virtual spaces 82, 82A in which AI clones 80, 80A can interact with user P3 who uses user terminal 12 are provided to user terminal 12. Therefore, user P3 can interact with AI clones 80, 80A, and the satisfaction of user P3 is improved.

[0122] In this embodiment, the management computer 11 may request the third external computer 110 to register the AI ​​clone information as a non-fungible token. Therefore, the AI ​​clone information can be provided to third parties via the network 16, thereby increasing the value of the AI ​​clone information.

[0123] In this embodiment, the management computer 11 provides the user terminal 12 with a usage screen 83 that sells related products that are related to the subject P2 or the AI ​​clones 80 and 80A and that can be used by the user P3 in the real world. This increases the user P3's sense of affinity with the subject P2.

[0124] In this embodiment, management computer 11 generates AI clone information that enables AI clones 80 and 80A to act in accordance with user information, and provides the generated AI clone information to user terminal 12. Therefore, user P3 feels a greater sense of affinity with AI clones 80 and 80A.

[0125] (Other explanations) An example of the technical meaning of the matters disclosed in this embodiment is as follows: The management computer 11 is an example of a clone information providing device. The processor 18 is an example of a processor. The user P3 is an example of a user. The user terminal 12 is an example of a user terminal. The third external computer 110 is an example of an external computer. The target person P2 is an example of a target person. The event venue B1 is an example of a venue. The AI ​​clones 80 and 80A are examples of AI clones. The usage screen 83 is an example of a usage screen.

[0126] Step S11 shown in FIG. 3 is an example of the first process. Step S13 is an example of the second process and the third process. Reason Step S14 is a fourth process. 5th This is an example of the principle. S15 is the sixth and seventh processes. This is an example of processing. Virtual spaces 82 and 82A are examples of virtual spaces.

[0127] The management computer 11 may be a single computer or a distributed computer made up of multiple devices. The distributed computers are connected to each other via a network so that they can communicate with each other. The management computer 11 may be made up of one or more computers such as a supercomputer, mainframe, server, or workstation.

[0128] In this embodiment, the program that operates the management computer 11 may be stored in the auxiliary storage device 20. Alternatively, the program that operates the management computer 11 may be stored in an external computer and configured to operate on a network.

[0129] This embodiment describes the following characteristic configuration. For example, a non-transitory storage medium is disclosed that stores a non-transitory program that causes a computer communicatively connected to a user terminal used by a user to execute a process of providing clone information, including an AI clone, to the user terminal. The program causes the computer to execute the following processes: a first process of generating first clone information, including an AI clone of a subject, based on subject information of the subject who actually exists in the real world; a second process of acquiring entertainment information, including entertainment that is held at a venue that actually exists in the real world and in which the subject is active; a third process of generating second clone information that causes the AI ​​clone to act in a virtual space in accordance with the subject's activities included in the entertainment information; and a fourth process of providing the second clone information to the user terminal. Note that the program can also be understood as a program product.

[0130] As an example of a modification, the following technology could also be adopted: Real people such as models, idols, and actors produce AI clones that act as their alter egos and sell them to fans (users). A service that allows users to process the AI ​​clones they purchase into an anime-style clone that moves in the same way. Characterized (animated) AI clones can be used in more situations from a design perspective, increasing their versatility. In addition to real people, for example, creating an AI clone of a real pet while it is still alive and raising it after the pet has passed away can enrich pet life.

[0131] Combat AI clones may also be sold. For example, AI clones of real (or former) professional wrestlers or fighters may be sold, and purchasers may customize them as they like and participate in battle games between AI clones in a virtual space. Users can view the AI ​​clones they have purchased not only on tablets or smartphones, but also with special goggles, creating a simulated experience of the AI ​​clone being right in front of their eyes or in the palm of their hand, similar to augmented reality (AR). [Industrial Applicability]

[0132] This embodiment can be used as a clone information providing device, a clone information providing method, and a program. [Explanation of symbols]

[0133] 11...Administrative computer, 12...User terminal, 18...Processor, 80, 80A...AI clone, 82, 82A...Virtual space, 83...User screen, 110...External computer, B1...Event location, P2...Target, P3...User

Claims

1. A clone information providing device having a processor for executing processing and providing clone information including AI clones to a user terminal used by a user, The processor: a first process of using subject information of a subject who actually exists in the real world as inference target data, executing an inference process using a learning model to generate an AI clone of the subject, and generating first clone information including the AI ​​clone; a second process of acquiring entertainment information including entertainment that is held at a venue that exists in the real world and in which the subject is active; A third process of generating second clone information that causes the AI ​​clone to act in a virtual space according to the activity of the subject included in the entertainment information; a fourth process of providing the second clone information to the user terminal; A fifth process of providing the user terminal with a virtual space in which the AI ​​clone and a user using the user terminal can interact; A sixth process of acquiring, from the user terminal, interaction information including interactions between the AI ​​clone and the user; a seventh process of training the learning model based on the interaction information and updating the first clone information based on each interaction information; A clone information providing device configured to execute the above.

2. 2. The clone information providing device according to claim 1, A clone information providing device, wherein the interaction information obtained by the processor from the user terminal by executing the sixth process includes information on interactions between the AI ​​clone and the user via sound information, and information on interactions between the AI ​​clone and a user avatar modeled after the user in the virtual space.

3. 2. The clone information providing device according to claim 1, A clone information providing device, wherein the interaction information obtained by the processor from the user terminal by executing the sixth process includes the AI ​​clone performing the same activity as the subject providing entertainment at the venue, or the AI ​​clone performing an activity different from that of the subject providing entertainment at the venue.

4. 4. The clone information providing device according to claim 3, A clone information providing device, wherein the interaction information obtained by the processor from the user terminal by executing the sixth process includes interactions in which the AI ​​clone speaks to the user using voice or text data, and interactions in which the user responds to the AI ​​clone using voice or text data.

5. A clone information providing method executed by a computer that is communicably connected to a user terminal used by a user and that provides clone information including AI clones to the user terminal, comprising: The computer a first process of using subject information of a subject who actually exists in the real world as inference target data, executing an inference process using a learning model to generate an AI clone of the subject, and generating first clone information including the AI ​​clone; a second process of acquiring entertainment information including entertainment that is held at a venue that exists in the real world and in which the subject is active; A third process of generating second clone information that causes the AI ​​clone to act in a virtual space according to the activity of the subject included in the entertainment information; a fourth process of providing the second clone information to the user terminal; A fifth process of providing the user terminal with a virtual space in which the AI ​​clone and a user using the user terminal can interact; A sixth process of acquiring, from the user terminal, interaction information including interactions between the AI ​​clone and the user; a seventh process of training the learning model based on the interaction information and updating the first clone information based on each interaction information; The clone information providing method is configured to execute the above.

6. A non-transitory program that causes a computer communicably connected to a user terminal used by a user to execute a process of providing clone information including an AI clone to the user terminal, The computer, a first process of using subject information of a subject who actually exists in the real world as inference target data, executing an inference process using a learning model to generate an AI clone of the subject, and generating first clone information including the AI ​​clone; a second process of acquiring entertainment information including entertainment that is held at a venue that exists in the real world and in which the subject is active; A third process of generating second clone information that causes the AI ​​clone to act in a virtual space according to the activity of the subject included in the entertainment information; a fourth process of providing the second clone information to the user terminal; A fifth process of providing the user terminal with a virtual space in which the AI ​​clone and a user using the user terminal can interact; A sixth process of acquiring, from the user terminal, interaction information including interactions between the AI ​​clone and the user; a seventh process of training the learning model based on the interaction information and updating the first clone information based on each interaction information; A program is a configuration that executes a program.

Images