system

Abstract

A system is provided.SOLUTION: An input means for allowing a user to select a game genre, a character type, and a story element, a terminal means for transmitting input data, a server means for acquiring an appropriate template and resource from a database based on the transmitted data, an AI generation means for generating a story, a character, and a map based on the acquired information, a game construction means for constructing game data based on the generated data, a creative mode means for allowing a user to manually correct the constructed game data, and a final data storage means for storing final data; A system comprising: storage and sharing means for generating a sharing URL or code; and other user access means for allowing other users to access a game using the sharing URL or code.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Traditional game creation requires extensive programming knowledge and time, making it difficult for beginners and non-experts to realize their ideas as games. This problem is often exacerbated by the complexity of games and the barrier of technical terminology. Therefore, there is a need for a game creation platform that can be operated intuitively even without specialized knowledge. [Means for solving the problem]

[0005] The present invention provides a platform that enables users to intuitively create games without specialized knowledge, through a system that includes input means for users to select game genres, character types, and story elements, terminal means for transmitting the input data, server means for retrieving appropriate templates and resources from a database based on the transmitted data, AI generation means for generating stories, characters, and maps based on the retrieved information, game construction means for constructing game data based on the generated data, creative mode means for users to manually modify the constructed game data, saving and sharing means for saving the final data and generating a sharing URL or code, and other user access means for other users to access the game using the sharing URL or code.

[0006] "User" means an individual or organization that uses the system to create games.

[0007] An "input method" is an interface or tool that allows a user to select a game genre, character type, or story element.

[0008] "Terminal means" refers to a device or computer system that processes input data and transmits it to a server.

[0009] The "server means" is a computer system that receives data sent from the terminal means and retrieves appropriate templates and resources from a database.

[0010] "AI generation means" refers to artificial intelligence technology that automatically generates stories, characters, and maps based on acquired information.

[0011] "Game construction means" is a system for constructing game data based on the generated data and turning it into an executable file or application.

[0012] "Creative mode means" refers to editing tools and interfaces used by users to manually modify constructed game data.

[0013] The "storage and sharing means" is a system for saving the finalized game data and generating a URL and code for sharing.

[0014] "Means for Other Users to Access" means an interface or tool that allows other users to access and play the Game using a shared URL or code. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11]FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] The present invention provides a system that automatically generates games and allows users to easily create games. This system includes input means for users to create their favorite games, terminal means for transmitting and processing data, server means for acquiring and processing templates and resources, AI generation means that is an automatic generation engine, game construction means for integrating game data, creative mode means for users to make modifications, saving and sharing means for saving and sharing completed games, and other user access means for other users to access the game.

[0037] User Input Phase

[0038] Users first log in using the system's interface and select game creation options, including genre (e.g., fantasy, action, adventure, etc.), character type (e.g., humanoid, robotic, quadrupedal, etc.), and basic story elements.

[0039] Data transmission phase

[0040] The device sends the input data from the user, specifically the selected genre, character type, and story elements, formatted as JSON data, and sent it to the server.

[0041] Data Collection Phase

[0042] The server receives the data and retrieves the appropriate templates and resources from a database, selecting story scripts, character designs, terrain models, and other elements appropriate for the genre.

[0043] AI generation phase

[0044] Based on the acquired templates and resources, the server launches an AI generator. This AI automatically generates a detailed story, character appearances and characteristics, map layout, etc. based on the given elements. For example, if you select a fantasy RPG, it will generate a cave inhabited by an evil dragon, a wizard's tower, etc.

[0045] Game Construction Phase

[0046] The server aggregates the generated elements and constructs the game data, which is then aggregated in JSON or XML format and passed to a game engine (e.g., Unity or Unreal Engine) to create an executable game file.

[0047] Creative Mode Phase

[0048] Users can manually modify the generated game data using the creative mode, changing the character's appearance, adjusting the map layout, modifying dialogue, etc. A real-time preview function is also provided during this process, so modifications can be seen immediately.

[0049] Save Game Phase

[0050] When the user saves the game after completing the modifications, the device sends the final data to the server. The server receives the data and uploads the game data to the sharing server using the saving and sharing method. A sharing URL or code is generated and notified to the user.

[0051] Shared and Other Access Phase

[0052] Other users can access the game using a shared URL or code. The server receives the request and sends the game data back to the other user's device in the appropriate format. The other user can then run and play the game on their device.

[0053] This system allows users to intuitively create games without any programming knowledge and easily share them with other users.

[0054] The processing flow will be explained below.

[0055] Step 1:

[0056] The user logs into the platform using a device.

[0057] Step 2:

[0058] Users select the game creation option and input or select the genre, character type, and story elements.

[0059] For example: "Genre: Fantasy", "Character: Human warrior", "Story: Adventure to save the kingdom"

[0060] Step 3:

[0061] The terminal formats the input data into JSON format or similar and sends it to the server.

[0062] Specifically, you send data to the " / generateGame" endpoint with a "POST" request.

[0063] Step 4:

[0064] The server parses the data it receives and retrieves appropriate templates and resources from a database based on genre, character type, and story elements.

[0065] Example: "SELECT FROM templates WHERE genre='Fantasy'"

[0066] Step 5:

[0067] The server then launches the AI ​​generation process based on the acquired template and user-entered data.

[0068] The story generation AI generates detailed stories based on specified elements.

[0069] Example: "An adventure to defeat an evil dragon"

[0070] Step 6:

[0071] The server uses a character design AI to generate details (appearance, skills, etc.) for the selected character.

[0072] Example: "Human warriors wear armor and carry swords."

[0073] Step 7:

[0074] The server uses map generation AI to create maps based on the story.

[0075] For example: "Kingdom Map, Witch's Forest, Dragon's Lair."

[0076] Step 8:

[0077] The server integrates the generated story, characters, and maps, and constructs game data in JSON and XML formats.

[0078] Step 9:

[0079] The server uses the game engine to generate executable game files based on the constructed data.

[0080] Example: "Create an .exe file using the Unity engine."

[0081] Step 10:

[0082] The server provides the creative mode means and sends the generated game data back to the user's device.

[0083] Step 11:

[0084] Users can manually modify character appearance, map layout, dialogue, and more in creative mode.

[0085] Step 12:

[0086] Once the user has finished making their modifications, they have the option to save the game.

[0087] Step 13:

[0088] The device sends the final data to the server.

[0089] Specifically, it involves sending data to the " / saveGame" endpoint with a "POST" request.

[0090] Step 14:

[0091] The server uploads the saved game data to a sharing server and generates a sharing URL or code and notifies the user.

[0092] Step 15:

[0093] Other users can access the game using a shared URL or code.

[0094] Step 16:

[0095] The server receives the request and sends the game data back to the other user's device in the appropriate format.

[0096] Step 17:

[0097] Other users receive the game data and run the game on their own devices to play.

[0098] Example 1

[0099] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0100] Current game creation systems often require specialized programming knowledge, making it difficult for average users to easily create games. Furthermore, existing systems require detailed settings for story and characters to be created manually, which is time-consuming. Furthermore, sharing and accessing games with other users requires complicated procedures, making it difficult to efficiently create and share games.

[0101] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0102] In this invention, the server includes input means for a user to select a game genre, character type, and story elements, terminal means for transmitting the input data, formatting means for formatting the transmitted data and transmitting it to the server, server means for retrieving appropriate templates and resources from a database based on the transmitted data, AI generation means for generating a story, characters, and maps based on the retrieved information, game construction means for integrating the generated data and constructing an executable game file, creative mode means for a user to manually modify the constructed game data, preview means for providing a real-time preview function, save and share means for saving the final data and generating a sharing URL and code, and other user access means for other users to access the game using the sharing URL and code. This enables users to intuitively create games without any programming knowledge and easily share them with other users.

[0103] "User" refers to a person who uses the system to create and operate a game.

[0104] "Input means" refers to a means that provides an interface for a user to select a game genre, character type, and story elements.

[0105] "Terminal means" refers to a device or system for transmitting data entered by a user.

[0106] "Formatting means" refers to a process or device for converting transmitted data into a format such as JSON or XML and transmitting it to the server.

[0107] "Server means" refers to a computer system responsible for retrieving appropriate templates and resources from a database based on the transmitted data.

[0108] "AI generation means" refers to an artificial intelligence system that automatically generates stories, characters, and maps based on acquired information.

[0109] "Game construction means" refers to a process or system for integrating generated data to construct an executable game file.

[0110] "Creative mode means" refers to means for providing an interface for the user to manually modify generated game data.

[0111] "Preview facility" refers to a feature that provides a real-time display as the user makes modifications.

[0112] "Storage and sharing method" refers to the process or system for storing the final data and generating a URL or code for sharing.

[0113] "Means for accessing other users" refers to the function that allows other users to access the game using a shared URL or code.

[0114] The present invention provides a system that allows a user to easily create a game and share it with other users. The system includes the following means.

[0115] First, the user logs into the system using an interface, which is provided through a terminal such as a web browser. Once logged in, the dashboard is displayed and the user selects the "Create a Game" option.

[0116] If the user selects the game creation option, they are presented with a screen where they can select the genre (e.g., fantasy, action, adventure, etc.), the character type (e.g., humanoid, robotic, quadrupedal, etc.), and basic story elements. The user selects these options and proceeds to the next step.

[0117] Next, the terminal receives the user's input and formats it into JSON format etc. For example, if you select a fantasy RPG, it will generate the following JSON data:

[0118] json

[0119] {

[0120] "genre": "fantasy",

[0121] "characters": ["humanoid", "mechanical"],

[0122] "story": "An adventure exploring the cave where the evil dragon lives"

[0123] }

[0124] The formatted data is sent to the server, which then retrieves the appropriate templates and resources from its database based on the received data. These templates and resources include story scripts, character designs, terrain models, and other elements appropriate for the genre.

[0125] The server then launches an AI generation method based on the acquired templates and resources. For example, GPT-3 (registered trademark) or DALL-E is used as a generative AI model. This automatically generates a detailed story, characters, maps, and other elements based on the elements selected by the user. As a specific example, in the case of a fantasy RPG, the following may be generated: a story about a cave inhabited by an evil dragon, characters about brave warriors and wizards, and maps about a cave and a wizard's tower.

[0126] The generated elements are then integrated by a game builder. The server integrates these elements and builds an executable game file. This game data is saved in JSON or XML format and passed to a game engine such as Unity or Unreal Engine.

[0127] Users can manually modify the generated game data using the Creative Mode interface, which provides tools for changing character appearances, adjusting map layouts, and modifying dialogue, and includes a real-time preview feature that allows users to instantly see their changes.

[0128] Once the game has been modified, the final data is sent to the server via the save and share method. The server receives this final data and uploads it to the sharing server. A sharing URL or code is generated and notified to the user.

[0129] Other users can access the game using this shared URL or code. The server receives the user's request and sends the game data back to the device. The other users can then use the received data to run the game on their own devices and enjoy playing it.

[0130] For example, the user enters the following prompt text:

[0131] "I want to create an action game. The main story will be about police robots who crack down on crime in a futuristic city, and I'd like the characters to be both mechanical and humanoid."

[0132] Based on these prompts, a generative AI model generates futuristic cities, criminals, police robots, etc. Users can adjust these elements to create their own original games, which can then be easily shared with other users.

[0133] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0134] Step 1:

[0135] A user opens the system interface and enters their login information. The server receives the information and authenticates the user. If the user authentication is successful, the server displays the dashboard. The input is the username and password, and the output is the dashboard screen after successful login.

[0136] Step 2:

[0137] The user selects the "Create a Game" option from the dashboard. The server displays the game creation screen and presents a form to input genre, character type, and basic story elements. The inputs are genre, character type, and story elements, and the output is a button to proceed to the next input step.

[0138] Step 3:

[0139] The user selects the genre, character type, and story elements, and clicks the Next button. The device formats this input data into JSON format and sends it to the server. The input is the user's selection, and the output is JSON format data. For example,

[0140] json

[0141] {

[0142] "genre": "fantasy",

[0143] "characters": ["humanoid", "mechanical"],

[0144] "story": "An adventure exploring the cave where the evil dragon lives"

[0145] }

[0146] Step 4:

[0147] The server parses the received JSON data and retrieves the corresponding templates and resources from the database. The server executes queries against the database to retrieve story scripts, character designs, terrain models, etc. appropriate for the genre. The input is JSON data, and the output is a list of retrieved templates and resources.

[0148] Step 5:

[0149] The server launches an AI generator based on the acquired templates and resources. The generative AI model (e.g., GPT-3, DALL-E) generates detailed stories, characters, and maps based on the given information. For example, in a fantasy RPG, a cave inhabited by an evil dragon might be generated as a story element. The input is the template or resource, and the output is detailed game elements.

[0150] Step 6:

[0151] The server aggregates the generated elements and constructs game data. This data is saved in JSON or XML format and passed to a game engine such as Unity or Unreal Engine. The game engine uses this data to create an executable game file. The input is the generated story, characters, and maps, and the output is an executable game file.

[0152] Step 7:

[0153] Users open Creative Mode and manually modify the generated game data. The interface provides tools for adjusting character appearance, stage maps, and dialogue. Furthermore, a real-time preview function allows users to instantly see the results of their changes. The input is the user's modifications, and the output is the modified game data.

[0154] Step 8:

[0155] When the user completes the edits and presses the save button, the device sends the final data to the server. The server receives the final data and uploads it to the storage and sharing server. The server generates a sharing URL and code and notifies the user of this information. The input is the edited game data, and the output is the sharing URL and code.

[0156] Step 9:

[0157] Other users access the game using a sharing URL or code. The server receives the access request and returns the game data in an appropriate format to the other user's device. The other user can then receive the data and run the game on their own device. The input is the sharing URL or code, and the output is the game data.

[0158] For example, the user enters the following prompt text:

[0159] "I want to create an action game. The main story will be about police robots who crack down on crime in a futuristic city, and I'd like the characters to be both mechanical and humanoid."

[0160] The generative AI model generates futuristic cities, police robots, and criminal characters, and users can adjust these elements to create original games that can then be easily shared with other users.

[0161] (Application example 1)

[0162] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0163] Conventional virtual stores have the problem that users need a lot of expertise and time to customize product displays. Furthermore, there are limited means to create interactive experiences that can be easily shared with other users, limiting the user experience. This makes it difficult for users to intuitively and quickly customize and share virtual experiences with others.

[0164] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0165] In this invention, the server includes input means for a user to select a product display type and scenario elements, terminal means for transmitting the input data, server means for retrieving appropriate templates and resources from a database based on the transmitted data, AI generation means for generating an exhibition scenario, virtual characters, and backgrounds based on the retrieved information, experience construction means for constructing a virtual experience based on the generated data, creative mode means for a user to manually modify the constructed experience data, storage and sharing means for saving the final data and generating a sharing URL or code, and other user access means for other users to access the virtual experience using the sharing URL or code. This enables users to intuitively customize a virtual experience without requiring specialized knowledge and quickly share it with other users.

[0166] "Input means" refers to an interface that allows the user to input options.

[0167] "Terminal means" refers to electronic equipment for transmitting input data.

[0168] The "server means" is a device for obtaining appropriate templates and resources from a database based on the transmitted data.

[0169] The "AI generation means" is an artificial intelligence system that automatically generates exhibition scenarios, virtual characters, and backgrounds based on acquired information.

[0170] "Experience construction means" is a function for constructing a virtual experience based on the generated data.

[0171] "Creative mode means" is a feature that allows users to manually modify the constructed experience data.

[0172] "Storage and sharing means" is a function for saving the final data and generating a URL or code for sharing.

[0173] "Access for Other Users" refers to the ability for other users to access a virtual experience using a shared URL or code.

[0174] This invention provides a system that allows users to customize product displays in a virtual store, automatically generate interactive experiences, and easily share them with other users. The system includes input means, terminal means, server means, AI generation means, experience construction means, creative mode means, storage and sharing means, and other user access means.

[0175] First, the user logs into the virtual store using a device such as a smartphone or head-mounted display. The user inputs the desired settings using an input means to select the type of product display and scenario elements. For example, the user selects a specific product (clothing, home appliances, furniture, etc.) and then selects the virtual display scenario for that product (e.g., fashion show, demonstration).

[0176] Next, the terminal means transmits the input data in JSON format to the server means, which receives the data and retrieves appropriate templates and resources (such as 3D product models, scenario scripts, and background models) from a database.

[0177] The server then automatically generates an exhibition scenario, virtual characters, and backgrounds based on the acquired information using AI generation means. For example, if the user selects a fashion show, a scenario is generated in which models wearing the selected clothes perform a virtual fashion show.

[0178] The server then uses an experience builder to build a virtual experience based on the generated data, which is then passed to a game engine such as Unity or Unreal Engine to create a virtual experience file that is used to run the experience.

[0179] Users can manually edit the created experience data in creative mode, for example, adjusting the model's appearance, exhibit content, and background layout. A real-time preview function is also provided during this process, so changes can be seen immediately.

[0180] The final experience data is sent to the server via the storage and sharing means, and a sharing URL or code is generated. Other users can then access the experience using the sharing URL or code. Other users can receive the experience data from the server and run it on their own devices.

[0181] Examples of specific prompts include:

[0182] "A user has selected a new smartphone. Generate a virtual demonstration scenario in which a product reviewer demonstrates the new features. The generated scenario should include a reviewer character, product feature descriptions, or interactive demonstrations."

[0183] The system allows users to intuitively customize virtual experiences without requiring specialized knowledge and quickly share them with others.

[0184] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0185] Step 1:

[0186] Users log in to the virtual store using a device such as a smartphone or head-mounted display.

[0187] Input: User ID, Password

[0188] Output: User information, viewable product list

[0189] Specifically, the user inputs login information using the input means, and the terminal transmits the information to the server.

[0190] Step 2:

[0191] The user selects the type of product display and scenario elements using the input means.

[0192] Input: Product selection, display type, scenario elements

[0193] Output: Selection data (JSON format)

[0194] Specifically, the user inputs the desired products and display settings, which are then compiled as data by the terminal.

[0195] Step 3:

[0196] The terminal transmits the input data to the server.

[0197] Input: Selection data (JSON format)

[0198] Output: Server received data

[0199] Specifically, the terminal formats the selected data in JSON format and sends it to the server.

[0200] Step 4:

[0201] The server retrieves the appropriate template or resource from the database.

[0202] Input: Received data

[0203] Output: Templates, 3D models, scenario scripts

[0204] Specifically, the server analyzes the received data and searches for and acquires the corresponding resource from the database.

[0205] Step 5:

[0206] The server generates an exhibition scenario, virtual characters, and backgrounds based on the acquired data using AI generation means.

[0207] Input: Template, 3D model, scenario script

[0208] Output: Generated data (exhibition scenario, characters, background)

[0209] Specifically, the server launches an AI generation model and automatically generates a virtual exhibit based on the input data.

[0210] Step 6:

[0211] The server uses the experience construction means to construct a virtual experience based on the generated data.

[0212] Input: Generated data

[0213] Output: Executable virtual experience file

[0214] Specifically, the server passes the generated data to a game engine such as Unity or Unreal Engine to build a runnable virtual experience.

[0215] Step 7:

[0216] The user manually modifies the experience data using creative mode means.

[0217] Input: Executable virtual experience file

[0218] Output: Modified virtual experience file

[0219] Specifically, the user makes modifications through the interface, which are previewed in real time.

[0220] Step 8:

[0221] The server stores the final data and generates a URL or code for sharing.

[0222] Input: Modified virtual experience file

[0223] Output: Share URL, code

[0224] The specific operation is that the server saves the final data in a database and generates a URL or code for sharing.

[0225] Step 9:

[0226] Other users access the virtual experience using a shareable URL or code.

[0227] Input: Share URL, code

[0228] Output: Virtual experience data

[0229] Specifically, other users access the server using a shared URL or code and receive the experience data on their devices.

[0230] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0231] The present invention provides a system that enables users to automatically generate games based on their emotions and share them with other users. The system includes an input means for users to create their favorite games, a terminal means for transmitting and processing data, a server means for acquiring and processing templates and resources, an AI generation means, a game construction means for integrating game data, a creative mode means for users to make modifications, a saving and sharing means for saving and sharing the completed game, a other user access means for other users to access the game, and an emotion recognition engine for recognizing user emotions.

[0232] User Input Phase

[0233] Users first log in using the system's interface and select game creation options, including genre (e.g., fantasy, action, adventure, etc.), character type (e.g., humanoid, robotic, quadrupedal, etc.), and basic story elements.

[0234] Emotion Recognition Phase

[0235] The device collects and analyzes emotional data from the user's facial expressions and voice. For example, if the user shows a smile or a surprised expression, the device captures that emotional data.

[0236] Data transmission phase

[0237] The device formats the input data and emotion data into JSON format and sends it to the server. Specifically, it sends the data to the " / generateGame" endpoint using a "POST" request.

[0238] Data Collection Phase

[0239] The server analyzes the received data and retrieves appropriate templates and resources from the database based on genre, character type, story elements, and emotion data. For example, if the user expresses surprise, stories and scenes containing surprise elements will be selected.

[0240] AI generation phase

[0241] The server activates the AI ​​generation method based on the acquired template, user-input data, and emotional data. This generation AI automatically generates a detailed story, character appearances and characteristics, map layout, etc., taking into account the emotional data. For example, a dynamic action scene that reflects a scene in which the user shows surprise is generated.

[0242] Game Construction Phase

[0243] The server aggregates the generated elements and constructs game data in JSON or XML format, which is passed to a game engine (e.g., Unity or Unreal Engine) to create an executable game file.

[0244] Creative Mode Phase

[0245] Users can manually modify the generated game data using the creative mode, changing the character's appearance, adjusting the map layout, modifying dialogue, etc. A real-time preview function is also provided during this process, so modifications can be seen immediately.

[0246] Save Game Phase

[0247] When the user saves the game after completing the modifications, the device sends the final data to the server. The server receives the data and uploads the game data to the sharing server using the saving and sharing method. A sharing URL or code is generated and notified to the user.

[0248] Shared and Other Access Phase

[0249] Other users can access the game using a shared URL or code. The server receives the request and sends the game data back to the other user's device in the appropriate format. The other user can then run and play the game on their device.

[0250] This system allows users to intuitively create games without any programming knowledge, provide emotionally relevant gaming experiences, and easily share them with other users.

[0251] The processing flow will be explained below.

[0252] Step 1:

[0253] The user logs into the platform using a device.

[0254] Step 2:

[0255] Users select the game creation option and input or select the genre, character type, and story elements.

[0256] For example: "Genre: Fantasy", "Character: Human warrior", "Story: Adventure to save the kingdom"

[0257] Step 3:

[0258] The device collects emotional data from the user's facial expressions and voice and analyzes it in real time.

[0259] Specifically, it uses a camera and microphone to capture the user's facial expressions and tone of voice, and then determines their emotions using an emotion recognition algorithm.

[0260] For example, "If they smile, it's recognized as happiness," and "If they frown, it's recognized as surprise."

[0261] Step 4:

[0262] The device formats the input data and emotional data into JSON format or similar and sends it to the server.

[0263] Specifically, you send data to the " / generateGame" endpoint with a "POST" request.

[0264] Step 5:

[0265] The server analyzes the received data and retrieves appropriate templates and resources from a database based on genre, character type, story elements, and emotional data.

[0266] Example: "SELECT FROM templates WHERE genre='Fantasy'"

[0267] Step 6:

[0268] The server activates the AI ​​generation method based on the acquired template, user input data, and emotional data.

[0269] Story generation AI generates detailed stories based on specified elements and emotional data.

[0270] Example: "If the emotion data is surprise, add a sudden enemy attack scene."

[0271] Step 7:

[0272] The server uses a character design AI to generate details (appearance, skills, etc.) for the selected character.

[0273] Example: "Human warriors wear armor and carry swords."

[0274] Step 8:

[0275] The server uses map generation AI to create a map based on the story and emotional data.

[0276] For example: "Kingdom Map, Witch's Forest, Dragon's Lair."

[0277] Step 9:

[0278] The server integrates the generated story, characters, and maps, and constructs game data in JSON and XML formats.

[0279] Step 10:

[0280] The server uses the game engine to generate executable game files based on the constructed data.

[0281] Example: "Create an .exe file using the Unity engine."

[0282] Step 11:

[0283] The server provides the creative mode means and sends the generated game data back to the user's device.

[0284] Step 12:

[0285] Users can manually modify character appearance, map layout, dialogue, and more in creative mode.

[0286] Example: "Change the character's armor color from blue to red."

[0287] Step 13:

[0288] Once the user has finished making their modifications, they have the option to save the game.

[0289] Step 14:

[0290] The device sends the final data to the server.

[0291] Specifically, it involves sending data to the " / saveGame" endpoint with a "POST" request.

[0292] Step 15:

[0293] The server uploads the saved game data to a sharing server and generates a sharing URL or code and notifies the user.

[0294] Step 16:

[0295] Other users can access the game using a shared URL or code.

[0296] Step 17:

[0297] The server receives the request and sends the game data back to the other user's device in the appropriate format.

[0298] Step 18:

[0299] Other users receive the game data and run the game on their own devices to play.

[0300] Example 2

[0301] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0302] Conventional game creation systems make it difficult for users to create games based on emotions and share them with other users. It is also difficult to analyze emotional data and incorporate it into game content, leaving a lack of ways to enrich the user experience. Furthermore, there is no mechanism to provide a real-time preview when manually editing generated game data, making it cumbersome for users to adjust the data.

[0303] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0304] In this invention, the server includes emotion recognition means that analyzes the user's facial expressions and voice and extracts emotion data, terminal means for transmitting the input data and emotion data, and server means for retrieving appropriate templates and resources from a database based on the transmitted data and emotion data. This allows for automatic generation of a game that reflects the user's emotions and provides a real-time preview function, making it easier for users to intuitively adjust the content of the game and to easily share it with other users.

[0305] "User" means an entity that uses the system to create and modify games and share them with other users.

[0306] "Input means" refers to the means by which a user selects a game genre, character type, or story element.

[0307] "Emotion recognition means" is a means for analyzing a user's facial expressions and voice and extracting emotional data.

[0308] The "terminal means" is a means for transmitting input data and emotion data to the server.

[0309] The "server means" is a means for obtaining appropriate templates and resources from a database based on the transmitted data and emotion data.

[0310] "AI generation means" refers to a means for generating stories, characters, and maps based on acquired information.

[0311] "Game construction means" refers to means for constructing game data based on the generated data.

[0312] "Creative mode means" refers to means by which the user can manually modify the constructed game data.

[0313] "Storage and sharing means" refers to the means for storing the final data and generating a URL or code for sharing.

[0314] "Means for other users to access the game" refers to the means by which other users can access the game using a shared URL or code.

[0315] "Management means" refers to a means for managing the generated stories, characters, and maps all at once.

[0316] A "preview means" is a means for providing a real-time preview function when a user manually makes corrections.

[0317] This invention aims to provide a system that allows users to automatically generate games based on their emotions and share them with other users. Below, we will explain how the invention can be specifically implemented using various hardware and software.

[0318] First, a user accesses the system through a terminal, which can be a general-purpose computing device such as a computer, smartphone, or tablet. The terminal has an interface for accepting user input. Through the interface, the user selects the game genre (e.g., fantasy, action), character type (e.g., humanoid, robotic), and story element (e.g., the beginning of the adventure).

[0319] The device's camera and microphone are used to recognize emotions. The camera and microphone capture the user's facial expressions and voice, and the emotional data is analyzed by a dedicated emotion recognition engine (e.g., Google® Cloud Vision API, Microsoft® Azure® Emotion API). For example, if the user smiles, the emotion recognition engine extracts the facial expression data as a "smile."

[0320] The device formats the input data and emotion data into a single JSON file and sends a POST request to the server. For example, the data is sent to an endpoint called " / generateGame." The server receives the request using web server software such as Apache (registered trademark) or Nginx.

[0321] The server then retrieves the appropriate templates and resources from a database (e.g., MySQL®, MongoDB). The database contains resources corresponding to various genres, character types, story elements, and emotional data. For example, if the user smiles, content that reflects that emotion will be selected.

[0322] The server passes the acquired template, input data, and emotion data to an AI generation engine (e.g., OpenAI (registered trademark) GPT, Google BERT), which automatically generates a detailed story, character appearances and characteristics, map layout, etc. For example, a comical scene is generated to reflect a "smile."

[0323] The server then combines the generated elements and constructs game data in JSON or XML format, which is passed to a game engine such as Unity or Unreal Engine to create an executable game file.

[0324] Users can manually modify the generated game data using Creative Mode, which allows them to change the character's appearance, adjust the map layout, and edit dialogue on the interface. The changes made by the user are previewed in real time, allowing them to see how they will be reflected in the game immediately.

[0325] Finally, when the user completes the modifications and saves the game, the device sends the final data to the server. The server receives this data and uploads the game data to the sharing server using the storage and sharing method. A sharing URL and access code are generated and notified to the user.

[0326] Other users can access the game using a shared URL or access code. The server receives the request and sends the game data back to the other user's device in the appropriate format. The other user can then receive the data, run the game on their device, and play.

[0327] Specific examples

[0328] Here is an example prompt:

[0329] A user wants to create a game in the fantasy genre. He logs into the system, selects a humanoid as his preferred character type, and smiles. He wants to auto-generate and share a game that includes story elements that reflect his smile.

[0330] This system allows users to intuitively create games without any programming knowledge, provide rich, emotionally-driven gaming experiences, and easily share them with other users.

[0331] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0332] Step 1: The user logs in to the system through the interface and selects the game creation option. The user inputs the genre, character type, and story elements. The input data obtained are "Fantasy," "Humanoid," and "The Beginning of the Adventure." This input data is collected by the terminal.

[0333] Step 2: The device uses the camera and microphone to capture the user's facial expressions and voice. The emotion recognition engine analyzes this data and extracts the emotional data "smile." The input is the user's facial expressions and voice, and the output is the analyzed emotional data.

[0334] Step 3: The device formats the input data (genre, character type, story elements) and emotion data in JSON format and sends it to the server. The data to be sent is passed to the endpoint " / generateGame" via a "POST" request. The input is the formatted JSON data, and the output is the data received by the server.

[0335] Step 4: The server parses the received JSON data and retrieves appropriate templates and resources from the database based on the genre, character type, story element, and emotion data. For example, a comical story template corresponding to the emotion data "smile" is selected. The input is JSON data, and the output is the retrieved templates and resources.

[0336] Step 5: The server passes the template, user input data, and emotion data to the AI ​​generation engine to generate a detailed story, characters, and map. Using the generative AI model, game elements that reflect the user's emotions are generated. For example, a story containing scenes that reflect a "smile" is output. The input is the template and data, and the output is the generated game elements.

[0337] Step 6: The server integrates the generated elements and constructs game data in JSON or XML format, which is then passed to the game engine (e.g. Unity) to create an executable game file. The input is the generated game elements, and the output is the executable game file.

[0338] Step 7: The user uses Creative Mode to manually modify the generated game data. For example, they can change the character's appearance, map layout, or dialogue in the interface. The modified data is previewed in real time, allowing the user to see the changes immediately. The input is the generated game data, and the output is the modified game data.

[0339] Step 8: When the user completes the modifications and saves the game, the device sends the final data to the server. The server receives this data and uploads the game data to the sharing server using the storage and sharing method. A sharing URL and access code are generated and notified to the user. The input is the modified game data, and the output is the sharing URL and access code.

[0340] Step 9: Other users access the game using the shared URL or access code. The server receives the request and sends the game data back to the other users' devices. The devices then run the game, making it available for other users to play. The input is the access request, and the output is the returned game data.

[0341] (Application example 2)

[0342] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0343] Conventional game generation systems could only provide static content, unable to respond to changes in a user's emotions. This made it difficult to satisfy users' real-time needs for excitement and relief, and they were unable to provide a dynamic gaming experience tailored to individual emotions. Furthermore, sharing and accessing content with other users was a time-consuming process, hindering the smooth distribution of content.

[0344] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0345] In this invention, the server includes emotion recognition means for generating a game in real time according to the user's emotional changes, server means for acquiring appropriate templates and resources from a database, and game construction means for constructing game data using AI generation means based on the acquired information, thereby making it possible to provide a dynamic game experience that responds immediately to the user's emotions.

[0346] "Input means" refers to the means by which a user selects a game genre, character type, or story element.

[0347] "Terminal means" refers to a device or apparatus for transmitting input data.

[0348] "Emotion recognition means" refers to means for collecting and analyzing user emotion data.

[0349] The "server means" is a means for obtaining appropriate templates and resources from a database based on the transmitted data.

[0350] "AI generation means" refers to the artificial intelligence means that generates stories, characters, and maps based on acquired information.

[0351] "Game construction means" refers to means for creating game data based on the generated data.

[0352] "Creative mode means" refers to means by which the user can manually modify the constructed game data.

[0353] "Storage and sharing means" refers to the means for storing the final data and generating a URL or code for sharing.

[0354] "Means for other users to access the game" refers to the means by which other users can access the game using a shared URL or code.

[0355] The "game generation means" is a means for generating a game whose content changes in real time according to the user's emotions.

[0356] The "management means" is a means for collectively managing the generated stories, characters, and maps, and dynamically adjusting them according to emotion recognition data.

[0357] The "preview means" is a means for providing a real-time preview function when the user manually makes corrections and for adjusting the preview according to changes in the user's emotions.

[0358] The present invention relates to a system for automatically generating games based on a user's emotions and sharing them with other users. This system includes an input unit, a terminal unit, an emotion recognition unit, a server unit, an AI generation unit, a game construction unit, a creative mode unit, a storage and sharing unit, a unit for accessing other users, and a game generation unit.

[0359] Hardware and software used

[0360] The devices used are smartphones, smart glasses, and head-mounted displays. The emotion recognition system uses the Microsoft Azure Emotion API. The server uses Node.js and Express. The game is built using the Unity game engine.

[0361] Program processing overview

[0362] Operation of the system begins when the user selects the genre, character type, and story elements using the input means. The terminal means collects the input data and the user's emotional data obtained by the emotion recognition means, and sends them to the server. Based on this data, the server retrieves the necessary templates and resources from the database, and automatically generates the game's story, characters, and maps using the AI ​​generation means.

[0363] After each element is generated, the entire game is constructed by the game construction means, and the user can make individual modifications using the creative mode means. For example, it is possible to change the character's appearance or the map layout. Once modifications are complete, the game data is resent to the server by the save and share means, and a sharing URL or code is generated. Other users can access the created game using these URLs or codes.

[0364] Specific examples

[0365] For example, if a user desires a relaxing game and the emotion recognition means detects that the user's emotional state is stressed, the server will select a relaxing landscape stroll game as a template and use the AI ​​generation means to generate a game that integrates resources such as beautiful scenic panoramas and calming music. The generated game can then be further adjusted manually by the user and then provided to other users via a sharing URL.

[0366] Prompt Sentence Examples

[0367] "If you sense that the user is relaxed, create a game scene to amplify that feeling of relaxation."

[0368] "If you detect that the user is excited, generate an action-packed episode."

[0369] This system allows users to enjoy a dynamic gaming experience that responds to their emotions in real time, and makes it easy to share their creations with other users.

[0370] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0371] Step 1:

[0372] A user selects a game genre, character type, and story elements using a device such as a smartphone or smart glasses. As input, the user's selection data is generated. The device receives this selection data as input and generates initial data.

[0373] Step 2:

[0374] The device uses a camera and microphone to capture the user's facial expressions and voice, and collects the user's emotional data through emotion recognition. The collected emotional data is analyzed using the Microsoft Azure Emotion API. Through this process, the input data is output as information about the user's emotional state.

[0375] Step 3:

[0376] The device formats the selection data and emotion data in JSON format and sends it to the server. Specifically, it sends the data using a "POST" request. Through this process, the input data is output as received data on the server.

[0377] Step 4:

[0378] The server analyzes the received data and retrieves appropriate templates and resources from a database based on the genre, character type, story elements, and emotion data. The server then selects appropriate game elements and outputs template data.

[0379] Step 5:

[0380] The server activates the AI ​​generation means based on the template, user selection data, and emotion data. The AI ​​generation means automatically generates detailed storylines, character appearances, characteristics, map layouts, etc., taking into account the emotion data. This process outputs the generated game data.

[0381] Step 6:

[0382] The server integrates the generated elements to build game data. This is done using a game engine such as Unity. Specifically, it combines template data and resource data to generate an executable game file. The completed game data is obtained as output.

[0383] Step 7:

[0384] The user manually modifies the constructed game data using the creative mode means. The user can adjust the character appearance and map layout through the interface and preview the changes in real time. At this step, the user's manually modified data is output.

[0385] Step 8:

[0386] Once the user has completed the modifications, the device sends the final game data to the server. The game data is uploaded to the sharing server through the storage and sharing means, and a sharing URL or code is generated. This outputs the sharing URL or code.

[0387] Step 9:

[0388] Other users access the game using a shared URL or code. The server receives the request and sends the game data back to the other users' devices. The other users can then run the data on their own devices and play the game. The output is gameplay data.

[0389] This series of processes allows the user to enjoy a dynamic gaming experience that responds to their emotions.

[0390] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0391] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0392] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0393] [Second embodiment]

[0394] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0395] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0396] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0397] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0398] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0399] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0400] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0401] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0402] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0403] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0404] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0405] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0406] The present invention provides a system that automatically generates games and allows users to easily create games. This system includes input means for users to create their favorite games, terminal means for transmitting and processing data, server means for acquiring and processing templates and resources, AI generation means that is an automatic generation engine, game construction means for integrating game data, creative mode means for users to make modifications, saving and sharing means for saving and sharing completed games, and other user access means for other users to access the game.

[0407] User Input Phase

[0408] Users first log in using the system's interface and select game creation options, including genre (e.g., fantasy, action, adventure, etc.), character type (e.g., humanoid, robotic, quadrupedal, etc.), and basic story elements.

[0409] Data transmission phase

[0410] The device sends the input data from the user, specifically the selected genre, character type, and story elements, formatted as JSON data, and sent it to the server.

[0411] Data Collection Phase

[0412] The server receives the data and retrieves the appropriate templates and resources from a database, selecting story scripts, character designs, terrain models, and other elements appropriate for the genre.

[0413] AI generation phase

[0414] Based on the acquired templates and resources, the server launches an AI generator. This AI automatically generates a detailed story, character appearances and characteristics, map layout, etc. based on the given elements. For example, if you select a fantasy RPG, it will generate a cave inhabited by an evil dragon, a wizard's tower, etc.

[0415] Game Construction Phase

[0416] The server aggregates the generated elements and constructs the game data, which is then aggregated in JSON or XML format and passed to a game engine (e.g., Unity or Unreal Engine) to create an executable game file.

[0417] Creative Mode Phase

[0418] Users can manually modify the generated game data using the creative mode, changing the character's appearance, adjusting the map layout, modifying dialogue, etc. A real-time preview function is also provided during this process, so modifications can be seen immediately.

[0419] Save Game Phase

[0420] When the user saves the game after completing the modifications, the device sends the final data to the server. The server receives the data and uploads the game data to the sharing server using the saving and sharing method. A sharing URL or code is generated and notified to the user.

[0421] Shared and Other Access Phase

[0422] Other users can access the game using a shared URL or code. The server receives the request and sends the game data back to the other user's device in the appropriate format. The other user can then run and play the game on their device.

[0423] This system allows users to intuitively create games without any programming knowledge and easily share them with other users.

[0424] The processing flow will be explained below.

[0425] Step 1:

[0426] The user logs into the platform using a device.

[0427] Step 2:

[0428] Users select the game creation option and input or select the genre, character type, and story elements.

[0429] For example: "Genre: Fantasy", "Character: Human warrior", "Story: Adventure to save the kingdom"

[0430] Step 3:

[0431] The terminal formats the input data into JSON format or similar and sends it to the server.

[0432] Specifically, you send data to the " / generateGame" endpoint with a "POST" request.

[0433] Step 4:

[0434] The server parses the data it receives and retrieves appropriate templates and resources from a database based on genre, character type, and story elements.

[0435] Example: "SELECT FROM templates WHERE genre='Fantasy'"

[0436] Step 5:

[0437] The server then launches the AI ​​generation process based on the acquired template and user-entered data.

[0438] The story generation AI generates detailed stories based on specified elements.

[0439] Example: "An adventure to defeat an evil dragon"

[0440] Step 6:

[0441] The server uses a character design AI to generate details (appearance, skills, etc.) for the selected character.

[0442] Example: "Human warriors wear armor and carry swords."

[0443] Step 7:

[0444] The server uses map generation AI to create maps based on the story.

[0445] For example: "Kingdom Map, Witch's Forest, Dragon's Lair."

[0446] Step 8:

[0447] The server integrates the generated story, characters, and maps, and constructs game data in JSON and XML formats.

[0448] Step 9:

[0449] The server uses the game engine to generate executable game files based on the constructed data.

[0450] Example: "Create an .exe file using the Unity engine."

[0451] Step 10:

[0452] The server provides the creative mode means and sends the generated game data back to the user's device.

[0453] Step 11:

[0454] Users can manually modify character appearance, map layout, dialogue, and more in creative mode.

[0455] Step 12:

[0456] Once the user has finished making their modifications, they have the option to save the game.

[0457] Step 13:

[0458] The device sends the final data to the server.

[0459] Specifically, it involves sending data to the " / saveGame" endpoint with a "POST" request.

[0460] Step 14:

[0461] The server uploads the saved game data to a sharing server and generates a sharing URL or code and notifies the user.

[0462] Step 15:

[0463] Other users can access the game using a shared URL or code.

[0464] Step 16:

[0465] The server receives the request and sends the game data back to the other user's device in the appropriate format.

[0466] Step 17:

[0467] Other users receive the game data and run the game on their own devices to play.

[0468] Example 1

[0469] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0470] Current game creation systems often require specialized programming knowledge, making it difficult for average users to easily create games. Furthermore, existing systems require detailed settings for story and characters to be created manually, which is time-consuming. Furthermore, sharing and accessing games with other users requires complicated procedures, making it difficult to efficiently create and share games.

[0471] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0472] In this invention, the server includes input means for a user to select a game genre, character type, and story elements, terminal means for transmitting the input data, formatting means for formatting the transmitted data and transmitting it to the server, server means for retrieving appropriate templates and resources from a database based on the transmitted data, AI generation means for generating a story, characters, and maps based on the retrieved information, game construction means for integrating the generated data and constructing an executable game file, creative mode means for a user to manually modify the constructed game data, preview means for providing a real-time preview function, save and share means for saving the final data and generating a sharing URL and code, and other user access means for other users to access the game using the sharing URL and code. This enables users to intuitively create games without any programming knowledge and easily share them with other users.

[0473] "User" refers to a person who uses the system to create and operate a game.

[0474] "Input means" refers to a means that provides an interface for a user to select a game genre, character type, and story elements.

[0475] "Terminal means" refers to a device or system for transmitting data entered by a user.

[0476] "Formatting means" refers to a process or device for converting transmitted data into a format such as JSON or XML and transmitting it to the server.

[0477] "Server means" refers to a computer system responsible for retrieving appropriate templates and resources from a database based on the transmitted data.

[0478] "AI generation means" refers to an artificial intelligence system that automatically generates stories, characters, and maps based on acquired information.

[0479] "Game construction means" refers to a process or system for integrating generated data to construct an executable game file.

[0480] "Creative mode means" refers to means for providing an interface for the user to manually modify generated game data.

[0481] "Preview facility" refers to a feature that provides a real-time display as the user makes modifications.

[0482] "Storage and sharing method" refers to the process or system for storing the final data and generating a URL or code for sharing.

[0483] "Means for accessing other users" refers to the function that allows other users to access the game using a shared URL or code.

[0484] The present invention provides a system that allows a user to easily create a game and share it with other users. The system includes the following means.

[0485] First, the user logs into the system using an interface, which is provided through a terminal such as a web browser. Once logged in, the dashboard is displayed and the user selects the "Create a Game" option.

[0486] If the user selects the game creation option, they are presented with a screen where they can select the genre (e.g., fantasy, action, adventure, etc.), the character type (e.g., humanoid, robotic, quadrupedal, etc.), and basic story elements. The user selects these options and proceeds to the next step.

[0487] Next, the terminal receives the user's input and formats it into JSON format etc. For example, if you select a fantasy RPG, it will generate the following JSON data:

[0488] json

[0489] {

[0490] "genre": "fantasy",

[0491] "characters": ["humanoid", "mechanical"],

[0492] "story": "An adventure exploring the cave where the evil dragon lives"

[0493] }

[0494] The formatted data is sent to the server, which then retrieves the appropriate templates and resources from its database based on the received data. These templates and resources include story scripts, character designs, terrain models, and other elements appropriate for the genre.

[0495] The server then launches an AI generation method based on the acquired templates and resources. For example, GPT-3 or DALL-E are used as generative AI models. This automatically generates detailed stories, characters, maps, etc. based on elements selected by the user. As a specific example, in the case of a fantasy RPG, the following may be generated: Story: A cave inhabited by an evil dragon; Characters: Brave warriors and wizards; Maps: A cave and a wizard's tower.

[0496] The generated elements are then integrated by a game builder. The server integrates these elements and builds an executable game file. This game data is saved in JSON or XML format and passed to a game engine such as Unity or Unreal Engine.

[0497] Users can manually modify the generated game data using the Creative Mode interface, which provides tools for changing character appearances, adjusting map layouts, and modifying dialogue, and includes a real-time preview feature that allows users to instantly see their changes.

[0498] Once the game has been modified, the final data is sent to the server via the save and share method. The server receives this final data and uploads it to the sharing server. A sharing URL or code is generated and notified to the user.

[0499] Other users can access the game using this shared URL or code. The server receives the user's request and sends the game data back to the device. The other users can then use the received data to run the game on their own devices and enjoy playing it.

[0500] For example, the user enters the following prompt text:

[0501] "I want to create an action game. The main story will be about police robots who crack down on crime in a futuristic city, and I'd like the characters to be both mechanical and humanoid."

[0502] Based on these prompts, a generative AI model generates futuristic cities, criminals, police robots, etc. Users can adjust these elements to create their own original games, which can then be easily shared with other users.

[0503] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0504] Step 1:

[0505] A user opens the system interface and enters their login information. The server receives the information and authenticates the user. If the user authentication is successful, the server displays the dashboard. The input is the username and password, and the output is the dashboard screen after successful login.

[0506] Step 2:

[0507] The user selects the "Create a Game" option from the dashboard. The server displays the game creation screen and presents a form to input genre, character type, and basic story elements. The inputs are genre, character type, and story elements, and the output is a button to proceed to the next input step.

[0508] Step 3:

[0509] The user selects the genre, character type, and story elements, and clicks the Next button. The device formats this input data into JSON format and sends it to the server. The input is the user's selection, and the output is JSON format data. For example,

[0510] json

[0511] {

[0512] "genre": "fantasy",

[0513] "characters": ["humanoid", "mechanical"],

[0514] "story": "An adventure exploring the cave where the evil dragon lives"

[0515] }

[0516] Step 4:

[0517] The server parses the received JSON data and retrieves the corresponding templates and resources from the database. The server executes queries against the database to retrieve story scripts, character designs, terrain models, etc. appropriate for the genre. The input is JSON data, and the output is a list of retrieved templates and resources.

[0518] Step 5:

[0519] The server launches an AI generator based on the acquired templates and resources. The generative AI model (e.g., GPT-3, DALL-E) generates detailed stories, characters, and maps based on the given information. For example, in a fantasy RPG, a cave inhabited by an evil dragon might be generated as a story element. The input is the template or resource, and the output is detailed game elements.

[0520] Step 6:

[0521] The server aggregates the generated elements and constructs game data. This data is saved in JSON or XML format and passed to a game engine such as Unity or Unreal Engine. The game engine uses this data to create an executable game file. The input is the generated story, characters, and maps, and the output is an executable game file.

[0522] Step 7:

[0523] Users open Creative Mode and manually modify the generated game data. The interface provides tools for adjusting character appearance, stage maps, and dialogue. Furthermore, a real-time preview function allows users to instantly see the results of their changes. The input is the user's modifications, and the output is the modified game data.

[0524] Step 8:

[0525] When the user completes the edits and presses the save button, the device sends the final data to the server. The server receives the final data and uploads it to the storage and sharing server. The server generates a sharing URL and code and notifies the user of this information. The input is the edited game data, and the output is the sharing URL and code.

[0526] Step 9:

[0527] Other users access the game using a sharing URL or code. The server receives the access request and returns the game data in an appropriate format to the other user's device. The other user can then receive the data and run the game on their own device. The input is the sharing URL or code, and the output is the game data.

[0528] For example, the user enters the following prompt text:

[0529] "I want to create an action game. The main story will be about police robots who crack down on crime in a futuristic city, and I'd like the characters to be both mechanical and humanoid."

[0530] The generative AI model generates futuristic cities, police robots, and criminal characters, and users can adjust these elements to create original games that can then be easily shared with other users.

[0531] (Application example 1)

[0532] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0533] Conventional virtual stores have the problem that users need a lot of expertise and time to customize product displays. Furthermore, there are limited means to create interactive experiences that can be easily shared with other users, limiting the user experience. This makes it difficult for users to intuitively and quickly customize and share virtual experiences with others.

[0534] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0535] In this invention, the server includes input means for a user to select a product display type and scenario elements, terminal means for transmitting the input data, server means for retrieving appropriate templates and resources from a database based on the transmitted data, AI generation means for generating an exhibition scenario, virtual characters, and backgrounds based on the retrieved information, experience construction means for constructing a virtual experience based on the generated data, creative mode means for a user to manually modify the constructed experience data, storage and sharing means for saving the final data and generating a sharing URL or code, and other user access means for other users to access the virtual experience using the sharing URL or code. This enables users to intuitively customize a virtual experience without requiring specialized knowledge and quickly share it with other users.

[0536] "Input means" refers to an interface that allows the user to input options.

[0537] "Terminal means" refers to electronic equipment for transmitting input data.

[0538] The "server means" is a device for obtaining appropriate templates and resources from a database based on the transmitted data.

[0539] The "AI generation means" is an artificial intelligence system that automatically generates exhibition scenarios, virtual characters, and backgrounds based on acquired information.

[0540] "Experience construction means" is a function for constructing a virtual experience based on the generated data.

[0541] "Creative mode means" is a feature that allows users to manually modify the constructed experience data.

[0542] "Storage and sharing means" is a function for saving the final data and generating a URL or code for sharing.

[0543] "Access for Other Users" refers to the ability for other users to access a virtual experience using a shared URL or code.

[0544] This invention provides a system that allows users to customize product displays in a virtual store, automatically generate interactive experiences, and easily share them with other users. The system includes input means, terminal means, server means, AI generation means, experience construction means, creative mode means, storage and sharing means, and other user access means.

[0545] First, the user logs into the virtual store using a device such as a smartphone or head-mounted display. The user inputs the desired settings using an input means to select the type of product display and scenario elements. For example, the user selects a specific product (clothing, home appliances, furniture, etc.) and then selects the virtual display scenario for that product (e.g., fashion show, demonstration).

[0546] Next, the terminal means transmits the input data in JSON format to the server means, which receives the data and retrieves appropriate templates and resources (such as 3D product models, scenario scripts, and background models) from a database.

[0547] The server then automatically generates an exhibition scenario, virtual characters, and backgrounds based on the acquired information using AI generation means. For example, if the user selects a fashion show, a scenario is generated in which models wearing the selected clothes perform a virtual fashion show.

[0548] The server then uses an experience builder to build a virtual experience based on the generated data, which is then passed to a game engine such as Unity or Unreal Engine to create a virtual experience file that is used to run the experience.

[0549] Users can manually edit the created experience data in creative mode, for example, adjusting the model's appearance, exhibit content, and background layout. A real-time preview function is also provided during this process, so changes can be seen immediately.

[0550] The final experience data is sent to the server via the storage and sharing means, and a sharing URL or code is generated. Other users can then access the experience using the sharing URL or code. Other users can receive the experience data from the server and run it on their own devices.

[0551] Examples of specific prompts include:

[0552] "A user has selected a new smartphone. Generate a virtual demonstration scenario in which a product reviewer demonstrates the new features. The generated scenario should include a reviewer character, product feature descriptions, or interactive demonstrations."

[0553] The system allows users to intuitively customize virtual experiences without requiring specialized knowledge and quickly share them with others.

[0554] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0555] Step 1:

[0556] Users log in to the virtual store using a device such as a smartphone or head-mounted display.

[0557] Input: User ID, Password

[0558] Output: User information, viewable product list

[0559] Specifically, the user inputs login information using the input means, and the terminal transmits the information to the server.

[0560] Step 2:

[0561] The user selects the type of product display and scenario elements using the input means.

[0562] Input: Product selection, display type, scenario elements

[0563] Output: Selection data (JSON format)

[0564] Specifically, the user inputs the desired products and display settings, which are then compiled as data by the terminal.

[0565] Step 3:

[0566] The terminal transmits the input data to the server.

[0567] Input: Selection data (JSON format)

[0568] Output: Server received data

[0569] Specifically, the terminal formats the selected data in JSON format and sends it to the server.

[0570] Step 4:

[0571] The server retrieves the appropriate template or resource from the database.

[0572] Input: Received data

[0573] Output: Templates, 3D models, scenario scripts

[0574] Specifically, the server analyzes the received data and searches for and acquires the corresponding resource from the database.

[0575] Step 5:

[0576] The server generates an exhibition scenario, virtual characters, and backgrounds based on the acquired data using AI generation means.

[0577] Input: Template, 3D model, scenario script

[0578] Output: Generated data (exhibition scenario, characters, background)

[0579] Specifically, the server launches an AI generation model and automatically generates a virtual exhibit based on the input data.

[0580] Step 6:

[0581] The server uses the experience construction means to construct a virtual experience based on the generated data.

[0582] Input: Generated data

[0583] Output: Executable virtual experience file

[0584] Specifically, the server passes the generated data to a game engine such as Unity or Unreal Engine to build a runnable virtual experience.

[0585] Step 7:

[0586] The user manually modifies the experience data using creative mode means.

[0587] Input: Executable virtual experience file

[0588] Output: Modified virtual experience file

[0589] Specifically, the user makes modifications through the interface, which are previewed in real time.

[0590] Step 8:

[0591] The server stores the final data and generates a URL or code for sharing.

[0592] Input: Modified virtual experience file

[0593] Output: Share URL, code

[0594] The specific operation is that the server saves the final data in a database and generates a URL or code for sharing.

[0595] Step 9:

[0596] Other users access the virtual experience using a shareable URL or code.

[0597] Input: Share URL, code

[0598] Output: Virtual experience data

[0599] Specifically, other users access the server using a shared URL or code and receive the experience data on their devices.

[0600] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0601] The present invention provides a system that enables users to automatically generate games based on their emotions and share them with other users. The system includes an input means for users to create their favorite games, a terminal means for transmitting and processing data, a server means for acquiring and processing templates and resources, an AI generation means, a game construction means for integrating game data, a creative mode means for users to make modifications, a saving and sharing means for saving and sharing the completed game, a other user access means for other users to access the game, and an emotion recognition engine for recognizing user emotions.

[0602] User Input Phase

[0603] Users first log in using the system's interface and select game creation options, including genre (e.g., fantasy, action, adventure, etc.), character type (e.g., humanoid, robotic, quadrupedal, etc.), and basic story elements.

[0604] Emotion Recognition Phase

[0605] The device collects and analyzes emotional data from the user's facial expressions and voice. For example, if the user shows a smile or a surprised expression, the device captures that emotional data.

[0606] Data transmission phase

[0607] The device formats the input data and emotion data into JSON format and sends it to the server. Specifically, it sends the data to the " / generateGame" endpoint using a "POST" request.

[0608] Data Collection Phase

[0609] The server analyzes the received data and retrieves appropriate templates and resources from the database based on genre, character type, story elements, and emotion data. For example, if the user expresses surprise, stories and scenes containing surprise elements will be selected.

[0610] AI generation phase

[0611] The server activates the AI ​​generation method based on the acquired template, user-input data, and emotional data. This generation AI automatically generates a detailed story, character appearances and characteristics, map layout, etc., taking into account the emotional data. For example, a dynamic action scene that reflects a scene in which the user shows surprise is generated.

[0612] Game Construction Phase

[0613] The server aggregates the generated elements and constructs game data in JSON or XML format, which is passed to a game engine (e.g., Unity or Unreal Engine) to create an executable game file.

[0614] Creative Mode Phase

[0615] Users can manually modify the generated game data using the creative mode, changing the character's appearance, adjusting the map layout, modifying dialogue, etc. A real-time preview function is also provided during this process, so modifications can be seen immediately.

[0616] Save Game Phase

[0617] When the user saves the game after completing the modifications, the device sends the final data to the server. The server receives the data and uploads the game data to the sharing server using the saving and sharing method. A sharing URL or code is generated and notified to the user.

[0618] Shared and Other Access Phase

[0619] Other users can access the game using a shared URL or code. The server receives the request and sends the game data back to the other user's device in the appropriate format. The other user can then run and play the game on their device.

[0620] This system allows users to intuitively create games without any programming knowledge, provide emotionally relevant gaming experiences, and easily share them with other users.

[0621] The processing flow will be explained below.

[0622] Step 1:

[0623] The user logs into the platform using a device.

[0624] Step 2:

[0625] Users select the game creation option and input or select the genre, character type, and story elements.

[0626] For example: "Genre: Fantasy", "Character: Human warrior", "Story: Adventure to save the kingdom"

[0627] Step 3:

[0628] The device collects emotional data from the user's facial expressions and voice and analyzes it in real time.

[0629] Specifically, it uses a camera and microphone to capture the user's facial expressions and tone of voice, and then determines their emotions using an emotion recognition algorithm.

[0630] For example, "If they smile, it's recognized as happiness," and "If they frown, it's recognized as surprise."

[0631] Step 4:

[0632] The device formats the input data and emotional data into JSON format or similar and sends it to the server.

[0633] Specifically, you send data to the " / generateGame" endpoint with a "POST" request.

[0634] Step 5:

[0635] The server analyzes the received data and retrieves appropriate templates and resources from a database based on genre, character type, story elements, and emotional data.

[0636] Example: "SELECT FROM templates WHERE genre='Fantasy'"

[0637] Step 6:

[0638] The server activates the AI ​​generation method based on the acquired template, user input data, and emotional data.

[0639] Story generation AI generates detailed stories based on specified elements and emotional data.

[0640] Example: "If the emotion data is surprise, add a sudden enemy attack scene."

[0641] Step 7:

[0642] The server uses a character design AI to generate details (appearance, skills, etc.) for the selected character.

[0643] Example: "Human warriors wear armor and carry swords."

[0644] Step 8:

[0645] The server uses map generation AI to create a map based on the story and emotional data.

[0646] For example: "Kingdom Map, Witch's Forest, Dragon's Lair."

[0647] Step 9:

[0648] The server integrates the generated story, characters, and maps, and constructs game data in JSON and XML formats.

[0649] Step 10:

[0650] The server uses the game engine to generate executable game files based on the constructed data.

[0651] Example: "Create an .exe file using the Unity engine."

[0652] Step 11:

[0653] The server provides the creative mode means and sends the generated game data back to the user's device.

[0654] Step 12:

[0655] Users can manually modify character appearance, map layout, dialogue, and more in creative mode.

[0656] Example: "Change the character's armor color from blue to red."

[0657] Step 13:

[0658] Once the user has finished making their modifications, they have the option to save the game.

[0659] Step 14:

[0660] The device sends the final data to the server.

[0661] Specifically, it involves sending data to the " / saveGame" endpoint with a "POST" request.

[0662] Step 15:

[0663] The server uploads the saved game data to a sharing server and generates a sharing URL or code and notifies the user.

[0664] Step 16:

[0665] Other users can access the game using a shared URL or code.

[0666] Step 17:

[0667] The server receives the request and sends the game data back to the other user's device in the appropriate format.

[0668] Step 18:

[0669] Other users receive the game data and run the game on their own devices to play.

[0670] Example 2

[0671] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0672] Conventional game creation systems make it difficult for users to create games based on emotions and share them with other users. It is also difficult to analyze emotional data and incorporate it into game content, leaving a lack of ways to enrich the user experience. Furthermore, there is no mechanism to provide a real-time preview when manually editing generated game data, making it cumbersome for users to adjust the data.

[0673] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0674] In this invention, the server includes emotion recognition means that analyzes the user's facial expressions and voice and extracts emotion data, terminal means for transmitting the input data and emotion data, and server means for retrieving appropriate templates and resources from a database based on the transmitted data and emotion data. This allows for automatic generation of a game that reflects the user's emotions and provides a real-time preview function, making it easier for users to intuitively adjust the content of the game and to easily share it with other users.

[0675] "User" means an entity that uses the system to create and modify games and share them with other users.

[0676] "Input means" refers to the means by which a user selects a game genre, character type, or story element.

[0677] "Emotion recognition means" is a means for analyzing a user's facial expressions and voice and extracting emotional data.

[0678] The "terminal means" is a means for transmitting input data and emotion data to the server.

[0679] The "server means" is a means for obtaining appropriate templates and resources from a database based on the transmitted data and emotion data.

[0680] "AI generation means" refers to a means for generating stories, characters, and maps based on acquired information.

[0681] "Game construction means" refers to means for constructing game data based on the generated data.

[0682] "Creative mode means" refers to means by which the user can manually modify the constructed game data.

[0683] "Storage and sharing means" refers to the means for storing the final data and generating a URL or code for sharing.

[0684] "Means for other users to access the game" refers to the means by which other users can access the game using a shared URL or code.

[0685] "Management means" refers to a means for managing the generated stories, characters, and maps all at once.

[0686] A "preview means" is a means for providing a real-time preview function when a user manually makes corrections.

[0687] This invention aims to provide a system that allows users to automatically generate games based on their emotions and share them with other users. Below, we will explain how the invention can be specifically implemented using various hardware and software.

[0688] First, a user accesses the system through a terminal, which can be a general-purpose computing device such as a computer, smartphone, or tablet. The terminal has an interface for accepting user input. Through the interface, the user selects the game genre (e.g., fantasy, action), character type (e.g., humanoid, robotic), and story element (e.g., the beginning of the adventure).

[0689] The device's camera and microphone are used to recognize emotions. The camera and microphone capture the user's facial expressions and voice, and the emotional data is analyzed by a dedicated emotion recognition engine (e.g., Google Cloud Vision API, Microsoft Azure Emotion API). For example, if the user smiles, the emotion recognition engine extracts the facial expression data as a "smile."

[0690] The device converts this input data and emotion data into a JSON file and sends a POST request to the server. For example, the data is sent to an endpoint called " / generateGame." The server receives the request using web server software such as Apache or Nginx.

[0691] The server then retrieves the appropriate templates and resources from a database (e.g., MySQL, MongoDB). The database contains resources for various genres, character types, story elements, and emotional data. For example, if the user smiles, content that reflects that emotion will be selected.

[0692] The server passes the acquired template, input data, and emotion data to an AI generation engine (e.g., OpenAI GPT, Google BERT), which automatically generates a detailed story, character appearances and characteristics, map layout, etc. For example, a comical scene is generated to reflect a "smile."

[0693] The server then combines the generated elements and constructs game data in JSON or XML format, which is passed to a game engine such as Unity or Unreal Engine to create an executable game file.

[0694] Users can manually modify the generated game data using Creative Mode, which allows them to change the character's appearance, adjust the map layout, and edit dialogue on the interface. The changes made by the user are previewed in real time, allowing them to see how they will be reflected in the game immediately.

[0695] Finally, when the user completes the modifications and saves the game, the device sends the final data to the server. The server receives this data and uploads the game data to the sharing server using the storage and sharing method. A sharing URL and access code are generated and notified to the user.

[0696] Other users can access the game using a shared URL or access code. The server receives the request and sends the game data back to the other user's device in the appropriate format. The other user can then receive the data, run the game on their device, and play.

[0697] Specific examples

[0698] Here is an example prompt:

[0699] A user wants to create a game in the fantasy genre. He logs into the system, selects a humanoid as his preferred character type, and smiles. He wants to auto-generate and share a game that includes story elements that reflect his smile.

[0700] This system allows users to intuitively create games without any programming knowledge, provide rich, emotionally-driven gaming experiences, and easily share them with other users.

[0701] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0702] Step 1: The user logs in to the system through the interface and selects the game creation option. The user inputs the genre, character type, and story elements. The input data obtained are "Fantasy," "Humanoid," and "The Beginning of the Adventure." This input data is collected by the terminal.

[0703] Step 2: The device uses the camera and microphone to capture the user's facial expressions and voice. The emotion recognition engine analyzes this data and extracts the emotional data "smile." The input is the user's facial expressions and voice, and the output is the analyzed emotional data.

[0704] Step 3: The device formats the input data (genre, character type, story elements) and emotion data in JSON format and sends it to the server. The data to be sent is passed to the endpoint " / generateGame" via a "POST" request. The input is the formatted JSON data, and the output is the data received by the server.

[0705] Step 4: The server parses the received JSON data and retrieves appropriate templates and resources from the database based on the genre, character type, story element, and emotion data. For example, a comical story template corresponding to the emotion data "smile" is selected. The input is JSON data, and the output is the retrieved templates and resources.

[0706] Step 5: The server passes the template, user input data, and emotion data to the AI ​​generation engine to generate a detailed story, characters, and map. Using the generative AI model, game elements that reflect the user's emotions are generated. For example, a story containing scenes that reflect a "smile" is output. The input is the template and data, and the output is the generated game elements.

[0707] Step 6: The server integrates the generated elements and constructs game data in JSON or XML format, which is then passed to the game engine (e.g. Unity) to create an executable game file. The input is the generated game elements, and the output is the executable game file.

[0708] Step 7: The user uses Creative Mode to manually modify the generated game data. For example, they can change the character's appearance, map layout, or dialogue in the interface. The modified data is previewed in real time, allowing the user to see the changes immediately. The input is the generated game data, and the output is the modified game data.

[0709] Step 8: When the user completes the modifications and saves the game, the device sends the final data to the server. The server receives this data and uploads the game data to the sharing server using the storage and sharing method. A sharing URL and access code are generated and notified to the user. The input is the modified game data, and the output is the sharing URL and access code.

[0710] Step 9: Other users access the game using the shared URL or access code. The server receives the request and sends the game data back to the other users' devices. The devices then run the game, making it available for other users to play. The input is the access request, and the output is the returned game data.

[0711] (Application example 2)

[0712] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0713] Conventional game generation systems could only provide static content, unable to respond to changes in a user's emotions. This made it difficult to satisfy users' real-time needs for excitement and relief, and they were unable to provide a dynamic gaming experience tailored to individual emotions. Furthermore, sharing and accessing content with other users was a time-consuming process, hindering the smooth distribution of content.

[0714] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0715] In this invention, the server includes emotion recognition means for generating a game in real time according to the user's emotional changes, server means for acquiring appropriate templates and resources from a database, and game construction means for constructing game data using AI generation means based on the acquired information, thereby making it possible to provide a dynamic game experience that responds immediately to the user's emotions.

[0716] "Input means" refers to the means by which a user selects a game genre, character type, or story element.

[0717] "Terminal means" refers to a device or apparatus for transmitting input data.

[0718] "Emotion recognition means" refers to means for collecting and analyzing user emotion data.

[0719] The "server means" is a means for obtaining appropriate templates and resources from a database based on the transmitted data.

[0720] "AI generation means" refers to the artificial intelligence means that generates stories, characters, and maps based on acquired information.

[0721] "Game construction means" refers to means for creating game data based on the generated data.

[0722] "Creative mode means" refers to means by which the user can manually modify the constructed game data.

[0723] "Storage and sharing means" refers to the means for storing the final data and generating a URL or code for sharing.

[0724] "Means for other users to access the game" refers to the means by which other users can access the game using a shared URL or code.

[0725] The "game generation means" is a means for generating a game whose content changes in real time according to the user's emotions.

[0726] The "management means" is a means for collectively managing the generated stories, characters, and maps, and dynamically adjusting them according to emotion recognition data.

[0727] The "preview means" is a means for providing a real-time preview function when the user manually makes corrections and for adjusting the preview according to changes in the user's emotions.

[0728] The present invention relates to a system for automatically generating games based on a user's emotions and sharing them with other users. This system includes an input unit, a terminal unit, an emotion recognition unit, a server unit, an AI generation unit, a game construction unit, a creative mode unit, a storage and sharing unit, a unit for accessing other users, and a game generation unit.

[0729] Hardware and software used

[0730] The devices used are smartphones, smart glasses, and head-mounted displays. The emotion recognition system uses the Microsoft Azure Emotion API. The server uses Node.js and Express. The game is built using the Unity game engine.

[0731] Program processing overview

[0732] Operation of the system begins when the user selects the genre, character type, and story elements using the input means. The terminal means collects the input data and the user's emotional data obtained by the emotion recognition means, and sends them to the server. Based on this data, the server retrieves the necessary templates and resources from the database, and automatically generates the game's story, characters, and maps using the AI ​​generation means.

[0733] After each element is generated, the entire game is constructed by the game construction means, and the user can make individual modifications using the creative mode means. For example, it is possible to change the character's appearance or the map layout. Once modifications are complete, the game data is resent to the server by the save and share means, and a sharing URL or code is generated. Other users can access the created game using these URLs or codes.

[0734] Specific examples

[0735] For example, if a user desires a relaxing game and the emotion recognition means detects that the user's emotional state is stressed, the server will select a relaxing landscape stroll game as a template and use the AI ​​generation means to generate a game that integrates resources such as beautiful scenic panoramas and calming music. The generated game can then be further adjusted manually by the user and then provided to other users via a sharing URL.

[0736] Prompt Sentence Examples

[0737] "If you sense that the user is relaxed, create a game scene to amplify that feeling of relaxation."

[0738] "If you detect that the user is excited, generate an action-packed episode."

[0739] This system allows users to enjoy a dynamic gaming experience that responds to their emotions in real time, and makes it easy to share their creations with other users.

[0740] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0741] Step 1:

[0742] A user selects a game genre, character type, and story elements using a device such as a smartphone or smart glasses. As input, the user's selection data is generated. The device receives this selection data as input and generates initial data.

[0743] Step 2:

[0744] The device uses a camera and microphone to capture the user's facial expressions and voice, and collects the user's emotional data through emotion recognition. The collected emotional data is analyzed using the Microsoft Azure Emotion API. Through this process, the input data is output as information about the user's emotional state.

[0745] Step 3:

[0746] The device formats the selection data and emotion data in JSON format and sends it to the server. Specifically, it sends the data using a "POST" request. Through this process, the input data is output as received data on the server.

[0747] Step 4:

[0748] The server analyzes the received data and retrieves appropriate templates and resources from a database based on the genre, character type, story elements, and emotion data. The server then selects appropriate game elements and outputs template data.

[0749] Step 5:

[0750] The server activates the AI ​​generation means based on the template, user selection data, and emotion data. The AI ​​generation means automatically generates detailed storylines, character appearances, characteristics, map layouts, etc., taking into account the emotion data. This process outputs the generated game data.

[0751] Step 6:

[0752] The server integrates the generated elements to build game data. This is done using a game engine such as Unity. Specifically, it combines template data and resource data to generate an executable game file. The completed game data is obtained as output.

[0753] Step 7:

[0754] The user manually modifies the constructed game data using the creative mode means. The user can adjust the character appearance and map layout through the interface and preview the changes in real time. At this step, the user's manually modified data is output.

[0755] Step 8:

[0756] Once the user has completed the modifications, the device sends the final game data to the server. The game data is uploaded to the sharing server through the storage and sharing means, and a sharing URL or code is generated. This outputs the sharing URL or code.

[0757] Step 9:

[0758] Other users access the game using a shared URL or code. The server receives the request and sends the game data back to the other users' devices. The other users can then run the data on their own devices and play the game. The output is gameplay data.

[0759] This series of processes allows the user to enjoy a dynamic gaming experience that responds to their emotions.

[0760] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0761] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0762] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0763] [Third embodiment]

[0764] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0765] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0766] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0767] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0768] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0769] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0770] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0771] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0772] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0773] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0774] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0775] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0776] The present invention provides a system that automatically generates games and allows users to easily create games. This system includes input means for users to create their favorite games, terminal means for transmitting and processing data, server means for acquiring and processing templates and resources, AI generation means that is an automatic generation engine, game construction means for integrating game data, creative mode means for users to make modifications, saving and sharing means for saving and sharing completed games, and other user access means for other users to access the game.

[0777] User Input Phase

[0778] Users first log in using the system's interface and select game creation options, including genre (e.g., fantasy, action, adventure, etc.), character type (e.g., humanoid, robotic, quadrupedal, etc.), and basic story elements.

[0779] Data transmission phase

[0780] The device sends the input data from the user, specifically the selected genre, character type, and story elements, formatted as JSON data, and sent it to the server.

[0781] Data Collection Phase

[0782] The server receives the data and retrieves the appropriate templates and resources from a database, selecting story scripts, character designs, terrain models, and other elements appropriate for the genre.

[0783] AI generation phase

[0784] Based on the acquired templates and resources, the server launches an AI generator. This AI automatically generates a detailed story, character appearances and characteristics, map layout, etc. based on the given elements. For example, if you select a fantasy RPG, it will generate a cave inhabited by an evil dragon, a wizard's tower, etc.

[0785] Game Construction Phase

[0786] The server aggregates the generated elements and constructs the game data, which is then aggregated in JSON or XML format and passed to a game engine (e.g., Unity or Unreal Engine) to create an executable game file.

[0787] Creative Mode Phase

[0788] Users can manually modify the generated game data using the creative mode, changing the character's appearance, adjusting the map layout, modifying dialogue, etc. A real-time preview function is also provided during this process, so modifications can be seen immediately.

[0789] Save Game Phase

[0790] When the user saves the game after completing the modifications, the device sends the final data to the server. The server receives the data and uploads the game data to the sharing server using the saving and sharing method. A sharing URL or code is generated and notified to the user.

[0791] Shared and Other Access Phase

[0792] Other users can access the game using a shared URL or code. The server receives the request and sends the game data back to the other user's device in the appropriate format. The other user can then run and play the game on their device.

[0793] This system allows users to intuitively create games without any programming knowledge and easily share them with other users.

[0794] The processing flow will be explained below.

[0795] Step 1:

[0796] The user logs into the platform using a device.

[0797] Step 2:

[0798] Users select the game creation option and input or select the genre, character type, and story elements.

[0799] For example: "Genre: Fantasy", "Character: Human warrior", "Story: Adventure to save the kingdom"

[0800] Step 3:

[0801] The terminal formats the input data into JSON format or similar and sends it to the server.

[0802] Specifically, you send data to the " / generateGame" endpoint with a "POST" request.

[0803] Step 4:

[0804] The server parses the data it receives and retrieves appropriate templates and resources from a database based on genre, character type, and story elements.

[0805] Example: "SELECT FROM templates WHERE genre='Fantasy'"

[0806] Step 5:

[0807] The server then launches the AI ​​generation process based on the acquired template and user-entered data.

[0808] The story generation AI generates detailed stories based on specified elements.

[0809] Example: "An adventure to defeat an evil dragon"

[0810] Step 6:

[0811] The server uses a character design AI to generate details (appearance, skills, etc.) for the selected character.

[0812] Example: "Human warriors wear armor and carry swords."

[0813] Step 7:

[0814] The server uses map generation AI to create maps based on the story.

[0815] For example: "Kingdom Map, Witch's Forest, Dragon's Lair."

[0816] Step 8:

[0817] The server integrates the generated story, characters, and maps, and constructs game data in JSON and XML formats.

[0818] Step 9:

[0819] The server uses the game engine to generate executable game files based on the constructed data.

[0820] Example: "Create an .exe file using the Unity engine."

[0821] Step 10:

[0822] The server provides the creative mode means and sends the generated game data back to the user's device.

[0823] Step 11:

[0824] Users can manually modify character appearance, map layout, dialogue, and more in creative mode.

[0825] Step 12:

[0826] Once the user has finished making their modifications, they have the option to save the game.

[0827] Step 13:

[0828] The device sends the final data to the server.

[0829] Specifically, it involves sending data to the " / saveGame" endpoint with a "POST" request.

[0830] Step 14:

[0831] The server uploads the saved game data to a sharing server and generates a sharing URL or code and notifies the user.

[0832] Step 15:

[0833] Other users can access the game using a shared URL or code.

[0834] Step 16:

[0835] The server receives the request and sends the game data back to the other user's device in the appropriate format.

[0836] Step 17:

[0837] Other users receive the game data and run the game on their own devices to play.

[0838] Example 1

[0839] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0840] Current game creation systems often require specialized programming knowledge, making it difficult for average users to easily create games. Furthermore, existing systems require detailed settings for story and characters to be created manually, which is time-consuming. Furthermore, sharing and accessing games with other users requires complicated procedures, making it difficult to efficiently create and share games.

[0841] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0842] In this invention, the server includes input means for a user to select a game genre, character type, and story elements, terminal means for transmitting the input data, formatting means for formatting the transmitted data and transmitting it to the server, server means for retrieving appropriate templates and resources from a database based on the transmitted data, AI generation means for generating a story, characters, and maps based on the retrieved information, game construction means for integrating the generated data and constructing an executable game file, creative mode means for a user to manually modify the constructed game data, preview means for providing a real-time preview function, save and share means for saving the final data and generating a sharing URL and code, and other user access means for other users to access the game using the sharing URL and code. This enables users to intuitively create games without any programming knowledge and easily share them with other users.

[0843] "User" refers to a person who uses the system to create and operate a game.

[0844] "Input means" refers to a means that provides an interface for a user to select a game genre, character type, and story elements.

[0845] "Terminal means" refers to a device or system for transmitting data entered by a user.

[0846] "Formatting means" refers to a process or device for converting transmitted data into a format such as JSON or XML and transmitting it to the server.

[0847] "Server means" refers to a computer system responsible for retrieving appropriate templates and resources from a database based on the transmitted data.

[0848] "AI generation means" refers to an artificial intelligence system that automatically generates stories, characters, and maps based on acquired information.

[0849] "Game construction means" refers to a process or system for integrating generated data to construct an executable game file.

[0850] "Creative mode means" refers to means for providing an interface for the user to manually modify generated game data.

[0851] "Preview facility" refers to a feature that provides a real-time display as the user makes modifications.

[0852] "Storage and sharing method" refers to the process or system for storing the final data and generating a URL or code for sharing.

[0853] "Means for accessing other users" refers to the function that allows other users to access the game using a shared URL or code.

[0854] The present invention provides a system that allows a user to easily create a game and share it with other users. The system includes the following means.

[0855] First, the user logs into the system using an interface, which is provided through a terminal such as a web browser. Once logged in, the dashboard is displayed and the user selects the "Create a Game" option.

[0856] If the user selects the game creation option, they are presented with a screen where they can select the genre (e.g., fantasy, action, adventure, etc.), the character type (e.g., humanoid, robotic, quadrupedal, etc.), and basic story elements. The user selects these options and proceeds to the next step.

[0857] Next, the terminal receives the user's input and formats it into JSON format etc. For example, if you select a fantasy RPG, it will generate the following JSON data:

[0858] json

[0859] {

[0860] "genre": "fantasy",

[0861] "characters": ["humanoid", "mechanical"],

[0862] "story": "An adventure exploring the cave where the evil dragon lives"

[0863] }

[0864] The formatted data is sent to the server, which then retrieves the appropriate templates and resources from its database based on the received data. These templates and resources include story scripts, character designs, terrain models, and other elements appropriate for the genre.

[0865] The server then launches an AI generation method based on the acquired templates and resources. For example, GPT-3 or DALL-E are used as generative AI models. This automatically generates detailed stories, characters, maps, etc. based on elements selected by the user. As a specific example, in the case of a fantasy RPG, the following may be generated: Story: A cave inhabited by an evil dragon; Characters: Brave warriors and wizards; Maps: A cave and a wizard's tower.

[0866] The generated elements are then integrated by a game builder. The server integrates these elements and builds an executable game file. This game data is saved in JSON or XML format and passed to a game engine such as Unity or Unreal Engine.

[0867] Users can manually modify the generated game data using the Creative Mode interface, which provides tools for changing character appearances, adjusting map layouts, and modifying dialogue, and includes a real-time preview feature that allows users to instantly see their changes.

[0868] Once the game has been modified, the final data is sent to the server via the save and share method. The server receives this final data and uploads it to the sharing server. A sharing URL or code is generated and notified to the user.

[0869] Other users can access the game using this shared URL or code. The server receives the user's request and sends the game data back to the device. The other users can then use the received data to run the game on their own devices and enjoy playing it.

[0870] For example, the user enters the following prompt text:

[0871] "I want to create an action game. The main story will be about police robots who crack down on crime in a futuristic city, and I'd like the characters to be both mechanical and humanoid."

[0872] Based on these prompts, a generative AI model generates futuristic cities, criminals, police robots, etc. Users can adjust these elements to create their own original games, which can then be easily shared with other users.

[0873] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0874] Step 1:

[0875] A user opens the system interface and enters their login information. The server receives the information and authenticates the user. If the user authentication is successful, the server displays the dashboard. The input is the username and password, and the output is the dashboard screen after successful login.

[0876] Step 2:

[0877] The user selects the "Create a Game" option from the dashboard. The server displays the game creation screen and presents a form to input genre, character type, and basic story elements. The inputs are genre, character type, and story elements, and the output is a button to proceed to the next input step.

[0878] Step 3:

[0879] The user selects the genre, character type, and story elements, and clicks the Next button. The device formats this input data into JSON format and sends it to the server. The input is the user's selection, and the output is JSON format data. For example,

[0880] json

[0881] {

[0882] "genre": "fantasy",

[0883] "characters": ["humanoid", "mechanical"],

[0884] "story": "An adventure exploring the cave where the evil dragon lives"

[0885] }

[0886] Step 4:

[0887] The server parses the received JSON data and retrieves the corresponding templates and resources from the database. The server executes queries against the database to retrieve story scripts, character designs, terrain models, etc. appropriate for the genre. The input is JSON data, and the output is a list of retrieved templates and resources.

[0888] Step 5:

[0889] The server launches an AI generator based on the acquired templates and resources. The generative AI model (e.g., GPT-3, DALL-E) generates detailed stories, characters, and maps based on the given information. For example, in a fantasy RPG, a cave inhabited by an evil dragon might be generated as a story element. The input is the template or resource, and the output is detailed game elements.

[0890] Step 6:

[0891] The server aggregates the generated elements and constructs game data. This data is saved in JSON or XML format and passed to a game engine such as Unity or Unreal Engine. The game engine uses this data to create an executable game file. The input is the generated story, characters, and maps, and the output is an executable game file.

[0892] Step 7:

[0893] Users open Creative Mode and manually modify the generated game data. The interface provides tools for adjusting character appearance, stage maps, and dialogue. Furthermore, a real-time preview function allows users to instantly see the results of their changes. The input is the user's modifications, and the output is the modified game data.

[0894] Step 8:

[0895] When the user completes the edits and presses the save button, the device sends the final data to the server. The server receives the final data and uploads it to the storage and sharing server. The server generates a sharing URL and code and notifies the user of this information. The input is the edited game data, and the output is the sharing URL and code.

[0896] Step 9:

[0897] Other users access the game using a sharing URL or code. The server receives the access request and returns the game data in an appropriate format to the other user's device. The other user can then receive the data and run the game on their own device. The input is the sharing URL or code, and the output is the game data.

[0898] For example, the user enters the following prompt text:

[0899] "I want to create an action game. The main story will be about police robots who crack down on crime in a futuristic city, and I'd like the characters to be both mechanical and humanoid."

[0900] The generative AI model generates futuristic cities, police robots, and criminal characters, and users can adjust these elements to create original games that can then be easily shared with other users.

[0901] (Application example 1)

[0902] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0903] Conventional virtual stores have the problem that users need a lot of expertise and time to customize product displays. Furthermore, there are limited means to create interactive experiences that can be easily shared with other users, limiting the user experience. This makes it difficult for users to intuitively and quickly customize and share virtual experiences with others.

[0904] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0905] In this invention, the server includes input means for a user to select a product display type and scenario elements, terminal means for transmitting the input data, server means for retrieving appropriate templates and resources from a database based on the transmitted data, AI generation means for generating an exhibition scenario, virtual characters, and backgrounds based on the retrieved information, experience construction means for constructing a virtual experience based on the generated data, creative mode means for a user to manually modify the constructed experience data, storage and sharing means for saving the final data and generating a sharing URL or code, and other user access means for other users to access the virtual experience using the sharing URL or code. This enables users to intuitively customize a virtual experience without requiring specialized knowledge and quickly share it with other users.

[0906] "Input means" refers to an interface that allows the user to input options.

[0907] "Terminal means" refers to electronic equipment for transmitting input data.

[0908] The "server means" is a device for obtaining appropriate templates and resources from a database based on the transmitted data.

[0909] The "AI generation means" is an artificial intelligence system that automatically generates exhibition scenarios, virtual characters, and backgrounds based on acquired information.

[0910] "Experience construction means" is a function for constructing a virtual experience based on the generated data.

[0911] "Creative mode means" is a feature that allows users to manually modify the constructed experience data.

[0912] "Storage and sharing means" is a function for saving the final data and generating a URL or code for sharing.

[0913] "Access for Other Users" refers to the ability for other users to access a virtual experience using a shared URL or code.

[0914] This invention provides a system that allows users to customize product displays in a virtual store, automatically generate interactive experiences, and easily share them with other users. The system includes input means, terminal means, server means, AI generation means, experience construction means, creative mode means, storage and sharing means, and other user access means.

[0915] First, the user logs into the virtual store using a device such as a smartphone or head-mounted display. The user inputs the desired settings using an input means to select the type of product display and scenario elements. For example, the user selects a specific product (clothing, home appliances, furniture, etc.) and then selects the virtual display scenario for that product (e.g., fashion show, demonstration).

[0916] Next, the terminal means transmits the input data in JSON format to the server means, which receives the data and retrieves appropriate templates and resources (such as 3D product models, scenario scripts, and background models) from a database.

[0917] The server then automatically generates an exhibition scenario, virtual characters, and backgrounds based on the acquired information using AI generation means. For example, if the user selects a fashion show, a scenario is generated in which models wearing the selected clothes perform a virtual fashion show.

[0918] The server then uses an experience builder to build a virtual experience based on the generated data, which is then passed to a game engine such as Unity or Unreal Engine to create a virtual experience file that is used to run the experience.

[0919] Users can manually edit the created experience data in creative mode, for example, adjusting the model's appearance, exhibit content, and background layout. A real-time preview function is also provided during this process, so changes can be seen immediately.

[0920] The final experience data is sent to the server via the storage and sharing means, and a sharing URL or code is generated. Other users can then access the experience using the sharing URL or code. Other users can receive the experience data from the server and run it on their own devices.

[0921] Examples of specific prompts include:

[0922] "A user has selected a new smartphone. Generate a virtual demonstration scenario in which a product reviewer demonstrates the new features. The generated scenario should include a reviewer character, product feature descriptions, or interactive demonstrations."

[0923] The system allows users to intuitively customize virtual experiences without requiring specialized knowledge and quickly share them with others.

[0924] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0925] Step 1:

[0926] Users log in to the virtual store using a device such as a smartphone or head-mounted display.

[0927] Input: User ID, Password

[0928] Output: User information, viewable product list

[0929] Specifically, the user inputs login information using the input means, and the terminal transmits the information to the server.

[0930] Step 2:

[0931] The user selects the type of product display and scenario elements using the input means.

[0932] Input: Product selection, display type, scenario elements

[0933] Output: Selection data (JSON format)

[0934] Specifically, the user inputs the desired products and display settings, which are then compiled as data by the terminal.

[0935] Step 3:

[0936] The terminal transmits the input data to the server.

[0937] Input: Selection data (JSON format)

[0938] Output: Server received data

[0939] Specifically, the terminal formats the selected data in JSON format and sends it to the server.

[0940] Step 4:

[0941] The server retrieves the appropriate template or resource from the database.

[0942] Input: Received data

[0943] Output: Templates, 3D models, scenario scripts

[0944] Specifically, the server analyzes the received data and searches for and acquires the corresponding resource from the database.

[0945] Step 5:

[0946] The server generates an exhibition scenario, virtual characters, and backgrounds based on the acquired data using AI generation means.

[0947] Input: Template, 3D model, scenario script

[0948] Output: Generated data (exhibition scenario, characters, background)

[0949] Specifically, the server launches an AI generation model and automatically generates a virtual exhibit based on the input data.

[0950] Step 6:

[0951] The server uses the experience construction means to construct a virtual experience based on the generated data.

[0952] Input: Generated data

[0953] Output: Executable virtual experience file

[0954] Specifically, the server passes the generated data to a game engine such as Unity or Unreal Engine to build a runnable virtual experience.

[0955] Step 7:

[0956] The user manually modifies the experience data using creative mode means.

[0957] Input: Executable virtual experience file

[0958] Output: Modified virtual experience file

[0959] Specifically, the user makes modifications through the interface, which are previewed in real time.

[0960] Step 8:

[0961] The server stores the final data and generates a URL or code for sharing.

[0962] Input: Modified virtual experience file

[0963] Output: Share URL, code

[0964] The specific operation is that the server saves the final data in a database and generates a URL or code for sharing.

[0965] Step 9:

[0966] Other users access the virtual experience using a shareable URL or code.

[0967] Input: Share URL, code

[0968] Output: Virtual experience data

[0969] Specifically, other users access the server using a shared URL or code and receive the experience data on their devices.

[0970] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0971] The present invention provides a system that enables users to automatically generate games based on their emotions and share them with other users. The system includes an input means for users to create their favorite games, a terminal means for transmitting and processing data, a server means for acquiring and processing templates and resources, an AI generation means, a game construction means for integrating game data, a creative mode means for users to make modifications, a saving and sharing means for saving and sharing the completed game, a other user access means for other users to access the game, and an emotion recognition engine for recognizing user emotions.

[0972] User Input Phase

[0973] Users first log in using the system's interface and select game creation options, including genre (e.g., fantasy, action, adventure, etc.), character type (e.g., humanoid, robotic, quadrupedal, etc.), and basic story elements.

[0974] Emotion Recognition Phase

[0975] The device collects and analyzes emotional data from the user's facial expressions and voice. For example, if the user shows a smile or a surprised expression, the device captures that emotional data.

[0976] Data transmission phase

[0977] The device formats the input data and emotion data into JSON format and sends it to the server. Specifically, it sends the data to the " / generateGame" endpoint using a "POST" request.

[0978] Data Collection Phase

[0979] The server analyzes the received data and retrieves appropriate templates and resources from the database based on genre, character type, story elements, and emotion data. For example, if the user expresses surprise, stories and scenes containing surprise elements will be selected.

[0980] AI generation phase

[0981] The server activates the AI ​​generation method based on the acquired template, user-input data, and emotional data. This generation AI automatically generates a detailed story, character appearances and characteristics, map layout, etc., taking into account the emotional data. For example, a dynamic action scene that reflects a scene in which the user shows surprise is generated.

[0982] Game Construction Phase

[0983] The server aggregates the generated elements and constructs game data in JSON or XML format, which is passed to a game engine (e.g., Unity or Unreal Engine) to create an executable game file.

[0984] Creative Mode Phase

[0985] Users can manually modify the generated game data using the creative mode, changing the character's appearance, adjusting the map layout, modifying dialogue, etc. A real-time preview function is also provided during this process, so modifications can be seen immediately.

[0986] Save Game Phase

[0987] When the user saves the game after completing the modifications, the device sends the final data to the server. The server receives the data and uploads the game data to the sharing server using the saving and sharing method. A sharing URL or code is generated and notified to the user.

[0988] Shared and Other Access Phase

[0989] Other users can access the game using a shared URL or code. The server receives the request and sends the game data back to the other user's device in the appropriate format. The other user can then run and play the game on their device.

[0990] This system allows users to intuitively create games without any programming knowledge, provide emotionally relevant gaming experiences, and easily share them with other users.

[0991] The processing flow will be explained below.

[0992] Step 1:

[0993] The user logs into the platform using a device.

[0994] Step 2:

[0995] Users select the game creation option and input or select the genre, character type, and story elements.

[0996] For example: "Genre: Fantasy", "Character: Human warrior", "Story: Adventure to save the kingdom"

[0997] Step 3:

[0998] The device collects emotional data from the user's facial expressions and voice and analyzes it in real time.

[0999] Specifically, it uses a camera and microphone to capture the user's facial expressions and tone of voice, and then determines their emotions using an emotion recognition algorithm.

[1000] For example, "If they smile, it's recognized as happiness," and "If they frown, it's recognized as surprise."

[1001] Step 4:

[1002] The device formats the input data and emotional data into JSON format or similar and sends it to the server.

[1003] Specifically, you send data to the " / generateGame" endpoint with a "POST" request.

[1004] Step 5:

[1005] The server analyzes the received data and retrieves appropriate templates and resources from a database based on genre, character type, story elements, and emotional data.

[1006] Example: "SELECT FROM templates WHERE genre='Fantasy'"

[1007] Step 6:

[1008] The server activates the AI ​​generation method based on the acquired template, user input data, and emotional data.

[1009] Story generation AI generates detailed stories based on specified elements and emotional data.

[1010] Example: "If the emotion data is surprise, add a sudden enemy attack scene."

[1011] Step 7:

[1012] The server uses a character design AI to generate details (appearance, skills, etc.) for the selected character.

[1013] Example: "Human warriors wear armor and carry swords."

[1014] Step 8:

[1015] The server uses map generation AI to create a map based on the story and emotional data.

[1016] For example: "Kingdom Map, Witch's Forest, Dragon's Lair."

[1017] Step 9:

[1018] The server integrates the generated story, characters, and maps, and constructs game data in JSON and XML formats.

[1019] Step 10:

[1020] The server uses the game engine to generate executable game files based on the constructed data.

[1021] Example: "Create an .exe file using the Unity engine."

[1022] Step 11:

[1023] The server provides the creative mode means and sends the generated game data back to the user's device.

[1024] Step 12:

[1025] Users can manually modify character appearance, map layout, dialogue, and more in creative mode.

[1026] Example: "Change the character's armor color from blue to red."

[1027] Step 13:

[1028] Once the user has finished making their modifications, they have the option to save the game.

[1029] Step 14:

[1030] The device sends the final data to the server.

[1031] Specifically, it involves sending data to the " / saveGame" endpoint with a "POST" request.

[1032] Step 15:

[1033] The server uploads the saved game data to a sharing server and generates a sharing URL or code and notifies the user.

[1034] Step 16:

[1035] Other users can access the game using a shared URL or code.

[1036] Step 17:

[1037] The server receives the request and sends the game data back to the other user's device in the appropriate format.

[1038] Step 18:

[1039] Other users receive the game data and run the game on their own devices to play.

[1040] Example 2

[1041] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1042] Conventional game creation systems make it difficult for users to create games based on emotions and share them with other users. It is also difficult to analyze emotional data and incorporate it into game content, leaving a lack of ways to enrich the user experience. Furthermore, there is no mechanism to provide a real-time preview when manually editing generated game data, making it cumbersome for users to adjust the data.

[1043] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1044] In this invention, the server includes emotion recognition means that analyzes the user's facial expressions and voice and extracts emotion data, terminal means for transmitting the input data and emotion data, and server means for retrieving appropriate templates and resources from a database based on the transmitted data and emotion data. This allows for automatic generation of a game that reflects the user's emotions and provides a real-time preview function, making it easier for users to intuitively adjust the content of the game and to easily share it with other users.

[1045] "User" means an entity that uses the system to create and modify games and share them with other users.

[1046] "Input means" refers to the means by which a user selects a game genre, character type, or story element.

[1047] "Emotion recognition means" is a means for analyzing a user's facial expressions and voice and extracting emotional data.

[1048] The "terminal means" is a means for transmitting input data and emotion data to the server.

[1049] The "server means" is a means for obtaining appropriate templates and resources from a database based on the transmitted data and emotion data.

[1050] "AI generation means" refers to a means for generating stories, characters, and maps based on acquired information.

[1051] "Game construction means" refers to means for constructing game data based on the generated data.

[1052] "Creative mode means" refers to means by which the user can manually modify the constructed game data.

[1053] "Storage and sharing means" refers to the means for storing the final data and generating a URL or code for sharing.

[1054] "Means for other users to access the game" refers to the means by which other users can access the game using a shared URL or code.

[1055] "Management means" refers to a means for managing the generated stories, characters, and maps all at once.

[1056] A "preview means" is a means for providing a real-time preview function when a user manually makes corrections.

[1057] This invention aims to provide a system that allows users to automatically generate games based on their emotions and share them with other users. Below, we will explain how the invention can be specifically implemented using various hardware and software.

[1058] First, a user accesses the system through a terminal, which can be a general-purpose computing device such as a computer, smartphone, or tablet. The terminal has an interface for accepting user input. Through the interface, the user selects the game genre (e.g., fantasy, action), character type (e.g., humanoid, robotic), and story element (e.g., the beginning of the adventure).

[1059] The device's camera and microphone are used to recognize emotions. The camera and microphone capture the user's facial expressions and voice, and the emotional data is analyzed by a dedicated emotion recognition engine (e.g., Google Cloud Vision API, Microsoft Azure Emotion API). For example, if the user smiles, the emotion recognition engine extracts the facial expression data as a "smile."

[1060] The device converts this input data and emotion data into a JSON file and sends a POST request to the server. For example, the data is sent to an endpoint called " / generateGame." The server receives the request using web server software such as Apache or Nginx.

[1061] The server then retrieves the appropriate templates and resources from a database (e.g., MySQL, MongoDB). The database contains resources for various genres, character types, story elements, and emotional data. For example, if the user smiles, content that reflects that emotion will be selected.

[1062] The server passes the acquired template, input data, and emotion data to an AI generation engine (e.g., OpenAI GPT, Google BERT), which automatically generates a detailed story, character appearances and characteristics, map layout, etc. For example, a comical scene is generated to reflect a "smile."

[1063] The server then combines the generated elements and constructs game data in JSON or XML format, which is passed to a game engine such as Unity or Unreal Engine to create an executable game file.

[1064] Users can manually modify the generated game data using Creative Mode, which allows them to change the character's appearance, adjust the map layout, and edit dialogue on the interface. The changes made by the user are previewed in real time, allowing them to see how they will be reflected in the game immediately.

[1065] Finally, when the user completes the modifications and saves the game, the device sends the final data to the server. The server receives this data and uploads the game data to the sharing server using the storage and sharing method. A sharing URL and access code are generated and notified to the user.

[1066] Other users can access the game using a shared URL or access code. The server receives the request and sends the game data back to the other user's device in the appropriate format. The other user can then receive the data, run the game on their device, and play.

[1067] Specific examples

[1068] Here is an example prompt:

[1069] A user wants to create a game in the fantasy genre. He logs into the system, selects a humanoid as his preferred character type, and smiles. He wants to auto-generate and share a game that includes story elements that reflect his smile.

[1070] This system allows users to intuitively create games without any programming knowledge, provide rich, emotionally-driven gaming experiences, and easily share them with other users.

[1071] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1072] Step 1: The user logs in to the system through the interface and selects the game creation option. The user inputs the genre, character type, and story elements. The input data obtained are "Fantasy," "Humanoid," and "The Beginning of the Adventure." This input data is collected by the terminal.

[1073] Step 2: The device uses the camera and microphone to capture the user's facial expressions and voice. The emotion recognition engine analyzes this data and extracts the emotional data "smile." The input is the user's facial expressions and voice, and the output is the analyzed emotional data.

[1074] Step 3: The device formats the input data (genre, character type, story elements) and emotion data in JSON format and sends it to the server. The data to be sent is passed to the endpoint " / generateGame" via a "POST" request. The input is the formatted JSON data, and the output is the data received by the server.

[1075] Step 4: The server parses the received JSON data and retrieves appropriate templates and resources from the database based on the genre, character type, story element, and emotion data. For example, a comical story template corresponding to the emotion data "smile" is selected. The input is JSON data, and the output is the retrieved templates and resources.

[1076] Step 5: The server passes the template, user input data, and emotion data to the AI ​​generation engine to generate a detailed story, characters, and map. Using the generative AI model, game elements that reflect the user's emotions are generated. For example, a story containing scenes that reflect a "smile" is output. The input is the template and data, and the output is the generated game elements.

[1077] Step 6: The server integrates the generated elements and constructs game data in JSON or XML format, which is then passed to the game engine (e.g. Unity) to create an executable game file. The input is the generated game elements, and the output is the executable game file.

[1078] Step 7: The user uses Creative Mode to manually modify the generated game data. For example, they can change the character's appearance, map layout, or dialogue in the interface. The modified data is previewed in real time, allowing the user to see the changes immediately. The input is the generated game data, and the output is the modified game data.

[1079] Step 8: When the user completes the modifications and saves the game, the device sends the final data to the server. The server receives this data and uploads the game data to the sharing server using the storage and sharing method. A sharing URL and access code are generated and notified to the user. The input is the modified game data, and the output is the sharing URL and access code.

[1080] Step 9: Other users access the game using the shared URL or access code. The server receives the request and sends the game data back to the other users' devices. The devices then run the game, making it available for other users to play. The input is the access request, and the output is the returned game data.

[1081] (Application example 2)

[1082] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1083] Conventional game generation systems could only provide static content, unable to respond to changes in a user's emotions. This made it difficult to satisfy users' real-time needs for excitement and relief, and they were unable to provide a dynamic gaming experience tailored to individual emotions. Furthermore, sharing and accessing content with other users was a time-consuming process, hindering the smooth distribution of content.

[1084] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1085] In this invention, the server includes emotion recognition means for generating a game in real time according to the user's emotional changes, server means for acquiring appropriate templates and resources from a database, and game construction means for constructing game data using AI generation means based on the acquired information, thereby making it possible to provide a dynamic game experience that responds immediately to the user's emotions.

[1086] "Input means" refers to the means by which a user selects a game genre, character type, or story element.

[1087] "Terminal means" refers to a device or apparatus for transmitting input data.

[1088] "Emotion recognition means" refers to means for collecting and analyzing user emotion data.

[1089] The "server means" is a means for obtaining appropriate templates and resources from a database based on the transmitted data.

[1090] "AI generation means" refers to the artificial intelligence means that generates stories, characters, and maps based on acquired information.

[1091] "Game construction means" refers to means for creating game data based on the generated data.

[1092] "Creative mode means" refers to means by which the user can manually modify the constructed game data.

[1093] "Storage and sharing means" refers to the means for storing the final data and generating a URL or code for sharing.

[1094] "Means for other users to access the game" refers to the means by which other users can access the game using a shared URL or code.

[1095] The "game generation means" is a means for generating a game whose content changes in real time according to the user's emotions.

[1096] The "management means" is a means for collectively managing the generated stories, characters, and maps, and dynamically adjusting them according to emotion recognition data.

[1097] The "preview means" is a means for providing a real-time preview function when the user manually makes corrections and for adjusting the preview according to changes in the user's emotions.

[1098] The present invention relates to a system for automatically generating games based on a user's emotions and sharing them with other users. This system includes an input unit, a terminal unit, an emotion recognition unit, a server unit, an AI generation unit, a game construction unit, a creative mode unit, a storage and sharing unit, a unit for accessing other users, and a game generation unit.

[1099] Hardware and software used

[1100] The devices used are smartphones, smart glasses, and head-mounted displays. The emotion recognition system uses the Microsoft Azure Emotion API. The server uses Node.js and Express. The game is built using the Unity game engine.

[1101] Program processing overview

[1102] Operation of the system begins when the user selects the genre, character type, and story elements using the input means. The terminal means collects the input data and the user's emotional data obtained by the emotion recognition means, and sends them to the server. Based on this data, the server retrieves the necessary templates and resources from the database, and automatically generates the game's story, characters, and maps using the AI ​​generation means.

[1103] After each element is generated, the entire game is constructed by the game construction means, and the user can make individual modifications using the creative mode means. For example, it is possible to change the character's appearance or the map layout. Once modifications are complete, the game data is resent to the server by the save and share means, and a sharing URL or code is generated. Other users can access the created game using these URLs or codes.

[1104] Specific examples

[1105] For example, if a user desires a relaxing game and the emotion recognition means detects that the user's emotional state is stressed, the server will select a relaxing landscape stroll game as a template and use the AI ​​generation means to generate a game that integrates resources such as beautiful scenic panoramas and calming music. The generated game can then be further adjusted manually by the user and then provided to other users via a sharing URL.

[1106] Prompt Sentence Examples

[1107] "If you sense that the user is relaxed, create a game scene to amplify that feeling of relaxation."

[1108] "If you detect that the user is excited, generate an action-packed episode."

[1109] This system allows users to enjoy a dynamic gaming experience that responds to their emotions in real time, and makes it easy to share their creations with other users.

[1110] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1111] Step 1:

[1112] A user selects a game genre, character type, and story elements using a device such as a smartphone or smart glasses. As input, the user's selection data is generated. The device receives this selection data as input and generates initial data.

[1113] Step 2:

[1114] The device uses a camera and microphone to capture the user's facial expressions and voice, and collects the user's emotional data through emotion recognition. The collected emotional data is analyzed using the Microsoft Azure Emotion API. Through this process, the input data is output as information about the user's emotional state.

[1115] Step 3:

[1116] The device formats the selection data and emotion data in JSON format and sends it to the server. Specifically, it sends the data using a "POST" request. Through this process, the input data is output as received data on the server.

[1117] Step 4:

[1118] The server analyzes the received data and retrieves appropriate templates and resources from a database based on the genre, character type, story elements, and emotion data. The server then selects appropriate game elements and outputs template data.

[1119] Step 5:

[1120] The server activates the AI ​​generation means based on the template, user selection data, and emotion data. The AI ​​generation means automatically generates detailed storylines, character appearances, characteristics, map layouts, etc., taking into account the emotion data. This process outputs the generated game data.

[1121] Step 6:

[1122] The server integrates the generated elements to build game data. This is done using a game engine such as Unity. Specifically, it combines template data and resource data to generate an executable game file. The completed game data is obtained as output.

[1123] Step 7:

[1124] The user manually modifies the constructed game data using the creative mode means. The user can adjust the character appearance and map layout through the interface and preview the changes in real time. At this step, the user's manually modified data is output.

[1125] Step 8:

[1126] Once the user has completed the modifications, the device sends the final game data to the server. The game data is uploaded to the sharing server through the storage and sharing means, and a sharing URL or code is generated. This outputs the sharing URL or code.

[1127] Step 9:

[1128] Other users access the game using a shared URL or code. The server receives the request and sends the game data back to the other users' devices. The other users can then run the data on their own devices and play the game. The output is gameplay data.

[1129] This series of processes allows the user to enjoy a dynamic gaming experience that responds to their emotions.

[1130] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1131] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1132] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1133] [Fourth embodiment]

[1134] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1135] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1136] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1137] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1138] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1139] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1140] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1141] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1142] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1143] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1144] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1145] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1146] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1147] The present invention provides a system that automatically generates games and allows users to easily create games. This system includes input means for users to create their favorite games, terminal means for transmitting and processing data, server means for acquiring and processing templates and resources, AI generation means that is an automatic generation engine, game construction means for integrating game data, creative mode means for users to make modifications, saving and sharing means for saving and sharing completed games, and other user access means for other users to access the game.

[1148] User Input Phase

[1149] Users first log in using the system's interface and select game creation options, including genre (e.g., fantasy, action, adventure, etc.), character type (e.g., humanoid, robotic, quadrupedal, etc.), and basic story elements.

[1150] Data transmission phase

[1151] The device sends the input data from the user, specifically the selected genre, character type, and story elements, formatted as JSON data, and sent it to the server.

[1152] Data Collection Phase

[1153] The server receives the data and retrieves the appropriate templates and resources from a database, selecting story scripts, character designs, terrain models, and other elements appropriate for the genre.

[1154] AI generation phase

[1155] Based on the acquired templates and resources, the server launches an AI generator. This AI automatically generates a detailed story, character appearances and characteristics, map layout, etc. based on the given elements. For example, if you select a fantasy RPG, it will generate a cave inhabited by an evil dragon, a wizard's tower, etc.

[1156] Game Construction Phase

[1157] The server aggregates the generated elements and constructs the game data, which is then aggregated in JSON or XML format and passed to a game engine (e.g., Unity or Unreal Engine) to create an executable game file.

[1158] Creative Mode Phase

[1159] Users can manually modify the generated game data using the creative mode, changing the character's appearance, adjusting the map layout, modifying dialogue, etc. A real-time preview function is also provided during this process, so modifications can be seen immediately.

[1160] Save Game Phase

[1161] When the user saves the game after completing the modifications, the device sends the final data to the server. The server receives the data and uploads the game data to the sharing server using the saving and sharing method. A sharing URL or code is generated and notified to the user.

[1162] Shared and Other Access Phase

[1163] Other users can access the game using a shared URL or code. The server receives the request and sends the game data back to the other user's device in the appropriate format. The other user can then run and play the game on their device.

[1164] This system allows users to intuitively create games without any programming knowledge and easily share them with other users.

[1165] The processing flow will be explained below.

[1166] Step 1:

[1167] The user logs into the platform using a device.

[1168] Step 2:

[1169] Users select the game creation option and input or select the genre, character type, and story elements.

[1170] For example: "Genre: Fantasy", "Character: Human warrior", "Story: Adventure to save the kingdom"

[1171] Step 3:

[1172] The terminal formats the input data into JSON format or similar and sends it to the server.

[1173] Specifically, you send data to the " / generateGame" endpoint with a "POST" request.

[1174] Step 4:

[1175] The server parses the data it receives and retrieves appropriate templates and resources from a database based on genre, character type, and story elements.

[1176] Example: "SELECT FROM templates WHERE genre='Fantasy'"

[1177] Step 5:

[1178] The server then launches the AI ​​generation process based on the acquired template and user-entered data.

[1179] The story generation AI generates detailed stories based on specified elements.

[1180] Example: "An adventure to defeat an evil dragon"

[1181] Step 6:

[1182] The server uses a character design AI to generate details (appearance, skills, etc.) for the selected character.

[1183] Example: "Human warriors wear armor and carry swords."

[1184] Step 7:

[1185] The server uses map generation AI to create maps based on the story.

[1186] For example: "Kingdom Map, Witch's Forest, Dragon's Lair."

[1187] Step 8:

[1188] The server integrates the generated story, characters, and maps, and constructs game data in JSON and XML formats.

[1189] Step 9:

[1190] The server uses the game engine to generate executable game files based on the constructed data.

[1191] Example: "Create an .exe file using the Unity engine."

[1192] Step 10:

[1193] The server provides the creative mode means and sends the generated game data back to the user's device.

[1194] Step 11:

[1195] Users can manually modify character appearance, map layout, dialogue, and more in creative mode.

[1196] Step 12:

[1197] Once the user has finished making their modifications, they have the option to save the game.

[1198] Step 13:

[1199] The device sends the final data to the server.

[1200] Specifically, it involves sending data to the " / saveGame" endpoint with a "POST" request.

[1201] Step 14:

[1202] The server uploads the saved game data to a sharing server and generates a sharing URL or code and notifies the user.

[1203] Step 15:

[1204] Other users can access the game using a shared URL or code.

[1205] Step 16:

[1206] The server receives the request and sends the game data back to the other user's device in the appropriate format.

[1207] Step 17:

[1208] Other users receive the game data and run the game on their own devices to play.

[1209] Example 1

[1210] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1211] Current game creation systems often require specialized programming knowledge, making it difficult for average users to easily create games. Furthermore, existing systems require detailed settings for story and characters to be created manually, which is time-consuming. Furthermore, sharing and accessing games with other users requires complicated procedures, making it difficult to efficiently create and share games.

[1212] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1213] In this invention, the server includes input means for a user to select a game genre, character type, and story elements, terminal means for transmitting the input data, formatting means for formatting the transmitted data and transmitting it to the server, server means for retrieving appropriate templates and resources from a database based on the transmitted data, AI generation means for generating a story, characters, and maps based on the retrieved information, game construction means for integrating the generated data and constructing an executable game file, creative mode means for a user to manually modify the constructed game data, preview means for providing a real-time preview function, save and share means for saving the final data and generating a sharing URL and code, and other user access means for other users to access the game using the sharing URL and code. This enables users to intuitively create games without any programming knowledge and easily share them with other users.

[1214] "User" refers to a person who uses the system to create and operate a game.

[1215] "Input means" refers to a means that provides an interface for a user to select a game genre, character type, and story elements.

[1216] "Terminal means" refers to a device or system for transmitting data entered by a user.

[1217] "Formatting means" refers to a process or device for converting transmitted data into a format such as JSON or XML and transmitting it to the server.

[1218] "Server means" refers to a computer system responsible for retrieving appropriate templates and resources from a database based on the transmitted data.

[1219] "AI generation means" refers to an artificial intelligence system that automatically generates stories, characters, and maps based on acquired information.

[1220] "Game construction means" refers to a process or system for integrating generated data to construct an executable game file.

[1221] "Creative mode means" refers to means for providing an interface for the user to manually modify generated game data.

[1222] "Preview facility" refers to a feature that provides a real-time display as the user makes modifications.

[1223] "Storage and sharing method" refers to the process or system for storing the final data and generating a URL or code for sharing.

[1224] "Means for accessing other users" refers to the function that allows other users to access the game using a shared URL or code.

[1225] The present invention provides a system that allows a user to easily create a game and share it with other users. The system includes the following means.

[1226] First, the user logs into the system using an interface, which is provided through a terminal such as a web browser. Once logged in, the dashboard is displayed and the user selects the "Create a Game" option.

[1227] If the user selects the game creation option, they are presented with a screen where they can select the genre (e.g., fantasy, action, adventure, etc.), the character type (e.g., humanoid, robotic, quadrupedal, etc.), and basic story elements. The user selects these options and proceeds to the next step.

[1228] Next, the terminal receives the user's input and formats it into JSON format etc. For example, if you select a fantasy RPG, it will generate the following JSON data:

[1229] json

[1230] {

[1231] "genre": "fantasy",

[1232] "characters": ["humanoid", "mechanical"],

[1233] "story": "An adventure exploring the cave where the evil dragon lives"

[1234] }

[1235] The formatted data is sent to the server, which then retrieves the appropriate templates and resources from its database based on the received data. These templates and resources include story scripts, character designs, terrain models, and other elements appropriate for the genre.

[1236] The server then launches an AI generation method based on the acquired templates and resources. For example, GPT-3 or DALL-E are used as generative AI models. This automatically generates detailed stories, characters, maps, etc. based on elements selected by the user. As a specific example, in the case of a fantasy RPG, the following may be generated: Story: A cave inhabited by an evil dragon; Characters: Brave warriors and wizards; Maps: A cave and a wizard's tower.

[1237] The generated elements are then integrated by a game builder. The server integrates these elements and builds an executable game file. This game data is saved in JSON or XML format and passed to a game engine such as Unity or Unreal Engine.

[1238] Users can manually modify the generated game data using the Creative Mode interface, which provides tools for changing character appearances, adjusting map layouts, and modifying dialogue, and includes a real-time preview feature that allows users to instantly see their changes.

[1239] Once the game has been modified, the final data is sent to the server via the save and share method. The server receives this final data and uploads it to the sharing server. A sharing URL or code is generated and notified to the user.

[1240] Other users can access the game using this shared URL or code. The server receives the user's request and sends the game data back to the device. The other users can then use the received data to run the game on their own devices and enjoy playing it.

[1241] For example, the user enters the following prompt text:

[1242] "I want to create an action game. The main story will be about police robots who crack down on crime in a futuristic city, and I'd like the characters to be both mechanical and humanoid."

[1243] Based on these prompts, a generative AI model generates futuristic cities, criminals, police robots, etc. Users can adjust these elements to create their own original games, which can then be easily shared with other users.

[1244] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1245] Step 1:

[1246] A user opens the system interface and enters their login information. The server receives the information and authenticates the user. If the user authentication is successful, the server displays the dashboard. The input is the username and password, and the output is the dashboard screen after successful login.

[1247] Step 2:

[1248] The user selects the "Create a Game" option from the dashboard. The server displays the game creation screen and presents a form to input genre, character type, and basic story elements. The inputs are genre, character type, and story elements, and the output is a button to proceed to the next input step.

[1249] Step 3:

[1250] The user selects the genre, character type, and story elements, and clicks the Next button. The device formats this input data into JSON format and sends it to the server. The input is the user's selection, and the output is JSON format data. For example,

[1251] json

[1252] {

[1253] "genre": "fantasy",

[1254] "characters": ["humanoid", "mechanical"],

[1255] "story": "An adventure exploring the cave where the evil dragon lives"

[1256] }

[1257] Step 4:

[1258] The server parses the received JSON data and retrieves the corresponding templates and resources from the database. The server executes queries against the database to retrieve story scripts, character designs, terrain models, etc. appropriate for the genre. The input is JSON data, and the output is a list of retrieved templates and resources.

[1259] Step 5:

[1260] The server launches an AI generator based on the acquired templates and resources. The generative AI model (e.g., GPT-3, DALL-E) generates detailed stories, characters, and maps based on the given information. For example, in a fantasy RPG, a cave inhabited by an evil dragon might be generated as a story element. The input is the template or resource, and the output is detailed game elements.

[1261] Step 6:

[1262] The server aggregates the generated elements and constructs game data. This data is saved in JSON or XML format and passed to a game engine such as Unity or Unreal Engine. The game engine uses this data to create an executable game file. The input is the generated story, characters, and maps, and the output is an executable game file.

[1263] Step 7:

[1264] Users open Creative Mode and manually modify the generated game data. The interface provides tools for adjusting character appearance, stage maps, and dialogue. Furthermore, a real-time preview function allows users to instantly see the results of their changes. The input is the user's modifications, and the output is the modified game data.

[1265] Step 8:

[1266] When the user completes the edits and presses the save button, the device sends the final data to the server. The server receives the final data and uploads it to the storage and sharing server. The server generates a sharing URL and code and notifies the user of this information. The input is the edited game data, and the output is the sharing URL and code.

[1267] Step 9:

[1268] Other users access the game using a sharing URL or code. The server receives the access request and returns the game data in an appropriate format to the other user's device. The other user can then receive the data and run the game on their own device. The input is the sharing URL or code, and the output is the game data.

[1269] For example, the user enters the following prompt text:

[1270] "I want to create an action game. The main story will be about police robots who crack down on crime in a futuristic city, and I'd like the characters to be both mechanical and humanoid."

[1271] The generative AI model generates futuristic cities, police robots, and criminal characters, and users can adjust these elements to create original games that can then be easily shared with other users.

[1272] (Application example 1)

[1273] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1274] Conventional virtual stores have the problem that users need a lot of expertise and time to customize product displays. Furthermore, there are limited means to create interactive experiences that can be easily shared with other users, limiting the user experience. This makes it difficult for users to intuitively and quickly customize and share virtual experiences with others.

[1275] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1276] In this invention, the server includes input means for a user to select a product display type and scenario elements, terminal means for transmitting the input data, server means for retrieving appropriate templates and resources from a database based on the transmitted data, AI generation means for generating an exhibition scenario, virtual characters, and backgrounds based on the retrieved information, experience construction means for constructing a virtual experience based on the generated data, creative mode means for a user to manually modify the constructed experience data, storage and sharing means for saving the final data and generating a sharing URL or code, and other user access means for other users to access the virtual experience using the sharing URL or code. This enables users to intuitively customize a virtual experience without requiring specialized knowledge and quickly share it with other users.

[1277] "Input means" refers to an interface that allows the user to input options.

[1278] "Terminal means" refers to electronic equipment for transmitting input data.

[1279] The "server means" is a device for obtaining appropriate templates and resources from a database based on the transmitted data.

[1280] The "AI generation means" is an artificial intelligence system that automatically generates exhibition scenarios, virtual characters, and backgrounds based on acquired information.

[1281] "Experience construction means" is a function for constructing a virtual experience based on the generated data.

[1282] "Creative mode means" is a feature that allows users to manually modify the constructed experience data.

[1283] "Storage and sharing means" is a function for saving the final data and generating a URL or code for sharing.

[1284] "Access for Other Users" refers to the ability for other users to access a virtual experience using a shared URL or code.

[1285] This invention provides a system that allows users to customize product displays in a virtual store, automatically generate interactive experiences, and easily share them with other users. The system includes input means, terminal means, server means, AI generation means, experience construction means, creative mode means, storage and sharing means, and other user access means.

[1286] First, the user logs into the virtual store using a device such as a smartphone or head-mounted display. The user inputs the desired settings using an input means to select the type of product display and scenario elements. For example, the user selects a specific product (clothing, home appliances, furniture, etc.) and then selects the virtual display scenario for that product (e.g., fashion show, demonstration).

[1287] Next, the terminal means transmits the input data in JSON format to the server means, which receives the data and retrieves appropriate templates and resources (such as 3D product models, scenario scripts, and background models) from a database.

[1288] The server then automatically generates an exhibition scenario, virtual characters, and backgrounds based on the acquired information using AI generation means. For example, if the user selects a fashion show, a scenario is generated in which models wearing the selected clothes perform a virtual fashion show.

[1289] The server then uses an experience builder to build a virtual experience based on the generated data, which is then passed to a game engine such as Unity or Unreal Engine to create a virtual experience file that is used to run the experience.

[1290] Users can manually edit the created experience data in creative mode, for example, adjusting the model's appearance, exhibit content, and background layout. A real-time preview function is also provided during this process, so changes can be seen immediately.

[1291] The final experience data is sent to the server via the storage and sharing means, and a sharing URL or code is generated. Other users can then access the experience using the sharing URL or code. Other users can receive the experience data from the server and run it on their own devices.

[1292] Examples of specific prompts include:

[1293] "A user has selected a new smartphone. Generate a virtual demonstration scenario in which a product reviewer demonstrates the new features. The generated scenario should include a reviewer character, product feature descriptions, or interactive demonstrations."

[1294] The system allows users to intuitively customize virtual experiences without requiring specialized knowledge and quickly share them with others.

[1295] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1296] Step 1:

[1297] Users log in to the virtual store using a device such as a smartphone or head-mounted display.

[1298] Input: User ID, Password

[1299] Output: User information, viewable product list

[1300] Specifically, the user inputs login information using the input means, and the terminal transmits the information to the server.

[1301] Step 2:

[1302] The user selects the type of product display and scenario elements using the input means.

[1303] Input: Product selection, display type, scenario elements

[1304] Output: Selection data (JSON format)

[1305] Specifically, the user inputs the desired products and display settings, which are then compiled as data by the terminal.

[1306] Step 3:

[1307] The terminal transmits the input data to the server.

[1308] Input: Selection data (JSON format)

[1309] Output: Server received data

[1310] Specifically, the terminal formats the selected data in JSON format and sends it to the server.

[1311] Step 4:

[1312] The server retrieves the appropriate template or resource from the database.

[1313] Input: Received data

[1314] Output: Templates, 3D models, scenario scripts

[1315] Specifically, the server analyzes the received data and searches for and acquires the corresponding resource from the database.

[1316] Step 5:

[1317] The server generates an exhibition scenario, virtual characters, and backgrounds based on the acquired data using AI generation means.

[1318] Input: Template, 3D model, scenario script

[1319] Output: Generated data (exhibition scenario, characters, background)

[1320] Specifically, the server launches an AI generation model and automatically generates a virtual exhibit based on the input data.

[1321] Step 6:

[1322] The server uses the experience construction means to construct a virtual experience based on the generated data.

[1323] Input: Generated data

[1324] Output: Executable virtual experience file

[1325] Specifically, the server passes the generated data to a game engine such as Unity or Unreal Engine to build a runnable virtual experience.

[1326] Step 7:

[1327] The user manually modifies the experience data using creative mode means.

[1328] Input: Executable virtual experience file

[1329] Output: Modified virtual experience file

[1330] Specifically, the user makes modifications through the interface, which are previewed in real time.

[1331] Step 8:

[1332] The server stores the final data and generates a URL or code for sharing.

[1333] Input: Modified virtual experience file

[1334] Output: Share URL, code

[1335] The specific operation is that the server saves the final data in a database and generates a URL or code for sharing.

[1336] Step 9:

[1337] Other users access the virtual experience using a shareable URL or code.

[1338] Input: Share URL, code

[1339] Output: Virtual experience data

[1340] Specifically, other users access the server using a shared URL or code and receive the experience data on their devices.

[1341] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1342] The present invention provides a system that enables users to automatically generate games based on their emotions and share them with other users. The system includes an input means for users to create their favorite games, a terminal means for transmitting and processing data, a server means for acquiring and processing templates and resources, an AI generation means, a game construction means for integrating game data, a creative mode means for users to make modifications, a saving and sharing means for saving and sharing the completed game, a other user access means for other users to access the game, and an emotion recognition engine for recognizing user emotions.

[1343] User Input Phase

[1344] Users first log in using the system's interface and select game creation options, including genre (e.g., fantasy, action, adventure, etc.), character type (e.g., humanoid, robotic, quadrupedal, etc.), and basic story elements.

[1345] Emotion Recognition Phase

[1346] The device collects and analyzes emotional data from the user's facial expressions and voice. For example, if the user shows a smile or a surprised expression, the device captures that emotional data.

[1347] Data transmission phase

[1348] The device formats the input data and emotion data into JSON format and sends it to the server. Specifically, it sends the data to the " / generateGame" endpoint using a "POST" request.

[1349] Data Collection Phase

[1350] The server analyzes the received data and retrieves appropriate templates and resources from the database based on genre, character type, story elements, and emotion data. For example, if the user expresses surprise, stories and scenes containing surprise elements will be selected.

[1351] AI generation phase

[1352] The server activates the AI ​​generation method based on the acquired template, user-input data, and emotional data. This generation AI automatically generates a detailed story, character appearances and characteristics, map layout, etc., taking into account the emotional data. For example, a dynamic action scene that reflects a scene in which the user shows surprise is generated.

[1353] Game Construction Phase

[1354] The server aggregates the generated elements and constructs game data in JSON or XML format, which is passed to a game engine (e.g., Unity or Unreal Engine) to create an executable game file.

[1355] Creative Mode Phase

[1356] Users can manually modify the generated game data using the creative mode, changing the character's appearance, adjusting the map layout, modifying dialogue, etc. A real-time preview function is also provided during this process, so modifications can be seen immediately.

[1357] Save Game Phase

[1358] When the user saves the game after completing the modifications, the device sends the final data to the server. The server receives the data and uploads the game data to the sharing server using the saving and sharing method. A sharing URL or code is generated and notified to the user.

[1359] Shared and Other Access Phase

[1360] Other users can access the game using a shared URL or code. The server receives the request and sends the game data back to the other user's device in the appropriate format. The other user can then run and play the game on their device.

[1361] This system allows users to intuitively create games without any programming knowledge, provide emotionally relevant gaming experiences, and easily share them with other users.

[1362] The processing flow will be explained below.

[1363] Step 1:

[1364] The user logs into the platform using a device.

[1365] Step 2:

[1366] Users select the game creation option and input or select the genre, character type, and story elements.

[1367] For example: "Genre: Fantasy", "Character: Human warrior", "Story: Adventure to save the kingdom"

[1368] Step 3:

[1369] The device collects emotional data from the user's facial expressions and voice and analyzes it in real time.

[1370] Specifically, it uses a camera and microphone to capture the user's facial expressions and tone of voice, and then determines their emotions using an emotion recognition algorithm.

[1371] For example, "If they smile, it's recognized as happiness," and "If they frown, it's recognized as surprise."

[1372] Step 4:

[1373] The device formats the input data and emotional data into JSON format or similar and sends it to the server.

[1374] Specifically, you send data to the " / generateGame" endpoint with a "POST" request.

[1375] Step 5:

[1376] The server analyzes the received data and retrieves appropriate templates and resources from a database based on genre, character type, story elements, and emotional data.

[1377] Example: "SELECT FROM templates WHERE genre='Fantasy'"

[1378] Step 6:

[1379] The server activates the AI ​​generation method based on the acquired template, user input data, and emotional data.

[1380] Story generation AI generates detailed stories based on specified elements and emotional data.

[1381] Example: "If the emotion data is surprise, add a sudden enemy attack scene."

[1382] Step 7:

[1383] The server uses a character design AI to generate details (appearance, skills, etc.) for the selected character.

[1384] Example: "Human warriors wear armor and carry swords."

[1385] Step 8:

[1386] The server uses map generation AI to create a map based on the story and emotional data.

[1387] For example: "Kingdom Map, Witch's Forest, Dragon's Lair."

[1388] Step 9:

[1389] The server integrates the generated story, characters, and maps, and constructs game data in JSON and XML formats.

[1390] Step 10:

[1391] The server uses the game engine to generate executable game files based on the constructed data.

[1392] Example: "Create an .exe file using the Unity engine."

[1393] Step 11:

[1394] The server provides the creative mode means and sends the generated game data back to the user's device.

[1395] Step 12:

[1396] Users can manually modify character appearance, map layout, dialogue, and more in creative mode.

[1397] Example: "Change the character's armor color from blue to red."

[1398] Step 13:

[1399] Once the user has finished making their modifications, they have the option to save the game.

[1400] Step 14:

[1401] The device sends the final data to the server.

[1402] Specifically, it involves sending data to the " / saveGame" endpoint with a "POST" request.

[1403] Step 15:

[1404] The server uploads the saved game data to a sharing server and generates a sharing URL or code and notifies the user.

[1405] Step 16:

[1406] Other users can access the game using a shared URL or code.

[1407] Step 17:

[1408] The server receives the request and sends the game data back to the other user's device in the appropriate format.

[1409] Step 18:

[1410] Other users receive the game data and run the game on their own devices to play.

[1411] Example 2

[1412] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1413] Conventional game creation systems make it difficult for users to create games based on emotions and share them with other users. It is also difficult to analyze emotional data and incorporate it into game content, leaving a lack of ways to enrich the user experience. Furthermore, there is no mechanism to provide a real-time preview when manually editing generated game data, making it cumbersome for users to adjust the data.

[1414] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1415] In this invention, the server includes emotion recognition means that analyzes the user's facial expressions and voice and extracts emotion data, terminal means for transmitting the input data and emotion data, and server means for retrieving appropriate templates and resources from a database based on the transmitted data and emotion data. This allows for automatic generation of a game that reflects the user's emotions and provides a real-time preview function, making it easier for users to intuitively adjust the content of the game and to easily share it with other users.

[1416] "User" means an entity that uses the system to create and modify games and share them with other users.

[1417] "Input means" refers to the means by which a user selects a game genre, character type, or story element.

[1418] "Emotion recognition means" is a means for analyzing a user's facial expressions and voice and extracting emotional data.

[1419] The "terminal means" is a means for transmitting input data and emotion data to the server.

[1420] The "server means" is a means for obtaining appropriate templates and resources from a database based on the transmitted data and emotion data.

[1421] "AI generation means" refers to a means for generating stories, characters, and maps based on acquired information.

[1422] "Game construction means" refers to means for constructing game data based on the generated data.

[1423] "Creative mode means" refers to means by which the user can manually modify the constructed game data.

[1424] "Storage and sharing means" refers to the means for storing the final data and generating a URL or code for sharing.

[1425] "Means for other users to access the game" refers to the means by which other users can access the game using a shared URL or code.

[1426] "Management means" refers to a means for managing the generated stories, characters, and maps all at once.

[1427] A "preview means" is a means for providing a real-time preview function when a user manually makes corrections.

[1428] This invention aims to provide a system that allows users to automatically generate games based on their emotions and share them with other users. Below, we will explain how the invention can be specifically implemented using various hardware and software.

[1429] First, a user accesses the system through a terminal, which can be a general-purpose computing device such as a computer, smartphone, or tablet. The terminal has an interface for accepting user input. Through the interface, the user selects the game genre (e.g., fantasy, action), character type (e.g., humanoid, robotic), and story element (e.g., the beginning of the adventure).

[1430] The device's camera and microphone are used to recognize emotions. The camera and microphone capture the user's facial expressions and voice, and the emotional data is analyzed by a dedicated emotion recognition engine (e.g., Google Cloud Vision API, Microsoft Azure Emotion API). For example, if the user smiles, the emotion recognition engine extracts the facial expression data as a "smile."

[1431] The device converts this input data and emotion data into a JSON file and sends a POST request to the server. For example, the data is sent to an endpoint called " / generateGame." The server receives the request using web server software such as Apache or Nginx.

[1432] The server then retrieves the appropriate templates and resources from a database (e.g., MySQL, MongoDB). The database contains resources for various genres, character types, story elements, and emotional data. For example, if the user smiles, content that reflects that emotion will be selected.

[1433] The server passes the acquired template, input data, and emotion data to an AI generation engine (e.g., OpenAI GPT, Google BERT), which automatically generates a detailed story, character appearances and characteristics, map layout, etc. For example, a comical scene is generated to reflect a "smile."

[1434] The server then combines the generated elements and constructs game data in JSON or XML format, which is passed to a game engine such as Unity or Unreal Engine to create an executable game file.

[1435] Users can manually modify the generated game data using Creative Mode, which allows them to change the character's appearance, adjust the map layout, and edit dialogue on the interface. The changes made by the user are previewed in real time, allowing them to see how they will be reflected in the game immediately.

[1436] Finally, when the user completes the modifications and saves the game, the device sends the final data to the server. The server receives this data and uploads the game data to the sharing server using the storage and sharing method. A sharing URL and access code are generated and notified to the user.

[1437] Other users can access the game using a shared URL or access code. The server receives the request and sends the game data back to the other user's device in the appropriate format. The other user can then receive the data, run the game on their device, and play.

[1438] Specific examples

[1439] Here is an example prompt:

[1440] A user wants to create a game in the fantasy genre. He logs into the system, selects a humanoid as his preferred character type, and smiles. He wants to auto-generate and share a game that includes story elements that reflect his smile.

[1441] This system allows users to intuitively create games without any programming knowledge, provide rich, emotionally-driven gaming experiences, and easily share them with other users.

[1442] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1443] Step 1: The user logs in to the system through the interface and selects the game creation option. The user inputs the genre, character type, and story elements. The input data obtained are "Fantasy," "Humanoid," and "The Beginning of the Adventure." This input data is collected by the terminal.

[1444] Step 2: The device uses the camera and microphone to capture the user's facial expressions and voice. The emotion recognition engine analyzes this data and extracts the emotional data "smile." The input is the user's facial expressions and voice, and the output is the analyzed emotional data.

[1445] Step 3: The device formats the input data (genre, character type, story elements) and emotion data in JSON format and sends it to the server. The data to be sent is passed to the endpoint " / generateGame" via a "POST" request. The input is the formatted JSON data, and the output is the data received by the server.

[1446] Step 4: The server parses the received JSON data and retrieves appropriate templates and resources from the database based on the genre, character type, story element, and emotion data. For example, a comical story template corresponding to the emotion data "smile" is selected. The input is JSON data, and the output is the retrieved templates and resources.

[1447] Step 5: The server passes the template, user input data, and emotion data to the AI ​​generation engine to generate a detailed story, characters, and map. Using the generative AI model, game elements that reflect the user's emotions are generated. For example, a story containing scenes that reflect a "smile" is output. The input is the template and data, and the output is the generated game elements.

[1448] Step 6: The server integrates the generated elements and constructs game data in JSON or XML format, which is then passed to the game engine (e.g. Unity) to create an executable game file. The input is the generated game elements, and the output is the executable game file.

[1449] Step 7: The user uses Creative Mode to manually modify the generated game data. For example, they can change the character's appearance, map layout, or dialogue in the interface. The modified data is previewed in real time, allowing the user to see the changes immediately. The input is the generated game data, and the output is the modified game data.

[1450] Step 8: When the user completes the modifications and saves the game, the device sends the final data to the server. The server receives this data and uploads the game data to the sharing server using the storage and sharing method. A sharing URL and access code are generated and notified to the user. The input is the modified game data, and the output is the sharing URL and access code.

[1451] Step 9: Other users access the game using the shared URL or access code. The server receives the request and sends the game data back to the other users' devices. The devices then run the game, making it available for other users to play. The input is the access request, and the output is the returned game data.

[1452] (Application example 2)

[1453] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1454] Conventional game generation systems could only provide static content, unable to respond to changes in a user's emotions. This made it difficult to satisfy users' real-time needs for excitement and relief, and they were unable to provide a dynamic gaming experience tailored to individual emotions. Furthermore, sharing and accessing content with other users was a time-consuming process, hindering the smooth distribution of content.

[1455] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1456] In this invention, the server includes emotion recognition means for generating a game in real time according to the user's emotional changes, server means for acquiring appropriate templates and resources from a database, and game construction means for constructing game data using AI generation means based on the acquired information, thereby making it possible to provide a dynamic game experience that responds immediately to the user's emotions.

[1457] "Input means" refers to the means by which a user selects a game genre, character type, or story element.

[1458] "Terminal means" refers to a device or apparatus for transmitting input data.

[1459] "Emotion recognition means" refers to means for collecting and analyzing user emotion data.

[1460] The "server means" is a means for obtaining appropriate templates and resources from a database based on the transmitted data.

[1461] "AI generation means" refers to the artificial intelligence means that generates stories, characters, and maps based on acquired information.

[1462] "Game construction means" refers to means for creating game data based on the generated data.

[1463] "Creative mode means" refers to means by which the user can manually modify the constructed game data.

[1464] "Storage and sharing means" refers to the means for storing the final data and generating a URL or code for sharing.

[1465] "Means for other users to access the game" refers to the means by which other users can access the game using a shared URL or code.

[1466] The "game generation means" is a means for generating a game whose content changes in real time according to the user's emotions.

[1467] The "management means" is a means for collectively managing the generated stories, characters, and maps, and dynamically adjusting them according to emotion recognition data.

[1468] The "preview means" is a means for providing a real-time preview function when the user manually makes corrections and for adjusting the preview according to changes in the user's emotions.

[1469] The present invention relates to a system for automatically generating games based on a user's emotions and sharing them with other users. This system includes an input unit, a terminal unit, an emotion recognition unit, a server unit, an AI generation unit, a game construction unit, a creative mode unit, a storage and sharing unit, a unit for accessing other users, and a game generation unit.

[1470] Hardware and software used

[1471] The devices used are smartphones, smart glasses, and head-mounted displays. The emotion recognition system uses the Microsoft Azure Emotion API. The server uses Node.js and Express. The game is built using the Unity game engine.

[1472] Program processing overview

[1473] Operation of the system begins when the user selects the genre, character type, and story elements using the input means. The terminal means collects the input data and the user's emotional data obtained by the emotion recognition means, and sends them to the server. Based on this data, the server retrieves the necessary templates and resources from the database, and automatically generates the game's story, characters, and maps using the AI ​​generation means.

[1474] After each element is generated, the entire game is constructed by the game construction means, and the user can make individual modifications using the creative mode means. For example, it is possible to change the character's appearance or the map layout. Once modifications are complete, the game data is resent to the server by the save and share means, and a sharing URL or code is generated. Other users can access the created game using these URLs or codes.

[1475] Specific examples

[1476] For example, if a user desires a relaxing game and the emotion recognition means detects that the user's emotional state is stressed, the server will select a relaxing landscape stroll game as a template and use the AI ​​generation means to generate a game that integrates resources such as beautiful scenic panoramas and calming music. The generated game can then be further adjusted manually by the user and then provided to other users via a sharing URL.

[1477] Prompt Sentence Examples

[1478] "If you sense that the user is relaxed, create a game scene to amplify that feeling of relaxation."

[1479] "If you detect that the user is excited, generate an action-packed episode."

[1480] This system allows users to enjoy a dynamic gaming experience that responds to their emotions in real time, and makes it easy to share their creations with other users.

[1481] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1482] Step 1:

[1483] A user selects a game genre, character type, and story elements using a device such as a smartphone or smart glasses. As input, the user's selection data is generated. The device receives this selection data as input and generates initial data.

[1484] Step 2:

[1485] The device uses a camera and microphone to capture the user's facial expressions and voice, and collects the user's emotional data through emotion recognition. The collected emotional data is analyzed using the Microsoft Azure Emotion API. Through this process, the input data is output as information about the user's emotional state.

[1486] Step 3:

[1487] The device formats the selection data and emotion data in JSON format and sends it to the server. Specifically, it sends the data using a "POST" request. Through this process, the input data is output as received data on the server.

[1488] Step 4:

[1489] The server analyzes the received data and retrieves appropriate templates and resources from a database based on the genre, character type, story elements, and emotion data. The server then selects appropriate game elements and outputs template data.

[1490] Step 5:

[1491] The server activates the AI ​​generation means based on the template, user selection data, and emotion data. The AI ​​generation means automatically generates detailed storylines, character appearances, characteristics, map layouts, etc., taking into account the emotion data. This process outputs the generated game data.

[1492] Step 6:

[1493] The server integrates the generated elements to build game data. This is done using a game engine such as Unity. Specifically, it combines template data and resource data to generate an executable game file. The completed game data is obtained as output.

[1494] Step 7:

[1495] The user manually modifies the constructed game data using the creative mode means. The user can adjust the character appearance and map layout through the interface and preview the changes in real time. At this step, the user's manually modified data is output.

[1496] Step 8:

[1497] Once the user has completed the modifications, the device sends the final game data to the server. The game data is uploaded to the sharing server through the storage and sharing means, and a sharing URL or code is generated. This outputs the sharing URL or code.

[1498] Step 9:

[1499] Other users access the game using a shared URL or code. The server receives the request and sends the game data back to the other users' devices. The other users can then run the data on their own devices and play the game. The output is gameplay data.

[1500] This series of processes allows the user to enjoy a dynamic gaming experience that responds to their emotions.

[1501] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1502] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1503] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1504] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1505] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1506] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1507] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1508] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1509] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1510] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1511] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1512] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1513] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1514] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1515] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1516] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1517] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1518] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1519] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1520] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1521] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1522] The following is further disclosed regarding the above embodiment.

[1523] (Claim 1)

[1524] input means for the user to select the game genre, character type, and story elements;

[1525] terminal means for transmitting input data;

[1526] server means for retrieving appropriate templates and resources from a database based on the submitted data;

[1527] An AI generation method that generates stories, characters, and maps based on the acquired information;

[1528] a game construction means for constructing game data based on the generated data;

[1529] A creative mode means for users to manually modify the constructed game data;

[1530] A storage and sharing mechanism to store the final data and generate a URL or code for sharing;

[1531] Other users can access the game using a shared URL or code, and

[1532] A system including:

[1533] (Claim 2)

[1534] 2. The system according to claim 1, further comprising a management means for collectively managing the generated stories, characters, and maps.

[1535] (Claim 3)

[1536] 10. The system of claim 1, further comprising a preview means for providing a real-time preview function as the user makes manual modifications.

[1537] "Example 1"

[1538] (Claim 1)

[1539] input means for a user to select a game genre, character type, and story elements;

[1540] terminal means for transmitting input data;

[1541] a formatting means for formatting the transmitted data and transmitting the formatted data to a server;

[1542] server means for retrieving appropriate templates and resources from a database based on the submitted data;

[1543] An AI generation method that generates stories, characters, and maps based on the acquired information;

[1544] a game building means for integrating the generated data and building an executable game file;

[1545] A creative mode means for a user to manually modify the constructed game data;

[1546] a preview means for providing a real-time preview function;

[1547] A storage and sharing mechanism to store the final data and generate a URL or code for sharing;

[1548] Other users can access the game using a shared URL or code.

[1549] A system including:

[1550] (Claim 2)

[1551] 2. The system according to claim 1, further comprising a management means for collectively managing the generated stories, characters, and maps.

[1552] (Claim 3)

[1553] The system according to claim 1, characterized in that the AI ​​automatically generates game elements based on a prompt sentence.

[1554] "Application Example 1"

[1555] (Claim 1)

[1556] an input means for a user to select a type of product display and a scenario element;

[1557] terminal means for transmitting input data;

[1558] server means for retrieving appropriate templates and resources from a database based on the submitted data;

[1559] an AI generation means for generating an exhibition scenario, virtual characters, and backgrounds based on the acquired information;

[1560] an experience construction means for constructing a virtual experience based on the generated data;

[1561] A creative mode means for users to manually modify the constructed experience data;

[1562] A storage and sharing mechanism to store the final data and generate a URL or code for sharing;

[1563] A means for others to access your virtual experience using a shared URL or code; and

[1564] A system including:

[1565] (Claim 2)

[1566] 2. The system according to claim 1, further comprising a management means for collectively managing the generated exhibition scenarios, virtual characters, and backgrounds.

[1567] (Claim 3)

[1568] 10. The system of claim 1, further comprising a preview means for providing a real-time preview function as the user makes manual modifications.

[1569] "Example 2: Combining Emotion Engines"

[1570] (Claim 1)

[1571] input means for the user to select the game genre, character type, and story elements;

[1572] An emotion recognition means for analyzing the user's facial expressions and voice and extracting emotion data;

[1573] a terminal means for transmitting input data and emotion data;

[1574] a server means for retrieving appropriate templates and resources from a database based on the transmitted data and emotion data;

[1575] An AI generation method that generates stories, characters, and maps based on the acquired information;

[1576] a game construction means for constructing game data based on the generated data;

[1577] A creative mode means for users to manually modify the constructed game data;

[1578] A storage and sharing mechanism to store the final data and generate a URL or code for sharing;

[1579] Other users can access the game using a shared URL or code, and

[1580] A system including:

[1581] (Claim 2)

[1582] 2. The system according to claim 1, further comprising a management means for collectively managing the generated stories, characters, and maps.

[1583] (Claim 3)

[1584] 10. The system of claim 1, further comprising a preview means for providing a real-time preview function as the user makes manual modifications.

[1585] "Application example 2 when combining emotion engines"

[1586] (Claim 1)

[1587] input means for the user to select the game genre, character type, and story elements;

[1588] terminal means for transmitting input data;

[1589] emotion recognition means for collecting and analyzing the transmitted data and the user's emotion data;

[1590] server means for retrieving appropriate templates and resources from a database based on the submitted data;

[1591] An AI generation method that generates stories, characters, and maps based on the acquired information;

[1592] a game construction means for constructing game data based on the generated data;

[1593] A creative mode means for users to manually modify the constructed game data;

[1594] A storage and sharing mechanism to store the final data and generate a URL or code for sharing;

[1595] Other users can access the game using a shared URL or code, and

[1596] A game generation means that changes the content in real time according to the user's emotions;

[1597] A system including:

[1598] (Claim 2)

[1599] 2. The system according to claim 1, further comprising a management means for collectively managing the generated stories, characters, and maps and dynamically adjusting them according to emotion recognition data.

[1600] (Claim 3)

[1601] 10. The system of claim 1, further comprising a preview means for providing a real-time preview function as the user manually makes corrections, and for adjusting the preview in response to changes in the user's emotions. [Explanation of symbols]

[1602] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. input means for the user to select the game genre, character type, and story elements; terminal means for transmitting input data; server means for retrieving appropriate templates and resources from a database based on the submitted data; An AI generation method that generates stories, characters, and maps based on the acquired information; a game construction means for constructing game data based on the generated data; A creative mode means for users to manually modify the constructed game data; A storage and sharing mechanism to store the final data and generate a URL or code for sharing; Other users can access the game using a shared URL or code, and A system including:

2. 2. The system according to claim 1, further comprising a management means for collectively managing the generated stories, characters, and maps.

3. 10. The system of claim 1, further comprising a preview means for providing a real-time preview function as the user makes manual modifications.

Images