System
The system addresses limitations in conventional pseudo-romance applications by generating personalized characters and stories, allowing for interactive dialogue and community engagement, thereby enhancing user experience.
Patent Information
- Application Number
- JP2024126361
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-01
- Publication Date
- 2026-02-13
AI Technical Summary
Conventional pseudo-romance applications are limited to specific celebrities or characters, lack personalization based on user-entered information, and do not provide interactive experiences such as real-life dialogue, event participation, or community features, leading to a lack of user engagement.
A system that allows users to input information, generates personalized characters and stories, adjusts character appearance and personality, and provides community interaction and online events, enhancing the user experience.
Enables a diverse and personalized pseudo-romance experience with interactive character dialogue, original stories, and community engagement, providing a deeper and more fulfilling user experience.
Smart Images

Figure 2026024040000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Conventional pseudo-romance applications have been limited to specific celebrities or characters, making it difficult for users to experience original stories that reflect their own "oshi" (favorites). Furthermore, personalization based on user-entered information is insufficient, limiting interactive experiences such as real-life dialogue with characters and event participation. Furthermore, the provision of community features and online events for user interaction is limited, leaving a lack of means to increase user engagement. It is necessary to solve these issues and provide a more diverse and personalized pseudo-romance experience. [Means for solving the problem]
[0005] The present invention solves the above-mentioned problems by providing a system including a means for providing an interface for a user to input information, a means for collecting and saving the information input by the user, a generation means for generating a personalized character based on the information, a means for providing the user with a dialogue with the personalized character, a means for generating an original story based on the dialogue, and a means for providing the story to the user. The present invention further includes a modification means for adjusting the appearance, body type, voice, and personality of the generated character, and a means for providing a regenerated story based on the adjusted character. The system also includes a community function for supporting interaction between users and a means for hosting online events, thereby improving the overall user experience.
[0006] A "user" is a person or entity that uses an application to experience the services and functionality provided.
[0007] An "interface" refers to a screen or operating means that allows a user to input or obtain information.
[0008] "Generator" refers to any technological device or software that generates personalized characters and stories based on input information.
[0009] "Personalization" refers to providing information and functions that are optimized for individual users.
[0010] "Character" refers to a virtual person or entity generated based on user input information.
[0011] The term "interaction" refers to any technology or functionality that allows a user and a character to communicate through text, voice, or other means.
[0012] "Story" refers to the story or scenario that unfolds between the user and the character.
[0013] "Modification means" refers to a function for changing attributes such as the appearance and personality of the generated character according to the user's request.
[0014] "Community function" refers to a platform or function that allows users to interact with each other and share information.
[0015] "Online Event" means a time-specific or themed event that users can participate in via the Internet. [Brief explanation of the drawings]
[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0018] First, the terms used in the following description will be explained.
[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0024] [First embodiment]
[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0037] The present invention relates to a system that provides a user with a customized simulated romance experience by interacting with a character personalized based on information provided by the user. This system is constructed by combining multiple means, and specific embodiments thereof are described below.
[0038] System Overview
[0039] The system works in collaboration with three entities: the user, the device, and the server. The user inputs information, which the device then sends to the server. The server uses generative AI to generate personalized characters and stories based on the collected information, and provides them to the user via the device. The system also supports community functions and online events to promote interaction between users.
[0040] Program processing
[0041] User login and information entry
[0042] server
[0043] 1. When a user launches the app, a login screen is displayed. Login information (email address, password) is received and authentication is performed. After successful authentication, a user profile entry screen is displayed.
[0044] Terminal
[0045] 1. Provide a login information input interface and send the information entered by the user to the server.
[0046] User
[0047] 1. Enter your email address and password and click the Login button. After logging in, enter the details of your favorite character on the profile entry screen.
[0048] Character Generation
[0049] server
[0050] 1. Information about the user's favorite character is passed to the AI generator, which generates data such as the character's face, body type, voice, personality, etc. The generated character data is stored on the server and notified to the user.
[0051] Terminal
[0052] 1. Receive the generated character data and display it to the user.
[0053] User
[0054] 1. Check the character's appearance and personality, and submit a revision request if necessary.
[0055] Story Generation
[0056] server
[0057] 1. Receive the correction request and update the corrected character data with the generation AI. Generate an original pseudo-romance story based on the final character data. Save the generated story and notify the user.
[0058] Terminal
[0059] 1. Receive story data and display it to the user.
[0060] User
[0061] 1. Receive notifications and enjoy original stories.
[0062] Interactive Challenge
[0063] server
[0064] 1. Generate new missions and challenges as the story progresses and notify the user about them.
[0065] Terminal
[0066] 1. Provide the user with a mission or challenge screen.
[0067] User
[0068] 1. Complete missions and challenges to progress through the story.
[0069] Community Interaction
[0070] server
[0071] 1. Providing community functions to support interaction between users, and providing information about online events and encouraging participation.
[0072] Terminal
[0073] 1. Provide an interface for community participation and online event participation.
[0074] User
[0075] 1. Interact with other users and participate in online events.
[0076] Specific examples
[0077] For example, it starts when a user launches the app and logs in. After entering their email address and password on the login screen, they are taken to a profile entry screen. Here, the user enters detailed information about their "oshi." Once the information is entered, the server collects it and uses generation AI to generate a character.
[0078] The generated character is displayed on the user's device, and the user can confirm the character. If the user is satisfied, the server then generates an original story and provides it to the user. The user can then enjoy the story and take on missions and challenges. In addition, a community function is available for interacting with other users, and the user can also participate in online events.
[0079] This invention allows users to realistically experience conversations and stories with their ideal "oshi" (favorite person), which makes it possible to provide a personalized and in-depth experience, unlike conventional limited pseudo-romance apps.
[0080] The processing flow will be explained below.
[0081] Step 1:
[0082] When a user launches the app, the login screen appears. The user enters their email address and password and clicks the login button.
[0083] Step 2:
[0084] The device sends login information to the server. The server receives the login information and performs user authentication. If authentication is successful, the home screen is displayed.
[0085] Step 3:
[0086] The server displays a profile entry screen to the user, allowing the user to enter detailed information about their favorite character (such as name, date of birth, birthplace, blood type, and social media information).
[0087] Step 4:
[0088] The user enters the details of their favorite character and clicks the send button. The device sends the entered information to the server.
[0089] Step 5:
[0090] The server passes the information received from the user to the generation AI, which then generates data such as the face, body type, voice, and personality of the character. The generated character data is stored on the server and notified to the user.
[0091] Step 6:
[0092] The terminal displays the character data received from the server to the user, who then checks the character and sends a correction request if necessary.
[0093] Step 7:
[0094] The server receives the modification request and updates the character data using the generation AI. The server then determines the final character data and generates an original pseudo-romance story based on it. The generated story is saved and notified to the user.
[0095] Step 8:
[0096] The device displays the story data received from the server to the user, who then enjoys the story.
[0097] Step 9:
[0098] The server generates new missions and challenges as the story progresses and notifies the user.
[0099] Step 10:
[0100] The device provides the user with a mission or challenge screen, which the user selects and executes.
[0101] Step 11:
[0102] The server provides a community function to support interactions between users, and also distributes information about online events to encourage user participation.
[0103] Step 12:
[0104] The device provides an interface for participating in a community or online event, allowing users to interact with other users and participate in online events.
[0105] The above are the specific processing steps in the system of the present invention.
[0106] Example 1
[0107] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0108] Current virtual experience systems face challenges in providing users with a deep sense of immersion through interactions with individually personalized characters. Furthermore, they lack functionality for user-to-user communication and online events, often resulting in a perceived lack of quality in the overall user experience. A system that can resolve these issues and provide users with a fulfilling simulated romantic experience is needed.
[0109] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0110] In this invention, the server includes means for providing an interface for users to input information, means for collecting and storing the information input by the users, and means for generating a personalized virtual character based on the information, thereby enabling a system in which users can interact with individually customized virtual characters, interact with other users, and easily participate in online events.
[0111] "User" refers to an individual who uses this system.
[0112] "Interface" refers to the screen or operating means provided for the user to input information.
[0113] "Collect" refers to obtaining information entered by the user and storing it for management purposes.
[0114] "Storage" refers to recording collected information in a database or the like and making it available for later use.
[0115] "Personalization" refers to customizing services and functions based on individual user information.
[0116] "Virtual person" refers to a digital character created by generative AI.
[0117] "Generative means" refers to the process of creating virtual characters and stories using AI and algorithms.
[0118] "Dialogue" refers to communication between a user and a virtual character.
[0119] "Story" refers to a story that unfolds through dialogue with virtual characters and user choices.
[0120] "Mission" refers to the tasks or actions that the user must accomplish in order to progress through the story.
[0121] A "challenge" refers to a task that a user must tackle, similar to a mission, but may include more advanced problems.
[0122] "Notification" refers to a message from the system to the user informing them of information or updates.
[0123] "Modification" refers to changing the content of the generated virtual character or story in response to the user's request.
[0124] "Interaction" refers to communication between users.
[0125] "Community function" refers to a function that allows users to interact with other users and share information.
[0126] "Online Event" means a digital event held within a community in which users can participate.
[0127] MODE FOR CARRYING OUT THE INVENTION
[0128] This invention relates to a system that provides users with a customized simulated romantic experience by interacting with a virtual character that is personalized based on information provided by the user. This system is constructed by combining multiple means, and operates in cooperation with three entities: a server, a terminal, and a user.
[0129] Basic system configuration
[0130] server
[0131] The server provides the following functionality:
[0132] 1. A means of providing an interface for users to enter information
[0133] 2. How we collect and store information entered by users
[0134] 3. A generator for generating a personalized virtual person based on user-entered information
[0135] 4. Means for providing a user with interaction with the personalized virtual person
[0136] 5. Means for generating an original story based on the dialogue
[0137] 6. Means for Providing the Story to Users
[0138] 7. Means for generating new missions and challenges as the story progresses and notifying the user
[0139] 8. Means of providing community features to support interaction between users
[0140] 9. Hosting online events and encouraging users to participate
[0141] Terminal
[0142] The terminal provides the following features:
[0143] 1. Login information input interface
[0144] 2. Profile entry screen
[0145] 3. Display of the generated virtual person
[0146] 4. Display of story data notified to the user
[0147] 5. Providing mission and challenge screens
[0148] 6. Community Participation Interface
[0149] 7. Interface for participating in online events
[0150] User
[0151] The user does the following:
[0152] 1. Launch the app, enter your email address and password on the login screen, and click the Login button.
[0153] 2. Enter your character information on the profile entry screen and click the Save button.
[0154] 3. Check the appearance and personality of the generated virtual persona and submit correction requests if necessary.
[0155] 4. Check the modified virtual person and proceed if you are satisfied.
[0156] 5. Enjoy the generated story.
[0157] 6. Take on a mission or challenge.
[0158] 7. Interact with other users and take advantage of community features and online events.
[0159] Specific examples
[0160] For example, it starts when a user launches the app and logs in. After entering their email address and password on the login screen and logging in, they are taken to a profile entry screen. Here, the user enters detailed information about their "favorite character." Once the information is entered, the server collects it and uses generation AI to generate a character.
[0161] The generated character is displayed on the user's device, and the user can confirm the character. If the user is satisfied, the server then generates an original story and provides it to the user. The user can then enjoy the story and take on missions and challenges. In addition, a community function is available for interacting with other users, and the user can also participate in online events.
[0162] Examples of prompt statements
[0163] Below are some examples of input prompts for generative AI models:
[0164] Generate a personalized virtual persona based on the following information provided by the user:
[0165] Name: Hanako Tanaka
[0166] Personality: Cheerful and active
[0167] Preferred type: Kind and intelligent people
[0168] Also, please generate an original pseudo-romance story featuring this character. The story setting is as follows:
[0169] Setting: Urban University
[0170] Meeting: A chance encounter at a campus event
[0171] The gist: Slowly develop the relationship
[0172] Using these prompts, the system can personalize the target characters and stories to provide the best experience for the user.
[0173] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0174] Program processing flow
[0175] Step 1: User Login
[0176] server
[0177] When a user launches the app, they are presented with a login screen.
[0178] The email address and password entered by the user are received and authenticated.
[0179] If authentication is successful, you will be instructed to move to the next screen (profile input screen).
[0180] Terminal
[0181] Displays a login screen and provides an interface for entering an email address and password.
[0182] The information entered by the user is sent to the server.
[0183] The screen transition will be performed depending on the authentication result. If successful, the profile entry screen will be displayed, and if unsuccessful, an error message will be displayed.
[0184] User
[0185] Launch the app, enter your email address and password on the login screen, and click the Login button.
[0186] If authentication is successful, you will be taken to the profile entry screen.
[0187] Specific operation:
[0188] The user enters [email address] and [password] and clicks the login button.
[0189] The server receives the [entered email address and password], performs authentication in the database, and notifies the terminal of the authentication result (success / failure).
[0190] Based on the authentication result, the device will display a profile entry screen if successful, or an error message if unsuccessful.
[0191] Step 2: Enter your profile information
[0192] server
[0193] Provides a profile entry screen.
[0194] Receives character information entered by the user and stores it in a database.
[0195] Terminal
[0196] A profile input screen is displayed, providing an interface for users to input character information (such as name, personality, preferences, etc.).
[0197] The entered information is sent to the server.
[0198] User
[0199] Enter your character information on the profile entry screen and click the Save button.
[0200] Specific operation:
[0201] The user enters the character name, personality, and preferences, and clicks the save button.
[0202] The input information is sent from the terminal to the server.
[0203] The server stores the received data in a database.
[0204] Step 3: Send and generate character information
[0205] server
[0206] The character information received from the user is passed to the generative AI model.
[0207] A generative AI model generates the character's face, body type, voice, personality, etc.
[0208] The generated character data is stored in the server, and the information is notified to the terminal.
[0209] Terminal
[0210] The generated character data is received from the server.
[0211] The character's appearance and personality are displayed for the user to check.
[0212] User
[0213] Check the appearance and personality of the generated character, and if you are satisfied, proceed to the next step. If any changes are needed, submit a correction request.
[0214] Specific operation:
[0215] The server sends the user's character information to the AI generation module as a prompt sentence.
[0216] The AI generation module generates the character's face, body type, voice, and personality and returns the results to the server.
[0217] The server stores the generated results in a database and notifies the terminal.
[0218] The terminal displays the generated character to the user.
[0219] Step 4: Check and modify your character
[0220] server
[0221] Receive correction requests from the user and send them back to the generative AI model.
[0222] Generate and save the modified character data.
[0223] The corrections are notified to the terminal.
[0224] Terminal
[0225] The modified character data is received and redisplayed to the user.
[0226] User
[0227] Review the revised character and if you are satisfied, proceed to the next step.
[0228] Specific operation:
[0229] The user submits a modification request.
[0230] The server sends the modifications to the AI generation module as a prompt sentence, generating new character data.
[0231] The server stores the corrected data in a database and notifies the terminal.
[0232] The terminal redisplays the modified data to the user.
[0233] Step 5: Generate stories
[0234] server
[0235] The data is sent to a generative AI model to generate a pseudo-romance story based on the final character data.
[0236] The generated story data is saved and notified to the user.
[0237] Terminal
[0238] Receives story data and displays it to the user.
[0239] User
[0240] Enjoy the generated story.
[0241] Specific operation:
[0242] The server generates a prompt sentence based on the character data and sends it to the AI generation module.
[0243] The AI generation module generates the story and returns it to the server.
[0244] The server stores the story data in a database and notifies the device.
[0245] The device displays the story to the user.
[0246] Step 6: Story progression
[0247] server
[0248] Create a new story event and notify the user.
[0249] Terminal
[0250] View new event information.
[0251] User
[0252] Take part in new events and progress through the story.
[0253] Specific operation:
[0254] The server generates new events according to the progress of the story and notifies the device.
[0255] The terminal displays the new event to the user.
[0256] Users can participate in new events and progress through the story.
[0257] Step 7: Missions and Challenges
[0258] server
[0259] As the story progresses, new missions and challenges are generated and notified to the user.
[0260] Terminal
[0261] Provides mission and challenge screens.
[0262] User
[0263] Take on missions and challenges to advance the story.
[0264] Specific operation:
[0265] The server generates new missions and challenges and notifies the device.
[0266] The device displays missions and challenges to the user.
[0267] Users progress through the story by completing missions and challenges.
[0268] Step 8: Community engagement and event participation
[0269] server
[0270] It provides community functions to help users interact with each other.
[0271] Provide information about online events and encourage users to participate.
[0272] Terminal
[0273] It provides an interface for community participation and a screen for participating in online events.
[0274] User
[0275] Interact with other users and participate in community features and online events.
[0276] Specific operation:
[0277] The server provides community functions and online event information to the terminal.
[0278] The terminal displays a community participation interface and an online event participation screen to the user.
[0279] Users interact with other users and participate in online events.
[0280] (Application example 1)
[0281] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0282] Conventional simulated dating systems are unable to respond to diverse user feedback, making it difficult to provide a personalized, in-depth experience. Furthermore, they lack interaction between users and other interactive elements, making it difficult to achieve sustained user engagement. This makes it difficult to maintain user interest, and as a result, it is difficult to expect an increase in the number of users.
[0283] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0284] In this invention, the server includes means for providing an interface for a user to input information, means for collecting and storing the information input by the user, means for generating a personalized character based on the information, means for providing the user with a dialogue with the personalized character, means for generating an original story based on the dialogue, means for providing the story to the user, means for generating an original drama using information received from the user, means for adding an interactive challenge to the original drama, and means for generating new missions and challenges based on the interactive challenge and providing them to the user. This makes it possible to provide an experience of interacting with a personalized character and promote sustained engagement through interactions between users and interactive missions.
[0285] An "interface for users to input information" is a means of providing a screen or form for users to input their own profile information, etc.
[0286] The "means for collecting and storing information input by the user" refers to a technique for transmitting information input by the user to the interface to a server and storing the information in a database.
[0287] The "generation means for generating a personalized character based on the information" refers to an algorithm or system for generating individual character data based on collected user information.
[0288] The "means for providing the user with the ability to interact with the personalized character" is a mechanism that allows the user to interact with the generated character.
[0289] The "means for generating an original story based on the dialogue" is a technique for creating a different storyline for each user based on the content of the dialogue with the character.
[0290] The "means for providing the story to the user" refers to a method for displaying or allowing the user to read the generated original story.
[0291] The "means for generating an original drama using information received from the user" is a technique for creating a personalized drama scenario based on input data from the user.
[0292] The "means for adding interactive challenges to the original drama" refers to a function for setting and adding tasks and missions that users can perform while the drama is in progress.
[0293] "Means for generating new missions and challenges based on the interactive challenge and providing them to the user" is a function for generating new tasks and challenges according to the user's progress and presenting them to the user.
[0294] System Overview
[0295] This system is an interactive simulated dating experience system that operates in cooperation with three entities: the user, the device, and the server. The user inputs information, which the device sends to the server. The server uses a generative AI model to generate personalized characters and stories, which are then provided to the user via the device. It also supports community functions and online events to promote interaction between users.
[0296] Hardware and Software
[0297] Hardware used
[0298] Server: Cloud platform (e.g. Amazon Web Services, Google Cloud Platform)
[0299] Device: Smartphone
[0300] Software used
[0301] Generative AI model: OpenAI's "GPT-4", and technologies such as "Stable Diffusion" for image generation
[0302] Login authentication: OAuth2.0
[0303] Database: MySQL or PostgreSQL
[0304] Program processing
[0305] User login and information entry
[0306] The server provides a login screen when a user launches the app on their smartphone. When the user enters their email address and password, the server authenticates the information using OAuth 2.0. If authentication is successful, the user is guided to a profile entry screen where they can enter information such as their hobbies and special skills.
[0307] Character Generation
[0308] The device sends the information entered by the user to the server. The server uses a generative AI model (GPT-4) to generate a personalized character based on the user's information. Furthermore, facial and body shape information is generated using image generation technology (Stable Diffusion). The generated character is stored on the server and notified to the user.
[0309] Story Generation
[0310] The device displays the generated character to the user and obtains the user's confirmation. The server then uses the generative AI model to generate an original drama scenario based on the user's interactions with the character. The generated story is saved on the server and notified to the user.
[0311] Adding Interactive Challenges
[0312] Based on the user's progress, the server generates and notifies the user of new missions and challenges, which are tasks the user can perform as the drama progresses, further personalizing the user's experience.
[0313] Community Interaction
[0314] The server provides a community function to promote interaction between users, allowing users to chat with other users and participate in online events. The terminal displays an interface to provide these functions to the user.
[0315] Specific examples
[0316] For example, when a user starts an app and logs in, they enter their email address and password on the login screen. After logging in, they are redirected to a profile entry screen where they enter information such as their hobbies and special skills. An example prompt is "User profile: [Name: Yamada Taro, Hobbies: Listening to music, Special skills: Guitar]."
[0317] Based on this information, the server uses a generative AI model to generate a character, and creates the face and body shape using image generation technology. The generated character information is stored on the server and sent to the user for confirmation. Once the character is confirmed, an original drama scenario is then generated. For example, based on the information "Favourite character: [Name: Hanako, Personality: Cheerful and energetic, Hobby: Watching movies]", a story is generated in which Hanako recommends movies to Yamada Taro.
[0318] As the story progresses, users can receive new missions from the server and deepen their relationships with their characters by taking on these tasks. Users can also use the community function to interact with other users and participate in online events.
[0319] Prompt Sentence Examples
[0320] User profile: [Name: Yamada Taro, Hobbies: Listening to music, Special skills: Guitar]
[0321] Favorite character: [Name: Hanako, Personality: Cheerful and energetic, Hobby: Watching movies]
[0322] As described above, this system promotes sustained engagement by providing personalized character interactions and drama experiences.
[0323] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0324] Step 1:
[0325] A user launches the app using their smartphone and enters their email address and password on the login screen. The device collects this information and sends it to the server. The server authenticates the login information using OAuth2.0. If authentication is successful, the server provides the user with a profile entry screen.
[0326] Input: Email address, password
[0327] Output: Authentication result (success / failure), profile entry screen
[0328] How it works: The user enters their email address and password, which the device sends to the server. The server authenticates them and, if successful, displays the following screen.
[0329] Step 2:
[0330] The user enters their information (name, hobbies, special skills, etc.) on the profile entry screen. The device collects the entered information and sends it to the server. The server stores this information in a database.
[0331] Input: Name, hobbies, special skills
[0332] Output: Save result (success / failure), character generation request
[0333] How it works: The user enters profile information, and the device sends it to the server, which stores it and then starts character generation.
[0334] Step 3:
[0335] The server uses a generative AI model (GPT-4) to generate a personalized character based on the user's profile information stored in the database. The character's face and body shape are generated using image generation technology (Stable Diffusion). The generated character data is stored on the server and sent to the device.
[0336] Input: User profile information
[0337] Output: Character data (face, body type, voice, personality)
[0338] How it works: The server uses generative AI to generate the character's personality and background, and creates the appearance using image generation technology. The results are stored in a database and sent to the device.
[0339] Step 4:
[0340] The device displays the generated character data to the user. The user checks the character's appearance and personality, and if necessary, sends a request for modification to the server via the device. The server receives the modification request, updates the character data using the generation AI, and sends it back to the device.
[0341] Input: Correction request
[0342] Output: Updated character data
[0343] How it works: The user checks the character details and sends a request from the device if any corrections are needed. The server updates the data using the generated AI and displays it again on the device.
[0344] Step 5:
[0345] The server generates an original pseudo-romance story using a generative AI model based on the final character data, and the generated story is saved on the server and notified to the user.
[0346] Input: Final character data
[0347] Output: Original story data
[0348] How it works: The server uses a generation AI to generate a storyline based on character data, saves the data, and notifies the user.
[0349] Step 6:
[0350] The device displays the generated story data to the user. The user enjoys the original story while receiving new missions and challenges based on the ongoing story. The server monitors the user's progress and generates interactive challenges.
[0351] Input: Story data, user progress
[0352] Output: Interactive challenge, mission data
[0353] How it works: The user progresses through the story, receives new missions and challenges from the server, and tackles them.
[0354] Step 7:
[0355] The server provides a community function to promote interaction between users and provides users with information about online events. The terminal displays an interface for participating in the community and online events. Users can interact with other users and participate in online events.
[0356] Input: Community information, online event information
[0357] Output: User interaction data, event participation data
[0358] How it works: Users use the community feature to connect with other users and deepen their engagement by participating in online events.
[0359] Prompt Sentence Examples
[0360] User profile: [Name: Yamada Taro, Hobbies: Listening to music, Special skills: Guitar]
[0361] Favorite character: [Name: Hanako, Personality: Cheerful and energetic, Hobby: Watching movies]
[0362] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0363] The present invention relates to a system that provides a user with a customized simulated romance experience by interacting with a character personalized based on information provided by the user. The system incorporates an emotion engine to add functionality that recognizes the user's emotions and dynamically adjusts the dialogue with the character and story generation based on those emotions. A specific embodiment of the present invention is described below.
[0364] System Overview
[0365] The system works in collaboration between three entities: the user, the device, and the server. The user inputs information, which the device sends to the server. The server uses generative AI based on the collected information to generate personalized characters and stories, which are then provided to the user via the device. Furthermore, an emotion engine recognizes the user's emotions and optimizes the content of the dialogue, the story, and community interactions.
[0366] Program processing
[0367] User login and information entry
[0368] server
[0369] 1. When a user launches the app, a login screen is displayed. Login information (email address, password) is received and authentication is performed. After successful authentication, a user profile entry screen is displayed.
[0370] Terminal
[0371] 1. Provide a login information input interface and send the information entered by the user to the server.
[0372] User
[0373] 1. Enter your email address and password and click the Login button. After logging in, enter the details of your favorite character on the profile entry screen.
[0374] Character Generation
[0375] server
[0376] 1. Information about the user's favorite character is passed to the AI generator, which generates data such as the character's face, body type, voice, personality, etc. The generated character data is stored on the server and notified to the user.
[0377] Terminal
[0378] 1. Receive the generated character data and display it to the user.
[0379] User
[0380] 1. Check the character's appearance and personality, and submit a revision request if necessary.
[0381] Story Generation
[0382] server
[0383] 1. Receive the correction request and update the corrected character data with the generation AI. Generate an original pseudo-romance story based on the final character data. Save the generated story and notify the user.
[0384] Terminal
[0385] 1. Receive story data and display it to the user.
[0386] User
[0387] 1. Receive notifications and enjoy original stories.
[0388] Dialogue adjustment using emotion engine
[0389] server
[0390] 1. Recognize the user's emotions using an emotion engine. Dynamically adjust the dialogue content based on the recognized emotion information.
[0391] Terminal
[0392] 1. Providing tailored interaction content to users.
[0393] User
[0394] 1. Enjoy interacting with the characters based on the dialogue provided.
[0395] Customize stories based on sentiment data
[0396] server
[0397] 1. Collect user emotional data and customize the story content based on that data. Save the customized story and provide it to the user.
[0398] Terminal
[0399] 1. Receive customized story data and display it to the user.
[0400] User
[0401] 1. Enjoy a customized story.
[0402] Optimizing community interaction
[0403] server
[0404] 1. Recognize users' emotions using an emotion engine and optimize interactions within the community function based on those emotions. Additionally, provide information about online events and encourage participation.
[0405] Terminal
[0406] 1. Provide an interface for community participation and online event participation.
[0407] User
[0408] 1. Interact with other users and participate in online events.
[0409] Specific examples
[0410] For example, it starts when a user launches the app and logs in. After entering their email address and password on the login screen, they are taken to a profile entry screen. Here, the user enters detailed information about their "oshi." Once the information is entered, the server collects it and uses generation AI to generate a character.
[0411] The generated character is displayed on the user's device, and the user confirms it. If the user is satisfied, the server then generates an original story and provides it to the user. As the user enjoys the story, the emotion engine analyzes the user's emotions, and the dialogue content and story details are dynamically adjusted based on those emotions.
[0412] In addition, the emotion engine also optimizes community features and online events. For example, if a user is feeling stressed, it can provide information about events to help them relax. Through these features, users can enjoy a more personalized and realistic experience.
[0413] This invention allows users to realistically experience conversations and stories with their ideal "oshi" (favorite person), which makes it possible to provide a personalized and in-depth experience, unlike conventional limited pseudo-romance apps.
[0414] The processing flow will be explained below.
[0415] Step 1:
[0416] When a user launches the app, the login screen appears. The user enters their email address and password and clicks the login button.
[0417] Step 2:
[0418] The device sends login information to the server. The server receives the login information and performs user authentication. If authentication is successful, the home screen is displayed.
[0419] Step 3:
[0420] The server displays a profile entry screen to the user, allowing the user to enter detailed information about their favorite character (such as name, date of birth, birthplace, blood type, and social media information).
[0421] Step 4:
[0422] The user enters the details of their favorite character and clicks the send button. The device sends the entered information to the server.
[0423] Step 5:
[0424] The server passes the information received from the user to the generation AI, which then generates data such as the face, body type, voice, and personality of the character. The generated character data is stored on the server and notified to the user.
[0425] Step 6:
[0426] The terminal displays the character data received from the server to the user, who then checks the character and sends a correction request if necessary.
[0427] Step 7:
[0428] The server receives the modification request and updates the character data using the generation AI. The server then determines the final character data and generates an original pseudo-romance story based on it. The generated story is saved and notified to the user.
[0429] Step 8:
[0430] The device displays the story data received from the server to the user, who then enjoys the story.
[0431] Step 9:
[0432] The emotion engine analyzes the user's reactions and inputs to recognize the user's emotions, and sends the emotion information to the server.
[0433] Step 10:
[0434] The server receives the user's emotional information and dynamically adjusts the dialogue content using the generative AI. The adjusted dialogue content is saved and notified to the user.
[0435] Step 11:
[0436] The terminal displays the adjusted dialogue content to the user, who then enjoys the dialogue with the character.
[0437] Step 12:
[0438] The server collects the user's emotional data and customizes the content of the story based on that data. The customized story is then saved and provided to the user.
[0439] Step 13:
[0440] The device displays the customized story data to the user, who then enjoys the new story.
[0441] Step 14:
[0442] The server uses an emotion engine to recognize users' emotions and optimizes interactions within the community function based on those emotions. It also distributes information about online events and encourages participation.
[0443] Step 15:
[0444] The device provides an interface for participating in communities and online events, allowing users to interact with other users and participate in events.
[0445] The above are the specific processing steps in the system of the present invention.
[0446] Example 2
[0447] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0448] Modern dating apps struggle to provide users with personalized experiences. Systems that can analyze users' emotional states in real time and dynamically adjust dialogue and storylines based on those data are particularly needed. Furthermore, there are challenges with optimizing user interactions, community building, and online events, and technology is needed to address these challenges.
[0449] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for providing an interface for a user to input information, a means for collecting and saving the information input by the user, a generation means for generating a personalized character based on the information, a means for providing the user with a dialogue with the personalized character, a means for recognizing the user's emotions using an emotion engine and dynamically adjusting the content of the dialogue, a means for generating an original story based on the dialogue, and a means for providing the story to the user. This makes it possible to provide dialogue and stories personalized according to the individual emotional state of the user.
[0450] An "interface for a user to input information" is a graphical user interface that is provided for a user to input information such as a name, email address, and password.
[0451] The "means for collecting and saving information input by the user" is a function for storing data input by the user in a storage such as a database.
[0452] A "generator for generating a personalized character" is a method or algorithm that automatically creates an individually customized character based on information entered by a user.
[0453] The "means for providing the user with a dialogue with a personalized character" is a function that allows the generated character to converse with the user in real time.
[0454] An "emotion engine" is an algorithm or technology that analyzes emotions from a user's words and actions and recognizes their emotional state.
[0455] The "means for generating an original story based on the dialogue" is an algorithm for creating a new story, taking into consideration the content of the dialogue with the character and the emotional state of the user.
[0456] The "means for providing a story to a user" is a function for displaying the generated story in a form that can be viewed or experienced by a user.
[0457] "Modification means for adjusting appearance, body type, voice, and personality" is a function for changing various attributes of the generated character based on the user's request.
[0458] The "means for providing a regenerated story" is a function for providing a user with a story that has been regenerated based on the corrected character information.
[0459] The "means for collecting emotional data and customizing story content based on that data" refers to an algorithm that collects emotional information about users and uses that information to individually tailor stories.
[0460] The "community function to support interaction between users" is a platform that allows multiple users to send and receive messages and share information with each other.
[0461] "Means for holding online events and encouraging users to participate" is a function for holding events such as webinars and live chats over the Internet and inviting users to participate.
[0462] "Means for optimizing interactions within the community" refers to algorithms and technologies that use an emotion engine to make communication between users efficient and meaningful.
[0463] This invention is a system that allows users to interact with personalized characters based on information provided by the user, providing a customized simulated romance experience. The system operates in cooperation with three entities: the user, the terminal, and the server. Specific embodiments of the invention are described below.
[0464] System Overview
[0465] The system starts when the user inputs information, which the device sends to the server. The server uses a generative AI model based on the collected information to generate personalized characters and stories, which are then provided to the user via the device. Furthermore, an emotion engine recognizes the user's emotions and optimizes the dialogue, story, and community interactions.
[0466] User login and information entry
[0467] server
[0468] When a user launches the app, a login screen is first displayed. Login information (email address, password) is received and authentication is performed. After authentication is successful, a user profile entry screen is displayed.
[0469] Terminal
[0470] A login screen is displayed, providing an interface for the user to enter their email address and password. The information entered by the user is sent to the server.
[0471] User
[0472] Users launch the app, enter their email address and password, and then enter detailed information about their favorite character on the profile entry screen.
[0473] Character Generation
[0474] server
[0475] The information about the character received from the user is passed to the generative AI model. The generative AI model generates data such as the character's face, body type, voice, and personality, and stores this on the server. The user is notified when generation is complete.
[0476] Terminal
[0477] The generated character data is received and displayed to the user.
[0478] User
[0479] The user checks the character's appearance and personality displayed on the terminal and sends a request for modification if necessary.
[0480] Story Generation
[0481] server
[0482] Receives correction requests from users and updates the corrected character data in the generative AI model. Generates an original pseudo-romance story based on the final character data and saves it on the server. Notifies the user when saving is complete.
[0483] Terminal
[0484] The generated story data is received and displayed to the user.
[0485] User
[0486] Users receive notifications and enjoy original stories.
[0487] Dialogue adjustment using emotion engine
[0488] server
[0489] The emotion engine recognizes the user's emotions and dynamically adjusts the dialogue content based on the recognized emotion information.
[0490] Terminal
[0491] The adjusted dialogue content is received and provided to the user.
[0492] User
[0493] Enjoy interacting with the characters based on the dialogue provided.
[0494] Customize stories based on sentiment data
[0495] server
[0496] Collects user emotional data and customizes the story content accordingly. Generates the customized story and saves it on the server. Notifies the user when saving is complete.
[0497] Terminal
[0498] Receive customized story data and display it to the user.
[0499] User
[0500] Users enjoy customized stories.
[0501] Optimizing community interaction
[0502] server
[0503] It uses an emotion engine to recognize users' emotions and optimize interactions within the community function based on those emotions. It also provides information about online events and encourages participation.
[0504] Terminal
[0505] Provides an interface for community participation and online event participation.
[0506] User
[0507] Users interact with other users and participate in online events.
[0508] Specific examples
[0509] For example, the flow when a user launches an app and logs in is shown below. The user enters their email address and password on the login screen, and after logging in, they are taken to a profile entry screen. Here, the user enters detailed information about their "favorite character." This information is sent to the server, which uses that information to generate a character using a generative AI model. The generated character is displayed on the user's device. The user checks the character's appearance and personality, and submits revision requests as needed. If satisfied, the server then generates an original story and provides it to the user. The user enjoys the story. During the story experience, the emotion engine analyzes the user's emotions, and the dialogue content and story are dynamically adjusted based on the results. The emotion engine also optimizes community functions and online events. For example, if the user is feeling stressed, it provides information about events to help them relax. Through these functions, users can enjoy a personalized, realistic experience.
[0510] Prompt Sentence Examples
[0511] Here are some example prompts to input to a generative AI model:
[0512] "Generate a personalized character based on user-entered information. Generate details including the character's face, body type, voice, and personality."
[0513] "Generate the most appropriate dialogue content for the user based on the following emotional data: Emotional state: joy, Content: words of praise or positive dialogue content."
[0514] "Customize an original fictional story based on your emotional data. Emotional situation: Sadness. Content: A story with a gentle tone to soothe your emotions."
[0515] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0516] Step 1: Display the user login screen and enter information
[0517] server
[0518] When a user launches the app, a login screen is provided, displaying an interface for entering login information (email address, password) and collecting that information.
[0519] Terminal
[0520] Displays a login screen and provides fields for the user to enter their email address and password.
[0521] User
[0522] The user launches the app, enters their email address and password, and then clicks the login button.
[0523] concrete action
[0524] Input: Email address, password
[0525] Output: Sending input data to the server
[0526] Step 2: User authentication and profile entry screen display
[0527] server
[0528] The received login information is checked against a database to authenticate it, and if authentication is successful, the user is presented with a profile entry screen.
[0529] Terminal
[0530] A notification of successful authentication is received from the server and the profile entry screen is displayed.
[0531] User
[0532] The user enters detailed information about their favorite character on the profile entry screen.
[0533] concrete action
[0534] Input: Login information
[0535] Data processing: Authentication processing
[0536] Output: Provide profile input screen
[0537] Step 3: Enter and submit your character information
[0538] server
[0539] Collect and store information about the favorite character received from the user.
[0540] Terminal
[0541] The character information entered by the user is sent to the server.
[0542] User
[0543] The user inputs detailed information about the character, such as face, body type, voice, and personality, and submits it.
[0544] concrete action
[0545] Input: Character information
[0546] Data Processing: Information Collection and Storage
[0547] Output: Send character information to the server
[0548] Step 4: Character Generation
[0549] server
[0550] The received character information is passed to a generative AI model to generate data such as the character's face, body type, voice, personality, etc. The generated character data is stored on the server and a notification is sent to the user.
[0551] Terminal
[0552] The generated character data is received from the server and displayed to the user.
[0553] User
[0554] The user checks the appearance and personality of the character displayed on the terminal.
[0555] concrete action
[0556] Input: Character information
[0557] Data processing: Character generation
[0558] Output: Save and notify character data
[0559] Step 5: Request a Character Modification
[0560] server
[0561] Receives correction requests from users, corrects character data using the generative AI model, updates the corrected character data, and notifies the user again.
[0562] Terminal
[0563] The modified character data is received and displayed to the user.
[0564] User
[0565] The user submits a modification request and confirms the character to be modified.
[0566] concrete action
[0567] Input: Correction request
[0568] Data processing: data correction and updating
[0569] Output: Notification of corrected data
[0570] Step 6: Generate an original story
[0571] server
[0572] Based on the final character data, an original pseudo-love story is generated using a generative AI model, saved on the server, and notified to the user.
[0573] Terminal
[0574] The generated story data is received and displayed to the user.
[0575] User
[0576] Users receive notifications and enjoy original stories.
[0577] concrete action
[0578] Input: Character data
[0579] Data processing: Story generation
[0580] Output: Save story data and notify
[0581] Step 7: Dialogue adjustment using emotion engine
[0582] server
[0583] An emotion engine is used to recognize the user's emotions and dynamically adjust the dialogue content according to those emotions.
[0584] Terminal
[0585] The adjusted dialogue content is received and provided to the user.
[0586] User
[0587] The user enjoys interacting with the character based on the dialogue content provided.
[0588] concrete action
[0589] Input: Emotion data
[0590] Data processing: Emotion recognition and dialogue content adjustment
[0591] Output: Providing tailored dialogue
[0592] Step 8: Customize your story based on sentiment data
[0593] server
[0594] Collect user emotion data and customize the story accordingly. Generate the customized story and store it on the server. Notify the user.
[0595] Terminal
[0596] Receive customized story data and display it to the user.
[0597] User
[0598] Users enjoy customized stories.
[0599] concrete action
[0600] Input: Emotion data
[0601] Data manipulation: customizing your story
[0602] Output: Save and notify customized story data
[0603] Step 9: Optimize community interactions
[0604] server
[0605] It uses an emotion engine to recognize users' emotions and optimize interactions within the community, as well as provide information about online events and encourage participation.
[0606] Terminal
[0607] Provides an interface for community participation and online event participation.
[0608] User
[0609] Users interact with other users and participate in online events.
[0610] concrete action
[0611] Input: Emotion data, community information
[0612] Data processing: Optimizing communication
[0613] Output: Providing event information, community functions
[0614] (Application example 2)
[0615] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0616] Conventional simulated love experience systems lacked dynamic dialogue or story generation based on the user's emotions, limiting the user's experience. Furthermore, due to a lack of optimization for user community interaction and event participation, users were unable to obtain a deep, personalized experience. This resulted in low user satisfaction and made it difficult for users to use the system for a long period of time.
[0617] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0618] In this invention, the server includes: means for providing an interface for a user to input information; means for collecting and storing the information input by the user; means for generating a personalized character based on the information; means for providing the user with a dialogue with the personalized character; means for generating an original story based on the dialogue; means for providing the story to the user; and means for analyzing the user's emotions using an emotion recognition engine and dynamically adjusting the dialogue content and story based on the analysis results. This allows users to enjoy dialogue and stories that match their emotions in real time. Furthermore, community functions and online events are also optimized through emotion analysis, promoting interaction between users and thereby improving user satisfaction and engagement.
[0619] - "User input interface" means a means of providing screens and input fields for users to enter their information and preferences into the system.
[0620] The "means for collecting and storing information entered by the user" is a function for transmitting data entered by the user to a server and storing the data in a database or the like.
[0621] A "generator for generating a personalized character" is an algorithm or software for generating an individualized character based on user information.
[0622] "Means for providing users with interaction with personalized characters" refers to a function that allows the generated characters to interact with the user.
[0623] "Means for generating original stories" refers to algorithms or software for automatically generating new stories based on user information and characters.
[0624] The "means for providing the story to the user" is a function for providing the created story in a form that can be viewed by the user.
[0625] An "emotion recognition engine" is software or algorithms that analyze emotions from user input and behavior.
[0626] "Means for analyzing a user's emotions using an emotion recognition engine and dynamically adjusting the dialogue content and story based on the analysis results" is a function that uses an emotion recognition engine to analyze a user's emotions and changes the dialogue and story content in real time based on the results.
[0627] "Modification means for adjusting the appearance, body type, voice, and personality of the generated character" refers to functions and interfaces for modifying various attributes of the generated character based on the user's requests.
[0628] The "means for providing a regenerated story" is a function for providing the user with a newly generated story based on the modified character.
[0629] The "means for generating and providing a story customized based on the emotions of each user" is a function for generating a story that reflects the results of an analysis of the user's emotions and providing it to the user.
[0630] "Means for providing community functions" refers to a function that provides an online space where users can interact with each other.
[0631] "Means for holding online events and encouraging users to participate" refers to a function for planning and implementing online events and encouraging users to participate.
[0632] "Means for optimizing interactions within the community function" is a function that facilitates interactions within the community based on the results of sentiment analysis.
[0633] This invention details a system for providing users with a customized simulated romance experience by interacting with a personalized character based on information provided by the user. In particular, it is characterized by using an emotion recognition engine to generate dialogue and stories based on the user's emotions.
[0634] System configuration
[0635] The system operates in cooperation with three entities: the user, the terminal, and the server.
[0636] User Interface
[0637] Terminal
[0638] It provides an interface for users to enter information, including a login screen and a profile entry screen. Users can enter their email address, password, and details of their favorite character on their device.
[0639] Data collection and generation
[0640] server
[0641] The information entered by the user is collected and saved. Based on this information, a character is generated using a generative AI. The generated character is personalized with features such as face, body type, voice, and personality, and the user is notified of the details. The user can then review or request corrections.
[0642] Story Generation and Dialogue
[0643] server
[0644] An original pseudo-romance story is generated based on the final character data. The generated story is provided to the user via their device, and the dialogue and story are dynamically adjusted using an emotion recognition engine.
[0645] Emotion Recognition Engine
[0646] server
[0647] The emotion engine analyzes user emotions and dynamically adjusts dialogue and storylines based on the analysis results, providing a more realistic and personalized experience. The emotion engine also optimizes interactions within the community function and provides information about online events.
[0648] Hardware and software used
[0649] Hardware: User's device (smartphone), server
[0650] Software: Emotion Recognition Engine, Generative AI, Server-Client Communication using REST API
[0651] Example: Running the system
[0652] When a user launches the app and enters their email address and password on the login screen, they are authenticated. After logging in, they provide information about their favorite character on the profile entry screen. The server collects this information and generates a character using a generative AI model. The generated character is displayed on the user's device, and if the user is satisfied, an original story is then generated. As the user enjoys the story, the emotion engine analyzes their emotions, dynamically adjusting the dialogue and story.
[0653] Prompt Sentence Examples
[0654] An example of a prompt used by the generative AI model is shown below.
[0655] "Generate your ideal character based on the user profile below.
[0656] profile:
[0657] Character Name: Ideal Character
[0658] Characteristics: Kind, funny
[0659] Can you tell me what the generated characters look like?
[0660] This invention allows users to experience real-time conversations and stories based on emotions, enabling a personalized and deep simulated romantic experience. Furthermore, community functions and online events are optimized through emotion analysis, promoting interaction between users and improving user satisfaction.
[0661] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0662] Step 1:
[0663] User login and information entry
[0664] User: The user launches the app and enters their email address and password on the login screen.
[0665] Terminal: Sends the login information entered by the user to the server.
[0666] Server: Receives login information and performs authentication. If authentication is successful, provides a profile entry screen to the device.
[0667] Input: Login information (email address, password)
[0668] Output: Authentication result, profile entry screen
[0669] Specific operation: The server returns the authentication result in JSON format to the terminal, and if authentication is successful, proceeds to the next step.
[0670] Step 2:
[0671] Enter and submit your user profile
[0672] User: Enter detailed information about your favorite character on the profile entry screen.
[0673] Device: Sends the entered profile information to the server.
[0674] Server: Receives and stores profile information, and sends it to the generation AI model to initiate character generation.
[0675] Input: Profile information (character name, characteristics)
[0676] Output: Character data
[0677] Specific operation: The server sends the profile information along with the prompt text to the generated AI model and saves the generated character.
[0678] Step 3:
[0679] Character generation and confirmation
[0680] Server: Sends character data generated by the generative AI model to the device.
[0681] Terminal: Receives the generated character data and displays it to the user, who can review it and send correction requests if necessary.
[0682] Input: Character data
[0683] Output: Correction request, confirmation result
[0684] Specific operation: Displays the generated character, and if there is a request for modification, sends it again to the generation AI model and receives the modified character data.
[0685] Step 4:
[0686] Story generation and delivery
[0687] Server: Generates an original pseudo-romance story based on the final character data. Sends the generated story data to the device.
[0688] Terminal: Receives story data and displays it to the user.
[0689] Input: Final character data
[0690] Output: Story data
[0691] Specific operation: The server generates a story using the generative AI model, saves the generated story, and sends it to the device.
[0692] Step 5:
[0693] Emotion Recognition and Dialogue Adjustment
[0694] Device: As the user continues the dialogue, the emotion recognition engine analyzes the user's emotions in real time.
[0695] Server: Dynamically adjusts dialogue content and story based on the results of emotion analysis. Sends the adjusted dialogue content to the device.
[0696] Input: User emotion data
[0697] Output: Adjusted dialogue
[0698] Specific operation: The emotion recognition engine analyzes the user's facial expressions and words to determine their emotional state. Based on the results, the dialogue content is modified to provide a more tailored conversation.
[0699] Step 6:
[0700] Delivering a customized story
[0701] Server: Collects user emotional data and generates a personalized story based on it. Sends the personalized story data to the device.
[0702] Terminal: Receives customized story data and displays it to the user.
[0703] Input: Emotion data, final character data
[0704] Output: Customized story data
[0705] Specific behavior: The server analyzes multiple emotional data patterns and generates different storylines based on them.
[0706] Step 7:
[0707] Optimizing community interaction
[0708] Server: Analyzes user emotions using an emotion recognition engine to optimize interactions within the community function. Provides information about online events and encourages user participation.
[0709] Terminal: Provides an interface for community participation and online event participation.
[0710] Input: Sentiment data, community participation data
[0711] Output: Optimized community interaction content, online event information
[0712] What it does: The server analyzes the topics and events that users are most interested in within the community and provides personalized recommendations based on that.
[0713] As described above, the system of the present invention can dynamically generate and adjust characters and stories according to the user's emotions and preferences, and can provide the user with a personalized and in-depth simulated romance experience.
[0714] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0715] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search<url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0716] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0717] [Second embodiment]
[0718] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0719] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0720] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0721] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0722] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0723] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0724] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0725] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0726] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0727] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0728] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0729] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0730] The present invention relates to a system that provides a user with a customized simulated romance experience by interacting with a character personalized based on information provided by the user. This system is constructed by combining multiple means, and specific embodiments thereof are described below.
[0731] System Overview
[0732] The system works in collaboration with three entities: the user, the device, and the server. The user inputs information, which the device then sends to the server. The server uses generative AI to generate personalized characters and stories based on the collected information, and provides them to the user via the device. The system also supports community functions and online events to promote interaction between users.
[0733] Program processing
[0734] User login and information entry
[0735] server
[0736] 1. When a user launches the app, a login screen is displayed. Login information (email address, password) is received and authentication is performed. After successful authentication, a user profile entry screen is displayed.
[0737] Terminal
[0738] 1. Provide a login information input interface and send the information entered by the user to the server.
[0739] User
[0740] 1. Enter your email address and password and click the Login button. After logging in, enter the details of your favorite character on the profile entry screen.
[0741] Character Generation
[0742] server
[0743] 1. Information about the user's favorite character is passed to the AI generator, which generates data such as the character's face, body type, voice, personality, etc. The generated character data is stored on the server and notified to the user.
[0744] Terminal
[0745] 1. Receive the generated character data and display it to the user.
[0746] User
[0747] 1. Check the character's appearance and personality, and submit a revision request if necessary.
[0748] Story Generation
[0749] server
[0750] 1. Receive the correction request and update the corrected character data with the generation AI. Generate an original pseudo-romance story based on the final character data. Save the generated story and notify the user.
[0751] Terminal
[0752] 1. Receive story data and display it to the user.
[0753] User
[0754] 1. Receive notifications and enjoy original stories.
[0755] Interactive Challenge
[0756] server
[0757] 1. Generate new missions and challenges as the story progresses and notify the user about them.
[0758] Terminal
[0759] 1. Provide the user with a mission or challenge screen.
[0760] User
[0761] 1. Complete missions and challenges to progress through the story.
[0762] Community Interaction
[0763] server
[0764] 1. Providing community functions to support interaction between users, and providing information about online events and encouraging participation.
[0765] Terminal
[0766] 1. Provide an interface for community participation and online event participation.
[0767] User
[0768] 1. Interact with other users and participate in online events.
[0769] Specific examples
[0770] For example, it starts when a user launches the app and logs in. After entering their email address and password on the login screen, they are taken to a profile entry screen. Here, the user enters detailed information about their "oshi." Once the information is entered, the server collects it and uses generation AI to generate a character.
[0771] The generated character is displayed on the user's device, and the user can confirm the character. If the user is satisfied, the server then generates an original story and provides it to the user. The user can then enjoy the story and take on missions and challenges. In addition, a community function is available for interacting with other users, and the user can also participate in online events.
[0772] This invention allows users to realistically experience conversations and stories with their ideal "oshi" (favorite person), which makes it possible to provide a personalized and in-depth experience, unlike conventional limited pseudo-romance apps.
[0773] The processing flow will be explained below.
[0774] Step 1:
[0775] When a user launches the app, the login screen appears. The user enters their email address and password and clicks the login button.
[0776] Step 2:
[0777] The device sends login information to the server. The server receives the login information and performs user authentication. If authentication is successful, the home screen is displayed.
[0778] Step 3:
[0779] The server displays a profile entry screen to the user, allowing the user to enter detailed information about their favorite character (such as name, date of birth, birthplace, blood type, and social media information).
[0780] Step 4:
[0781] The user enters the details of their favorite character and clicks the send button. The device sends the entered information to the server.
[0782] Step 5:
[0783] The server passes the information received from the user to the generation AI, which then generates data such as the face, body type, voice, and personality of the character. The generated character data is stored on the server and notified to the user.
[0784] Step 6:
[0785] The terminal displays the character data received from the server to the user, who then checks the character and sends a correction request if necessary.
[0786] Step 7:
[0787] The server receives the modification request and updates the character data using the generation AI. The server then determines the final character data and generates an original pseudo-romance story based on it. The generated story is saved and notified to the user.
[0788] Step 8:
[0789] The device displays the story data received from the server to the user, who then enjoys the story.
[0790] Step 9:
[0791] The server generates new missions and challenges as the story progresses and notifies the user.
[0792] Step 10:
[0793] The device provides the user with a mission or challenge screen, which the user selects and executes.
[0794] Step 11:
[0795] The server provides a community function to support interactions between users, and also distributes information about online events to encourage user participation.
[0796] Step 12:
[0797] The device provides an interface for participating in a community or online event, allowing users to interact with other users and participate in online events.
[0798] The above are the specific processing steps in the system of the present invention.
[0799] Example 1
[0800] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0801] Current virtual experience systems face challenges in providing users with a deep sense of immersion through interactions with individually personalized characters. Furthermore, they lack functionality for user-to-user communication and online events, often resulting in a perceived lack of quality in the overall user experience. A system that can resolve these issues and provide users with a fulfilling simulated romantic experience is needed.
[0802] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0803] In this invention, the server includes means for providing an interface for users to input information, means for collecting and storing the information input by the users, and means for generating a personalized virtual character based on the information, thereby enabling a system in which users can interact with individually customized virtual characters, interact with other users, and easily participate in online events.
[0804] "User" refers to an individual who uses this system.
[0805] "Interface" refers to the screen or operating means provided for the user to input information.
[0806] "Collect" refers to obtaining information entered by the user and storing it for management purposes.
[0807] "Storage" refers to recording collected information in a database or the like and making it available for later use.
[0808] "Personalization" refers to customizing services and functions based on individual user information.
[0809] "Virtual person" refers to a digital character created by generative AI.
[0810] "Generative means" refers to the process of creating virtual characters and stories using AI and algorithms.
[0811] "Dialogue" refers to communication between a user and a virtual character.
[0812] "Story" refers to a story that unfolds through dialogue with virtual characters and user choices.
[0813] "Mission" refers to the tasks or actions that the user must accomplish in order to progress through the story.
[0814] A "challenge" refers to a task that a user must tackle, similar to a mission, but may include more advanced problems.
[0815] "Notification" refers to a message from the system to the user informing them of information or updates.
[0816] "Modification" refers to changing the content of the generated virtual character or story in response to the user's request.
[0817] "Interaction" refers to communication between users.
[0818] "Community function" refers to a function that allows users to interact with other users and share information.
[0819] "Online Event" means a digital event held within a community in which users can participate.
[0820] MODE FOR CARRYING OUT THE INVENTION
[0821] This invention relates to a system that provides users with a customized simulated romantic experience by interacting with a virtual character that is personalized based on information provided by the user. This system is constructed by combining multiple means, and operates in cooperation with three entities: a server, a terminal, and a user.
[0822] Basic system configuration
[0823] server
[0824] The server provides the following functionality:
[0825] 1. A means of providing an interface for users to enter information
[0826] 2. How we collect and store information entered by users
[0827] 3. A generator for generating a personalized virtual person based on user-entered information
[0828] 4. Means for providing a user with interaction with the personalized virtual person
[0829] 5. Means for generating an original story based on the dialogue
[0830] 6. Means for Providing the Story to Users
[0831] 7. Means for generating new missions and challenges as the story progresses and notifying the user
[0832] 8. Means of providing community features to support interaction between users
[0833] 9. Hosting online events and encouraging users to participate
[0834] Terminal
[0835] The terminal provides the following features:
[0836] 1. Login information input interface
[0837] 2. Profile entry screen
[0838] 3. Display of the generated virtual person
[0839] 4. Display of story data notified to the user
[0840] 5. Providing mission and challenge screens
[0841] 6. Community Participation Interface
[0842] 7. Interface for participating in online events
[0843] User
[0844] The user does the following:
[0845] 1. Launch the app, enter your email address and password on the login screen, and click the Login button.
[0846] 2. Enter your character information on the profile entry screen and click the Save button.
[0847] 3. Check the appearance and personality of the generated virtual persona and submit correction requests if necessary.
[0848] 4. Check the modified virtual person and proceed if you are satisfied.
[0849] 5. Enjoy the generated story.
[0850] 6. Take on a mission or challenge.
[0851] 7. Interact with other users and take advantage of community features and online events.
[0852] Specific examples
[0853] For example, it starts when a user launches the app and logs in. After entering their email address and password on the login screen and logging in, they are taken to a profile entry screen. Here, the user enters detailed information about their "favorite character." Once the information is entered, the server collects it and uses generation AI to generate a character.
[0854] The generated character is displayed on the user's device, and the user can confirm the character. If the user is satisfied, the server then generates an original story and provides it to the user. The user can then enjoy the story and take on missions and challenges. In addition, a community function is available for interacting with other users, and the user can also participate in online events.
[0855] Examples of prompt statements
[0856] Below are some examples of input prompts for generative AI models:
[0857] Generate a personalized virtual persona based on the following information provided by the user:
[0858] Name: Hanako Tanaka
[0859] Personality: Cheerful and active
[0860] Preferred type: Kind and intelligent people
[0861] Also, please generate an original pseudo-romance story featuring this character. The story setting is as follows:
[0862] Setting: Urban University
[0863] Meeting: A chance encounter at a campus event
[0864] The gist: Slowly develop the relationship
[0865] Using these prompts, the system can personalize the target characters and stories to provide the best experience for the user.
[0866] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0867] Program processing flow
[0868] Step 1: User Login
[0869] server
[0870] When a user launches the app, they are presented with a login screen.
[0871] The email address and password entered by the user are received and authenticated.
[0872] If authentication is successful, you will be instructed to move to the next screen (profile input screen).
[0873] Terminal
[0874] Displays a login screen and provides an interface for entering an email address and password.
[0875] The information entered by the user is sent to the server.
[0876] The screen transition will be performed depending on the authentication result. If successful, the profile entry screen will be displayed, and if unsuccessful, an error message will be displayed.
[0877] User
[0878] Launch the app, enter your email address and password on the login screen, and click the Login button.
[0879] If authentication is successful, you will be taken to the profile entry screen.
[0880] Specific operation:
[0881] The user enters [email address] and [password] and clicks the login button.
[0882] The server receives the [entered email address and password], performs authentication in the database, and notifies the terminal of the authentication result (success / failure).
[0883] Based on the authentication result, the device will display a profile entry screen if successful, or an error message if unsuccessful.
[0884] Step 2: Enter your profile information
[0885] server
[0886] Provides a profile entry screen.
[0887] Receives character information entered by the user and stores it in a database.
[0888] Terminal
[0889] A profile input screen is displayed, providing an interface for users to input character information (such as name, personality, preferences, etc.).
[0890] The entered information is sent to the server.
[0891] User
[0892] Enter your character information on the profile entry screen and click the Save button.
[0893] Specific operation:
[0894] The user enters the character name, personality, and preferences, and clicks the save button.
[0895] The input information is sent from the terminal to the server.
[0896] The server stores the received data in a database.
[0897] Step 3: Send and generate character information
[0898] server
[0899] The character information received from the user is passed to the generative AI model.
[0900] A generative AI model generates the character's face, body type, voice, personality, etc.
[0901] The generated character data is stored in the server, and the information is notified to the terminal.
[0902] Terminal
[0903] The generated character data is received from the server.
[0904] The character's appearance and personality are displayed for the user to check.
[0905] User
[0906] Check the appearance and personality of the generated character, and if you are satisfied, proceed to the next step. If any changes are needed, submit a correction request.
[0907] Specific operation:
[0908] The server sends the user's character information to the AI generation module as a prompt sentence.
[0909] The AI generation module generates the character's face, body type, voice, and personality and returns the results to the server.
[0910] The server stores the generated results in a database and notifies the terminal.
[0911] The terminal displays the generated character to the user.
[0912] Step 4: Check and modify your character
[0913] server
[0914] Receive correction requests from the user and send them back to the generative AI model.
[0915] Generate and save the modified character data.
[0916] The corrections are notified to the terminal.
[0917] Terminal
[0918] The modified character data is received and redisplayed to the user.
[0919] User
[0920] Review the revised character and if you are satisfied, proceed to the next step.
[0921] Specific operation:
[0922] The user submits a modification request.
[0923] The server sends the modifications to the AI generation module as a prompt sentence, generating new character data.
[0924] The server stores the corrected data in a database and notifies the terminal.
[0925] The terminal redisplays the modified data to the user.
[0926] Step 5: Generate stories
[0927] server
[0928] The data is sent to a generative AI model to generate a pseudo-romance story based on the final character data.
[0929] The generated story data is saved and notified to the user.
[0930] Terminal
[0931] Receives story data and displays it to the user.
[0932] User
[0933] Enjoy the generated story.
[0934] Specific operation:
[0935] The server generates a prompt sentence based on the character data and sends it to the AI generation module.
[0936] The AI generation module generates the story and returns it to the server.
[0937] The server stores the story data in a database and notifies the device.
[0938] The device displays the story to the user.
[0939] Step 6: Story progression
[0940] server
[0941] Create a new story event and notify the user.
[0942] Terminal
[0943] View new event information.
[0944] User
[0945] Take part in new events and progress through the story.
[0946] Specific operation:
[0947] The server generates new events according to the progress of the story and notifies the device.
[0948] The terminal displays the new event to the user.
[0949] Users can participate in new events and progress through the story.
[0950] Step 7: Missions and Challenges
[0951] server
[0952] As the story progresses, new missions and challenges are generated and notified to the user.
[0953] Terminal
[0954] Provides mission and challenge screens.
[0955] User
[0956] Take on missions and challenges to advance the story.
[0957] Specific operation:
[0958] The server generates new missions and challenges and notifies the device.
[0959] The device displays missions and challenges to the user.
[0960] Users progress through the story by completing missions and challenges.
[0961] Step 8: Community engagement and event participation
[0962] server
[0963] It provides community functions to help users interact with each other.
[0964] Provide information about online events and encourage users to participate.
[0965] Terminal
[0966] It provides an interface for community participation and a screen for participating in online events.
[0967] User
[0968] Interact with other users and participate in community features and online events.
[0969] Specific operation:
[0970] The server provides community functions and online event information to the terminal.
[0971] The terminal displays a community participation interface and an online event participation screen to the user.
[0972] Users interact with other users and participate in online events.
[0973] (Application example 1)
[0974] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0975] Conventional simulated dating systems are unable to respond to diverse user feedback, making it difficult to provide a personalized, in-depth experience. Furthermore, they lack interaction between users and other interactive elements, making it difficult to achieve sustained user engagement. This makes it difficult to maintain user interest, and as a result, it is difficult to expect an increase in the number of users.
[0976] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0977] In this invention, the server includes means for providing an interface for a user to input information, means for collecting and storing the information input by the user, means for generating a personalized character based on the information, means for providing the user with a dialogue with the personalized character, means for generating an original story based on the dialogue, means for providing the story to the user, means for generating an original drama using information received from the user, means for adding an interactive challenge to the original drama, and means for generating new missions and challenges based on the interactive challenge and providing them to the user. This makes it possible to provide an experience of interacting with a personalized character and promote sustained engagement through interactions between users and interactive missions.
[0978] An "interface for users to input information" is a means of providing a screen or form for users to input their own profile information, etc.
[0979] The "means for collecting and storing information input by the user" refers to a technique for transmitting information input by the user to the interface to a server and storing the information in a database.
[0980] The "generation means for generating a personalized character based on the information" refers to an algorithm or system for generating individual character data based on collected user information.
[0981] The "means for providing the user with the ability to interact with the personalized character" is a mechanism that allows the user to interact with the generated character.
[0982] The "means for generating an original story based on the dialogue" is a technique for creating a different storyline for each user based on the content of the dialogue with the character.
[0983] The "means for providing the story to the user" refers to a method for displaying or allowing the user to read the generated original story.
[0984] The "means for generating an original drama using information received from the user" is a technique for creating a personalized drama scenario based on input data from the user.
[0985] The "means for adding interactive challenges to the original drama" refers to a function for setting and adding tasks and missions that users can perform while the drama is in progress.
[0986] "Means for generating new missions and challenges based on the interactive challenge and providing them to the user" is a function for generating new tasks and challenges according to the user's progress and presenting them to the user.
[0987] System Overview
[0988] This system is an interactive simulated dating experience system that operates in cooperation with three entities: the user, the device, and the server. The user inputs information, which the device sends to the server. The server uses a generative AI model to generate personalized characters and stories, which are then provided to the user via the device. It also supports community functions and online events to promote interaction between users.
[0989] Hardware and Software
[0990] Hardware used
[0991] Server: Cloud platform (e.g. Amazon Web Services, Google Cloud Platform)
[0992] Device: Smartphone
[0993] Software used
[0994] Generative AI model: OpenAI's "GPT-4", and technologies such as "Stable Diffusion" for image generation
[0995] Login authentication: OAuth2.0
[0996] Database: MySQL or PostgreSQL
[0997] Program processing
[0998] User login and information entry
[0999] The server provides a login screen when a user launches the app on their smartphone. When the user enters their email address and password, the server authenticates the information using OAuth 2.0. If authentication is successful, the user is guided to a profile entry screen where they can enter information such as their hobbies and special skills.
[1000] Character Generation
[1001] The device sends the information entered by the user to the server. The server uses a generative AI model (GPT-4) to generate a personalized character based on the user's information. Furthermore, facial and body shape information is generated using image generation technology (Stable Diffusion). The generated character is stored on the server and notified to the user.
[1002] Story Generation
[1003] The device displays the generated character to the user and obtains the user's confirmation. The server then uses the generative AI model to generate an original drama scenario based on the user's interactions with the character. The generated story is saved on the server and notified to the user.
[1004] Adding Interactive Challenges
[1005] Based on the user's progress, the server generates and notifies the user of new missions and challenges, which are tasks the user can perform as the drama progresses, further personalizing the user's experience.
[1006] Community Interaction
[1007] The server provides a community function to promote interaction between users, allowing users to chat with other users and participate in online events. The terminal displays an interface to provide these functions to the user.
[1008] Specific examples
[1009] For example, when a user starts an app and logs in, they enter their email address and password on the login screen. After logging in, they are redirected to a profile entry screen where they enter information such as their hobbies and special skills. An example prompt is "User profile: [Name: Yamada Taro, Hobbies: Listening to music, Special skills: Guitar]."
[1010] Based on this information, the server uses a generative AI model to generate a character, and creates the face and body shape using image generation technology. The generated character information is stored on the server and sent to the user for confirmation. Once the character is confirmed, an original drama scenario is then generated. For example, based on the information "Favourite character: [Name: Hanako, Personality: Cheerful and energetic, Hobby: Watching movies]", a story is generated in which Hanako recommends movies to Yamada Taro.
[1011] As the story progresses, users can receive new missions from the server and deepen their relationships with their characters by taking on these tasks. Users can also use the community function to interact with other users and participate in online events.
[1012] Prompt Sentence Examples
[1013] User profile: [Name: Yamada Taro, Hobbies: Listening to music, Special skills: Guitar]
[1014] Favorite character: [Name: Hanako, Personality: Cheerful and energetic, Hobby: Watching movies]
[1015] As described above, this system promotes sustained engagement by providing personalized character interactions and drama experiences.
[1016] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1017] Step 1:
[1018] A user launches the app using their smartphone and enters their email address and password on the login screen. The device collects this information and sends it to the server. The server authenticates the login information using OAuth2.0. If authentication is successful, the server provides the user with a profile entry screen.
[1019] Input: Email address, password
[1020] Output: Authentication result (success / failure), profile entry screen
[1021] How it works: The user enters their email address and password, which the device sends to the server. The server authenticates them and, if successful, displays the following screen.
[1022] Step 2:
[1023] The user enters their information (name, hobbies, special skills, etc.) on the profile entry screen. The device collects the entered information and sends it to the server. The server stores this information in a database.
[1024] Input: Name, hobbies, special skills
[1025] Output: Save result (success / failure), character generation request
[1026] How it works: The user enters profile information, and the device sends it to the server, which stores it and then starts character generation.
[1027] Step 3:
[1028] The server uses a generative AI model (GPT-4) to generate a personalized character based on the user's profile information stored in the database. The character's face and body shape are generated using image generation technology (Stable Diffusion). The generated character data is stored on the server and sent to the device.
[1029] Input: User profile information
[1030] Output: Character data (face, body type, voice, personality)
[1031] How it works: The server uses generative AI to generate the character's personality and background, and creates the appearance using image generation technology. The results are stored in a database and sent to the device.
[1032] Step 4:
[1033] The device displays the generated character data to the user. The user checks the character's appearance and personality, and if necessary, sends a request for modification to the server via the device. The server receives the modification request, updates the character data using the generation AI, and sends it back to the device.
[1034] Input: Correction request
[1035] Output: Updated character data
[1036] How it works: The user checks the character details and sends a request from the device if any corrections are needed. The server updates the data using the generated AI and displays it again on the device.
[1037] Step 5:
[1038] The server generates an original pseudo-romance story using a generative AI model based on the final character data, and the generated story is saved on the server and notified to the user.
[1039] Input: Final character data
[1040] Output: Original story data
[1041] How it works: The server uses a generation AI to generate a storyline based on character data, saves the data, and notifies the user.
[1042] Step 6:
[1043] The device displays the generated story data to the user. The user enjoys the original story while receiving new missions and challenges based on the ongoing story. The server monitors the user's progress and generates interactive challenges.
[1044] Input: Story data, user progress
[1045] Output: Interactive challenge, mission data
[1046] How it works: The user progresses through the story, receives new missions and challenges from the server, and tackles them.
[1047] Step 7:
[1048] The server provides a community function to promote interaction between users and provides users with information about online events. The terminal displays an interface for participating in the community and online events. Users can interact with other users and participate in online events.
[1049] Input: Community information, online event information
[1050] Output: User interaction data, event participation data
[1051] How it works: Users use the community feature to connect with other users and deepen their engagement by participating in online events.
[1052] Prompt Sentence Examples
[1053] User profile: [Name: Yamada Taro, Hobbies: Listening to music, Special skills: Guitar]
[1054] Favorite character: [Name: Hanako, Personality: Cheerful and energetic, Hobby: Watching movies]
[1055] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1056] The present invention relates to a system that provides a user with a customized simulated romance experience by interacting with a character personalized based on information provided by the user. The system incorporates an emotion engine to add functionality that recognizes the user's emotions and dynamically adjusts the dialogue with the character and story generation based on those emotions. A specific embodiment of the present invention is described below.
[1057] System Overview
[1058] The system works in collaboration between three entities: the user, the device, and the server. The user inputs information, which the device sends to the server. The server uses generative AI based on the collected information to generate personalized characters and stories, which are then provided to the user via the device. Furthermore, an emotion engine recognizes the user's emotions and optimizes the content of the dialogue, the story, and community interactions.
[1059] Program processing
[1060] User login and information entry
[1061] server
[1062] 1. When a user launches the app, a login screen is displayed. Login information (email address, password) is received and authentication is performed. After successful authentication, a user profile entry screen is displayed.
[1063] Terminal
[1064] 1. Provide a login information input interface and send the information entered by the user to the server.
[1065] User
[1066] 1. Enter your email address and password and click the Login button. After logging in, enter the details of your favorite character on the profile entry screen.
[1067] Character Generation
[1068] server
[1069] 1. Information about the user's favorite character is passed to the AI generator, which generates data such as the character's face, body type, voice, personality, etc. The generated character data is stored on the server and notified to the user.
[1070] Terminal
[1071] 1. Receive the generated character data and display it to the user.
[1072] User
[1073] 1. Check the character's appearance and personality, and submit a revision request if necessary.
[1074] Story Generation
[1075] server
[1076] 1. Receive the correction request and update the corrected character data with the generation AI. Generate an original pseudo-romance story based on the final character data. Save the generated story and notify the user.
[1077] Terminal
[1078] 1. Receive story data and display it to the user.
[1079] User
[1080] 1. Receive notifications and enjoy original stories.
[1081] Dialogue adjustment using emotion engine
[1082] server
[1083] 1. Recognize the user's emotions using an emotion engine. Dynamically adjust the dialogue content based on the recognized emotion information.
[1084] Terminal
[1085] 1. Providing tailored interaction content to users.
[1086] User
[1087] 1. Enjoy interacting with the characters based on the dialogue provided.
[1088] Customize stories based on sentiment data
[1089] server
[1090] 1. Collect user emotional data and customize the story content based on that data. Save the customized story and provide it to the user.
[1091] Terminal
[1092] 1. Receive customized story data and display it to the user.
[1093] User
[1094] 1. Enjoy a customized story.
[1095] Optimizing community interaction
[1096] server
[1097] 1. Recognize users' emotions using an emotion engine and optimize interactions within the community function based on those emotions. Additionally, provide information about online events and encourage participation.
[1098] Terminal
[1099] 1. Provide an interface for community participation and online event participation.
[1100] User
[1101] 1. Interact with other users and participate in online events.
[1102] Specific examples
[1103] For example, it starts when a user launches the app and logs in. After entering their email address and password on the login screen, they are taken to a profile entry screen. Here, the user enters detailed information about their "oshi." Once the information is entered, the server collects it and uses generation AI to generate a character.
[1104] The generated character is displayed on the user's device, and the user confirms it. If the user is satisfied, the server then generates an original story and provides it to the user. As the user enjoys the story, the emotion engine analyzes the user's emotions, and the dialogue content and story details are dynamically adjusted based on those emotions.
[1105] In addition, the emotion engine also optimizes community features and online events. For example, if a user is feeling stressed, it can provide information about events to help them relax. Through these features, users can enjoy a more personalized and realistic experience.
[1106] This invention allows users to realistically experience conversations and stories with their ideal "oshi" (favorite person), which makes it possible to provide a personalized and in-depth experience, unlike conventional limited pseudo-romance apps.
[1107] The processing flow will be explained below.
[1108] Step 1:
[1109] When a user launches the app, the login screen appears. The user enters their email address and password and clicks the login button.
[1110] Step 2:
[1111] The device sends login information to the server. The server receives the login information and performs user authentication. If authentication is successful, the home screen is displayed.
[1112] Step 3:
[1113] The server displays a profile entry screen to the user, allowing the user to enter detailed information about their favorite character (such as name, date of birth, birthplace, blood type, and social media information).
[1114] Step 4:
[1115] The user enters the details of their favorite character and clicks the send button. The device sends the entered information to the server.
[1116] Step 5:
[1117] The server passes the information received from the user to the generation AI, which then generates data such as the face, body type, voice, and personality of the character. The generated character data is stored on the server and notified to the user.
[1118] Step 6:
[1119] The terminal displays the character data received from the server to the user, who then checks the character and sends a correction request if necessary.
[1120] Step 7:
[1121] The server receives the modification request and updates the character data using the generation AI. The server then determines the final character data and generates an original pseudo-romance story based on it. The generated story is saved and notified to the user.
[1122] Step 8:
[1123] The device displays the story data received from the server to the user, who then enjoys the story.
[1124] Step 9:
[1125] The emotion engine analyzes the user's reactions and inputs to recognize the user's emotions, and sends the emotion information to the server.
[1126] Step 10:
[1127] The server receives the user's emotional information and dynamically adjusts the dialogue content using the generative AI. The adjusted dialogue content is saved and notified to the user.
[1128] Step 11:
[1129] The terminal displays the adjusted dialogue content to the user, who then enjoys the dialogue with the character.
[1130] Step 12:
[1131] The server collects the user's emotional data and customizes the content of the story based on that data. The customized story is then saved and provided to the user.
[1132] Step 13:
[1133] The device displays the customized story data to the user, who then enjoys the new story.
[1134] Step 14:
[1135] The server uses an emotion engine to recognize users' emotions and optimizes interactions within the community function based on those emotions. It also distributes information about online events and encourages participation.
[1136] Step 15:
[1137] The device provides an interface for participating in communities and online events, allowing users to interact with other users and participate in events.
[1138] The above are the specific processing steps in the system of the present invention.
[1139] Example 2
[1140] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1141] Modern dating apps struggle to provide users with personalized experiences. Systems that can analyze users' emotional states in real time and dynamically adjust dialogue and storylines based on those data are particularly needed. Furthermore, there are challenges with optimizing user interactions, community building, and online events, and technology is needed to address these challenges.
[1142] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for providing an interface for a user to input information, a means for collecting and saving the information input by the user, a generation means for generating a personalized character based on the information, a means for providing the user with a dialogue with the personalized character, a means for recognizing the user's emotions using an emotion engine and dynamically adjusting the content of the dialogue, a means for generating an original story based on the dialogue, and a means for providing the story to the user. This makes it possible to provide dialogue and stories personalized according to the individual emotional state of the user.
[1143] An "interface for a user to input information" is a graphical user interface that is provided for a user to input information such as a name, email address, and password.
[1144] The "means for collecting and saving information input by the user" is a function for storing data input by the user in a storage such as a database.
[1145] A "generator for generating a personalized character" is a method or algorithm that automatically creates an individually customized character based on information entered by a user.
[1146] The "means for providing the user with a dialogue with a personalized character" is a function that allows the generated character to converse with the user in real time.
[1147] An "emotion engine" is an algorithm or technology that analyzes emotions from a user's words and actions and recognizes their emotional state.
[1148] The "means for generating an original story based on the dialogue" is an algorithm for creating a new story, taking into consideration the content of the dialogue with the character and the emotional state of the user.
[1149] The "means for providing a story to a user" is a function for displaying the generated story in a form that can be viewed or experienced by a user.
[1150] "Modification means for adjusting appearance, body type, voice, and personality" is a function for changing various attributes of the generated character based on the user's request.
[1151] The "means for providing a regenerated story" is a function for providing a user with a story that has been regenerated based on the corrected character information.
[1152] The "means for collecting emotional data and customizing story content based on that data" refers to an algorithm that collects emotional information about users and uses that information to individually tailor stories.
[1153] The "community function to support interaction between users" is a platform that allows multiple users to send and receive messages and share information with each other.
[1154] "Means for holding online events and encouraging users to participate" is a function for holding events such as webinars and live chats over the Internet and inviting users to participate.
[1155] "Means for optimizing interactions within the community" refers to algorithms and technologies that use an emotion engine to make communication between users efficient and meaningful.
[1156] This invention is a system that allows users to interact with personalized characters based on information provided by the user, providing a customized simulated romance experience. The system operates in cooperation with three entities: the user, the terminal, and the server. Specific embodiments of the invention are described below.
[1157] System Overview
[1158] The system starts when the user inputs information, which the device sends to the server. The server uses a generative AI model based on the collected information to generate personalized characters and stories, which are then provided to the user via the device. Furthermore, an emotion engine recognizes the user's emotions and optimizes the dialogue, story, and community interactions.
[1159] User login and information entry
[1160] server
[1161] When a user launches the app, a login screen is first displayed. Login information (email address, password) is received and authentication is performed. After authentication is successful, a user profile entry screen is displayed.
[1162] Terminal
[1163] A login screen is displayed, providing an interface for the user to enter their email address and password. The information entered by the user is sent to the server.
[1164] User
[1165] Users launch the app, enter their email address and password, and then enter detailed information about their favorite character on the profile entry screen.
[1166] Character Generation
[1167] server
[1168] The information about the character received from the user is passed to the generative AI model. The generative AI model generates data such as the character's face, body type, voice, and personality, and stores this on the server. The user is notified when generation is complete.
[1169] Terminal
[1170] The generated character data is received and displayed to the user.
[1171] User
[1172] The user checks the character's appearance and personality displayed on the terminal and sends a request for modification if necessary.
[1173] Story Generation
[1174] server
[1175] Receives correction requests from users and updates the corrected character data in the generative AI model. Generates an original pseudo-romance story based on the final character data and saves it on the server. Notifies the user when saving is complete.
[1176] Terminal
[1177] The generated story data is received and displayed to the user.
[1178] User
[1179] Users receive notifications and enjoy original stories.
[1180] Dialogue adjustment using emotion engine
[1181] server
[1182] The emotion engine recognizes the user's emotions and dynamically adjusts the dialogue content based on the recognized emotion information.
[1183] Terminal
[1184] The adjusted dialogue content is received and provided to the user.
[1185] User
[1186] Enjoy interacting with the characters based on the dialogue provided.
[1187] Customize stories based on sentiment data
[1188] server
[1189] Collects user emotional data and customizes the story content accordingly. Generates the customized story and saves it on the server. Notifies the user when saving is complete.
[1190] Terminal
[1191] Receive customized story data and display it to the user.
[1192] User
[1193] Users enjoy customized stories.
[1194] Optimizing community interaction
[1195] server
[1196] It uses an emotion engine to recognize users' emotions and optimize interactions within the community function based on those emotions. It also provides information about online events and encourages participation.
[1197] Terminal
[1198] Provides an interface for community participation and online event participation.
[1199] User
[1200] Users interact with other users and participate in online events.
[1201] Specific examples
[1202] For example, the flow when a user launches an app and logs in is shown below. The user enters their email address and password on the login screen, and after logging in, they are taken to a profile entry screen. Here, the user enters detailed information about their "favorite character." This information is sent to the server, which uses that information to generate a character using a generative AI model. The generated character is displayed on the user's device. The user checks the character's appearance and personality, and submits revision requests as needed. If satisfied, the server then generates an original story and provides it to the user. The user enjoys the story. During the story experience, the emotion engine analyzes the user's emotions, and the dialogue content and story are dynamically adjusted based on the results. The emotion engine also optimizes community functions and online events. For example, if the user is feeling stressed, it provides information about events to help them relax. Through these functions, users can enjoy a personalized, realistic experience.
[1203] Prompt Sentence Examples
[1204] Here are some example prompts to input to a generative AI model:
[1205] "Generate a personalized character based on user-entered information. Generate details including the character's face, body type, voice, and personality."
[1206] "Generate the most appropriate dialogue content for the user based on the following emotional data: Emotional state: joy, Content: words of praise or positive dialogue content."
[1207] "Customize an original fictional story based on your emotional data. Emotional situation: Sadness. Content: A story with a gentle tone to soothe your emotions."
[1208] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1209] Step 1: Display the user login screen and enter information
[1210] server
[1211] When a user launches the app, a login screen is provided, displaying an interface for entering login information (email address, password) and collecting that information.
[1212] Terminal
[1213] Displays a login screen and provides fields for the user to enter their email address and password.
[1214] User
[1215] The user launches the app, enters their email address and password, and then clicks the login button.
[1216] concrete action
[1217] Input: Email address, password
[1218] Output: Sending input data to the server
[1219] Step 2: User authentication and profile entry screen display
[1220] server
[1221] The received login information is checked against a database to authenticate it, and if authentication is successful, the user is presented with a profile entry screen.
[1222] Terminal
[1223] A notification of successful authentication is received from the server and the profile entry screen is displayed.
[1224] User
[1225] The user enters detailed information about their favorite character on the profile entry screen.
[1226] concrete action
[1227] Input: Login information
[1228] Data processing: Authentication processing
[1229] Output: Provide profile input screen
[1230] Step 3: Enter and submit your character information
[1231] server
[1232] Collect and store information about the favorite character received from the user.
[1233] Terminal
[1234] The character information entered by the user is sent to the server.
[1235] User
[1236] The user inputs detailed information about the character, such as face, body type, voice, and personality, and submits it.
[1237] concrete action
[1238] Input: Character information
[1239] Data Processing: Information Collection and Storage
[1240] Output: Send character information to the server
[1241] Step 4: Character Generation
[1242] server
[1243] The received character information is passed to a generative AI model to generate data such as the character's face, body type, voice, personality, etc. The generated character data is stored on the server and a notification is sent to the user.
[1244] Terminal
[1245] The generated character data is received from the server and displayed to the user.
[1246] User
[1247] The user checks the appearance and personality of the character displayed on the terminal.
[1248] concrete action
[1249] Input: Character information
[1250] Data processing: Character generation
[1251] Output: Save and notify character data
[1252] Step 5: Request a Character Modification
[1253] server
[1254] Receives correction requests from users, corrects character data using the generative AI model, updates the corrected character data, and notifies the user again.
[1255] Terminal
[1256] The modified character data is received and displayed to the user.
[1257] User
[1258] The user submits a modification request and confirms the character to be modified.
[1259] concrete action
[1260] Input: Correction request
[1261] Data processing: data correction and updating
[1262] Output: Notification of corrected data
[1263] Step 6: Generate an original story
[1264] server
[1265] Based on the final character data, an original pseudo-love story is generated using a generative AI model, saved on the server, and notified to the user.
[1266] Terminal
[1267] The generated story data is received and displayed to the user.
[1268] User
[1269] Users receive notifications and enjoy original stories.
[1270] concrete action
[1271] Input: Character data
[1272] Data processing: Story generation
[1273] Output: Save story data and notify
[1274] Step 7: Dialogue adjustment using emotion engine
[1275] server
[1276] An emotion engine is used to recognize the user's emotions and dynamically adjust the dialogue content according to those emotions.
[1277] Terminal
[1278] The adjusted dialogue content is received and provided to the user.
[1279] User
[1280] The user enjoys interacting with the character based on the dialogue content provided.
[1281] concrete action
[1282] Input: Emotion data
[1283] Data processing: Emotion recognition and dialogue content adjustment
[1284] Output: Providing tailored dialogue
[1285] Step 8: Customize your story based on sentiment data
[1286] server
[1287] Collect user emotion data and customize the story accordingly. Generate the customized story and store it on the server. Notify the user.
[1288] Terminal
[1289] Receive customized story data and display it to the user.
[1290] User
[1291] Users enjoy customized stories.
[1292] concrete action
[1293] Input: Emotion data
[1294] Data manipulation: customizing your story
[1295] Output: Save and notify customized story data
[1296] Step 9: Optimize community interactions
[1297] server
[1298] It uses an emotion engine to recognize users' emotions and optimize interactions within the community, as well as provide information about online events and encourage participation.
[1299] Terminal
[1300] Provides an interface for community participation and online event participation.
[1301] User
[1302] Users interact with other users and participate in online events.
[1303] concrete action
[1304] Input: Emotion data, community information
[1305] Data processing: Optimizing communication
[1306] Output: Providing event information, community functions
[1307] (Application example 2)
[1308] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1309] Conventional simulated love experience systems lacked dynamic dialogue or story generation based on the user's emotions, limiting the user's experience. Furthermore, due to a lack of optimization for user community interaction and event participation, users were unable to obtain a deep, personalized experience. This resulted in low user satisfaction and made it difficult for users to use the system for a long period of time.
[1310] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1311] In this invention, the server includes: means for providing an interface for a user to input information; means for collecting and storing the information input by the user; means for generating a personalized character based on the information; means for providing the user with a dialogue with the personalized character; means for generating an original story based on the dialogue; means for providing the story to the user; and means for analyzing the user's emotions using an emotion recognition engine and dynamically adjusting the dialogue content and story based on the analysis results. This allows users to enjoy dialogue and stories that match their emotions in real time. Furthermore, community functions and online events are also optimized through emotion analysis, promoting interaction between users and thereby improving user satisfaction and engagement.
[1312] - "User input interface" means a means of providing screens and input fields for users to enter their information and preferences into the system.
[1313] The "means for collecting and storing information entered by the user" is a function for transmitting data entered by the user to a server and storing the data in a database or the like.
[1314] A "generator for generating a personalized character" is an algorithm or software for generating an individualized character based on user information.
[1315] "Means for providing users with interaction with personalized characters" refers to a function that allows the generated characters to interact with the user.
[1316] "Means for generating original stories" refers to algorithms or software for automatically generating new stories based on user information and characters.
[1317] The "means for providing the story to the user" is a function for providing the created story in a form that can be viewed by the user.
[1318] An "emotion recognition engine" is software or algorithms that analyze emotions from user input and behavior.
[1319] "Means for analyzing a user's emotions using an emotion recognition engine and dynamically adjusting the dialogue content and story based on the analysis results" is a function that uses an emotion recognition engine to analyze a user's emotions and changes the dialogue and story content in real time based on the results.
[1320] "Modification means for adjusting the appearance, body type, voice, and personality of the generated character" refers to functions and interfaces for modifying various attributes of the generated character based on the user's requests.
[1321] The "means for providing a regenerated story" is a function for providing the user with a newly generated story based on the modified character.
[1322] The "means for generating and providing a story customized based on the emotions of each user" is a function for generating a story that reflects the results of an analysis of the user's emotions and providing it to the user.
[1323] "Means for providing community functions" refers to a function that provides an online space where users can interact with each other.
[1324] "Means for holding online events and encouraging users to participate" refers to a function for planning and implementing online events and encouraging users to participate.
[1325] "Means for optimizing interactions within the community function" is a function that facilitates interactions within the community based on the results of sentiment analysis.
[1326] This invention details a system for providing users with a customized simulated romance experience by interacting with a personalized character based on information provided by the user. In particular, it is characterized by using an emotion recognition engine to generate dialogue and stories based on the user's emotions.
[1327] System configuration
[1328] The system operates in cooperation with three entities: the user, the terminal, and the server.
[1329] User Interface
[1330] Terminal
[1331] It provides an interface for users to enter information, including a login screen and a profile entry screen. Users can enter their email address, password, and details of their favorite character on their device.
[1332] Data collection and generation
[1333] server
[1334] The information entered by the user is collected and saved. Based on this information, a character is generated using a generative AI. The generated character is personalized with features such as face, body type, voice, and personality, and the user is notified of the details. The user can then review or request corrections.
[1335] Story Generation and Dialogue
[1336] server
[1337] An original pseudo-romance story is generated based on the final character data. The generated story is provided to the user via their device, and the dialogue and story are dynamically adjusted using an emotion recognition engine.
[1338] Emotion Recognition Engine
[1339] server
[1340] The emotion engine analyzes user emotions and dynamically adjusts dialogue and storylines based on the analysis results, providing a more realistic and personalized experience. The emotion engine also optimizes interactions within the community function and provides information about online events.
[1341] Hardware and software used
[1342] Hardware: User's device (smartphone), server
[1343] Software: Emotion Recognition Engine, Generative AI, Server-Client Communication using REST API
[1344] Example: Running the system
[1345] When a user launches the app and enters their email address and password on the login screen, they are authenticated. After logging in, they provide information about their favorite character on the profile entry screen. The server collects this information and generates a character using a generative AI model. The generated character is displayed on the user's device, and if the user is satisfied, an original story is then generated. As the user enjoys the story, the emotion engine analyzes their emotions, dynamically adjusting the dialogue and story.
[1346] Prompt Sentence Examples
[1347] An example of a prompt used by the generative AI model is shown below.
[1348] "Generate your ideal character based on the user profile below.
[1349] profile:
[1350] Character Name: Ideal Character
[1351] Characteristics: Kind, funny
[1352] Can you tell me what the generated characters look like?
[1353] This invention allows users to experience real-time conversations and stories based on emotions, enabling a personalized and deep simulated romantic experience. Furthermore, community functions and online events are optimized through emotion analysis, promoting interaction between users and improving user satisfaction.
[1354] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1355] Step 1:
[1356] User login and information entry
[1357] User: The user launches the app and enters their email address and password on the login screen.
[1358] Terminal: Sends the login information entered by the user to the server.
[1359] Server: Receives login information and performs authentication. If authentication is successful, provides a profile entry screen to the device.
[1360] Input: Login information (email address, password)
[1361] Output: Authentication result, profile entry screen
[1362] Specific operation: The server returns the authentication result in JSON format to the terminal, and if authentication is successful, proceeds to the next step.
[1363] Step 2:
[1364] Enter and submit your user profile
[1365] User: Enter detailed information about your favorite character on the profile entry screen.
[1366] Device: Sends the entered profile information to the server.
[1367] Server: Receives and stores profile information, and sends it to the generation AI model to initiate character generation.
[1368] Input: Profile information (character name, characteristics)
[1369] Output: Character data
[1370] Specific operation: The server sends the profile information along with the prompt text to the generated AI model and saves the generated character.
[1371] Step 3:
[1372] Character generation and confirmation
[1373] Server: Sends character data generated by the generative AI model to the device.
[1374] Terminal: Receives the generated character data and displays it to the user, who can review it and send correction requests if necessary.
[1375] Input: Character data
[1376] Output: Correction request, confirmation result
[1377] Specific operation: Displays the generated character, and if there is a request for modification, sends it again to the generation AI model and receives the modified character data.
[1378] Step 4:
[1379] Story generation and delivery
[1380] Server: Generates an original pseudo-romance story based on the final character data. Sends the generated story data to the device.
[1381] Terminal: Receives story data and displays it to the user.
[1382] Input: Final character data
[1383] Output: Story data
[1384] Specific operation: The server generates a story using the generative AI model, saves the generated story, and sends it to the device.
[1385] Step 5:
[1386] Emotion Recognition and Dialogue Adjustment
[1387] Device: As the user continues the dialogue, the emotion recognition engine analyzes the user's emotions in real time.
[1388] Server: Dynamically adjusts dialogue content and story based on the results of emotion analysis. Sends the adjusted dialogue content to the device.
[1389] Input: User emotion data
[1390] Output: Adjusted dialogue
[1391] Specific operation: The emotion recognition engine analyzes the user's facial expressions and words to determine their emotional state. Based on the results, the dialogue content is modified to provide a more tailored conversation.
[1392] Step 6:
[1393] Delivering a customized story
[1394] Server: Collects user emotional data and generates a personalized story based on it. Sends the personalized story data to the device.
[1395] Terminal: Receives customized story data and displays it to the user.
[1396] Input: Emotion data, final character data
[1397] Output: Customized story data
[1398] Specific behavior: The server analyzes multiple emotional data patterns and generates different storylines based on them.
[1399] Step 7:
[1400] Optimizing community interaction
[1401] Server: Analyzes user emotions using an emotion recognition engine to optimize interactions within the community function. Provides information about online events and encourages user participation.
[1402] Terminal: Provides an interface for community participation and online event participation.
[1403] Input: Sentiment data, community participation data
[1404] Output: Optimized community interaction content, online event information
[1405] What it does: The server analyzes the topics and events that users are most interested in within the community and provides personalized recommendations based on that.
[1406] As described above, the system of the present invention can dynamically generate and adjust characters and stories according to the user's emotions and preferences, and can provide the user with a personalized and in-depth simulated romance experience.
[1407] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1408] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1409] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1410] [Third embodiment]
[1411] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1412] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[1413] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1414] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1415] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1416] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1417] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1418] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1419] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1420] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1421] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1422] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1423] The present invention relates to a system that provides a user with a customized simulated romance experience by interacting with a character personalized based on information provided by the user. This system is constructed by combining multiple means, and specific embodiments thereof are described below.
[1424] System Overview
[1425] The system works in collaboration with three entities: the user, the device, and the server. The user inputs information, which the device then sends to the server. The server uses generative AI to generate personalized characters and stories based on the collected information, and provides them to the user via the device. The system also supports community functions and online events to promote interaction between users.
[1426] Program processing
[1427] User login and information entry
[1428] server
[1429] 1. When a user launches the app, a login screen is displayed. Login information (email address, password) is received and authentication is performed. After successful authentication, a user profile entry screen is displayed.
[1430] Terminal
[1431] 1. Provide a login information input interface and send the information entered by the user to the server.
[1432] User
[1433] 1. Enter your email address and password and click the Login button. After logging in, enter the details of your favorite character on the profile entry screen.
[1434] Character Generation
[1435] server
[1436] 1. Information about the user's favorite character is passed to the AI generator, which generates data such as the character's face, body type, voice, personality, etc. The generated character data is stored on the server and notified to the user.
[1437] Terminal
[1438] 1. Receive the generated character data and display it to the user.
[1439] User
[1440] 1. Check the character's appearance and personality, and submit a revision request if necessary.
[1441] Story Generation
[1442] server
[1443] 1. Receive the correction request and update the corrected character data with the generation AI. Generate an original pseudo-romance story based on the final character data. Save the generated story and notify the user.
[1444] Terminal
[1445] 1. Receive story data and display it to the user.
[1446] User
[1447] 1. Receive notifications and enjoy original stories.
[1448] Interactive Challenge
[1449] server
[1450] 1. Generate new missions and challenges as the story progresses and notify the user about them.
[1451] Terminal
[1452] 1. Provide the user with a mission or challenge screen.
[1453] User
[1454] 1. Complete missions and challenges to progress through the story.
[1455] Community Interaction
[1456] server
[1457] 1. Providing community functions to support interaction between users, and providing information about online events and encouraging participation.
[1458] Terminal
[1459] 1. Provide an interface for community participation and online event participation.
[1460] User
[1461] 1. Interact with other users and participate in online events.
[1462] Specific examples
[1463] For example, it starts when a user launches the app and logs in. After entering their email address and password on the login screen, they are taken to a profile entry screen. Here, the user enters detailed information about their "oshi." Once the information is entered, the server collects it and uses generation AI to generate a character.
[1464] The generated character is displayed on the user's device, and the user can confirm the character. If the user is satisfied, the server then generates an original story and provides it to the user. The user can then enjoy the story and take on missions and challenges. In addition, a community function is available for interacting with other users, and the user can also participate in online events.
[1465] This invention allows users to realistically experience conversations and stories with their ideal "oshi" (favorite person), which makes it possible to provide a personalized and in-depth experience, unlike conventional limited pseudo-romance apps.
[1466] The processing flow will be explained below.
[1467] Step 1:
[1468] When a user launches the app, the login screen appears. The user enters their email address and password and clicks the login button.
[1469] Step 2:
[1470] The device sends login information to the server. The server receives the login information and performs user authentication. If authentication is successful, the home screen is displayed.
[1471] Step 3:
[1472] The server displays a profile entry screen to the user, allowing the user to enter detailed information about their favorite character (such as name, date of birth, birthplace, blood type, and social media information).
[1473] Step 4:
[1474] The user enters the details of their favorite character and clicks the send button. The device sends the entered information to the server.
[1475] Step 5:
[1476] The server passes the information received from the user to the generation AI, which then generates data such as the face, body type, voice, and personality of the character. The generated character data is stored on the server and notified to the user.
[1477] Step 6:
[1478] The terminal displays the character data received from the server to the user, who then checks the character and sends a correction request if necessary.
[1479] Step 7:
[1480] The server receives the modification request and updates the character data using the generation AI. The server then determines the final character data and generates an original pseudo-romance story based on it. The generated story is saved and notified to the user.
[1481] Step 8:
[1482] The device displays the story data received from the server to the user, who then enjoys the story.
[1483] Step 9:
[1484] The server generates new missions and challenges as the story progresses and notifies the user.
[1485] Step 10:
[1486] The device provides the user with a mission or challenge screen, which the user selects and executes.
[1487] Step 11:
[1488] The server provides a community function to support interactions between users, and also distributes information about online events to encourage user participation.
[1489] Step 12:
[1490] The device provides an interface for participating in a community or online event, allowing users to interact with other users and participate in online events.
[1491] The above are the specific processing steps in the system of the present invention.
[1492] Example 1
[1493] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1494] Current virtual experience systems face challenges in providing users with a deep sense of immersion through interactions with individually personalized characters. Furthermore, they lack functionality for user-to-user communication and online events, often resulting in a perceived lack of quality in the overall user experience. A system that can resolve these issues and provide users with a fulfilling simulated romantic experience is needed.
[1495] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1496] In this invention, the server includes means for providing an interface for users to input information, means for collecting and storing the information input by the users, and means for generating a personalized virtual character based on the information, thereby enabling a system in which users can interact with individually customized virtual characters, interact with other users, and easily participate in online events.
[1497] "User" refers to an individual who uses this system.
[1498] "Interface" refers to the screen or operating means provided for the user to input information.
[1499] "Collect" refers to obtaining information entered by the user and storing it for management purposes.
[1500] "Storage" refers to recording collected information in a database or the like and making it available for later use.
[1501] "Personalization" refers to customizing services and functions based on individual user information.
[1502] "Virtual person" refers to a digital character created by generative AI.
[1503] "Generative means" refers to the process of creating virtual characters and stories using AI and algorithms.
[1504] "Dialogue" refers to communication between a user and a virtual character.
[1505] "Story" refers to a story that unfolds through dialogue with virtual characters and user choices.
[1506] "Mission" refers to the tasks or actions that the user must accomplish in order to progress through the story.
[1507] A "challenge" refers to a task that a user must tackle, similar to a mission, but may include more advanced problems.
[1508] "Notification" refers to a message from the system to the user informing them of information or updates.
[1509] "Modification" refers to changing the content of the generated virtual character or story in response to the user's request.
[1510] "Interaction" refers to communication between users.
[1511] "Community function" refers to a function that allows users to interact with other users and share information.
[1512] "Online Event" means a digital event held within a community in which users can participate.
[1513] MODE FOR CARRYING OUT THE INVENTION
[1514] This invention relates to a system that provides users with a customized simulated romantic experience by interacting with a virtual character that is personalized based on information provided by the user. This system is constructed by combining multiple means, and operates in cooperation with three entities: a server, a terminal, and a user.
[1515] Basic system configuration
[1516] server
[1517] The server provides the following functionality:
[1518] 1. A means of providing an interface for users to enter information
[1519] 2. How we collect and store information entered by users
[1520] 3. A generator for generating a personalized virtual person based on user-entered information
[1521] 4. Means for providing a user with interaction with the personalized virtual person
[1522] 5. Means for generating an original story based on the dialogue
[1523] 6. Means for Providing the Story to Users
[1524] 7. Means for generating new missions and challenges as the story progresses and notifying the user
[1525] 8. Means of providing community features to support interaction between users
[1526] 9. Hosting online events and encouraging users to participate
[1527] Terminal
[1528] The terminal provides the following features:
[1529] 1. Login information input interface
[1530] 2. Profile entry screen
[1531] 3. Display of the generated virtual person
[1532] 4. Display of story data notified to the user
[1533] 5. Providing mission and challenge screens
[1534] 6. Community Participation Interface
[1535] 7. Interface for participating in online events
[1536] User
[1537] The user does the following:
[1538] 1. Launch the app, enter your email address and password on the login screen, and click the Login button.
[1539] 2. Enter your character information on the profile entry screen and click the Save button.
[1540] 3. Check the appearance and personality of the generated virtual persona and submit correction requests if necessary.
[1541] 4. Check the modified virtual person and proceed if you are satisfied.
[1542] 5. Enjoy the generated story.
[1543] 6. Take on a mission or challenge.
[1544] 7. Interact with other users and take advantage of community features and online events.
[1545] Specific examples
[1546] For example, it starts when a user launches the app and logs in. After entering their email address and password on the login screen and logging in, they are taken to a profile entry screen. Here, the user enters detailed information about their "favorite character." Once the information is entered, the server collects it and uses generation AI to generate a character.
[1547] The generated character is displayed on the user's device, and the user can confirm the character. If the user is satisfied, the server then generates an original story and provides it to the user. The user can then enjoy the story and take on missions and challenges. In addition, a community function is available for interacting with other users, and the user can also participate in online events.
[1548] Examples of prompt statements
[1549] Below are some examples of input prompts for generative AI models:
[1550] Generate a personalized virtual persona based on the following information provided by the user:
[1551] Name: Hanako Tanaka
[1552] Personality: Cheerful and active
[1553] Preferred type: Kind and intelligent people
[1554] Also, please generate an original pseudo-romance story featuring this character. The story setting is as follows:
[1555] Setting: Urban University
[1556] Meeting: A chance encounter at a campus event
[1557] The gist: Slowly develop the relationship
[1558] Using these prompts, the system can personalize the target characters and stories to provide the best experience for the user.
[1559] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1560] Program processing flow
[1561] Step 1: User Login
[1562] server
[1563] When a user launches the app, they are presented with a login screen.
[1564] The email address and password entered by the user are received and authenticated.
[1565] If authentication is successful, you will be instructed to move to the next screen (profile input screen).
[1566] Terminal
[1567] Displays a login screen and provides an interface for entering an email address and password.
[1568] The information entered by the user is sent to the server.
[1569] The screen transition will be performed depending on the authentication result. If successful, the profile entry screen will be displayed, and if unsuccessful, an error message will be displayed.
[1570] User
[1571] Launch the app, enter your email address and password on the login screen, and click the Login button.
[1572] If authentication is successful, you will be taken to the profile entry screen.
[1573] Specific operation:
[1574] The user enters [email address] and [password] and clicks the login button.
[1575] The server receives the [entered email address and password], performs authentication in the database, and notifies the terminal of the authentication result (success / failure).
[1576] Based on the authentication result, the device will display a profile entry screen if successful, or an error message if unsuccessful.
[1577] Step 2: Enter your profile information
[1578] server
[1579] Provides a profile entry screen.
[1580] Receives character information entered by the user and stores it in a database.
[1581] Terminal
[1582] A profile input screen is displayed, providing an interface for users to input character information (such as name, personality, preferences, etc.).
[1583] The entered information is sent to the server.
[1584] User
[1585] Enter your character information on the profile entry screen and click the Save button.
[1586] Specific operation:
[1587] The user enters the character name, personality, and preferences, and clicks the save button.
[1588] The input information is sent from the terminal to the server.
[1589] The server stores the received data in a database.
[1590] Step 3: Send and generate character information
[1591] server
[1592] The character information received from the user is passed to the generative AI model.
[1593] A generative AI model generates the character's face, body type, voice, personality, etc.
[1594] The generated character data is stored in the server, and the information is notified to the terminal.
[1595] Terminal
[1596] The generated character data is received from the server.
[1597] The character's appearance and personality are displayed for the user to check.
[1598] User
[1599] Check the appearance and personality of the generated character, and if you are satisfied, proceed to the next step. If any changes are needed, submit a correction request.
[1600] Specific operation:
[1601] The server sends the user's character information to the AI generation module as a prompt sentence.
[1602] The AI generation module generates the character's face, body type, voice, and personality and returns the results to the server.
[1603] The server stores the generated results in a database and notifies the terminal.
[1604] The terminal displays the generated character to the user.
[1605] Step 4: Check and modify your character
[1606] server
[1607] Receive correction requests from the user and send them back to the generative AI model.
[1608] Generate and save the modified character data.
[1609] The corrections are notified to the terminal.
[1610] Terminal
[1611] The modified character data is received and redisplayed to the user.
[1612] User
[1613] Review the revised character and if you are satisfied, proceed to the next step.
[1614] Specific operation:
[1615] The user submits a modification request.
[1616] The server sends the modifications to the AI generation module as a prompt sentence, generating new character data.
[1617] The server stores the corrected data in a database and notifies the terminal.
[1618] The terminal redisplays the modified data to the user.
[1619] Step 5: Generate stories
[1620] server
[1621] The data is sent to a generative AI model to generate a pseudo-romance story based on the final character data.
[1622] The generated story data is saved and notified to the user.
[1623] Terminal
[1624] Receives story data and displays it to the user.
[1625] User
[1626] Enjoy the generated story.
[1627] Specific operation:
[1628] The server generates a prompt sentence based on the character data and sends it to the AI generation module.
[1629] The AI generation module generates the story and returns it to the server.
[1630] The server stores the story data in a database and notifies the device.
[1631] The device displays the story to the user.
[1632] Step 6: Story progression
[1633] server
[1634] Create a new story event and notify the user.
[1635] Terminal
[1636] View new event information.
[1637] User
[1638] Take part in new events and progress through the story.
[1639] Specific operation:
[1640] The server generates new events according to the progress of the story and notifies the device.
[1641] The terminal displays the new event to the user.
[1642] Users can participate in new events and progress through the story.
[1643] Step 7: Missions and Challenges
[1644] server
[1645] As the story progresses, new missions and challenges are generated and notified to the user.
[1646] Terminal
[1647] Provides mission and challenge screens.
[1648] User
[1649] Take on missions and challenges to advance the story.
[1650] Specific operation:
[1651] The server generates new missions and challenges and notifies the device.
[1652] The device displays missions and challenges to the user.
[1653] Users progress through the story by completing missions and challenges.
[1654] Step 8: Community engagement and event participation
[1655] server
[1656] It provides community functions to help users interact with each other.
[1657] Provide information about online events and encourage users to participate.
[1658] Terminal
[1659] It provides an interface for community participation and a screen for participating in online events.
[1660] User
[1661] Interact with other users and participate in community features and online events.
[1662] Specific operation:
[1663] The server provides community functions and online event information to the terminal.
[1664] The terminal displays a community participation interface and an online event participation screen to the user.
[1665] Users interact with other users and participate in online events.
[1666] (Application example 1)
[1667] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1668] Conventional simulated dating systems are unable to respond to diverse user feedback, making it difficult to provide a personalized, in-depth experience. Furthermore, they lack interaction between users and other interactive elements, making it difficult to achieve sustained user engagement. This makes it difficult to maintain user interest, and as a result, it is difficult to expect an increase in the number of users.
[1669] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1670] In this invention, the server includes means for providing an interface for a user to input information, means for collecting and storing the information input by the user, means for generating a personalized character based on the information, means for providing the user with a dialogue with the personalized character, means for generating an original story based on the dialogue, means for providing the story to the user, means for generating an original drama using information received from the user, means for adding an interactive challenge to the original drama, and means for generating new missions and challenges based on the interactive challenge and providing them to the user. This makes it possible to provide an experience of interacting with a personalized character and promote sustained engagement through interactions between users and interactive missions.
[1671] An "interface for users to input information" is a means of providing a screen or form for users to input their own profile information, etc.
[1672] The "means for collecting and storing information input by the user" refers to a technique for transmitting information input by the user to the interface to a server and storing the information in a database.
[1673] The "generation means for generating a personalized character based on the information" refers to an algorithm or system for generating individual character data based on collected user information.
[1674] The "means for providing the user with the ability to interact with the personalized character" is a mechanism that allows the user to interact with the generated character.
[1675] The "means for generating an original story based on the dialogue" is a technique for creating a different storyline for each user based on the content of the dialogue with the character.
[1676] The "means for providing the story to the user" refers to a method for displaying or allowing the user to read the generated original story.
[1677] The "means for generating an original drama using information received from the user" is a technique for creating a personalized drama scenario based on input data from the user.
[1678] The "means for adding interactive challenges to the original drama" refers to a function for setting and adding tasks and missions that users can perform while the drama is in progress.
[1679] "Means for generating new missions and challenges based on the interactive challenge and providing them to the user" is a function for generating new tasks and challenges according to the user's progress and presenting them to the user.
[1680] System Overview
[1681] This system is an interactive simulated dating experience system that operates in cooperation with three entities: the user, the device, and the server. The user inputs information, which the device sends to the server. The server uses a generative AI model to generate personalized characters and stories, which are then provided to the user via the device. It also supports community functions and online events to promote interaction between users.
[1682] Hardware and Software
[1683] Hardware used
[1684] Server: Cloud platform (e.g. Amazon Web Services, Google Cloud Platform)
[1685] Device: Smartphone
[1686] Software used
[1687] Generative AI model: OpenAI's "GPT-4", and technologies such as "Stable Diffusion" for image generation
[1688] Login authentication: OAuth2.0
[1689] Database: MySQL or PostgreSQL
[1690] Program processing
[1691] User login and information entry
[1692] The server provides a login screen when a user launches the app on their smartphone. When the user enters their email address and password, the server authenticates the information using OAuth 2.0. If authentication is successful, the user is guided to a profile entry screen where they can enter information such as their hobbies and special skills.
[1693] Character Generation
[1694] The device sends the information entered by the user to the server. The server uses a generative AI model (GPT-4) to generate a personalized character based on the user's information. Furthermore, facial and body shape information is generated using image generation technology (Stable Diffusion). The generated character is stored on the server and notified to the user.
[1695] Story Generation
[1696] The device displays the generated character to the user and obtains the user's confirmation. The server then uses the generative AI model to generate an original drama scenario based on the user's interactions with the character. The generated story is saved on the server and notified to the user.
[1697] Adding Interactive Challenges
[1698] Based on the user's progress, the server generates and notifies the user of new missions and challenges, which are tasks the user can perform as the drama progresses, further personalizing the user's experience.
[1699] Community Interaction
[1700] The server provides a community function to promote interaction between users, allowing users to chat with other users and participate in online events. The terminal displays an interface to provide these functions to the user.
[1701] Specific examples
[1702] For example, when a user starts an app and logs in, they enter their email address and password on the login screen. After logging in, they are redirected to a profile entry screen where they enter information such as their hobbies and special skills. An example prompt is "User profile: [Name: Yamada Taro, Hobbies: Listening to music, Special skills: Guitar]."
[1703] Based on this information, the server uses a generative AI model to generate a character, and creates the face and body shape using image generation technology. The generated character information is stored on the server and sent to the user for confirmation. Once the character is confirmed, an original drama scenario is then generated. For example, based on the information "Favourite character: [Name: Hanako, Personality: Cheerful and energetic, Hobby: Watching movies]", a story is generated in which Hanako recommends movies to Yamada Taro.
[1704] As the story progresses, users can receive new missions from the server and deepen their relationships with their characters by taking on these tasks. Users can also use the community function to interact with other users and participate in online events.
[1705] Prompt Sentence Examples
[1706] User profile: [Name: Yamada Taro, Hobbies: Listening to music, Special skills: Guitar]
[1707] Favorite character: [Name: Hanako, Personality: Cheerful and energetic, Hobby: Watching movies]
[1708] As described above, this system promotes sustained engagement by providing personalized character interactions and drama experiences.
[1709] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1710] Step 1:
[1711] A user launches the app using their smartphone and enters their email address and password on the login screen. The device collects this information and sends it to the server. The server authenticates the login information using OAuth2.0. If authentication is successful, the server provides the user with a profile entry screen.
[1712] Input: Email address, password
[1713] Output: Authentication result (success / failure), profile entry screen
[1714] How it works: The user enters their email address and password, which the device sends to the server. The server authenticates them and, if successful, displays the following screen.
[1715] Step 2:
[1716] The user enters their information (name, hobbies, special skills, etc.) on the profile entry screen. The device collects the entered information and sends it to the server. The server stores this information in a database.
[1717] Input: Name, hobbies, special skills
[1718] Output: Save result (success / failure), character generation request
[1719] How it works: The user enters profile information, and the device sends it to the server, which stores it and then starts character generation.
[1720] Step 3:
[1721] The server uses a generative AI model (GPT-4) to generate a personalized character based on the user's profile information stored in the database. The character's face and body shape are generated using image generation technology (Stable Diffusion). The generated character data is stored on the server and sent to the device.
[1722] Input: User profile information
[1723] Output: Character data (face, body type, voice, personality)
[1724] How it works: The server uses generative AI to generate the character's personality and background, and creates the appearance using image generation technology. The results are stored in a database and sent to the device.
[1725] Step 4:
[1726] The device displays the generated character data to the user. The user checks the character's appearance and personality, and if necessary, sends a request for modification to the server via the device. The server receives the modification request, updates the character data using the generation AI, and sends it back to the device.
[1727] Input: Correction request
[1728] Output: Updated character data
[1729] How it works: The user checks the character details and sends a request from the device if any corrections are needed. The server updates the data using the generated AI and displays it again on the device.
[1730] Step 5:
[1731] The server generates an original pseudo-romance story using a generative AI model based on the final character data, and the generated story is saved on the server and notified to the user.
[1732] Input: Final character data
[1733] Output: Original story data
[1734] How it works: The server uses a generation AI to generate a storyline based on character data, saves the data, and notifies the user.
[1735] Step 6:
[1736] The device displays the generated story data to the user. The user enjoys the original story while receiving new missions and challenges based on the ongoing story. The server monitors the user's progress and generates interactive challenges.
[1737] Input: Story data, user progress
[1738] Output: Interactive challenge, mission data
[1739] How it works: The user progresses through the story, receives new missions and challenges from the server, and tackles them.
[1740] Step 7:
[1741] The server provides a community function to promote interaction between users and provides users with information about online events. The terminal displays an interface for participating in the community and online events. Users can interact with other users and participate in online events.
[1742] Input: Community information, online event information
[1743] Output: User interaction data, event participation data
[1744] How it works: Users use the community feature to connect with other users and deepen their engagement by participating in online events.
[1745] Prompt Sentence Examples
[1746] User profile: [Name: Yamada Taro, Hobbies: Listening to music, Special skills: Guitar]
[1747] Favorite character: [Name: Hanako, Personality: Cheerful and energetic, Hobby: Watching movies]
[1748] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1749] The present invention relates to a system that provides a user with a customized simulated romance experience by interacting with a character personalized based on information provided by the user. The system incorporates an emotion engine to add functionality that recognizes the user's emotions and dynamically adjusts the dialogue with the character and story generation based on those emotions. A specific embodiment of the present invention is described below.
[1750] System Overview
[1751] The system works in collaboration between three entities: the user, the device, and the server. The user inputs information, which the device sends to the server. The server uses generative AI based on the collected information to generate personalized characters and stories, which are then provided to the user via the device. Furthermore, an emotion engine recognizes the user's emotions and optimizes the content of the dialogue, the story, and community interactions.
[1752] Program processing
[1753] User login and information entry
[1754] server
[1755] 1. When a user launches the app, a login screen is displayed. Login information (email address, password) is received and authentication is performed. After successful authentication, a user profile entry screen is displayed.
[1756] Terminal
[1757] 1. Provide a login information input interface and send the information entered by the user to the server.
[1758] User
[1759] 1. Enter your email address and password and click the Login button. After logging in, enter the details of your favorite character on the profile entry screen.
[1760] Character Generation
[1761] server
[1762] 1. Information about the user's favorite character is passed to the AI generator, which generates data such as the character's face, body type, voice, personality, etc. The generated character data is stored on the server and notified to the user.
[1763] Terminal
[1764] 1. Receive the generated character data and display it to the user.
[1765] User
[1766] 1. Check the character's appearance and personality, and submit a revision request if necessary.
[1767] Story Generation
[1768] server
[1769] 1. Receive the correction request and update the corrected character data with the generation AI. Generate an original pseudo-romance story based on the final character data. Save the generated story and notify the user.
[1770] Terminal
[1771] 1. Receive story data and display it to the user.
[1772] User
[1773] 1. Receive notifications and enjoy original stories.
[1774] Dialogue adjustment using emotion engine
[1775] server
[1776] 1. Recognize the user's emotions using an emotion engine. Dynamically adjust the dialogue content based on the recognized emotion information.
[1777] Terminal
[1778] 1. Providing tailored interaction content to users.
[1779] User
[1780] 1. Enjoy interacting with the characters based on the dialogue provided.
[1781] Customize stories based on sentiment data
[1782] server
[1783] 1. Collect user emotional data and customize the story content based on that data. Save the customized story and provide it to the user.
[1784] Terminal
[1785] 1. Receive customized story data and display it to the user.
[1786] User
[1787] 1. Enjoy a customized story.
[1788] Optimizing community interaction
[1789] server
[1790] 1. Recognize users' emotions using an emotion engine and optimize interactions within the community function based on those emotions. Additionally, provide information about online events and encourage participation.
[1791] Terminal
[1792] 1. Provide an interface for community participation and online event participation.
[1793] User
[1794] 1. Interact with other users and participate in online events.
[1795] Specific examples
[1796] For example, it starts when a user launches the app and logs in. After entering their email address and password on the login screen, they are taken to a profile entry screen. Here, the user enters detailed information about their "oshi." Once the information is entered, the server collects it and uses generation AI to generate a character.
[1797] The generated character is displayed on the user's device, and the user confirms it. If the user is satisfied, the server then generates an original story and provides it to the user. As the user enjoys the story, the emotion engine analyzes the user's emotions, and the dialogue content and story details are dynamically adjusted based on those emotions.
[1798] In addition, the emotion engine also optimizes community features and online events. For example, if a user is feeling stressed, it can provide information about events to help them relax. Through these features, users can enjoy a more personalized and realistic experience.
[1799] This invention allows users to realistically experience conversations and stories with their ideal "oshi" (favorite person), which makes it possible to provide a personalized and in-depth experience, unlike conventional limited pseudo-romance apps.
[1800] The processing flow will be explained below.
[1801] Step 1:
[1802] When a user launches the app, the login screen appears. The user enters their email address and password and clicks the login button.
[1803] Step 2:
[1804] The device sends login information to the server. The server receives the login information and performs user authentication. If authentication is successful, the home screen is displayed.
[1805] Step 3:
[1806] The server displays a profile entry screen to the user, allowing the user to enter detailed information about their favorite character (such as name, date of birth, birthplace, blood type, and social media information).
[1807] Step 4:
[1808] The user enters the details of their favorite character and clicks the send button. The device sends the entered information to the server.
[1809] Step 5:
[1810] The server passes the information received from the user to the generation AI, which then generates data such as the face, body type, voice, and personality of the character. The generated character data is stored on the server and notified to the user.
[1811] Step 6:
[1812] The terminal displays the character data received from the server to the user, who then checks the character and sends a correction request if necessary.
[1813] Step 7:
[1814] The server receives the modification request and updates the character data using the generation AI. The server then determines the final character data and generates an original pseudo-romance story based on it. The generated story is saved and notified to the user.
[1815] Step 8:
[1816] The device displays the story data received from the server to the user, who then enjoys the story.
[1817] Step 9:
[1818] The emotion engine analyzes the user's reactions and inputs to recognize the user's emotions, and sends the emotion information to the server.
[1819] Step 10:
[1820] The server receives the user's emotional information and dynamically adjusts the dialogue content using the generative AI. The adjusted dialogue content is saved and notified to the user.
[1821] Step 11:
[1822] The terminal displays the adjusted dialogue content to the user, who then enjoys the dialogue with the character.
[1823] Step 12:
[1824] The server collects the user's emotional data and customizes the content of the story based on that data. The customized story is then saved and provided to the user.
[1825] Step 13:
[1826] The device displays the customized story data to the user, who then enjoys the new story.
[1827] Step 14:
[1828] The server uses an emotion engine to recognize users' emotions and optimizes interactions within the community function based on those emotions. It also distributes information about online events and encourages participation.
[1829] Step 15:
[1830] The device provides an interface for participating in communities and online events, allowing users to interact with other users and participate in events.
[1831] The above are the specific processing steps in the system of the present invention.
[1832] Example 2
[1833] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1834] Modern dating apps struggle to provide users with personalized experiences. Systems that can analyze users' emotional states in real time and dynamically adjust dialogue and storylines based on those data are particularly needed. Furthermore, there are challenges with optimizing user interactions, community building, and online events, and technology is needed to address these challenges.
[1835] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for providing an interface for a user to input information, a means for collecting and saving the information input by the user, a generation means for generating a personalized character based on the information, a means for providing the user with a dialogue with the personalized character, a means for recognizing the user's emotions using an emotion engine and dynamically adjusting the content of the dialogue, a means for generating an original story based on the dialogue, and a means for providing the story to the user. This makes it possible to provide dialogue and stories personalized according to the individual emotional state of the user.
[1836] An "interface for a user to input information" is a graphical user interface that is provided for a user to input information such as a name, email address, and password.
[1837] The "means for collecting and saving information input by the user" is a function for storing data input by the user in a storage such as a database.
[1838] A "generator for generating a personalized character" is a method or algorithm that automatically creates an individually customized character based on information entered by a user.
[1839] The "means for providing the user with a dialogue with a personalized character" is a function that allows the generated character to converse with the user in real time.
[1840] An "emotion engine" is an algorithm or technology that analyzes emotions from a user's words and actions and recognizes their emotional state.
[1841] The "means for generating an original story based on the dialogue" is an algorithm for creating a new story, taking into consideration the content of the dialogue with the character and the emotional state of the user.
[1842] The "means for providing a story to a user" is a function for displaying the generated story in a form that can be viewed or experienced by a user.
[1843] "Modification means for adjusting appearance, body type, voice, and personality" is a function for changing various attributes of the generated character based on the user's request.
[1844] The "means for providing a regenerated story" is a function for providing a user with a story that has been regenerated based on the corrected character information.
[1845] The "means for collecting emotional data and customizing story content based on that data" refers to an algorithm that collects emotional information about users and uses that information to individually tailor stories.
[1846] The "community function to support interaction between users" is a platform that allows multiple users to send and receive messages and share information with each other.
[1847] "Means for holding online events and encouraging users to participate" is a function for holding events such as webinars and live chats over the Internet and inviting users to participate.
[1848] "Means for optimizing interactions within the community" refers to algorithms and technologies that use an emotion engine to make communication between users efficient and meaningful.
[1849] This invention is a system that allows users to interact with personalized characters based on information provided by the user, providing a customized simulated romance experience. The system operates in cooperation with three entities: the user, the terminal, and the server. Specific embodiments of the invention are described below.
[1850] System Overview
[1851] The system starts when the user inputs information, which the device sends to the server. The server uses a generative AI model based on the collected information to generate personalized characters and stories, which are then provided to the user via the device. Furthermore, an emotion engine recognizes the user's emotions and optimizes the dialogue, story, and community interactions.
[1852] User login and information entry
[1853] server
[1854] When a user launches the app, a login screen is first displayed. Login information (email address, password) is received and authentication is performed. After authentication is successful, a user profile entry screen is displayed.
[1855] Terminal
[1856] A login screen is displayed, providing an interface for the user to enter their email address and password. The information entered by the user is sent to the server.
[1857] User
[1858] Users launch the app, enter their email address and password, and then enter detailed information about their favorite character on the profile entry screen.
[1859] Character Generation
[1860] server
[1861] The information about the character received from the user is passed to the generative AI model. The generative AI model generates data such as the character's face, body type, voice, and personality, and stores this on the server. The user is notified when generation is complete.
[1862] Terminal
[1863] The generated character data is received and displayed to the user.
[1864] User
[1865] The user checks the character's appearance and personality displayed on the terminal and sends a request for modification if necessary.
[1866] Story Generation
[1867] server
[1868] Receives correction requests from users and updates the corrected character data in the generative AI model. Generates an original pseudo-romance story based on the final character data and saves it on the server. Notifies the user when saving is complete.
[1869] Terminal
[1870] The generated story data is received and displayed to the user.
[1871] User
[1872] Users receive notifications and enjoy original stories.
[1873] Dialogue adjustment using emotion engine
[1874] server
[1875] The emotion engine recognizes the user's emotions and dynamically adjusts the dialogue content based on the recognized emotion information.
[1876] Terminal
[1877] The adjusted dialogue content is received and provided to the user.
[1878] User
[1879] Enjoy interacting with the characters based on the dialogue provided.
[1880] Customize stories based on sentiment data
[1881] server
[1882] Collects user emotional data and customizes the story content accordingly. Generates the customized story and saves it on the server. Notifies the user when saving is complete.
[1883] Terminal
[1884] Receive customized story data and display it to the user.
[1885] User
[1886] Users enjoy customized stories.
[1887] Optimizing community interaction
[1888] server
[1889] It uses an emotion engine to recognize users' emotions and optimize interactions within the community function based on those emotions. It also provides information about online events and encourages participation.
[1890] Terminal
[1891] Provides an interface for community participation and online event participation.
[1892] User
[1893] Users interact with other users and participate in online events.
[1894] Specific examples
[1895] For example, the flow when a user launches an app and logs in is shown below. The user enters their email address and password on the login screen, and after logging in, they are taken to a profile entry screen. Here, the user enters detailed information about their "favorite character." This information is sent to the server, which uses that information to generate a character using a generative AI model. The generated character is displayed on the user's device. The user checks the character's appearance and personality, and submits revision requests as needed. If satisfied, the server then generates an original story and provides it to the user. The user enjoys the story. During the story experience, the emotion engine analyzes the user's emotions, and the dialogue content and story are dynamically adjusted based on the results. The emotion engine also optimizes community functions and online events. For example, if the user is feeling stressed, it provides information about events to help them relax. Through these functions, users can enjoy a personalized, realistic experience.
[1896] Prompt Sentence Examples
[1897] Here are some example prompts to input to a generative AI model:
[1898] "Generate a personalized character based on user-entered information. Generate details including the character's face, body type, voice, and personality."
[1899] "Generate the most appropriate dialogue content for the user based on the following emotional data: Emotional state: joy, Content: words of praise or positive dialogue content."
[1900] "Customize an original fictional story based on your emotional data. Emotional situation: Sadness. Content: A story with a gentle tone to soothe your emotions."
[1901] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1902] Step 1: Display the user login screen and enter information
[1903] server
[1904] When a user launches the app, a login screen is provided, displaying an interface for entering login information (email address, password) and collecting that information.
[1905] Terminal
[1906] Displays a login screen and provides fields for the user to enter their email address and password.
[1907] User
[1908] The user launches the app, enters their email address and password, and then clicks the login button.
[1909] concrete action
[1910] Input: Email address, password
[1911] Output: Sending input data to the server
[1912] Step 2: User authentication and profile entry screen display
[1913] server
[1914] The received login information is checked against a database to authenticate it, and if authentication is successful, the user is presented with a profile entry screen.
[1915] Terminal
[1916] A notification of successful authentication is received from the server and the profile entry screen is displayed.
[1917] User
[1918] The user enters detailed information about their favorite character on the profile entry screen.
[1919] concrete action
[1920] Input: Login information
[1921] Data processing: Authentication processing
[1922] Output: Provide profile input screen
[1923] Step 3: Enter and submit your character information
[1924] server
[1925] Collect and store information about the favorite character received from the user.
[1926] Terminal
[1927] The character information entered by the user is sent to the server.
[1928] User
[1929] The user inputs detailed information about the character, such as face, body type, voice, and personality, and submits it.
[1930] concrete action
[1931] Input: Character information
[1932] Data Processing: Information Collection and Storage
[1933] Output: Send character information to the server
[1934] Step 4: Character Generation
[1935] server
[1936] The received character information is passed to a generative AI model to generate data such as the character's face, body type, voice, personality, etc. The generated character data is stored on the server and a notification is sent to the user.
[1937] Terminal
[1938] The generated character data is received from the server and displayed to the user.
[1939] User
[1940] The user checks the appearance and personality of the character displayed on the terminal.
[1941] concrete action
[1942] Input: Character information
[1943] Data processing: Character generation
[1944] Output: Save and notify character data
[1945] Step 5: Request a Character Modification
[1946] server
[1947] Receives correction requests from users, corrects character data using the generative AI model, updates the corrected character data, and notifies the user again.
[1948] Terminal
[1949] The modified character data is received and displayed to the user.
[1950] User
[1951] The user submits a modification request and confirms the character to be modified.
[1952] concrete action
[1953] Input: Correction request
[1954] Data processing: data correction and updating
[1955] Output: Notification of corrected data
[1956] Step 6: Generate an original story
[1957] server
[1958] Based on the final character data, an original pseudo-love story is generated using a generative AI model, saved on the server, and notified to the user.
[1959] Terminal
[1960] The generated story data is received and displayed to the user.
[1961] User
[1962] Users receive notifications and enjoy original stories.
[1963] concrete action
[1964] Input: Character data
[1965] Data processing: Story generation
[1966] Output: Save story data and notify
[1967] Step 7: Dialogue adjustment using emotion engine
[1968] server
[1969] An emotion engine is used to recognize the user's emotions and dynamically adjust the dialogue content according to those emotions.
[1970] Terminal
[1971] The adjusted dialogue content is received and provided to the user.
[1972] User
[1973] The user enjoys interacting with the character based on the dialogue content provided.
[1974] concrete action
[1975] Input: Emotion data
[1976] Data processing: Emotion recognition and dialogue content adjustment
[1977] Output: Providing tailored dialogue
[1978] Step 8: Customize your story based on sentiment data
[1979] server
[1980] Collect user emotion data and customize the story accordingly. Generate the customized story and store it on the server. Notify the user.
[1981] Terminal
[1982] Receive customized story data and display it to the user.
[1983] User
[1984] Users enjoy customized stories.
[1985] concrete action
[1986] Input: Emotion data
[1987] Data manipulation: customizing your story
[1988] Output: Save and notify customized story data
[1989] Step 9: Optimize community interactions
[1990] server
[1991] It uses an emotion engine to recognize users' emotions and optimize interactions within the community, as well as provide information about online events and encourage participation.
[1992] Terminal
[1993] Provides an interface for community participation and online event participation.
[1994] User
[1995] Users interact with other users and participate in online events.
[1996] concrete action
[1997] Input: Emotion data, community information
[1998] Data processing: Optimizing communication
[1999] Output: Providing event information, community functions
[2000] (Application example 2)
[2001] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[2002] Conventional simulated love experience systems lacked dynamic dialogue or story generation based on the user's emotions, limiting the user's experience. Furthermore, due to a lack of optimization for user community interaction and event participation, users were unable to obtain a deep, personalized experience. This resulted in low user satisfaction and made it difficult for users to use the system for a long period of time.
[2003] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[2004] In this invention, the server includes: means for providing an interface for a user to input information; means for collecting and storing the information input by the user; means for generating a personalized character based on the information; means for providing the user with a dialogue with the personalized character; means for generating an original story based on the dialogue; means for providing the story to the user; and means for analyzing the user's emotions using an emotion recognition engine and dynamically adjusting the dialogue content and story based on the analysis results. This allows users to enjoy dialogue and stories that match their emotions in real time. Furthermore, community functions and online events are also optimized through emotion analysis, promoting interaction between users and thereby improving user satisfaction and engagement.
[2005] - "User input interface" means a means of providing screens and input fields for users to enter their information and preferences into the system.
[2006] The "means for collecting and storing information entered by the user" is a function for transmitting data entered by the user to a server and storing the data in a database or the like.
[2007] A "generator for generating a personalized character" is an algorithm or software for generating an individualized character based on user information.
[2008] "Means for providing users with interaction with personalized characters" refers to a function that allows the generated characters to interact with the user.
[2009] "Means for generating original stories" refers to algorithms or software for automatically generating new stories based on user information and characters.
[2010] The "means for providing the story to the user" is a function for providing the created story in a form that can be viewed by the user.
[2011] An "emotion recognition engine" is software or algorithms that analyze emotions from user input and behavior.
[2012] "Means for analyzing a user's emotions using an emotion recognition engine and dynamically adjusting the dialogue content and story based on the analysis results" is a function that uses an emotion recognition engine to analyze a user's emotions and changes the dialogue and story content in real time based on the results.
[2013] "Modification means for adjusting the appearance, body type, voice, and personality of the generated character" refers to functions and interfaces for modifying various attributes of the generated character based on the user's requests.
[2014] The "means for providing a regenerated story" is a function for providing the user with a newly generated story based on the modified character.
[2015] The "means for generating and providing a story customized based on the emotions of each user" is a function for generating a story that reflects the results of an analysis of the user's emotions and providing it to the user.
[2016] "Means for providing community functions" refers to a function that provides an online space where users can interact with each other.
[2017] "Means for holding online events and encouraging users to participate" refers to a function for planning and implementing online events and encouraging users to participate.
[2018] "Means for optimizing interactions within the community function" is a function that facilitates interactions within the community based on the results of sentiment analysis.
[2019] This invention details a system for providing users with a customized simulated romance experience by interacting with a personalized character based on information provided by the user. In particular, it is characterized by using an emotion recognition engine to generate dialogue and stories based on the user's emotions.
[2020] System configuration
[2021] The system operates in cooperation with three entities: the user, the terminal, and the server.
[2022] User Interface
[2023] Terminal
[2024] It provides an interface for users to enter information, including a login screen and a profile entry screen. Users can enter their email address, password, and details of their favorite character on their device.
[2025] Data collection and generation
[2026] server
[2027] The information entered by the user is collected and saved. Based on this information, a character is generated using a generative AI. The generated character is personalized with features such as face, body type, voice, and personality, and the user is notified of the details. The user can then review or request corrections.
[2028] Story Generation and Dialogue
[2029] server
[2030] An original pseudo-romance story is generated based on the final character data. The generated story is provided to the user via their device, and the dialogue and story are dynamically adjusted using an emotion recognition engine.
[2031] Emotion Recognition Engine
[2032] server
[2033] The emotion engine analyzes user emotions and dynamically adjusts dialogue and storylines based on the analysis results, providing a more realistic and personalized experience. The emotion engine also optimizes interactions within the community function and provides information about online events.
[2034] Hardware and software used
[2035] Hardware: User's device (smartphone), server
[2036] Software: Emotion Recognition Engine, Generative AI, Server-Client Communication using REST API
[2037] Example: Running the system
[2038] When a user launches the app and enters their email address and password on the login screen, they are authenticated. After logging in, they provide information about their favorite character on the profile entry screen. The server collects this information and generates a character using a generative AI model. The generated character is displayed on the user's device, and if the user is satisfied, an original story is then generated. As the user enjoys the story, the emotion engine analyzes their emotions, dynamically adjusting the dialogue and story.
[2039] Prompt Sentence Examples
[2040] An example of a prompt used by the generative AI model is shown below.
[2041] "Generate your ideal character based on the user profile below.
[2042] profile:
[2043] Character Name: Ideal Character
[2044] Characteristics: Kind, funny
[2045] Can you tell me what the generated characters look like?
[2046] This invention allows users to experience real-time conversations and stories based on emotions, enabling a personalized and deep simulated romantic experience. Furthermore, community functions and online events are optimized through emotion analysis, promoting interaction between users and improving user satisfaction.
[2047] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[2048] Step 1:
[2049] User login and information entry
[2050] User: The user launches the app and enters their email address and password on the login screen.
[2051] Terminal: Sends the login information entered by the user to the server.
[2052] Server: Receives login information and performs authentication. If authentication is successful, provides a profile entry screen to the device.
[2053] Input: Login information (email address, password)
[2054] Output: Authentication result, profile entry screen
[2055] Specific operation: The server returns the authentication result in JSON format to the terminal, and if authentication is successful, proceeds to the next step.
[2056] Step 2:
[2057] Enter and submit your user profile
[2058] User: Enter detailed information about your favorite character on the profile entry screen.
[2059] Device: Sends the entered profile information to the server.
[2060] Server: Receives and stores profile information, and sends it to the generation AI model to initiate character generation.
[2061] Input: Profile information (character name, characteristics)
[2062] Output: Character data
[2063] Specific operation: The server sends the profile information along with the prompt text to the generated AI model and saves the generated character.
[2064] Step 3:
[2065] Character generation and confirmation
[2066] Server: Sends character data generated by the generative AI model to the device.
[2067] Terminal: Receives the generated character data and displays it to the user, who can review it and send correction requests if necessary.
[2068] Input: Character data
[2069] Output: Correction request, confirmation result
[2070] Specific operation: Displays the generated character, and if there is a request for modification, sends it again to the generation AI model and receives the modified character data.
[2071] Step 4:
[2072] Story generation and delivery
[2073] Server: Generates an original pseudo-romance story based on the final character data. Sends the generated story data to the device.
[2074] Terminal: Receives story data and displays it to the user.
[2075] Input: Final character data
[2076] Output: Story data
[2077] Specific operation: The server generates a story using the generative AI model, saves the generated story, and sends it to the device.
[2078] Step 5:
[2079] Emotion Recognition and Dialogue Adjustment
[2080] Device: As the user continues the dialogue, the emotion recognition engine analyzes the user's emotions in real time.
[2081] Server: Dynamically adjusts dialogue content and story based on the results of emotion analysis. Sends the adjusted dialogue content to the device.
[2082] Input: User emotion data
[2083] Output: Adjusted dialogue
[2084] Specific operation: The emotion recognition engine analyzes the user's facial expressions and words to determine their emotional state. Based on the results, the dialogue content is modified to provide a more tailored conversation.
[2085] Step 6:
[2086] Delivering a customized story
[2087] Server: Collects user emotional data and generates a personalized story based on it. Sends the personalized story data to the device.
[2088] Terminal: Receives customized story data and displays it to the user.
[2089] Input: Emotion data, final character data
[2090] Output: Customized story data
[2091] Specific behavior: The server analyzes multiple emotional data patterns and generates different storylines based on them.
[2092] Step 7:
[2093] Optimizing community interaction
[2094] Server: Analyzes user emotions using an emotion recognition engine to optimize interactions within the community function. Provides information about online events and encourages user participation.
[2095] Terminal: Provides an interface for community participation and online event participation.
[2096] Input: Sentiment data, community participation data
[2097] Output: Optimized community interaction content, online event information
[2098] What it does: The server analyzes the topics and events that users are most interested in within the community and provides personalized recommendations based on that.
[2099] As described above, the system of the present invention can dynamically generate and adjust characters and stories according to the user's emotions and preferences, and can provide the user with a personalized and in-depth simulated romance experience.
[2100] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[2101] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[2102] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[2103] [Fourth embodiment]
[2104] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[2105] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[2106] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[2107] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[2108] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[2109] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[2110] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[2111] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[2112] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[2113] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[2114] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[2115] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[2116] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2117] The present invention relates to a system that provides a user with a customized simulated romance experience by interacting with a character personalized based on information provided by the user. This system is constructed by combining multiple means, and specific embodiments thereof are described below.
[2118] System Overview
[2119] The system works in collaboration with three entities: the user, the device, and the server. The user inputs information, which the device then sends to the server. The server uses generative AI to generate personalized characters and stories based on the collected information, and provides them to the user via the device. The system also supports community functions and online events to promote interaction between users.
[2120] Program processing
[2121] User login and information entry
[2122] server
[2123] 1. When a user launches the app, a login screen is displayed. Login information (email address, password) is received and authentication is performed. After successful authentication, a user profile entry screen is displayed.
[2124] Terminal
[2125] 1. Provide a login information input interface and send the information entered by the user to the server.
[2126] User
[2127] 1. Enter your email address and password and click the Login button. After logging in, enter the details of your favorite character on the profile entry screen.
[2128] Character Generation
[2129] server
[2130] 1. Information about the user's favorite character is passed to the AI generator, which generates data such as the character's face, body type, voice, personality, etc. The generated character data is stored on the server and notified to the user.
[2131] Terminal
[2132] 1. Receive the generated character data and display it to the user.
[2133] User
[2134] 1. Check the character's appearance and personality, and submit a revision request if necessary.
[2135] Story Generation
[2136] server
[2137] 1. Receive the correction request and update the corrected character data with the generation AI. Generate an original pseudo-romance story based on the final character data. Save the generated story and notify the user.
[2138] Terminal
[2139] 1. Receive story data and display it to the user.
[2140] User
[2141] 1. Receive notifications and enjoy original stories.
[2142] Interactive Challenge
[2143] server
[2144] 1. Generate new missions and challenges as the story progresses and notify the user about them.
[2145] Terminal
[2146] 1. Provide the user with a mission or challenge screen.
[2147] User
[2148] 1. Complete missions and challenges to progress through the story.
[2149] Community Interaction
[2150] server
[2151] 1. Providing community functions to support interaction between users, and providing information about online events and encouraging participation.
[2152] Terminal
[2153] 1. Provide an interface for community participation and online event participation.
[2154] User
[2155] 1. Interact with other users and participate in online events.
[2156] Specific examples
[2157] For example, it starts when a user launches the app and logs in. After entering their email address and password on the login screen, they are taken to a profile entry screen. Here, the user enters detailed information about their "oshi." Once the information is entered, the server collects it and uses generation AI to generate a character.
[2158] The generated character is displayed on the user's device, and the user can confirm the character. If the user is satisfied, the server then generates an original story and provides it to the user. The user can then enjoy the story and take on missions and challenges. In addition, a community function is available for interacting with other users, and the user can also participate in online events.
[2159] This invention allows users to realistically experience conversations and stories with their ideal "oshi" (favorite person), which makes it possible to provide a personalized and in-depth experience, unlike conventional limited pseudo-romance apps.
[2160] The processing flow will be explained below.
[2161] Step 1:
[2162] When a user launches the app, the login screen appears. The user enters their email address and password and clicks the login button.
[2163] Step 2:
[2164] The device sends login information to the server. The server receives the login information and performs user authentication. If authentication is successful, the home screen is displayed.
[2165] Step 3:
[2166] The server displays a profile entry screen to the user, allowing the user to enter detailed information about their favorite character (such as name, date of birth, birthplace, blood type, and social media information).
[2167] Step 4:
[2168] The user enters the details of their favorite character and clicks the send button. The device sends the entered information to the server.
[2169] Step 5:
[2170] The server passes the information received from the user to the generation AI, which then generates data such as the face, body type, voice, and personality of the character. The generated character data is stored on the server and notified to the user.
[2171] Step 6:
[2172] The terminal displays the character data received from the server to the user, who then checks the character and sends a correction request if necessary.
[2173] Step 7:
[2174] The server receives the modification request and updates the character data using the generation AI. The server then determines the final character data and generates an original pseudo-romance story based on it. The generated story is saved and notified to the user.
[2175] Step 8:
[2176] The device displays the story data received from the server to the user, who then enjoys the story.
[2177] Step 9:
[2178] The server generates new missions and challenges as the story progresses and notifies the user.
[2179] Step 10:
[2180] The device provides the user with a mission or challenge screen, which the user selects and executes.
[2181] Step 11:
[2182] The server provides a community function to support interactions between users, and also distributes information about online events to encourage user participation.
[2183] Step 12:
[2184] The device provides an interface for participating in a community or online event, allowing users to interact with other users and participate in online events.
[2185] The above are the specific processing steps in the system of the present invention.
[2186] Example 1
[2187] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2188] Current virtual experience systems face challenges in providing users with a deep sense of immersion through interactions with individually personalized characters. Furthermore, they lack functionality for user-to-user communication and online events, often resulting in a perceived lack of quality in the overall user experience. A system that can resolve these issues and provide users with a fulfilling simulated romantic experience is needed.
[2189] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[2190] In this invention, the server includes means for providing an interface for users to input information, means for collecting and storing the information input by the users, and means for generating a personalized virtual character based on the information, thereby enabling a system in which users can interact with individually customized virtual characters, interact with other users, and easily participate in online events.
[2191] "User" refers to an individual who uses this system.
[2192] "Interface" refers to the screen or operating means provided for the user to input information.
[2193] "Collect" refers to obtaining information entered by the user and storing it for management purposes.
[2194] "Storage" refers to recording collected information in a database or the like and making it available for later use.
[2195] "Personalization" refers to customizing services and functions based on individual user information.
[2196] "Virtual person" refers to a digital character created by generative AI.
[2197] "Generative means" refers to the process of creating virtual characters and stories using AI and algorithms.
[2198] "Dialogue" refers to communication between a user and a virtual character.
[2199] "Story" refers to a story that unfolds through dialogue with virtual characters and user choices.
[2200] "Mission" refers to the tasks or actions that the user must accomplish in order to progress through the story.
[2201] A "challenge" refers to a task that a user must tackle, similar to a mission, but may include more advanced problems.
[2202] "Notification" refers to a message from the system to the user informing them of information or updates.
[2203] "Modification" refers to changing the content of the generated virtual character or story in response to the user's request.
[2204] "Interaction" refers to communication between users.
[2205] "Community function" refers to a function that allows users to interact with other users and share information.
[2206] "Online Event" means a digital event held within a community in which users can participate.
[2207] MODE FOR CARRYING OUT THE INVENTION
[2208] This invention relates to a system that provides users with a customized simulated romantic experience by interacting with a virtual character that is personalized based on information provided by the user. This system is constructed by combining multiple means, and operates in cooperation with three entities: a server, a terminal, and a user.
[2209] Basic system configuration
[2210] server
[2211] The server provides the following functionality:
[2212] 1. A means of providing an interface for users to enter information
[2213] 2. How we collect and store information entered by users
[2214] 3. A generator for generating a personalized virtual person based on user-entered information
[2215] 4. Means for providing a user with interaction with the personalized virtual person
[2216] 5. Means for generating an original story based on the dialogue
[2217] 6. Means for Providing the Story to Users
[2218] 7. Means for generating new missions and challenges as the story progresses and notifying the user
[2219] 8. Means of providing community features to support interaction between users
[2220] 9. Hosting online events and encouraging users to participate
[2221] Terminal
[2222] The terminal provides the following features:
[2223] 1. Login information input interface
[2224] 2. Profile entry screen
[2225] 3. Display of the generated virtual person
[2226] 4. Display of story data notified to the user
[2227] 5. Providing mission and challenge screens
[2228] 6. Community Participation Interface
[2229] 7. Interface for participating in online events
[2230] User
[2231] The user does the following:
[2232] 1. Launch the app, enter your email address and password on the login screen, and click the Login button.
[2233] 2. Enter your character information on the profile entry screen and click the Save button.
[2234] 3. Check the appearance and personality of the generated virtual persona and submit correction requests if necessary.
[2235] 4. Check the modified virtual person and proceed if you are satisfied.
[2236] 5. Enjoy the generated story.
[2237] 6. Take on a mission or challenge.
[2238] 7. Interact with other users and take advantage of community features and online events.
[2239] Specific examples
[2240] For example, it starts when a user launches the app and logs in. After entering their email address and password on the login screen and logging in, they are taken to a profile entry screen. Here, the user enters detailed information about their "favorite character." Once the information is entered, the server collects it and uses generation AI to generate a character.
[2241] The generated character is displayed on the user's device, and the user can confirm the character. If the user is satisfied, the server then generates an original story and provides it to the user. The user can then enjoy the story and take on missions and challenges. In addition, a community function is available for interacting with other users, and the user can also participate in online events.
[2242] Examples of prompt statements
[2243] Below are some examples of input prompts for generative AI models:
[2244] Generate a personalized virtual persona based on the following information provided by the user:
[2245] Name: Hanako Tanaka
[2246] Personality: Cheerful and active
[2247] Preferred type: Kind and intelligent people
[2248] Also, please generate an original pseudo-romance story featuring this character. The story setting is as follows:
[2249] Setting: Urban University
[2250] Meeting: A chance encounter at a campus event
[2251] The gist: Slowly develop the relationship
[2252] Using these prompts, the system can personalize the target characters and stories to provide the best experience for the user.
[2253] The flow of the identification process in the first embodiment will be described with reference to FIG.
[2254] Program processing flow
[2255] Step 1: User Login
[2256] server
[2257] When a user launches the app, they are presented with a login screen.
[2258] The email address and password entered by the user are received and authenticated.
[2259] If authentication is successful, you will be instructed to move to the next screen (profile input screen).
[2260] Terminal
[2261] Displays a login screen and provides an interface for entering an email address and password.
[2262] The information entered by the user is sent to the server.
[2263] The screen transition will be performed depending on the authentication result. If successful, the profile entry screen will be displayed, and if unsuccessful, an error message will be displayed.
[2264] User
[2265] Launch the app, enter your email address and password on the login screen, and click the Login button.
[2266] If authentication is successful, you will be taken to the profile entry screen.
[2267] Specific operation:
[2268] The user enters [email address] and [password] and clicks the login button.
[2269] The server receives the [entered email address and password], performs authentication in the database, and notifies the terminal of the authentication result (success / failure).
[2270] Based on the authentication result, the device will display a profile entry screen if successful, or an error message if unsuccessful.
[2271] Step 2: Enter your profile information
[2272] server
[2273] Provides a profile entry screen.
[2274] Receives character information entered by the user and stores it in a database.
[2275] Terminal
[2276] A profile input screen is displayed, providing an interface for users to input character information (such as name, personality, preferences, etc.).
[2277] The entered information is sent to the server.
[2278] User
[2279] Enter your character information on the profile entry screen and click the Save button.
[2280] Specific operation:
[2281] The user enters the character name, personality, and preferences, and clicks the save button.
[2282] The input information is sent from the terminal to the server.
[2283] The server stores the received data in a database.
[2284] Step 3: Send and generate character information
[2285] server
[2286] The character information received from the user is passed to the generative AI model.
[2287] A generative AI model generates the character's face, body type, voice, personality, etc.
[2288] The generated character data is stored in the server, and the information is notified to the terminal.
[2289] Terminal
[2290] The generated character data is received from the server.
[2291] The character's appearance and personality are displayed for the user to check.
[2292] User
[2293] Check the appearance and personality of the generated character, and if you are satisfied, proceed to the next step. If any changes are needed, submit a correction request.
[2294] Specific operation:
[2295] The server sends the user's character information to the AI generation module as a prompt sentence.
[2296] The AI generation module generates the character's face, body type, voice, and personality and returns the results to the server.
[2297] The server stores the generated results in a database and notifies the terminal.
[2298] The terminal displays the generated character to the user.
[2299] Step 4: Check and modify your character
[2300] server
[2301] Receive correction requests from the user and send them back to the generative AI model.
[2302] Generate and save the modified character data.
[2303] The corrections are notified to the terminal.
[2304] Terminal
[2305] The modified character data is received and redisplayed to the user.
[2306] User
[2307] Review the revised character and if you are satisfied, proceed to the next step.
[2308] Specific operation:
[2309] The user submits a modification request.
[2310] The server sends the modifications to the AI generation module as a prompt sentence, generating new character data.
[2311] The server stores the corrected data in a database and notifies the terminal.
[2312] The terminal redisplays the modified data to the user.
[2313] Step 5: Generate stories
[2314] server
[2315] The data is sent to a generative AI model to generate a pseudo-romance story based on the final character data.
[2316] The generated story data is saved and notified to the user.
[2317] Terminal
[2318] Receives story data and displays it to the user.
[2319] User
[2320] Enjoy the generated story.
[2321] Specific operation:
[2322] The server generates a prompt sentence based on the character data and sends it to the AI generation module.
[2323] The AI generation module generates the story and returns it to the server.
[2324] The server stores the story data in a database and notifies the device.
[2325] The device displays the story to the user.
[2326] Step 6: Story progression
[2327] server
[2328] Create a new story event and notify the user.
[2329] Terminal
[2330] View new event information.
[2331] User
[2332] Take part in new events and progress through the story.
[2333] Specific operation:
[2334] The server generates new events according to the progress of the story and notifies the device.
[2335] The terminal displays the new event to the user.
[2336] Users can participate in new events and progress through the story.
[2337] Step 7: Missions and Challenges
[2338] server
[2339] As the story progresses, new missions and challenges are generated and notified to the user.
[2340] Terminal
[2341] Provides mission and challenge screens.
[2342] User
[2343] Take on missions and challenges to advance the story.
[2344] Specific operation:
[2345] The server generates new missions and challenges and notifies the device.
[2346] The device displays missions and challenges to the user.
[2347] Users progress through the story by completing missions and challenges.
[2348] Step 8: Community engagement and event participation
[2349] server
[2350] It provides community functions to help users interact with each other.
[2351] Provide information about online events and encourage users to participate.
[2352] Terminal
[2353] It provides an interface for community participation and a screen for participating in online events.
[2354] User
[2355] Interact with other users and participate in community features and online events.
[2356] Specific operation:
[2357] The server provides community functions and online event information to the terminal.
[2358] The terminal displays a community participation interface and an online event participation screen to the user.
[2359] Users interact with other users and participate in online events.
[2360] (Application example 1)
[2361] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2362] Conventional simulated dating systems are unable to respond to diverse user feedback, making it difficult to provide a personalized, in-depth experience. Furthermore, they lack interaction between users and other interactive elements, making it difficult to achieve sustained user engagement. This makes it difficult to maintain user interest, and as a result, it is difficult to expect an increase in the number of users.
[2363] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[2364] In this invention, the server includes means for providing an interface for a user to input information, means for collecting and storing the information input by the user, means for generating a personalized character based on the information, means for providing the user with a dialogue with the personalized character, means for generating an original story based on the dialogue, means for providing the story to the user, means for generating an original drama using information received from the user, means for adding an interactive challenge to the original drama, and means for generating new missions and challenges based on the interactive challenge and providing them to the user. This makes it possible to provide an experience of interacting with a personalized character and promote sustained engagement through interactions between users and interactive missions.
[2365] An "interface for users to input information" is a means of providing a screen or form for users to input their own profile information, etc.
[2366] The "means for collecting and storing information input by the user" refers to a technique for transmitting information input by the user to the interface to a server and storing the information in a database.
[2367] The "generation means for generating a personalized character based on the information" refers to an algorithm or system for generating individual character data based on collected user information.
[2368] The "means for providing the user with the ability to interact with the personalized character" is a mechanism that allows the user to interact with the generated character.
[2369] The "means for generating an original story based on the dialogue" is a technique for creating a different storyline for each user based on the content of the dialogue with the character.
[2370] The "means for providing the story to the user" refers to a method for displaying or allowing the user to read the generated original story.
[2371] The "means for generating an original drama using information received from the user" is a technique for creating a personalized drama scenario based on input data from the user.
[2372] The "means for adding interactive challenges to the original drama" refers to a function for setting and adding tasks and missions that users can perform while the drama is in progress.
[2373] "Means for generating new missions and challenges based on the interactive challenge and providing them to the user" is a function for generating new tasks and challenges according to the user's progress and presenting them to the user.
[2374] System Overview
[2375] This system is an interactive simulated dating experience system that operates in cooperation with three entities: the user, the device, and the server. The user inputs information, which the device sends to the server. The server uses a generative AI model to generate personalized characters and stories, which are then provided to the user via the device. It also supports community functions and online events to promote interaction between users.
[2376] Hardware and Software
[2377] Hardware used
[2378] Server: Cloud platform (e.g. Amazon Web Services, Google Cloud Platform)
[2379] Device: Smartphone
[2380] Software used
[2381] Generative AI model: OpenAI's "GPT-4", and technologies such as "Stable Diffusion" for image generation
[2382] Login authentication: OAuth2.0
[2383] Database: MySQL or PostgreSQL
[2384] Program processing
[2385] User login and information entry
[2386] The server provides a login screen when a user launches the app on their smartphone. When the user enters their email address and password, the server authenticates the information using OAuth 2.0. If authentication is successful, the user is guided to a profile entry screen where they can enter information such as their hobbies and special skills.
[2387] Character Generation
[2388] The device sends the information entered by the user to the server. The server uses a generative AI model (GPT-4) to generate a personalized character based on the user's information. Furthermore, facial and body shape information is generated using image generation technology (Stable Diffusion). The generated character is stored on the server and notified to the user.
[2389] Story Generation
[2390] The device displays the generated character to the user and obtains the user's confirmation. The server then uses the generative AI model to generate an original drama scenario based on the user's interactions with the character. The generated story is saved on the server and notified to the user.
[2391] Adding Interactive Challenges
[2392] Based on the user's progress, the server generates and notifies the user of new missions and challenges, which are tasks the user can perform as the drama progresses, further personalizing the user's experience.
[2393] Community Interaction
[2394] The server provides a community function to promote interaction between users, allowing users to chat with other users and participate in online events. The terminal displays an interface to provide these functions to the user.
[2395] Specific examples
[2396] For example, when a user starts an app and logs in, they enter their email address and password on the login screen. After logging in, they are redirected to a profile entry screen where they enter information such as their hobbies and special skills. An example prompt is "User profile: [Name: Yamada Taro, Hobbies: Listening to music, Special skills: Guitar]."
[2397] Based on this information, the server uses a generative AI model to generate a character, and creates the face and body shape using image generation technology. The generated character information is stored on the server and sent to the user for confirmation. Once the character is confirmed, an original drama scenario is then generated. For example, based on the information "Favourite character: [Name: Hanako, Personality: Cheerful and energetic, Hobby: Watching movies]", a story is generated in which Hanako recommends movies to Yamada Taro.
[2398] As the story progresses, users can receive new missions from the server and deepen their relationships with their characters by taking on these tasks. Users can also use the community function to interact with other users and participate in online events.
[2399] Prompt Sentence Examples
[2400] User profile: [Name: Yamada Taro, Hobbies: Listening to music, Special skills: Guitar]
[2401] Favorite character: [Name: Hanako, Personality: Cheerful and energetic, Hobby: Watching movies]
[2402] As described above, this system promotes sustained engagement by providing personalized character interactions and drama experiences.
[2403] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[2404] Step 1:
[2405] A user launches the app using their smartphone and enters their email address and password on the login screen. The device collects this information and sends it to the server. The server authenticates the login information using OAuth2.0. If authentication is successful, the server provides the user with a profile entry screen.
[2406] Input: Email address, password
[2407] Output: Authentication result (success / failure), profile entry screen
[2408] How it works: The user enters their email address and password, which the device sends to the server. The server authenticates them and, if successful, displays the following screen.
[2409] Step 2:
[2410] The user enters their information (name, hobbies, special skills, etc.) on the profile entry screen. The device collects the entered information and sends it to the server. The server stores this information in a database.
[2411] Input: Name, hobbies, special skills
[2412] Output: Save result (success / failure), character generation request
[2413] How it works: The user enters profile information, and the device sends it to the server, which stores it and then starts character generation.
[2414] Step 3:
[2415] The server uses a generative AI model (GPT-4) to generate a personalized character based on the user's profile information stored in the database. The character's face and body shape are generated using image generation technology (Stable Diffusion). The generated character data is stored on the server and sent to the device.
[2416] Input: User profile information
[2417] Output: Character data (face, body type, voice, personality)
[2418] How it works: The server uses generative AI to generate the character's personality and background, and creates the appearance using image generation technology. The results are stored in a database and sent to the device.
[2419] Step 4:
[2420] The device displays the generated character data to the user. The user checks the character's appearance and personality, and if necessary, sends a request for modification to the server via the device. The server receives the modification request, updates the character data using the generation AI, and sends it back to the device.
[2421] Input: Correction request
[2422] Output: Updated character data
[2423] How it works: The user checks the character details and sends a request from the device if any corrections are needed. The server updates the data using the generated AI and displays it again on the device.
[2424] Step 5:
[2425] The server generates an original pseudo-romance story using a generative AI model based on the final character data, and the generated story is saved on the server and notified to the user.
[2426] Input: Final character data
[2427] Output: Original story data
[2428] How it works: The server uses a generation AI to generate a storyline based on character data, saves the data, and notifies the user.
[2429] Step 6:
[2430] The device displays the generated story data to the user. The user enjoys the original story while receiving new missions and challenges based on the ongoing story. The server monitors the user's progress and generates interactive challenges.
[2431] Input: Story data, user progress
[2432] Output: Interactive challenge, mission data
[2433] How it works: The user progresses through the story, receives new missions and challenges from the server, and tackles them.
[2434] Step 7:
[2435] The server provides a community function to promote interaction between users and provides users with information about online events. The terminal displays an interface for participating in the community and online events. Users can interact with other users and participate in online events.
[2436] Input: Community information, online event information
[2437] Output: User interaction data, event participation data
[2438] How it works: Users use the community feature to connect with other users and deepen their engagement by participating in online events.
[2439] Prompt Sentence Examples
[2440] User profile: [Name: Yamada Taro, Hobbies: Listening to music, Special skills: Guitar]
[2441] Favorite character: [Name: Hanako, Personality: Cheerful and energetic, Hobby: Watching movies]
[2442] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[2443] The present invention relates to a system that provides a user with a customized simulated romance experience by interacting with a character personalized based on information provided by the user. The system incorporates an emotion engine to add functionality that recognizes the user's emotions and dynamically adjusts the dialogue with the character and story generation based on those emotions. A specific embodiment of the present invention is described below.
[2444] System Overview
[2445] The system works in collaboration between three entities: the user, the device, and the server. The user inputs information, which the device sends to the server. The server uses generative AI based on the collected information to generate personalized characters and stories, which are then provided to the user via the device. Furthermore, an emotion engine recognizes the user's emotions and optimizes the content of the dialogue, the story, and community interactions.
[2446] Program processing
[2447] User login and information entry
[2448] server
[2449] 1. When a user launches the app, a login screen is displayed. Login information (email address, password) is received and authentication is performed. After successful authentication, a user profile entry screen is displayed.
[2450] Terminal
[2451] 1. Provide a login information input interface and send the information entered by the user to the server.
[2452] User
[2453] 1. Enter your email address and password and click the Login button. After logging in, enter the details of your favorite character on the profile entry screen.
[2454] Character Generation
[2455] server
[2456] 1. Information about the user's favorite character is passed to the AI generator, which generates data such as the character's face, body type, voice, personality, etc. The generated character data is stored on the server and notified to the user.
[2457] Terminal
[2458] 1. Receive the generated character data and display it to the user.
[2459] User
[2460] 1. Check the character's appearance and personality, and submit a revision request if necessary.
[2461] Story Generation
[2462] server
[2463] 1. Receive the correction request and update the corrected character data with the generation AI. Generate an original pseudo-romance story based on the final character data. Save the generated story and notify the user.
[2464] Terminal
[2465] 1. Receive story data and display it to the user.
[2466] User
[2467] 1. Receive notifications and enjoy original stories.
[2468] Dialogue adjustment using emotion engine
[2469] server
[2470] 1. Recognize the user's emotions using an emotion engine. Dynamically adjust the dialogue content based on the recognized emotion information.
[2471] Terminal
[2472] 1. Providing tailored interaction content to users.
[2473] User
[2474] 1. Enjoy interacting with the characters based on the dialogue provided.
[2475] Customize stories based on sentiment data
[2476] server
[2477] 1. Collect user emotional data and customize the story content based on that data. Save the customized story and provide it to the user.
[2478] Terminal
[2479] 1. Receive customized story data and display it to the user.
[2480] User
[2481] 1. Enjoy a customized story.
[2482] Optimizing community interaction
[2483] server
[2484] 1. Recognize users' emotions using an emotion engine and optimize interactions within the community function based on those emotions. Additionally, provide information about online events and encourage participation.
[2485] Terminal
[2486] 1. Provide an interface for community participation and online event participation.
[2487] User
[2488] 1. Interact with other users and participate in online events.
[2489] Specific examples
[2490] For example, it starts when a user launches the app and logs in. After entering their email address and password on the login screen, they are taken to a profile entry screen. Here, the user enters detailed information about their "oshi." Once the information is entered, the server collects it and uses generation AI to generate a character.
[2491] The generated character is displayed on the user's device, and the user confirms it. If the user is satisfied, the server then generates an original story and provides it to the user. As the user enjoys the story, the emotion engine analyzes the user's emotions, and the dialogue content and story details are dynamically adjusted based on those emotions.
[2492] In addition, the emotion engine also optimizes community features and online events. For example, if a user is feeling stressed, it can provide information about events to help them relax. Through these features, users can enjoy a more personalized and realistic experience.
[2493] This invention allows users to realistically experience conversations and stories with their ideal "oshi" (favorite person), which makes it possible to provide a personalized and in-depth experience, unlike conventional limited pseudo-romance apps.
[2494] The processing flow will be explained below.
[2495] Step 1:
[2496] When a user launches the app, the login screen appears. The user enters their email address and password and clicks the login button.
[2497] Step 2:
[2498] The device sends login information to the server. The server receives the login information and performs user authentication. If authentication is successful, the home screen is displayed.
[2499] Step 3:
[2500] The server displays a profile entry screen to the user, allowing the user to enter detailed information about their favorite character (such as name, date of birth, birthplace, blood type, and social media information).
[2501] Step 4:
[2502] The user enters the details of their favorite character and clicks the send button. The device sends the entered information to the server.
[2503] Step 5:
[2504] The server passes the information received from the user to the generation AI, which then generates data such as the face, body type, voice, and personality of the character. The generated character data is stored on the server and notified to the user.
[2505] Step 6:
[2506] The terminal displays the character data received from the server to the user, who then checks the character and sends a correction request if necessary.
[2507] Step 7:
[2508] The server receives the modification request and updates the character data using the generation AI. The server then determines the final character data and generates an original pseudo-romance story based on it. The generated story is saved and notified to the user.
[2509] Step 8:
[2510] The device displays the story data received from the server to the user, who then enjoys the story.
[2511] Step 9:
[2512] The emotion engine analyzes the user's reactions and inputs to recognize the user's emotions, and sends the emotion information to the server.
[2513] Step 10:
[2514] The server receives the user's emotional information and dynamically adjusts the dialogue content using the generative AI. The adjusted dialogue content is saved and notified to the user.
[2515] Step 11:
[2516] The terminal displays the adjusted dialogue content to the user, who then enjoys the dialogue with the character.
[2517] Step 12:
[2518] The server collects the user's emotional data and customizes the content of the story based on that data. The customized story is then saved and provided to the user.
[2519] Step 13:
[2520] The device displays the customized story data to the user, who then enjoys the new story.
[2521] Step 14:
[2522] The server uses an emotion engine to recognize users' emotions and optimizes interactions within the community function based on those emotions. It also distributes information about online events and encourages participation.
[2523] Step 15:
[2524] The device provides an interface for participating in communities and online events, allowing users to interact with other users and participate in events.
[2525] The above are the specific processing steps in the system of the present invention.
[2526] Example 2
[2527] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2528] Modern dating apps struggle to provide users with personalized experiences. Systems that can analyze users' emotional states in real time and dynamically adjust dialogue and storylines based on those data are particularly needed. Furthermore, there are challenges with optimizing user interactions, community building, and online events, and technology is needed to address these challenges.
[2529] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for providing an interface for a user to input information, a means for collecting and saving the information input by the user, a generation means for generating a personalized character based on the information, a means for providing the user with a dialogue with the personalized character, a means for recognizing the user's emotions using an emotion engine and dynamically adjusting the content of the dialogue, a means for generating an original story based on the dialogue, and a means for providing the story to the user. This makes it possible to provide dialogue and stories personalized according to the individual emotional state of the user.
[2530] An "interface for a user to input information" is a graphical user interface that is provided for a user to input information such as a name, email address, and password.
[2531] The "means for collecting and saving information input by the user" is a function for storing data input by the user in a storage such as a database.
[2532] A "generator for generating a personalized character" is a method or algorithm that automatically creates an individually customized character based on information entered by a user.
[2533] The "means for providing the user with a dialogue with a personalized character" is a function that allows the generated character to converse with the user in real time.
[2534] An "emotion engine" is an algorithm or technology that analyzes emotions from a user's words and actions and recognizes their emotional state.
[2535] The "means for generating an original story based on the dialogue" is an algorithm for creating a new story, taking into consideration the content of the dialogue with the character and the emotional state of the user.
[2536] The "means for providing a story to a user" is a function for displaying the generated story in a form that can be viewed or experienced by a user.
[2537] "Modification means for adjusting appearance, body type, voice, and personality" is a function for changing various attributes of the generated character based on the user's request.
[2538] The "means for providing a regenerated story" is a function for providing a user with a story that has been regenerated based on the corrected character information.
[2539] The "means for collecting emotional data and customizing story content based on that data" refers to an algorithm that collects emotional information about users and uses that information to individually tailor stories.
[2540] The "community function to support interaction between users" is a platform that allows multiple users to send and receive messages and share information with each other.
[2541] "Means for holding online events and encouraging users to participate" is a function for holding events such as webinars and live chats over the Internet and inviting users to participate.
[2542] "Means for optimizing interactions within the community" refers to algorithms and technologies that use an emotion engine to make communication between users efficient and meaningful.
[2543] This invention is a system that allows users to interact with personalized characters based on information provided by the user, providing a customized simulated romance experience. The system operates in cooperation with three entities: the user, the terminal, and the server. Specific embodiments of the invention are described below.
[2544] System Overview
[2545] The system starts when the user inputs information, which the device sends to the server. The server uses a generative AI model based on the collected information to generate personalized characters and stories, which are then provided to the user via the device. Furthermore, an emotion engine recognizes the user's emotions and optimizes the dialogue, story, and community interactions.
[2546] User login and information entry
[2547] server
[2548] When a user launches the app, a login screen is first displayed. Login information (email address, password) is received and authentication is performed. After authentication is successful, a user profile entry screen is displayed.
[2549] Terminal
[2550] A login screen is displayed, providing an interface for the user to enter their email address and password. The information entered by the user is sent to the server.
[2551] User
[2552] Users launch the app, enter their email address and password, and then enter detailed information about their favorite character on the profile entry screen.
[2553] Character Generation
[2554] server
[2555] The information about the character received from the user is passed to the generative AI model. The generative AI model generates data such as the character's face, body type, voice, and personality, and stores this on the server. The user is notified when generation is complete.
[2556] Terminal
[2557] The generated character data is received and displayed to the user.
[2558] User
[2559] The user checks the character's appearance and personality displayed on the terminal and sends a request for modification if necessary.
[2560] Story Generation
[2561] server
[2562] Receives correction requests from users and updates the corrected character data in the generative AI model. Generates an original pseudo-romance story based on the final character data and saves it on the server. Notifies the user when saving is complete.
[2563] Terminal
[2564] The generated story data is received and displayed to the user.
[2565] User
[2566] Users receive notifications and enjoy original stories.
[2567] Dialogue adjustment using emotion engine
[2568] server
[2569] The emotion engine recognizes the user's emotions and dynamically adjusts the dialogue content based on the recognized emotion information.
[2570] Terminal
[2571] The adjusted dialogue content is received and provided to the user.
[2572] User
[2573] Enjoy interacting with the characters based on the dialogue provided.
[2574] Customize stories based on sentiment data
[2575] server
[2576] Collects user emotional data and customizes the story content accordingly. Generates the customized story and saves it on the server. Notifies the user when saving is complete.
[2577] Terminal
[2578] Receive customized story data and display it to the user.
[2579] User
[2580] Users enjoy customized stories.
[2581] Optimizing community interaction
[2582] server
[2583] It uses an emotion engine to recognize users' emotions and optimize interactions within the community function based on those emotions. It also provides information about online events and encourages participation.
[2584] Terminal
[2585] Provides an interface for community participation and online event participation.
[2586] User
[2587] Users interact with other users and participate in online events.
[2588] Specific examples
[2589] For example, the flow when a user launches an app and logs in is shown below. The user enters their email address and password on the login screen, and after logging in, they are taken to a profile entry screen. Here, the user enters detailed information about their "favorite character." This information is sent to the server, which uses that information to generate a character using a generative AI model. The generated character is displayed on the user's device. The user checks the character's appearance and personality, and submits revision requests as needed. If satisfied, the server then generates an original story and provides it to the user. The user enjoys the story. During the story experience, the emotion engine analyzes the user's emotions, and the dialogue content and story are dynamically adjusted based on the results. The emotion engine also optimizes community functions and online events. For example, if the user is feeling stressed, it provides information about events to help them relax. Through these functions, users can enjoy a personalized, realistic experience.
[2590] Prompt Sentence Examples
[2591] Here are some example prompts to input to a generative AI model:
[2592] "Generate a personalized character based on user-entered information. Generate details including the character's face, body type, voice, and personality."
[2593] "Generate the most appropriate dialogue content for the user based on the following emotional data: Emotional state: joy, Content: words of praise or positive dialogue content."
[2594] "Customize an original fictional story based on your emotional data. Emotional situation: Sadness. Content: A story with a gentle tone to soothe your emotions."
[2595] The flow of the identification process in the second embodiment will be described with reference to FIG.
[2596] Step 1: Display the user login screen and enter information
[2597] server
[2598] When a user launches the app, a login screen is provided, displaying an interface for entering login information (email address, password) and collecting that information.
[2599] Terminal
[2600] Displays a login screen and provides fields for the user to enter their email address and password.
[2601] User
[2602] The user launches the app, enters their email address and password, and then clicks the login button.
[2603] concrete action
[2604] Input: Email address, password
[2605] Output: Sending input data to the server
[2606] Step 2: User authentication and profile entry screen display
[2607] server
[2608] The received login information is checked against a database to authenticate it, and if authentication is successful, the user is presented with a profile entry screen.
[2609] Terminal
[2610] A notification of successful authe...
Claims
1. means for providing an interface for a user to input information; means for collecting and storing information entered by said user; generation means for generating a personalized character based on the information; means for providing a user with interaction with the personalized character; means for generating an original story based on the dialogue; means for providing the story to a user; A system including:
2. Modifications to adjust the generated character's appearance, body type, voice, and personality, and means for providing a regenerated story based on the adjusted character; The system of claim 1 further comprising:
3. A means for providing a community function for supporting interactions between users; means for hosting an online event and encouraging said users to participate; The system of claim 1 further comprising:
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A