System
The system assists users in discovering new hobbies by inputting basic information, using generative AI for suggestions, and offering detailed information and support, addressing the challenge of finding suitable hobbies post-retirement.
Patent Information
- Application Number
- JP2024131448
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-07
- Publication Date
- 2026-02-20
AI Technical Summary
Middle-aged and older individuals face difficulty in finding a suitable hobby after retirement due to the vast amount of online information, making it challenging to identify hobbies that align with their interests and budget, and existing systems lack comprehensive support for starting new hobbies.
A system that includes an input means for basic information, information collection, proposal generation using generative AI, presentation of hobby suggestions, detailed information acquisition, and company introduction to facilitate the discovery and initiation of new hobbies.
Enables users to easily find and start new hobbies by providing tailored hobby suggestions and detailed information, along with necessary services and goods, overcoming the limitations of conventional systems.
Smart Images

Figure 2026028832000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] For middle-aged and older people who have prioritized family and work for many years, finding a new hobby after retirement can be difficult. Furthermore, there is a lot of information available online, making it difficult to narrow down the hobby that best suits you. This creates the challenge of many people being unable to find the right hobby and thus unable to enjoy a fulfilling life after retirement. [Means for solving the problem]
[0005] To solve these problems, the present invention provides an input means for inputting basic information about a user, and further provides an information collection means for acquiring this basic information. It also provides a proposal generation means for generating hobby proposals based on the acquired basic information, and a presentation means for presenting these proposals to the user. It also provides a detailed information acquisition means for acquiring detailed information related to the hobby selected by the user, and a hobby detail presentation means for presenting this detailed information to the user. Finally, it constructs a system that provides a company introduction means for introducing business partners that provide services and goods necessary for the pursuit of the hobby. These means allow users to easily find a new hobby and receive support for starting it.
[0006] "Basic user information" is information necessary for a user to find a new hobby, and includes age, address, gender, desired hobby, budget, areas of interest, and the like.
[0007] The "input means" is an interface for the user to input basic information about himself / herself, and takes the form of a form, questionnaire, or the like.
[0008] "Information collection means" refers to means for acquiring and recording basic information entered by the user, and includes sending data to a server and storing it in the cloud.
[0009] The "suggestion generation means" is a means for generating hobby suggestions suitable for the user based on the collected basic information, and uses generation AI or algorithms, etc.
[0010] The "presentation means" is a means for presenting the generated hobby suggestions to the user in a visual or text format, and includes a display or a screen display.
[0011] The "means for obtaining detailed information" refers to a means for obtaining detailed information related to the hobby selected by the user, and includes database searches, online information acquisition, and the like.
[0012] The "interest detail presentation means" is a means for presenting the acquired hobby detail information to the user, and includes a display, a printout, and the like.
[0013] The "company introduction means" is a means for introducing companies that provide services and goods necessary for users to pursue their hobbies, and includes linking and recommendation functions. [Brief explanation of the drawings]
[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0016] First, the terms used in the following description will be explained.
[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0022] [First embodiment]
[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0035] The present invention is a system for inputting basic information of a user, proposing new hobbies based on the input information, and providing specific detailed information. This system includes an input means for inputting the user's basic information, an information collection means, a proposal generation means for generating hobby proposals, a presentation means for presenting the generated proposals, a detailed information acquisition means for acquiring detailed information about a hobby selected by the user, a hobby detail presentation means for presenting the detailed information, and a company introduction means for introducing business partners.
[0036] Program processing
[0037] Basic information input phase
[0038] Step 1: Displaying the input form
[0039] The server generates a form for entering basic information about the user and sends it to the terminal.
[0040] The terminal displays the submitted input form to the user.
[0041] Step 2: Enter basic information
[0042] The user fills in the form that appears with information such as age, address, gender, indoor / outdoor preferences, initial investment amount, monthly expenses, and interests.
[0043] The terminal transmits the information entered by the user to the server.
[0044] Hobby proposal phase
[0045] Step 1: Gather information
[0046] The server obtains and records the user's input information.
[0047] Step 2: Generate interest suggestions
[0048] The server uses a generation AI based on the acquired information to generate a list of hobbies suitable for the user.
[0049] The server transmits the generated interest list to the terminal.
[0050] As a concrete example, if a 60-year-old male user enters the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that monthly costs are within 10,000 yen, the generating AI will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips."
[0051] Hobby Detail Guide Phase
[0052] Step 1: Choose a hobby
[0053] The user selects a hobby that interests them from a list of suggested hobbies.
[0054] The terminal transmits the user's selection to the server.
[0055] Step 2: View hobby details
[0056] The server obtains detailed information about the selected hobby and transmits the information to the terminal.
[0057] The terminal displays detailed information to the user.
[0058] As a specific example, if the user selects "photography," the server provides an overview of photography, how to get started, available photo spots, required initial costs, and monthly maintenance fees.
[0059] Support and Account Introduction Phase
[0060] Step 1: Introducing services and goods
[0061] The server acquires information about companies that provide services and goods necessary for the user to start a hobby and transmits that information to the terminal.
[0062] The terminal displays the company information to the user.
[0063] As specific examples, we will introduce camera shops, photography classes, and editing software providers, all of which are related to photography.
[0064] In this way, users can easily discover new hobbies and receive specific support to get started in those hobbies.
[0065] The processing flow will be explained below.
[0066] The present invention is a system for inputting basic information of a user, proposing new hobbies based on the input information, and providing specific detailed information. This system includes an input means for inputting the user's basic information, an information collection means, a proposal generation means for generating hobby proposals, a presentation means for presenting the generated proposals, a detailed information acquisition means for acquiring detailed information about a hobby selected by the user, a hobby detail presentation means for presenting the detailed information, and a company introduction means for introducing business partners.
[0067] Program processing
[0068] Basic information input phase
[0069] Step 1:
[0070] The server generates a form for entering basic information about the user and sends it to the terminal.
[0071] Step 2:
[0072] The terminal displays the submitted input form to the user.
[0073] Step 3:
[0074] The user is presented with a form to enter the following information:
[0075] age
[0076] address
[0077] sex
[0078] Indoor and outdoor desires
[0079] Initial investment costs
[0080] Monthly costs
[0081] Interests
[0082] Step 4:
[0083] The terminal transmits the information entered by the user to the server.
[0084] Hobby proposal phase
[0085] Step 5:
[0086] The server obtains and records the user's input information.
[0087] Step 6:
[0088] The server uses a generation AI based on the acquired information to generate a list of hobbies suitable for the user.
[0089] Step 7:
[0090] The server transmits the generated interest list to the terminal.
[0091] Step 8:
[0092] The terminal displays the hobby list to the user.
[0093] As a concrete example, if a 60-year-old male user enters the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that monthly costs are within 10,000 yen, the generating AI will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips."
[0094] Hobby Detail Guide Phase
[0095] Step 9:
[0096] The user selects a hobby that interests them from a list of suggested hobbies.
[0097] Step 10:
[0098] The terminal transmits the user's selection to the server.
[0099] Step 11:
[0100] The server obtains detailed information about the selected hobby and transmits the information to the terminal.
[0101] Step 12:
[0102] The terminal displays the detailed information to the user.
[0103] As a specific example, if the user selects "photography," the server provides an overview of photography, how to get started, available photo spots, required initial costs, and monthly maintenance fees.
[0104] Support and Account Introduction Phase
[0105] Step 13:
[0106] The server acquires information about companies that provide services and goods necessary for the user to start a hobby and transmits that information to the terminal.
[0107] Step 14:
[0108] The terminal displays the company information to the user.
[0109] As specific examples, we will introduce camera shops, photography classes, and editing software providers, all of which are related to photography.
[0110] In this way, users can easily discover new hobbies and receive specific support to get started in those hobbies.
[0111] Example 1
[0112] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0113] Conventional hobby suggestion systems have limited suggestions to users, making it difficult to provide comprehensive information on a wide range of hobbies. They also lacked a mechanism for properly presenting specific hobby suggestions and detailed information tailored to a user's interests and budget. Furthermore, they were unable to properly introduce related services and product providers for pursuing a hobby, resulting in insufficient support for users starting a new hobby.
[0114] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0115] In this invention, the server includes an input means for inputting basic information about the user, an information collection means for acquiring the basic information, a proposal generation means for generating a prompt sentence using a generative AI model based on the basic information and generating hobby proposals suitable for the user, a presentation means for presenting the generated hobby proposals to the user, a detailed information acquisition means for acquiring detailed information related to the selected hobby, a hobby detail presentation means for presenting detailed information about the hobby to the user, and a company introduction means for introducing business partners that provide services and goods necessary for practicing the hobby. This makes it possible to propose specific and appropriate hobbies that suit the interests and budgets of a variety of users, and allows users to receive detailed information and related services to start a new hobby.
[0116] "Input means" is a function that provides an interface for the user to input basic information.
[0117] "Information collection means" is a function that acquires and records basic information entered by the user.
[0118] The "suggestion generation means" is a function in which the generative AI model generates prompt sentences based on the acquired basic information and creates hobby suggestions suitable for the user.
[0119] The "presentation means" is a function that displays the generated hobby suggestions to the user.
[0120] The "detailed information acquisition means" is a function for collecting detailed information about the hobby selected by the user.
[0121] The "interest detail presentation means" is a function that displays detailed information about the acquired interest to the user.
[0122] The "company introduction means" is a function that introduces business partners that provide services and goods necessary for carrying out a hobby.
[0123] A "generative AI model" is an artificial intelligence algorithm that generates appropriate suggestions for a user based on input prompts.
[0124] A "prompt sentence" is a sentence to be input into a generative AI model, and is created based on basic information about the user.
[0125] The present invention relates to a system for suggesting new hobbies based on a user's basic information and providing detailed information. The system includes an input means, an information collection means, a suggestion generation means, a presentation means, a detailed information acquisition means, a hobby detail presentation means, and a company introduction means.
[0126] The input means is an interface for users to enter basic information, and is provided as an HTML web form. The information collection means has the function of receiving the basic information entered by the user and recording it in a database. For the server to perform these basic processes, an Apache server or Nginx server, for example, can be used.
[0127] The suggestion generation means has a function in which a generative AI model generates prompt sentences based on the acquired basic information and creates a list of hobbies suitable for the user. A natural language generation model such as OpenAI GPT-3 can be used as the generative AI model. This suggestion generation means suggests hobbies that match the user's interests and budget.
[0128] As a concrete example, if a 60-year-old male user is interested in "scenery" and "travel," and inputs the conditions that the initial cost is 30,000 yen and the monthly cost is within 10,000 yen, the following prompt sentence will be generated:
[0129] "60-year-old male, interested in scenery and travel. Initial cost: less than 30,000 yen, monthly cost: less than 10,000 yen. Please suggest a new hobby that meets these conditions."
[0130] The generated hobby suggestions are displayed to the user via a presentation means. In this process, the device plays a role in displaying the generated hobby list to the user. When the user selects an interest from the suggested hobbies, detailed information about the selected hobby is obtained from a database or an external API via a detailed information obtaining means.
[0131] Detailed information is displayed to the user through a hobby detail presentation means. For example, if the user selects "photography," the server provides an overview of photography, how to get started, photo spots, and the required initial costs and monthly maintenance fees.
[0132] Furthermore, the company introduction means has a function of collecting information on business partners that provide services and goods necessary for carrying out hobbies and introducing this information to the user. For example, information on "camera shops," "photography classes," and "editing software providers" related to "photography" is displayed.
[0133] In this way, users can easily find new hobbies and receive detailed information and support related to them, which solves the problems of conventional hobby suggestion systems, such as the lack of diverse suggestions and specific support.
[0134] The above is a specific embodiment of the present invention. The overall flow of the present invention and the detailed functions of each element allow users to discover new hobbies and receive specific guidance for starting them.
[0135] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0136] Step 1:
[0137] The server generates an HTML input form for the user to enter basic information. The generated input form includes fields such as the user's age, address, gender, indoor / outdoor preferences, available initial investment, monthly expenses, and interests. The server sends the generated input form to the terminal as an HTTP response, which displays the input form in the terminal's browser.
[0138] Input: None
[0139] Output: HTML input form
[0140] Specific behavior:
[0141] When the user opens the browser on their device, an input form is displayed.
[0142] Step 2:
[0143] The user enters the required basic information into the displayed input form. The device converts the information entered by the user into JSON data and sends it to the server via an HTTP POST request. The server parses the received JSON data and obtains the user's basic information.
[0144] Input: Basic information entered by the user
[0145] Output: JSON data
[0146] Specific behavior:
[0147] The user fills out the form and clicks the "Submit" button.
[0148] Step 3:
[0149] The server records the user's basic information in a database. Based on the recorded basic information, the server generates a prompt to be input into the generative AI model. The generated prompt might be something like, "60-year-old male, interested in scenery and travel. Initial cost: less than 30,000 yen, monthly cost: less than 10,000 yen. Please suggest a new hobby that meets these conditions."
[0150] Input: User basic information
[0151] Output: prompt statement
[0152] Specific behavior:
[0153] The server generates a prompt sentence such as "60-year-old male, interested in scenery and travel. Initial cost: less than 30,000 yen, monthly cost: less than 10,000 yen. Please suggest a new hobby that meets these conditions."
[0154] Step 4:
[0155] The server inputs the generated prompt into the generative AI model, which analyzes the prompt and generates a list of hobbies suitable for the user. The list is converted into JSON format and sent from the server to the device, which then displays the received list of hobbies to the user.
[0156] Input: prompt statement
[0157] Output: Hobby list
[0158] Specific behavior:
[0159] Based on the user's criteria, the AI suggests hobbies such as "photography," "walking," "gardening," "historical exploration," and "road trips," and displays them in a list format.
[0160] Step 5:
[0161] The user selects the hobby they are interested in from the presented hobby list. The device converts the user's selection information into JSON format and sends it to the server.
[0162] Input: User's selected hobby
[0163] Output: JSON data
[0164] Specific behavior:
[0165] The user selects "Take a photo" from the list.
[0166] Step 6:
[0167] The server retrieves detailed information about the user's selected hobbies from a database or external API, converts the information into JSON format, and sends it to the device, which then displays the retrieved details to the user.
[0168] Input: User-selected hobby information
[0169] Output: Hobby details
[0170] Specific behavior:
[0171] The user checks detailed information about "photography" (for example, necessary equipment, how to get started, photo spots, estimated costs, etc.) on the device screen.
[0172] Step 7:
[0173] The server also retrieves information about companies that provide services and goods necessary for the user's hobby from a database or external API, converts the information into JSON format, and sends it to the device, which then displays the retrieved information to the user.
[0174] Input: User-selected hobby
[0175] Output: Company information
[0176] Specific behavior:
[0177] Users can check information related to photography, such as camera shops, photography classes, and editing software providers.
[0178] Through the above steps, users can find new hobbies and receive detailed information and related services.
[0179] (Application example 1)
[0180] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0181] Conventional systems provide insufficient support for users to discover new hobbies, especially lacking the ability to provide information on physical stores related to the hobby. This leaves users with the inconvenience of having to search for specific information and physical stores needed to start a hobby. Furthermore, detailed information on suggested hobbies cannot be easily obtained, which can create a high barrier to entry in the early stages of starting a hobby.
[0182] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0183] In this invention, the server includes an input means for inputting basic information about a user, an information collection means for acquiring the basic information, a proposal generation means for generating hobby proposals based on the basic information, a presentation means for presenting the hobby proposals generated by the proposal generation means to the user, a detailed information acquisition means for acquiring detailed information related to the hobby selected by the user, a hobby detail presentation means for presenting the detailed hobby information acquired by the detailed information acquisition means to the user, a company introduction means for introducing business partners that provide services and goods necessary for practicing the hobby presented by the hobby detail presentation means, and a store information presentation means for acquiring information about physical stores related to the hobby and presenting it to the user. This makes it easier for users to find new hobbies and enables them to quickly and efficiently obtain specific information and physical store information related to their hobbies.
[0184] "Input means" refers to the device or software functions that allow the user to input basic information.
[0185] "Information collection means" is a function that acquires the input basic information and sends it to the server.
[0186] The "suggestion generation means" is a function that uses a generation AI to generate hobby suggestions based on the acquired basic information.
[0187] The "presentation means" is a function that displays the generated hobby suggestions to the user.
[0188] The "detailed information acquisition means" is a function for acquiring detailed information related to the hobby selected by the user.
[0189] The "interest detail presentation means" is a function that displays detailed information about the acquired interest to the user.
[0190] The "company introduction means" is a function that introduces the user to business partners that provide services and goods necessary for carrying out the hobby.
[0191] The "store information presentation means" is a function that acquires information about physical stores related to the hobby selected by the user and displays it to the user.
[0192] The system for implementing this invention acquires basic information about a user, suggests new hobbies based on that information, and provides detailed information about the hobbies and information about brick-and-mortar stores. Specifically, the system is composed of the following means:
[0193] Hardware and Software Configuration
[0194] Hardware
[0195] Devices: smartphones, tablets, PCs
[0196] Server: Used for data processing and running generative AI models
[0197] software
[0198] Generative AI models: OpenAI GPT-4 as an example
[0199] Database management system: MySQL, etc.
[0200] Front-end: Web frameworks such as React and Angular
[0201] Backend: Node.js, Python, etc.
[0202] Program processing overview
[0203] Basic information input phase
[0204] The server generates an input form for the user to enter basic information and sends it to the terminal. When the user enters basic information such as age, gender, address, hobbies, initial costs, and monthly costs on the terminal, the terminal sends this information to the server.
[0205] Hobby proposal phase
[0206] The server uses a generative AI model to generate hobby suggestions based on the acquired user's basic information. The generated hobby list is sent to the device and presented to the user. For example, if a 60-year-old male user is interested in "scenery" and "travel," and inputs the conditions that the initial cost is 30,000 yen and the monthly cost is within 10,000 yen, the generative AI model will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips." These hobby suggestions are made using the following prompts:
[0207] A 60-year-old male interested in scenery and travel, with initial costs of 30,000 yen and monthly costs of less than 10,000 yen. Please suggest four to five new hobbies.
[0208] Hobby Detail Guide Phase
[0209] When a user selects a hobby that interests them from the hobby list, the selection information is sent to the server. The server obtains detailed information about the selected hobby and sends it to the terminal. The user can view this detailed information on the terminal. For example, if a user selects "photography," an overview of photography, how to get started, photo spots, required initial costs, and monthly maintenance fees are provided.
[0210] Please provide more information about your hobby "photography".
[0211] Support and Account Introduction Phase
[0212] The server collects information on partner companies that offer services and goods related to the user's selected hobby and sends it to the user's device. This allows the user to easily find the services and goods of partner companies. At the same time, the server also obtains information on physical stores related to the hobby and presents it to the user, providing information on nearby stores that the user can actually visit.
[0213] As a specific example, if you select "Photography," information about physical camera shops, photography classes, and camera maintenance services will be displayed.
[0214] In this way, the present invention realizes a system that makes it easy for users to find new hobbies and provides specific detailed information and brick-and-mortar store information quickly and efficiently.
[0215] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0216] Step 1:
[0217] The server generates an input form for inputting basic information of the user and sends it to the terminal.
[0218] Input: Database connection information at system startup
[0219] Data processing: Generate an HTML input form
[0220] Output: The generated input form
[0221] Specific behavior: Displays a form for the user to enter basic information (age, gender, address, hobbies, initial costs, monthly costs, etc.).
[0222] Step 2:
[0223] The user uses the terminal to enter basic information into the input form and clicks the send button.
[0224] Input: Basic user information entered in the form
[0225] Data processing: Convert the input data into JSON format
[0226] Output: Basic information in JSON format
[0227] What happens: The user enters all the desired information and clicks the submit button, which sends the data to the server.
[0228] Step 3:
[0229] The server receives the basic information sent from the terminal and stores the information in a database.
[0230] Input: Basic information in JSON format
[0231] Data processing: Converting data into a format for saving to a database
[0232] Output: Basic information stored in the database
[0233] Specific operation: The server registers basic information in the database, making it available for the next process.
[0234] Step 4:
[0235] The server generates hobby suggestions using a generative AI model based on basic information stored in a database.
[0236] Input: Basic information stored in the database
[0237] Data processing: Generate prompts for the generative AI model and input them into the model
[0238] Output: A list of hobby suggestions from the generative AI model
[0239] Specific operation: The generated prompt sentence (e.g., "60-year-old male, interested in scenery and travel, initial cost 30,000 yen, monthly cost within 10,000 yen. Please suggest four to five new hobbies.") is input into the AI model to obtain a list of hobby suggestions.
[0240] Step 5:
[0241] The server transmits the generated hobby suggestion list to the terminal and presents it to the user.
[0242] Input: A list of hobby suggestions from a generative AI model
[0243] Data processing: Convert to HTML for displaying the list
[0244] Output: A list of hobby suggestions displayed on the terminal
[0245] What it does: Allows users to review a list of hobby suggestions and select hobbies that interest them.
[0246] Step 6:
[0247] The user selects a hobby of interest from the hobby suggestion list presented on the terminal.
[0248] Input: User-selected hobby information
[0249] Data processing: Converting selected information into a format for sending to the server
[0250] Output: Selected hobby information sent to the server
[0251] Specific operation: Send the user's selected hobbies to the server.
[0252] Step 7:
[0253] The server obtains detailed information related to the hobby selected by the user and transmits it to the terminal.
[0254] Input: User-selected hobby information
[0255] Data processing: Retrieve detailed hobby-related information from the database and convert it to HTML
[0256] Output: Hobby details displayed on the terminal
[0257] Specific behavior: Provides users with an overview of a hobby, how to get started, what supplies are needed, costs, etc. Example: "Please provide more information about the hobby 'photography'."
[0258] Step 8:
[0259] The server collects information on business partners that provide services and goods related to the hobby selected by the user and transmits it to the terminal. It also collects information on brick-and-mortar stores related to the hobby and transmits it to the terminal.
[0260] Input: User-selected hobby information
[0261] Data processing: Retrieve information about business partners and physical stores from the database and convert it into HTML
[0262] Output: Account and physical store information displayed on the device
[0263] Specific operation: Provides users with information about hobby-related businesses and brick-and-mortar stores, such as camera shops and photography classes.
[0264] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0265] The present invention is a system that allows a user to input basic information, suggests new hobbies based on that information, and provides specific detailed information. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to suggest hobbies and provide detailed information that takes the user's emotions into consideration. This system includes an input means for inputting the user's basic information, an information collection means, a proposal generation means for generating hobby proposals, a presentation means for presenting the generated proposals, a detailed information acquisition means for acquiring detailed information about a hobby selected by the user, a hobby detail presentation means for presenting the detailed information, a company introduction means for introducing business partners, and the emotion engine.
[0266] Program processing
[0267] Basic information input phase
[0268] Step 1:
[0269] The server generates a form for entering basic information about the user and sends it to the terminal.
[0270] Step 2:
[0271] The terminal displays the submitted input form to the user.
[0272] Step 3:
[0273] The user is presented with a form to enter the following information:
[0274] age
[0275] address
[0276] sex
[0277] Indoor and outdoor desires
[0278] Initial investment costs
[0279] Monthly costs
[0280] Interests
[0281] Step 4:
[0282] The terminal transmits the information entered by the user to the server.
[0283] Hobby proposal phase
[0284] Step 5:
[0285] The server obtains and records the user's input information.
[0286] Step 6:
[0287] The server uses a generation AI based on the acquired information to generate a list of hobbies suitable for the user.
[0288] Step 7:
[0289] The server transmits the generated interest list to the terminal.
[0290] Step 8:
[0291] The terminal displays the hobby list to the user.
[0292] As a concrete example, if a 60-year-old male user enters the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that monthly costs are within 10,000 yen, the generating AI will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips."
[0293] Hobby Detail Guide Phase
[0294] Step 9:
[0295] The user selects a hobby that interests them from a list of suggested hobbies.
[0296] Step 10:
[0297] The terminal transmits the user's selection to the server.
[0298] Step 11:
[0299] The server obtains detailed information about the selected hobby and transmits the information to the terminal.
[0300] Step 12:
[0301] The terminal displays the detailed information to the user.
[0302] As a specific example, if the user selects "photography," the server provides an overview of photography, how to get started, available photo spots, required initial costs, and monthly maintenance fees.
[0303] Emotion engine phase
[0304] Step 13:
[0305] The emotion engine recognizes emotions from the user's reactions and input.
[0306] Step 14:
[0307] The server further filters the hobby suggestions taking into account the user's emotions recognized by the emotion engine.
[0308] Step 15:
[0309] The emotion engine monitors the user's reaction to the suggested hobbies.
[0310] Step 16:
[0311] The server will prioritize detailed information related to hobbies that have received a positive response.
[0312] As a specific example, if a user is interested in "photography" but also responds positively to "historical exploration," the server will prioritize providing detailed information related to "historical exploration."
[0313] Support and Account Introduction Phase
[0314] Step 17:
[0315] The server acquires information about companies that provide services and goods necessary for the user to start a hobby and transmits that information to the terminal.
[0316] Step 18:
[0317] The terminal displays the company information to the user.
[0318] As specific examples, we will introduce camera shops, photography classes, and editing software providers, all of which are related to photography.
[0319] In this way, users can easily discover new hobbies and receive specific support to get started in them. Furthermore, emotion recognition by the emotion engine enables more appropriate suggestions and detailed information tailored to the user's interests and preferences.
[0320] The processing flow will be explained below.
[0321] The present invention is a system that allows a user to input basic information, suggests new hobbies based on that information, and provides specific detailed information. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to suggest hobbies and provide detailed information that takes the user's emotions into consideration. This system includes an input means for inputting the user's basic information, an information collection means, a proposal generation means for generating hobby proposals, a presentation means for presenting the generated proposals, a detailed information acquisition means for acquiring detailed information about a hobby selected by the user, a hobby detail presentation means for presenting the detailed information, a company introduction means for introducing business partners, and the emotion engine.
[0322] Program processing
[0323] Basic information input phase
[0324] Step 1:
[0325] The server generates a form for entering basic information about the user and sends it to the terminal.
[0326] Step 2:
[0327] The terminal displays the submitted input form to the user.
[0328] Step 3:
[0329] The user is presented with a form to enter the following information:
[0330] age
[0331] address
[0332] sex
[0333] Indoor and outdoor desires
[0334] Initial investment costs
[0335] Monthly costs
[0336] Interests
[0337] Step 4:
[0338] The terminal transmits the information entered by the user to the server.
[0339] Hobby proposal phase
[0340] Step 5:
[0341] The server obtains and records the user's input information.
[0342] Step 6:
[0343] The server uses a generation AI based on the acquired information to generate a list of hobbies suitable for the user.
[0344] Step 7:
[0345] The server transmits the generated interest list to the terminal.
[0346] Step 8:
[0347] The terminal displays the hobby list to the user.
[0348] As a concrete example, if a 60-year-old male user enters the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that monthly costs are within 10,000 yen, the generating AI will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips."
[0349] Hobby Detail Guide Phase
[0350] Step 9:
[0351] The user selects a hobby that interests them from a list of suggested hobbies.
[0352] Step 10:
[0353] The terminal transmits the user's selection to the server.
[0354] Step 11:
[0355] The server obtains detailed information about the selected hobby and transmits the information to the terminal.
[0356] Step 12:
[0357] The terminal displays the detailed information to the user.
[0358] As a specific example, if the user selects "photography," the server provides an overview of photography, how to get started, available photo spots, required initial costs, and monthly maintenance fees.
[0359] Emotion engine phase
[0360] Step 13:
[0361] The emotion engine recognizes emotions from the user's reactions and input.
[0362] Step 14:
[0363] The server further filters the hobby suggestions taking into account the user's emotions recognized by the emotion engine.
[0364] Step 15:
[0365] The emotion engine monitors the user's reaction to the suggested hobbies.
[0366] Step 16:
[0367] The server will prioritize detailed information related to hobbies that have received a positive response.
[0368] As a specific example, if a user is interested in "photography" but also responds positively to "historical exploration," the server will prioritize providing detailed information related to "historical exploration."
[0369] Support and Account Introduction Phase
[0370] Step 17:
[0371] The server acquires information about companies that provide services and goods necessary for the user to start a hobby and transmits that information to the terminal.
[0372] Step 18:
[0373] The terminal displays the company information to the user.
[0374] As specific examples, we will introduce camera shops, photography classes, and editing software providers, all of which are related to photography.
[0375] In this way, users can easily discover new hobbies and receive specific support to get started in them. Furthermore, emotion recognition by the emotion engine enables more appropriate suggestions and detailed information tailored to the user's interests and preferences.
[0376] Example 2
[0377] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0378] Conventional hobby suggestion systems only provide the function of suggesting hobbies based on the user's basic information. However, these systems make uniform suggestions without considering the user's emotions, which means that they are unable to make suggestions that are appropriate for the user's interests and mood. Furthermore, they lack specific details on starting the suggested hobbies and introductions to related services and goods, which creates a high barrier to users actually starting the hobbies. A system that solves these problems is needed.
[0379] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0380] In this invention, the server includes: an input means for inputting basic information of a user; an information collection means for acquiring the basic information;
[0381] a suggestion generating means for generating hobby suggestions based on the basic information;
[0382] a presentation means for presenting the hobby suggestions generated by the suggestion generation means to the user;
[0383] A detailed information acquisition means for acquiring detailed information related to a hobby selected by a user;
[0384] a hobby detail presentation means for presenting detailed hobby information acquired by the detailed information acquisition means to the user;
[0385] a company introduction means for introducing business partners that provide goods necessary for carrying out the hobby presented by the hobby detail presentation means;
[0386] an emotion engine that recognizes the user's emotions;
[0387] means for filtering suggestions based on the user's emotions recognized by the emotion engine;
[0388] Includes:
[0389] This makes it possible to suggest hobbies and provide detailed information that takes into account the user's emotions, lowering the barrier to starting a hobby.
[0390] "Input means" refers to a device or software that allows a user to input basic information. It provides an interface for a user to input information.
[0391] "Information collection means" refers to a device or software that acquires basic information entered by the user and converts it into a format that can be used within the system.
[0392] The "proposal generating means" is a device or software that generates hobby suggestions suited to the user based on the acquired basic information.
[0393] The "presentation means" is a device or software that visually or audibly presents the generated hobby suggestions to the user.
[0394] The "detailed information acquisition means" is a device or software that acquires specific detailed information related to the hobby selected by the user.
[0395] The "interest detail presentation means" is a device or software that presents the user with detailed information about the interest acquired by the detailed information acquisition means.
[0396] The "company introduction means" is a device or software that introduces to the user business partners that provide goods and services necessary for carrying out the hobby presented by the hobby details presentation means.
[0397] An "emotion engine" is a device or software that recognizes a user's emotions and converts that emotional information into a format that can be used within the system.
[0398] A "filtering means" is a device or software that filters the list of suggested interests based on the user's emotions recognized by the emotion engine.
[0399] This system allows users to input basic information, suggests appropriate hobbies based on that information, and provides necessary detailed information. Furthermore, it aims to provide more personalized suggestions by recognizing the user's emotions and filtering the suggestions. This system is composed of hardware and software, including a server, a terminal, and an emotion engine.
[0400] Specifically, the server comprises the following components:
[0401] Input means for entering basic user information
[0402] Information collection method to obtain basic information entered
[0403] A proposal generator that generates hobby proposals based on basic information
[0404] a presentation means for presenting the hobby suggestions generated by the suggestion generation means to the user;
[0405] A detailed information acquisition means for acquiring detailed information related to the hobby selected by the user
[0406] A hobby detail presentation means for presenting the acquired detailed information to the user.
[0407] A company introduction tool that introduces companies that provide goods and services necessary for carrying out hobbies
[0408] Emotion engine that recognizes user emotions
[0409] Filtering measures to filter suggestions based on sentiment
[0410] Hardware and software used
[0411] Hardware:
[0412] Server: processes and stores data
[0413] Terminal: A device operated by a user (PC, smartphone, etc.)
[0414] software:
[0415] Input method: HTML form
[0416] Information collection method: Database management system (DBMS)
[0417] Proposal generation method: Generative AI model
[0418] Emotion Engine: Natural Language Processing (NLP) Engine
[0419] Examples of hobby suggestions
[0420] For example, if a 60-year-old male user inputs the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that the monthly cost is within 10,000 yen, the generative AI model will generate the following prompt:
[0421] "User information: Age = 60, Interests = Landscape, Travel, Budget = ¥30,000 initial, ¥10,000 monthly. Please suggest hobbies suitable for this user."
[0422] Based on this prompt, the AI generator suggests hobbies such as photography, walking, gardening, historical exploration, and car trips. The server sends these suggestions to the device, which then displays them on the user's screen.
[0423] Providing more information
[0424] If the user selects "photography" from the suggested hobbies, the server retrieves detailed information about photography from a database or external API. This information includes an overview of photography, how to get started, recommended photo spots, required initial costs, monthly maintenance fees, etc. The device displays this information to the user and provides specific instructions on how to get started.
[0425] Utilizing the Emotion Engine
[0426] The emotion engine recognizes emotions from user input and operation logs. For example, if a user has a positive reaction to taking a photo, the server uses the emotion engine's evaluation results to prioritize providing related information that is likely to be of more interest to the user. In this way, the user experience can be improved.
[0427] Company Introduction
[0428] The server collects information on businesses that provide goods and services needed to start a hobby and sends it to the terminal. For example, it obtains information on camera shops, photography classes, editing software providers, and other businesses related to photography, and presents it to the user. This allows the user to easily find the resources they need.
[0429] This system allows users to easily find new hobbies and receive specific support to get started in those hobbies. It also utilizes emotion recognition by an emotion engine to make optimal suggestions based on the user's interests and mood.
[0430] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0431] Step 1:
[0432] The server generates an HTML form for the user to enter basic information, including fields for age, address, gender, indoor / outdoor preferences, initial investment amount, monthly expenses, and interests. The server then sends the generated form to the terminal.
[0433] Input: None
[0434] Output: An HTML form to enter basic user information
[0435] Step 2:
[0436] The terminal displays the HTML form received from the server in the user's browser, adding appropriate labels and explanations to allow the user to input information intuitively.
[0437] Input: HTML form
[0438] Output: Input form displayed in browser
[0439] Step 3:
[0440] The user is presented with a form to enter basic information, including age, address, gender, indoor / outdoor preferences, initial investment amount, monthly expenses, and interests.
[0441] Input: Input form displayed in browser
[0442] Output: Basic information entered
[0443] Step 4:
[0444] The device sends the information entered by the user to the server in JSON format using a secure communication protocol (e.g., HTTPS).
[0445] Input: Basic information entered
[0446] Output: User basic information sent to the server
[0447] Step 5:
[0448] The server records the received user basic information in a database, which will be used in subsequent processes.
[0449] Input: User basic information
[0450] Output: Basic information recorded in the database
[0451] Step 6:
[0452] The server then sends prompts to the generative AI model based on the recorded information to generate hobby suggestions, which include factors such as the user's age, interests, and budget.
[0453] Example: "User information: Age = 60, Interests = Landscape, Travel, Budget = ¥30,000 initial, ¥10,000 monthly. Please suggest hobbies suitable for this user."
[0454] Input: Basic information recorded in the database
[0455] Output: A list of hobbies returned by the generative AI model
[0456] Step 7:
[0457] The server sends the generated interest list to the terminal in JSON format.
[0458] Input: Generated hobby list
[0459] Output: Interest list sent to the device
[0460] Step 8:
[0461] The device displays the hobby list to the user in a format that is easy for the user to visually review, along with a brief description of each hobby.
[0462] Input: Interest list received from the server
[0463] Output: Interests list displayed in a browser
[0464] Step 9:
[0465] The user selects one hobby that interests them from the list of suggested hobbies.
[0466] Input: A list of hobbies displayed in a browser
[0467] Output: Selected hobby
[0468] Step 10:
[0469] The terminal transmits information about the hobby selected by the user to the server.
[0470] Input: Selected Hobbies
[0471] Output: Selections sent to the server
[0472] Step 11:
[0473] The server retrieves details related to the selected hobby from a database or external API, such as the initial costs, maintenance costs, required equipment, and recommended spots for photography.
[0474] Input: Selected Hobbies
[0475] Output: Retrieved details
[0476] Step 12:
[0477] The device then displays the received detailed information to the user, visually displaying detailed information including specific instructions on how to get started and important points to note.
[0478] Input: Details received from the server
[0479] Output: Detailed information displayed in a browser
[0480] Step 13:
[0481] The emotion engine recognizes emotions from user reactions and inputs, and uses natural language processing (NLP) technology to analyze user emotions.
[0482] Input: User responses and input
[0483] Output: Recognized emotion
[0484] Step 14:
[0485] The server re-filters the list of hobbies based on the user's emotions recognized by the emotion engine, giving priority to hobbies that have generated positive reactions.
[0486] Input: Recognized emotions, list of hobbies
[0487] Output: A filtered list of hobbies
[0488] Step 15:
[0489] The emotion engine continuously monitors how users respond to suggested hobbies and adjusts the suggestions as needed.
[0490] Input: User response
[0491] Output: Monitoring results
[0492] Step 16:
[0493] The server will prioritize detailed information related to hobbies that have been positively responded to, providing the user with additional information that is likely to be of interest.
[0494] Input: Monitoring results, detailed information
[0495] Output: Prioritized detailed information
[0496] Step 17:
[0497] The server collects information about companies that provide services and goods that support hobbies and sends it to the device. Related company information is also obtained from external APIs.
[0498] Input: Selected Hobbies
[0499] Output: Retrieved company information
[0500] Step 18:
[0501] The device displays company information to the user, along with contact details and service overviews for each company.
[0502] Input: Company information received from the server
[0503] Output: Company information displayed in a browser
[0504] (Application example 2)
[0505] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0506] While conventional hobby suggestion systems can make suggestions based on a user's basic information, they have difficulty responding flexibly to the user's emotions and reactions to make optimal suggestions. Furthermore, conventional systems are limited to standard online platforms and are unable to improve the user experience in virtual environments. This results in low user satisfaction with the suggested hobbies and insufficient support for actually starting a hobby.
[0507] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: an input means for inputting basic information about the user; an information collection means for acquiring the basic information; a proposal generation means for generating hobby proposals based on the basic information; a presentation means for presenting the hobby proposals generated by the proposal generation means to the user; a detailed information acquisition means for acquiring detailed information related to the hobby selected by the user; a hobby detail presentation means for presenting the detailed hobby information acquired by the detailed information acquisition means to the user; a company introduction means for introducing business partners that provide services and goods necessary for the hobby practice presented by the hobby detail presentation means; an emotion recognition means for recognizing the user's emotions and filtering the hobby proposals generated by the proposal generation means; a means for preferentially presenting detailed information related to the hobby practice for which the emotion recognition means recognizes the emotion; and a virtual interface means for installing this system in a virtual environment and enabling the user to receive hobby proposals in a virtual store. This allows optimal hobby proposals to be made based on the user's emotions and preferences, and real-time emotion recognition in the virtual store significantly improves the user experience.
[0508] "Input means" refers to an interface device for collecting basic information about the user.
[0509] The "information collection means" is a device that acquires basic information entered by the user and transmits it to the server.
[0510] The "suggestion generation means" is a device that uses an AI model based on the acquired basic information of the user to generate hobby suggestions.
[0511] The "presentation means" is a device that visually or audibly presents the generated hobby suggestions to the user.
[0512] The "detailed information acquisition means" is a device that acquires detailed information related to the hobby selected by the user from an external resource.
[0513] The "interest detail presentation means" is a device that presents the acquired hobby detail information to the user.
[0514] The "company introduction means" is a device that introduces to the user information about companies that provide services and goods necessary for carrying out the hobby.
[0515] An "emotion recognition means" is a device that recognizes emotions by analyzing the user's facial expressions and voice data.
[0516] "Virtual interface means" means an interface device that allows a user to receive hobby suggestions within a virtual environment.
[0517] This system allows users to input basic information, and based on that information, suggests new hobbies and provides specific detailed information. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to suggest hobbies and provide detailed information that takes the user's emotions into consideration.
[0518] The system includes the following components:
[0519] Input means: An interface device that collects basic information from users through an application installed on a device such as a smartphone or tablet. Specifically, users are asked to enter information such as age, address, gender, indoor / outdoor preferences, initial investment costs, monthly expenses, and interests.
[0520] Information collection means: A device that transmits the basic information input through the input means from the terminal to the server. The communication protocol is a general internet communication.
[0521] Suggestion generation means: A device that acquires the basic information and generates hobby suggestions using a generative AI model. For example, the AI generates a hobby list based on the user's input information and returns the results to the server.
[0522] Presentation means: A device that displays the hobby suggestions generated by the suggestion generation means on the screen of a smartphone or tablet. Specifically, it visually presents the suggestion contents to the user in text or image format.
[0523] Detailed information acquisition means: A device that acquires detailed information related to the hobby selected by the user from the Internet. The detailed information includes an overview of the hobby, how to get started, the initial costs and monthly maintenance fees required, and information on related services and products.
[0524] Hobby details presentation means: A device that presents the detailed information acquired by the detailed information acquisition means to the user. It visually displays information about the hobby selected by the user and serves as a concrete guide for starting that hobby.
[0525] Company introduction means: A device that provides information on companies that offer services and goods that users need when starting a new hobby. Specifically, it introduces users to information on companies that sell related products and services.
[0526] Emotion recognition means: A system that recognizes emotions by analyzing the user's facial expressions and voice data. This determines how the user feels about the suggested hobbies, and filters the suggestions based on that result.
[0527] Virtual Interface Means: An interface device that allows the system to be installed in a virtual environment and allows users to receive hobby suggestions in a virtual store, for example, using a VR headset or smart glasses.
[0528] As a concrete example, a user inputs basic information through a smartphone app. For example, if a 60-year-old man is interested in "scenery" and "travel," and inputs conditions that the initial cost is 30,000 yen and the monthly cost is within 10,000 yen, the generative AI model will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips." In this case, the following prompt sentence is input to the generative AI model:
[0529] "Age: 60, Address: Tokyo, Gender: Male, Interests: Landscapes, Travel, What new hobby can you suggest?"
[0530] The emotion recognition means reads emotions from the user's facial expressions and voice, and presents the filtered results to the user. Then, detailed information about the hobby selected by the user is obtained using the detailed information acquisition means, and the information is provided to the user through the hobby detail presentation means. Furthermore, information about companies offering related products and services is also presented to the user through the company introduction means.
[0531] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0532] Step 1:
[0533] The user launches the app installed on their smartphone or tablet and displays a form for entering basic information.
[0534] Specifically, the application provides users with a screen where they can enter their age, address, gender, indoor / outdoor preferences, initial investment amount, monthly expenses, interests, etc.
[0535] (Input) User basic information
[0536] (Output) Display of input form
[0537] Step 2:
[0538] The user enters basic information and presses the submit button.
[0539] The entered information is sent from the device to the server, where data security is maintained using encrypted communication.
[0540] (Input) User input information (age, address, gender, interests, etc.)
[0541] (Output) Basic information sent to the server
[0542] Step 3:
[0543] The server analyzes and records the received user information.
[0544] This analysis involves manipulating a database to store basic user information in an appropriate format.
[0545] (Input) Basic information sent from the device
[0546] (Output) Save parsed user information
[0547] Step 4:
[0548] The server uses a generative AI model to generate a list of hobby suggestions based on user entries.
[0549] At this time, machine learning technology is used to generate optimal candidates based on the input conditions.
[0550] (Input) Recorded user information
[0551] (Output) A list of generated hobby suggestions
[0552] Step 5:
[0553] The server transmits the generated hobby suggestion list to the terminal and displays it.
[0554] The suggestions are displayed as a list for the user to visually review.
[0555] (Input) Generated hobby suggestion list
[0556] (Output) Hobby suggestions displayed on the device
[0557] Step 6:
[0558] The user selects a hobby that interests them from a list of suggestions.
[0559] It provides a one-tap selection interface and the selection is sent to the server.
[0560] (Input) User's hobby selection
[0561] (Output) Send selected hobby information to server
[0562] Step 7:
[0563] The server retrieves detailed information related to the selected hobby from the Internet.
[0564] Specifically, information is collected about the hobby, including an overview, how to get started, initial costs and monthly maintenance fees, and related products and services.
[0565] (Input) Selected hobby information
[0566] (Output) Detailed information about the acquired hobbies
[0567] Step 8:
[0568] The server sends the acquired detailed information to the terminal and displays it to the user.
[0569] Include images and links to ensure the information is presented in an easy-to-read format.
[0570] (Input) Detailed information about the acquired hobbies
[0571] (Output) Hobby details displayed on the device
[0572] Step 9:
[0573] The emotion recognition means analyzes the user's facial expressions and voice data to recognize the emotions.
[0574] It collects data in real time through cameras and microphones and applies sentiment analysis algorithms.
[0575] (Input) User's facial expression and voice data
[0576] (Output) Recognized emotion data
[0577] Step 10:
[0578] The server uses the emotion data provided by the emotion recognition means to filter the suggestions.
[0579] Prioritize detailed information related to hobbies that generate positive responses.
[0580] (Input) Recognized emotion data
[0581] (Output) Filtered suggestions
[0582] Step 11:
[0583] The server introduces information about companies that provide products and services necessary for users to start a hobby.
[0584] It provides users with information on related products and service providers, and displays shopping guidance and contact information.
[0585] (Input) Filtered suggestions
[0586] (Output) Company information introduced
[0587] Specific prompt examples:
[0588] "Age: 60, Address: Tokyo, Gender: Male, Interests: Landscapes, Travel, What new hobby can you suggest?"
[0589] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0590] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0591] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0592] [Second embodiment]
[0593] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0594] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0595] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0596] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0597] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0598] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0599] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0600] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0601] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0602] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0603] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0604] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0605] The present invention is a system for inputting basic information of a user, proposing new hobbies based on the input information, and providing specific detailed information. This system includes an input means for inputting the user's basic information, an information collection means, a proposal generation means for generating hobby proposals, a presentation means for presenting the generated proposals, a detailed information acquisition means for acquiring detailed information about a hobby selected by the user, a hobby detail presentation means for presenting the detailed information, and a company introduction means for introducing business partners.
[0606] Program processing
[0607] Basic information input phase
[0608] Step 1: Displaying the input form
[0609] The server generates a form for entering basic information about the user and sends it to the terminal.
[0610] The terminal displays the submitted input form to the user.
[0611] Step 2: Enter basic information
[0612] The user fills in the form that appears with information such as age, address, gender, indoor / outdoor preferences, initial investment amount, monthly expenses, and interests.
[0613] The terminal transmits the information entered by the user to the server.
[0614] Hobby proposal phase
[0615] Step 1: Gather information
[0616] The server obtains and records the user's input information.
[0617] Step 2: Generate interest suggestions
[0618] The server uses a generation AI based on the acquired information to generate a list of hobbies suitable for the user.
[0619] The server transmits the generated interest list to the terminal.
[0620] As a concrete example, if a 60-year-old male user enters the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that monthly costs are within 10,000 yen, the generating AI will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips."
[0621] Hobby Detail Guide Phase
[0622] Step 1: Choose a hobby
[0623] The user selects a hobby that interests them from a list of suggested hobbies.
[0624] The terminal transmits the user's selection to the server.
[0625] Step 2: View hobby details
[0626] The server obtains detailed information about the selected hobby and transmits the information to the terminal.
[0627] The terminal displays detailed information to the user.
[0628] As a specific example, if the user selects "photography," the server provides an overview of photography, how to get started, available photo spots, required initial costs, and monthly maintenance fees.
[0629] Support and Account Introduction Phase
[0630] Step 1: Introducing services and goods
[0631] The server acquires information about companies that provide services and goods necessary for the user to start a hobby and transmits that information to the terminal.
[0632] The terminal displays the company information to the user.
[0633] As specific examples, we will introduce camera shops, photography classes, and editing software providers, all of which are related to photography.
[0634] In this way, users can easily discover new hobbies and receive specific support to get started in those hobbies.
[0635] The processing flow will be explained below.
[0636] The present invention is a system for inputting basic information of a user, proposing new hobbies based on the input information, and providing specific detailed information. This system includes an input means for inputting the user's basic information, an information collection means, a proposal generation means for generating hobby proposals, a presentation means for presenting the generated proposals, a detailed information acquisition means for acquiring detailed information about a hobby selected by the user, a hobby detail presentation means for presenting the detailed information, and a company introduction means for introducing business partners.
[0637] Program processing
[0638] Basic information input phase
[0639] Step 1:
[0640] The server generates a form for entering basic information about the user and sends it to the terminal.
[0641] Step 2:
[0642] The terminal displays the submitted input form to the user.
[0643] Step 3:
[0644] The user is presented with a form to enter the following information:
[0645] age
[0646] address
[0647] sex
[0648] Indoor and outdoor desires
[0649] Initial investment costs
[0650] Monthly costs
[0651] Interests
[0652] Step 4:
[0653] The terminal transmits the information entered by the user to the server.
[0654] Hobby proposal phase
[0655] Step 5:
[0656] The server obtains and records the user's input information.
[0657] Step 6:
[0658] The server uses a generation AI based on the acquired information to generate a list of hobbies suitable for the user.
[0659] Step 7:
[0660] The server transmits the generated interest list to the terminal.
[0661] Step 8:
[0662] The terminal displays the hobby list to the user.
[0663] As a concrete example, if a 60-year-old male user enters the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that monthly costs are within 10,000 yen, the generating AI will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips."
[0664] Hobby Detail Guide Phase
[0665] Step 9:
[0666] The user selects a hobby that interests them from a list of suggested hobbies.
[0667] Step 10:
[0668] The terminal transmits the user's selection to the server.
[0669] Step 11:
[0670] The server obtains detailed information about the selected hobby and transmits the information to the terminal.
[0671] Step 12:
[0672] The terminal displays the detailed information to the user.
[0673] As a specific example, if the user selects "photography," the server provides an overview of photography, how to get started, available photo spots, required initial costs, and monthly maintenance fees.
[0674] Support and Account Introduction Phase
[0675] Step 13:
[0676] The server acquires information about companies that provide services and goods necessary for the user to start a hobby and transmits that information to the terminal.
[0677] Step 14:
[0678] The terminal displays the company information to the user.
[0679] As specific examples, we will introduce camera shops, photography classes, and editing software providers, all of which are related to photography.
[0680] In this way, users can easily discover new hobbies and receive specific support to get started in those hobbies.
[0681] Example 1
[0682] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0683] Conventional hobby suggestion systems have limited suggestions to users, making it difficult to provide comprehensive information on a wide range of hobbies. They also lacked a mechanism for properly presenting specific hobby suggestions and detailed information tailored to a user's interests and budget. Furthermore, they were unable to properly introduce related services and product providers for pursuing a hobby, resulting in insufficient support for users starting a new hobby.
[0684] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0685] In this invention, the server includes an input means for inputting basic information about the user, an information collection means for acquiring the basic information, a proposal generation means for generating a prompt sentence using a generative AI model based on the basic information and generating hobby proposals suitable for the user, a presentation means for presenting the generated hobby proposals to the user, a detailed information acquisition means for acquiring detailed information related to the selected hobby, a hobby detail presentation means for presenting detailed information about the hobby to the user, and a company introduction means for introducing business partners that provide services and goods necessary for practicing the hobby. This makes it possible to propose specific and appropriate hobbies that suit the interests and budgets of a variety of users, and allows users to receive detailed information and related services to start a new hobby.
[0686] "Input means" is a function that provides an interface for the user to input basic information.
[0687] "Information collection means" is a function that acquires and records basic information entered by the user.
[0688] The "suggestion generation means" is a function in which the generative AI model generates prompt sentences based on the acquired basic information and creates hobby suggestions suitable for the user.
[0689] The "presentation means" is a function that displays the generated hobby suggestions to the user.
[0690] The "detailed information acquisition means" is a function for collecting detailed information about the hobby selected by the user.
[0691] The "interest detail presentation means" is a function that displays detailed information about the acquired interest to the user.
[0692] The "company introduction means" is a function that introduces business partners that provide services and goods necessary for carrying out a hobby.
[0693] A "generative AI model" is an artificial intelligence algorithm that generates appropriate suggestions for a user based on input prompts.
[0694] A "prompt sentence" is a sentence to be input into a generative AI model, and is created based on basic information about the user.
[0695] The present invention relates to a system for suggesting new hobbies based on a user's basic information and providing detailed information. The system includes an input means, an information collection means, a suggestion generation means, a presentation means, a detailed information acquisition means, a hobby detail presentation means, and a company introduction means.
[0696] The input means is an interface for users to enter basic information, and is provided as an HTML web form. The information collection means has the function of receiving the basic information entered by the user and recording it in a database. For the server to perform these basic processes, an Apache server or Nginx server, for example, can be used.
[0697] The suggestion generation means has a function in which a generative AI model generates prompt sentences based on the acquired basic information and creates a list of hobbies suitable for the user. A natural language generation model such as OpenAI GPT-3 can be used as the generative AI model. This suggestion generation means suggests hobbies that match the user's interests and budget.
[0698] As a concrete example, if a 60-year-old male user is interested in "scenery" and "travel," and inputs the conditions that the initial cost is 30,000 yen and the monthly cost is within 10,000 yen, the following prompt sentence will be generated:
[0699] "60-year-old male, interested in scenery and travel. Initial cost: less than 30,000 yen, monthly cost: less than 10,000 yen. Please suggest a new hobby that meets these conditions."
[0700] The generated hobby suggestions are displayed to the user via a presentation means. In this process, the device plays a role in displaying the generated hobby list to the user. When the user selects an interest from the suggested hobbies, detailed information about the selected hobby is obtained from a database or an external API via a detailed information obtaining means.
[0701] Detailed information is displayed to the user through a hobby detail presentation means. For example, if the user selects "photography," the server provides an overview of photography, how to get started, photo spots, and the required initial costs and monthly maintenance fees.
[0702] Furthermore, the company introduction means has a function of collecting information on business partners that provide services and goods necessary for carrying out hobbies and introducing this information to the user. For example, information on "camera shops," "photography classes," and "editing software providers" related to "photography" is displayed.
[0703] In this way, users can easily find new hobbies and receive detailed information and support related to them, which solves the problems of conventional hobby suggestion systems, such as the lack of diverse suggestions and specific support.
[0704] The above is a specific embodiment of the present invention. The overall flow of the present invention and the detailed functions of each element allow users to discover new hobbies and receive specific guidance for starting them.
[0705] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0706] Step 1:
[0707] The server generates an HTML input form for the user to enter basic information. The generated input form includes fields such as the user's age, address, gender, indoor / outdoor preferences, available initial investment, monthly expenses, and interests. The server sends the generated input form to the terminal as an HTTP response, which displays the input form in the terminal's browser.
[0708] Input: None
[0709] Output: HTML input form
[0710] Specific behavior:
[0711] When the user opens the browser on their device, an input form is displayed.
[0712] Step 2:
[0713] The user enters the required basic information into the displayed input form. The device converts the information entered by the user into JSON data and sends it to the server via an HTTP POST request. The server parses the received JSON data and obtains the user's basic information.
[0714] Input: Basic information entered by the user
[0715] Output: JSON data
[0716] Specific behavior:
[0717] The user fills out the form and clicks the "Submit" button.
[0718] Step 3:
[0719] The server records the user's basic information in a database. Based on the recorded basic information, the server generates a prompt to be input into the generative AI model. The generated prompt might be something like, "60-year-old male, interested in scenery and travel. Initial cost: less than 30,000 yen, monthly cost: less than 10,000 yen. Please suggest a new hobby that meets these conditions."
[0720] Input: User basic information
[0721] Output: prompt statement
[0722] Specific behavior:
[0723] The server generates a prompt sentence such as "60-year-old male, interested in scenery and travel. Initial cost: less than 30,000 yen, monthly cost: less than 10,000 yen. Please suggest a new hobby that meets these conditions."
[0724] Step 4:
[0725] The server inputs the generated prompt into the generative AI model, which analyzes the prompt and generates a list of hobbies suitable for the user. The list is converted into JSON format and sent from the server to the device, which then displays the received list of hobbies to the user.
[0726] Input: prompt statement
[0727] Output: Hobby list
[0728] Specific behavior:
[0729] Based on the user's criteria, the AI suggests hobbies such as "photography," "walking," "gardening," "historical exploration," and "road trips," and displays them in a list format.
[0730] Step 5:
[0731] The user selects the hobby they are interested in from the presented hobby list. The device converts the user's selection information into JSON format and sends it to the server.
[0732] Input: User's selected hobby
[0733] Output: JSON data
[0734] Specific behavior:
[0735] The user selects "Take a photo" from the list.
[0736] Step 6:
[0737] The server retrieves detailed information about the user's selected hobbies from a database or external API, converts the information into JSON format, and sends it to the device, which then displays the retrieved details to the user.
[0738] Input: User-selected hobby information
[0739] Output: Hobby details
[0740] Specific behavior:
[0741] The user checks detailed information about "photography" (for example, necessary equipment, how to get started, photo spots, estimated costs, etc.) on the device screen.
[0742] Step 7:
[0743] The server also retrieves information about companies that provide services and goods necessary for the user's hobby from a database or external API, converts the information into JSON format, and sends it to the device, which then displays the retrieved information to the user.
[0744] Input: User-selected hobby
[0745] Output: Company information
[0746] Specific behavior:
[0747] Users can check information related to photography, such as camera shops, photography classes, and editing software providers.
[0748] Through the above steps, users can find new hobbies and receive detailed information and related services.
[0749] (Application example 1)
[0750] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0751] Conventional systems provide insufficient support for users to discover new hobbies, especially lacking the ability to provide information on physical stores related to the hobby. This leaves users with the inconvenience of having to search for specific information and physical stores needed to start a hobby. Furthermore, detailed information on suggested hobbies cannot be easily obtained, which can create a high barrier to entry in the early stages of starting a hobby.
[0752] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0753] In this invention, the server includes an input means for inputting basic information about a user, an information collection means for acquiring the basic information, a proposal generation means for generating hobby proposals based on the basic information, a presentation means for presenting the hobby proposals generated by the proposal generation means to the user, a detailed information acquisition means for acquiring detailed information related to the hobby selected by the user, a hobby detail presentation means for presenting the detailed hobby information acquired by the detailed information acquisition means to the user, a company introduction means for introducing business partners that provide services and goods necessary for practicing the hobby presented by the hobby detail presentation means, and a store information presentation means for acquiring information about physical stores related to the hobby and presenting it to the user. This makes it easier for users to find new hobbies and enables them to quickly and efficiently obtain specific information and physical store information related to their hobbies.
[0754] "Input means" refers to the device or software functions that allow the user to input basic information.
[0755] "Information collection means" is a function that acquires the input basic information and sends it to the server.
[0756] The "suggestion generation means" is a function that uses a generation AI to generate hobby suggestions based on the acquired basic information.
[0757] The "presentation means" is a function that displays the generated hobby suggestions to the user.
[0758] The "detailed information acquisition means" is a function for acquiring detailed information related to the hobby selected by the user.
[0759] The "interest detail presentation means" is a function that displays detailed information about the acquired interest to the user.
[0760] The "company introduction means" is a function that introduces the user to business partners that provide services and goods necessary for carrying out the hobby.
[0761] The "store information presentation means" is a function that acquires information about physical stores related to the hobby selected by the user and displays it to the user.
[0762] The system for implementing this invention acquires basic information about a user, suggests new hobbies based on that information, and provides detailed information about the hobbies and information about brick-and-mortar stores. Specifically, the system is composed of the following means:
[0763] Hardware and Software Configuration
[0764] Hardware
[0765] Devices: smartphones, tablets, PCs
[0766] Server: Used for data processing and running generative AI models
[0767] software
[0768] Generative AI models: OpenAI GPT-4 as an example
[0769] Database management system: MySQL, etc.
[0770] Front-end: Web frameworks such as React and Angular
[0771] Backend: Node.js, Python, etc.
[0772] Program processing overview
[0773] Basic information input phase
[0774] The server generates an input form for the user to enter basic information and sends it to the terminal. When the user enters basic information such as age, gender, address, hobbies, initial costs, and monthly costs on the terminal, the terminal sends this information to the server.
[0775] Hobby proposal phase
[0776] The server uses a generative AI model to generate hobby suggestions based on the acquired user's basic information. The generated hobby list is sent to the device and presented to the user. For example, if a 60-year-old male user is interested in "scenery" and "travel," and inputs the conditions that the initial cost is 30,000 yen and the monthly cost is within 10,000 yen, the generative AI model will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips." These hobby suggestions are made using the following prompts:
[0777] A 60-year-old male interested in scenery and travel, with initial costs of 30,000 yen and monthly costs of less than 10,000 yen. Please suggest four to five new hobbies.
[0778] Hobby Detail Guide Phase
[0779] When a user selects a hobby that interests them from the hobby list, the selection information is sent to the server. The server obtains detailed information about the selected hobby and sends it to the terminal. The user can view this detailed information on the terminal. For example, if a user selects "photography," an overview of photography, how to get started, photo spots, required initial costs, and monthly maintenance fees are provided.
[0780] Please provide more information about your hobby "photography".
[0781] Support and Account Introduction Phase
[0782] The server collects information on partner companies that offer services and goods related to the user's selected hobby and sends it to the user's device. This allows the user to easily find the services and goods of partner companies. At the same time, the server also obtains information on physical stores related to the hobby and presents it to the user, providing information on nearby stores that the user can actually visit.
[0783] As a specific example, if you select "Photography," information about physical camera shops, photography classes, and camera maintenance services will be displayed.
[0784] In this way, the present invention realizes a system that makes it easy for users to find new hobbies and provides specific detailed information and brick-and-mortar store information quickly and efficiently.
[0785] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0786] Step 1:
[0787] The server generates an input form for inputting basic information of the user and sends it to the terminal.
[0788] Input: Database connection information at system startup
[0789] Data processing: Generate an HTML input form
[0790] Output: The generated input form
[0791] Specific behavior: Displays a form for the user to enter basic information (age, gender, address, hobbies, initial costs, monthly costs, etc.).
[0792] Step 2:
[0793] The user uses the terminal to enter basic information into the input form and clicks the send button.
[0794] Input: Basic user information entered in the form
[0795] Data processing: Convert the input data into JSON format
[0796] Output: Basic information in JSON format
[0797] What happens: The user enters all the desired information and clicks the submit button, which sends the data to the server.
[0798] Step 3:
[0799] The server receives the basic information sent from the terminal and stores the information in a database.
[0800] Input: Basic information in JSON format
[0801] Data processing: Converting data into a format for saving to a database
[0802] Output: Basic information stored in the database
[0803] Specific operation: The server registers basic information in the database, making it available for the next process.
[0804] Step 4:
[0805] The server generates hobby suggestions using a generative AI model based on basic information stored in a database.
[0806] Input: Basic information stored in the database
[0807] Data processing: Generate prompts for the generative AI model and input them into the model
[0808] Output: A list of hobby suggestions from the generative AI model
[0809] Specific operation: The generated prompt sentence (e.g., "60-year-old male, interested in scenery and travel, initial cost 30,000 yen, monthly cost within 10,000 yen. Please suggest four to five new hobbies.") is input into the AI model to obtain a list of hobby suggestions.
[0810] Step 5:
[0811] The server transmits the generated hobby suggestion list to the terminal and presents it to the user.
[0812] Input: A list of hobby suggestions from a generative AI model
[0813] Data processing: Convert to HTML for displaying the list
[0814] Output: A list of hobby suggestions displayed on the terminal
[0815] What it does: Allows users to review a list of hobby suggestions and select hobbies that interest them.
[0816] Step 6:
[0817] The user selects a hobby of interest from the hobby suggestion list presented on the terminal.
[0818] Input: User-selected hobby information
[0819] Data processing: Converting selected information into a format for sending to the server
[0820] Output: Selected hobby information sent to the server
[0821] Specific operation: Send the user's selected hobbies to the server.
[0822] Step 7:
[0823] The server obtains detailed information related to the hobby selected by the user and transmits it to the terminal.
[0824] Input: User-selected hobby information
[0825] Data processing: Retrieve detailed hobby-related information from the database and convert it to HTML
[0826] Output: Hobby details displayed on the terminal
[0827] Specific behavior: Provides users with an overview of a hobby, how to get started, what supplies are needed, costs, etc. Example: "Please provide more information about the hobby 'photography'."
[0828] Step 8:
[0829] The server collects information on business partners that provide services and goods related to the hobby selected by the user and transmits it to the terminal. It also collects information on brick-and-mortar stores related to the hobby and transmits it to the terminal.
[0830] Input: User-selected hobby information
[0831] Data processing: Retrieve information about business partners and physical stores from the database and convert it into HTML
[0832] Output: Account and physical store information displayed on the device
[0833] Specific operation: Provides users with information about hobby-related businesses and brick-and-mortar stores, such as camera shops and photography classes.
[0834] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0835] The present invention is a system that allows a user to input basic information, suggests new hobbies based on that information, and provides specific detailed information. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to suggest hobbies and provide detailed information that takes the user's emotions into consideration. This system includes an input means for inputting the user's basic information, an information collection means, a proposal generation means for generating hobby proposals, a presentation means for presenting the generated proposals, a detailed information acquisition means for acquiring detailed information about a hobby selected by the user, a hobby detail presentation means for presenting the detailed information, a company introduction means for introducing business partners, and the emotion engine.
[0836] Program processing
[0837] Basic information input phase
[0838] Step 1:
[0839] The server generates a form for entering basic information about the user and sends it to the terminal.
[0840] Step 2:
[0841] The terminal displays the submitted input form to the user.
[0842] Step 3:
[0843] The user is presented with a form to enter the following information:
[0844] age
[0845] address
[0846] sex
[0847] Indoor and outdoor desires
[0848] Initial investment costs
[0849] Monthly costs
[0850] Interests
[0851] Step 4:
[0852] The terminal transmits the information entered by the user to the server.
[0853] Hobby proposal phase
[0854] Step 5:
[0855] The server obtains and records the user's input information.
[0856] Step 6:
[0857] The server uses a generation AI based on the acquired information to generate a list of hobbies suitable for the user.
[0858] Step 7:
[0859] The server transmits the generated interest list to the terminal.
[0860] Step 8:
[0861] The terminal displays the hobby list to the user.
[0862] As a concrete example, if a 60-year-old male user enters the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that monthly costs are within 10,000 yen, the generating AI will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips."
[0863] Hobby Detail Guide Phase
[0864] Step 9:
[0865] The user selects a hobby that interests them from a list of suggested hobbies.
[0866] Step 10:
[0867] The terminal transmits the user's selection to the server.
[0868] Step 11:
[0869] The server obtains detailed information about the selected hobby and transmits the information to the terminal.
[0870] Step 12:
[0871] The terminal displays the detailed information to the user.
[0872] As a specific example, if the user selects "photography," the server provides an overview of photography, how to get started, available photo spots, required initial costs, and monthly maintenance fees.
[0873] Emotion engine phase
[0874] Step 13:
[0875] The emotion engine recognizes emotions from the user's reactions and input.
[0876] Step 14:
[0877] The server further filters the hobby suggestions taking into account the user's emotions recognized by the emotion engine.
[0878] Step 15:
[0879] The emotion engine monitors the user's reaction to the suggested hobbies.
[0880] Step 16:
[0881] The server will prioritize detailed information related to hobbies that have received a positive response.
[0882] As a specific example, if a user is interested in "photography" but also responds positively to "historical exploration," the server will prioritize providing detailed information related to "historical exploration."
[0883] Support and Account Introduction Phase
[0884] Step 17:
[0885] The server acquires information about companies that provide services and goods necessary for the user to start a hobby and transmits that information to the terminal.
[0886] Step 18:
[0887] The terminal displays the company information to the user.
[0888] As specific examples, we will introduce camera shops, photography classes, and editing software providers, all of which are related to photography.
[0889] In this way, users can easily discover new hobbies and receive specific support to get started in them. Furthermore, emotion recognition by the emotion engine enables more appropriate suggestions and detailed information tailored to the user's interests and preferences.
[0890] The processing flow will be explained below.
[0891] The present invention is a system that allows a user to input basic information, suggests new hobbies based on that information, and provides specific detailed information. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to suggest hobbies and provide detailed information that takes the user's emotions into consideration. This system includes an input means for inputting the user's basic information, an information collection means, a proposal generation means for generating hobby proposals, a presentation means for presenting the generated proposals, a detailed information acquisition means for acquiring detailed information about a hobby selected by the user, a hobby detail presentation means for presenting the detailed information, a company introduction means for introducing business partners, and the emotion engine.
[0892] Program processing
[0893] Basic information input phase
[0894] Step 1:
[0895] The server generates a form for entering basic information about the user and sends it to the terminal.
[0896] Step 2:
[0897] The terminal displays the submitted input form to the user.
[0898] Step 3:
[0899] The user is presented with a form to enter the following information:
[0900] age
[0901] address
[0902] sex
[0903] Indoor and outdoor desires
[0904] Initial investment costs
[0905] Monthly costs
[0906] Interests
[0907] Step 4:
[0908] The terminal transmits the information entered by the user to the server.
[0909] Hobby proposal phase
[0910] Step 5:
[0911] The server obtains and records the user's input information.
[0912] Step 6:
[0913] The server uses a generation AI based on the acquired information to generate a list of hobbies suitable for the user.
[0914] Step 7:
[0915] The server transmits the generated interest list to the terminal.
[0916] Step 8:
[0917] The terminal displays the hobby list to the user.
[0918] As a concrete example, if a 60-year-old male user enters the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that monthly costs are within 10,000 yen, the generating AI will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips."
[0919] Hobby Detail Guide Phase
[0920] Step 9:
[0921] The user selects a hobby that interests them from a list of suggested hobbies.
[0922] Step 10:
[0923] The terminal transmits the user's selection to the server.
[0924] Step 11:
[0925] The server obtains detailed information about the selected hobby and transmits the information to the terminal.
[0926] Step 12:
[0927] The terminal displays the detailed information to the user.
[0928] As a specific example, if the user selects "photography," the server provides an overview of photography, how to get started, available photo spots, required initial costs, and monthly maintenance fees.
[0929] Emotion engine phase
[0930] Step 13:
[0931] The emotion engine recognizes emotions from the user's reactions and input.
[0932] Step 14:
[0933] The server further filters the hobby suggestions taking into account the user's emotions recognized by the emotion engine.
[0934] Step 15:
[0935] The emotion engine monitors the user's reaction to the suggested hobbies.
[0936] Step 16:
[0937] The server will prioritize detailed information related to hobbies that have received a positive response.
[0938] As a specific example, if a user is interested in "photography" but also responds positively to "historical exploration," the server will prioritize providing detailed information related to "historical exploration."
[0939] Support and Account Introduction Phase
[0940] Step 17:
[0941] The server acquires information about companies that provide services and goods necessary for the user to start a hobby and transmits that information to the terminal.
[0942] Step 18:
[0943] The terminal displays the company information to the user.
[0944] As specific examples, we will introduce camera shops, photography classes, and editing software providers, all of which are related to photography.
[0945] In this way, users can easily discover new hobbies and receive specific support to get started in them. Furthermore, emotion recognition by the emotion engine enables more appropriate suggestions and detailed information tailored to the user's interests and preferences.
[0946] Example 2
[0947] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0948] Conventional hobby suggestion systems only provide the function of suggesting hobbies based on the user's basic information. However, these systems make uniform suggestions without considering the user's emotions, which means that they are unable to make suggestions that are appropriate for the user's interests and mood. Furthermore, they lack specific details on starting the suggested hobbies and introductions to related services and goods, which creates a high barrier to users actually starting the hobbies. A system that solves these problems is needed.
[0949] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0950] In this invention, the server includes: an input means for inputting basic information of a user; an information collection means for acquiring the basic information;
[0951] a suggestion generating means for generating hobby suggestions based on the basic information;
[0952] a presentation means for presenting the hobby suggestions generated by the suggestion generation means to the user;
[0953] A detailed information acquisition means for acquiring detailed information related to a hobby selected by a user;
[0954] a hobby detail presentation means for presenting detailed hobby information acquired by the detailed information acquisition means to the user;
[0955] a company introduction means for introducing business partners that provide goods necessary for carrying out the hobby presented by the hobby detail presentation means;
[0956] an emotion engine that recognizes the user's emotions;
[0957] means for filtering suggestions based on the user's emotions recognized by the emotion engine;
[0958] Includes:
[0959] This makes it possible to suggest hobbies and provide detailed information that takes into account the user's emotions, lowering the barrier to starting a hobby.
[0960] "Input means" refers to a device or software that allows a user to input basic information. It provides an interface for a user to input information.
[0961] "Information collection means" refers to a device or software that acquires basic information entered by the user and converts it into a format that can be used within the system.
[0962] The "proposal generating means" is a device or software that generates hobby suggestions suited to the user based on the acquired basic information.
[0963] The "presentation means" is a device or software that visually or audibly presents the generated hobby suggestions to the user.
[0964] The "detailed information acquisition means" is a device or software that acquires specific detailed information related to the hobby selected by the user.
[0965] The "interest detail presentation means" is a device or software that presents the user with detailed information about the interest acquired by the detailed information acquisition means.
[0966] The "company introduction means" is a device or software that introduces to the user business partners that provide goods and services necessary for carrying out the hobby presented by the hobby details presentation means.
[0967] An "emotion engine" is a device or software that recognizes a user's emotions and converts that emotional information into a format that can be used within the system.
[0968] A "filtering means" is a device or software that filters the list of suggested interests based on the user's emotions recognized by the emotion engine.
[0969] This system allows users to input basic information, suggests appropriate hobbies based on that information, and provides necessary detailed information. Furthermore, it aims to provide more personalized suggestions by recognizing the user's emotions and filtering the suggestions. This system is composed of hardware and software, including a server, a terminal, and an emotion engine.
[0970] Specifically, the server comprises the following components:
[0971] Input means for entering basic user information
[0972] Information collection method to obtain basic information entered
[0973] A proposal generator that generates hobby proposals based on basic information
[0974] a presentation means for presenting the hobby suggestions generated by the suggestion generation means to the user;
[0975] A detailed information acquisition means for acquiring detailed information related to the hobby selected by the user
[0976] A hobby detail presentation means for presenting the acquired detailed information to the user.
[0977] A company introduction tool that introduces companies that provide goods and services necessary for carrying out hobbies
[0978] Emotion engine that recognizes user emotions
[0979] Filtering measures to filter suggestions based on sentiment
[0980] Hardware and software used
[0981] Hardware:
[0982] Server: processes and stores data
[0983] Terminal: A device operated by a user (PC, smartphone, etc.)
[0984] software:
[0985] Input method: HTML form
[0986] Information collection method: Database management system (DBMS)
[0987] Proposal generation method: Generative AI model
[0988] Emotion Engine: Natural Language Processing (NLP) Engine
[0989] Examples of hobby suggestions
[0990] For example, if a 60-year-old male user inputs the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that the monthly cost is within 10,000 yen, the generative AI model will generate the following prompt:
[0991] "User information: Age = 60, Interests = Landscape, Travel, Budget = ¥30,000 initial, ¥10,000 monthly. Please suggest hobbies suitable for this user."
[0992] Based on this prompt, the AI generator suggests hobbies such as photography, walking, gardening, historical exploration, and car trips. The server sends these suggestions to the device, which then displays them on the user's screen.
[0993] Providing more information
[0994] If the user selects "photography" from the suggested hobbies, the server retrieves detailed information about photography from a database or external API. This information includes an overview of photography, how to get started, recommended photo spots, required initial costs, monthly maintenance fees, etc. The device displays this information to the user and provides specific instructions on how to get started.
[0995] Utilizing the Emotion Engine
[0996] The emotion engine recognizes emotions from user input and operation logs. For example, if a user has a positive reaction to taking a photo, the server uses the emotion engine's evaluation results to prioritize providing related information that is likely to be of more interest to the user. In this way, the user experience can be improved.
[0997] Company Introduction
[0998] The server collects information on businesses that provide goods and services needed to start a hobby and sends it to the terminal. For example, it obtains information on camera shops, photography classes, editing software providers, and other businesses related to photography, and presents it to the user. This allows the user to easily find the resources they need.
[0999] This system allows users to easily find new hobbies and receive specific support to get started in those hobbies. It also utilizes emotion recognition by an emotion engine to make optimal suggestions based on the user's interests and mood.
[1000] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1001] Step 1:
[1002] The server generates an HTML form for the user to enter basic information, including fields for age, address, gender, indoor / outdoor preferences, initial investment amount, monthly expenses, and interests. The server then sends the generated form to the terminal.
[1003] Input: None
[1004] Output: An HTML form to enter basic user information
[1005] Step 2:
[1006] The terminal displays the HTML form received from the server in the user's browser, adding appropriate labels and explanations to allow the user to input information intuitively.
[1007] Input: HTML form
[1008] Output: Input form displayed in browser
[1009] Step 3:
[1010] The user is presented with a form to enter basic information, including age, address, gender, indoor / outdoor preferences, initial investment amount, monthly expenses, and interests.
[1011] Input: Input form displayed in browser
[1012] Output: Basic information entered
[1013] Step 4:
[1014] The device sends the information entered by the user to the server in JSON format using a secure communication protocol (e.g., HTTPS).
[1015] Input: Basic information entered
[1016] Output: User basic information sent to the server
[1017] Step 5:
[1018] The server records the received user basic information in a database, which will be used in subsequent processes.
[1019] Input: User basic information
[1020] Output: Basic information recorded in the database
[1021] Step 6:
[1022] The server then sends prompts to the generative AI model based on the recorded information to generate hobby suggestions, which include factors such as the user's age, interests, and budget.
[1023] Example: "User information: Age = 60, Interests = Landscape, Travel, Budget = ¥30,000 initial, ¥10,000 monthly. Please suggest hobbies suitable for this user."
[1024] Input: Basic information recorded in the database
[1025] Output: A list of hobbies returned by the generative AI model
[1026] Step 7:
[1027] The server sends the generated interest list to the terminal in JSON format.
[1028] Input: Generated hobby list
[1029] Output: Interest list sent to the device
[1030] Step 8:
[1031] The device displays the hobby list to the user in a format that is easy for the user to visually review, along with a brief description of each hobby.
[1032] Input: Interest list received from the server
[1033] Output: Interests list displayed in a browser
[1034] Step 9:
[1035] The user selects one hobby that interests them from the list of suggested hobbies.
[1036] Input: A list of hobbies displayed in a browser
[1037] Output: Selected hobby
[1038] Step 10:
[1039] The terminal transmits information about the hobby selected by the user to the server.
[1040] Input: Selected Hobbies
[1041] Output: Selections sent to the server
[1042] Step 11:
[1043] The server retrieves details related to the selected hobby from a database or external API, such as the initial costs, maintenance costs, required equipment, and recommended spots for photography.
[1044] Input: Selected Hobbies
[1045] Output: Retrieved details
[1046] Step 12:
[1047] The device then displays the received detailed information to the user, visually displaying detailed information including specific instructions on how to get started and important points to note.
[1048] Input: Details received from the server
[1049] Output: Detailed information displayed in a browser
[1050] Step 13:
[1051] The emotion engine recognizes emotions from user reactions and inputs, and uses natural language processing (NLP) technology to analyze user emotions.
[1052] Input: User responses and input
[1053] Output: Recognized emotion
[1054] Step 14:
[1055] The server re-filters the list of hobbies based on the user's emotions recognized by the emotion engine, giving priority to hobbies that have generated positive reactions.
[1056] Input: Recognized emotions, list of hobbies
[1057] Output: A filtered list of hobbies
[1058] Step 15:
[1059] The emotion engine continuously monitors how users respond to suggested hobbies and adjusts the suggestions as needed.
[1060] Input: User response
[1061] Output: Monitoring results
[1062] Step 16:
[1063] The server will prioritize detailed information related to hobbies that have been positively responded to, providing the user with additional information that is likely to be of interest.
[1064] Input: Monitoring results, detailed information
[1065] Output: Prioritized detailed information
[1066] Step 17:
[1067] The server collects information about companies that provide services and goods that support hobbies and sends it to the device. Related company information is also obtained from external APIs.
[1068] Input: Selected Hobbies
[1069] Output: Retrieved company information
[1070] Step 18:
[1071] The device displays company information to the user, along with contact details and service overviews for each company.
[1072] Input: Company information received from the server
[1073] Output: Company information displayed in a browser
[1074] (Application example 2)
[1075] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1076] While conventional hobby suggestion systems can make suggestions based on a user's basic information, they have difficulty responding flexibly to the user's emotions and reactions to make optimal suggestions. Furthermore, conventional systems are limited to standard online platforms and are unable to improve the user experience in virtual environments. This results in low user satisfaction with the suggested hobbies and insufficient support for actually starting a hobby.
[1077] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: an input means for inputting basic information about the user; an information collection means for acquiring the basic information; a proposal generation means for generating hobby proposals based on the basic information; a presentation means for presenting the hobby proposals generated by the proposal generation means to the user; a detailed information acquisition means for acquiring detailed information related to the hobby selected by the user; a hobby detail presentation means for presenting the detailed hobby information acquired by the detailed information acquisition means to the user; a company introduction means for introducing business partners that provide services and goods necessary for the hobby practice presented by the hobby detail presentation means; an emotion recognition means for recognizing the user's emotions and filtering the hobby proposals generated by the proposal generation means; a means for preferentially presenting detailed information related to the hobby practice for which the emotion recognition means recognizes the emotion; and a virtual interface means for installing this system in a virtual environment and enabling the user to receive hobby proposals in a virtual store. This allows optimal hobby proposals to be made based on the user's emotions and preferences, and real-time emotion recognition in the virtual store significantly improves the user experience.
[1078] "Input means" refers to an interface device for collecting basic information about the user.
[1079] The "information collection means" is a device that acquires basic information entered by the user and transmits it to the server.
[1080] The "suggestion generation means" is a device that uses an AI model based on the acquired basic information of the user to generate hobby suggestions.
[1081] The "presentation means" is a device that visually or audibly presents the generated hobby suggestions to the user.
[1082] The "detailed information acquisition means" is a device that acquires detailed information related to the hobby selected by the user from an external resource.
[1083] The "interest detail presentation means" is a device that presents the acquired hobby detail information to the user.
[1084] The "company introduction means" is a device that introduces to the user information about companies that provide services and goods necessary for carrying out the hobby.
[1085] An "emotion recognition means" is a device that recognizes emotions by analyzing the user's facial expressions and voice data.
[1086] "Virtual interface means" means an interface device that allows a user to receive hobby suggestions within a virtual environment.
[1087] This system allows users to input basic information, and based on that information, suggests new hobbies and provides specific detailed information. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to suggest hobbies and provide detailed information that takes the user's emotions into consideration.
[1088] The system includes the following components:
[1089] Input means: An interface device that collects basic information from users through an application installed on a device such as a smartphone or tablet. Specifically, users are asked to enter information such as age, address, gender, indoor / outdoor preferences, initial investment costs, monthly expenses, and interests.
[1090] Information collection means: A device that transmits the basic information input through the input means from the terminal to the server. The communication protocol is a general internet communication.
[1091] Suggestion generation means: A device that acquires the basic information and generates hobby suggestions using a generative AI model. For example, the AI generates a hobby list based on the user's input information and returns the results to the server.
[1092] Presentation means: A device that displays the hobby suggestions generated by the suggestion generation means on the screen of a smartphone or tablet. Specifically, it visually presents the suggestion contents to the user in text or image format.
[1093] Detailed information acquisition means: A device that acquires detailed information related to the hobby selected by the user from the Internet. The detailed information includes an overview of the hobby, how to get started, the initial costs and monthly maintenance fees required, and information on related services and products.
[1094] Hobby details presentation means: A device that presents the detailed information acquired by the detailed information acquisition means to the user. It visually displays information about the hobby selected by the user and serves as a concrete guide for starting that hobby.
[1095] Company introduction means: A device that provides information on companies that offer services and goods that users need when starting a new hobby. Specifically, it introduces users to information on companies that sell related products and services.
[1096] Emotion recognition means: A system that recognizes emotions by analyzing the user's facial expressions and voice data. This determines how the user feels about the suggested hobbies, and filters the suggestions based on that result.
[1097] Virtual Interface Means: An interface device that allows the system to be installed in a virtual environment and allows users to receive hobby suggestions in a virtual store, for example, using a VR headset or smart glasses.
[1098] As a concrete example, a user inputs basic information through a smartphone app. For example, if a 60-year-old man is interested in "scenery" and "travel," and inputs conditions that the initial cost is 30,000 yen and the monthly cost is within 10,000 yen, the generative AI model will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips." In this case, the following prompt sentence is input to the generative AI model:
[1099] "Age: 60, Address: Tokyo, Gender: Male, Interests: Landscapes, Travel, What new hobby can you suggest?"
[1100] The emotion recognition means reads emotions from the user's facial expressions and voice, and presents the filtered results to the user. Then, detailed information about the hobby selected by the user is obtained using the detailed information acquisition means, and the information is provided to the user through the hobby detail presentation means. Furthermore, information about companies offering related products and services is also presented to the user through the company introduction means.
[1101] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1102] Step 1:
[1103] The user launches the app installed on their smartphone or tablet and displays a form for entering basic information.
[1104] Specifically, the application provides users with a screen where they can enter their age, address, gender, indoor / outdoor preferences, initial investment amount, monthly expenses, interests, etc.
[1105] (Input) User basic information
[1106] (Output) Display of input form
[1107] Step 2:
[1108] The user enters basic information and presses the submit button.
[1109] The entered information is sent from the device to the server, where data security is maintained using encrypted communication.
[1110] (Input) User input information (age, address, gender, interests, etc.)
[1111] (Output) Basic information sent to the server
[1112] Step 3:
[1113] The server analyzes and records the received user information.
[1114] This analysis involves manipulating a database to store basic user information in an appropriate format.
[1115] (Input) Basic information sent from the device
[1116] (Output) Save parsed user information
[1117] Step 4:
[1118] The server uses a generative AI model to generate a list of hobby suggestions based on user entries.
[1119] At this time, machine learning technology is used to generate optimal candidates based on the input conditions.
[1120] (Input) Recorded user information
[1121] (Output) A list of generated hobby suggestions
[1122] Step 5:
[1123] The server transmits the generated hobby suggestion list to the terminal and displays it.
[1124] The suggestions are displayed as a list for the user to visually review.
[1125] (Input) Generated hobby suggestion list
[1126] (Output) Hobby suggestions displayed on the device
[1127] Step 6:
[1128] The user selects a hobby that interests them from a list of suggestions.
[1129] It provides a one-tap selection interface and the selection is sent to the server.
[1130] (Input) User's hobby selection
[1131] (Output) Send selected hobby information to server
[1132] Step 7:
[1133] The server retrieves detailed information related to the selected hobby from the Internet.
[1134] Specifically, information is collected about the hobby, including an overview, how to get started, initial costs and monthly maintenance fees, and related products and services.
[1135] (Input) Selected hobby information
[1136] (Output) Detailed information about the acquired hobbies
[1137] Step 8:
[1138] The server sends the acquired detailed information to the terminal and displays it to the user.
[1139] Include images and links to ensure the information is presented in an easy-to-read format.
[1140] (Input) Detailed information about the acquired hobbies
[1141] (Output) Hobby details displayed on the device
[1142] Step 9:
[1143] The emotion recognition means analyzes the user's facial expressions and voice data to recognize the emotions.
[1144] It collects data in real time through cameras and microphones and applies sentiment analysis algorithms.
[1145] (Input) User's facial expression and voice data
[1146] (Output) Recognized emotion data
[1147] Step 10:
[1148] The server uses the emotion data provided by the emotion recognition means to filter the suggestions.
[1149] Prioritize detailed information related to hobbies that generate positive responses.
[1150] (Input) Recognized emotion data
[1151] (Output) Filtered suggestions
[1152] Step 11:
[1153] The server introduces information about companies that provide products and services necessary for users to start a hobby.
[1154] It provides users with information on related products and service providers, and displays shopping guidance and contact information.
[1155] (Input) Filtered suggestions
[1156] (Output) Company information introduced
[1157] Specific prompt examples:
[1158] "Age: 60, Address: Tokyo, Gender: Male, Interests: Landscapes, Travel, What new hobby can you suggest?"
[1159] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1160] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1161] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1162] [Third embodiment]
[1163] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1164] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[1165] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1166] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1167] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1168] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1169] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1170] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1171] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1172] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1173] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1174] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1175] The present invention is a system for inputting basic information of a user, proposing new hobbies based on the input information, and providing specific detailed information. This system includes an input means for inputting the user's basic information, an information collection means, a proposal generation means for generating hobby proposals, a presentation means for presenting the generated proposals, a detailed information acquisition means for acquiring detailed information about a hobby selected by the user, a hobby detail presentation means for presenting the detailed information, and a company introduction means for introducing business partners.
[1176] Program processing
[1177] Basic information input phase
[1178] Step 1: Displaying the input form
[1179] The server generates a form for entering basic information about the user and sends it to the terminal.
[1180] The terminal displays the submitted input form to the user.
[1181] Step 2: Enter basic information
[1182] The user fills in the form that appears with information such as age, address, gender, indoor / outdoor preferences, initial investment amount, monthly expenses, and interests.
[1183] The terminal transmits the information entered by the user to the server.
[1184] Hobby proposal phase
[1185] Step 1: Gather information
[1186] The server obtains and records the user's input information.
[1187] Step 2: Generate interest suggestions
[1188] The server uses a generation AI based on the acquired information to generate a list of hobbies suitable for the user.
[1189] The server transmits the generated interest list to the terminal.
[1190] As a concrete example, if a 60-year-old male user enters the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that monthly costs are within 10,000 yen, the generating AI will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips."
[1191] Hobby Detail Guide Phase
[1192] Step 1: Choose a hobby
[1193] The user selects a hobby that interests them from a list of suggested hobbies.
[1194] The terminal transmits the user's selection to the server.
[1195] Step 2: View hobby details
[1196] The server obtains detailed information about the selected hobby and transmits the information to the terminal.
[1197] The terminal displays detailed information to the user.
[1198] As a specific example, if the user selects "photography," the server provides an overview of photography, how to get started, available photo spots, required initial costs, and monthly maintenance fees.
[1199] Support and Account Introduction Phase
[1200] Step 1: Introducing services and goods
[1201] The server acquires information about companies that provide services and goods necessary for the user to start a hobby and transmits that information to the terminal.
[1202] The terminal displays the company information to the user.
[1203] As specific examples, we will introduce camera shops, photography classes, and editing software providers, all of which are related to photography.
[1204] In this way, users can easily discover new hobbies and receive specific support to get started in those hobbies.
[1205] The processing flow will be explained below.
[1206] The present invention is a system for inputting basic information of a user, proposing new hobbies based on the input information, and providing specific detailed information. This system includes an input means for inputting the user's basic information, an information collection means, a proposal generation means for generating hobby proposals, a presentation means for presenting the generated proposals, a detailed information acquisition means for acquiring detailed information about a hobby selected by the user, a hobby detail presentation means for presenting the detailed information, and a company introduction means for introducing business partners.
[1207] Program processing
[1208] Basic information input phase
[1209] Step 1:
[1210] The server generates a form for entering basic information about the user and sends it to the terminal.
[1211] Step 2:
[1212] The terminal displays the submitted input form to the user.
[1213] Step 3:
[1214] The user is presented with a form to enter the following information:
[1215] age
[1216] address
[1217] sex
[1218] Indoor and outdoor desires
[1219] Initial investment costs
[1220] Monthly costs
[1221] Interests
[1222] Step 4:
[1223] The terminal transmits the information entered by the user to the server.
[1224] Hobby proposal phase
[1225] Step 5:
[1226] The server obtains and records the user's input information.
[1227] Step 6:
[1228] The server uses a generation AI based on the acquired information to generate a list of hobbies suitable for the user.
[1229] Step 7:
[1230] The server transmits the generated interest list to the terminal.
[1231] Step 8:
[1232] The terminal displays the hobby list to the user.
[1233] As a concrete example, if a 60-year-old male user enters the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that monthly costs are within 10,000 yen, the generating AI will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips."
[1234] Hobby Detail Guide Phase
[1235] Step 9:
[1236] The user selects a hobby that interests them from a list of suggested hobbies.
[1237] Step 10:
[1238] The terminal transmits the user's selection to the server.
[1239] Step 11:
[1240] The server obtains detailed information about the selected hobby and transmits the information to the terminal.
[1241] Step 12:
[1242] The terminal displays the detailed information to the user.
[1243] As a specific example, if the user selects "photography," the server provides an overview of photography, how to get started, available photo spots, required initial costs, and monthly maintenance fees.
[1244] Support and Account Introduction Phase
[1245] Step 13:
[1246] The server acquires information about companies that provide services and goods necessary for the user to start a hobby and transmits that information to the terminal.
[1247] Step 14:
[1248] The terminal displays the company information to the user.
[1249] As specific examples, we will introduce camera shops, photography classes, and editing software providers, all of which are related to photography.
[1250] In this way, users can easily discover new hobbies and receive specific support to get started in those hobbies.
[1251] Example 1
[1252] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1253] Conventional hobby suggestion systems have limited suggestions to users, making it difficult to provide comprehensive information on a wide range of hobbies. They also lacked a mechanism for properly presenting specific hobby suggestions and detailed information tailored to a user's interests and budget. Furthermore, they were unable to properly introduce related services and product providers for pursuing a hobby, resulting in insufficient support for users starting a new hobby.
[1254] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1255] In this invention, the server includes an input means for inputting basic information about the user, an information collection means for acquiring the basic information, a proposal generation means for generating a prompt sentence using a generative AI model based on the basic information and generating hobby proposals suitable for the user, a presentation means for presenting the generated hobby proposals to the user, a detailed information acquisition means for acquiring detailed information related to the selected hobby, a hobby detail presentation means for presenting detailed information about the hobby to the user, and a company introduction means for introducing business partners that provide services and goods necessary for practicing the hobby. This makes it possible to propose specific and appropriate hobbies that suit the interests and budgets of a variety of users, and allows users to receive detailed information and related services to start a new hobby.
[1256] "Input means" is a function that provides an interface for the user to input basic information.
[1257] "Information collection means" is a function that acquires and records basic information entered by the user.
[1258] The "suggestion generation means" is a function in which the generative AI model generates prompt sentences based on the acquired basic information and creates hobby suggestions suitable for the user.
[1259] The "presentation means" is a function that displays the generated hobby suggestions to the user.
[1260] The "detailed information acquisition means" is a function for collecting detailed information about the hobby selected by the user.
[1261] The "interest detail presentation means" is a function that displays detailed information about the acquired interest to the user.
[1262] The "company introduction means" is a function that introduces business partners that provide services and goods necessary for carrying out a hobby.
[1263] A "generative AI model" is an artificial intelligence algorithm that generates appropriate suggestions for a user based on input prompts.
[1264] A "prompt sentence" is a sentence to be input into a generative AI model, and is created based on basic information about the user.
[1265] The present invention relates to a system for suggesting new hobbies based on a user's basic information and providing detailed information. The system includes an input means, an information collection means, a suggestion generation means, a presentation means, a detailed information acquisition means, a hobby detail presentation means, and a company introduction means.
[1266] The input means is an interface for users to enter basic information, and is provided as an HTML web form. The information collection means has the function of receiving the basic information entered by the user and recording it in a database. For the server to perform these basic processes, an Apache server or Nginx server, for example, can be used.
[1267] The suggestion generation means has a function in which a generative AI model generates prompt sentences based on the acquired basic information and creates a list of hobbies suitable for the user. A natural language generation model such as OpenAI GPT-3 can be used as the generative AI model. This suggestion generation means suggests hobbies that match the user's interests and budget.
[1268] As a concrete example, if a 60-year-old male user is interested in "scenery" and "travel," and inputs the conditions that the initial cost is 30,000 yen and the monthly cost is within 10,000 yen, the following prompt sentence will be generated:
[1269] "60-year-old male, interested in scenery and travel. Initial cost: less than 30,000 yen, monthly cost: less than 10,000 yen. Please suggest a new hobby that meets these conditions."
[1270] The generated hobby suggestions are displayed to the user via a presentation means. In this process, the device plays a role in displaying the generated hobby list to the user. When the user selects an interest from the suggested hobbies, detailed information about the selected hobby is obtained from a database or an external API via a detailed information obtaining means.
[1271] Detailed information is displayed to the user through a hobby detail presentation means. For example, if the user selects "photography," the server provides an overview of photography, how to get started, photo spots, and the required initial costs and monthly maintenance fees.
[1272] Furthermore, the company introduction means has a function of collecting information on business partners that provide services and goods necessary for carrying out hobbies and introducing this information to the user. For example, information on "camera shops," "photography classes," and "editing software providers" related to "photography" is displayed.
[1273] In this way, users can easily find new hobbies and receive detailed information and support related to them, which solves the problems of conventional hobby suggestion systems, such as the lack of diverse suggestions and specific support.
[1274] The above is a specific embodiment of the present invention. The overall flow of the present invention and the detailed functions of each element allow users to discover new hobbies and receive specific guidance for starting them.
[1275] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1276] Step 1:
[1277] The server generates an HTML input form for the user to enter basic information. The generated input form includes fields such as the user's age, address, gender, indoor / outdoor preferences, available initial investment, monthly expenses, and interests. The server sends the generated input form to the terminal as an HTTP response, which displays the input form in the terminal's browser.
[1278] Input: None
[1279] Output: HTML input form
[1280] Specific behavior:
[1281] When the user opens the browser on their device, an input form is displayed.
[1282] Step 2:
[1283] The user enters the required basic information into the displayed input form. The device converts the information entered by the user into JSON data and sends it to the server via an HTTP POST request. The server parses the received JSON data and obtains the user's basic information.
[1284] Input: Basic information entered by the user
[1285] Output: JSON data
[1286] Specific behavior:
[1287] The user fills out the form and clicks the "Submit" button.
[1288] Step 3:
[1289] The server records the user's basic information in a database. Based on the recorded basic information, the server generates a prompt to be input into the generative AI model. The generated prompt might be something like, "60-year-old male, interested in scenery and travel. Initial cost: less than 30,000 yen, monthly cost: less than 10,000 yen. Please suggest a new hobby that meets these conditions."
[1290] Input: User basic information
[1291] Output: prompt statement
[1292] Specific behavior:
[1293] The server generates a prompt sentence such as "60-year-old male, interested in scenery and travel. Initial cost: less than 30,000 yen, monthly cost: less than 10,000 yen. Please suggest a new hobby that meets these conditions."
[1294] Step 4:
[1295] The server inputs the generated prompt into the generative AI model, which analyzes the prompt and generates a list of hobbies suitable for the user. The list is converted into JSON format and sent from the server to the device, which then displays the received list of hobbies to the user.
[1296] Input: prompt statement
[1297] Output: Hobby list
[1298] Specific behavior:
[1299] Based on the user's criteria, the AI suggests hobbies such as "photography," "walking," "gardening," "historical exploration," and "road trips," and displays them in a list format.
[1300] Step 5:
[1301] The user selects the hobby they are interested in from the presented hobby list. The device converts the user's selection information into JSON format and sends it to the server.
[1302] Input: User's selected hobby
[1303] Output: JSON data
[1304] Specific behavior:
[1305] The user selects "Take a photo" from the list.
[1306] Step 6:
[1307] The server retrieves detailed information about the user's selected hobbies from a database or external API, converts the information into JSON format, and sends it to the device, which then displays the retrieved details to the user.
[1308] Input: User-selected hobby information
[1309] Output: Hobby details
[1310] Specific behavior:
[1311] The user checks detailed information about "photography" (for example, necessary equipment, how to get started, photo spots, estimated costs, etc.) on the device screen.
[1312] Step 7:
[1313] The server also retrieves information about companies that provide services and goods necessary for the user's hobby from a database or external API, converts the information into JSON format, and sends it to the device, which then displays the retrieved information to the user.
[1314] Input: User-selected hobby
[1315] Output: Company information
[1316] Specific behavior:
[1317] Users can check information related to photography, such as camera shops, photography classes, and editing software providers.
[1318] Through the above steps, users can find new hobbies and receive detailed information and related services.
[1319] (Application example 1)
[1320] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1321] Conventional systems provide insufficient support for users to discover new hobbies, especially lacking the ability to provide information on physical stores related to the hobby. This leaves users with the inconvenience of having to search for specific information and physical stores needed to start a hobby. Furthermore, detailed information on suggested hobbies cannot be easily obtained, which can create a high barrier to entry in the early stages of starting a hobby.
[1322] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1323] In this invention, the server includes an input means for inputting basic information about a user, an information collection means for acquiring the basic information, a proposal generation means for generating hobby proposals based on the basic information, a presentation means for presenting the hobby proposals generated by the proposal generation means to the user, a detailed information acquisition means for acquiring detailed information related to the hobby selected by the user, a hobby detail presentation means for presenting the detailed hobby information acquired by the detailed information acquisition means to the user, a company introduction means for introducing business partners that provide services and goods necessary for practicing the hobby presented by the hobby detail presentation means, and a store information presentation means for acquiring information about physical stores related to the hobby and presenting it to the user. This makes it easier for users to find new hobbies and enables them to quickly and efficiently obtain specific information and physical store information related to their hobbies.
[1324] "Input means" refers to the device or software functions that allow the user to input basic information.
[1325] "Information collection means" is a function that acquires the input basic information and sends it to the server.
[1326] The "suggestion generation means" is a function that uses a generation AI to generate hobby suggestions based on the acquired basic information.
[1327] The "presentation means" is a function that displays the generated hobby suggestions to the user.
[1328] The "detailed information acquisition means" is a function for acquiring detailed information related to the hobby selected by the user.
[1329] The "interest detail presentation means" is a function that displays detailed information about the acquired interest to the user.
[1330] The "company introduction means" is a function that introduces the user to business partners that provide services and goods necessary for carrying out the hobby.
[1331] The "store information presentation means" is a function that acquires information about physical stores related to the hobby selected by the user and displays it to the user.
[1332] The system for implementing this invention acquires basic information about a user, suggests new hobbies based on that information, and provides detailed information about the hobbies and information about brick-and-mortar stores. Specifically, the system is composed of the following means:
[1333] Hardware and Software Configuration
[1334] Hardware
[1335] Devices: smartphones, tablets, PCs
[1336] Server: Used for data processing and running generative AI models
[1337] software
[1338] Generative AI models: OpenAI GPT-4 as an example
[1339] Database management system: MySQL, etc.
[1340] Front-end: Web frameworks such as React and Angular
[1341] Backend: Node.js, Python, etc.
[1342] Program processing overview
[1343] Basic information input phase
[1344] The server generates an input form for the user to enter basic information and sends it to the terminal. When the user enters basic information such as age, gender, address, hobbies, initial costs, and monthly costs on the terminal, the terminal sends this information to the server.
[1345] Hobby proposal phase
[1346] The server uses a generative AI model to generate hobby suggestions based on the acquired user's basic information. The generated hobby list is sent to the device and presented to the user. For example, if a 60-year-old male user is interested in "scenery" and "travel," and inputs the conditions that the initial cost is 30,000 yen and the monthly cost is within 10,000 yen, the generative AI model will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips." These hobby suggestions are made using the following prompts:
[1347] A 60-year-old male interested in scenery and travel, with initial costs of 30,000 yen and monthly costs of less than 10,000 yen. Please suggest four to five new hobbies.
[1348] Hobby Detail Guide Phase
[1349] When a user selects a hobby that interests them from the hobby list, the selection information is sent to the server. The server obtains detailed information about the selected hobby and sends it to the terminal. The user can view this detailed information on the terminal. For example, if a user selects "photography," an overview of photography, how to get started, photo spots, required initial costs, and monthly maintenance fees are provided.
[1350] Please provide more information about your hobby "photography".
[1351] Support and Account Introduction Phase
[1352] The server collects information on partner companies that offer services and goods related to the user's selected hobby and sends it to the user's device. This allows the user to easily find the services and goods of partner companies. At the same time, the server also obtains information on physical stores related to the hobby and presents it to the user, providing information on nearby stores that the user can actually visit.
[1353] As a specific example, if you select "Photography," information about physical camera shops, photography classes, and camera maintenance services will be displayed.
[1354] In this way, the present invention realizes a system that makes it easy for users to find new hobbies and provides specific detailed information and brick-and-mortar store information quickly and efficiently.
[1355] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1356] Step 1:
[1357] The server generates an input form for inputting basic information of the user and sends it to the terminal.
[1358] Input: Database connection information at system startup
[1359] Data processing: Generate an HTML input form
[1360] Output: The generated input form
[1361] Specific behavior: Displays a form for the user to enter basic information (age, gender, address, hobbies, initial costs, monthly costs, etc.).
[1362] Step 2:
[1363] The user uses the terminal to enter basic information into the input form and clicks the send button.
[1364] Input: Basic user information entered in the form
[1365] Data processing: Convert the input data into JSON format
[1366] Output: Basic information in JSON format
[1367] What happens: The user enters all the desired information and clicks the submit button, which sends the data to the server.
[1368] Step 3:
[1369] The server receives the basic information sent from the terminal and stores the information in a database.
[1370] Input: Basic information in JSON format
[1371] Data processing: Converting data into a format for saving to a database
[1372] Output: Basic information stored in the database
[1373] Specific operation: The server registers basic information in the database, making it available for the next process.
[1374] Step 4:
[1375] The server generates hobby suggestions using a generative AI model based on basic information stored in a database.
[1376] Input: Basic information stored in the database
[1377] Data processing: Generate prompts for the generative AI model and input them into the model
[1378] Output: A list of hobby suggestions from the generative AI model
[1379] Specific operation: The generated prompt sentence (e.g., "60-year-old male, interested in scenery and travel, initial cost 30,000 yen, monthly cost within 10,000 yen. Please suggest four to five new hobbies.") is input into the AI model to obtain a list of hobby suggestions.
[1380] Step 5:
[1381] The server transmits the generated hobby suggestion list to the terminal and presents it to the user.
[1382] Input: A list of hobby suggestions from a generative AI model
[1383] Data processing: Convert to HTML for displaying the list
[1384] Output: A list of hobby suggestions displayed on the terminal
[1385] What it does: Allows users to review a list of hobby suggestions and select hobbies that interest them.
[1386] Step 6:
[1387] The user selects a hobby of interest from the hobby suggestion list presented on the terminal.
[1388] Input: User-selected hobby information
[1389] Data processing: Converting selected information into a format for sending to the server
[1390] Output: Selected hobby information sent to the server
[1391] Specific operation: Send the user's selected hobbies to the server.
[1392] Step 7:
[1393] The server obtains detailed information related to the hobby selected by the user and transmits it to the terminal.
[1394] Input: User-selected hobby information
[1395] Data processing: Retrieve detailed hobby-related information from the database and convert it to HTML
[1396] Output: Hobby details displayed on the terminal
[1397] Specific behavior: Provides users with an overview of a hobby, how to get started, what supplies are needed, costs, etc. Example: "Please provide more information about the hobby 'photography'."
[1398] Step 8:
[1399] The server collects information on business partners that provide services and goods related to the hobby selected by the user and transmits it to the terminal. It also collects information on brick-and-mortar stores related to the hobby and transmits it to the terminal.
[1400] Input: User-selected hobby information
[1401] Data processing: Retrieve information about business partners and physical stores from the database and convert it into HTML
[1402] Output: Account and physical store information displayed on the device
[1403] Specific operation: Provides users with information about hobby-related businesses and brick-and-mortar stores, such as camera shops and photography classes.
[1404] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1405] The present invention is a system that allows a user to input basic information, suggests new hobbies based on that information, and provides specific detailed information. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to suggest hobbies and provide detailed information that takes the user's emotions into consideration. This system includes an input means for inputting the user's basic information, an information collection means, a proposal generation means for generating hobby proposals, a presentation means for presenting the generated proposals, a detailed information acquisition means for acquiring detailed information about a hobby selected by the user, a hobby detail presentation means for presenting the detailed information, a company introduction means for introducing business partners, and the emotion engine.
[1406] Program processing
[1407] Basic information input phase
[1408] Step 1:
[1409] The server generates a form for entering basic information about the user and sends it to the terminal.
[1410] Step 2:
[1411] The terminal displays the submitted input form to the user.
[1412] Step 3:
[1413] The user is presented with a form to enter the following information:
[1414] age
[1415] address
[1416] sex
[1417] Indoor and outdoor desires
[1418] Initial investment costs
[1419] Monthly costs
[1420] Interests
[1421] Step 4:
[1422] The terminal transmits the information entered by the user to the server.
[1423] Hobby proposal phase
[1424] Step 5:
[1425] The server obtains and records the user's input information.
[1426] Step 6:
[1427] The server uses a generation AI based on the acquired information to generate a list of hobbies suitable for the user.
[1428] Step 7:
[1429] The server transmits the generated interest list to the terminal.
[1430] Step 8:
[1431] The terminal displays the hobby list to the user.
[1432] As a concrete example, if a 60-year-old male user enters the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that monthly costs are within 10,000 yen, the generating AI will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips."
[1433] Hobby Detail Guide Phase
[1434] Step 9:
[1435] The user selects a hobby that interests them from a list of suggested hobbies.
[1436] Step 10:
[1437] The terminal transmits the user's selection to the server.
[1438] Step 11:
[1439] The server obtains detailed information about the selected hobby and transmits the information to the terminal.
[1440] Step 12:
[1441] The terminal displays the detailed information to the user.
[1442] As a specific example, if the user selects "photography," the server provides an overview of photography, how to get started, available photo spots, required initial costs, and monthly maintenance fees.
[1443] Emotion engine phase
[1444] Step 13:
[1445] The emotion engine recognizes emotions from the user's reactions and input.
[1446] Step 14:
[1447] The server further filters the hobby suggestions taking into account the user's emotions recognized by the emotion engine.
[1448] Step 15:
[1449] The emotion engine monitors the user's reaction to the suggested hobbies.
[1450] Step 16:
[1451] The server will prioritize detailed information related to hobbies that have received a positive response.
[1452] As a specific example, if a user is interested in "photography" but also responds positively to "historical exploration," the server will prioritize providing detailed information related to "historical exploration."
[1453] Support and Account Introduction Phase
[1454] Step 17:
[1455] The server acquires information about companies that provide services and goods necessary for the user to start a hobby and transmits that information to the terminal.
[1456] Step 18:
[1457] The terminal displays the company information to the user.
[1458] As specific examples, we will introduce camera shops, photography classes, and editing software providers, all of which are related to photography.
[1459] In this way, users can easily discover new hobbies and receive specific support to get started in them. Furthermore, emotion recognition by the emotion engine enables more appropriate suggestions and detailed information tailored to the user's interests and preferences.
[1460] The processing flow will be explained below.
[1461] The present invention is a system that allows a user to input basic information, suggests new hobbies based on that information, and provides specific detailed information. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to suggest hobbies and provide detailed information that takes the user's emotions into consideration. This system includes an input means for inputting the user's basic information, an information collection means, a proposal generation means for generating hobby proposals, a presentation means for presenting the generated proposals, a detailed information acquisition means for acquiring detailed information about a hobby selected by the user, a hobby detail presentation means for presenting the detailed information, a company introduction means for introducing business partners, and the emotion engine.
[1462] Program processing
[1463] Basic information input phase
[1464] Step 1:
[1465] The server generates a form for entering basic information about the user and sends it to the terminal.
[1466] Step 2:
[1467] The terminal displays the submitted input form to the user.
[1468] Step 3:
[1469] The user is presented with a form to enter the following information:
[1470] age
[1471] address
[1472] sex
[1473] Indoor and outdoor desires
[1474] Initial investment costs
[1475] Monthly costs
[1476] Interests
[1477] Step 4:
[1478] The terminal transmits the information entered by the user to the server.
[1479] Hobby proposal phase
[1480] Step 5:
[1481] The server obtains and records the user's input information.
[1482] Step 6:
[1483] The server uses a generation AI based on the acquired information to generate a list of hobbies suitable for the user.
[1484] Step 7:
[1485] The server transmits the generated interest list to the terminal.
[1486] Step 8:
[1487] The terminal displays the hobby list to the user.
[1488] As a concrete example, if a 60-year-old male user enters the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that monthly costs are within 10,000 yen, the generating AI will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips."
[1489] Hobby Detail Guide Phase
[1490] Step 9:
[1491] The user selects a hobby that interests them from a list of suggested hobbies.
[1492] Step 10:
[1493] The terminal transmits the user's selection to the server.
[1494] Step 11:
[1495] The server obtains detailed information about the selected hobby and transmits the information to the terminal.
[1496] Step 12:
[1497] The terminal displays the detailed information to the user.
[1498] As a specific example, if the user selects "photography," the server provides an overview of photography, how to get started, available photo spots, required initial costs, and monthly maintenance fees.
[1499] Emotion engine phase
[1500] Step 13:
[1501] The emotion engine recognizes emotions from the user's reactions and input.
[1502] Step 14:
[1503] The server further filters the hobby suggestions taking into account the user's emotions recognized by the emotion engine.
[1504] Step 15:
[1505] The emotion engine monitors the user's reaction to the suggested hobbies.
[1506] Step 16:
[1507] The server will prioritize detailed information related to hobbies that have received a positive response.
[1508] As a specific example, if a user is interested in "photography" but also responds positively to "historical exploration," the server will prioritize providing detailed information related to "historical exploration."
[1509] Support and Account Introduction Phase
[1510] Step 17:
[1511] The server acquires information about companies that provide services and goods necessary for the user to start a hobby and transmits that information to the terminal.
[1512] Step 18:
[1513] The terminal displays the company information to the user.
[1514] As specific examples, we will introduce camera shops, photography classes, and editing software providers, all of which are related to photography.
[1515] In this way, users can easily discover new hobbies and receive specific support to get started in them. Furthermore, emotion recognition by the emotion engine enables more appropriate suggestions and detailed information tailored to the user's interests and preferences.
[1516] Example 2
[1517] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1518] Conventional hobby suggestion systems only provide the function of suggesting hobbies based on the user's basic information. However, these systems make uniform suggestions without considering the user's emotions, which means that they are unable to make suggestions that are appropriate for the user's interests and mood. Furthermore, they lack specific details on starting the suggested hobbies and introductions to related services and goods, which creates a high barrier to users actually starting the hobbies. A system that solves these problems is needed.
[1519] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1520] In this invention, the server includes: an input means for inputting basic information of a user; an information collection means for acquiring the basic information;
[1521] a suggestion generating means for generating hobby suggestions based on the basic information;
[1522] a presentation means for presenting the hobby suggestions generated by the suggestion generation means to the user;
[1523] A detailed information acquisition means for acquiring detailed information related to a hobby selected by a user;
[1524] a hobby detail presentation means for presenting detailed hobby information acquired by the detailed information acquisition means to the user;
[1525] a company introduction means for introducing business partners that provide goods necessary for carrying out the hobby presented by the hobby detail presentation means;
[1526] an emotion engine that recognizes the user's emotions;
[1527] means for filtering suggestions based on the user's emotions recognized by the emotion engine;
[1528] Includes:
[1529] This makes it possible to suggest hobbies and provide detailed information that takes into account the user's emotions, lowering the barrier to starting a hobby.
[1530] "Input means" refers to a device or software that allows a user to input basic information. It provides an interface for a user to input information.
[1531] "Information collection means" refers to a device or software that acquires basic information entered by the user and converts it into a format that can be used within the system.
[1532] The "proposal generating means" is a device or software that generates hobby suggestions suited to the user based on the acquired basic information.
[1533] The "presentation means" is a device or software that visually or audibly presents the generated hobby suggestions to the user.
[1534] The "detailed information acquisition means" is a device or software that acquires specific detailed information related to the hobby selected by the user.
[1535] The "interest detail presentation means" is a device or software that presents the user with detailed information about the interest acquired by the detailed information acquisition means.
[1536] The "company introduction means" is a device or software that introduces to the user business partners that provide goods and services necessary for carrying out the hobby presented by the hobby details presentation means.
[1537] An "emotion engine" is a device or software that recognizes a user's emotions and converts that emotional information into a format that can be used within the system.
[1538] A "filtering means" is a device or software that filters the list of suggested interests based on the user's emotions recognized by the emotion engine.
[1539] This system allows users to input basic information, suggests appropriate hobbies based on that information, and provides necessary detailed information. Furthermore, it aims to provide more personalized suggestions by recognizing the user's emotions and filtering the suggestions. This system is composed of hardware and software, including a server, a terminal, and an emotion engine.
[1540] Specifically, the server comprises the following components:
[1541] Input means for entering basic user information
[1542] Information collection method to obtain basic information entered
[1543] A proposal generator that generates hobby proposals based on basic information
[1544] a presentation means for presenting the hobby suggestions generated by the suggestion generation means to the user;
[1545] A detailed information acquisition means for acquiring detailed information related to the hobby selected by the user
[1546] A hobby detail presentation means for presenting the acquired detailed information to the user.
[1547] A company introduction tool that introduces companies that provide goods and services necessary for carrying out hobbies
[1548] Emotion engine that recognizes user emotions
[1549] Filtering measures to filter suggestions based on sentiment
[1550] Hardware and software used
[1551] Hardware:
[1552] Server: processes and stores data
[1553] Terminal: A device operated by a user (PC, smartphone, etc.)
[1554] software:
[1555] Input method: HTML form
[1556] Information collection method: Database management system (DBMS)
[1557] Proposal generation method: Generative AI model
[1558] Emotion Engine: Natural Language Processing (NLP) Engine
[1559] Examples of hobby suggestions
[1560] For example, if a 60-year-old male user inputs the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that the monthly cost is within 10,000 yen, the generative AI model will generate the following prompt:
[1561] "User information: Age = 60, Interests = Landscape, Travel, Budget = ¥30,000 initial, ¥10,000 monthly. Please suggest hobbies suitable for this user."
[1562] Based on this prompt, the AI generator suggests hobbies such as photography, walking, gardening, historical exploration, and car trips. The server sends these suggestions to the device, which then displays them on the user's screen.
[1563] Providing more information
[1564] If the user selects "photography" from the suggested hobbies, the server retrieves detailed information about photography from a database or external API. This information includes an overview of photography, how to get started, recommended photo spots, required initial costs, monthly maintenance fees, etc. The device displays this information to the user and provides specific instructions on how to get started.
[1565] Utilizing the Emotion Engine
[1566] The emotion engine recognizes emotions from user input and operation logs. For example, if a user has a positive reaction to taking a photo, the server uses the emotion engine's evaluation results to prioritize providing related information that is likely to be of more interest to the user. In this way, the user experience can be improved.
[1567] Company Introduction
[1568] The server collects information on businesses that provide goods and services needed to start a hobby and sends it to the terminal. For example, it obtains information on camera shops, photography classes, editing software providers, and other businesses related to photography, and presents it to the user. This allows the user to easily find the resources they need.
[1569] This system allows users to easily find new hobbies and receive specific support to get started in those hobbies. It also utilizes emotion recognition by an emotion engine to make optimal suggestions based on the user's interests and mood.
[1570] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1571] Step 1:
[1572] The server generates an HTML form for the user to enter basic information, including fields for age, address, gender, indoor / outdoor preferences, initial investment amount, monthly expenses, and interests. The server then sends the generated form to the terminal.
[1573] Input: None
[1574] Output: An HTML form to enter basic user information
[1575] Step 2:
[1576] The terminal displays the HTML form received from the server in the user's browser, adding appropriate labels and explanations to allow the user to input information intuitively.
[1577] Input: HTML form
[1578] Output: Input form displayed in browser
[1579] Step 3:
[1580] The user is presented with a form to enter basic information, including age, address, gender, indoor / outdoor preferences, initial investment amount, monthly expenses, and interests.
[1581] Input: Input form displayed in browser
[1582] Output: Basic information entered
[1583] Step 4:
[1584] The device sends the information entered by the user to the server in JSON format using a secure communication protocol (e.g., HTTPS).
[1585] Input: Basic information entered
[1586] Output: User basic information sent to the server
[1587] Step 5:
[1588] The server records the received user basic information in a database, which will be used in subsequent processes.
[1589] Input: User basic information
[1590] Output: Basic information recorded in the database
[1591] Step 6:
[1592] The server then sends prompts to the generative AI model based on the recorded information to generate hobby suggestions, which include factors such as the user's age, interests, and budget.
[1593] Example: "User information: Age = 60, Interests = Landscape, Travel, Budget = ¥30,000 initial, ¥10,000 monthly. Please suggest hobbies suitable for this user."
[1594] Input: Basic information recorded in the database
[1595] Output: A list of hobbies returned by the generative AI model
[1596] Step 7:
[1597] The server sends the generated interest list to the terminal in JSON format.
[1598] Input: Generated hobby list
[1599] Output: Interest list sent to the device
[1600] Step 8:
[1601] The device displays the hobby list to the user in a format that is easy for the user to visually review, along with a brief description of each hobby.
[1602] Input: Interest list received from the server
[1603] Output: Interests list displayed in a browser
[1604] Step 9:
[1605] The user selects one hobby that interests them from the list of suggested hobbies.
[1606] Input: A list of hobbies displayed in a browser
[1607] Output: Selected hobby
[1608] Step 10:
[1609] The terminal transmits information about the hobby selected by the user to the server.
[1610] Input: Selected Hobbies
[1611] Output: Selections sent to the server
[1612] Step 11:
[1613] The server retrieves details related to the selected hobby from a database or external API, such as the initial costs, maintenance costs, required equipment, and recommended spots for photography.
[1614] Input: Selected Hobbies
[1615] Output: Retrieved details
[1616] Step 12:
[1617] The device then displays the received detailed information to the user, visually displaying detailed information including specific instructions on how to get started and important points to note.
[1618] Input: Details received from the server
[1619] Output: Detailed information displayed in a browser
[1620] Step 13:
[1621] The emotion engine recognizes emotions from user reactions and inputs, and uses natural language processing (NLP) technology to analyze user emotions.
[1622] Input: User responses and input
[1623] Output: Recognized emotion
[1624] Step 14:
[1625] The server re-filters the list of hobbies based on the user's emotions recognized by the emotion engine, giving priority to hobbies that have generated positive reactions.
[1626] Input: Recognized emotions, list of hobbies
[1627] Output: A filtered list of hobbies
[1628] Step 15:
[1629] The emotion engine continuously monitors how users respond to suggested hobbies and adjusts the suggestions as needed.
[1630] Input: User response
[1631] Output: Monitoring results
[1632] Step 16:
[1633] The server will prioritize detailed information related to hobbies that have been positively responded to, providing the user with additional information that is likely to be of interest.
[1634] Input: Monitoring results, detailed information
[1635] Output: Prioritized detailed information
[1636] Step 17:
[1637] The server collects information about companies that provide services and goods that support hobbies and sends it to the device. Related company information is also obtained from external APIs.
[1638] Input: Selected Hobbies
[1639] Output: Retrieved company information
[1640] Step 18:
[1641] The device displays company information to the user, along with contact details and service overviews for each company.
[1642] Input: Company information received from the server
[1643] Output: Company information displayed in a browser
[1644] (Application example 2)
[1645] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1646] While conventional hobby suggestion systems can make suggestions based on a user's basic information, they have difficulty responding flexibly to the user's emotions and reactions to make optimal suggestions. Furthermore, conventional systems are limited to standard online platforms and are unable to improve the user experience in virtual environments. This results in low user satisfaction with the suggested hobbies and insufficient support for actually starting a hobby.
[1647] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: an input means for inputting basic information about the user; an information collection means for acquiring the basic information; a proposal generation means for generating hobby proposals based on the basic information; a presentation means for presenting the hobby proposals generated by the proposal generation means to the user; a detailed information acquisition means for acquiring detailed information related to the hobby selected by the user; a hobby detail presentation means for presenting the detailed hobby information acquired by the detailed information acquisition means to the user; a company introduction means for introducing business partners that provide services and goods necessary for the hobby practice presented by the hobby detail presentation means; an emotion recognition means for recognizing the user's emotions and filtering the hobby proposals generated by the proposal generation means; a means for preferentially presenting detailed information related to the hobby practice for which the emotion recognition means recognizes the emotion; and a virtual interface means for installing this system in a virtual environment and enabling the user to receive hobby proposals in a virtual store. This allows optimal hobby proposals to be made based on the user's emotions and preferences, and real-time emotion recognition in the virtual store significantly improves the user experience.
[1648] "Input means" refers to an interface device for collecting basic information about the user.
[1649] The "information collection means" is a device that acquires basic information entered by the user and transmits it to the server.
[1650] The "suggestion generation means" is a device that uses an AI model based on the acquired basic information of the user to generate hobby suggestions.
[1651] The "presentation means" is a device that visually or audibly presents the generated hobby suggestions to the user.
[1652] The "detailed information acquisition means" is a device that acquires detailed information related to the hobby selected by the user from an external resource.
[1653] The "interest detail presentation means" is a device that presents the acquired hobby detail information to the user.
[1654] The "company introduction means" is a device that introduces to the user information about companies that provide services and goods necessary for carrying out the hobby.
[1655] An "emotion recognition means" is a device that recognizes emotions by analyzing the user's facial expressions and voice data.
[1656] "Virtual interface means" means an interface device that allows a user to receive hobby suggestions within a virtual environment.
[1657] This system allows users to input basic information, and based on that information, suggests new hobbies and provides specific detailed information. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to suggest hobbies and provide detailed information that takes the user's emotions into consideration.
[1658] The system includes the following components:
[1659] Input means: An interface device that collects basic information from users through an application installed on a device such as a smartphone or tablet. Specifically, users are asked to enter information such as age, address, gender, indoor / outdoor preferences, initial investment costs, monthly expenses, and interests.
[1660] Information collection means: A device that transmits the basic information input through the input means from the terminal to the server. The communication protocol is a general internet communication.
[1661] Suggestion generation means: A device that acquires the basic information and generates hobby suggestions using a generative AI model. For example, the AI generates a hobby list based on the user's input information and returns the results to the server.
[1662] Presentation means: A device that displays the hobby suggestions generated by the suggestion generation means on the screen of a smartphone or tablet. Specifically, it visually presents the suggestion contents to the user in text or image format.
[1663] Detailed information acquisition means: A device that acquires detailed information related to the hobby selected by the user from the Internet. The detailed information includes an overview of the hobby, how to get started, the initial costs and monthly maintenance fees required, and information on related services and products.
[1664] Hobby details presentation means: A device that presents the detailed information acquired by the detailed information acquisition means to the user. It visually displays information about the hobby selected by the user and serves as a concrete guide for starting that hobby.
[1665] Company introduction means: A device that provides information on companies that offer services and goods that users need when starting a new hobby. Specifically, it introduces users to information on companies that sell related products and services.
[1666] Emotion recognition means: A system that recognizes emotions by analyzing the user's facial expressions and voice data. This determines how the user feels about the suggested hobbies, and filters the suggestions based on that result.
[1667] Virtual Interface Means: An interface device that allows the system to be installed in a virtual environment and allows users to receive hobby suggestions in a virtual store, for example, using a VR headset or smart glasses.
[1668] As a concrete example, a user inputs basic information through a smartphone app. For example, if a 60-year-old man is interested in "scenery" and "travel," and inputs conditions that the initial cost is 30,000 yen and the monthly cost is within 10,000 yen, the generative AI model will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips." In this case, the following prompt sentence is input to the generative AI model:
[1669] "Age: 60, Address: Tokyo, Gender: Male, Interests: Landscapes, Travel, What new hobby can you suggest?"
[1670] The emotion recognition means reads emotions from the user's facial expressions and voice, and presents the filtered results to the user. Then, detailed information about the hobby selected by the user is obtained using the detailed information acquisition means, and the information is provided to the user through the hobby detail presentation means. Furthermore, information about companies offering related products and services is also presented to the user through the company introduction means.
[1671] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1672] Step 1:
[1673] The user launches the app installed on their smartphone or tablet and displays a form for entering basic information.
[1674] Specifically, the application provides users with a screen where they can enter their age, address, gender, indoor / outdoor preferences, initial investment amount, monthly expenses, interests, etc.
[1675] (Input) User basic information
[1676] (Output) Display of input form
[1677] Step 2:
[1678] The user enters basic information and presses the submit button.
[1679] The entered information is sent from the device to the server, where data security is maintained using encrypted communication.
[1680] (Input) User input information (age, address, gender, interests, etc.)
[1681] (Output) Basic information sent to the server
[1682] Step 3:
[1683] The server analyzes and records the received user information.
[1684] This analysis involves manipulating a database to store basic user information in an appropriate format.
[1685] (Input) Basic information sent from the device
[1686] (Output) Save parsed user information
[1687] Step 4:
[1688] The server uses a generative AI model to generate a list of hobby suggestions based on user entries.
[1689] At this time, machine learning technology is used to generate optimal candidates based on the input conditions.
[1690] (Input) Recorded user information
[1691] (Output) A list of generated hobby suggestions
[1692] Step 5:
[1693] The server transmits the generated hobby suggestion list to the terminal and displays it.
[1694] The suggestions are displayed as a list for the user to visually review.
[1695] (Input) Generated hobby suggestion list
[1696] (Output) Hobby suggestions displayed on the device
[1697] Step 6:
[1698] The user selects a hobby that interests them from a list of suggestions.
[1699] It provides a one-tap selection interface and the selection is sent to the server.
[1700] (Input) User's hobby selection
[1701] (Output) Send selected hobby information to server
[1702] Step 7:
[1703] The server retrieves detailed information related to the selected hobby from the Internet.
[1704] Specifically, information is collected about the hobby, including an overview, how to get started, initial costs and monthly maintenance fees, and related products and services.
[1705] (Input) Selected hobby information
[1706] (Output) Detailed information about the acquired hobbies
[1707] Step 8:
[1708] The server sends the acquired detailed information to the terminal and displays it to the user.
[1709] Include images and links to ensure the information is presented in an easy-to-read format.
[1710] (Input) Detailed information about the acquired hobbies
[1711] (Output) Hobby details displayed on the device
[1712] Step 9:
[1713] The emotion recognition means analyzes the user's facial expressions and voice data to recognize the emotions.
[1714] It collects data in real time through cameras and microphones and applies sentiment analysis algorithms.
[1715] (Input) User's facial expression and voice data
[1716] (Output) Recognized emotion data
[1717] Step 10:
[1718] The server uses the emotion data provided by the emotion recognition means to filter the suggestions.
[1719] Prioritize detailed information related to hobbies that generate positive responses.
[1720] (Input) Recognized emotion data
[1721] (Output) Filtered suggestions
[1722] Step 11:
[1723] The server introduces information about companies that provide products and services necessary for users to start a hobby.
[1724] It provides users with information on related products and service providers, and displays shopping guidance and contact information.
[1725] (Input) Filtered suggestions
[1726] (Output) Company information introduced
[1727] Specific prompt examples:
[1728] "Age: 60, Address: Tokyo, Gender: Male, Interests: Landscapes, Travel, What new hobby can you suggest?"
[1729] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1730] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1731] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1732] [Fourth embodiment]
[1733] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1734] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1735] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1736] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1737] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1738] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1739] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1740] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1741] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1742] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1743] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1744] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1745] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1746] The present invention is a system for inputting basic information of a user, proposing new hobbies based on the input information, and providing specific detailed information. This system includes an input means for inputting the user's basic information, an information collection means, a proposal generation means for generating hobby proposals, a presentation means for presenting the generated proposals, a detailed information acquisition means for acquiring detailed information about a hobby selected by the user, a hobby detail presentation means for presenting the detailed information, and a company introduction means for introducing business partners.
[1747] Program processing
[1748] Basic information input phase
[1749] Step 1: Displaying the input form
[1750] The server generates a form for entering basic information about the user and sends it to the terminal.
[1751] The terminal displays the submitted input form to the user.
[1752] Step 2: Enter basic information
[1753] The user fills in the form that appears with information such as age, address, gender, indoor / outdoor preferences, initial investment amount, monthly expenses, and interests.
[1754] The terminal transmits the information entered by the user to the server.
[1755] Hobby proposal phase
[1756] Step 1: Gather information
[1757] The server obtains and records the user's input information.
[1758] Step 2: Generate interest suggestions
[1759] The server uses a generation AI based on the acquired information to generate a list of hobbies suitable for the user.
[1760] The server transmits the generated interest list to the terminal.
[1761] As a concrete example, if a 60-year-old male user enters the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that monthly costs are within 10,000 yen, the generating AI will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips."
[1762] Hobby Detail Guide Phase
[1763] Step 1: Choose a hobby
[1764] The user selects a hobby that interests them from a list of suggested hobbies.
[1765] The terminal transmits the user's selection to the server.
[1766] Step 2: View hobby details
[1767] The server obtains detailed information about the selected hobby and transmits the information to the terminal.
[1768] The terminal displays detailed information to the user.
[1769] As a specific example, if the user selects "photography," the server provides an overview of photography, how to get started, available photo spots, required initial costs, and monthly maintenance fees.
[1770] Support and Account Introduction Phase
[1771] Step 1: Introducing services and goods
[1772] The server acquires information about companies that provide services and goods necessary for the user to start a hobby and transmits that information to the terminal.
[1773] The terminal displays the company information to the user.
[1774] As specific examples, we will introduce camera shops, photography classes, and editing software providers, all of which are related to photography.
[1775] In this way, users can easily discover new hobbies and receive specific support to get started in those hobbies.
[1776] The processing flow will be explained below.
[1777] The present invention is a system for inputting basic information of a user, proposing new hobbies based on the input information, and providing specific detailed information. This system includes an input means for inputting the user's basic information, an information collection means, a proposal generation means for generating hobby proposals, a presentation means for presenting the generated proposals, a detailed information acquisition means for acquiring detailed information about a hobby selected by the user, a hobby detail presentation means for presenting the detailed information, and a company introduction means for introducing business partners.
[1778] Program processing
[1779] Basic information input phase
[1780] Step 1:
[1781] The server generates a form for entering basic information about the user and sends it to the terminal.
[1782] Step 2:
[1783] The terminal displays the submitted input form to the user.
[1784] Step 3:
[1785] The user is presented with a form to enter the following information:
[1786] age
[1787] address
[1788] sex
[1789] Indoor and outdoor desires
[1790] Initial investment costs
[1791] Monthly costs
[1792] Interests
[1793] Step 4:
[1794] The terminal transmits the information entered by the user to the server.
[1795] Hobby proposal phase
[1796] Step 5:
[1797] The server obtains and records the user's input information.
[1798] Step 6:
[1799] The server uses a generation AI based on the acquired information to generate a list of hobbies suitable for the user.
[1800] Step 7:
[1801] The server transmits the generated interest list to the terminal.
[1802] Step 8:
[1803] The terminal displays the hobby list to the user.
[1804] As a concrete example, if a 60-year-old male user enters the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that monthly costs are within 10,000 yen, the generating AI will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips."
[1805] Hobby Detail Guide Phase
[1806] Step 9:
[1807] The user selects a hobby that interests them from a list of suggested hobbies.
[1808] Step 10:
[1809] The terminal transmits the user's selection to the server.
[1810] Step 11:
[1811] The server obtains detailed information about the selected hobby and transmits the information to the terminal.
[1812] Step 12:
[1813] The terminal displays the detailed information to the user.
[1814] As a specific example, if the user selects "photography," the server provides an overview of photography, how to get started, available photo spots, required initial costs, and monthly maintenance fees.
[1815] Support and Account Introduction Phase
[1816] Step 13:
[1817] The server acquires information about companies that provide services and goods necessary for the user to start a hobby and transmits that information to the terminal.
[1818] Step 14:
[1819] The terminal displays the company information to the user.
[1820] As specific examples, we will introduce camera shops, photography classes, and editing software providers, all of which are related to photography.
[1821] In this way, users can easily discover new hobbies and receive specific support to get started in those hobbies.
[1822] Example 1
[1823] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1824] Conventional hobby suggestion systems have limited suggestions to users, making it difficult to provide comprehensive information on a wide range of hobbies. They also lacked a mechanism for properly presenting specific hobby suggestions and detailed information tailored to a user's interests and budget. Furthermore, they were unable to properly introduce related services and product providers for pursuing a hobby, resulting in insufficient support for users starting a new hobby.
[1825] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1826] In this invention, the server includes an input means for inputting basic information about the user, an information collection means for acquiring the basic information, a proposal generation means for generating a prompt sentence using a generative AI model based on the basic information and generating hobby proposals suitable for the user, a presentation means for presenting the generated hobby proposals to the user, a detailed information acquisition means for acquiring detailed information related to the selected hobby, a hobby detail presentation means for presenting detailed information about the hobby to the user, and a company introduction means for introducing business partners that provide services and goods necessary for practicing the hobby. This makes it possible to propose specific and appropriate hobbies that suit the interests and budgets of a variety of users, and allows users to receive detailed information and related services to start a new hobby.
[1827] "Input means" is a function that provides an interface for the user to input basic information.
[1828] "Information collection means" is a function that acquires and records basic information entered by the user.
[1829] The "suggestion generation means" is a function in which the generative AI model generates prompt sentences based on the acquired basic information and creates hobby suggestions suitable for the user.
[1830] The "presentation means" is a function that displays the generated hobby suggestions to the user.
[1831] The "detailed information acquisition means" is a function for collecting detailed information about the hobby selected by the user.
[1832] The "interest detail presentation means" is a function that displays detailed information about the acquired interest to the user.
[1833] The "company introduction means" is a function that introduces business partners that provide services and goods necessary for carrying out a hobby.
[1834] A "generative AI model" is an artificial intelligence algorithm that generates appropriate suggestions for a user based on input prompts.
[1835] A "prompt sentence" is a sentence to be input into a generative AI model, and is created based on basic information about the user.
[1836] The present invention relates to a system for suggesting new hobbies based on a user's basic information and providing detailed information. The system includes an input means, an information collection means, a suggestion generation means, a presentation means, a detailed information acquisition means, a hobby detail presentation means, and a company introduction means.
[1837] The input means is an interface for users to enter basic information, and is provided as an HTML web form. The information collection means has the function of receiving the basic information entered by the user and recording it in a database. For the server to perform these basic processes, an Apache server or Nginx server, for example, can be used.
[1838] The suggestion generation means has a function in which a generative AI model generates prompt sentences based on the acquired basic information and creates a list of hobbies suitable for the user. A natural language generation model such as OpenAI GPT-3 can be used as the generative AI model. This suggestion generation means suggests hobbies that match the user's interests and budget.
[1839] As a concrete example, if a 60-year-old male user is interested in "scenery" and "travel," and inputs the conditions that the initial cost is 30,000 yen and the monthly cost is within 10,000 yen, the following prompt sentence will be generated:
[1840] "60-year-old male, interested in scenery and travel. Initial cost: less than 30,000 yen, monthly cost: less than 10,000 yen. Please suggest a new hobby that meets these conditions."
[1841] The generated hobby suggestions are displayed to the user via a presentation means. In this process, the device plays a role in displaying the generated hobby list to the user. When the user selects an interest from the suggested hobbies, detailed information about the selected hobby is obtained from a database or an external API via a detailed information obtaining means.
[1842] Detailed information is displayed to the user through a hobby detail presentation means. For example, if the user selects "photography," the server provides an overview of photography, how to get started, photo spots, and the required initial costs and monthly maintenance fees.
[1843] Furthermore, the company introduction means has a function of collecting information on business partners that provide services and goods necessary for carrying out hobbies and introducing this information to the user. For example, information on "camera shops," "photography classes," and "editing software providers" related to "photography" is displayed.
[1844] In this way, users can easily find new hobbies and receive detailed information and support related to them, which solves the problems of conventional hobby suggestion systems, such as the lack of diverse suggestions and specific support.
[1845] The above is a specific embodiment of the present invention. The overall flow of the present invention and the detailed functions of each element allow users to discover new hobbies and receive specific guidance for starting them.
[1846] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1847] Step 1:
[1848] The server generates an HTML input form for the user to enter basic information. The generated input form includes fields such as the user's age, address, gender, indoor / outdoor preferences, available initial investment, monthly expenses, and interests. The server sends the generated input form to the terminal as an HTTP response, which displays the input form in the terminal's browser.
[1849] Input: None
[1850] Output: HTML input form
[1851] Specific behavior:
[1852] When the user opens the browser on their device, an input form is displayed.
[1853] Step 2:
[1854] The user enters the required basic information into the displayed input form. The device converts the information entered by the user into JSON data and sends it to the server via an HTTP POST request. The server parses the received JSON data and obtains the user's basic information.
[1855] Input: Basic information entered by the user
[1856] Output: JSON data
[1857] Specific behavior:
[1858] The user fills out the form and clicks the "Submit" button.
[1859] Step 3:
[1860] The server records the user's basic information in a database. Based on the recorded basic information, the server generates a prompt to be input into the generative AI model. The generated prompt might be something like, "60-year-old male, interested in scenery and travel. Initial cost: less than 30,000 yen, monthly cost: less than 10,000 yen. Please suggest a new hobby that meets these conditions."
[1861] Input: User basic information
[1862] Output: prompt statement
[1863] Specific behavior:
[1864] The server generates a prompt sentence such as "60-year-old male, interested in scenery and travel. Initial cost: less than 30,000 yen, monthly cost: less than 10,000 yen. Please suggest a new hobby that meets these conditions."
[1865] Step 4:
[1866] The server inputs the generated prompt into the generative AI model, which analyzes the prompt and generates a list of hobbies suitable for the user. The list is converted into JSON format and sent from the server to the device, which then displays the received list of hobbies to the user.
[1867] Input: prompt statement
[1868] Output: Hobby list
[1869] Specific behavior:
[1870] Based on the user's criteria, the AI suggests hobbies such as "photography," "walking," "gardening," "historical exploration," and "road trips," and displays them in a list format.
[1871] Step 5:
[1872] The user selects the hobby they are interested in from the presented hobby list. The device converts the user's selection information into JSON format and sends it to the server.
[1873] Input: User's selected hobby
[1874] Output: JSON data
[1875] Specific behavior:
[1876] The user selects "Take a photo" from the list.
[1877] Step 6:
[1878] The server retrieves detailed information about the user's selected hobbies from a database or external API, converts the information into JSON format, and sends it to the device, which then displays the retrieved details to the user.
[1879] Input: User-selected hobby information
[1880] Output: Hobby details
[1881] Specific behavior:
[1882] The user checks detailed information about "photography" (for example, necessary equipment, how to get started, photo spots, estimated costs, etc.) on the device screen.
[1883] Step 7:
[1884] The server also retrieves information about companies that provide services and goods necessary for the user's hobby from a database or external API, converts the information into JSON format, and sends it to the device, which then displays the retrieved information to the user.
[1885] Input: User-selected hobby
[1886] Output: Company information
[1887] Specific behavior:
[1888] Users can check information related to photography, such as camera shops, photography classes, and editing software providers.
[1889] Through the above steps, users can find new hobbies and receive detailed information and related services.
[1890] (Application example 1)
[1891] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1892] Conventional systems provide insufficient support for users to discover new hobbies, especially lacking the ability to provide information on physical stores related to the hobby. This leaves users with the inconvenience of having to search for specific information and physical stores needed to start a hobby. Furthermore, detailed information on suggested hobbies cannot be easily obtained, which can create a high barrier to entry in the early stages of starting a hobby.
[1893] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1894] In this invention, the server includes an input means for inputting basic information about a user, an information collection means for acquiring the basic information, a proposal generation means for generating hobby proposals based on the basic information, a presentation means for presenting the hobby proposals generated by the proposal generation means to the user, a detailed information acquisition means for acquiring detailed information related to the hobby selected by the user, a hobby detail presentation means for presenting the detailed hobby information acquired by the detailed information acquisition means to the user, a company introduction means for introducing business partners that provide services and goods necessary for practicing the hobby presented by the hobby detail presentation means, and a store information presentation means for acquiring information about physical stores related to the hobby and presenting it to the user. This makes it easier for users to find new hobbies and enables them to quickly and efficiently obtain specific information and physical store information related to their hobbies.
[1895] "Input means" refers to the device or software functions that allow the user to input basic information.
[1896] "Information collection means" is a function that acquires the input basic information and sends it to the server.
[1897] The "suggestion generation means" is a function that uses a generation AI to generate hobby suggestions based on the acquired basic information.
[1898] The "presentation means" is a function that displays the generated hobby suggestions to the user.
[1899] The "detailed information acquisition means" is a function for acquiring detailed information related to the hobby selected by the user.
[1900] The "interest detail presentation means" is a function that displays detailed information about the acquired interest to the user.
[1901] The "company introduction means" is a function that introduces the user to business partners that provide services and goods necessary for carrying out the hobby.
[1902] The "store information presentation means" is a function that acquires information about physical stores related to the hobby selected by the user and displays it to the user.
[1903] The system for implementing this invention acquires basic information about a user, suggests new hobbies based on that information, and provides detailed information about the hobbies and information about brick-and-mortar stores. Specifically, the system is composed of the following means:
[1904] Hardware and Software Configuration
[1905] Hardware
[1906] Devices: smartphones, tablets, PCs
[1907] Server: Used for data processing and running generative AI models
[1908] software
[1909] Generative AI models: OpenAI GPT-4 as an example
[1910] Database management system: MySQL, etc.
[1911] Front-end: Web frameworks such as React and Angular
[1912] Backend: Node.js, Python, etc.
[1913] Program processing overview
[1914] Basic information input phase
[1915] The server generates an input form for the user to enter basic information and sends it to the terminal. When the user enters basic information such as age, gender, address, hobbies, initial costs, and monthly costs on the terminal, the terminal sends this information to the server.
[1916] Hobby proposal phase
[1917] The server uses a generative AI model to generate hobby suggestions based on the acquired user's basic information. The generated hobby list is sent to the device and presented to the user. For example, if a 60-year-old male user is interested in "scenery" and "travel," and inputs the conditions that the initial cost is 30,000 yen and the monthly cost is within 10,000 yen, the generative AI model will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips." These hobby suggestions are made using the following prompts:
[1918] A 60-year-old male interested in scenery and travel, with initial costs of 30,000 yen and monthly costs of less than 10,000 yen. Please suggest four to five new hobbies.
[1919] Hobby Detail Guide Phase
[1920] When a user selects a hobby that interests them from the hobby list, the selection information is sent to the server. The server obtains detailed information about the selected hobby and sends it to the terminal. The user can view this detailed information on the terminal. For example, if a user selects "photography," an overview of photography, how to get started, photo spots, required initial costs, and monthly maintenance fees are provided.
[1921] Please provide more information about your hobby "photography".
[1922] Support and Account Introduction Phase
[1923] The server collects information on partner companies that offer services and goods related to the user's selected hobby and sends it to the user's device. This allows the user to easily find the services and goods of partner companies. At the same time, the server also obtains information on physical stores related to the hobby and presents it to the user, providing information on nearby stores that the user can actually visit.
[1924] As a specific example, if you select "Photography," information about physical camera shops, photography classes, and camera maintenance services will be displayed.
[1925] In this way, the present invention realizes a system that makes it easy for users to find new hobbies and provides specific detailed information and brick-and-mortar store information quickly and efficiently.
[1926] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1927] Step 1:
[1928] The server generates an input form for inputting basic information of the user and sends it to the terminal.
[1929] Input: Database connection information at system startup
[1930] Data processing: Generate an HTML input form
[1931] Output: The generated input form
[1932] Specific behavior: Displays a form for the user to enter basic information (age, gender, address, hobbies, initial costs, monthly costs, etc.).
[1933] Step 2:
[1934] The user uses the terminal to enter basic information into the input form and clicks the send button.
[1935] Input: Basic user information entered in the form
[1936] Data processing: Convert the input data into JSON format
[1937] Output: Basic information in JSON format
[1938] What happens: The user enters all the desired information and clicks the submit button, which sends the data to the server.
[1939] Step 3:
[1940] The server receives the basic information sent from the terminal and stores the information in a database.
[1941] Input: Basic information in JSON format
[1942] Data processing: Converting data into a format for saving to a database
[1943] Output: Basic information stored in the database
[1944] Specific operation: The server registers basic information in the database, making it available for the next process.
[1945] Step 4:
[1946] The server generates hobby suggestions using a generative AI model based on basic information stored in a database.
[1947] Input: Basic information stored in the database
[1948] Data processing: Generate prompts for the generative AI model and input them into the model
[1949] Output: A list of hobby suggestions from the generative AI model
[1950] Specific operation: The generated prompt sentence (e.g., "60-year-old male, interested in scenery and travel, initial cost 30,000 yen, monthly cost within 10,000 yen. Please suggest four to five new hobbies.") is input into the AI model to obtain a list of hobby suggestions.
[1951] Step 5:
[1952] The server transmits the generated hobby suggestion list to the terminal and presents it to the user.
[1953] Input: A list of hobby suggestions from a generative AI model
[1954] Data processing: Convert to HTML for displaying the list
[1955] Output: A list of hobby suggestions displayed on the terminal
[1956] What it does: Allows users to review a list of hobby suggestions and select hobbies that interest them.
[1957] Step 6:
[1958] The user selects a hobby of interest from the hobby suggestion list presented on the terminal.
[1959] Input: User-selected hobby information
[1960] Data processing: Converting selected information into a format for sending to the server
[1961] Output: Selected hobby information sent to the server
[1962] Specific operation: Send the user's selected hobbies to the server.
[1963] Step 7:
[1964] The server obtains detailed information related to the hobby selected by the user and transmits it to the terminal.
[1965] Input: User-selected hobby information
[1966] Data processing: Retrieve detailed hobby-related information from the database and convert it to HTML
[1967] Output: Hobby details displayed on the terminal
[1968] Specific behavior: Provides users with an overview of a hobby, how to get started, what supplies are needed, costs, etc. Example: "Please provide more information about the hobby 'photography'."
[1969] Step 8:
[1970] The server collects information on business partners that provide services and goods related to the hobby selected by the user and transmits it to the terminal. It also collects information on brick-and-mortar stores related to the hobby and transmits it to the terminal.
[1971] Input: User-selected hobby information
[1972] Data processing: Retrieve information about business partners and physical stores from the database and convert it into HTML
[1973] Output: Account and physical store information displayed on the device
[1974] Specific operation: Provides users with information about hobby-related businesses and brick-and-mortar stores, such as camera shops and photography classes.
[1975] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1976] The present invention is a system that allows a user to input basic information, suggests new hobbies based on that information, and provides specific detailed information. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to suggest hobbies and provide detailed information that takes the user's emotions into consideration. This system includes an input means for inputting the user's basic information, an information collection means, a proposal generation means for generating hobby proposals, a presentation means for presenting the generated proposals, a detailed information acquisition means for acquiring detailed information about a hobby selected by the user, a hobby detail presentation means for presenting the detailed information, a company introduction means for introducing business partners, and the emotion engine.
[1977] Program processing
[1978] Basic information input phase
[1979] Step 1:
[1980] The server generates a form for entering basic information about the user and sends it to the terminal.
[1981] Step 2:
[1982] The terminal displays the submitted input form to the user.
[1983] Step 3:
[1984] The user is presented with a form to enter the following information:
[1985] age
[1986] address
[1987] sex
[1988] Indoor and outdoor desires
[1989] Initial investment costs
[1990] Monthly costs
[1991] Interests
[1992] Step 4:
[1993] The terminal transmits the information entered by the user to the server.
[1994] Hobby proposal phase
[1995] Step 5:
[1996] The server obtains and records the user's input information.
[1997] Step 6:
[1998] The server uses a generation AI based on the acquired information to generate a list of hobbies suitable for the user.
[1999] Step 7:
[2000] The server transmits the generated interest list to the terminal.
[2001] Step 8:
[2002] The terminal displays the hobby list to the user.
[2003] As a concrete example, if a 60-year-old male user enters the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that monthly costs are within 10,000 yen, the generating AI will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips."
[2004] Hobby Detail Guide Phase
[2005] Step 9:
[2006] The user selects a hobby that interests them from a list of suggested hobbies.
[2007] Step 10:
[2008] The terminal transmits the user's selection to the server.
[2009] Step 11:
[2010] The server obtains detailed information about the selected hobby and transmits the information to the terminal.
[2011] Step 12:
[2012] The terminal displays the detailed information to the user.
[2013] As a specific example, if the user selects "photography," the server provides an overview of photography, how to get started, available photo spots, required initial costs, and monthly maintenance fees.
[2014] Emotion engine phase
[2015] Step 13:
[2016] The emotion engine recognizes emotions from the user's reactions and input.
[2017] Step 14:
[2018] The server further filters the hobby suggestions taking into account the user's emotions recognized by the emotion engine.
[2019] Step 15:
[2020] The emotion engine monitors the user's reaction to the suggested hobbies.
[2021] Step 16:
[2022] The server will prioritize detailed information related to hobbies that have received a positive response.
[2023] As a specific example, if a user is interested in "photography" but also responds positively to "historical exploration," the server will prioritize providing detailed information related to "historical exploration."
[2024] Support and Account Introduction Phase
[2025] Step 17:
[2026] The server acquires information about companies that provide services and goods necessary for the user to start a hobby and transmits that information to the terminal.
[2027] Step 18:
[2028] The terminal displays the company information to the user.
[2029] As specific examples, we will introduce camera shops, photography classes, and editing software providers, all of which are related to photography.
[2030] In this way, users can easily discover new hobbies and receive specific support to get started in them. Furthermore, emotion recognition by the emotion engine enables more appropriate suggestions and detailed information tailored to the user's interests and preferences.
[2031] The processing flow will be explained below.
[2032] The present invention is a system that allows a user to input basic information, suggests new hobbies based on that information, and provides specific detailed information. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to suggest hobbies and provide detailed information that takes the user's emotions into consideration. This system includes an input means for inputting the user's basic information, an information collection means, a proposal generation means for generating hobby proposals, a presentation means for presenting the generated proposals, a detailed information acquisition means for acquiring detailed information about a hobby selected by the user, a hobby detail presentation means for presenting the detailed information, a company introduction means for introducing business partners, and the emotion engine.
[2033] Program processing
[2034] Basic information input phase
[2035] Step 1:
[2036] The server generates a form for entering basic information about the user and sends it to the terminal.
[2037] Step 2:
[2038] The terminal displays the submitted input form to the user.
[2039] Step 3:
[2040] The user is presented with a form to enter the following information:
[2041] age
[2042] address
[2043] sex
[2044] Indoor and outdoor desires
[2045] Initial investment costs
[2046] Monthly costs
[2047] Interests
[2048] Step 4:
[2049] The terminal transmits the information entered by the user to the server.
[2050] Hobby proposal phase
[2051] Step 5:
[2052] The server obtains and records the user's input information.
[2053] Step 6:
[2054] The server uses a generation AI based on the acquired information to generate a list of hobbies suitable for the user.
[2055] Step 7:
[2056] The server transmits the generated interest list to the terminal.
[2057] Step 8:
[2058] The terminal displays the hobby list to the user.
[2059] As a concrete example, if a 60-year-old male user enters the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that monthly costs are within 10,000 yen, the generating AI will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips."
[2060] Hobby Detail Guide Phase
[2061] Step 9:
[2062] The user selects a hobby that interests them from a list of suggested hobbies.
[2063] Step 10:
[2064] The terminal transmits the user's selection to the server.
[2065] Step 11:
[2066] The server obtains detailed information about the selected hobby and transmits the information to the terminal.
[2067] Step 12:
[2068] The terminal displays the detailed information to the user.
[2069] As a specific example, if the user selects "photography," the server provides an overview of photography, how to get started, available photo spots, required initial costs, and monthly maintenance fees.
[2070] Emotion engine phase
[2071] Step 13:
[2072] The emotion engine recognizes emotions from the user's reactions and input.
[2073] Step 14:
[2074] The server further filters the hobby suggestions taking into account the user's emotions recognized by the emotion engine.
[2075] Step 15:
[2076] The emotion engine monitors the user's reaction to the suggested hobbies.
[2077] Step 16:
[2078] The server will prioritize detailed information related to hobbies that have received a positive response.
[2079] As a specific example, if a user is interested in "photography" but also responds positively to "historical exploration," the server will prioritize providing detailed information related to "historical exploration."
[2080] Support and Account Introduction Phase
[2081] Step 17:
[2082] The server acquires information about companies that provide services and goods necessary for the user to start a hobby and transmits that information to the terminal.
[2083] Step 18:
[2084] The terminal displays the company information to the user.
[2085] As specific examples, we will introduce camera shops, photography classes, and editing software providers, all of which are related to photography.
[2086] In this way, users can easily discover new hobbies and receive specific support to get started in them. Furthermore, emotion recognition by the emotion engine enables more appropriate suggestions and detailed information tailored to the user's interests and preferences.
[2087] Example 2
[2088] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2089] Conventional hobby suggestion systems only provide the function of suggesting hobbies based on the user's basic information. However, these systems make uniform suggestions without considering the user's emotions, which means that they are unable to make suggestions that are appropriate for the user's interests and mood. Furthermore, they lack specific details on starting the suggested hobbies and introductions to related services and goods, which creates a high barrier to users actually starting the hobbies. A system that solves these problems is needed.
[2090] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[2091] In this invention, the server includes: an input means for inputting basic information of a user; an information collection means for acquiring the basic information;
[2092] a suggestion generating means for generating hobby suggestions based on the basic information;
[2093] a presentation means for presenting the hobby suggestions generated by the suggestion generation means to the user;
[2094] A detailed information acquisition means for acquiring detailed information related to a hobby selected by a user;
[2095] a hobby detail presentation means for presenting detailed hobby information acquired by the detailed information acquisition means to the user;
[2096] a company introduction means for introducing business partners that provide goods necessary for carrying out the hobby presented by the hobby detail presentation means;
[2097] an emotion engine that recognizes the user's emotions;
[2098] means for filtering suggestions based on the user's emotions recognized by the emotion engine;
[2099] Includes:
[2100] This makes it possible to suggest hobbies and provide detailed information that takes into account the user's emotions, lowering the barrier to starting a hobby.
[2101] "Input means" refers to a device or software that allows a user to input basic information. It provides an interface for a user to input information.
[2102] "Information collection means" refers to a device or software that acquires basic information entered by the user and converts it into a format that can be used within the system.
[2103] The "proposal generating means" is a device or software that generates hobby suggestions suited to the user based on the acquired basic information.
[2104] The "presentation means" is a device or software that visually or audibly presents the generated hobby suggestions to the user.
[2105] The "detailed information acquisition means" is a device or software that acquires specific detailed information related to the hobby selected by the user.
[2106] The "interest detail presentation means" is a device or software that presents the user with detailed information about the interest acquired by the detailed information acquisition means.
[2107] The "company introduction means" is a device or software that introduces to the user business partners that provide goods and services necessary for carrying out the hobby presented by the hobby details presentation means.
[2108] An "emotion engine" is a device or software that recognizes a user's emotions and converts that emotional information into a format that can be used within the system.
[2109] A "filtering means" is a device or software that filters the list of suggested interests based on the user's emotions recognized by the emotion engine.
[2110] This system allows users to input basic information, suggests appropriate hobbies based on that information, and provides necessary detailed information. Furthermore, it aims to provide more personalized suggestions by recognizing the user's emotions and filtering the suggestions. This system is composed of hardware and software, including a server, a terminal, and an emotion engine.
[2111] Specifically, the server comprises the following components:
[2112] Input means for entering basic user information
[2113] Information collection method to obtain basic information entered
[2114] A proposal generator that generates hobby proposals based on basic information
[2115] a presentation means for presenting the hobby suggestions generated by the suggestion generation means to the user;
[2116] A detailed information acquisition means for acquiring detailed information related to the hobby selected by the user
[2117] A hobby detail presentation means for presenting the acquired detailed information to the user.
[2118] A company introduction tool that introduces companies that provide goods and services necessary for carrying out hobbies
[2119] Emotion engine that recognizes user emotions
[2120] Filtering measures to filter suggestions based on sentiment
[2121] Hardware and software used
[2122] Hardware:
[2123] Server: processes and stores data
[2124] Terminal: A device operated by a user (PC, smartphone, etc.)
[2125] software:
[2126] Input method: HTML form
[2127] Information collection method: Database management system (DBMS)
[2128] Proposal generation method: Generative AI model
[2129] Emotion Engine: Natural Language Processing (NLP) Engine
[2130] Examples of hobby suggestions
[2131] For example, if a 60-year-old male user inputs the conditions that he is interested in "scenery" and "travel," that the initial cost is 30,000 yen, and that the monthly cost is within 10,000 yen, the generative AI model will generate the following prompt:
[2132] "User information: Age = 60, Interests = Landscape, Travel, Budget = ¥30,000 initial, ¥10,000 monthly. Please suggest hobbies suitable for this user."
[2133] Based on this prompt, the AI generator suggests hobbies such as photography, walking, gardening, historical exploration, and car trips. The server sends these suggestions to the device, which then displays them on the user's screen.
[2134] Providing more information
[2135] If the user selects "photography" from the suggested hobbies, the server retrieves detailed information about photography from a database or external API. This information includes an overview of photography, how to get started, recommended photo spots, required initial costs, monthly maintenance fees, etc. The device displays this information to the user and provides specific instructions on how to get started.
[2136] Utilizing the Emotion Engine
[2137] The emotion engine recognizes emotions from user input and operation logs. For example, if a user has a positive reaction to taking a photo, the server uses the emotion engine's evaluation results to prioritize providing related information that is likely to be of more interest to the user. In this way, the user experience can be improved.
[2138] Company Introduction
[2139] The server collects information on businesses that provide goods and services needed to start a hobby and sends it to the terminal. For example, it obtains information on camera shops, photography classes, editing software providers, and other businesses related to photography, and presents it to the user. This allows the user to easily find the resources they need.
[2140] This system allows users to easily find new hobbies and receive specific support to get started in those hobbies. It also utilizes emotion recognition by an emotion engine to make optimal suggestions based on the user's interests and mood.
[2141] The flow of the identification process in the second embodiment will be described with reference to FIG.
[2142] Step 1:
[2143] The server generates an HTML form for the user to enter basic information, including fields for age, address, gender, indoor / outdoor preferences, initial investment amount, monthly expenses, and interests. The server then sends the generated form to the terminal.
[2144] Input: None
[2145] Output: An HTML form to enter basic user information
[2146] Step 2:
[2147] The terminal displays the HTML form received from the server in the user's browser, adding appropriate labels and explanations to allow the user to input information intuitively.
[2148] Input: HTML form
[2149] Output: Input form displayed in browser
[2150] Step 3:
[2151] The user is presented with a form to enter basic information, including age, address, gender, indoor / outdoor preferences, initial investment amount, monthly expenses, and interests.
[2152] Input: Input form displayed in browser
[2153] Output: Basic information entered
[2154] Step 4:
[2155] The device sends the information entered by the user to the server in JSON format using a secure communication protocol (e.g., HTTPS).
[2156] Input: Basic information entered
[2157] Output: User basic information sent to the server
[2158] Step 5:
[2159] The server records the received user basic information in a database, which will be used in subsequent processes.
[2160] Input: User basic information
[2161] Output: Basic information recorded in the database
[2162] Step 6:
[2163] The server then sends prompts to the generative AI model based on the recorded information to generate hobby suggestions, which include factors such as the user's age, interests, and budget.
[2164] Example: "User information: Age = 60, Interests = Landscape, Travel, Budget = ¥30,000 initial, ¥10,000 monthly. Please suggest hobbies suitable for this user."
[2165] Input: Basic information recorded in the database
[2166] Output: A list of hobbies returned by the generative AI model
[2167] Step 7:
[2168] The server sends the generated interest list to the terminal in JSON format.
[2169] Input: Generated hobby list
[2170] Output: Interest list sent to the device
[2171] Step 8:
[2172] The device displays the hobby list to the user in a format that is easy for the user to visually review, along with a brief description of each hobby.
[2173] Input: Interest list received from the server
[2174] Output: Interests list displayed in a browser
[2175] Step 9:
[2176] The user selects one hobby that interests them from the list of suggested hobbies.
[2177] Input: A list of hobbies displayed in a browser
[2178] Output: Selected hobby
[2179] Step 10:
[2180] The terminal transmits information about the hobby selected by the user to the server.
[2181] Input: Selected Hobbies
[2182] Output: Selections sent to the server
[2183] Step 11:
[2184] The server retrieves details related to the selected hobby from a database or external API, such as the initial costs, maintenance costs, required equipment, and recommended spots for photography.
[2185] Input: Selected Hobbies
[2186] Output: Retrieved details
[2187] Step 12:
[2188] The device then displays the received detailed information to the user, visually displaying detailed information including specific instructions on how to get started and important points to note.
[2189] Input: Details received from the server
[2190] Output: Detailed information displayed in a browser
[2191] Step 13:
[2192] The emotion engine recognizes emotions from user reactions and inputs, and uses natural language processing (NLP) technology to analyze user emotions.
[2193] Input: User responses and input
[2194] Output: Recognized emotion
[2195] Step 14:
[2196] The server re-filters the list of hobbies based on the user's emotions recognized by the emotion engine, giving priority to hobbies that have generated positive reactions.
[2197] Input: Recognized emotions, list of hobbies
[2198] Output: A filtered list of hobbies
[2199] Step 15:
[2200] The emotion engine continuously monitors how users respond to suggested hobbies and adjusts the suggestions as needed.
[2201] Input: User response
[2202] Output: Monitoring results
[2203] Step 16:
[2204] The server will prioritize detailed information related to hobbies that have been positively responded to, providing the user with additional information that is likely to be of interest.
[2205] Input: Monitoring results, detailed information
[2206] Output: Prioritized detailed information
[2207] Step 17:
[2208] The server collects information about companies that provide services and goods that support hobbies and sends it to the device. Related company information is also obtained from external APIs.
[2209] Input: Selected Hobbies
[2210] Output: Retrieved company information
[2211] Step 18:
[2212] The device displays company information to the user, along with contact details and service overviews for each company.
[2213] Input: Company information received from the server
[2214] Output: Company information displayed in a browser
[2215] (Application example 2)
[2216] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2217] While conventional hobby suggestion systems can make suggestions based on a user's basic information, they have difficulty responding flexibly to the user's emotions and reactions to make optimal suggestions. Furthermore, conventional systems are limited to standard online platforms and are unable to improve the user experience in virtual environments. This results in low user satisfaction with the suggested hobbies and insufficient support for actually starting a hobby.
[2218] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: an input means for inputting basic information about the user; an information collection means for acquiring the basic information; a proposal generation means for generating hobby proposals based on the basic information; a presentation means for presenting the hobby proposals generated by the proposal generation means to the user; a detailed information acquisition means for acquiring detailed information related to the hobby selected by the user; a hobby detail presentation means for presenting the detailed hobby information acquired by the detailed information acquisition means to the user; a company introduction means for introducing business partners that provide services and goods necessary for the hobby practice presented by the hobby detail presentation means; an emotion recognition means for recognizing the user's emotions and filtering the hobby proposals generated by the proposal generation means; a means for preferentially presenting detailed information related to the hobby practice for which the emotion recognition means recognizes the emotion; and a virtual interface means for installing this system in a virtual environment and enabling the user to receive hobby proposals in a virtual store. This allows optimal hobby proposals to be made based on the user's emotions and preferences, and real-time emotion recognition in the virtual store significantly improves the user experience.
[2219] "Input means" refers to an interface device for collecting basic information about the user.
[2220] The "information collection means" is a device that acquires basic information entered by the user and transmits it to the server.
[2221] The "suggestion generation means" is a device that uses an AI model based on the acquired basic information of the user to generate hobby suggestions.
[2222] The "presentation means" is a device that visually or audibly presents the generated hobby suggestions to the user.
[2223] The "detailed information acquisition means" is a device that acquires detailed information related to the hobby selected by the user from an external resource.
[2224] The "interest detail presentation means" is a device that presents the acquired hobby detail information to the user.
[2225] The "company introduction means" is a device that introduces to the user information about companies that provide services and goods necessary for carrying out the hobby.
[2226] An "emotion recognition means" is a device that recognizes emotions by analyzing the user's facial expressions and voice data.
[2227] "Virtual interface means" means an interface device that allows a user to receive hobby suggestions within a virtual environment.
[2228] This system allows users to input basic information, and based on that information, suggests new hobbies and provides specific detailed information. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to suggest hobbies and provide detailed information that takes the user's emotions into consideration.
[2229] The system includes the following components:
[2230] Input means: An interface device that collects basic information from users through an application installed on a device such as a smartphone or tablet. Specifically, users are asked to enter information such as age, address, gender, indoor / outdoor preferences, initial investment costs, monthly expenses, and interests.
[2231] Information collection means: A device that transmits the basic information input through the input means from the terminal to the server. The communication protocol is a general internet communication.
[2232] Suggestion generation means: A device that acquires the basic information and generates hobby suggestions using a generative AI model. For example, the AI generates a hobby list based on the user's input information and returns the results to the server.
[2233] Presentation means: A device that displays the hobby suggestions generated by the suggestion generation means on the screen of a smartphone or tablet. Specifically, it visually presents the suggestion contents to the user in text or image format.
[2234] Detailed information acquisition means: A device that acquires detailed information related to the hobby selected by the user from the Internet. The detailed information includes an overview of the hobby, how to get started, the initial costs and monthly maintenance fees required, and information on related services and products.
[2235] Hobby details presentation means: A device that presents the detailed information acquired by the detailed information acquisition means to the user. It visually displays information about the hobby selected by the user and serves as a concrete guide for starting that hobby.
[2236] Company introduction means: A device that provides information on companies that offer services and goods that users need when starting a new hobby. Specifically, it introduces users to information on companies that sell related products and services.
[2237] Emotion recognition means: A system that recognizes emotions by analyzing the user's facial expressions and voice data. This determines how the user feels about the suggested hobbies, and filters the suggestions based on that result.
[2238] Virtual Interface Means: An interface device that allows the system to be installed in a virtual environment and allows users to receive hobby suggestions in a virtual store, for example, using a VR headset or smart glasses.
[2239] As a concrete example, a user inputs basic information through a smartphone app. For example, if a 60-year-old man is interested in "scenery" and "travel," and inputs conditions that the initial cost is 30,000 yen and the monthly cost is within 10,000 yen, the generative AI model will suggest hobbies such as "photography," "walking," "gardening," "historical exploration," and "car trips." In this case, the following prompt sentence is input to the generative AI model:
[2240] "Age: 60, Address: Tokyo, Gender: Male, Interests: Landscapes, Travel, What new hobby can you suggest?"
[2241] The emotion recognition means reads emotions from the user's facial expressions and voice, and presents the filtered results to the user. Then, detailed information about the hobby selected by the user is obtained using the detailed information acquisition means, and the information is provided to the user through the hobby detail presentation means. Furthermore, information about companies offering related products and services is also presented to the user through the company introduction means.
[2242] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[2243] Step 1:
[2244] The user launches the app installed on their smartphone or tablet and displays a form for entering basic information.
[2245] Specifically, the application provides users with a screen where they can enter their age, address, gender, indoor / outdoor preferences, initial investment amount, monthly expenses, interests, etc.
[2246] (Input) User basic information
[2247] (Output) Display of input form
[2248] Step 2:
[2249] The user enters basic information and presses the submit button.
[2250] The entered information is sent from the device to the server, where data security is maintained using encrypted communication.
[2251] (Input) User input information (age, address, gender, interests, etc.)
[2252] (Output) Basic information sent to the server
[2253] Step 3:
[2254] The server analyzes and records the received user information.
[2255] This analysis involves manipulating a database to store basic user information in an appropriate format.
[2256] (Input) Basic information sent from the device
[2257] (Output) Save parsed user information
[2258] Step 4:
[2259] The server uses a generative AI model to generate a list of hobby suggestions based on user entries.
[2260] At this time, machine learning technology is used to generate optimal candidates based on the input conditions.
[2261] (Input) Recorded user information
[2262] (Output) A list of generated hobby suggestions
[2263] Step 5:
[2264] The server transmits the generated hobby suggestion list to the terminal and displays it.
[2265] The suggestions are displayed as a list for the user to visually review.
[2266] (Input) Generated hobby suggestion list
[2267] (Output) Hobby suggestions displayed on the device
[2268] Step 6:
[2269] The user selects a hobby that interests them from a list of suggestions.
[2270] It provides a one-tap selection interface and the selection is sent to the server.
[2271] (Input) User's hobby selection
[2272] (Output) Send selected hobby information to server
[2273] Step 7:
[2274] The server retrieves detailed information related to the selected hobby from the Internet.
[2275] Specifically, information is collected about the hobby, including an overview, how to get started, initial costs and monthly maintenance fees, and related products and services.
[2276] (Input) Selected hobby information
[2277] (Output) Detailed information about the acquired hobbies
[2278] Step 8:
[2279] The server sends the acquired detailed information to the terminal and displays it to the user.
[2280] Include images and links to ensure the information is presented in an easy-to-read format.
[2281] (Input) Detailed information about the acquired hobbies
[2282] (Output) Hobby details displayed on the device
[2283] Step 9:
[2284] The emotion recognition means analyzes the user's facial expressions and voice data to recognize the emotions.
[2285] It collects data in real time through cameras and microphones and applies sentiment analysis algorithms.
[2286] (Input) User's facial expression and voice data
[2287] (Output) Recognized emotion data
[2288] Step 10:
[2289] The server uses the emotion data provided by the emotion recognition means to filter the suggestions.
[2290] Prioritize detailed information related to hobbies that generate positive responses.
[2291] (Input) Recognized emotion data
[2292] (Output) Filtered suggestions
[2293] Step 11:
[2294] The server introduces information about companies that provide products and services necessary for users to start a hobby.
[2295] It provides users with information on related products and service providers, and displays shopping guidance and contact information.
[2296] (Input) Filtered suggestions
[2297] (Output) Company information introduced
[2298] Specific prompt examples:
[2299] "Age: 60, Address: Tokyo, Gender: Male, Interests: Landscapes, Travel, What new hobby can you suggest?"
[2300] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[2301] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[2302] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.
[2303] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[2304] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.
[2305] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.
[2306] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).
[2307] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.
[2308] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."
[2309] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.
[2310] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).
[2311] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.
[2312] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.
[2313] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[2314] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.
[2315] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.
[2316] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.
[2317] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware res...
Claims
1. an input means for inputting basic information of a user; information collection means for acquiring the basic information; a suggestion generating means for generating a hobby suggestion based on the basic information; a presentation means for presenting the hobby suggestions generated by the suggestion generation means to the user; A detailed information acquisition means for acquiring detailed information related to a hobby selected by a user; a hobby detail presentation means for presenting detailed hobby information acquired by the detailed information acquisition means to a user; a company introduction means for introducing business partners that provide services and goods necessary for carrying out the hobby presented by the hobby detail presentation means; A system including:
2. a suggestion generating means for suggesting outdoor or indoor hobbies based on basic information input by a user; The system of claim 1 .
3. The hobby suggestion generating means further includes a means for reflecting the user's interests in the hobby suggestion generated by the suggestion generating means. The system of claim 1 .
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A