System
A system using a generative AI model to integrate job, accommodation, and tourist attraction information addresses the need for continued work and leisure after retirement, enhancing post-retirement life and resolving labor shortages.
Patent Information
- Application Number
- JP2024137170
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-16
- Publication Date
- 2026-02-27
AI Technical Summary
There is a need for systems that enable individuals to continue working and enjoying leisure time after retirement, while also addressing labor shortages in rural areas, by providing comprehensive information on job opportunities, accommodations, and tourist attractions in desired regions.
A system that allows users to input their desired region and job type using a terminal, which connects to a server that uses a generative AI model to search for job information and extracts relevant data from a regional information database, integrating and presenting this information along with accommodation and tourist attraction details.
Enables users to balance work and leisure by providing comprehensive information on job opportunities, accommodations, and tourist attractions, thereby enriching their post-retirement life and alleviating labor shortages in rural areas.
Smart Images

Figure 2026034049000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] In today's world, where people are expected to live to 100 years old, an increasing number of people need to continue working after retirement because their standard of living will decline if they rely solely on pensions and savings. However, unlike their working years, many people want to enjoy leisure time after retirement. Therefore, there is a need to provide ways for people to continue working and enjoy their leisure time after retirement. At the same time, labor shortages are an issue in rural areas, making it difficult to secure a labor force. This invention solves these problems by providing a system that enriches people's lives after retirement and alleviates the labor shortage in rural areas. [Means for solving the problem]
[0005] The present invention includes a means for a user to input their desired region and job type using a terminal and send that information to a server. The server has the function of searching and extracting job information based on the input conditions using a generative AI model and sending the results to the terminal. The server also has a means for extracting information on accommodations and tourist attractions in the relevant region from a regional information database and providing this information to the user. This allows users to enjoy leisure time while working after retirement, contributing to resolving labor shortages in rural areas.
[0006] A "terminal" is a device that a user uses to enter information and receive responses from a server.
[0007] "Server" refers to a central processing unit that processes input information using a generative AI model and searches for and provides information on job openings, accommodations, and tourist attractions.
[0008] A "generative AI model" is an artificial intelligence algorithm used to generate optimal job listings and local information based on user input criteria.
[0009] "Job information" is information about job recruitment, and is data including details such as specific job types, working conditions, and work locations.
[0010] "Accommodation information" is information about available accommodations in the area desired by the user.
[0011] "Tourist attraction information" is information about tourist attractions worth visiting in the area where the user is staying.
[0012] A "regional information database" is a database that stores a variety of information about a specific region, including information about accommodations and tourist attractions.
[0013] A "user" is someone who uses this system to input their desired area and job type and receives job information and area information. [Brief explanation of the drawings]
[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0016] First, the terms used in the following description will be explained.
[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0022] [First embodiment]
[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0035] The system of the present invention provides job information and local information based on the desired area and job type to users who want to continue working and enjoy leisure time after retirement. Specific embodiments of the present invention will be described below.
[0036] System Overview
[0037] 1. User Input and Data Submission
[0038] The user uses the terminal to input information about the region and job type they are looking for. For example, the user inputs "tourist guide for Nagano Prefecture."
[0039] The terminal is responsible for transmitting this input information to the server.
[0040] 2. Data processing by the server
[0041] The server uses the generative AI model to search for job information based on the entered conditions and extract relevant information.
[0042] Specifically, the server extracts job information that matches the conditions "Nagano Prefecture" and "tourist guide" from the job database.
[0043] 3. Providing local information
[0044] At the same time, the server searches and extracts information about accommodations and tourist attractions in the relevant area from the local information database.
[0045] For example, this includes information on popular accommodations, tourist attractions, and restaurants in Nagano Prefecture.
[0046] 4. Response from the server to the terminal and presentation to the user
[0047] The server integrates the job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[0048] The device receives the response from the server and visually presents it to the user. For example, it displays information such as "Tour guide wanted at resort facility (3 days a week)," "Traditional Japanese inn (free Wi-Fi in all rooms, hot spring)," and "Zenkoji Temple (meditation experience available)."
[0049] What the program does (natural language explanation)
[0050] 1. User Input
[0051] The user inputs the desired area and job type into the terminal. For example, "Nagano Prefecture Tourist Guide" is input.
[0052] 2. Data transmission
[0053] The terminal sends the user's input information to the server. For example, the information "Nagano Prefecture" and "tourist guide" is sent to the server.
[0054] 3. Extracting job information
[0055] The server launches the generative AI model and searches the job database based on the input criteria, specifically extracting job listings for tour guides in Nagano Prefecture.
[0056] 4. Extracting Regional Information
[0057] The server uses the generated AI model to search for accommodation and tourist attraction information in the relevant area from a local information database. For example, it extracts information on famous accommodations and tourist attractions in Nagano Prefecture.
[0058] 5. Generating and Sending the Response
[0059] The server integrates the job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[0060] 6. Presentation to the User
[0061] The device receives the response from the server and visually presents it to the user. For example, it displays information about a resort facility in Nagano Prefecture looking for a tour guide, information about traditional Japanese inns where to stay, and information about tourist attractions worth visiting.
[0062] Through this process, users can not only find job information in their desired area, but also information on tourist attractions and accommodations they can enjoy during their stay. This will enable them to balance financial concerns with leisure time after retirement, and will also contribute to solving the labor shortage problem in rural areas.
[0063] The processing flow will be explained below.
[0064] Step 1:
[0065] The user uses the terminal to input information about the desired area and job type. For example, the user inputs "tourist guide for Nagano Prefecture."
[0066] Step 2:
[0067] The terminal sends the entered information to the server. Specifically, the entered information "Nagano Prefecture" and "tourist guide" is sent.
[0068] Step 3:
[0069] When the server receives the input, it triggers a generative AI model, which acts based on the input conditions.
[0070] Step 4:
[0071] The server searches the job database and extracts job listings based on the input criteria. Job listings for "tourist guides in Nagano Prefecture" that match the criteria are found.
[0072] Step 5:
[0073] The server searches the local information database and extracts information about accommodations in the relevant area, such as "traditional Japanese-style inns in Nagano Prefecture."
[0074] Step 6:
[0075] The server also extracts tourist spot information for the same region from the regional information database. For example, tourist spot information such as "Zenkoji Temple in Nagano Prefecture" or "Soba-making classes" is searched.
[0076] Step 7:
[0077] The server then generates a response by integrating the extracted job listings, accommodation information, and tourist attraction information, and then organizing and formatting each piece of information for presentation to the user.
[0078] Step 8:
[0079] The server sends the generated response to the terminal, which includes information on job openings, accommodations, and tourist attractions.
[0080] Step 9:
[0081] The terminal receives the response from the server and visually presents it to the user. For example, information such as "Resort facility tour guide wanted," "Traditional Japanese inn," and "Zenkoji Temple" is displayed on the user's screen.
[0082] Step 10:
[0083] Users can review the information presented and decide on their next action, such as applying for a job, booking accommodation, or planning a trip, depending on their needs.
[0084] Example 1
[0085] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0086] In today's aging society, an increasing number of people want to continue working and enjoying leisure time after retirement. However, it is difficult to obtain job information based on the desired area and type of job, as well as information on accommodations and tourist attractions in one place. For this reason, there is a need for a comprehensive information system to improve the quality of life after retirement.
[0087] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0088] In this invention, the server includes means for inputting information on a desired area and job type from a terminal, means for transmitting the input information to the server, means for the server to search for and extract job information based on the input conditions using a generating AI model, means for the server to search for and extract accommodation information and tourist attraction information in the relevant area from a local information database, means for integrating the job information, accommodation information, and tourist attraction information and transmitting the integrated information to the terminal, and means for the terminal to receive a response from the server and visually present it to the user. This makes it possible for a user to continue working in a desired area after retirement and obtain information on accommodations and tourist attractions in that area all at once.
[0089] A "terminal" is a device through which a user inputs information and transmits that information to a server.
[0090] The "means for inputting information on desired area and job type" is an interface that allows a user to input information on the area and job type that he or she desires into the terminal.
[0091] The "means for transmitting input information to a server" is a function that enables a terminal to transmit information input by a user to a server.
[0092] A "generative AI model" is an algorithm that uses artificial intelligence techniques such as machine learning and deep learning to generate and analyze data.
[0093] "Job information" is information about jobs and benefits that companies and organizations provide to job seekers.
[0094] A "regional information database" is a database that stores and manages information about accommodations and tourist attractions in a specific region.
[0095] The "job information database" is a database that stores and manages job information.
[0096] "Search and extraction means" refers to a function for searching and retrieving relevant information from a database based on specific conditions.
[0097] "Accommodation information" is detailed information about accommodation facilities such as hotels, inns, and guesthouses.
[0098] "Tourist attraction information" is information about tourist spots and famous places in a particular area.
[0099] The "means for integrating and transmitting to the terminal" is a function that allows the server to compile multiple pieces of information into one and transmit it to the terminal.
[0100] "Means for receiving a response from the server and visually presenting it to the user" is a function that allows the terminal to receive information sent from the server and display it in a form that is easy for the user to see.
[0101] MODE FOR CARRYING OUT THE INVENTION
[0102] The system of the present invention provides job information and local information based on the desired area and job type to users who want to continue working and enjoy leisure time after retirement. A specific embodiment of the system is described below.
[0103] The system's main hardware components are the user device and the back-end server, while the generative AI model and associated database are used as software components.
[0104] Users use the system by entering information about their desired region and occupation on a terminal. For example, they might enter "Nagano Prefecture tourist guide." The terminal is equipped with input interfaces such as a keyboard and touch screen, making operation easy.
[0105] The entered information is sent from the device to the server. The server receives this information and activates a generative AI model to search and extract job listings based on the entered criteria. Specifically, the server searches a job database (e.g., a general job database) and extracts job listings that match the criteria "Nagano Prefecture" and "tourist guide."
[0106] Next, the server uses the same generative AI model to search a local information database (e.g., a local area database) to extract information about accommodations and tourist attractions in the area. For example, it retrieves information about well-known accommodations and tourist attractions in Nagano Prefecture. This information includes details about accommodations (e.g., traditional Japanese inn, free Wi-Fi in all rooms, hot springs) and tourist attractions (e.g., Zenkoji Temple, meditation experience available).
[0107] The server combines this job information, accommodation information, and tourist attraction information to generate a single response message. This response message is sent from the server to the device. The device receives the response from the server and visually presents it to the user. For example, information such as "Tour guide wanted at resort facility (work three days a week)," "Traditional Japanese inn (free Wi-Fi in all rooms, hot springs)," and "Zenkoji Temple (meditation experience available)" may be displayed on the screen.
[0108] Examples of specific prompts include:
[0109] I would like to work as a tourist guide in Nagano Prefecture. Could you also give me information about local accommodations and tourist attractions?
[0110] This system not only gives users the opportunity to work in the area of their choice after retirement, but also provides information on accommodations and tourist attractions that they can enjoy during their stay. This is expected to enrich post-retirement life and contribute to resolving the labor shortage problem in rural areas.
[0111] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0112] Step 1:
[0113] The user inputs the desired area and job type into the terminal.
[0114] Input: The user types "Nagano Prefecture Tourist Guide" into the device.
[0115] Specific operation: The user enters the desired region and job type into the input form on the device and clicks the "Submit" button.
[0116] Output: Contains information entered into the terminal.
[0117] Step 2:
[0118] The terminal transmits the user's input information to the server.
[0119] Input: Information about "Nagano Prefecture" and "Tourist Guide" entered into the device.
[0120] Specific operation: The terminal converts input information into data packets and sends them over the network to the server.
[0121] Output: The server receives the packet and parses the information.
[0122] Step 3:
[0123] The server launches the generative AI model to search and extract job information based on the input criteria.
[0124] Input: Information about "Nagano Prefecture" and "Tourist Guide" sent to the server.
[0125] Specific operation: The server launches a generative AI model (e.g., GPT-3 (registered trademark)) and searches and extracts information corresponding to "Nagano Prefecture" and "tourist guide" from the job information database.
[0126] Data processing / calculation: Performs condition matching and filtering using an AI model.
[0127] Output: The extracted job information is stored on the server.
[0128] Step 4:
[0129] The server uses the generated AI model to search and extract local information.
[0130] Input: Regional information condition "Nagano Prefecture".
[0131] Specific operation: The server uses the generative AI model to search the local information database and extract accommodation information and tourist attraction information.
[0132] Data processing / calculation: Performs condition matching and data extraction processing using an AI model.
[0133] Output: Accommodation information and tourist attraction information are stored on the server.
[0134] Step 5:
[0135] The server integrates the job information and the area information, generates a response message, and sends it to the terminal.
[0136] Input: Extracted job listings, accommodation information, and tourist attraction information.
[0137] Specific behavior: The server combines and formats this information into a single response message.
[0138] Data processing / calculation: Generates message formats and integrates data.
[0139] Output: A response message is generated and sent to the terminal.
[0140] Step 6:
[0141] The terminal receives the response from the server and visually presents it to the user.
[0142] Input: The response message sent by the server.
[0143] Specific operation: The device receives the response message, analyzes the data, and performs the design and layout for the screen display.
[0144] Data processing / calculation: Analyzes messages and generates visual designs.
[0145] Output: Job information, accommodation information, and tourist attraction information are displayed on the user's screen.
[0146] Through these steps, users can obtain comprehensive information not only about job openings in their desired area and occupation, but also about accommodations and tourist attractions in the area.
[0147] (Application example 1)
[0148] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0149] Conventional job information systems mainly provide only job information based on the desired region and type of job to users who want to continue working and enjoying their leisure time after retirement, but have the problem of not being able to provide comprehensive local information that would help users adapt to their new living environment and enjoy fulfilling leisure time. In particular, to support diverse lifestyles after retirement, it is necessary to provide integrated information on local tourist attractions, accommodations, etc. in addition to job information that suits users.
[0150] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0151] In this invention, the server includes means for inputting information on a desired area and job type from a terminal, means for transmitting the input information to the server, means for the server to search for and extract job information based on the input conditions using a generative artificial intelligence model, means for transmitting the relevant job information to the terminal, means for presenting accommodation information and tourist attraction information in the relevant area, and means for the terminal to integrate and present job information in the food delivery industry and local information based on the input conditions. This enables a user to obtain appropriate food delivery job information in a desired area while simultaneously obtaining comprehensive information for enjoying life and sightseeing in that area.
[0152] A "terminal" is a device that allows a user to input information and transmit that information to a server. This includes mobile devices such as smartphones and tablets.
[0153] The "desired area" refers to the geographical location where the user wishes to obtain job information and local information.
[0154] "Occupation" refers to the type of work or industry that a user desires when seeking employment.
[0155] A "server" is a computer system that receives transmitted information, searches and processes data based on that information, and transmits the results to a terminal.
[0156] "Generative artificial intelligence models" refer to AI technologies used to search and extract job listings or local information based on user input, such as generative natural language processing models.
[0157] "Job Postings" means information about employment opportunities related to a particular geographic area or occupation.
[0158] "Accommodation information" refers to information about available accommodations, such as hotels and inns, where users can stay.
[0159] "Tourist attraction information" refers to information about places and spots within a particular area that are recommended for tourists to visit.
[0160] The "food delivery industry" refers to the service industry that delivers food and beverage orders to customers.
[0161] "Integrated presentation means" refers to a method or technique for bringing together multiple different types of information and visually presenting it to the user in an integrated form.
[0162] "Database" means an organized collection of information used to efficiently manage, search, and retrieve job and local information.
[0163] The system of the present invention provides users with integrated job information and area information based on their desired area and occupation to support their post-retirement life. This system is mainly composed of the following elements:
[0164] 1. User Input and Data Submission
[0165] Users use devices such as smartphones to input information about their desired area and job type. For example, if a user inputs "food delivery in Hokkaido," that information is sent from the device to the server.
[0166] 2. Data processing by the server
[0167] The server uses a generative AI model based on the received information to search and extract data. This generative AI model uses OpenAI's GPT-4. Specifically, the server processes the data as follows:
[0168] Extracting job information: The server searches and extracts relevant job information from the job database based on the desired area and job type.
[0169] Extracting local information: The server searches a local information database and extracts information about tourist attractions and accommodations in the area.
[0170] 3. Generating and Sending a Response
[0171] The server integrates the job information and local information, generates a response message, and sends it to the terminal, allowing the user to obtain both job information and tourist information at the same time.
[0172] 4. Presenting Information to the User
[0173] The terminal visually presents the response received from the server to the user, for example displaying the following information:
[0174] "Food delivery in Hokkaido (3 days a week)"
[0175] "Popular ramen restaurant in Sapporo"
[0176] "Night view spots of Mt. Hakodate"
[0177] Hardware and software used
[0178] Hardware: Smartphone (iOS or ANDROID (registered trademark) device)
[0179] software:
[0180] Generative AI model: OpenAI's GPT-4
[0181] Job Database: Real-time updated job information API for the food delivery industry
[0182] Regional information database: Regional information services such as TriPad (registered trademark) visor and Google (registered trademark) Maps API
[0183] Prompt Sentence Examples
[0184] Here are some example prompts using GPS-4:
[0185] Based on the region and job type information you entered, extract the following information:
[0186] 1. Food delivery job information in your area
[0187] 2. Tourist attractions in the area
[0188] 3. Gourmet spots in the area
[0189] Input: Hokkaido Food Delivery
[0190] This allows users to obtain appropriate food delivery job information in their desired area, while also obtaining comprehensive information on how to enjoy living and sightseeing in that area.
[0191] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0192] Step 1:
[0193] The user uses a device such as a smartphone to enter information about the desired area and job type. The entered information (e.g., "Hokkaido food delivery") is sent from the device to the server.
[0194] Step 2:
[0195] Based on the information received, the server begins searching for job information based on the desired region and job type. At this point, the server uses a generative AI model (e.g., GPT-4) to search the job information database. As a result, "job information for food delivery in Hokkaido" is extracted.
[0196] Step 3:
[0197] The server searches the regional information database to retrieve information on tourist attractions and accommodations in the entered region. Specifically, information on tourist attractions and accommodations in Hokkaido is extracted.
[0198] Step 4:
[0199] The server then integrates the extracted job information with local information. In this process, the job information, tourist attraction information, and accommodation information are compiled into a user-friendly format.
[0200] Step 5:
[0201] The integrated information is sent from the server to the device, including information such as "Food delivery in Hokkaido (working three days a week)," "Popular ramen restaurants in Sapporo," and "Night view spots around Mount Hakodate."
[0202] Step 6:
[0203] The device analyzes the received information and visually presents it to the user, who then sees the integrated job and tourism information displayed on the device screen.
[0204] Step 7:
[0205] Based on the information provided, users can apply for suitable jobs or decide on tourist destinations, allowing them to simultaneously obtain suitable food delivery job information in their desired area as well as tourist and accommodation information for that area.
[0206] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0207] The system of the present invention provides job information, accommodation information, and tourist spot information based on the desired area and occupation to users who want to continue working and enjoying leisure time after retirement. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the system provides optimal information based on the user's emotions.
[0208] System Overview
[0209] 1. User Input and Data Submission
[0210] The user uses the terminal to input information about the desired area and job type. For example, the user inputs "tourist guide for Nagano Prefecture."
[0211] The terminal is responsible for transmitting this input information to the server.
[0212] 2. Emotion Recognition by Emotion Engine
[0213] As the user enters information, the device captures the user's voice and facial expressions.
[0214] The emotion engine analyzes this data to recognize the user's current emotional state. For example, if the user is relaxed, it will prioritize reassuring suggestions.
[0215] 3. Server-based data processing and emotion-based adjustments
[0216] The server uses the generative AI model to search for job listings based on the entered conditions and extract relevant information.
[0217] The server then adjusts job listings and local information based on the user's perceived emotions. For example, if the user is feeling stressed, it prioritizes job listings that offer a relaxing work environment.
[0218] 4. Providing local information
[0219] The server searches and extracts information about accommodations and tourist attractions in the relevant area from the local information database.
[0220] Based on the results of the emotion engine, the system selects the most suitable accommodation and tourist spot information. For example, if the user is looking for relaxation, the system will suggest accommodation in a quiet environment and tourist spots where they can relax.
[0221] 5. Response from the server to the terminal and presentation to the user
[0222] The server integrates the job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[0223] The device receives the response from the server and visually presents it to the user. For example, it displays information such as "Tour guide wanted for resort facility," "Quiet traditional Japanese inn," and "Zenkoji Temple where you can experience meditation."
[0224] What the program does (natural language explanation)
[0225] 1. User Input
[0226] The user inputs the desired area and job type into the terminal. For example, "Nagano Prefecture Tourist Guide" is input.
[0227] 2. Emotional Engine Activation
[0228] The device captures the user's voice and facial expressions, and the emotion engine analyzes them to recognize the user's current emotions.
[0229] 3. Data transmission
[0230] The device sends the user's input information and the emotion engine's analysis results to the server. For example, "Nagano Prefecture" and "tourist guide" are sent, along with the emotion information of a relaxed state.
[0231] 4. Extract and refine job listings
[0232] The server launches the generative AI model and searches the job database based on the input criteria. It extracts job listings for "tourist guides in Nagano Prefecture" that match the criteria.
[0233] Based on the results of the emotion engine, the most suitable job information for the user is selected on a priority basis.
[0234] 5. Providing and coordinating local information
[0235] The server searches the local information database and extracts information about accommodations and tourist attractions in the relevant area.
[0236] Taking into account the results of the emotion engine, accommodations and tourist spots that suit the user's emotions are selected.
[0237] 6. Generating and Sending the Response
[0238] The server integrates the job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[0239] 7. Presentation to the User
[0240] The device receives the response from the server and visually presents it to the user. For example, a user looking to relax might see suggestions such as "resort facility tour guide wanted," "quiet traditional Japanese inn," or "Zenkoji Temple where you can experience meditation."
[0241] In this way, the present invention provides an information provision function that takes into account the user's feelings, which will further enhance the way people work and spend their leisure time after retirement. It will also be effective in solving the problem of labor shortages in rural areas.
[0242] The processing flow will be explained below.
[0243] The system of the present invention provides job information, accommodation information, and tourist spot information based on the desired area and occupation to users who want to continue working and enjoying leisure time after retirement. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the system provides optimal information based on the user's emotions.
[0244] Program processing content (processing steps)
[0245] Step 1:
[0246] The user uses the terminal to input information about the desired area and job type. For example, the user inputs "tourist guide for Nagano Prefecture."
[0247] Step 2:
[0248] The terminal sends the entered information to the server. Specifically, the entered information "Nagano Prefecture" and "tourist guide" is sent.
[0249] Step 3:
[0250] The terminal activates sensors to capture the user's voice and facial expressions, and collects the user's emotional data.
[0251] Step 4:
[0252] An emotion engine analyzes the collected voice and facial expression data to recognize the user's current emotional state, for example, identifying that the user is relaxed.
[0253] Step 5:
[0254] The device sends the input information and the emotion engine's analysis results (emotion information) to the server. For example, the information "Nagano Prefecture," "tourist guide," and "relaxed state" is sent.
[0255] Step 6:
[0256] The server launches the generative AI model and searches the job database based on the input criteria, extracting job information related to tourist guides in Nagano Prefecture.
[0257] Step 7:
[0258] Based on the results of the emotion engine, the server prioritizes and selects job offers that are suited to the user's emotional state, for example, by selecting job offers that offer a work environment suited to a relaxed state.
[0259] Step 8:
[0260] The server searches the local information database and extracts information about accommodations and tourist attractions in the relevant area.
[0261] Step 9:
[0262] The server considers the results of the emotion engine and selects accommodations and tourist spots that suit the user's emotions. For users seeking relaxation, it will recommend quiet traditional Japanese inns and Zenkoji Temple where they can experience meditation.
[0263] Step 10:
[0264] The server generates a response by combining job listings, accommodation information, and tourist attraction information, and then organizes and formats each piece of information for presentation to the user.
[0265] Step 11:
[0266] The server sends the generated response to the terminal, which includes information on job openings, accommodations, and tourist attractions.
[0267] Step 12:
[0268] The device receives the response from the server and visually presents it to the user. For example, it displays information such as "Looking for a tourist guide for a resort facility," "Quiet traditional Japanese inn," and "Zenkoji Temple where you can experience meditation."
[0269] Step 13:
[0270] Users can review the information presented and decide on their next action, such as applying for a job, booking accommodation, or planning a trip, depending on their needs.
[0271] In this way, the present invention provides an information provision function that takes into account the user's feelings, which will further enhance the way people work and spend their leisure time after retirement. It will also be effective in solving the problem of labor shortages in rural areas.
[0272] Example 2
[0273] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0274] Current job information systems and tourism information systems provide information without considering the user's emotional state, resulting in low user satisfaction. Furthermore, information is provided based only on the user's desired region or occupation, and optimal information is not provided in response to the user's emotions. There is a need to address these issues.
[0275] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0276] In this invention, the server includes means for collecting voice and facial expression data of the user to analyze input information and emotions, means for analyzing the collected data and recognizing the emotional state of the user, and means for the server to adjust job information, accommodation information, and tourist attraction information based on the emotions, thereby making it possible to provide optimal job information and local information according to the user's emotions.
[0277] A "terminal" is an electronic device used by a user to enter and receive information.
[0278] "Input means" refers to a method or device for inputting information about the area and job type desired by the user into the terminal.
[0279] "Means for collecting voice and facial expression data" refers to functions and devices for capturing the user's voice, facial expressions, etc.
[0280] "Means for recognizing emotional state" refers to a method or software for analyzing collected voice and facial expression data to determine the user's emotional state.
[0281] A "server" is a central computing device that receives and processes collected and transmitted data.
[0282] A "generative artificial intelligence model" is an artificial intelligence software model that learns from large amounts of data and makes predictions and classifications for specific tasks.
[0283] "Job information" refers to information about employment opportunities provided to job seekers.
[0284] "Accommodation information" is information about accommodation locations that users can refer to when considering lodging.
[0285] "Tourist attraction information" is information about places that users visit or areas that they visit for sightseeing.
[0286] A "conditioning mechanism" is a method or algorithm for combining and prioritizing information based on input data and emotional data.
[0287] A "search and retrieval means" is a method or device for locating and retrieving information that meets specific criteria from a database.
[0288] Overall system overview
[0289] The system of this invention combines a terminal, a server, a generative AI model, and an emotion engine to provide users with job information, accommodation information, and tourist attraction information based on their desired area and job type. Furthermore, the emotion engine is used to recognize the user's emotional state and provide optimal information accordingly.
[0290] Hardware and software used
[0291] 1. Terminal
[0292] An electronic device that allows Yuga to input information and check the results. Specifically, a smartphone, tablet, or PC is used.
[0293] It also has a built-in camera and microphone that collects emotional data.
[0294] 2. Server
[0295] A central computing device for data processing and analysis, running generative AI models and searching databases.
[0296] 3. Generative AI Models
[0297] A software model that uses deep learning and machine learning. It learns from large amounts of data and generates optimal information based on user input conditions.
[0298] 4. Emotion Engine
[0299] Software that analyzes the user's voice and facial expressions to recognize their emotional state. The analysis results are sent to a server and the information provided is adjusted accordingly.
[0300] Data processing and calculation
[0301] 1. Data Collection
[0302] The device collects information about the user's desired area and occupation, and also uses a camera and microphone to collect the user's voice and facial expression data.
[0303] 2. Emotion analysis
[0304] The collected voice and facial expression data is sent to an emotion engine to analyze the user's emotional state, for example, to determine whether the user is relaxed.
[0305] 3. Data Transmission
[0306] The terminal transmits the user's input information and the emotion analysis results to the server.
[0307] 4. Search and extract job information
[0308] The server uses the generative AI model to search the job database based on the input conditions of region and job type, and extracts relevant job information.
[0309] 5. Searching and extracting local information
[0310] The server searches the local information database and extracts information on accommodations and tourist attractions in the relevant area.
[0311] 6. Coordination of Information
[0312] The server adjusts job information and local information based on the results of the emotion engine. For example, if the user is looking for relaxation, it will prioritize job information and accommodations with a relaxing environment.
[0313] 7. Generating and Sending a Response
[0314] The server integrates the adjusted job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[0315] 8. User Display
[0316] The terminal visually displays the received information to the user.
[0317] Examples and prompts
[0318] For example, if a user types "tourist guide in Nagano Prefecture" into their device and detects a relaxed emotion, the server will suggest job listings for tour guides with a relaxing work environment, along with suggestions for quiet traditional Japanese inns and relaxing tourist spots.
[0319] Prompt Sentence Examples
[0320] "For users who are looking for a relaxed job as a tour guide in Nagano Prefecture, we suggest job listings with relaxing work environments, quiet traditional Japanese inns, and tourist spots where you can experience meditation."
[0321] This system makes it possible to provide optimal information that takes into account the user's emotional state, enabling them to enrich their work and leisure time after retirement.
[0322] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0323] Step 1:
[0324] The user inputs desired conditions into the terminal. Specifically, the user inputs information about the desired area and job type into the terminal. For example, the user inputs "tourist guide for Nagano Prefecture." This input information is stored internally.
[0325] Input: The user enters the desired region and job type in text format into the device.
[0326] Output: Keep input information in the terminal
[0327] Step 2:
[0328] The device collects the user's voice and facial expression data. While the user is entering information, the device's camera and microphone capture the user's facial expressions and voice.
[0329] Input: User's voice and facial expressions
[0330] Output: Voice data and facial expression data
[0331] Step 3:
[0332] The device sends voice data and facial expression data to the emotion engine, which analyzes the data and recognizes the user's emotional state, for example, determining whether the user is relaxed or stressed.
[0333] Input: Voice data and facial expression data
[0334] Output: Perceived emotional state (e.g., relaxed)
[0335] Step 4:
[0336] The terminal transmits the input desired conditions and the recognized emotional state to the server. For example, the text information "Tourist guide of Nagano Prefecture" and the emotional information "Relaxed state" are transmitted to the server.
[0337] Input: Input information and emotional state
[0338] Output: Input information and emotional state sent to the server
[0339] Step 5:
[0340] The server uses the generative artificial intelligence model to search for job listings based on the input criteria. Specifically, the server searches a job listing database based on information such as "tourist guide for Nagano Prefecture" and extracts relevant job listings.
[0341] Input: Input conditions (region and occupation)
[0342] Output: Matching job postings
[0343] Step 6:
[0344] The server adjusts the job information based on the results of the emotion engine. Specifically, it selects the job information that best suits the user based on the recognized emotional state. For a user in a relaxed state, it prioritizes job information with a relaxing work environment.
[0345] Input: Applicable job posting and emotional state
[0346] Output: Adjusted job listings
[0347] Step 7:
[0348] The server searches the local information database and extracts information about accommodations and tourist attractions in the relevant area. Specifically, it collects information about various accommodations and tourist attractions in Nagano Prefecture.
[0349] Input: Applicable area (Nagano Prefecture)
[0350] Output: Accommodation and tourist information for the area
[0351] Step 8:
[0352] The server adjusts the local information based on the results of the emotion engine. Specifically, it selects accommodations and tourist spots that suit the user's emotional state. For users who want to relax, it suggests accommodations with quiet environments and tourist spots where they can relax.
[0353] Input: Accommodation and tourist attraction information, emotional state
[0354] Output: Tailored accommodation and attraction information
[0355] Step 9:
[0356] The server generates a response by integrating information on jobs, accommodations, and tourist attractions, making it possible to provide comprehensive information.
[0357] Input: Tailored job listings, accommodation listings, and tourist attraction listings
[0358] Output: Consolidated response message
[0359] Step 10:
[0360] The server sends the integrated response message to the device, which may include information such as "Looking for a tour guide for a resort facility," "Quiet traditional Japanese inn," and "Zenkoji Temple where you can experience meditation."
[0361] Input: Unified response message
[0362] Output: Response message sent to the terminal
[0363] Step 11:
[0364] The terminal receives the response message from the server and visually displays the received information to the user.
[0365] Input: Received response message
[0366] Output: Information visually presented to the user
[0367] (Application example 2)
[0368] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0369] Conventional job information systems do not provide personalized information based on the user's emotions. This makes it difficult for users to obtain information that meets their emotional needs, such as wanting to relax or reduce stress. In the food delivery field, too, there is a lack of restaurant and food suggestions that match the user's emotional state, preventing users from making satisfying choices.
[0370] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting information on the desired area and job type from a terminal, and means including an emotion engine that recognizes the user's emotions and provides optimal information based on the emotions. This makes it possible to provide optimal job information, accommodation information, and tourist attraction information based on the user's emotional state. Furthermore, the server includes means for launching a generative artificial intelligence model based on the input area and job type, and means for providing optimal restaurants and dishes in the corresponding area based on the user's emotional state, making it possible to present options that suit the user's emotions even in the food delivery field.
[0371] A "terminal" is an electronic device that allows a user to input information and communicate with a server.
[0372] "Information about desired area and type of job" is information about the area where the user wants to work and the type of job he or she wants to have.
[0373] The "means for inputting information" refers to a method or device for a user to use a terminal to input information about the desired area and job type.
[0374] The "means for transmitting information to a server" refers to a method or device for transmitting the input information on the desired area and job type from the terminal to the server.
[0375] "Means for a server to search and extract job information based on conditions entered using a generated AI model" means a method in which a server uses a generated AI model to search and extract job information from a database that matches the conditions entered by a user.
[0376] "Job Information" means open positions and details thereof for a particular geographic area and job type.
[0377] The "means for transmitting the relevant job information to the terminal" refers to a method or device for transferring the extracted job information from the server to the terminal.
[0378] The "means for presenting information about accommodation facilities and tourist attractions in the relevant area" refers to a method or device for presenting information about accommodation facilities and tourist attractions in the relevant area to the user.
[0379] An "emotion engine" is a device or software that analyzes a user's voice and facial expression data to recognize the user's current emotional state.
[0380] The "restaurant database with restaurant information and food information" is a database that stores detailed information about restaurants and the food they serve.
[0381] The "emotional state of the user" refers to the psychological state of the user, such as whether the user is relaxed or stressed.
[0382] The "means for providing optimal restaurants and dishes based on emotions" refers to a method or device for selecting and providing optimal restaurants and dishes in consideration of the user's emotional state.
[0383] The "means for integrating and transmitting information to a terminal" refers to a method or device for integrating job information, accommodation information, tourist attraction information, restaurant and food information, and transmitting the information to a terminal.
[0384] "Means for visually presenting to the user" refers to a method or device for displaying the provided information on the screen of a terminal.
[0385]
[0386] The present invention is a system with an information provision function that takes user emotions into consideration, and provides job information, accommodation information, tourist spot information, and optimal restaurant and food information based on the user's desired area and job type. This system is composed of the following hardware and software.
[0387] 1. User Input and Emotion Recognition
[0388] The server provides a means for users to input information about their desired region and occupation using a smartphone or smart glasses. When a user speaks, "Tourist guide for Nagano prefecture," the smartphone or smart glasses detects this information and sends it to the server. In addition, it captures the user's voice and facial expression data and recognizes the user's emotions using an emotion engine (e.g., OpenCV or Emotion API).
[0389] 2. Data processing by the server
[0390] The server launches a generative artificial intelligence model (e.g., GPT-3.5) based on the input conditions and searches a job information database. After extracting job listings for "tourist guides in Nagano Prefecture" that match the conditions, it prioritizes and provides job listings that best fit the user's emotions based on the results of the emotion engine.
[0391] The server then searches a local information database to extract information on accommodations and tourist attractions in the area, and provides information that best suits the user's emotional state. For example, if the user is looking to relax, the server suggests accommodations in quiet environments and tourist spots where they can relax.
[0392] 3. Application to food delivery field
[0393] The system of the present invention can also be applied to the food delivery field. Based on the user's desired type of food and emotional state, the server searches a database containing relevant restaurant and food information and selects the most suitable restaurant and food based on the user's emotions. For example, if the user is feeling stressed, the server will suggest restaurants that offer healthy food that will help relieve stress.
[0394] 4. Information integration and presentation
[0395] The server integrates information on job openings, accommodations, tourist attractions, restaurants, and cuisines, and sends it to the terminal. The terminal visually presents this information to the user. For example, "Looking for a tour guide for a resort facility," "A quiet traditional Japanese inn," "Zenkoji Temple where you can experience meditation," "A quiet restaurant that serves healthy pasta dishes," etc.
[0396] Prompt Sentence Examples
[0397] An example prompt for this application is:
[0398] The user is stressed and wants to eat Italian food. Suggest a restaurant with a quiet atmosphere where they can relax.
[0399] As described above, the present invention provides information that takes into account the user's emotions, making it possible to provide job information, local information, and food delivery information that better meets the user's needs. This system aims to increase user satisfaction and support a more comfortable lifestyle.
[0400] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0401] Step 1:
[0402] The user uses a smartphone or smart glasses to input information about the desired region and job type by voice. The input information could be, for example, "Tourist guide for Nagano Prefecture." The input voice information is converted into text data through a voice recognition engine.
[0403] Input: Audio information ("Nagano Prefecture Tourist Guide")
[0404] Output: Text data ("Nagano Prefecture Tourist Guide")
[0405] Step 2:
[0406] The device captures the user's voice and facial expression data and uses an emotion engine (e.g., OpenCV or Emotion API) to recognize the user's emotions, which are then classified as states such as relaxed, stressed, etc.
[0407] Input: Voice data and facial expression data
[0408] Output: Emotion data (relaxed, stressed, etc.)
[0409] Step 3:
[0410] The device sends the text data from step 1 and the emotion data from step 2 to the server, which then receives the user's desired information and emotion information.
[0411] Input: Text data, emotion data
[0412] Output: Data sent to the server
[0413] Step 4:
[0414] The server launches a generative AI model (e.g., GPT-3.5) and runs it based on the text data. The server then searches a job information database and extracts job listings for "tourist guides in Nagano Prefecture" that match the input criteria.
[0415] Input: Text data, job information database
[0416] Output: Relevant job information (e.g., "Resort facility tour guide wanted")
[0417] Step 5:
[0418] Based on the emotional data, the server prioritizes job offers that best suit the user's emotional state. For example, if the user is looking for relaxation, the server suggests workplaces with quiet environments.
[0419] Input: relevant job information, emotion data
[0420] Output: Optimized job listings
[0421] Step 6:
[0422] The server searches the local information database and extracts information on accommodations and tourist attractions in the area. In particular, it selects accommodations and tourist attractions that are relaxing and take into account the user's feelings.
[0423] Input: Region database, emotion data
[0424] Output: Applicable accommodation and tourist attraction information
[0425] Step 7:
[0426] The server searches a database containing relevant restaurant and food information and extracts the most suitable restaurant and food information based on the user's emotions. For example, if the user is feeling stressed, it will select restaurants that serve healthy food.
[0427] Input: Restaurant database, emotion data
[0428] Output: Best restaurant and food information
[0429] Step 8:
[0430] The server aggregates job information, accommodation information, tourist attraction information, restaurant and cuisine information, and generates a response, which is then sent to the terminal.
[0431] Input: Optimized job listings, accommodation information, tourist attractions, restaurants and cuisine information
[0432] Output: Consolidated response data
[0433] Step 9:
[0434] The device visually presents the integrated response data received from the server to the user, such as information such as "want a tour guide for a resort facility," "a quiet traditional Japanese inn," "Zenkoji Temple where you can experience meditation," and "a restaurant that serves healthy pasta dishes."
[0435] Input: Consolidated response data
[0436] Output: Visually presented information
[0437] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0438] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0439] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0440] [Second embodiment]
[0441] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0442] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0443] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0444] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0445] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0446] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0447] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0448] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0449] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0450] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0451] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0452] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0453] The system of the present invention provides job information and local information based on the desired area and job type to users who want to continue working and enjoy leisure time after retirement. Specific embodiments of the present invention will be described below.
[0454] System Overview
[0455] 1. User Input and Data Submission
[0456] The user uses the terminal to input information about the region and job type they are looking for. For example, the user inputs "tourist guide for Nagano Prefecture."
[0457] The terminal is responsible for transmitting this input information to the server.
[0458] 2. Data processing by the server
[0459] The server uses the generative AI model to search for job information based on the entered conditions and extract relevant information.
[0460] Specifically, the server extracts job information that matches the conditions "Nagano Prefecture" and "tourist guide" from the job database.
[0461] 3. Providing local information
[0462] At the same time, the server searches and extracts information about accommodations and tourist attractions in the relevant area from the local information database.
[0463] For example, this includes information on popular accommodations, tourist attractions, and restaurants in Nagano Prefecture.
[0464] 4. Response from the server to the terminal and presentation to the user
[0465] The server integrates the job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[0466] The device receives the response from the server and visually presents it to the user. For example, it displays information such as "Tour guide wanted at resort facility (3 days a week)," "Traditional Japanese inn (free Wi-Fi in all rooms, hot spring)," and "Zenkoji Temple (meditation experience available)."
[0467] What the program does (natural language explanation)
[0468] 1. User Input
[0469] The user inputs the desired area and job type into the terminal. For example, "Nagano Prefecture Tourist Guide" is input.
[0470] 2. Data transmission
[0471] The terminal sends the user's input information to the server. For example, the information "Nagano Prefecture" and "tourist guide" is sent to the server.
[0472] 3. Extracting job information
[0473] The server launches the generative AI model and searches the job database based on the input criteria, specifically extracting job listings for tour guides in Nagano Prefecture.
[0474] 4. Extracting Regional Information
[0475] The server uses the generated AI model to search for accommodation and tourist attraction information in the relevant area from a local information database. For example, it extracts information on famous accommodations and tourist attractions in Nagano Prefecture.
[0476] 5. Generating and Sending the Response
[0477] The server integrates the job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[0478] 6. Presentation to the User
[0479] The device receives the response from the server and visually presents it to the user. For example, it displays information about a resort facility in Nagano Prefecture looking for a tour guide, information about traditional Japanese inns where to stay, and information about tourist attractions worth visiting.
[0480] Through this process, users can not only find job information in their desired area, but also information on tourist attractions and accommodations they can enjoy during their stay. This will enable them to balance financial concerns with leisure time after retirement, and will also contribute to solving the labor shortage problem in rural areas.
[0481] The processing flow will be explained below.
[0482] Step 1:
[0483] The user uses the terminal to input information about the desired area and job type. For example, the user inputs "tourist guide for Nagano Prefecture."
[0484] Step 2:
[0485] The terminal sends the entered information to the server. Specifically, the entered information "Nagano Prefecture" and "tourist guide" is sent.
[0486] Step 3:
[0487] When the server receives the input, it triggers a generative AI model, which acts based on the input conditions.
[0488] Step 4:
[0489] The server searches the job database and extracts job listings based on the input criteria. Job listings for "tourist guides in Nagano Prefecture" that match the criteria are found.
[0490] Step 5:
[0491] The server searches the local information database and extracts information about accommodations in the relevant area, such as "traditional Japanese-style inns in Nagano Prefecture."
[0492] Step 6:
[0493] The server also extracts tourist spot information from the local information database in the same region. For example, tourist spot information such as "Zenkoji Temple in Nagano Prefecture" or "Soba-making classes" can be searched.
[0494] Step 7:
[0495] The server then combines the extracted job listings, accommodation information, and tourist attraction information to generate a response, which is then organized and formatted for presentation to the user.
[0496] Step 8:
[0497] The server sends the generated response to the terminal, which includes information on job openings, accommodations, and tourist attractions.
[0498] Step 9:
[0499] The terminal receives the response from the server and visually presents it to the user. For example, information such as "Resort facility tour guide wanted," "Traditional Japanese inn," and "Zenkoji Temple" is displayed on the user's screen.
[0500] Step 10:
[0501] Users can review the information presented and decide on their next action, such as applying for a job, booking accommodation, or planning a trip, depending on their needs.
[0502] Example 1
[0503] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0504] In today's aging society, an increasing number of people want to continue working and enjoying leisure time after retirement. However, it is difficult to obtain job information based on the desired area and type of job, as well as information on accommodations and tourist attractions in one place. For this reason, there is a need for a comprehensive information system to improve the quality of life after retirement.
[0505] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0506] In this invention, the server includes means for inputting information on a desired area and job type from a terminal, means for transmitting the input information to the server, means for the server to search for and extract job information based on the input conditions using a generating AI model, means for the server to search for and extract accommodation information and tourist attraction information in the relevant area from a local information database, means for integrating the job information, accommodation information, and tourist attraction information and transmitting the integrated information to the terminal, and means for the terminal to receive a response from the server and visually present it to the user. This makes it possible for a user to continue working in a desired area after retirement and obtain information on accommodations and tourist attractions in that area all at once.
[0507] A "terminal" is a device through which a user inputs information and transmits that information to a server.
[0508] The "means for inputting information on desired area and job type" is an interface that allows a user to input information on the area and job type that he or she desires into the terminal.
[0509] The "means for transmitting input information to a server" is a function that enables a terminal to transmit information input by a user to a server.
[0510] A "generative AI model" is an algorithm that uses artificial intelligence techniques such as machine learning and deep learning to generate and analyze data.
[0511] "Job information" is information about jobs and benefits that companies and organizations provide to job seekers.
[0512] A "regional information database" is a database that stores and manages information about accommodations and tourist attractions in a specific region.
[0513] The "job information database" is a database that stores and manages job information.
[0514] "Search and extraction means" refers to a function for searching and retrieving relevant information from a database based on specific conditions.
[0515] "Accommodation information" is detailed information about accommodation facilities such as hotels, inns, and guesthouses.
[0516] "Tourist attraction information" is information about tourist spots and famous places in a particular area.
[0517] The "means for integrating and transmitting to the terminal" is a function that allows the server to compile multiple pieces of information into one and transmit it to the terminal.
[0518] "Means for receiving a response from the server and visually presenting it to the user" is a function that allows the terminal to receive information sent from the server and display it in a form that is easy for the user to see.
[0519] MODE FOR CARRYING OUT THE INVENTION
[0520] The system of the present invention provides job information and local information based on the desired area and job type to users who want to continue working and enjoy leisure time after retirement. A specific embodiment of the system is described below.
[0521] The system's main hardware components are the user device and the back-end server, while the generative AI model and associated database are used as software components.
[0522] Users use the system by entering information about their desired region and occupation on a terminal. For example, they might enter "Nagano Prefecture tourist guide." The terminal is equipped with input interfaces such as a keyboard and touch screen, making operation easy.
[0523] The entered information is sent from the device to the server. The server receives this information and activates a generative AI model to search and extract job listings based on the entered criteria. Specifically, the server searches a job database (e.g., a general job database) and extracts job listings that match the criteria "Nagano Prefecture" and "tourist guide."
[0524] Next, the server uses the same generative AI model to search a local information database (e.g., a local area database) to extract information about accommodations and tourist attractions in the area. For example, it retrieves information about well-known accommodations and tourist attractions in Nagano Prefecture. This information includes details about accommodations (e.g., traditional Japanese inn, free Wi-Fi in all rooms, hot springs) and tourist attractions (e.g., Zenkoji Temple, meditation experience available).
[0525] The server combines this job information, accommodation information, and tourist attraction information to generate a single response message. This response message is sent from the server to the device. The device receives the response from the server and visually presents it to the user. For example, information such as "Tour guide wanted at resort facility (work three days a week)," "Traditional Japanese inn (free Wi-Fi in all rooms, hot springs)," and "Zenkoji Temple (meditation experience available)" may be displayed on the screen.
[0526] Examples of specific prompts include:
[0527] I would like to work as a tourist guide in Nagano Prefecture. Could you also give me information about local accommodations and tourist attractions?
[0528] This system not only gives users the opportunity to work in the area of their choice after retirement, but also provides information on accommodations and tourist attractions that they can enjoy during their stay. This is expected to enrich post-retirement life and contribute to resolving the labor shortage problem in rural areas.
[0529] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0530] Step 1:
[0531] The user inputs the desired area and job type into the terminal.
[0532] Input: The user types "Nagano Prefecture Tourist Guide" into the device.
[0533] Specific operation: The user enters the desired region and job type into the input form on the device and clicks the "Submit" button.
[0534] Output: Contains information entered into the terminal.
[0535] Step 2:
[0536] The terminal transmits the user's input information to the server.
[0537] Input: Information about "Nagano Prefecture" and "Tourist Guide" entered into the device.
[0538] Specific operation: The terminal converts input information into data packets and sends them over the network to the server.
[0539] Output: The server receives the packet and parses the information.
[0540] Step 3:
[0541] The server launches the generative AI model to search and extract job information based on the input criteria.
[0542] Input: Information about "Nagano Prefecture" and "Tourist Guide" sent to the server.
[0543] Specific operation: The server launches a generative AI model (e.g., GPT-3) and searches and extracts information corresponding to "Nagano Prefecture" and "tourist guide" from the job information database.
[0544] Data processing / calculation: Performs condition matching and filtering using an AI model.
[0545] Output: The extracted job information is stored on the server.
[0546] Step 4:
[0547] The server uses the generated AI model to search and extract local information.
[0548] Input: Regional information condition "Nagano Prefecture".
[0549] Specific operation: The server uses the generative AI model to search the local information database and extract accommodation information and tourist attraction information.
[0550] Data processing / calculation: Performs condition matching and data extraction processing using an AI model.
[0551] Output: Accommodation information and tourist attraction information are stored on the server.
[0552] Step 5:
[0553] The server integrates the job information and the area information, generates a response message, and sends it to the terminal.
[0554] Input: Extracted job listings, accommodation information, and tourist attraction information.
[0555] Specific behavior: The server combines and formats this information into a single response message.
[0556] Data processing / calculation: Generates message formats and integrates data.
[0557] Output: A response message is generated and sent to the terminal.
[0558] Step 6:
[0559] The terminal receives the response from the server and visually presents it to the user.
[0560] Input: The response message sent by the server.
[0561] Specific operation: The device receives the response message, analyzes the data, and performs the design and layout for the screen display.
[0562] Data processing / calculation: Analyzes messages and generates visual designs.
[0563] Output: Job information, accommodation information, and tourist attraction information are displayed on the user's screen.
[0564] Through these steps, users can obtain comprehensive information not only about job openings in their desired area and occupation, but also about accommodations and tourist attractions in the area.
[0565] (Application example 1)
[0566] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0567] Conventional job information systems mainly provide only job information based on the desired region and type of job to users who want to continue working and enjoying their leisure time after retirement, but have the problem of not being able to provide comprehensive local information that would help users adapt to their new living environment and enjoy fulfilling leisure time. In particular, to support diverse lifestyles after retirement, it is necessary to provide integrated information on local tourist attractions, accommodations, etc. in addition to job information that suits users.
[0568] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0569] In this invention, the server includes means for inputting information on a desired area and job type from a terminal, means for transmitting the input information to the server, means for the server to search for and extract job information based on the input conditions using a generative artificial intelligence model, means for transmitting the relevant job information to the terminal, means for presenting accommodation information and tourist attraction information in the relevant area, and means for the terminal to integrate and present job information in the food delivery industry and local information based on the input conditions. This enables a user to obtain appropriate food delivery job information in a desired area while simultaneously obtaining comprehensive information for enjoying life and sightseeing in that area.
[0570] A "terminal" is a device that allows a user to input information and transmit that information to a server. This includes mobile devices such as smartphones and tablets.
[0571] The "desired area" refers to the geographical location where the user wishes to obtain job information and local information.
[0572] "Occupation" refers to the type of work or industry that a user desires when seeking employment.
[0573] A "server" is a computer system that receives transmitted information, searches and processes data based on that information, and transmits the results to a terminal.
[0574] "Generative artificial intelligence models" refer to AI technologies used to search and extract job listings or local information based on user input, such as generative natural language processing models.
[0575] "Job Postings" means information about employment opportunities related to a particular geographic area or occupation.
[0576] "Accommodation information" refers to information about available accommodations, such as hotels and inns, where users can stay.
[0577] "Tourist attraction information" refers to information about places and spots within a particular area that are recommended for tourists to visit.
[0578] The "food delivery industry" refers to the service industry that delivers food and beverage orders to customers.
[0579] "Integrated presentation means" refers to a method or technique for bringing together multiple different types of information and visually presenting it to the user in an integrated form.
[0580] "Database" means an organized collection of information used to efficiently manage, search, and retrieve job and local information.
[0581] The system of the present invention provides users with integrated job information and area information based on their desired area and occupation to support their post-retirement life. This system is mainly composed of the following elements:
[0582] 1. User Input and Data Submission
[0583] Users use devices such as smartphones to input information about their desired area and job type. For example, if a user inputs "food delivery in Hokkaido," that information is sent from the device to the server.
[0584] 2. Data processing by the server
[0585] The server uses a generative AI model based on the received information to search and extract data. This generative AI model uses OpenAI's GPT-4. Specifically, the server processes the data as follows:
[0586] Extracting job information: The server searches and extracts relevant job information from the job database based on the desired area and job type.
[0587] Extracting local information: The server searches a local information database and extracts information about tourist attractions and accommodations in the area.
[0588] 3. Generating and Sending a Response
[0589] The server integrates the job information and local information, generates a response message, and sends it to the terminal, allowing the user to obtain both job information and tourist information at the same time.
[0590] 4. Presenting Information to the User
[0591] The terminal visually presents the response received from the server to the user, for example displaying the following information:
[0592] "Food delivery in Hokkaido (3 days a week)"
[0593] "Popular ramen restaurant in Sapporo"
[0594] "Night view spots of Mt. Hakodate"
[0595] Hardware and software used
[0596] Hardware: Smartphone (iOS or Android device)
[0597] software:
[0598] Generative AI model: OpenAI's GPT-4
[0599] Job Database: Real-time updated job information API for the food delivery industry
[0600] Local information database: Local information services such as TripAdvisor and Google Maps API
[0601] Prompt Sentence Examples
[0602] Here are some example prompts using GPS-4:
[0603] Based on the region and job type information you entered, extract the following information:
[0604] 1. Food delivery job information in your area
[0605] 2. Tourist attractions in the area
[0606] 3. Gourmet spots in the area
[0607] Input: Hokkaido Food Delivery
[0608] This allows users to obtain appropriate food delivery job information in their desired area, while also obtaining comprehensive information on how to enjoy living and sightseeing in that area.
[0609] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0610] Step 1:
[0611] The user uses a device such as a smartphone to enter information about the desired area and job type. The entered information (e.g., "Hokkaido food delivery") is sent from the device to the server.
[0612] Step 2:
[0613] Based on the information received, the server begins searching for job information based on the desired region and job type. At this point, the server uses a generative AI model (e.g., GPT-4) to search the job information database. As a result, "job information for food delivery in Hokkaido" is extracted.
[0614] Step 3:
[0615] The server searches the regional information database to retrieve information on tourist attractions and accommodations in the entered region. Specifically, information on tourist attractions and accommodations in Hokkaido is extracted.
[0616] Step 4:
[0617] The server then integrates the extracted job information with local information. In this process, the job information, tourist attraction information, and accommodation information are compiled into a user-friendly format.
[0618] Step 5:
[0619] The integrated information is sent from the server to the device, including information such as "Food delivery in Hokkaido (working three days a week)," "Popular ramen restaurants in Sapporo," and "Night view spots around Mount Hakodate."
[0620] Step 6:
[0621] The device analyzes the received information and visually presents it to the user, who then sees the integrated job and tourism information displayed on the device screen.
[0622] Step 7:
[0623] Based on the information provided, users can apply for suitable jobs or decide on tourist destinations, allowing them to simultaneously obtain suitable food delivery job information in their desired area as well as tourist and accommodation information for that area.
[0624] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0625] The system of the present invention provides job information, accommodation information, and tourist spot information based on the desired area and occupation to users who want to continue working and enjoying leisure time after retirement. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the system provides optimal information based on the user's emotions.
[0626] System Overview
[0627] 1. User Input and Data Submission
[0628] The user uses the terminal to input information about the desired area and job type. For example, the user inputs "tourist guide for Nagano Prefecture."
[0629] The terminal is responsible for transmitting this input information to the server.
[0630] 2. Emotion Recognition by Emotion Engine
[0631] As the user enters information, the device captures the user's voice and facial expressions.
[0632] The emotion engine analyzes this data to recognize the user's current emotional state. For example, if the user is relaxed, it will prioritize reassuring suggestions.
[0633] 3. Server-based data processing and emotion-based adjustments
[0634] The server uses the generative AI model to search for job listings based on the entered conditions and extract relevant information.
[0635] The server then adjusts job listings and local information based on the user's perceived emotions. For example, if the user is feeling stressed, it prioritizes job listings that offer a relaxing work environment.
[0636] 4. Providing local information
[0637] The server searches and extracts information about accommodations and tourist attractions in the relevant area from the local information database.
[0638] Based on the results of the emotion engine, the system selects the most suitable accommodation and tourist spot information. For example, if the user is looking for relaxation, the system will suggest accommodation in a quiet environment and tourist spots where they can relax.
[0639] 5. Response from the server to the terminal and presentation to the user
[0640] The server integrates the job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[0641] The device receives the response from the server and visually presents it to the user. For example, it displays information such as "Tour guide wanted for resort facility," "Quiet traditional Japanese inn," and "Zenkoji Temple where you can experience meditation."
[0642] What the program does (natural language explanation)
[0643] 1. User Input
[0644] The user inputs the desired area and job type into the terminal. For example, "Nagano Prefecture Tourist Guide" is input.
[0645] 2. Emotional Engine Activation
[0646] The device captures the user's voice and facial expressions, and the emotion engine analyzes them to recognize the user's current emotions.
[0647] 3. Data transmission
[0648] The device sends the user's input information and the emotion engine's analysis results to the server. For example, "Nagano Prefecture" and "tourist guide" are sent, along with the emotion information of a relaxed state.
[0649] 4. Extract and refine job listings
[0650] The server launches the generative AI model and searches the job database based on the input criteria. It extracts job listings for "tourist guides in Nagano Prefecture" that match the criteria.
[0651] Based on the results of the emotion engine, the most suitable job information for the user is selected on a priority basis.
[0652] 5. Providing and coordinating local information
[0653] The server searches the local information database and extracts information about accommodations and tourist attractions in the relevant area.
[0654] Taking into account the results of the emotion engine, accommodations and tourist spots that suit the user's emotions are selected.
[0655] 6. Generating and Sending the Response
[0656] The server integrates the job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[0657] 7. Presentation to the User
[0658] The device receives the response from the server and visually presents it to the user. For example, a user looking to relax might see suggestions such as "resort facility tour guide wanted," "quiet traditional Japanese inn," or "Zenkoji Temple where you can experience meditation."
[0659] In this way, the present invention provides an information provision function that takes into account the user's feelings, which will further enhance the way people work and spend their leisure time after retirement. It will also be effective in solving the problem of labor shortages in rural areas.
[0660] The processing flow will be explained below.
[0661] The system of the present invention provides job information, accommodation information, and tourist spot information based on the desired area and occupation to users who want to continue working and enjoying leisure time after retirement. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the system provides optimal information based on the user's emotions.
[0662] Program processing content (processing steps)
[0663] Step 1:
[0664] The user uses the terminal to input information about the desired area and job type. For example, the user inputs "tourist guide for Nagano Prefecture."
[0665] Step 2:
[0666] The terminal sends the entered information to the server. Specifically, the entered information "Nagano Prefecture" and "tourist guide" is sent.
[0667] Step 3:
[0668] The terminal activates sensors to capture the user's voice and facial expressions, and collects the user's emotional data.
[0669] Step 4:
[0670] An emotion engine analyzes the collected voice and facial expression data to recognize the user's current emotional state, for example, identifying that the user is relaxed.
[0671] Step 5:
[0672] The device sends the input information and the emotion engine's analysis results (emotion information) to the server. For example, the information "Nagano Prefecture," "tourist guide," and "relaxed state" is sent.
[0673] Step 6:
[0674] The server launches the generative AI model and searches the job database based on the input criteria, extracting job information related to tourist guides in Nagano Prefecture.
[0675] Step 7:
[0676] Based on the results of the emotion engine, the server prioritizes and selects job offers that are suited to the user's emotional state, for example, by selecting job offers that offer a work environment suited to a relaxed state.
[0677] Step 8:
[0678] The server searches the local information database and extracts information about accommodations and tourist attractions in the relevant area.
[0679] Step 9:
[0680] The server considers the results of the emotion engine and selects accommodations and tourist spots that suit the user's emotions. For users seeking relaxation, it will recommend quiet traditional Japanese inns and Zenkoji Temple where they can experience meditation.
[0681] Step 10:
[0682] The server generates a response by combining job listings, accommodation information, and tourist attraction information, and then organizes and formats each piece of information for presentation to the user.
[0683] Step 11:
[0684] The server sends the generated response to the terminal, which includes information on job openings, accommodations, and tourist attractions.
[0685] Step 12:
[0686] The device receives the response from the server and visually presents it to the user. For example, it displays information such as "Looking for a tourist guide for a resort facility," "Quiet traditional Japanese inn," and "Zenkoji Temple where you can experience meditation."
[0687] Step 13:
[0688] Users can review the information presented and decide on their next action, such as applying for a job, booking accommodation, or planning a trip, depending on their needs.
[0689] In this way, the present invention provides an information provision function that takes into account the user's feelings, which will further enhance the way people work and spend their leisure time after retirement. It will also be effective in solving the problem of labor shortages in rural areas.
[0690] Example 2
[0691] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0692] Current job information systems and tourism information systems provide information without considering the user's emotional state, resulting in low user satisfaction. Furthermore, information is provided based only on the user's desired region or occupation, and optimal information is not provided in response to the user's emotions. There is a need to address these issues.
[0693] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0694] In this invention, the server includes means for collecting voice and facial expression data of the user to analyze input information and emotions, means for analyzing the collected data and recognizing the emotional state of the user, and means for the server to adjust job information, accommodation information, and tourist attraction information based on the emotions, thereby making it possible to provide optimal job information and local information according to the user's emotions.
[0695] A "terminal" is an electronic device used by a user to enter and receive information.
[0696] "Input means" refers to a method or device for inputting information about the area and job type desired by the user into the terminal.
[0697] "Means for collecting voice and facial expression data" refers to functions and devices for capturing the user's voice, facial expressions, etc.
[0698] "Means for recognizing emotional state" refers to a method or software for analyzing collected voice and facial expression data to determine the user's emotional state.
[0699] A "server" is a central computing device that receives and processes collected and transmitted data.
[0700] A "generative artificial intelligence model" is an artificial intelligence software model that learns from large amounts of data and makes predictions and classifications for specific tasks.
[0701] "Job information" refers to information about employment opportunities provided to job seekers.
[0702] "Accommodation information" is information about accommodation locations that users can refer to when considering lodging.
[0703] "Tourist attraction information" is information about places that users visit or areas that they visit for sightseeing.
[0704] A "conditioning mechanism" is a method or algorithm for combining and prioritizing information based on input data and emotional data.
[0705] A "search and retrieval means" is a method or device for locating and retrieving information that meets specific criteria from a database.
[0706] Overall system overview
[0707] The system of this invention combines a terminal, a server, a generative AI model, and an emotion engine to provide users with job information, accommodation information, and tourist attraction information based on their desired area and job type. Furthermore, the emotion engine is used to recognize the user's emotional state and provide optimal information accordingly.
[0708] Hardware and software used
[0709] 1. Terminal
[0710] An electronic device that allows Yuga to input information and check the results. Specifically, a smartphone, tablet, or PC is used.
[0711] It also has a built-in camera and microphone that collects emotional data.
[0712] 2. Server
[0713] A central computing device for data processing and analysis, running generative AI models and searching databases.
[0714] 3. Generative AI Models
[0715] A software model that uses deep learning and machine learning. It learns from large amounts of data and generates optimal information based on user input conditions.
[0716] 4. Emotion Engine
[0717] Software that analyzes the user's voice and facial expressions to recognize their emotional state. The analysis results are sent to a server and the information provided is adjusted accordingly.
[0718] Data processing and calculation
[0719] 1. Data Collection
[0720] The device collects information about the user's desired area and occupation, and also uses a camera and microphone to collect the user's voice and facial expression data.
[0721] 2. Emotion analysis
[0722] The collected voice and facial expression data is sent to an emotion engine to analyze the user's emotional state, for example, to determine whether the user is relaxed.
[0723] 3. Data Transmission
[0724] The terminal transmits the user's input information and the emotion analysis results to the server.
[0725] 4. Search and extract job information
[0726] The server uses the generative AI model to search the job database based on the input conditions of region and job type, and extracts relevant job information.
[0727] 5. Searching and extracting local information
[0728] The server searches the local information database and extracts information on accommodations and tourist attractions in the relevant area.
[0729] 6. Coordination of Information
[0730] The server adjusts job information and local information based on the results of the emotion engine. For example, if the user is looking for relaxation, it will prioritize job information and accommodations with a relaxing environment.
[0731] 7. Generating and Sending a Response
[0732] The server integrates the adjusted job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[0733] 8. User Display
[0734] The terminal visually displays the received information to the user.
[0735] Examples and prompts
[0736] For example, if a user types "tourist guide in Nagano Prefecture" into their device and detects a relaxed emotion, the server will suggest job listings for tour guides with a relaxing work environment, along with suggestions for quiet traditional Japanese inns and relaxing tourist spots.
[0737] Prompt Sentence Examples
[0738] "For users who are looking for a relaxed job as a tour guide in Nagano Prefecture, we suggest job listings with relaxing work environments, quiet traditional Japanese inns, and tourist spots where you can experience meditation."
[0739] This system makes it possible to provide optimal information that takes into account the user's emotional state, enabling them to enrich their work and leisure time after retirement.
[0740] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0741] Step 1:
[0742] The user inputs desired conditions into the terminal. Specifically, the user inputs information about the desired area and job type into the terminal. For example, the user inputs "tourist guide for Nagano Prefecture." This input information is stored internally.
[0743] Input: The user enters the desired region and job type in text format into the device.
[0744] Output: Keep input information in the terminal
[0745] Step 2:
[0746] The device collects the user's voice and facial expression data. While the user is entering information, the device's camera and microphone capture the user's facial expressions and voice.
[0747] Input: User's voice and facial expressions
[0748] Output: Voice data and facial expression data
[0749] Step 3:
[0750] The device sends voice data and facial expression data to the emotion engine, which analyzes the data and recognizes the user's emotional state, for example, determining whether the user is relaxed or stressed.
[0751] Input: Voice data and facial expression data
[0752] Output: Perceived emotional state (e.g., relaxed)
[0753] Step 4:
[0754] The terminal transmits the input desired conditions and the recognized emotional state to the server. For example, the text information "Tourist guide of Nagano Prefecture" and the emotional information "Relaxed state" are transmitted to the server.
[0755] Input: Input information and emotional state
[0756] Output: Input information and emotional state sent to the server
[0757] Step 5:
[0758] The server uses the generative artificial intelligence model to search for job listings based on the input criteria. Specifically, the server searches a job listing database based on information such as "tourist guide for Nagano Prefecture" and extracts relevant job listings.
[0759] Input: Input conditions (region and occupation)
[0760] Output: Matching job postings
[0761] Step 6:
[0762] The server adjusts the job information based on the results of the emotion engine. Specifically, it selects the job information that best suits the user based on the recognized emotional state. For a user in a relaxed state, it prioritizes job information with a relaxing work environment.
[0763] Input: Applicable job posting and emotional state
[0764] Output: Adjusted job listings
[0765] Step 7:
[0766] The server searches the local information database and extracts information about accommodations and tourist attractions in the relevant area. Specifically, it collects information about various accommodations and tourist attractions in Nagano Prefecture.
[0767] Input: Applicable area (Nagano Prefecture)
[0768] Output: Accommodation and tourist information for the area
[0769] Step 8:
[0770] The server adjusts the local information based on the results of the emotion engine. Specifically, it selects accommodations and tourist spots that suit the user's emotional state. For users who want to relax, it suggests accommodations with quiet environments and tourist spots where they can relax.
[0771] Input: Accommodation and tourist attraction information, emotional state
[0772] Output: Tailored accommodation and attraction information
[0773] Step 9:
[0774] The server generates a response by integrating information on jobs, accommodations, and tourist attractions, making it possible to provide comprehensive information.
[0775] Input: Tailored job listings, accommodation listings, and tourist attraction listings
[0776] Output: Consolidated response message
[0777] Step 10:
[0778] The server sends the integrated response message to the device, which may include information such as "Looking for a tour guide for a resort facility," "Quiet traditional Japanese inn," and "Zenkoji Temple where you can experience meditation."
[0779] Input: Unified response message
[0780] Output: Response message sent to the terminal
[0781] Step 11:
[0782] The terminal receives the response message from the server and visually displays the received information to the user.
[0783] Input: Received response message
[0784] Output: Information visually presented to the user
[0785] (Application example 2)
[0786] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0787] Conventional job information systems do not provide personalized information based on the user's emotions. This makes it difficult for users to obtain information that meets their emotional needs, such as wanting to relax or reduce stress. In the food delivery field, too, there is a lack of restaurant and food suggestions that match the user's emotional state, preventing users from making satisfying choices.
[0788] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting information on the desired area and job type from a terminal, and means including an emotion engine that recognizes the user's emotions and provides optimal information based on the emotions. This makes it possible to provide optimal job information, accommodation information, and tourist attraction information based on the user's emotional state. Furthermore, the server includes means for launching a generative artificial intelligence model based on the input area and job type, and means for providing optimal restaurants and dishes in the corresponding area based on the user's emotional state, making it possible to present options that suit the user's emotions even in the food delivery field.
[0789] A "terminal" is an electronic device that allows a user to input information and communicate with a server.
[0790] "Information about desired area and type of job" is information about the area where the user wants to work and the type of job he or she wants to have.
[0791] The "means for inputting information" refers to a method or device for a user to use a terminal to input information about the desired area and job type.
[0792] The "means for transmitting information to a server" refers to a method or device for transmitting the input information on the desired area and job type from the terminal to the server.
[0793] "Means for a server to search and extract job information based on conditions entered using a generated AI model" means a method in which a server uses a generated AI model to search and extract job information from a database that matches the conditions entered by a user.
[0794] "Job Information" means open positions and details thereof for a particular geographic area and job type.
[0795] The "means for transmitting the relevant job information to the terminal" refers to a method or device for transferring the extracted job information from the server to the terminal.
[0796] The "means for presenting information about accommodation facilities and tourist attractions in the relevant area" refers to a method or device for presenting information about accommodation facilities and tourist attractions in the relevant area to the user.
[0797] An "emotion engine" is a device or software that analyzes a user's voice and facial expression data to recognize the user's current emotional state.
[0798] The "restaurant database with restaurant information and food information" is a database that stores detailed information about restaurants and the food they serve.
[0799] The "emotional state of the user" refers to the psychological state of the user, such as whether the user is relaxed or stressed.
[0800] The "means for providing optimal restaurants and dishes based on emotions" refers to a method or device for selecting and providing optimal restaurants and dishes in consideration of the user's emotional state.
[0801] The "means for integrating and transmitting information to a terminal" refers to a method or device for integrating job information, accommodation information, tourist attraction information, restaurant and food information, and transmitting the information to a terminal.
[0802] "Means for visually presenting to the user" refers to a method or device for displaying the provided information on the screen of a terminal.
[0803]
[0804] The present invention is a system with an information provision function that takes user emotions into consideration, and provides job information, accommodation information, tourist spot information, and optimal restaurant and food information based on the user's desired area and job type. This system is composed of the following hardware and software.
[0805] 1. User Input and Emotion Recognition
[0806] The server provides a means for users to input information about their desired region and occupation using a smartphone or smart glasses. When a user speaks, "Tourist guide for Nagano prefecture," the smartphone or smart glasses detects this information and sends it to the server. In addition, it captures the user's voice and facial expression data and recognizes the user's emotions using an emotion engine (e.g., OpenCV or Emotion API).
[0807] 2. Data processing by the server
[0808] The server launches a generative artificial intelligence model (e.g., GPT-3.5) based on the input conditions and searches a job information database. After extracting job listings for "tourist guides in Nagano Prefecture" that match the conditions, it prioritizes and provides job listings that best fit the user's emotions based on the results of the emotion engine.
[0809] The server then searches a local information database to extract information on accommodations and tourist attractions in the area, and provides information that best suits the user's emotional state. For example, if the user is looking to relax, the server suggests accommodations in quiet environments and tourist spots where they can relax.
[0810] 3. Application to food delivery field
[0811] The system of the present invention can also be applied to the food delivery field. Based on the user's desired type of food and emotional state, the server searches a database containing relevant restaurant and food information and selects the most suitable restaurant and food based on the user's emotions. For example, if the user is feeling stressed, the server will suggest restaurants that offer healthy food that will help relieve stress.
[0812] 4. Information integration and presentation
[0813] The server integrates information on job openings, accommodations, tourist attractions, restaurants, and cuisines, and sends it to the terminal. The terminal visually presents this information to the user. For example, "Looking for a tour guide for a resort facility," "A quiet traditional Japanese inn," "Zenkoji Temple where you can experience meditation," "A quiet restaurant that serves healthy pasta dishes," etc.
[0814] Prompt Sentence Examples
[0815] An example prompt for this application is:
[0816] The user is stressed and wants to eat Italian food. Suggest a restaurant with a quiet atmosphere where they can relax.
[0817] As described above, the present invention provides information that takes into account the user's emotions, making it possible to provide job information, local information, and food delivery information that better meets the user's needs. This system aims to increase user satisfaction and support a more comfortable lifestyle.
[0818] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0819] Step 1:
[0820] The user uses a smartphone or smart glasses to input information about the desired region and job type by voice. The input information could be, for example, "Tourist guide for Nagano Prefecture." The input voice information is converted into text data through a voice recognition engine.
[0821] Input: Audio information ("Nagano Prefecture Tourist Guide")
[0822] Output: Text data ("Nagano Prefecture Tourist Guide")
[0823] Step 2:
[0824] The device captures the user's voice and facial expression data and uses an emotion engine (e.g., OpenCV or Emotion API) to recognize the user's emotions, which are then classified as states such as relaxed, stressed, etc.
[0825] Input: Voice data and facial expression data
[0826] Output: Emotion data (relaxed, stressed, etc.)
[0827] Step 3:
[0828] The device sends the text data from step 1 and the emotion data from step 2 to the server, which then receives the user's desired information and emotion information.
[0829] Input: Text data, emotion data
[0830] Output: Data sent to the server
[0831] Step 4:
[0832] The server launches a generative AI model (e.g., GPT-3.5) and runs it based on the text data. The server then searches a job information database and extracts job listings for "tourist guides in Nagano Prefecture" that match the input criteria.
[0833] Input: Text data, job information database
[0834] Output: Relevant job information (e.g., "Resort facility tour guide wanted")
[0835] Step 5:
[0836] Based on the emotional data, the server prioritizes job offers that best suit the user's emotional state. For example, if the user is looking for relaxation, the server suggests workplaces with quiet environments.
[0837] Input: relevant job information, emotion data
[0838] Output: Optimized job listings
[0839] Step 6:
[0840] The server searches the local information database and extracts information on accommodations and tourist attractions in the area. In particular, it selects accommodations and tourist attractions that are relaxing and take into account the user's feelings.
[0841] Input: Region database, emotion data
[0842] Output: Applicable accommodation and tourist attraction information
[0843] Step 7:
[0844] The server searches a database containing relevant restaurant and food information and extracts the most suitable restaurant and food information based on the user's emotions. For example, if the user is feeling stressed, it will select restaurants that serve healthy food.
[0845] Input: Restaurant database, emotion data
[0846] Output: Best restaurant and food information
[0847] Step 8:
[0848] The server aggregates job information, accommodation information, tourist attraction information, restaurant and cuisine information, and generates a response, which is then sent to the terminal.
[0849] Input: Optimized job listings, accommodation information, tourist attractions, restaurants and cuisine information
[0850] Output: Consolidated response data
[0851] Step 9:
[0852] The device visually presents the integrated response data received from the server to the user, such as information such as "want a tour guide for a resort facility," "a quiet traditional Japanese inn," "Zenkoji Temple where you can experience meditation," and "a restaurant that serves healthy pasta dishes."
[0853] Input: Consolidated response data
[0854] Output: Visually presented information
[0855] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0856] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0857] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[0858] [Third embodiment]
[0859] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[0860] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[0861] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0862] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[0863] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0864] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0865] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0866] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0867] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0868] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0869] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0870] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[0871] The system of the present invention provides job information and local information based on the desired area and job type to users who want to continue working and enjoy leisure time after retirement. Specific embodiments of the present invention will be described below.
[0872] System Overview
[0873] 1. User Input and Data Submission
[0874] The user uses the terminal to input information about the region and job type they are looking for. For example, the user inputs "tourist guide for Nagano Prefecture."
[0875] The terminal is responsible for transmitting this input information to the server.
[0876] 2. Data processing by the server
[0877] The server uses the generative AI model to search for job information based on the entered conditions and extract relevant information.
[0878] Specifically, the server extracts job information that matches the conditions "Nagano Prefecture" and "tourist guide" from the job database.
[0879] 3. Providing local information
[0880] At the same time, the server searches and extracts information about accommodations and tourist attractions in the relevant area from the local information database.
[0881] For example, this includes information on popular accommodations, tourist attractions, and restaurants in Nagano Prefecture.
[0882] 4. Response from the server to the terminal and presentation to the user
[0883] The server integrates the job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[0884] The device receives the response from the server and visually presents it to the user. For example, it displays information such as "Tour guide wanted at resort facility (3 days a week)," "Traditional Japanese inn (free Wi-Fi in all rooms, hot spring)," and "Zenkoji Temple (meditation experience available)."
[0885] What the program does (natural language explanation)
[0886] 1. User Input
[0887] The user inputs the desired area and job type into the terminal. For example, "Nagano Prefecture Tourist Guide" is input.
[0888] 2. Data transmission
[0889] The terminal sends the user's input information to the server. For example, the information "Nagano Prefecture" and "tourist guide" is sent to the server.
[0890] 3. Extracting job information
[0891] The server launches the generative AI model and searches the job database based on the input criteria, specifically extracting job listings for tour guides in Nagano Prefecture.
[0892] 4. Extracting Regional Information
[0893] The server uses the generated AI model to search for accommodation and tourist attraction information in the relevant area from a local information database. For example, it extracts information on famous accommodations and tourist attractions in Nagano Prefecture.
[0894] 5. Generating and Sending the Response
[0895] The server integrates the job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[0896] 6. Presentation to the User
[0897] The device receives the response from the server and visually presents it to the user. For example, it displays information about a resort facility in Nagano Prefecture looking for a tour guide, information about traditional Japanese inns where to stay, and information about tourist attractions worth visiting.
[0898] Through this process, users can not only find job information in their desired area, but also information on tourist attractions and accommodations they can enjoy during their stay. This will enable them to balance financial concerns with leisure time after retirement, and will also contribute to solving the labor shortage problem in rural areas.
[0899] The processing flow will be explained below.
[0900] Step 1:
[0901] The user uses the terminal to input information about the desired area and job type. For example, the user inputs "tourist guide for Nagano Prefecture."
[0902] Step 2:
[0903] The terminal sends the entered information to the server. Specifically, the entered information "Nagano Prefecture" and "tourist guide" is sent.
[0904] Step 3:
[0905] When the server receives the input, it triggers a generative AI model, which acts based on the input conditions.
[0906] Step 4:
[0907] The server searches the job database and extracts job listings based on the input criteria. Job listings for "tourist guides in Nagano Prefecture" that match the criteria are found.
[0908] Step 5:
[0909] The server searches the local information database and extracts information about accommodations in the relevant area, such as "traditional Japanese-style inns in Nagano Prefecture."
[0910] Step 6:
[0911] The server also extracts tourist spot information for the same region from the regional information database. For example, tourist spot information such as "Zenkoji Temple in Nagano Prefecture" or "Soba-making classes" is searched.
[0912] Step 7:
[0913] The server then generates a response by integrating the extracted job listings, accommodation information, and tourist attraction information, and then organizing and formatting each piece of information for presentation to the user.
[0914] Step 8:
[0915] The server sends the generated response to the terminal, which includes information on job openings, accommodations, and tourist attractions.
[0916] Step 9:
[0917] The terminal receives the response from the server and visually presents it to the user. For example, information such as "Resort facility tour guide wanted," "Traditional Japanese inn," and "Zenkoji Temple" is displayed on the user's screen.
[0918] Step 10:
[0919] Users can review the information presented and decide on their next action, such as applying for a job, booking accommodation, or planning a trip, depending on their needs.
[0920] Example 1
[0921] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0922] In today's aging society, an increasing number of people want to continue working and enjoying leisure time after retirement. However, it is difficult to obtain job information based on the desired area and type of job, as well as information on accommodations and tourist attractions in one place. For this reason, there is a need for a comprehensive information system to improve the quality of life after retirement.
[0923] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0924] In this invention, the server includes means for inputting information on a desired area and job type from a terminal, means for transmitting the input information to the server, means for the server to search for and extract job information based on the input conditions using a generating AI model, means for the server to search for and extract accommodation information and tourist attraction information in the relevant area from a local information database, means for integrating the job information, accommodation information, and tourist attraction information and transmitting the integrated information to the terminal, and means for the terminal to receive a response from the server and visually present it to the user. This makes it possible for a user to continue working in a desired area after retirement and obtain information on accommodations and tourist attractions in that area all at once.
[0925] A "terminal" is a device through which a user inputs information and transmits that information to a server.
[0926] The "means for inputting information on desired area and job type" is an interface that allows a user to input information on the area and job type that he or she desires into the terminal.
[0927] The "means for transmitting input information to a server" is a function that enables a terminal to transmit information input by a user to a server.
[0928] A "generative AI model" is an algorithm that uses artificial intelligence techniques such as machine learning and deep learning to generate and analyze data.
[0929] "Job information" is information about jobs and benefits that companies and organizations provide to job seekers.
[0930] A "regional information database" is a database that stores and manages information about accommodations and tourist attractions in a specific region.
[0931] The "job information database" is a database that stores and manages job information.
[0932] "Search and extraction means" refers to a function for searching and retrieving relevant information from a database based on specific conditions.
[0933] "Accommodation information" is detailed information about accommodation facilities such as hotels, inns, and guesthouses.
[0934] "Tourist attraction information" is information about tourist spots and famous places in a particular area.
[0935] The "means for integrating and transmitting to the terminal" is a function that allows the server to compile multiple pieces of information into one and transmit it to the terminal.
[0936] "Means for receiving a response from the server and visually presenting it to the user" is a function that allows the terminal to receive information sent from the server and display it in a form that is easy for the user to see.
[0937] MODE FOR CARRYING OUT THE INVENTION
[0938] The system of the present invention provides job information and local information based on the desired area and job type to users who want to continue working and enjoy leisure time after retirement. A specific embodiment of the system is described below.
[0939] The system's main hardware components are the user device and the back-end server, while the generative AI model and associated database are used as software components.
[0940] Users use the system by entering information about their desired region and occupation on a terminal. For example, they might enter "Nagano Prefecture tourist guide." The terminal is equipped with input interfaces such as a keyboard and touch screen, making operation easy.
[0941] The entered information is sent from the device to the server. The server receives this information and activates a generative AI model to search and extract job listings based on the entered criteria. Specifically, the server searches a job database (e.g., a general job database) and extracts job listings that match the criteria "Nagano Prefecture" and "tourist guide."
[0942] Next, the server uses the same generative AI model to search a local information database (e.g., a local area database) to extract information about accommodations and tourist attractions in the area. For example, it retrieves information about well-known accommodations and tourist attractions in Nagano Prefecture. This information includes details about accommodations (e.g., traditional Japanese inn, free Wi-Fi in all rooms, hot springs) and tourist attractions (e.g., Zenkoji Temple, meditation experience available).
[0943] The server combines this job information, accommodation information, and tourist attraction information to generate a single response message. This response message is sent from the server to the device. The device receives the response from the server and visually presents it to the user. For example, information such as "Tour guide wanted at resort facility (work three days a week)," "Traditional Japanese inn (free Wi-Fi in all rooms, hot springs)," and "Zenkoji Temple (meditation experience available)" may be displayed on the screen.
[0944] Examples of specific prompts include:
[0945] I would like to work as a tourist guide in Nagano Prefecture. Could you also give me information about local accommodations and tourist attractions?
[0946] This system not only gives users the opportunity to work in the area of their choice after retirement, but also provides information on accommodations and tourist attractions that they can enjoy during their stay. This is expected to enrich post-retirement life and contribute to resolving the labor shortage problem in rural areas.
[0947] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0948] Step 1:
[0949] The user inputs the desired area and job type into the terminal.
[0950] Input: The user types "Nagano Prefecture Tourist Guide" into the device.
[0951] Specific operation: The user enters the desired region and job type into the input form on the device and clicks the "Submit" button.
[0952] Output: Contains information entered into the terminal.
[0953] Step 2:
[0954] The terminal transmits the user's input information to the server.
[0955] Input: Information about "Nagano Prefecture" and "Tourist Guide" entered into the device.
[0956] Specific operation: The terminal converts input information into data packets and sends them over the network to the server.
[0957] Output: The server receives the packet and parses the information.
[0958] Step 3:
[0959] The server launches the generative AI model to search and extract job information based on the input criteria.
[0960] Input: Information about "Nagano Prefecture" and "Tourist Guide" sent to the server.
[0961] Specific operation: The server launches a generative AI model (e.g., GPT-3) and searches and extracts information corresponding to "Nagano Prefecture" and "tourist guide" from the job information database.
[0962] Data processing / calculation: Performs condition matching and filtering using an AI model.
[0963] Output: The extracted job information is stored on the server.
[0964] Step 4:
[0965] The server uses the generated AI model to search and extract local information.
[0966] Input: Regional information condition "Nagano Prefecture".
[0967] Specific operation: The server uses the generative AI model to search the local information database and extract accommodation information and tourist attraction information.
[0968] Data processing / calculation: Performs condition matching and data extraction processing using an AI model.
[0969] Output: Accommodation information and tourist attraction information are stored on the server.
[0970] Step 5:
[0971] The server integrates the job information and the area information, generates a response message, and sends it to the terminal.
[0972] Input: Extracted job listings, accommodation information, and tourist attraction information.
[0973] Specific behavior: The server combines and formats this information into a single response message.
[0974] Data processing / calculation: Generates message formats and integrates data.
[0975] Output: A response message is generated and sent to the terminal.
[0976] Step 6:
[0977] The terminal receives the response from the server and visually presents it to the user.
[0978] Input: The response message sent by the server.
[0979] Specific operation: The device receives the response message, analyzes the data, and performs the design and layout for the screen display.
[0980] Data processing / calculation: Analyzes messages and generates visual designs.
[0981] Output: Job information, accommodation information, and tourist attraction information are displayed on the user's screen.
[0982] Through these steps, users can obtain comprehensive information not only about job openings in their desired area and occupation, but also about accommodations and tourist attractions in the area.
[0983] (Application example 1)
[0984] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0985] Conventional job information systems mainly provide only job information based on the desired region and type of job to users who want to continue working and enjoying their leisure time after retirement, but have the problem of not being able to provide comprehensive local information that would help users adapt to their new living environment and enjoy fulfilling leisure time. In particular, to support diverse lifestyles after retirement, it is necessary to provide integrated information on local tourist attractions, accommodations, etc. in addition to job information that suits users.
[0986] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0987] In this invention, the server includes means for inputting information on a desired area and job type from a terminal, means for transmitting the input information to the server, means for the server to search for and extract job information based on the input conditions using a generative artificial intelligence model, means for transmitting the relevant job information to the terminal, means for presenting accommodation information and tourist attraction information in the relevant area, and means for the terminal to integrate and present job information in the food delivery industry and local information based on the input conditions. This enables a user to obtain appropriate food delivery job information in a desired area while simultaneously obtaining comprehensive information for enjoying life and sightseeing in that area.
[0988] A "terminal" is a device that allows a user to input information and transmit that information to a server. This includes mobile devices such as smartphones and tablets.
[0989] The "desired area" refers to the geographical location where the user wishes to obtain job information and local information.
[0990] "Occupation" refers to the type of work or industry that a user desires when seeking employment.
[0991] A "server" is a computer system that receives transmitted information, searches and processes data based on that information, and transmits the results to a terminal.
[0992] "Generative artificial intelligence models" refer to AI technologies used to search and extract job listings or local information based on user input, such as generative natural language processing models.
[0993] "Job Postings" means information about employment opportunities related to a particular geographic area or occupation.
[0994] "Accommodation information" refers to information about available accommodations, such as hotels and inns, where users can stay.
[0995] "Tourist attraction information" refers to information about places and spots within a particular area that are recommended for tourists to visit.
[0996] The "food delivery industry" refers to the service industry that delivers food and beverage orders to customers.
[0997] "Integrated presentation means" refers to a method or technique for bringing together multiple different types of information and visually presenting it to the user in an integrated form.
[0998] "Database" means an organized collection of information used to efficiently manage, search, and retrieve job and local information.
[0999] The system of the present invention provides users with integrated job information and area information based on their desired area and occupation to support their post-retirement life. This system is mainly composed of the following elements:
[1000] 1. User Input and Data Submission
[1001] Users use devices such as smartphones to input information about their desired area and job type. For example, if a user inputs "food delivery in Hokkaido," that information is sent from the device to the server.
[1002] 2. Data processing by the server
[1003] The server uses a generative AI model based on the received information to search and extract data. This generative AI model uses OpenAI's GPT-4. Specifically, the server processes the data as follows:
[1004] Extracting job information: The server searches and extracts relevant job information from the job database based on the desired area and job type.
[1005] Extracting local information: The server searches a local information database and extracts information about tourist attractions and accommodations in the area.
[1006] 3. Generating and Sending a Response
[1007] The server integrates the job information and local information, generates a response message, and sends it to the terminal, allowing the user to obtain both job information and tourist information at the same time.
[1008] 4. Presenting Information to the User
[1009] The terminal visually presents the response received from the server to the user, for example displaying the following information:
[1010] "Food delivery in Hokkaido (3 days a week)"
[1011] "Popular ramen restaurant in Sapporo"
[1012] "Night view spots of Mt. Hakodate"
[1013] Hardware and software used
[1014] Hardware: Smartphone (iOS or Android device)
[1015] software:
[1016] Generative AI model: OpenAI's GPT-4
[1017] Job Database: Real-time updated job information API for the food delivery industry
[1018] Local information database: Local information services such as TripAdvisor and Google Maps API
[1019] Prompt Sentence Examples
[1020] Here are some example prompts using GPS-4:
[1021] Based on the region and job type information you entered, extract the following information:
[1022] 1. Food delivery job information in your area
[1023] 2. Tourist attractions in the area
[1024] 3. Gourmet spots in the area
[1025] Input: Hokkaido Food Delivery
[1026] This allows users to obtain appropriate food delivery job information in their desired area, while also obtaining comprehensive information on how to enjoy living and sightseeing in that area.
[1027] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1028] Step 1:
[1029] The user uses a device such as a smartphone to enter information about the desired area and job type. The entered information (e.g., "Hokkaido food delivery") is sent from the device to the server.
[1030] Step 2:
[1031] Based on the information received, the server begins searching for job information based on the desired region and job type. At this point, the server uses a generative AI model (e.g., GPT-4) to search the job information database. As a result, "job information for food delivery in Hokkaido" is extracted.
[1032] Step 3:
[1033] The server searches the regional information database to retrieve information on tourist attractions and accommodations in the entered region. Specifically, information on tourist attractions and accommodations in Hokkaido is extracted.
[1034] Step 4:
[1035] The server then integrates the extracted job information with local information. In this process, the job information, tourist attraction information, and accommodation information are compiled into a user-friendly format.
[1036] Step 5:
[1037] The integrated information is sent from the server to the device, including information such as "Food delivery in Hokkaido (working three days a week)," "Popular ramen restaurants in Sapporo," and "Night view spots around Mount Hakodate."
[1038] Step 6:
[1039] The device analyzes the received information and visually presents it to the user, who then sees the integrated job and tourism information displayed on the device screen.
[1040] Step 7:
[1041] Based on the information provided, users can apply for suitable jobs or decide on tourist destinations, allowing them to simultaneously obtain suitable food delivery job information in their desired area as well as tourist and accommodation information for that area.
[1042] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1043] The system of the present invention provides job information, accommodation information, and tourist spot information based on the desired area and occupation to users who want to continue working and enjoying leisure time after retirement. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the system provides optimal information based on the user's emotions.
[1044] System Overview
[1045] 1. User Input and Data Submission
[1046] The user uses the terminal to input information about the desired area and job type. For example, the user inputs "tourist guide for Nagano Prefecture."
[1047] The terminal is responsible for transmitting this input information to the server.
[1048] 2. Emotion Recognition by Emotion Engine
[1049] As the user enters information, the device captures the user's voice and facial expressions.
[1050] The emotion engine analyzes this data to recognize the user's current emotional state. For example, if the user is relaxed, it will prioritize reassuring suggestions.
[1051] 3. Server-based data processing and emotion-based adjustments
[1052] The server uses the generative AI model to search for job listings based on the entered conditions and extract relevant information.
[1053] The server then adjusts job listings and local information based on the user's perceived emotions. For example, if the user is feeling stressed, it prioritizes job listings that offer a relaxing work environment.
[1054] 4. Providing local information
[1055] The server searches and extracts information about accommodations and tourist attractions in the relevant area from the local information database.
[1056] Based on the results of the emotion engine, the system selects the most suitable accommodation and tourist spot information. For example, if the user is looking for relaxation, the system will suggest accommodation in a quiet environment and tourist spots where they can relax.
[1057] 5. Response from the server to the terminal and presentation to the user
[1058] The server integrates the job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[1059] The device receives the response from the server and visually presents it to the user. For example, it displays information such as "Tour guide wanted for resort facility," "Quiet traditional Japanese inn," and "Zenkoji Temple where you can experience meditation."
[1060] What the program does (natural language explanation)
[1061] 1. User Input
[1062] The user inputs the desired area and job type into the terminal. For example, "Nagano Prefecture Tourist Guide" is input.
[1063] 2. Emotional Engine Activation
[1064] The device captures the user's voice and facial expressions, and the emotion engine analyzes them to recognize the user's current emotions.
[1065] 3. Data transmission
[1066] The device sends the user's input information and the emotion engine's analysis results to the server. For example, "Nagano Prefecture" and "tourist guide" are sent, along with the emotion information of a relaxed state.
[1067] 4. Extract and refine job listings
[1068] The server launches the generative AI model and searches the job database based on the input criteria. It extracts job listings for "tourist guides in Nagano Prefecture" that match the criteria.
[1069] Based on the results of the emotion engine, the most suitable job information for the user is selected on a priority basis.
[1070] 5. Providing and coordinating local information
[1071] The server searches the local information database and extracts information about accommodations and tourist attractions in the relevant area.
[1072] Taking into account the results of the emotion engine, accommodations and tourist spots that suit the user's emotions are selected.
[1073] 6. Generating and Sending the Response
[1074] The server integrates the job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[1075] 7. Presentation to the User
[1076] The device receives the response from the server and visually presents it to the user. For example, a user looking to relax might see suggestions such as "resort facility tour guide wanted," "quiet traditional Japanese inn," or "Zenkoji Temple where you can experience meditation."
[1077] In this way, the present invention provides an information provision function that takes into account the user's feelings, which will further enhance the way people work and spend their leisure time after retirement. It will also be effective in solving the problem of labor shortages in rural areas.
[1078] The processing flow will be explained below.
[1079] The system of the present invention provides job information, accommodation information, and tourist spot information based on the desired area and occupation to users who want to continue working and enjoying leisure time after retirement. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the system provides optimal information based on the user's emotions.
[1080] Program processing content (processing steps)
[1081] Step 1:
[1082] The user uses the terminal to input information about the desired area and job type. For example, the user inputs "tourist guide for Nagano Prefecture."
[1083] Step 2:
[1084] The terminal sends the entered information to the server. Specifically, the entered information "Nagano Prefecture" and "tourist guide" is sent.
[1085] Step 3:
[1086] The terminal activates sensors to capture the user's voice and facial expressions, and collects the user's emotional data.
[1087] Step 4:
[1088] An emotion engine analyzes the collected voice and facial expression data to recognize the user's current emotional state, for example, identifying that the user is relaxed.
[1089] Step 5:
[1090] The device sends the input information and the emotion engine's analysis results (emotion information) to the server. For example, the information "Nagano Prefecture," "tourist guide," and "relaxed state" is sent.
[1091] Step 6:
[1092] The server launches the generative AI model and searches the job database based on the input criteria, extracting job information related to tourist guides in Nagano Prefecture.
[1093] Step 7:
[1094] Based on the results of the emotion engine, the server prioritizes and selects job offers that are suited to the user's emotional state, for example, by selecting job offers that offer a work environment suited to a relaxed state.
[1095] Step 8:
[1096] The server searches the local information database and extracts information about accommodations and tourist attractions in the relevant area.
[1097] Step 9:
[1098] The server considers the results of the emotion engine and selects accommodations and tourist spots that suit the user's emotions. For users seeking relaxation, it will recommend quiet traditional Japanese inns and Zenkoji Temple where they can experience meditation.
[1099] Step 10:
[1100] The server generates a response by combining job listings, accommodation information, and tourist attraction information, and then organizes and formats each piece of information for presentation to the user.
[1101] Step 11:
[1102] The server sends the generated response to the terminal, which includes information on job openings, accommodations, and tourist attractions.
[1103] Step 12:
[1104] The device receives the response from the server and visually presents it to the user. For example, it displays information such as "Looking for a tourist guide for a resort facility," "Quiet traditional Japanese inn," and "Zenkoji Temple where you can experience meditation."
[1105] Step 13:
[1106] Users can review the information presented and decide on their next action, such as applying for a job, booking accommodation, or planning a trip, depending on their needs.
[1107] In this way, the present invention provides an information provision function that takes into account the user's feelings, which will further enhance the way people work and spend their leisure time after retirement. It will also be effective in solving the problem of labor shortages in rural areas.
[1108] Example 2
[1109] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1110] Current job information systems and tourism information systems provide information without considering the user's emotional state, resulting in low user satisfaction. Furthermore, information is provided based only on the user's desired region or occupation, and optimal information is not provided in response to the user's emotions. There is a need to address these issues.
[1111] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1112] In this invention, the server includes means for collecting voice and facial expression data of the user to analyze input information and emotions, means for analyzing the collected data and recognizing the emotional state of the user, and means for the server to adjust job information, accommodation information, and tourist attraction information based on the emotions, thereby making it possible to provide optimal job information and local information according to the user's emotions.
[1113] A "terminal" is an electronic device used by a user to enter and receive information.
[1114] "Input means" refers to a method or device for inputting information about the area and job type desired by the user into the terminal.
[1115] "Means for collecting voice and facial expression data" refers to functions and devices for capturing the user's voice, facial expressions, etc.
[1116] "Means for recognizing emotional state" refers to a method or software for analyzing collected voice and facial expression data to determine the user's emotional state.
[1117] A "server" is a central computing device that receives and processes collected and transmitted data.
[1118] A "generative artificial intelligence model" is an artificial intelligence software model that learns from large amounts of data and makes predictions and classifications for specific tasks.
[1119] "Job information" refers to information about employment opportunities provided to job seekers.
[1120] "Accommodation information" is information about accommodation locations that users can refer to when considering lodging.
[1121] "Tourist attraction information" is information about places that users visit or areas that they visit for sightseeing.
[1122] A "conditioning mechanism" is a method or algorithm for combining and prioritizing information based on input data and emotional data.
[1123] A "search and retrieval means" is a method or device for locating and retrieving information that meets specific criteria from a database.
[1124] Overall system overview
[1125] The system of this invention combines a terminal, a server, a generative AI model, and an emotion engine to provide users with job information, accommodation information, and tourist attraction information based on their desired area and job type. Furthermore, the emotion engine is used to recognize the user's emotional state and provide optimal information accordingly.
[1126] Hardware and software used
[1127] 1. Terminal
[1128] An electronic device that allows Yuga to input information and check the results. Specifically, a smartphone, tablet, or PC is used.
[1129] It also has a built-in camera and microphone that collects emotional data.
[1130] 2. Server
[1131] A central computing device for data processing and analysis, running generative AI models and searching databases.
[1132] 3. Generative AI Models
[1133] A software model that uses deep learning and machine learning. It learns from large amounts of data and generates optimal information based on user input conditions.
[1134] 4. Emotion Engine
[1135] Software that analyzes the user's voice and facial expressions to recognize their emotional state. The analysis results are sent to a server and the information provided is adjusted accordingly.
[1136] Data processing and calculation
[1137] 1. Data Collection
[1138] The device collects information about the user's desired area and occupation, and also uses a camera and microphone to collect the user's voice and facial expression data.
[1139] 2. Emotion analysis
[1140] The collected voice and facial expression data is sent to an emotion engine to analyze the user's emotional state, for example, to determine whether the user is relaxed.
[1141] 3. Data Transmission
[1142] The terminal transmits the user's input information and the emotion analysis results to the server.
[1143] 4. Search and extract job information
[1144] The server uses the generative AI model to search the job database based on the input conditions of region and job type, and extracts relevant job information.
[1145] 5. Searching and extracting local information
[1146] The server searches the local information database and extracts information on accommodations and tourist attractions in the relevant area.
[1147] 6. Coordination of Information
[1148] The server adjusts job information and local information based on the results of the emotion engine. For example, if the user is looking for relaxation, it will prioritize job information and accommodations with a relaxing environment.
[1149] 7. Generating and Sending a Response
[1150] The server integrates the adjusted job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[1151] 8. User Display
[1152] The terminal visually displays the received information to the user.
[1153] Examples and prompts
[1154] For example, if a user types "tourist guide in Nagano Prefecture" into their device and detects a relaxed emotion, the server will suggest job listings for tour guides with a relaxing work environment, along with suggestions for quiet traditional Japanese inns and relaxing tourist spots.
[1155] Prompt Sentence Examples
[1156] "For users who are looking for a relaxed job as a tour guide in Nagano Prefecture, we suggest job listings with relaxing work environments, quiet traditional Japanese inns, and tourist spots where you can experience meditation."
[1157] This system makes it possible to provide optimal information that takes into account the user's emotional state, enabling them to enrich their work and leisure time after retirement.
[1158] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1159] Step 1:
[1160] The user inputs desired conditions into the terminal. Specifically, the user inputs information about the desired area and job type into the terminal. For example, the user inputs "tourist guide for Nagano Prefecture." This input information is stored internally.
[1161] Input: The user enters the desired region and job type in text format into the device.
[1162] Output: Keep input information in the terminal
[1163] Step 2:
[1164] The device collects the user's voice and facial expression data. While the user is entering information, the device's camera and microphone capture the user's facial expressions and voice.
[1165] Input: User's voice and facial expressions
[1166] Output: Voice data and facial expression data
[1167] Step 3:
[1168] The device sends voice data and facial expression data to the emotion engine, which analyzes the data and recognizes the user's emotional state, for example, determining whether the user is relaxed or stressed.
[1169] Input: Voice data and facial expression data
[1170] Output: Perceived emotional state (e.g., relaxed)
[1171] Step 4:
[1172] The terminal transmits the input desired conditions and the recognized emotional state to the server. For example, the text information "Tourist guide of Nagano Prefecture" and the emotional information "Relaxed state" are transmitted to the server.
[1173] Input: Input information and emotional state
[1174] Output: Input information and emotional state sent to the server
[1175] Step 5:
[1176] The server uses the generative artificial intelligence model to search for job listings based on the input criteria. Specifically, the server searches a job listing database based on information such as "tourist guide for Nagano Prefecture" and extracts relevant job listings.
[1177] Input: Input conditions (region and occupation)
[1178] Output: Matching job postings
[1179] Step 6:
[1180] The server adjusts the job information based on the results of the emotion engine. Specifically, it selects the job information that best suits the user based on the recognized emotional state. For a user in a relaxed state, it prioritizes job information with a relaxing work environment.
[1181] Input: Applicable job posting and emotional state
[1182] Output: Adjusted job listings
[1183] Step 7:
[1184] The server searches the local information database and extracts information about accommodations and tourist attractions in the relevant area. Specifically, it collects information about various accommodations and tourist attractions in Nagano Prefecture.
[1185] Input: Applicable area (Nagano Prefecture)
[1186] Output: Accommodation and tourist information for the area
[1187] Step 8:
[1188] The server adjusts the local information based on the results of the emotion engine. Specifically, it selects accommodations and tourist spots that suit the user's emotional state. For users who want to relax, it suggests accommodations with quiet environments and tourist spots where they can relax.
[1189] Input: Accommodation and tourist attraction information, emotional state
[1190] Output: Tailored accommodation and attraction information
[1191] Step 9:
[1192] The server generates a response by integrating information on jobs, accommodations, and tourist attractions, making it possible to provide comprehensive information.
[1193] Input: Tailored job listings, accommodation listings, and tourist attraction listings
[1194] Output: Consolidated response message
[1195] Step 10:
[1196] The server sends the integrated response message to the device, which may include information such as "Looking for a tour guide for a resort facility," "Quiet traditional Japanese inn," and "Zenkoji Temple where you can experience meditation."
[1197] Input: Unified response message
[1198] Output: Response message sent to the terminal
[1199] Step 11:
[1200] The terminal receives the response message from the server and visually displays the received information to the user.
[1201] Input: Received response message
[1202] Output: Information visually presented to the user
[1203] (Application example 2)
[1204] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1205] Conventional job information systems do not provide personalized information based on the user's emotions. This makes it difficult for users to obtain information that meets their emotional needs, such as wanting to relax or reduce stress. In the food delivery field, too, there is a lack of restaurant and food suggestions that match the user's emotional state, preventing users from making satisfying choices.
[1206] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting information on the desired area and job type from a terminal, and means including an emotion engine that recognizes the user's emotions and provides optimal information based on the emotions. This makes it possible to provide optimal job information, accommodation information, and tourist attraction information based on the user's emotional state. Furthermore, the server includes means for launching a generative artificial intelligence model based on the input area and job type, and means for providing optimal restaurants and dishes in the corresponding area based on the user's emotional state, making it possible to present options that suit the user's emotions even in the food delivery field.
[1207] A "terminal" is an electronic device that allows a user to input information and communicate with a server.
[1208] "Information about desired area and type of job" is information about the area where the user wants to work and the type of job he or she wants to have.
[1209] The "means for inputting information" refers to a method or device for a user to use a terminal to input information about the desired area and job type.
[1210] The "means for transmitting information to a server" refers to a method or device for transmitting the input information on the desired area and job type from the terminal to the server.
[1211] "Means for a server to search and extract job information based on conditions entered using a generated AI model" means a method in which a server uses a generated AI model to search and extract job information from a database that matches the conditions entered by a user.
[1212] "Job Information" means open positions and details thereof for a particular geographic area and job type.
[1213] The "means for transmitting the relevant job information to the terminal" refers to a method or device for transferring the extracted job information from the server to the terminal.
[1214] The "means for presenting information about accommodation facilities and tourist attractions in the relevant area" refers to a method or device for presenting information about accommodation facilities and tourist attractions in the relevant area to the user.
[1215] An "emotion engine" is a device or software that analyzes a user's voice and facial expression data to recognize the user's current emotional state.
[1216] The "restaurant database with restaurant information and food information" is a database that stores detailed information about restaurants and the food they serve.
[1217] The "emotional state of the user" refers to the psychological state of the user, such as whether the user is relaxed or stressed.
[1218] The "means for providing optimal restaurants and dishes based on emotions" refers to a method or device for selecting and providing optimal restaurants and dishes in consideration of the user's emotional state.
[1219] The "means for integrating and transmitting information to a terminal" refers to a method or device for integrating job information, accommodation information, tourist attraction information, restaurant and food information, and transmitting the information to a terminal.
[1220] "Means for visually presenting to the user" refers to a method or device for displaying the provided information on the screen of a terminal.
[1221]
[1222] The present invention is a system with an information provision function that takes user emotions into consideration, and provides job information, accommodation information, tourist spot information, and optimal restaurant and food information based on the user's desired area and job type. This system is composed of the following hardware and software.
[1223] 1. User Input and Emotion Recognition
[1224] The server provides a means for users to input information about their desired region and occupation using a smartphone or smart glasses. When a user speaks, "Tourist guide for Nagano prefecture," the smartphone or smart glasses detects this information and sends it to the server. In addition, it captures the user's voice and facial expression data and recognizes the user's emotions using an emotion engine (e.g., OpenCV or Emotion API).
[1225] 2. Data processing by the server
[1226] The server launches a generative artificial intelligence model (e.g., GPT-3.5) based on the input conditions and searches a job information database. After extracting job listings for "tourist guides in Nagano Prefecture" that match the conditions, it prioritizes and provides job listings that best fit the user's emotions based on the results of the emotion engine.
[1227] The server then searches a local information database to extract information on accommodations and tourist attractions in the area, and provides information that best suits the user's emotional state. For example, if the user is looking to relax, the server suggests accommodations in quiet environments and tourist spots where they can relax.
[1228] 3. Application to food delivery field
[1229] The system of the present invention can also be applied to the food delivery field. Based on the user's desired type of food and emotional state, the server searches a database containing relevant restaurant and food information and selects the most suitable restaurant and food based on the user's emotions. For example, if the user is feeling stressed, the server will suggest restaurants that offer healthy food that will help relieve stress.
[1230] 4. Information integration and presentation
[1231] The server integrates information on job openings, accommodations, tourist attractions, restaurants, and cuisines, and sends it to the terminal. The terminal visually presents this information to the user. For example, "Looking for a tour guide for a resort facility," "A quiet traditional Japanese inn," "Zenkoji Temple where you can experience meditation," "A quiet restaurant that serves healthy pasta dishes," etc.
[1232] Prompt Sentence Examples
[1233] An example prompt for this application is:
[1234] The user is stressed and wants to eat Italian food. Suggest a restaurant with a quiet atmosphere where they can relax.
[1235] As described above, the present invention provides information that takes into account the user's emotions, making it possible to provide job information, local information, and food delivery information that better meets the user's needs. This system aims to increase user satisfaction and support a more comfortable lifestyle.
[1236] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1237] Step 1:
[1238] The user uses a smartphone or smart glasses to input information about the desired region and job type by voice. The input information could be, for example, "Tourist guide for Nagano Prefecture." The input voice information is converted into text data through a voice recognition engine.
[1239] Input: Audio information ("Nagano Prefecture Tourist Guide")
[1240] Output: Text data ("Nagano Prefecture Tourist Guide")
[1241] Step 2:
[1242] The device captures the user's voice and facial expression data and uses an emotion engine (e.g., OpenCV or Emotion API) to recognize the user's emotions, which are then classified as states such as relaxed, stressed, etc.
[1243] Input: Voice data and facial expression data
[1244] Output: Emotion data (relaxed, stressed, etc.)
[1245] Step 3:
[1246] The device sends the text data from step 1 and the emotion data from step 2 to the server, which then receives the user's desired information and emotion information.
[1247] Input: Text data, emotion data
[1248] Output: Data sent to the server
[1249] Step 4:
[1250] The server launches a generative AI model (e.g., GPT-3.5) and runs it based on the text data. The server then searches a job information database and extracts job listings for "tourist guides in Nagano Prefecture" that match the input criteria.
[1251] Input: Text data, job information database
[1252] Output: Relevant job information (e.g., "Resort facility tour guide wanted")
[1253] Step 5:
[1254] Based on the emotional data, the server prioritizes job offers that best suit the user's emotional state. For example, if the user is looking for relaxation, the server suggests workplaces with quiet environments.
[1255] Input: relevant job information, emotion data
[1256] Output: Optimized job listings
[1257] Step 6:
[1258] The server searches the local information database and extracts information on accommodations and tourist attractions in the area. In particular, it selects accommodations and tourist attractions that are relaxing and take into account the user's feelings.
[1259] Input: Region database, emotion data
[1260] Output: Applicable accommodation and tourist attraction information
[1261] Step 7:
[1262] The server searches a database containing relevant restaurant and food information and extracts the most suitable restaurant and food information based on the user's emotions. For example, if the user is feeling stressed, it will select restaurants that serve healthy food.
[1263] Input: Restaurant database, emotion data
[1264] Output: Best restaurant and food information
[1265] Step 8:
[1266] The server aggregates job information, accommodation information, tourist attraction information, restaurant and cuisine information, and generates a response, which is then sent to the terminal.
[1267] Input: Optimized job listings, accommodation information, tourist attractions, restaurants and cuisine information
[1268] Output: Consolidated response data
[1269] Step 9:
[1270] The device visually presents the integrated response data received from the server to the user, such as information such as "want a tour guide for a resort facility," "a quiet traditional Japanese inn," "Zenkoji Temple where you can experience meditation," and "a restaurant that serves healthy pasta dishes."
[1271] Input: Consolidated response data
[1272] Output: Visually presented information
[1273] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1274] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1275] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1276] [Fourth embodiment]
[1277] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1278] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1279] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1280] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1281] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1282] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1283] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1284] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1285] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1286] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1287] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1288] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1289] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1290] The system of the present invention provides job information and local information based on the desired area and job type to users who want to continue working and enjoy leisure time after retirement. Specific embodiments of the present invention will be described below.
[1291] System Overview
[1292] 1. User Input and Data Submission
[1293] The user uses the terminal to input information about the region and job type they are looking for. For example, the user inputs "tourist guide for Nagano Prefecture."
[1294] The terminal is responsible for transmitting this input information to the server.
[1295] 2. Data processing by the server
[1296] The server uses the generative AI model to search for job information based on the entered conditions and extract relevant information.
[1297] Specifically, the server extracts job information that matches the conditions "Nagano Prefecture" and "tourist guide" from the job database.
[1298] 3. Providing local information
[1299] At the same time, the server searches and extracts information about accommodations and tourist attractions in the relevant area from the local information database.
[1300] For example, this includes information on popular accommodations, tourist attractions, and restaurants in Nagano Prefecture.
[1301] 4. Response from the server to the terminal and presentation to the user
[1302] The server integrates the job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[1303] The device receives the response from the server and visually presents it to the user. For example, it displays information such as "Tour guide wanted at resort facility (3 days a week)," "Traditional Japanese inn (free Wi-Fi in all rooms, hot spring)," and "Zenkoji Temple (meditation experience available)."
[1304] What the program does (natural language explanation)
[1305] 1. User Input
[1306] The user inputs the desired area and job type into the terminal. For example, "Nagano Prefecture Tourist Guide" is input.
[1307] 2. Data transmission
[1308] The terminal sends the user's input information to the server. For example, the information "Nagano Prefecture" and "tourist guide" is sent to the server.
[1309] 3. Extracting job information
[1310] The server launches the generative AI model and searches the job database based on the input criteria, specifically extracting job listings for tour guides in Nagano Prefecture.
[1311] 4. Extracting Regional Information
[1312] The server uses the generated AI model to search for accommodation and tourist attraction information in the relevant area from a local information database. For example, it extracts information on famous accommodations and tourist attractions in Nagano Prefecture.
[1313] 5. Generating and Sending the Response
[1314] The server integrates the job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[1315] 6. Presentation to the User
[1316] The device receives the response from the server and visually presents it to the user. For example, it displays information about a resort facility in Nagano Prefecture looking for a tour guide, information about traditional Japanese inns where to stay, and information about tourist attractions worth visiting.
[1317] Through this process, users can not only find job information in their desired area, but also information on tourist attractions and accommodations they can enjoy during their stay. This will enable them to balance financial concerns with leisure time after retirement, and will also contribute to solving the labor shortage problem in rural areas.
[1318] The processing flow will be explained below.
[1319] Step 1:
[1320] The user uses the terminal to input information about the desired area and job type. For example, the user inputs "tourist guide for Nagano Prefecture."
[1321] Step 2:
[1322] The terminal sends the entered information to the server. Specifically, the entered information "Nagano Prefecture" and "tourist guide" is sent.
[1323] Step 3:
[1324] When the server receives the input, it triggers a generative AI model, which acts based on the input conditions.
[1325] Step 4:
[1326] The server searches the job database and extracts job listings based on the input criteria. Job listings for "tourist guides in Nagano Prefecture" that match the criteria are found.
[1327] Step 5:
[1328] The server searches the local information database and extracts information about accommodations in the relevant area, such as "traditional Japanese-style inns in Nagano Prefecture."
[1329] Step 6:
[1330] The server also extracts tourist spot information for the same region from the regional information database. For example, tourist spot information such as "Zenkoji Temple in Nagano Prefecture" or "Soba-making classes" is searched.
[1331] Step 7:
[1332] The server then generates a response by integrating the extracted job listings, accommodation information, and tourist attraction information, and then organizing and formatting each piece of information for presentation to the user.
[1333] Step 8:
[1334] The server sends the generated response to the terminal, which includes information on job openings, accommodations, and tourist attractions.
[1335] Step 9:
[1336] The terminal receives the response from the server and visually presents it to the user. For example, information such as "Resort facility tour guide wanted," "Traditional Japanese inn," and "Zenkoji Temple" is displayed on the user's screen.
[1337] Step 10:
[1338] Users can review the information presented and decide on their next action, such as applying for a job, booking accommodation, or planning a trip, depending on their needs.
[1339] Example 1
[1340] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1341] In today's aging society, an increasing number of people want to continue working and enjoying leisure time after retirement. However, it is difficult to obtain job information based on the desired area and type of job, as well as information on accommodations and tourist attractions in one place. For this reason, there is a need for a comprehensive information system to improve the quality of life after retirement.
[1342] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1343] In this invention, the server includes means for inputting information on a desired area and job type from a terminal, means for transmitting the input information to the server, means for the server to search for and extract job information based on the input conditions using a generating AI model, means for the server to search for and extract accommodation information and tourist attraction information in the relevant area from a local information database, means for integrating the job information, accommodation information, and tourist attraction information and transmitting the integrated information to the terminal, and means for the terminal to receive a response from the server and visually present it to the user. This makes it possible for a user to continue working in a desired area after retirement and obtain information on accommodations and tourist attractions in that area all at once.
[1344] A "terminal" is a device through which a user inputs information and transmits that information to a server.
[1345] The "means for inputting information on desired area and job type" is an interface that allows a user to input information on the area and job type that he or she desires into the terminal.
[1346] The "means for transmitting input information to a server" is a function that enables a terminal to transmit information input by a user to a server.
[1347] A "generative AI model" is an algorithm that uses artificial intelligence techniques such as machine learning and deep learning to generate and analyze data.
[1348] "Job information" is information about jobs and benefits that companies and organizations provide to job seekers.
[1349] A "regional information database" is a database that stores and manages information about accommodations and tourist attractions in a specific region.
[1350] The "job information database" is a database that stores and manages job information.
[1351] "Search and extraction means" refers to a function for searching and retrieving relevant information from a database based on specific conditions.
[1352] "Accommodation information" is detailed information about accommodation facilities such as hotels, inns, and guesthouses.
[1353] "Tourist attraction information" is information about tourist spots and famous places in a particular area.
[1354] The "means for integrating and transmitting to the terminal" is a function that allows the server to compile multiple pieces of information into one and transmit it to the terminal.
[1355] "Means for receiving a response from the server and visually presenting it to the user" is a function that allows the terminal to receive information sent from the server and display it in a form that is easy for the user to see.
[1356] MODE FOR CARRYING OUT THE INVENTION
[1357] The system of the present invention provides job information and local information based on the desired area and job type to users who want to continue working and enjoy leisure time after retirement. A specific embodiment of the system is described below.
[1358] The system's main hardware components are the user device and the back-end server, while the generative AI model and associated database are used as software components.
[1359] Users use the system by entering information about their desired region and occupation on a terminal. For example, they might enter "Nagano Prefecture tourist guide." The terminal is equipped with input interfaces such as a keyboard and touch screen, making operation easy.
[1360] The entered information is sent from the device to the server. The server receives this information and activates a generative AI model to search and extract job listings based on the entered criteria. Specifically, the server searches a job database (e.g., a general job database) and extracts job listings that match the criteria "Nagano Prefecture" and "tourist guide."
[1361] Next, the server uses the same generative AI model to search a local information database (e.g., a local area database) to extract information about accommodations and tourist attractions in the area. For example, it retrieves information about well-known accommodations and tourist attractions in Nagano Prefecture. This information includes details about accommodations (e.g., traditional Japanese inn, free Wi-Fi in all rooms, hot springs) and tourist attractions (e.g., Zenkoji Temple, meditation experience available).
[1362] The server combines this job information, accommodation information, and tourist attraction information to generate a single response message. This response message is sent from the server to the device. The device receives the response from the server and visually presents it to the user. For example, information such as "Tour guide wanted at resort facility (work three days a week)," "Traditional Japanese inn (free Wi-Fi in all rooms, hot springs)," and "Zenkoji Temple (meditation experience available)" may be displayed on the screen.
[1363] Examples of specific prompts include:
[1364] I would like to work as a tourist guide in Nagano Prefecture. Could you also give me information about local accommodations and tourist attractions?
[1365] This system not only gives users the opportunity to work in the area of their choice after retirement, but also provides information on accommodations and tourist attractions that they can enjoy during their stay. This is expected to enrich post-retirement life and contribute to resolving the labor shortage problem in rural areas.
[1366] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1367] Step 1:
[1368] The user inputs the desired area and job type into the terminal.
[1369] Input: The user types "Nagano Prefecture Tourist Guide" into the device.
[1370] Specific operation: The user enters the desired region and job type into the input form on the device and clicks the "Submit" button.
[1371] Output: Contains information entered into the terminal.
[1372] Step 2:
[1373] The terminal transmits the user's input information to the server.
[1374] Input: Information about "Nagano Prefecture" and "Tourist Guide" entered into the device.
[1375] Specific operation: The terminal converts input information into data packets and sends them over the network to the server.
[1376] Output: The server receives the packet and parses the information.
[1377] Step 3:
[1378] The server launches the generative AI model to search and extract job information based on the input criteria.
[1379] Input: Information about "Nagano Prefecture" and "Tourist Guide" sent to the server.
[1380] Specific operation: The server launches a generative AI model (e.g., GPT-3) and searches and extracts information corresponding to "Nagano Prefecture" and "tourist guide" from the job information database.
[1381] Data processing / calculation: Performs condition matching and filtering using an AI model.
[1382] Output: The extracted job information is stored on the server.
[1383] Step 4:
[1384] The server uses the generated AI model to search and extract local information.
[1385] Input: Regional information condition "Nagano Prefecture".
[1386] Specific operation: The server uses the generative AI model to search the local information database and extract accommodation information and tourist attraction information.
[1387] Data processing / calculation: Performs condition matching and data extraction processing using an AI model.
[1388] Output: Accommodation information and tourist attraction information are stored on the server.
[1389] Step 5:
[1390] The server integrates the job information and the area information, generates a response message, and sends it to the terminal.
[1391] Input: Extracted job listings, accommodation information, and tourist attraction information.
[1392] Specific behavior: The server combines and formats this information into a single response message.
[1393] Data processing / calculation: Generates message formats and integrates data.
[1394] Output: A response message is generated and sent to the terminal.
[1395] Step 6:
[1396] The terminal receives the response from the server and visually presents it to the user.
[1397] Input: The response message sent by the server.
[1398] Specific operation: The device receives the response message, analyzes the data, and performs the design and layout for the screen display.
[1399] Data processing / calculation: Analyzes messages and generates visual designs.
[1400] Output: Job information, accommodation information, and tourist attraction information are displayed on the user's screen.
[1401] Through these steps, users can obtain comprehensive information not only about job openings in their desired area and occupation, but also about accommodations and tourist attractions in the area.
[1402] (Application example 1)
[1403] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1404] Conventional job information systems mainly provide only job information based on the desired region and type of job to users who want to continue working and enjoying their leisure time after retirement, but have the problem of not being able to provide comprehensive local information that would help users adapt to their new living environment and enjoy fulfilling leisure time. In particular, to support diverse lifestyles after retirement, it is necessary to provide integrated information on local tourist attractions, accommodations, etc. in addition to job information that suits users.
[1405] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1406] In this invention, the server includes means for inputting information on a desired area and job type from a terminal, means for transmitting the input information to the server, means for the server to search for and extract job information based on the input conditions using a generative artificial intelligence model, means for transmitting the relevant job information to the terminal, means for presenting accommodation information and tourist attraction information in the relevant area, and means for the terminal to integrate and present job information in the food delivery industry and local information based on the input conditions. This enables a user to obtain appropriate food delivery job information in a desired area while simultaneously obtaining comprehensive information for enjoying life and sightseeing in that area.
[1407] A "terminal" is a device that allows a user to input information and transmit that information to a server. This includes mobile devices such as smartphones and tablets.
[1408] The "desired area" refers to the geographical location where the user wishes to obtain job information and local information.
[1409] "Occupation" refers to the type of work or industry that a user desires when seeking employment.
[1410] A "server" is a computer system that receives transmitted information, searches and processes data based on that information, and transmits the results to a terminal.
[1411] "Generative artificial intelligence models" refer to AI technologies used to search and extract job listings or local information based on user input, such as generative natural language processing models.
[1412] "Job Postings" means information about employment opportunities related to a particular geographic area or occupation.
[1413] "Accommodation information" refers to information about available accommodations, such as hotels and inns, where users can stay.
[1414] "Tourist attraction information" refers to information about places and spots within a particular area that are recommended for tourists to visit.
[1415] The "food delivery industry" refers to the service industry that delivers food and beverage orders to customers.
[1416] "Integrated presentation means" refers to a method or technique for bringing together multiple different types of information and visually presenting it to the user in an integrated form.
[1417] "Database" means an organized collection of information used to efficiently manage, search, and retrieve job and local information.
[1418] The system of the present invention provides users with integrated job information and area information based on their desired area and occupation to support their post-retirement life. This system is mainly composed of the following elements:
[1419] 1. User Input and Data Submission
[1420] Users use devices such as smartphones to input information about their desired area and job type. For example, if a user inputs "food delivery in Hokkaido," that information is sent from the device to the server.
[1421] 2. Data processing by the server
[1422] The server uses a generative AI model based on the received information to search and extract data. This generative AI model uses OpenAI's GPT-4. Specifically, the server processes the data as follows:
[1423] Extracting job information: The server searches and extracts relevant job information from the job database based on the desired area and job type.
[1424] Extracting local information: The server searches a local information database and extracts information about tourist attractions and accommodations in the area.
[1425] 3. Generating and Sending a Response
[1426] The server integrates the job information and local information, generates a response message, and sends it to the terminal, allowing the user to obtain both job information and tourist information at the same time.
[1427] 4. Presenting Information to the User
[1428] The terminal visually presents the response received from the server to the user, for example displaying the following information:
[1429] "Food delivery in Hokkaido (3 days a week)"
[1430] "Popular ramen restaurant in Sapporo"
[1431] "Night view spots of Mt. Hakodate"
[1432] Hardware and software used
[1433] Hardware: Smartphone (iOS or Android device)
[1434] software:
[1435] Generative AI model: OpenAI's GPT-4
[1436] Job Database: Real-time updated job information API for the food delivery industry
[1437] Local information database: Local information services such as TripAdvisor and Google Maps API
[1438] Prompt Sentence Examples
[1439] Here are some example prompts using GPS-4:
[1440] Based on the region and job type information you entered, extract the following information:
[1441] 1. Food delivery job information in your area
[1442] 2. Tourist attractions in the area
[1443] 3. Gourmet spots in the area
[1444] Input: Hokkaido Food Delivery
[1445] This allows users to obtain appropriate food delivery job information in their desired area, while also obtaining comprehensive information on how to enjoy living and sightseeing in that area.
[1446] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1447] Step 1:
[1448] The user uses a device such as a smartphone to enter information about the desired area and job type. The entered information (e.g., "Hokkaido food delivery") is sent from the device to the server.
[1449] Step 2:
[1450] Based on the information received, the server begins searching for job information based on the desired region and job type. At this point, the server uses a generative AI model (e.g., GPT-4) to search the job information database. As a result, "job information for food delivery in Hokkaido" is extracted.
[1451] Step 3:
[1452] The server searches the regional information database to retrieve information on tourist attractions and accommodations in the entered region. Specifically, information on tourist attractions and accommodations in Hokkaido is extracted.
[1453] Step 4:
[1454] The server then integrates the extracted job information with local information. In this process, the job information, tourist attraction information, and accommodation information are compiled into a user-friendly format.
[1455] Step 5:
[1456] The integrated information is sent from the server to the device, including information such as "Food delivery in Hokkaido (working three days a week)," "Popular ramen restaurants in Sapporo," and "Night view spots around Mount Hakodate."
[1457] Step 6:
[1458] The device analyzes the received information and visually presents it to the user, who then sees the integrated job and tourism information displayed on the device screen.
[1459] Step 7:
[1460] Based on the information provided, users can apply for suitable jobs or decide on tourist destinations, allowing them to simultaneously obtain suitable food delivery job information in their desired area as well as tourist and accommodation information for that area.
[1461] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1462] The system of the present invention provides job information, accommodation information, and tourist spot information based on the desired area and occupation to users who want to continue working and enjoying leisure time after retirement. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the system provides optimal information based on the user's emotions.
[1463] System Overview
[1464] 1. User Input and Data Submission
[1465] The user uses the terminal to input information about the desired area and job type. For example, the user inputs "tourist guide for Nagano Prefecture."
[1466] The terminal is responsible for transmitting this input information to the server.
[1467] 2. Emotion Recognition by Emotion Engine
[1468] As the user enters information, the device captures the user's voice and facial expressions.
[1469] The emotion engine analyzes this data to recognize the user's current emotional state. For example, if the user is relaxed, it will prioritize reassuring suggestions.
[1470] 3. Server-based data processing and emotion-based adjustments
[1471] The server uses the generative AI model to search for job listings based on the entered conditions and extract relevant information.
[1472] The server then adjusts job listings and local information based on the user's perceived emotions. For example, if the user is feeling stressed, it prioritizes job listings that offer a relaxing work environment.
[1473] 4. Providing local information
[1474] The server searches and extracts information about accommodations and tourist attractions in the relevant area from the local information database.
[1475] Based on the results of the emotion engine, the system selects the most suitable accommodation and tourist spot information. For example, if the user is looking for relaxation, the system will suggest accommodation in a quiet environment and tourist spots where they can relax.
[1476] 5. Response from the server to the terminal and presentation to the user
[1477] The server integrates the job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[1478] The device receives the response from the server and visually presents it to the user. For example, it displays information such as "Tour guide wanted for resort facility," "Quiet traditional Japanese inn," and "Zenkoji Temple where you can experience meditation."
[1479] What the program does (natural language explanation)
[1480] 1. User Input
[1481] The user inputs the desired area and job type into the terminal. For example, "Nagano Prefecture Tourist Guide" is input.
[1482] 2. Emotional Engine Activation
[1483] The device captures the user's voice and facial expressions, and the emotion engine analyzes them to recognize the user's current emotions.
[1484] 3. Data transmission
[1485] The device sends the user's input information and the emotion engine's analysis results to the server. For example, "Nagano Prefecture" and "tourist guide" are sent, along with the emotion information of a relaxed state.
[1486] 4. Extract and refine job listings
[1487] The server launches the generative AI model and searches the job database based on the input criteria. It extracts job listings for "tourist guides in Nagano Prefecture" that match the criteria.
[1488] Based on the results of the emotion engine, the most suitable job information for the user is selected on a priority basis.
[1489] 5. Providing and coordinating local information
[1490] The server searches the local information database and extracts information about accommodations and tourist attractions in the relevant area.
[1491] Taking into account the results of the emotion engine, accommodations and tourist spots that suit the user's emotions are selected.
[1492] 6. Generating and Sending the Response
[1493] The server integrates the job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[1494] 7. Presentation to the User
[1495] The device receives the response from the server and visually presents it to the user. For example, a user looking to relax might see suggestions such as "resort facility tour guide wanted," "quiet traditional Japanese inn," or "Zenkoji Temple where you can experience meditation."
[1496] In this way, the present invention provides an information provision function that takes into account the user's feelings, which will further enhance the way people work and spend their leisure time after retirement. It will also be effective in solving the problem of labor shortages in rural areas.
[1497] The processing flow will be explained below.
[1498] The system of the present invention provides job information, accommodation information, and tourist spot information based on the desired area and occupation to users who want to continue working and enjoying leisure time after retirement. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the system provides optimal information based on the user's emotions.
[1499] Program processing content (processing steps)
[1500] Step 1:
[1501] The user uses the terminal to input information about the desired area and job type. For example, the user inputs "tourist guide for Nagano Prefecture."
[1502] Step 2:
[1503] The terminal sends the entered information to the server. Specifically, the entered information "Nagano Prefecture" and "tourist guide" is sent.
[1504] Step 3:
[1505] The terminal activates sensors to capture the user's voice and facial expressions, and collects the user's emotional data.
[1506] Step 4:
[1507] An emotion engine analyzes the collected voice and facial expression data to recognize the user's current emotional state, for example, identifying that the user is relaxed.
[1508] Step 5:
[1509] The device sends the input information and the emotion engine's analysis results (emotion information) to the server. For example, the information "Nagano Prefecture," "tourist guide," and "relaxed state" is sent.
[1510] Step 6:
[1511] The server launches the generative AI model and searches the job database based on the input criteria, extracting job information related to tourist guides in Nagano Prefecture.
[1512] Step 7:
[1513] Based on the results of the emotion engine, the server prioritizes and selects job offers that are suited to the user's emotional state, for example, by selecting job offers that offer a work environment suited to a relaxed state.
[1514] Step 8:
[1515] The server searches the local information database and extracts information about accommodations and tourist attractions in the relevant area.
[1516] Step 9:
[1517] The server considers the results of the emotion engine and selects accommodations and tourist spots that suit the user's emotions. For users seeking relaxation, it will recommend quiet traditional Japanese inns and Zenkoji Temple where they can experience meditation.
[1518] Step 10:
[1519] The server generates a response by combining job listings, accommodation information, and tourist attraction information, and then organizes and formats each piece of information for presentation to the user.
[1520] Step 11:
[1521] The server sends the generated response to the terminal, which includes information on job openings, accommodations, and tourist attractions.
[1522] Step 12:
[1523] The device receives the response from the server and visually presents it to the user. For example, it displays information such as "Looking for a tourist guide for a resort facility," "Quiet traditional Japanese inn," and "Zenkoji Temple where you can experience meditation."
[1524] Step 13:
[1525] Users can review the information presented and decide on their next action, such as applying for a job, booking accommodation, or planning a trip, depending on their needs.
[1526] In this way, the present invention provides an information provision function that takes into account the user's feelings, which will further enhance the way people work and spend their leisure time after retirement. It will also be effective in solving the problem of labor shortages in rural areas.
[1527] Example 2
[1528] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1529] Current job information systems and tourism information systems provide information without considering the user's emotional state, resulting in low user satisfaction. Furthermore, information is provided based only on the user's desired region or occupation, and optimal information is not provided in response to the user's emotions. There is a need to address these issues.
[1530] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1531] In this invention, the server includes means for collecting voice and facial expression data of the user to analyze input information and emotions, means for analyzing the collected data and recognizing the emotional state of the user, and means for the server to adjust job information, accommodation information, and tourist attraction information based on the emotions, thereby making it possible to provide optimal job information and local information according to the user's emotions.
[1532] A "terminal" is an electronic device used by a user to enter and receive information.
[1533] "Input means" refers to a method or device for inputting information about the area and job type desired by the user into the terminal.
[1534] "Means for collecting voice and facial expression data" refers to functions and devices for capturing the user's voice, facial expressions, etc.
[1535] "Means for recognizing emotional state" refers to a method or software for analyzing collected voice and facial expression data to determine the user's emotional state.
[1536] A "server" is a central computing device that receives and processes collected and transmitted data.
[1537] A "generative artificial intelligence model" is an artificial intelligence software model that learns from large amounts of data and makes predictions and classifications for specific tasks.
[1538] "Job information" refers to information about employment opportunities provided to job seekers.
[1539] "Accommodation information" is information about accommodation locations that users can refer to when considering lodging.
[1540] "Tourist attraction information" is information about places that users visit or areas that they visit for sightseeing.
[1541] A "conditioning mechanism" is a method or algorithm for combining and prioritizing information based on input data and emotional data.
[1542] A "search and retrieval means" is a method or device for locating and retrieving information that meets specific criteria from a database.
[1543] Overall system overview
[1544] The system of this invention combines a terminal, a server, a generative AI model, and an emotion engine to provide users with job information, accommodation information, and tourist attraction information based on their desired area and job type. Furthermore, the emotion engine is used to recognize the user's emotional state and provide optimal information accordingly.
[1545] Hardware and software used
[1546] 1. Terminal
[1547] An electronic device that allows Yuga to input information and check the results. Specifically, a smartphone, tablet, or PC is used.
[1548] It also has a built-in camera and microphone that collects emotional data.
[1549] 2. Server
[1550] A central computing device for data processing and analysis, running generative AI models and searching databases.
[1551] 3. Generative AI Models
[1552] A software model that uses deep learning and machine learning. It learns from large amounts of data and generates optimal information based on user input conditions.
[1553] 4. Emotion Engine
[1554] Software that analyzes the user's voice and facial expressions to recognize their emotional state. The analysis results are sent to a server and the information provided is adjusted accordingly.
[1555] Data processing and calculation
[1556] 1. Data Collection
[1557] The device collects information about the user's desired area and occupation, and also uses a camera and microphone to collect the user's voice and facial expression data.
[1558] 2. Emotion analysis
[1559] The collected voice and facial expression data is sent to an emotion engine to analyze the user's emotional state, for example, to determine whether the user is relaxed.
[1560] 3. Data Transmission
[1561] The terminal transmits the user's input information and the emotion analysis results to the server.
[1562] 4. Search and extract job information
[1563] The server uses the generative AI model to search the job database based on the input conditions of region and job type, and extracts relevant job information.
[1564] 5. Searching and extracting local information
[1565] The server searches the local information database and extracts information on accommodations and tourist attractions in the relevant area.
[1566] 6. Coordination of Information
[1567] The server adjusts job information and local information based on the results of the emotion engine. For example, if the user is looking for relaxation, it will prioritize job information and accommodations with a relaxing environment.
[1568] 7. Generating and Sending a Response
[1569] The server integrates the adjusted job information, accommodation information, and tourist attraction information to generate a response and transmits it to the terminal.
[1570] 8. User Display
[1571] The terminal visually displays the received information to the user.
[1572] Examples and prompts
[1573] For example, if a user types "tourist guide in Nagano Prefecture" into their device and detects a relaxed emotion, the server will suggest job listings for tour guides with a relaxing work environment, along with suggestions for quiet traditional Japanese inns and relaxing tourist spots.
[1574] Prompt Sentence Examples
[1575] "For users who are looking for a relaxed job as a tour guide in Nagano Prefecture, we suggest job listings with relaxing work environments, quiet traditional Japanese inns, and tourist spots where you can experience meditation."
[1576] This system makes it possible to provide optimal information that takes into account the user's emotional state, enabling them to enrich their work and leisure time after retirement.
[1577] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1578] Step 1:
[1579] The user inputs desired conditions into the terminal. Specifically, the user inputs information about the desired area and job type into the terminal. For example, the user inputs "tourist guide for Nagano Prefecture." This input information is stored internally.
[1580] Input: The user enters the desired region and job type in text format into the device.
[1581] Output: Keep input information in the terminal
[1582] Step 2:
[1583] The device collects the user's voice and facial expression data. While the user is entering information, the device's camera and microphone capture the user's facial expressions and voice.
[1584] Input: User's voice and facial expressions
[1585] Output: Voice data and facial expression data
[1586] Step 3:
[1587] The device sends voice data and facial expression data to the emotion engine, which analyzes the data and recognizes the user's emotional state, for example, determining whether the user is relaxed or stressed.
[1588] Input: Voice data and facial expression data
[1589] Output: Perceived emotional state (e.g., relaxed)
[1590] Step 4:
[1591] The terminal transmits the input desired conditions and the recognized emotional state to the server. For example, the text information "Tourist guide of Nagano Prefecture" and the emotional information "Relaxed state" are transmitted to the server.
[1592] Input: Input information and emotional state
[1593] Output: Input information and emotional state sent to the server
[1594] Step 5:
[1595] The server uses the generative artificial intelligence model to search for job listings based on the input criteria. Specifically, the server searches a job listing database based on information such as "tourist guide for Nagano Prefecture" and extracts relevant job listings.
[1596] Input: Input conditions (region and occupation)
[1597] Output: Matching job postings
[1598] Step 6:
[1599] The server adjusts the job information based on the results of the emotion engine. Specifically, it selects the job information that best suits the user based on the recognized emotional state. For a user in a relaxed state, it prioritizes job information with a relaxing work environment.
[1600] Input: Applicable job posting and emotional state
[1601] Output: Adjusted job listings
[1602] Step 7:
[1603] The server searches the local information database and extracts information about accommodations and tourist attractions in the relevant area. Specifically, it collects information about various accommodations and tourist attractions in Nagano Prefecture.
[1604] Input: Applicable area (Nagano Prefecture)
[1605] Output: Accommodation and tourist information for the area
[1606] Step 8:
[1607] The server adjusts the local information based on the results of the emotion engine. Specifically, it selects accommodations and tourist spots that suit the user's emotional state. For users who want to relax, it suggests accommodations with quiet environments and tourist spots where they can relax.
[1608] Input: Accommodation and tourist attraction information, emotional state
[1609] Output: Tailored accommodation and attraction information
[1610] Step 9:
[1611] The server generates a response by integrating information on jobs, accommodations, and tourist attractions, making it possible to provide comprehensive information.
[1612] Input: Tailored job listings, accommodation listings, and tourist attraction listings
[1613] Output: Consolidated response message
[1614] Step 10:
[1615] The server sends the integrated response message to the device, which may include information such as "Looking for a tour guide for a resort facility," "Quiet traditional Japanese inn," and "Zenkoji Temple where you can experience meditation."
[1616] Input: Unified response message
[1617] Output: Response message sent to the terminal
[1618] Step 11:
[1619] The terminal receives the response message from the server and visually displays the received information to the user.
[1620] Input: Received response message
[1621] Output: Information visually presented to the user
[1622] (Application example 2)
[1623] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1624] Conventional job information systems do not provide personalized information based on the user's emotions. This makes it difficult for users to obtain information that meets their emotional needs, such as wanting to relax or reduce stress. In the food delivery field, too, there is a lack of restaurant and food suggestions that match the user's emotional state, preventing users from making satisfying choices.
[1625] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting information on the desired area and job type from a terminal, and means including an emotion engine that recognizes the user's emotions and provides optimal information based on the emotions. This makes it possible to provide optimal job information, accommodation information, and tourist attraction information based on the user's emotional state. Furthermore, the server includes means for launching a generative artificial intelligence model based on the input area and job type, and means for providing optimal restaurants and dishes in the corresponding area based on the user's emotional state, making it possible to present options that suit the user's emotions even in the food delivery field.
[1626] A "terminal" is an electronic device that allows a user to input information and communicate with a server.
[1627] "Information about desired area and type of job" is information about the area where the user wants to work and the type of job he or she wants to have.
[1628] The "means for inputting information" refers to a method or device for a user to use a terminal to input information about the desired area and job type.
[1629] The "means for transmitting information to a server" refers to a method or device for transmitting the input information on the desired area and job type from the terminal to the server.
[1630] "Means for a server to search and extract job information based on conditions entered using a generated AI model" means a method in which a server uses a generated AI model to search and extract job information from a database that matches the conditions entered by a user.
[1631] "Job Information" means open positions and details thereof for a particular geographic area and job type.
[1632] The "means for transmitting the relevant job information to the terminal" refers to a method or device for transferring the extracted job information from the server to the terminal.
[1633] The "means for presenting information about accommodation facilities and tourist attractions in the relevant area" refers to a method or device for presenting information about accommodation facilities and tourist attractions in the relevant area to the user.
[1634] An "emotion engine" is a device or software that analyzes a user's voice and facial expression data to recognize the user's current emotional state.
[1635] The "restaurant database with restaurant information and food information" is a database that stores detailed information about restaurants and the food they serve.
[1636] The "emotional state of the user" refers to the psychological state of the user, such as whether the user is relaxed or stressed.
[1637] The "means for providing optimal restaurants and dishes based on emotions" refers to a method or device for selecting and providing optimal restaurants and dishes in consideration of the user's emotional state.
[1638] The "means for integrating and transmitting information to a terminal" refers to a method or device for integrating job information, accommodation information, tourist attraction information, restaurant and food information, and transmitting the information to a terminal.
[1639] "Means for visually presenting to the user" refers to a method or device for displaying the provided information on the screen of a terminal.
[1640]
[1641] The present invention is a system with an information provision function that takes user emotions into consideration, and provides job information, accommodation information, tourist spot information, and optimal restaurant and food information based on the user's desired area and job type. This system is composed of the following hardware and software.
[1642] 1. User Input and Emotion Recognition
[1643] The server provides a means for users to input information about their desired region and occupation using a smartphone or smart glasses. When a user speaks, "Tourist guide for Nagano prefecture," the smartphone or smart glasses detects this information and sends it to the server. In addition, it captures the user's voice and facial expression data and recognizes the user's emotions using an emotion engine (e.g., OpenCV or Emotion API).
[1644] 2. Data processing by the server
[1645] The server launches a generative artificial intelligence model (e.g., GPT-3.5) based on the input conditions and searches a job information database. After extracting job listings for "tourist guides in Nagano Prefecture" that match the conditions, it prioritizes and provides job listings that best fit the user's emotions based on the results of the emotion engine.
[1646] The server then searches a local information database to extract information on accommodations and tourist attractions in the area, and provides information that best suits the user's emotional state. For example, if the user is looking to relax, the server suggests accommodations in quiet environments and tourist spots where they can relax.
[1647] 3. Application to food delivery field
[1648] The system of the present invention can also be applied to the food delivery field. Based on the user's desired type of food and emotional state, the server searches a database containing relevant restaurant and food information and selects the most suitable restaurant and food based on the user's emotions. For example, if the user is feeling stressed, the server will suggest restaurants that offer healthy food that will help relieve stress.
[1649] 4. Information integration and presentation
[1650] The server integrates information on job openings, accommodations, tourist attractions, restaurants, and cuisines, and sends it to the terminal. The terminal visually presents this information to the user. For example, "Looking for a tour guide for a resort facility," "A quiet traditional Japanese inn," "Zenkoji Temple where you can experience meditation," "A quiet restaurant that serves healthy pasta dishes," etc.
[1651] Prompt Sentence Examples
[1652] An example prompt for this application is:
[1653] The user is stressed and wants to eat Italian food. Suggest a restaurant with a quiet atmosphere where they can relax.
[1654] As described above, the present invention provides information that takes into account the user's emotions, making it possible to provide job information, local information, and food delivery information that better meets the user's needs. This system aims to increase user satisfaction and support a more comfortable lifestyle.
[1655] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1656] Step 1:
[1657] The user uses a smartphone or smart glasses to input information about the desired region and job type by voice. The input information could be, for example, "Tourist guide for Nagano Prefecture." The input voice information is converted into text data through a voice recognition engine.
[1658] Input: Audio information ("Nagano Prefecture Tourist Guide")
[1659] Output: Text data ("Nagano Prefecture Tourist Guide")
[1660] Step 2:
[1661] The device captures the user's voice and facial expression data and uses an emotion engine (e.g., OpenCV or Emotion API) to recognize the user's emotions, which are then classified as states such as relaxed, stressed, etc.
[1662] Input: Voice data and facial expression data
[1663] Output: Emotion data (relaxed, stressed, etc.)
[1664] Step 3:
[1665] The device sends the text data from step 1 and the emotion data from step 2 to the server, which then receives the user's desired information and emotion information.
[1666] Input: Text data, emotion data
[1667] Output: Data sent to the server
[1668] Step 4:
[1669] The server launches a generative AI model (e.g., GPT-3.5) and runs it based on the text data. The server then searches a job information database and extracts job listings for "tourist guides in Nagano Prefecture" that match the input criteria.
[1670] Input: Text data, job information database
[1671] Output: Relevant job information (e.g., "Resort facility tour guide wanted")
[1672] Step 5:
[1673] Based on the emotional data, the server prioritizes job offers that best suit the user's emotional state. For example, if the user is looking for relaxation, the server suggests workplaces with quiet environments.
[1674] Input: relevant job information, emotion data
[1675] Output: Optimized job listings
[1676] Step 6:
[1677] The server searches the local information database and extracts information on accommodations and tourist attractions in the area. In particular, it selects accommodations and tourist attractions that are relaxing and take into account the user's feelings.
[1678] Input: Region database, emotion data
[1679] Output: Applicable accommodation and tourist attraction information
[1680] Step 7:
[1681] The server searches a database containing relevant restaurant and food information and extracts the most suitable restaurant and food information based on the user's emotions. For example, if the user is feeling stressed, it will select restaurants that serve healthy food.
[1682] Input: Restaurant database, emotion data
[1683] Output: Best restaurant and food information
[1684] Step 8:
[1685] The server aggregates job information, accommodation information, tourist attraction information, restaurant and cuisine information, and generates a response, which is then sent to the terminal.
[1686] Input: Optimized job listings, accommodation information, tourist attractions, restaurants and cuisine information
[1687] Output: Consolidated response data
[1688] Step 9:
[1689] The device visually presents the integrated response data received from the server to the user, such as information such as "want a tour guide for a resort facility," "a quiet traditional Japanese inn," "Zenkoji Temple where you can experience meditation," and "a restaurant that serves healthy pasta dishes."
[1690] Input: Consolidated response data
[1691] Output: Visually presented information
[1692] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[1693] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1694] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.
[1695] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[1696] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.
[1697] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.
[1698] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).
[1699] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.
[1700] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."
[1701] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.
[1702] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).
[1703] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.
[1704] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.
[1705] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[1706] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.
[1707] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.
[1708] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.
[1709] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.
[1710] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.
[1711] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.
[1712] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.
[1713] The following is further disclosed regarding the above embodiment.
[1714] (Claim 1)
[1715] A means for inputting desired area and job type information from a terminal;
[1716] means for transmitting the input information to a server;
[1717] A means for the server to search and extract job information based on input conditions using a generated artificial intelligence model;
[1718] means for transmitting the relevant job information to the terminal;
[1719] a means of presenting accommodation and tourist attraction information in the area;
[1720] A system including:
[1721] (Claim 2)
[1722] A means for the server to search the job information database and extract job information;
[1723] The system further comprises a means for searching a local information database having accommodation information and tourist attraction information, and extracting relevant information.
[1724] 10. The system of claim 1.
[1725] (Claim 3)
[1726] A means for the server to start a generative artificial intelligence model based on the input region and occupation;
[1727] The information processing device further includes a means for integrating job information, accommodation information, and tourist attraction information and transmitting the integrated information to the terminal.
[1728] 10. The system of claim 1.
[1729] "Example 1"
[1730] (Claim 1)
[1731] A means for inputting desired area and job type information from a terminal;
[1732] means for transmitting the input information to a server;
[1733] A means for the server to search and extract job information based on the input conditions using the generated AI model;
[1734] A means for searching and extracting accommodation information and tourist attraction information in the relevant area from a local information database;
[1735] means for integrating job information, accommodation information, and tourist attraction information and transmitting the information to the terminal;
[1736] means for the terminal to receive a response from the server and visually present it to the user;
[1737] A system including:
[1738] (Claim 2)
[1739] A means for the server to search the job information database and extract job information;
[1740] A means for searching a local information database having accommodation information and tourist attraction information and extracting relevant information;
[1741] The server further comprises means for integrating the job information, accommodation information, and tourist attraction information to generate a response and transmit the response to the terminal.
[1742] 10. The system of claim 1.
[1743] (Claim 3)
[1744] A means for the server to activate a generative AI model based on the input region and occupation;
[1745] The terminal further comprises means for receiving a response from the server and visually presenting the response to the user.
[1746] 10. The system of claim 1.
[1747] "Application Example 1"
[1748] (Claim 1)
[1749] A means for inputting desired area and job type information from a terminal;
[1750] means for transmitting the input information to a server;
[1751] A means for the server to search and extract job information based on input conditions using a generated artificial intelligence model;
[1752] means for transmitting the relevant job information to the terminal;
[1753] a means of presenting accommodation and tourist attraction information in the area;
[1754] A means for displaying integrated job information and local information in the food delivery industry based on input conditions by the terminal;
[1755] A system including:
[1756] (Claim 2)
[1757] A means for the server to search the job information database and extract job information;
[1758] The system further comprises a means for searching a local information database having accommodation information and tourist attraction information, and extracting relevant information.
[1759] 10. The system of claim 1.
[1760] (Claim 3)
[1761] A means for the server to start a generative artificial intelligence model based on the input region and occupation;
[1762] The information processing device further includes a means for integrating job information, accommodation information, and tourist attraction information and transmitting the integrated information to the terminal.
[1763] 10. The system of claim 1.
[1764] "Example 2: Combining Emotion Engines"
[1765] (Claim 1)
[1766] A means for inputting desired area and job type information from a terminal;
[1767] means for collecting user voice and facial expression data for analyzing input information and emotions;
[1768] means for analyzing the collected data and recognizing the user's emotional state;
[1769] means for transmitting the input information and the recognized emotional state to a server;
[1770] A means for the server to search and extract job information based on input conditions using a generated artificial intelligence model;
[1771] a means for the server to adjust job information, accommodation information, and tourist attraction information based on the emotion;
[1772] means for transmitting the relevant job information, accommodation information, and tourist attraction information to the terminal;
[1773] A system including:
[1774] (Claim 2)
[1775] A means for the server to search the job information database and extract job information;
[1776] The system further comprises a means for searching a local information database having accommodation information and tourist attraction information, and extracting relevant information.
[1777] 10. The system of claim 1.
[1778] (Claim 3)
[1779] A means for the server to start a generative artificial intelligence model based on the input region and occupation;
[1780] The information processing device further includes a means for integrating job information, accommodation information, and tourist attraction information and transmitting the integrated information to the terminal.
[1781] 10. The system of claim 1.
[1782] "Application example 2 when combining emotion engines"
[1783] (Claim 1)
[1784] A means for inputting desired area and job type information from a terminal;
[1785] means for transmitting the input information to a server;
[1786] A means for the server to search and extract job information based on input conditions using a generated artificial intelligence model;
[1787] means for transmitting the relevant job information to the terminal;
[1788] a means of presenting accommodation and tourist attraction information in the area;
[1789] means including an emotion engine for recognizing the emotion of a user and providing optimal information based on the emotion;
[1790] A system including:
[1791] (Claim 2)
[1792] A means for the server to search the job information database and extract job information;
[1793] The system further comprises a means for searching a local information database having accommodation information and tourist attraction information, and extracting relevant information.
[1794] The system further includes a means for searching a restaurant database having relevant restaurant information and dish information, and providing the optimal restaurant and dish based on the emotion.
[1795] 10. The system of claim 1.
[1796] (Claim 3)
[1797] A means for the server to start a generative artificial intelligence model based on the input region and occupation;
[1798] The information processing device further includes a means for integrating job information, accommodation information, and tourist attraction information and transmitting the integrated information to the terminal.
[1799] The system further comprises a means for selecting optimal restaurants and dishes in the area based on the emotional state of the user and presenting the selected restaurants and dishes on the terminal.
[1800] 10. The system of claim 1. [Explanation of symbols]
[1801] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>
Claims
1. A means for inputting desired area and job type information from a terminal; means for transmitting the input information to a server; A means for the server to search and extract job information based on input conditions using a generated artificial intelligence model; means for transmitting the relevant job information to the terminal; a means of presenting accommodation and tourist attraction information in the area; A system including:
2. A means for the server to search the job information database and extract job information; The system further comprises a means for searching a local information database having accommodation information and tourist attraction information, and extracting relevant information. The system of claim 1 .
3. A means for the server to start a generative artificial intelligence model based on the input region and occupation; The information processing device further includes a means for integrating job information, accommodation information, and tourist attraction information and transmitting the integrated information to the terminal. The system of claim 1 .
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A