System
A system that matches elderly individuals with university students for dialogue and support, addressing loneliness and social experience gaps, enhances daily life support, and manages fees and procedures effectively.
Patent Information
- Application Number
- JP2024128402
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-02
- Publication Date
- 2026-02-16
AI Technical Summary
Elderly individuals often experience loneliness and require daily life support, while young people, especially university students, lack opportunities for rich social experiences and effective interaction.
A system that allows elderly individuals to input their requests and requirements, matches them with university students based on profiles, facilitates dialogue through generative AI, manages service fees, and supports administrative procedures.
Reduces feelings of loneliness among the elderly and provides young people with social experiences, while ensuring cost-effective and efficient service provision.
Smart Images

Figure 2026025593000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] In an aging society, the elderly often suffer from loneliness and inconveniences in daily life. Furthermore, relying on traditional nursing care services can be costly and lack personal interaction. Meanwhile, young people (especially university students) have limited opportunities to gain rich social experiences. In these circumstances, there is a need to provide a system that mutually benefits both the elderly and the young. [Means for solving the problem]
[0005] The present invention relates to a system that allows elderly people and young people to interact with each other and provide support for daily life. Specifically, the system includes an input means for elderly people to input their requests and requirements, an input means for university students to input their profiles and available services, a storage means for storing the requests and requirements of elderly people and the profiles of university students in a database, a matching means for selecting suitable university students based on the requests and requirements of elderly people, a notification means for sending a matching notification to the selected university students, a dialogue means for a generation AI to dialogue based on the voice data and personality information of the university students, and a log storage means for storing the dialogue log of the generation AI.
[0006] Furthermore, the present invention includes an income and expenditure management means for managing service usage fees for elderly people and app usage fees for university students, a remuneration calculation means for calculating university students' remuneration and determining payment information, and an administrative procedure support means for supporting administrative procedures so that elderly people can use nursing care insurance, etc. This reduces the sense of loneliness felt by elderly people and allows young people to gain rich social experience, while also making it possible to provide services cost-effectively.
[0007] "Elderly" refers to individuals who, due to their advancing age, require support and care in their daily lives.
[0008] "Young people" refers particularly to university students, and refers to individuals of a relatively young age who are in the process of gaining social experience.
[0009] "Input means" refers to the function that allows elderly people and university students to use a terminal to input their own information into the system.
[0010] A "profile" refers to a collection of data provided by a university student, including personal information and the services that can be provided.
[0011] "Storage means" refers to a function for storing input information in a recording medium such as a database.
[0012] "Matching methods" refer to algorithms and functions for selecting the optimal combination based on the requests and conditions of the elderly and the profiles of university students.
[0013] "Notification means" refers to the function for informing elderly people and university students of the matching results.
[0014] "Generative AI" is an artificial intelligence that can converse with elderly people based on voice data and personality information from university students.
[0015] "Dialogue means" refers to the function that enables the generative AI to communicate with the elderly through voice and messages.
[0016] "Log storage means" refers to the function for recording and saving the content of conversations with the generating AI.
[0017] "Income and expenditure management means" refers to functions for managing service fees and expenditures.
[0018] "Remuneration calculation means" refers to the functionality for calculating remuneration for university students and processing payment information.
[0019] "Administrative procedure support means" refers to functions that support procedures so that elderly people can use administrative services such as nursing care insurance. [Brief explanation of the drawings]
[0020] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0021] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0022] First, the terms used in the following description will be explained.
[0023] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0024] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0025] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0026] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0027] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0028] [First embodiment]
[0029] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0030] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0031] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0032] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0033] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0034] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0035] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0036] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0037] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0038] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0039] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0040] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0041] This invention is a system that matches elderly people with young people (especially university students) and supports their daily lives while eliminating feelings of loneliness. The system aims to reduce feelings of loneliness for elderly people and enable them to live fulfilling daily lives, while providing opportunities for young people to gain experience in the real world.
[0042] Program Overview
[0043] Registration Steps
[0044] 1. User (elderly)
[0045] Seniors use their devices to download the app and create an account.
[0046] Elderly people enter information such as their area of residence, hobbies, whether they have a car, and desired services (e.g., transportation, shopping accompaniment, conversation partner).
[0047] 2. Devices (elderly people's smartphones)
[0048] The information entered by the elderly person is converted into JSON format and sent to the server.
[0049] 3. Server
[0050] The server receives the information sent by the user and stores it in a database.
[0051] Similarly, university students (users) input their profile, schedule, and available services and send them to the server.
[0052] Matching Step
[0053] 1. Server
[0054] The requests of registered elderly people and the profiles of university students are obtained and a matching algorithm is run.
[0055] Generate a list of the most suitable college students as matching candidates.
[0056] 2. Server
[0057] The server then sends a notification to the potential matched university students, including basic information about the elderly person (e.g., residential area, desired services).
[0058] 3. Device (university student's smartphone)
[0059] The university student's terminal receives the matching notification and displays detailed information to the university student user.
[0060] 4. User (University Student)
[0061] College students can review the matching details and choose to accept or decline.
[0062] 5. Device (university student's smartphone)
[0063] The university student's selection is sent to the server.
[0064] 6. Server
[0065] The server receives the university student's selection and notifies the senior citizen if he or she accepts.
[0066] If a match is made, detailed service details and schedules will be provided to both parties.
[0067] Supported by generative AI
[0068] 1. Server
[0069] The server collects voice data and personality information from college students and trains a generative AI model.
[0070] If university students are absent, the generative AI will have the ability to automatically converse with the elderly.
[0071] 2. Users (elderly people)
[0072] Elderly people can interact with the generative AI through devices they are familiar with.
[0073] 3. Devices (elderly people's smartphones)
[0074] The elderly person's device activates the generation AI's dialogue function, and a dialogue between the generation AI and the elderly person begins.
[0075] 4. Server
[0076] The server stores the dialogue logs of the generated AI and uses them as training data for the next time.
[0077] Income and expenditure management and administrative procedure support
[0078] 1. Server
[0079] The server manages data on service usage fees for elderly people and app usage fees for university students.
[0080] Calculate compensation for college students and determine payment information.
[0081] 2. Users (elderly people)
[0082] Seniors can pay for services within the app.
[0083] 3. Devices (elderly people's smartphones)
[0084] The terminal transmits the payment information to the server.
[0085] 4. Server
[0086] After receiving payment confirmation, the server notifies the elderly person and, if necessary, supports administrative procedures for applying for nursing care insurance, etc.
[0087] This will allow the elderly to enjoy their daily lives more happily and youthfully, and young people to gain meaningful social experiences. Furthermore, the conversational support provided by generative AI will significantly reduce the sense of loneliness felt by the elderly.
[0088] The processing flow will be explained below.
[0089] Step 1:
[0090] Users (seniors) download the app using their devices and create an account. After creating the account, they log in and enter information such as their area of residence, hobbies, whether they have a car, and desired services (e.g., transportation, shopping accompaniment, conversation partner).
[0091] Step 2:
[0092] The terminal (elderly person's smartphone) converts the information entered by the elderly person into JSON format and sends it to the server.
[0093] Step 3:
[0094] The server receives the information sent by the user and stores it in a database. Similarly, university student users also input their profile, schedule, and available services and send them to the server.
[0095] Step 4:
[0096] The server retrieves the profiles of university students based on the elderly person's requests and conditions and runs a matching algorithm to generate a list of university students who best fit the elderly person's needs.
[0097] Step 5:
[0098] The server then sends a notification to the potential matched university students, including basic information about the elderly person (e.g., residential area, desired services).
[0099] Step 6:
[0100] The terminal (the university student's smartphone) receives the matching notification and displays detailed information to the university student user.
[0101] Step 7:
[0102] The user (college student) checks the matching details and chooses to accept or reject.
[0103] Step 8:
[0104] The terminal (the university student's smartphone) sends the student's selection to the server.
[0105] Step 9:
[0106] The server receives the student's selection and sends a notification to the elderly person if they accept. If a match is made, detailed service content and schedules are provided to both parties.
[0107] Step 10:
[0108] The server acquires the voice data and personality information of university students and trains the generative AI model, which then prepares a function for the generative AI to converse with the elderly when the university students are absent.
[0109] Step 11:
[0110] When the university student is not present, the user (elderly person) can interact with the generating AI through the terminal.
[0111] Step 12:
[0112] The device (elderly person's smartphone) activates the generative AI's dialogue function, and a dialogue between the generative AI and the elderly person begins.
[0113] Step 13:
[0114] The server stores the dialogue logs of the generated AI and uses them as training data for the future.
[0115] Step 14:
[0116] The server manages data on service fees for seniors and app fees for university students, calculates the university students' remuneration, and determines payment information.
[0117] Step 15:
[0118] Users (elderly people) can pay for the service within the app.
[0119] Step 16:
[0120] The terminal (elderly person's smartphone) sends payment information to the server.
[0121] Step 17:
[0122] After receiving payment confirmation, the server notifies the elderly person and, if necessary, supports administrative procedures for applying for nursing care insurance, etc.
[0123] Example 1
[0124] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0125] There is a need for a system that supports the elderly in their daily lives and prevents them from feeling lonely. At the same time, there are a lack of opportunities for young people to gain experience in the real world. Another issue is the lack of efficient and effective ways to match the elderly with young people. Furthermore, when university students are not available, it is important to find ways to alleviate the elderly's sense of loneliness. In addition, there is a need for a system that can comprehensively support income and expenditure management and assistance with administrative procedures.
[0126] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0127] In this invention, the server includes: an input means for elderly people to input their requests and requirements; an input means for young people to input their profile and available services; a storage means for storing the elderly people's requests and requirements and the young people's profiles in a database; a matching means for selecting an appropriate young person based on the elderly people's requests and requirements; a notification means for sending a matching notification to the selected young person; a dialogue means for the generative model to engage in dialogue based on the young person's voice data and personality information; a log storage means for storing the dialogue log of the generative model; and a service provision means for providing detailed service content and schedules for both the elderly and the young person. This makes it possible to reduce the elderly's sense of loneliness while providing young people with real-world experiences. Furthermore, elderly people can alleviate their loneliness through dialogue with the generative model even when their university students are away. Furthermore, by providing a system that comprehensively supports income and expenditure management and administrative procedures, more secure and convenient services can be realized.
[0128] "Elderly people" refers to people over a certain age who require a certain level of support in their daily lives and who may feel lonely.
[0129] "Young people" refers specifically to students and young adults seeking real-world experience.
[0130] "Input means" refers to an interface through which a user inputs specific information into the system.
[0131] "Storage means" refers to a component for recording and managing input information in a database.
[0132] "Matching methods" refer to algorithms and processes for selecting suitable young people based on the requests and conditions of older people.
[0133] "Notification means" refers to the method or system for sending the selection results and necessary information to matched young people.
[0134] A "generative model" refers to an artificial intelligence program that conducts dialogue based on young people's voice data and personality information.
[0135] "Dialogue method" refers to a method of using a generative model to enable natural language communication with the elderly.
[0136] "Log storage means" refers to a system or component for recording and storing the content and history of a conversation.
[0137] "Service provision means" refers to the method for providing detailed service content and schedule information to both the elderly and young people after a match is made.
[0138] "Income and expenditure management measures" refers to the systems and components that manage service fees for the elderly and app fees for young people.
[0139] "Remuneration calculation means" refers to a system or component for calculating a youth's compensation and determining payment information.
[0140] "Administrative procedure support measures" refers to systems and methods that support the procedures required for elderly people to access public assistance such as nursing care insurance.
[0141] MODE FOR CARRYING OUT THE INVENTION
[0142] The present invention is a system for matching elderly people with young people and supporting their daily lives. The purpose of this system is to reduce the sense of loneliness felt by elderly people and to provide young people with real-world experience. Specific embodiments of the system are described below.
[0143] 1. Registration Steps
[0144] Elderly information registration
[0145] User (elderly)
[0146] Seniors download a dedicated application onto their smartphones, create an account, and then enter their area of residence, hobbies, whether they have a car, and desired services (e.g., accompanying them on shopping trips, having someone to talk to, etc.).
[0147] Example: Elderly person A opens the app and fills out the form with "Tokyo," "reading," "none," and "accompany shopping."
[0148] Device (elderly person's smartphone)
[0149] The terminal converts the input information into JSON format and sends the information to the server.
[0150] server
[0151] The server stores the received information about the elderly person in a database.
[0152] Youth information registration
[0153] Users (young people)
[0154] Young people also download the app and create an account, filling out their profile and the services they can offer.
[0155] Devices (young people's smartphones)
[0156] The terminal converts the input information into JSON format and sends the information to the server.
[0157] server
[0158] The server stores the received information about the young people in a database.
[0159] 2. Matching step
[0160] server
[0161] The server runs a matching algorithm based on the elderly person's requests and the young person's profile information to generate a list of suitable young people, taking into account, for example, their area of residence and the services they can provide.
[0162] server
[0163] The server sends a notification to the potential matched young person, including basic information about the elderly person (e.g., residential area, desired services).
[0164] Devices (young people's smartphones)
[0165] The young person's device receives the notification and displays detailed information to the user.
[0166] Users (young people)
[0167] The young person reviews the match details and chooses to accept or decline.
[0168] Devices (young people's smartphones)
[0169] The selection results are sent to the server.
[0170] server
[0171] If the request is accepted, the server will notify the elderly person and officially establish a match. After the match is established, detailed service content and schedules will be provided to both parties.
[0172] 3. Generative AI support
[0173] server
[0174] The server receives voice data and personality information from young people and trains a generative AI model that automatically converses with the elderly when the young people are not present.
[0175] User (elderly)
[0176] Elderly people can interact with the generative AI through their smartphones.
[0177] Device (elderly person's smartphone)
[0178] The device activates the generation AI's dialogue function and begins a dialogue between the generation AI and the elderly person.
[0179] Specific operation: When elderly person A asks, "What book should I read today?", the generating AI responds, "I'll introduce you to the latest bestseller list."
[0180] server
[0181] The server stores the dialogue logs of the generated AI and uses them as training data for the next time.
[0182] 4. Income and expenditure management and administrative procedure support
[0183] server
[0184] The server manages the service fees for seniors and the app fees for young people, calculates the young people's rewards, and determines payment information.
[0185] User (elderly)
[0186] Seniors can pay for services within the app.
[0187] Device (elderly person's smartphone)
[0188] Send payment information to the server.
[0189] server
[0190] After payment is confirmed, a notification will be sent and support will be provided for administrative procedures such as nursing care insurance if necessary.
[0191] Example prompts for generative AI models
[0192] "A 70-year-old elderly person, Mr. A, would like to go shopping. Please accompany him. Mr. A lives in the XX area. Mr. A's hobby is reading."
[0193] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0194] Step 1:
[0195] Elderly information registration
[0196] User (elderly)
[0197] Seniors download the app using their smartphones, create an account, and then enter their area of residence, hobbies, whether they have a car, and desired services (e.g., shopping accompaniment, conversation partner, etc.).
[0198] Input: area of residence, hobbies, whether you have a car, desired service details
[0199] Output: User information in JSON format
[0200] Specific actions: Elderly person A opens the app and fills in the form with "Tokyo," "reading," "none," and "accompany shopping."
[0201] Device (elderly person's smartphone)
[0202] The terminal converts the input information into JSON format and sends the information to the server.
[0203] Input: Information entered by the user
[0204] Output: JSON information sent to the server
[0205] server
[0206] The server stores the received information about the elderly person in a database.
[0207] Input: JSON format information sent from the terminal
[0208] Output: User information stored in the database
[0209] Step 2:
[0210] Youth information registration
[0211] Users (young people)
[0212] Young people also download the app and create an account, filling out their profile and the services they can offer.
[0213] Input: Profile information, available services
[0214] Output: User information in JSON format
[0215] Devices (young people's smartphones)
[0216] The terminal converts the input information into JSON format and sends the information to the server.
[0217] Input: Information entered by the user
[0218] Output: JSON information sent to the server
[0219] server
[0220] The server stores the received information about the young people in a database.
[0221] Input: JSON format information sent from the terminal
[0222] Output: User information stored in the database
[0223] Step 3:
[0224] Executing the Matching
[0225] server
[0226] The server runs a matching algorithm based on the elderly person's requests and the young person's profile information to generate a list of the most suitable young people.
[0227] Input: Elderly person's request, young person's profile information
[0228] Output: A list of the best young people
[0229] Specific operation: The server analyzes Tanaka's request and lists the young people who are available and who best fit his / her requirements.
[0230] Step 4:
[0231] Sending matching notifications
[0232] server
[0233] The server then sends a notification to the potential matched young person, including basic information about the elderly person (e.g., their residential area and desired services).
[0234] Input: List of young people, basic information of elderly people
[0235] Output: Notification sent to the young person
[0236] Devices (young people's smartphones)
[0237] The young person's device receives the notification and displays detailed information.
[0238] Input: Notification from the server
[0239] Output: what is displayed to the user
[0240] Specific operation: A push notification is sent to the young person's device, displaying the message, "Elderly person A wants to accompany you shopping."
[0241] Step 5:
[0242] Youth Choice
[0243] Users (young people)
[0244] The young person reviews the match details and chooses to accept or decline.
[0245] Input: Match details
[0246] Output: Choice of Accept or Reject
[0247] Devices (young people's smartphones)
[0248] The terminal transmits the selection result to the server.
[0249] Input: Accept or reject
[0250] Output: Selection results sent to the server
[0251] Step 6:
[0252] Matching confirmation and service provision
[0253] server
[0254] If the request is accepted, the server will send a notification to the elderly person to confirm the match. After the match is established, detailed service content and schedules will be provided to both parties.
[0255] Input: Young people's choice results
[0256] Output: Notification to the elderly and detailed service content and schedule
[0257] Specific operation: After the matching is accepted, the server sends the service details and schedule to the elderly and young people.
[0258] Step 7:
[0259] Supported by generative AI
[0260] server
[0261] The server receives voice data and personality information from young people and trains a generative AI model, which then converses with the elderly when they are absent.
[0262] Input: Young people's voice data, personality information
[0263] Output: A trained generative AI model
[0264] User (elderly)
[0265] Elderly people can interact with the generative AI through their smartphones.
[0266] Input: Utterance
[0267] Output: AI response
[0268] Device (elderly person's smartphone)
[0269] The device activates the generation AI's dialogue function and begins a dialogue between the generation AI and the elderly person.
[0270] Input: Senior's voice / text
[0271] Output: Response from the generation AI
[0272] Specific behavior: In response to the question, "What book should I read today?", the generative AI responds, "I'll show you the latest bestsellers."
[0273] server
[0274] The server stores the dialogue logs of the generated AI and uses them as training data for the next time.
[0275] Input: Interaction log
[0276] Output: Saved log data
[0277] Step 8:
[0278] Income and expenditure management and administrative procedure support
[0279] server
[0280] The server manages the service fees for the elderly and the app fees for the young, calculates the young's remuneration, and determines payment information.
[0281] Input: Service usage data, app usage data
[0282] Output: Income and expenditure data, payment information
[0283] User (elderly)
[0284] Seniors can pay for services within the app.
[0285] Input: Payment Information
[0286] Output: Payment for the service
[0287] Device (elderly person's smartphone)
[0288] The terminal transmits the payment information to the server.
[0289] Input: Payment data
[0290] Output: Payment information sent to the server
[0291] server
[0292] After payment is confirmed, a notification will be sent and support will be provided for administrative procedures such as nursing care insurance if necessary.
[0293] Input: Payment Verification Information
[0294] Output: Notification to the elderly and administrative procedure support
[0295] (Application example 1)
[0296] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0297] In modern society, the sense of loneliness felt by older adults and the lack of support for daily life are serious issues. Furthermore, university students have limited opportunities to gain real-world experience, limiting their future opportunities for growth and contribution to society. Furthermore, there is a lack of support for meal preparation and delivery, which is particularly difficult for older adults, and this needs to be addressed.
[0298] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0299] In this invention, the server includes: an input means for elderly people to input their requests and requirements; an input means for university students to input their profiles and available services; a storage means for storing the elderly people's requests and requirements and the university students' profiles in a database; a matching means for selecting suitable university students based on the elderly people's requests and requirements; a notification means for sending a matching notification to the selected university students; a dialogue means for the generation AI to engage in dialogue based on the university students' voice data and personality information; a log storage means for saving the dialogue log of the generation AI; a request means for elderly people to order meals and request support; a receiving means for university students to receive meal-related requests from elderly people; and a delivery management means for managing meal orders and delivery. This allows elderly people to enrich their daily lives while alleviating feelings of loneliness, and allows university students to gain real-world experience. Furthermore, the quality of life of elderly people is improved, especially by providing more support for meal preparation and delivery.
[0300] "Elderly" refers to an older person who requires special assistance in daily life.
[0301] "University student" refers to a young person enrolled in a university who is studying academic or technical subjects.
[0302] "Input means" refers to a device or interface that allows a user to input information into a system.
[0303] "Storage means" refers to the technology or device used to store input information in a database.
[0304] "Matching means" refers to the algorithms and devices used to select the most suitable elderly people and university students based on the conditions within the system.
[0305] "Notification means" refers to the technology or device used to notify the target person of selected information.
[0306] "Generative AI" refers to artificial intelligence that uses machine learning technology to generate natural language and engage in dialogue.
[0307] "Interaction means" refers to the interface or technology that enables the generative AI to interact with the user.
[0308] "Log storage means" refers to technology or devices for storing records of interactions conducted by the generating AI.
[0309] "Request means" refers to the interface or device that allows elderly people to order meals or request assistance.
[0310] "Means of receipt" refers to the technology and equipment that university students use to receive requests from elderly people.
[0311] "Delivery management means" refers to systems and technologies for managing food order and delivery information.
[0312] This invention is a system that matches elderly people with university students and supports their daily lives while reducing feelings of loneliness. This system will be described below.
[0313] The server consists of an input means for elderly people to input their requests and requirements, an input means for university students to input their profile and the services they can provide, and a storage means for saving this information. Information on elderly people and university students is saved in a database and can be searched and updated as needed.
[0314] The matching means selects a university student who meets the elderly person's needs based on the information stored in the database. A matching notification is sent to the selected university student through the notification means. This allows the elderly person and the university student to be appropriately matched.
[0315] The generative AI provides a dialogue means for conversing with elderly people based on the voice data and personality information of university students. This dialogue means includes a log storage means for saving the dialogue log of the generative AI. The generative AI automatically converses with elderly people on behalf of university students when they are absent or busy.
[0316] The system also includes a requesting mechanism for seniors to order meals and request assistance, and a receiving mechanism for university students to receive those requests. This allows for efficient management of meal preparation and delivery for seniors. It also includes a delivery management mechanism for managing information on meal orders and delivery.
[0317] To implement this invention, cloud platforms such as AWS and Google Cloud are used for the servers, ensuring high scalability and reliability of the system. Relational databases such as PostgreSQL and MongoDB or NoSQL databases are used for the databases. Front-end applications are developed using cross-platform development frameworks such as React Native and Flutter.
[0318] The generative AI uses machine learning models such as GPT-4. To enable natural conversations with the elderly, the AI uses voice data from university students as training data. The content of the conversations the AI has is saved as a log and used as training data for the next round.
[0319] Examples:
[0320] If an elderly person, Person A, wants to buy ingredients for dinner, he or she will send a request using the app. This request will be received by University student Person B, who will purchase the appropriate ingredients based on Person A's request and deliver them to Person A's home. If the University student is busy, the generated AI will converse with Person A on his or her behalf to confirm the necessary information.
[0321] Example prompt sentence:
[0322] Prompt for the senior to type: "Can you please buy the ingredients for dinner next Monday?"
[0323] A prompt sentence that a university student converses with the generative AI on his / her behalf: "I'm going shopping now. Can you give me a list of what I'm going to buy?"
[0324] This will improve the quality of life for seniors, allow university students to gain social experience, and reduce feelings of loneliness among seniors through conversational support provided by generative AI.
[0325] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0326] Step 1:
[0327] The user (senior citizen) launches the app using their smartphone and inputs their requests and conditions (area of residence, hobbies, whether they have a car, desired service details, etc.). The input information is converted to JSON format and sent to the server. At this time, the input data includes text information about the area of residence, hobbies, and desired service details, and JSON format data is generated as the output.
[0328] Step 2:
[0329] Similarly, the device (university student) inputs their profile, schedule, and available services and sends the data to the server. In this process, the input data also includes text information about the profile, schedule, and available services, and the output data is generated in JSON format.
[0330] Step 3:
[0331] The server saves the input data of the elderly and university students in a database. The database manages this information and searches and updates it as needed. In doing so, it parses the JSON data received as input and saves it in the appropriate table. The status of the save confirmation is generated as output.
[0332] Step 4:
[0333] The server runs a matching algorithm based on the information stored in the database, selecting the university student who best suits the elderly person's needs and creating a list of match candidates. This process uses the elderly person's needs and the university student's profile as input data, applies the matching algorithm, and generates a list of match candidates as output.
[0334] Step 5:
[0335] The server sends a matching notification to the selected university students. The notification includes basic information about the elderly person (e.g., residential area, desired services). In this process, the list of matching candidates and related information are used as input data, and a notification message is generated as output.
[0336] Step 6:
[0337] The device (university student) receives the matching notification and displays detailed information. The university student checks the elderly person's information and inputs whether to accept or reject the match. At this time, detailed information is displayed and the university student's selection is made as input data, and the selection result is sent to the server as output.
[0338] Step 7:
[0339] The server receives the university student's selection results and notifies the elderly person if they accept. If a match is made, detailed service content and schedules are provided to both parties. The university student's selection results are used as input data, and service content and schedule information are generated as output.
[0340] Step 8:
[0341] The generative AI converses with the elderly based on the voice data and personality information of university students. The elderly provide input for the dialogue with the generative AI, which then generates an appropriate response based on that input. The elderly person asks a question as input, and the generative AI's response is displayed as output.
[0342] Step 9:
[0343] The dialogue log of the generation AI is saved by the server using a log saving means. The saved log is used as training data for the next training. At this time, the dialogue content of the generation AI is used as input data, and the dialogue log saved as output is generated.
[0344] Step 10:
[0345] Elderly people use a requesting tool to order meals or request assistance and send a request from their device. The request is received by a university student and output as an executable service. Meal order information is used as input data, and a notification of request receipt is generated as output.
[0346] Step 11:
[0347] The university student uses the receiving means to confirm the elderly person's request and delivers the meal through the delivery management means. The specific delivery schedule and delivery contents are managed and notified to the elderly person. The delivery schedule and delivery contents are used as input data, and a delivery completion report is generated as output.
[0348] Through these processing steps, the system can support the elderly in their daily lives and provide real-world experience to university students.
[0349] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0350] This invention relates to a system that matches elderly people with young people (especially university students) and supports their daily lives while eliminating feelings of loneliness using an emotion engine. The system aims to reduce feelings of loneliness for elderly people, enable them to live fulfilling daily lives, and provide opportunities for young people to gain experience in the real world. Furthermore, the emotion engine recognizes the user's emotions, providing more personalized services.
[0351] Program Overview
[0352] Registration Steps
[0353] 1. User (elderly)
[0354] Seniors use their devices to download the app and create an account.
[0355] Elderly people enter information such as their area of residence, hobbies, whether they have a car, and desired services (e.g., transportation, shopping accompaniment, conversation partner).
[0356] 2. Devices (elderly people's smartphones)
[0357] The information entered by the elderly person is converted into JSON format and sent to the server.
[0358] 3. Server
[0359] The server receives the information sent by the user and stores it in a database.
[0360] Similarly, university student users input their profile, schedule, and available services and send them to the server.
[0361] Matching Step
[0362] 1. Server
[0363] The requests of registered elderly people and the profiles of university students are obtained and a matching algorithm is run.
[0364] Generate a list of the most suitable college students as matching candidates.
[0365] 2. Server
[0366] The server then sends a notification to the potential matched university students, which includes basic information about the elderly person (e.g., residential area, desired services).
[0367] 3. Device (university student's smartphone)
[0368] The university student's terminal receives the matching notification and displays detailed information to the university student user.
[0369] 4. User (University Student)
[0370] College students can review the matching details and choose to accept or decline.
[0371] 5. Device (university student's smartphone)
[0372] The university student's selection is sent to the server.
[0373] 6. Server
[0374] The server receives the student's selection and sends a notification to the elderly person if they accept. If a match is made, detailed service content and schedules are provided to both parties.
[0375] Supported by generative AI
[0376] 1. Server
[0377] The server collects voice data and personality information from college students and trains a generative AI model.
[0378] If university students are absent, the generative AI will have the ability to automatically converse with the elderly.
[0379] 2. Users (elderly people)
[0380] Elderly people can interact with the generative AI through devices they are familiar with.
[0381] 3. Devices (elderly people's smartphones)
[0382] The elderly person's device activates the generation AI's dialogue function, and a dialogue between the generation AI and the elderly person begins.
[0383] 4. Server
[0384] The server stores the dialogue logs of the generated AI and uses them as training data for the next time.
[0385] Emotion engine integration
[0386] 1. Server
[0387] The server analyzes the emotional state of the elderly person using an emotion engine, which has the ability to recognize the user's emotions from voice and text data.
[0388] 2. Means of interaction
[0389] The emotion engine dynamically adjusts the dialogue content for the elderly based on their emotional state. For example, if the elderly feels sad, it will offer words of encouragement or topics to cheer them up.
[0390] 3. Log storage method
[0391] Emotion data analyzed by the emotion engine is stored along with the dialogue log, allowing the generative AI to deliver more personalized dialogue based on past emotional data.
[0392] Income and expenditure management and administrative procedure support
[0393] 1. Server
[0394] The server manages data on service fees for seniors and app fees for university students, calculates the university students' remuneration, and determines payment information.
[0395] 2. Users (elderly people)
[0396] Seniors can pay for services within the app.
[0397] 3. Devices (elderly people's smartphones)
[0398] The terminal transmits the payment information to the server.
[0399] 4. Server
[0400] After receiving payment confirmation, the server notifies the elderly person and, if necessary, supports administrative procedures for applying for nursing care insurance, etc.
[0401] As a result, a system integrating an emotion engine can analyze the emotional state of elderly people and provide more personalized dialogue and support, significantly reducing their sense of loneliness and helping them live richer lives.
[0402] The processing flow will be explained below.
[0403] Step 1:
[0404] Users (seniors) download the app using their devices and create an account. After creating the account, they log in and enter information such as their area of residence, hobbies, whether they have a car, and desired services (e.g., transportation, shopping accompaniment, conversation partner).
[0405] Step 2:
[0406] The terminal (elderly person's smartphone) converts the information entered by the elderly person into JSON format and sends it to the server.
[0407] Step 3:
[0408] The server receives the information sent by the user and stores it in a database. Similarly, university student users input their profile, schedule, and available services and send them to the server.
[0409] Step 4:
[0410] The server retrieves the profiles of university students based on the elderly person's requests and conditions and runs a matching algorithm to generate a list of university students who best fit the elderly person's needs.
[0411] Step 5:
[0412] The server then sends a notification to the potential matched university students, which includes basic information about the elderly person (e.g., residential area, desired services).
[0413] Step 6:
[0414] The terminal (the university student's smartphone) receives the matching notification and displays detailed information to the university student user.
[0415] Step 7:
[0416] The user (college student) checks the matching details and chooses to accept or reject.
[0417] Step 8:
[0418] The terminal (the university student's smartphone) sends the student's selection to the server.
[0419] Step 9:
[0420] The server receives the student's selection and notifies the elderly person if they accept. If a match is made, detailed service content and schedules are provided to both parties.
[0421] Step 10:
[0422] The server collects the voice data and personality information of university students and trains the generative AI model. When the university students are absent, the generative AI prepares a function to automatically converse with the elderly.
[0423] Step 11:
[0424] When the university student is not present, the user (elderly person) can interact with the generating AI through the terminal.
[0425] Step 12:
[0426] The device (elderly person's smartphone) activates the Generative AI's dialogue function and begins a dialogue between the Generative AI and the elderly person. At that time, the Generative AI uses the elderly person's voice and text data to perform emotion analysis using its emotion engine.
[0427] Step 13:
[0428] The server stores the dialogue logs generated by the generation AI and the emotion analysis data generated by the emotion engine, and uses these as training data for the next time.
[0429] Step 14:
[0430] The server uses an emotion engine to analyze the elderly person's emotional state and dynamically adjust the dialogue content, for example, if the elderly person feels sad, it will provide words of encouragement or topics to cheer them up.
[0431] Step 15:
[0432] The server manages data on service fees for seniors and app fees for university students, calculates the university students' remuneration, and determines payment information.
[0433] Step 16:
[0434] Users (elderly people) can pay for the service within the app.
[0435] Step 17:
[0436] The terminal (elderly person's smartphone) sends payment information to the server.
[0437] Step 18:
[0438] After receiving payment confirmation, the server notifies the elderly person and, if necessary, supports administrative procedures for applying for nursing care insurance, etc.
[0439] Example 2
[0440] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0441] In modern society, elderly people face serious problems such as loneliness and lack of support for daily life. It is not easy for them to properly communicate their needs and requirements and match them with the right support provider. Furthermore, there is a lack of services that cater to the emotional state of the elderly, leaving many elderly people seeking mental health care. Meanwhile, young people have fewer opportunities to gain real-world experience and lack social involvement. Therefore, there is a need for a system that can properly match elderly people with young people and provide personalized services based on emotion recognition.
[0442] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0443] In this invention, the server includes: an input means for the elderly to input their requests and requirements; an input means for the young person to input their profile and the services they can provide; a storage means for storing the elderly's requests and requirements and the young person's profile in a database; a matching means for selecting an appropriate young person based on the elderly's requests and requirements; a notification means for sending a matching notification to the selected young person; a dialogue means for the generation AI to engage in a dialogue based on the young person's voice data and personality information; a log storage means for saving the dialogue log of the generation AI; an emotion analysis means for analyzing the emotional state of the elderly using an emotion engine; and a dialogue adjustment means for adjusting the dialogue content based on the emotion analysis results. This makes it possible to reduce the elderly's sense of loneliness and provide personalized emotional support while providing young people with opportunities to gain experience in the real world.
[0444] "Input means" refers to devices or interfaces that allow older people and younger people to input information such as their needs, profiles, and available services.
[0445] The "storage means" is a function or device for storing the requests and conditions of the elderly and the profile information of the young people in a database.
[0446] The "matching means" refers to the algorithms and processing functions for selecting the most suitable young person based on the elderly person's requests and conditions.
[0447] The "notification means" is a function or device for sending a notification regarding a match to the selected young person.
[0448] "Dialogue means" refers to a function or device that enables the generation AI to engage in dialogue with the elderly based on the voice data and personality information of the young person.
[0449] "Log storage means" refers to a function or device for storing a log of the dialogue conducted by the generation AI.
[0450] The "emotion analysis means" is a function or device for analyzing the emotional state of the elderly person using an emotion engine.
[0451] The "dialogue adjustment means" is a function or device for dynamically adjusting the dialogue content provided to the elderly based on the emotion analysis results.
[0452] The "income and expenditure management means" is a function or device for managing service usage fees for the elderly and app usage fees for young people.
[0453] A "remuneration calculation means" is a function or device for calculating a youth's remuneration and determining payment information.
[0454] "Administrative procedure support means" refers to a function or device that supports administrative procedures so that elderly people can use nursing care insurance, etc.
[0455] The present invention is a system that matches elderly people with young people, alleviates feelings of loneliness using an emotion engine, and supports daily life. The system includes the following means.
[0456] Registration method
[0457] Elderly and young people use devices such as smartphones to input their respective requests, profiles, and available services. For example, elderly people input their residential area, hobbies, and desired services (e.g., transportation, shopping accompaniment, conversation partner). Meanwhile, young people input their own profiles, schedules, and available services. This information is converted into JSON format by the device and sent to the server as an HTTP POST request.
[0458] Preservation means
[0459] The server analyzes the received JSON data and stores it in a database, allowing the requests and conditions of the elderly and the profile information of the young people to be managed in a unified manner.
[0460] Matching Method
[0461] The server retrieves the elderly person's needs and the young person's profile from the database and runs a matching algorithm that generates a list of suitable young people using criteria such as geographical proximity and similar interests, thereby selecting the young person who best suits the elderly person's needs.
[0462] Notification means
[0463] The server then sends a push notification to the selected young person, which includes basic information such as the elderly person's residential area and desired service. The young person receives the notification on their smartphone and checks the detailed information.
[0464] Interaction methods
[0465] The generative AI will converse with the elderly based on the younger person's voice data and personality information. For example, if the younger person is not present, the generative AI will automatically ask the elderly questions such as, "How was your day?" The elderly can enjoy everyday conversations through the generative AI.
[0466] Log storage method
[0467] The server stores the logs of the conversations that the AI has had and uses them as training data for the next time. This allows the AI to provide more personalized conversations based on past conversation data.
[0468] Emotion analysis means
[0469] An emotion engine is used to analyze the emotional state of the elderly person from their voice and text data, for example, by analyzing their tone of voice and word choice to determine their emotional state.
[0470] Dialogue coordination means
[0471] The server dynamically adjusts the dialogue content based on the results of emotion analysis. For example, if an elderly person appears sad, the AI generator can be configured to offer encouraging words.
[0472] Income and expenditure management methods
[0473] The server manages the service fees for seniors and the app fees for young people. The server calculates the remuneration for young people and determines payment information.
[0474] Administrative procedure support tools
[0475] The server supports administrative procedures so that elderly people can use nursing care insurance, etc. The server collects necessary information and assists elderly people in the appropriate procedures.
[0476] Specific examples
[0477] As a concrete example of how this works, the following prompt might be entered:
[0478] Elderly Registration Procedure:
[0479] 1. Seniors download the app on their smartphones and click the "Sign Up" button.
[0480] 2. Enter your name, age, address, hobbies, and desired service (e.g., accompanying you shopping), then press the "Submit" button.
[0481] Matching Procedure:
[0482] 1. The server retrieves the elderly person's preferences and the young person's profile data and uses an algorithm to perform the best match.
[0483] 2. A "new match notification" will be sent to the young person's smartphone, and when the user opens the app, detailed information will be displayed.
[0484] 3. When the young person clicks the consent button, the selection information is sent to the server and the elderly person is notified.
[0485] Generative AI support:
[0486] 1. If the younger person is not present, the generating AI will ask the older person, "How are you doing lately?"
[0487] 2. If the elderly person answers, "I feel a little lonely," the generating AI continues, "What do you like to do when you feel lonely?"
[0488] Through these aspects, the present invention can significantly reduce the sense of loneliness felt by the elderly and provide a valuable opportunity for young people to gain real-world experience.
[0489] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0490] Step 1:
[0491] User (elderly)
[0492] Seniors use their smartphones to download the app and create an account.
[0493] Input: Name, age, address, hobbies, desired service (e.g., shopping accompaniment)
[0494] Action: Enter the required information on the app's sign-up screen and press the "Submit" button.
[0495] Output: The user's basic information is saved on the device and converted to JSON format in the next step.
[0496] Step 2:
[0497] Device (elderly person's smartphone)
[0498] The information entered by the user is converted into JSON format and sent to the server as an HTTP POST request.
[0499] Input: Basic information entered by the user (name, age, address, hobbies, desired service)
[0500] Behavior: Converts input data into JSON format and sends it to the server.
[0501] Output: JSON formatted data is sent to the server.
[0502] Step 3:
[0503] server
[0504] Parse the received JSON data and save it in the database.
[0505] Input: Basic information data of elderly people in JSON format
[0506] What it does: Parses JSON data and stores it in a database. It performs the parsing process and maps each field to the appropriate database column.
[0507] Output: Basic information of the elderly is saved in the database.
[0508] Step 4:
[0509] User (younger people)
[0510] Young people fill out their profile and the services they can offer.
[0511] Input: Name, age, address, hobbies, available services (e.g. conversation partner, shopping accompaniment)
[0512] Action: Enter the required information on the app's sign-up screen and press the "Submit" button.
[0513] Output: The user's basic information is saved on the device and converted to JSON format in the next step.
[0514] Step 5:
[0515] Devices (young people's smartphones)
[0516] The information entered by the young person is converted into JSON format and sent to the server as an HTTP POST request.
[0517] Input: Basic information entered by the young person (name, age, address, hobbies, available services)
[0518] Behavior: Converts input data into JSON format and sends it to the server.
[0519] Output: JSON formatted data is sent to the server.
[0520] Step 6:
[0521] server
[0522] Parse the received JSON data and save it in the database.
[0523] Input: Basic information data of young people in JSON format
[0524] What it does: Parses JSON data and stores it in a database. It performs the parsing process and maps each field to the appropriate database column.
[0525] Output: Basic information about the young person is saved in the database.
[0526] Step 7:
[0527] server
[0528] The database retrieves the elderly person's requests and the young person's profile, and then runs a matching algorithm.
[0529] Input: Elderly requests and young people's profiles stored in a database
[0530] How it works: It uses an algorithm to match people based on criteria such as geographic proximity or shared interests.
[0531] Output: Generate a list of the most suitable young people.
[0532] Step 8:
[0533] server
[0534] Push notifications are sent to selected young people.
[0535] Input: List of most suitable young people, basic information of elderly people
[0536] How it works: A push notification is generated and sent to the selected young person, including the senior's location and desired services.
[0537] Output: A notification is sent to the young person's smartphone.
[0538] Step 9:
[0539] Devices (young people's smartphones)
[0540] Receive notifications and view more information.
[0541] Input: Push notification from the server
[0542] What it does: The app receives a notification and displays more information to the user.
[0543] Output: A screen will be displayed where the user (young person) can review the details and choose to accept or decline.
[0544] Step 10:
[0545] User (younger people)
[0546] Review the details and accept or reject the match.
[0547] Input: Match details
[0548] Action: The young person operates the screen and chooses whether to accept or reject the request. To accept, they click the "Accept" button, and to reject, they click the "Reject" button.
[0549] Output: An accept or reject choice is created and sent to the server in the next step.
[0550] Step 11:
[0551] Devices (young people's smartphones)
[0552] The accept or reject choice is sent to the server.
[0553] Input: Accept or reject selection information
[0554] What it does: Sends the selection to the server as an HTTP POST request.
[0555] Output: The accept or reject choice is sent to the server.
[0556] Step 12:
[0557] server
[0558] The younger person's selection is received and, if accepted, a notification is sent to the older person.
[0559] Input: Young person's consent or denial selection information
[0560] What it does: Parse the selection and, if accepted, generate and send a push notification to the senior.
[0561] Output: If accepted, a match confirmation notification is sent to the senior.
[0562] Step 13:
[0563] server
[0564] The generative AI trains the dialogue module based on young people's voice data and personality information.
[0565] Input: Young person's voice data and personality information
[0566] How it works: A generative AI model is used to analyze young people's voice data and personality information, which is then used as training data.
[0567] Output: A trained generative AI model
[0568] Step 14:
[0569] User (elderly)
[0570] Elderly people can interact with the generating AI through the devices they use.
[0571] Input: Senior voice or text input
[0572] How it works: Dialogue is conducted in real time using generative AI. For example, the generative AI asks, "How are you doing lately?"
[0573] Output: Dialogue data between the elderly person and the generative AI
[0574] Step 15:
[0575] Device (elderly person's smartphone)
[0576] Activate the generation AI's dialogue function and begin the dialogue.
[0577] Input: Voice or text input by seniors
[0578] Behavior: Recognizes input and initiates a dialogue with the generative AI.
[0579] Output: Voice or text data during the conversation
[0580] Step 16:
[0581] server
[0582] The conversation logs of the generating AI are saved and used as training data for the next time.
[0583] Input: Conversation log between the generative AI and the elderly person
[0584] What it does: Saves the conversation log to a database and uses it for the next generative AI training.
[0585] Output: Saved interaction logs
[0586] Step 17:
[0587] server
[0588] An emotion engine is used to analyze the emotional state of the elderly and dynamically adjust the dialogue content.
[0589] Input: Elderly person's voice or text data
[0590] How it works: Analyzes data using an emotion engine to determine emotional state.
[0591] Output: Dialogue based on emotional state
[0592] Step 18:
[0593] server
[0594] Manages service fees for the elderly and app fees for young people and calculates rewards.
[0595] Input: Service usage history of elderly people, service provision history of young people
[0596] Operation: Manages usage fees and calculates remuneration using the financial management tool. Determines payment information and notifies the senior.
[0597] Output: User fee management information for elderly people, reward information for young people
[0598] Step 19:
[0599] server
[0600] We support administrative procedures so that elderly people can use nursing care insurance and other services.
[0601] Input: Elderly user status, necessary administrative procedures
[0602] Function: Collects necessary information and assists with application procedures for nursing care insurance, etc.
[0603] Output: Supporting information for administrative procedures
[0604] Through these concrete steps, the system can reduce loneliness among older people and provide real-world experience for younger people.
[0605] (Application example 2)
[0606] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0607] There is a need for a system that can effectively support elderly people in their daily lives and alleviate their feelings of loneliness. Strengthening security for elderly people is also important, and it is desirable to be able to quickly detect and respond to any abnormalities related to this. Furthermore, simplifying the procedures and cost management for receiving this support is also a challenge.
[0608] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: input means for the elderly person to input their requests and requirements; input means for the user to input their profile and available services; storage means for storing the elderly person's requests and requirements and the user's profile in a database; matching means for selecting an appropriate user based on the elderly person's requests and requirements; notification means for sending a matching notification to the selected user; dialogue means for the generation AI to engage in dialogue based on the user's voice data and personality information; log storage means for saving the dialogue log of the generation AI; analysis means for analyzing the elderly person's emotional state using an emotion engine; adjustment means for dynamically adjusting the dialogue content for the elderly person based on the analysis results; and abnormality notification means for sending a notification when a security-related abnormality is detected. This makes it possible to reduce the elderly person's sense of loneliness, support their daily lives, and strengthen security.
[0609] "Elderly" refers to people who are getting older and require support from others and professional help.
[0610] "Requests and conditions" refer to the matters and requests that are necessary for elderly people to receive life support and interactive services.
[0611] "Users" are all people who use the system, including young people and students, who provide services to support the elderly in particular.
[0612] "Profile" refers to information that describes a user's basic personal information, qualifications, and the services that can be provided.
[0613] "Database" refers to a system for effectively managing stored information and making it easy to search and reference.
[0614] "Matching" refers to the process of matching the requests, conditions, and profile information of elderly people and users to find the optimal match.
[0615] "Notification" refers to the system sending a message to the selected user to inform them of the matching result.
[0616] "Generative AI" refers to artificial intelligence technology that generates dialogue based on a user's voice data and personality information.
[0617] "Emotion engine" refers to technology for analyzing a user's emotional state from voice and text data.
[0618] "Analysis results" refers to information about the user's emotional state analyzed by the emotion engine.
[0619] "Abnormal" refers to an unusual emotional state or security issue, often a situation that requires immediate attention.
[0620] "Security" refers to protective and conservation measures to ensure that elderly people can live in peace.
[0621] "Log" refers to recorded data such as past interactions and system operation history.
[0622] "Notification means" refers to methods or functions for notifying specific people or systems of abnormalities or important information.
[0623] "Adjustment means" refers to a function that enables the system to dynamically change the content of dialogue and the content of services according to the needs of the user.
[0624] The present invention relates to a system for relieving the sense of loneliness of elderly people, supporting their daily lives, and strengthening security. This system aims to provide an environment in which elderly people can live with peace of mind.
[0625] System configuration
[0626] Hardware
[0627] Smartphones: Devices used by the elderly, used as a means of input and communication.
[0628] Server: Hosts the database, generative AI models, and emotion engine.
[0629] Sensors: Sensors to monitor the elderly person's environmental variables as needed (e.g., temperature and humidity sensors).
[0630] software
[0631] Emotion engine: Voice analysis technology using NVIDIA DeepStream SDK.
[0632] Generative AI model: A dialogue generation engine using OpenAI's GPT-3.
[0633] Database: AWS RDS is used.
[0634] Data processing and calculation
[0635] The server stores the input information of the elderly and users (in this case, young people and students) in a database and performs matching based on this information. The emotional state of the elderly is analyzed using an emotion engine, and the generation AI engages in dialogue as necessary. The detailed process of the system is explained below.
[0636] 1. Data Collection
[0637] Elderly people use their smartphones to input their requests and conditions (such as their residential area, hobbies, desired service content, etc.) This information is converted into JSON format and sent to the server.
[0638] 2. Storage of Information
[0639] The server stores the elderly's requests and conditions, as well as user profile information (qualifications, available services, etc.) in a database.
[0640] 3. Matching
[0641] The server matches the elderly person's requests and conditions with the user's profile to find the best match, and sends a match notification to the selected user.
[0642] 4. Emotion analysis
[0643] The emotion engine analyzes the emotional state of elderly people from their daily conversations and voice data, and this emotional state data is stored on a server.
[0644] 5. Generative AI Dialogue
[0645] If an abnormality in the elderly person's emotional state is detected, a generative AI model (GPT-3) generates a dialogue to provide reassurance. Specific prompt examples:
[0646] "You seem a little down, is there something bothering you?"
[0647] 6. Data storage and abnormality notification
[0648] The conversation logs with the generative AI are stored in a database and used as training data for the next round. If the emotion engine detects an abnormality, it will send a notification to relatives or a monitoring center. The notification will include the current emotional state and past logs.
[0649] This will help reduce the sense of loneliness among the elderly, support them in their daily lives, and strengthen security.
[0650] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0651] Step 1:
[0652] input:
[0653] Elderly people use their smartphones to input their requests and conditions (e.g., area of residence, hobbies, desired services).
[0654] process:
[0655] The terminal converts the input information into JSON format and sends it to the server.
[0656] output:
[0657] The elderly person's requests and requirements are sent to the server.
[0658] Specific behavior:
[0659] Seniors access the app on their smartphones, enter their details into various input fields, and press the submit button. This information is encoded in JSON format by the smartphone app and sent to the server's API.
[0660] Step 2:
[0661] input:
[0662] The user (university student) uses a smartphone to enter their profile and the services that can be provided.
[0663] process:
[0664] The terminal converts the input information into JSON format and sends it to the server.
[0665] output:
[0666] The user's profile and information about available services are sent to the server.
[0667] Specific behavior:
[0668] A user (a university student) accesses the smartphone app, enters details into various input fields, and presses the submit button. This information is encoded into JSON format by the smartphone app and sent to the server's API.
[0669] Step 3:
[0670] input:
[0671] The elderly person's requests and conditions, as well as the user's profile information, are sent to the server.
[0672] process:
[0673] The server stores this information in a database.
[0674] output:
[0675] The elderly's requests and conditions, as well as user profile information, are stored in a database.
[0676] Specific behavior:
[0677] The server parses the received JSON data, extracts each field, and stores it in a database using AWS RDS.
[0678] Step 4:
[0679] input:
[0680] The elderly's requests and conditions, as well as user profile information, are stored in a database.
[0681] process:
[0682] The server runs a matching algorithm to select suitable users based on the elderly person's needs and requirements.
[0683] output:
[0684] A list of matched users.
[0685] Specific behavior:
[0686] The server retrieves the elderly's requests and conditions and user profile information from the database, then runs a matching algorithm to select the most suitable user. It compares each request and condition and lists users with the highest match.
[0687] Step 5:
[0688] input:
[0689] A list of matched users.
[0690] process:
[0691] The server sends a match notification to the selected users.
[0692] output:
[0693] A notification is sent to the user's device.
[0694] Specific behavior:
[0695] The server sends a notification to each user's smartphone based on the list of matched users, which includes basic information about the elderly person (e.g., residential area, desired service).
[0696] Step 6:
[0697] input:
[0698] A match notification sent to the user's device.
[0699] process:
[0700] The user (university student) checks the notification and chooses to accept or decline.
[0701] output:
[0702] The user's choice (accept or decline) is sent to the server.
[0703] Specific behavior:
[0704] The user (university student) checks the notification on their smartphone and taps the option to accept or decline. The result of the selection is sent to the server in JSON format.
[0705] Step 7:
[0706] input:
[0707] User's choice (accept or deny).
[0708] process:
[0709] The server receives the user's selection and, if accepted, provides both parties with detailed service content and schedule.
[0710] output:
[0711] Specific service content and schedules are provided to the elderly and users.
[0712] Specific behavior:
[0713] The server receives the user's selection and, if accepted, notifies the elderly person and the user of the service details and schedule. This notification content is also sent in JSON format.
[0714] Step 8:
[0715] input:
[0716] Daily conversations and voice data of elderly people.
[0717] process:
[0718] Using an emotion engine, the emotional state of elderly people is analyzed from voice data.
[0719] output:
[0720] Emotional state data of older adults.
[0721] Specific behavior:
[0722] The voice data spoken by the elderly is sent via smartphone to the emotion engine, which uses DeepStream SDK to analyze the voice data and identify the emotional state. The results are sent to a server and stored in a database.
[0723] Step 9:
[0724] input:
[0725] Emotional state data of older adults.
[0726] process:
[0727] The generative AI model generates dialogue based on emotional state data and engages in conversation with the elderly.
[0728] output:
[0729] Dialogue text from a generative AI model.
[0730] Specific behavior:
[0731] The generative AI model (GPT-3) receives the elderly person's emotional state data as input and generates appropriate dialogue. Specific prompt examples:
[0732] "You seem a little down, is there something bothering you?"
[0733] The content of the conversation is displayed as text on the elderly person's smartphone.
[0734] Step 10:
[0735] input:
[0736] Interaction logs from generative AI models.
[0737] process:
[0738] The server stores a log of interactions with the generated AI and, if necessary, sends a notification if an abnormality is detected.
[0739] output:
[0740] Saving conversation logs and sending abnormality notifications.
[0741] Specific behavior:
[0742] The conversation log with the generative AI is sent to the server and stored in a database. If the emotion engine detects an abnormality, the server will send a notification to the user's relatives or a monitoring center. This notification will include the user's current emotional state and past logs.
[0743] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0744] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0745] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0746] [Second embodiment]
[0747] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0748] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0749] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0750] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0751] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0752] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0753] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0754] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0755] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0756] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0757] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0758] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0759] This invention is a system that matches elderly people with young people (especially university students) and supports their daily lives while eliminating feelings of loneliness. The system aims to reduce feelings of loneliness for elderly people and enable them to live fulfilling daily lives, while providing opportunities for young people to gain experience in the real world.
[0760] Program Overview
[0761] Registration Steps
[0762] 1. User (elderly)
[0763] Seniors use their devices to download the app and create an account.
[0764] Elderly people enter information such as their area of residence, hobbies, whether they have a car, and desired services (e.g., transportation, shopping accompaniment, conversation partner).
[0765] 2. Devices (elderly people's smartphones)
[0766] The information entered by the elderly person is converted into JSON format and sent to the server.
[0767] 3. Server
[0768] The server receives the information sent by the user and stores it in a database.
[0769] Similarly, university students (users) input their profile, schedule, and available services and send them to the server.
[0770] Matching Step
[0771] 1. Server
[0772] The requests of registered elderly people and the profiles of university students are obtained and a matching algorithm is run.
[0773] Generate a list of the most suitable college students as matching candidates.
[0774] 2. Server
[0775] The server then sends a notification to the potential matched university students, including basic information about the elderly person (e.g., residential area, desired services).
[0776] 3. Device (university student's smartphone)
[0777] The university student's terminal receives the matching notification and displays detailed information to the university student user.
[0778] 4. User (University Student)
[0779] College students can review the matching details and choose to accept or decline.
[0780] 5. Device (university student's smartphone)
[0781] The university student's selection is sent to the server.
[0782] 6. Server
[0783] The server receives the university student's selection and notifies the senior citizen if he or she accepts.
[0784] If a match is made, detailed service details and schedules will be provided to both parties.
[0785] Supported by generative AI
[0786] 1. Server
[0787] The server collects voice data and personality information from college students and trains a generative AI model.
[0788] If university students are absent, the generative AI will have the ability to automatically converse with the elderly.
[0789] 2. Users (elderly people)
[0790] Elderly people can interact with the generative AI through devices they are familiar with.
[0791] 3. Devices (elderly people's smartphones)
[0792] The elderly person's device activates the generation AI's dialogue function, and a dialogue between the generation AI and the elderly person begins.
[0793] 4. Server
[0794] The server stores the dialogue logs of the generated AI and uses them as training data for the next time.
[0795] Income and expenditure management and administrative procedure support
[0796] 1. Server
[0797] The server manages data on service usage fees for elderly people and app usage fees for university students.
[0798] Calculate compensation for college students and determine payment information.
[0799] 2. Users (elderly people)
[0800] Seniors can pay for services within the app.
[0801] 3. Devices (elderly people's smartphones)
[0802] The terminal transmits the payment information to the server.
[0803] 4. Server
[0804] After receiving payment confirmation, the server notifies the elderly person and, if necessary, supports administrative procedures for applying for nursing care insurance, etc.
[0805] This will allow the elderly to enjoy their daily lives more happily and youthfully, and young people to gain meaningful social experiences. Furthermore, the conversational support provided by generative AI will significantly reduce the sense of loneliness felt by the elderly.
[0806] The processing flow will be explained below.
[0807] Step 1:
[0808] Users (seniors) download the app using their devices and create an account. After creating the account, they log in and enter information such as their area of residence, hobbies, whether they have a car, and desired services (e.g., transportation, shopping accompaniment, conversation partner).
[0809] Step 2:
[0810] The terminal (elderly person's smartphone) converts the information entered by the elderly person into JSON format and sends it to the server.
[0811] Step 3:
[0812] The server receives the information sent by the user and stores it in a database. Similarly, university student users also input their profile, schedule, and available services and send them to the server.
[0813] Step 4:
[0814] The server retrieves the profiles of university students based on the elderly person's requests and conditions and runs a matching algorithm to generate a list of university students who best fit the elderly person's needs.
[0815] Step 5:
[0816] The server then sends a notification to the potential matched university students, including basic information about the elderly person (e.g., residential area, desired services).
[0817] Step 6:
[0818] The terminal (the university student's smartphone) receives the matching notification and displays detailed information to the university student user.
[0819] Step 7:
[0820] The user (college student) checks the matching details and chooses to accept or reject.
[0821] Step 8:
[0822] The terminal (the university student's smartphone) sends the student's selection to the server.
[0823] Step 9:
[0824] The server receives the student's selection and sends a notification to the elderly person if they accept. If a match is made, detailed service content and schedules are provided to both parties.
[0825] Step 10:
[0826] The server acquires the voice data and personality information of university students and trains the generative AI model, which then prepares a function for the generative AI to converse with the elderly when the university students are absent.
[0827] Step 11:
[0828] When the university student is not present, the user (elderly person) can interact with the generating AI through the terminal.
[0829] Step 12:
[0830] The device (elderly person's smartphone) activates the generative AI's dialogue function, and a dialogue between the generative AI and the elderly person begins.
[0831] Step 13:
[0832] The server stores the dialogue logs of the generated AI and uses them as training data for the future.
[0833] Step 14:
[0834] The server manages data on service fees for seniors and app fees for university students, calculates the university students' remuneration, and determines payment information.
[0835] Step 15:
[0836] Users (elderly people) can pay for the service within the app.
[0837] Step 16:
[0838] The terminal (elderly person's smartphone) sends payment information to the server.
[0839] Step 17:
[0840] After receiving payment confirmation, the server notifies the elderly person and, if necessary, supports administrative procedures for applying for nursing care insurance, etc.
[0841] Example 1
[0842] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0843] There is a need for a system that supports the elderly in their daily lives and prevents them from feeling lonely. At the same time, there are a lack of opportunities for young people to gain experience in the real world. Another issue is the lack of efficient and effective ways to match the elderly with young people. Furthermore, when university students are not available, it is important to find ways to alleviate the elderly's sense of loneliness. In addition, there is a need for a system that can comprehensively support income and expenditure management and assistance with administrative procedures.
[0844] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0845] In this invention, the server includes: an input means for elderly people to input their requests and requirements; an input means for young people to input their profile and available services; a storage means for storing the elderly people's requests and requirements and the young people's profiles in a database; a matching means for selecting an appropriate young person based on the elderly people's requests and requirements; a notification means for sending a matching notification to the selected young person; a dialogue means for the generative model to engage in dialogue based on the young person's voice data and personality information; a log storage means for storing the dialogue log of the generative model; and a service provision means for providing detailed service content and schedules for both the elderly and the young person. This makes it possible to reduce the elderly's sense of loneliness while providing young people with real-world experiences. Furthermore, elderly people can alleviate their loneliness through dialogue with the generative model even when their university students are away. Furthermore, by providing a system that comprehensively supports income and expenditure management and administrative procedures, more secure and convenient services can be realized.
[0846] "Elderly people" refers to people over a certain age who require a certain level of support in their daily lives and who may feel lonely.
[0847] "Young people" refers specifically to students and young adults seeking real-world experience.
[0848] "Input means" refers to an interface through which a user inputs specific information into the system.
[0849] "Storage means" refers to a component for recording and managing input information in a database.
[0850] "Matching methods" refer to algorithms and processes for selecting suitable young people based on the requests and conditions of older people.
[0851] "Notification means" refers to the method or system for sending the selection results and necessary information to matched young people.
[0852] A "generative model" refers to an artificial intelligence program that conducts dialogue based on young people's voice data and personality information.
[0853] "Dialogue method" refers to a method of using a generative model to enable natural language communication with the elderly.
[0854] "Log storage means" refers to a system or component for recording and storing the content and history of a conversation.
[0855] "Service provision means" refers to the method for providing detailed service content and schedule information to both the elderly and young people after a match is made.
[0856] "Income and expenditure management measures" refers to the systems and components that manage service fees for the elderly and app fees for young people.
[0857] "Remuneration calculation means" refers to a system or component for calculating a youth's compensation and determining payment information.
[0858] "Administrative procedure support measures" refers to systems and methods that support the procedures required for elderly people to access public assistance such as nursing care insurance.
[0859] MODE FOR CARRYING OUT THE INVENTION
[0860] The present invention is a system for matching elderly people with young people and supporting their daily lives. The purpose of this system is to reduce the sense of loneliness felt by elderly people and to provide young people with real-world experience. Specific embodiments of the system are described below.
[0861] 1. Registration Steps
[0862] Elderly information registration
[0863] User (elderly)
[0864] Seniors download a dedicated application onto their smartphones, create an account, and then enter their area of residence, hobbies, whether they have a car, and desired services (e.g., accompanying them on shopping trips, having someone to talk to, etc.).
[0865] Example: Elderly person A opens the app and fills out the form with "Tokyo," "reading," "none," and "accompany shopping."
[0866] Device (elderly person's smartphone)
[0867] The terminal converts the input information into JSON format and sends the information to the server.
[0868] server
[0869] The server stores the received information about the elderly person in a database.
[0870] Youth information registration
[0871] Users (young people)
[0872] Young people also download the app and create an account, filling out their profile and the services they can offer.
[0873] Devices (young people's smartphones)
[0874] The terminal converts the input information into JSON format and sends the information to the server.
[0875] server
[0876] The server stores the received information about the young people in a database.
[0877] 2. Matching step
[0878] server
[0879] The server runs a matching algorithm based on the elderly person's requests and the young person's profile information to generate a list of suitable young people, taking into account, for example, their area of residence and the services they can provide.
[0880] server
[0881] The server sends a notification to the potential matched young person, including basic information about the elderly person (e.g., residential area, desired services).
[0882] Devices (young people's smartphones)
[0883] The young person's device receives the notification and displays detailed information to the user.
[0884] Users (young people)
[0885] The young person reviews the match details and chooses to accept or decline.
[0886] Devices (young people's smartphones)
[0887] The selection results are sent to the server.
[0888] server
[0889] If the request is accepted, the server will notify the elderly person and officially establish a match. After the match is established, detailed service content and schedules will be provided to both parties.
[0890] 3. Generative AI support
[0891] server
[0892] The server receives voice data and personality information from young people and trains a generative AI model that automatically converses with the elderly when the young people are not present.
[0893] User (elderly)
[0894] Elderly people can interact with the generative AI through their smartphones.
[0895] Device (elderly person's smartphone)
[0896] The device activates the generation AI's dialogue function and begins a dialogue between the generation AI and the elderly person.
[0897] Specific operation: When elderly person A asks, "What book should I read today?", the generating AI responds, "I'll introduce you to the latest bestseller list."
[0898] server
[0899] The server stores the dialogue logs of the generated AI and uses them as training data for the next time.
[0900] 4. Income and expenditure management and administrative procedure support
[0901] server
[0902] The server manages the service fees for seniors and the app fees for young people, calculates the young people's rewards, and determines payment information.
[0903] User (elderly)
[0904] Seniors can pay for services within the app.
[0905] Device (elderly person's smartphone)
[0906] Send payment information to the server.
[0907] server
[0908] After payment is confirmed, a notification will be sent and support will be provided for administrative procedures such as nursing care insurance if necessary.
[0909] Example prompts for generative AI models
[0910] "A 70-year-old elderly person, Mr. A, would like to go shopping. Please accompany him. Mr. A lives in the XX area. Mr. A's hobby is reading."
[0911] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0912] Step 1:
[0913] Elderly information registration
[0914] User (elderly)
[0915] Seniors download the app using their smartphones, create an account, and then enter their area of residence, hobbies, whether they have a car, and desired services (e.g., shopping accompaniment, conversation partner, etc.).
[0916] Input: area of residence, hobbies, whether you have a car, desired service details
[0917] Output: User information in JSON format
[0918] Specific actions: Elderly person A opens the app and fills in the form with "Tokyo," "reading," "none," and "accompany shopping."
[0919] Device (elderly person's smartphone)
[0920] The terminal converts the input information into JSON format and sends the information to the server.
[0921] Input: Information entered by the user
[0922] Output: JSON information sent to the server
[0923] server
[0924] The server stores the received information about the elderly person in a database.
[0925] Input: JSON format information sent from the terminal
[0926] Output: User information stored in the database
[0927] Step 2:
[0928] Youth information registration
[0929] Users (young people)
[0930] Young people also download the app and create an account, filling out their profile and the services they can offer.
[0931] Input: Profile information, available services
[0932] Output: User information in JSON format
[0933] Devices (young people's smartphones)
[0934] The terminal converts the input information into JSON format and sends the information to the server.
[0935] Input: Information entered by the user
[0936] Output: JSON information sent to the server
[0937] server
[0938] The server stores the received information about the young people in a database.
[0939] Input: JSON format information sent from the terminal
[0940] Output: User information stored in the database
[0941] Step 3:
[0942] Executing the Matching
[0943] server
[0944] The server runs a matching algorithm based on the elderly person's requests and the young person's profile information to generate a list of the most suitable young people.
[0945] Input: Elderly person's request, young person's profile information
[0946] Output: A list of the best young people
[0947] Specific operation: The server analyzes Tanaka's request and lists the young people who are available and who best fit his / her requirements.
[0948] Step 4:
[0949] Sending matching notifications
[0950] server
[0951] The server then sends a notification to the potential matched young person, including basic information about the elderly person (e.g., their residential area and desired services).
[0952] Input: List of young people, basic information of elderly people
[0953] Output: Notification sent to the young person
[0954] Devices (young people's smartphones)
[0955] The young person's device receives the notification and displays detailed information.
[0956] Input: Notification from the server
[0957] Output: what is displayed to the user
[0958] Specific operation: A push notification is sent to the young person's device, displaying the message, "Elderly person A wants to accompany you shopping."
[0959] Step 5:
[0960] Youth Choice
[0961] Users (young people)
[0962] The young person reviews the match details and chooses to accept or decline.
[0963] Input: Match details
[0964] Output: Choice of Accept or Reject
[0965] Devices (young people's smartphones)
[0966] The terminal transmits the selection result to the server.
[0967] Input: Accept or reject
[0968] Output: Selection results sent to the server
[0969] Step 6:
[0970] Matching confirmation and service provision
[0971] server
[0972] If the request is accepted, the server will send a notification to the elderly person to confirm the match. After the match is established, detailed service content and schedules will be provided to both parties.
[0973] Input: Young people's choice results
[0974] Output: Notification to the elderly and detailed service content and schedule
[0975] Specific operation: After the matching is accepted, the server sends the service details and schedule to the elderly and young people.
[0976] Step 7:
[0977] Supported by generative AI
[0978] server
[0979] The server receives voice data and personality information from young people and trains a generative AI model, which then converses with the elderly when they are absent.
[0980] Input: Young people's voice data, personality information
[0981] Output: A trained generative AI model
[0982] User (elderly)
[0983] Elderly people can interact with the generative AI through their smartphones.
[0984] Input: Utterance
[0985] Output: AI response
[0986] Device (elderly person's smartphone)
[0987] The device activates the generation AI's dialogue function and begins a dialogue between the generation AI and the elderly person.
[0988] Input: Senior's voice / text
[0989] Output: Response from the generation AI
[0990] Specific behavior: In response to the question, "What book should I read today?", the generative AI responds, "I'll show you the latest bestsellers."
[0991] server
[0992] The server stores the dialogue logs of the generated AI and uses them as training data for the next time.
[0993] Input: Interaction log
[0994] Output: Saved log data
[0995] Step 8:
[0996] Income and expenditure management and administrative procedure support
[0997] server
[0998] The server manages the service fees for the elderly and the app fees for the young, calculates the young's remuneration, and determines payment information.
[0999] Input: Service usage data, app usage data
[1000] Output: Income and expenditure data, payment information
[1001] User (elderly)
[1002] Seniors can pay for services within the app.
[1003] Input: Payment Information
[1004] Output: Payment for the service
[1005] Device (elderly person's smartphone)
[1006] The terminal transmits the payment information to the server.
[1007] Input: Payment data
[1008] Output: Payment information sent to the server
[1009] server
[1010] After payment is confirmed, a notification will be sent and support will be provided for administrative procedures such as nursing care insurance if necessary.
[1011] Input: Payment Verification Information
[1012] Output: Notification to the elderly and administrative procedure support
[1013] (Application example 1)
[1014] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1015] In modern society, the sense of loneliness felt by older adults and the lack of support for daily life are serious issues. Furthermore, university students have limited opportunities to gain real-world experience, limiting their future opportunities for growth and contribution to society. Furthermore, there is a lack of support for meal preparation and delivery, which is particularly difficult for older adults, and this needs to be addressed.
[1016] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1017] In this invention, the server includes: an input means for elderly people to input their requests and requirements; an input means for university students to input their profiles and available services; a storage means for storing the elderly people's requests and requirements and the university students' profiles in a database; a matching means for selecting suitable university students based on the elderly people's requests and requirements; a notification means for sending a matching notification to the selected university students; a dialogue means for the generation AI to engage in dialogue based on the university students' voice data and personality information; a log storage means for saving the dialogue log of the generation AI; a request means for elderly people to order meals and request support; a receiving means for university students to receive meal-related requests from elderly people; and a delivery management means for managing meal orders and delivery. This allows elderly people to enrich their daily lives while alleviating feelings of loneliness, and allows university students to gain real-world experience. Furthermore, the quality of life of elderly people is improved, especially by providing more support for meal preparation and delivery.
[1018] "Elderly" refers to an older person who requires special assistance in daily life.
[1019] "University student" refers to a young person enrolled in a university who is studying academic or technical subjects.
[1020] "Input means" refers to a device or interface that allows a user to input information into a system.
[1021] "Storage means" refers to the technology or device used to store input information in a database.
[1022] "Matching means" refers to the algorithms and devices used to select the most suitable elderly people and university students based on the conditions within the system.
[1023] "Notification means" refers to the technology or device used to notify the target person of selected information.
[1024] "Generative AI" refers to artificial intelligence that uses machine learning technology to generate natural language and engage in dialogue.
[1025] "Interaction means" refers to the interface or technology that enables the generative AI to interact with the user.
[1026] "Log storage means" refers to technology or devices for storing records of interactions conducted by the generating AI.
[1027] "Request means" refers to the interface or device that allows elderly people to order meals or request assistance.
[1028] "Means of receipt" refers to the technology and equipment that university students use to receive requests from elderly people.
[1029] "Delivery management means" refers to systems and technologies for managing food order and delivery information.
[1030] This invention is a system that matches elderly people with university students and supports their daily lives while reducing feelings of loneliness. This system will be described below.
[1031] The server consists of an input means for elderly people to input their requests and requirements, an input means for university students to input their profile and the services they can provide, and a storage means for saving this information. Information on elderly people and university students is saved in a database and can be searched and updated as needed.
[1032] The matching means selects a university student who meets the elderly person's needs based on the information stored in the database. A matching notification is sent to the selected university student through the notification means. This allows the elderly person and the university student to be appropriately matched.
[1033] The generative AI provides a dialogue means for conversing with elderly people based on the voice data and personality information of university students. This dialogue means includes a log storage means for saving the dialogue log of the generative AI. The generative AI automatically converses with elderly people on behalf of university students when they are absent or busy.
[1034] The system also includes a requesting mechanism for seniors to order meals and request assistance, and a receiving mechanism for university students to receive those requests. This allows for efficient management of meal preparation and delivery for seniors. It also includes a delivery management mechanism for managing information on meal orders and delivery.
[1035] To implement this invention, cloud platforms such as AWS and Google Cloud are used for the servers, ensuring high scalability and reliability of the system. Relational databases such as PostgreSQL and MongoDB or NoSQL databases are used for the databases. Front-end applications are developed using cross-platform development frameworks such as React Native and Flutter.
[1036] The generative AI uses machine learning models such as GPT-4. To enable natural conversations with the elderly, the AI uses voice data from university students as training data. The content of the conversations the AI has is saved as a log and used as training data for the next round.
[1037] Examples:
[1038] If an elderly person, Person A, wants to buy ingredients for dinner, he or she will send a request using the app. This request will be received by University student Person B, who will purchase the appropriate ingredients based on Person A's request and deliver them to Person A's home. If the University student is busy, the generated AI will converse with Person A on his or her behalf to confirm the necessary information.
[1039] Example prompt sentence:
[1040] Prompt for the senior to type: "Can you please buy the ingredients for dinner next Monday?"
[1041] A prompt sentence that a university student converses with the generative AI on his / her behalf: "I'm going shopping now. Can you give me a list of what I'm going to buy?"
[1042] This will improve the quality of life for seniors, allow university students to gain social experience, and reduce feelings of loneliness among seniors through conversational support provided by generative AI.
[1043] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1044] Step 1:
[1045] The user (senior citizen) launches the app using their smartphone and inputs their requests and conditions (area of residence, hobbies, whether they have a car, desired service details, etc.). The input information is converted to JSON format and sent to the server. At this time, the input data includes text information about the area of residence, hobbies, and desired service details, and JSON format data is generated as the output.
[1046] Step 2:
[1047] Similarly, the device (university student) inputs their profile, schedule, and available services and sends the data to the server. In this process, the input data also includes text information about the profile, schedule, and available services, and the output data is generated in JSON format.
[1048] Step 3:
[1049] The server saves the input data of the elderly and university students in a database. The database manages this information and searches and updates it as needed. In doing so, it parses the JSON data received as input and saves it in the appropriate table. The status of the save confirmation is generated as output.
[1050] Step 4:
[1051] The server runs a matching algorithm based on the information stored in the database, selecting the university student who best suits the elderly person's needs and creating a list of match candidates. This process uses the elderly person's needs and the university student's profile as input data, applies the matching algorithm, and generates a list of match candidates as output.
[1052] Step 5:
[1053] The server sends a matching notification to the selected university students. The notification includes basic information about the elderly person (e.g., residential area, desired services). In this process, the list of matching candidates and related information are used as input data, and a notification message is generated as output.
[1054] Step 6:
[1055] The device (university student) receives the matching notification and displays detailed information. The university student checks the elderly person's information and inputs whether to accept or reject the match. At this time, detailed information is displayed and the university student's selection is made as input data, and the selection result is sent to the server as output.
[1056] Step 7:
[1057] The server receives the university student's selection results and notifies the elderly person if they accept. If a match is made, detailed service content and schedules are provided to both parties. The university student's selection results are used as input data, and service content and schedule information are generated as output.
[1058] Step 8:
[1059] The generative AI converses with the elderly based on the voice data and personality information of university students. The elderly provide input for the dialogue with the generative AI, which then generates an appropriate response based on that input. The elderly person asks a question as input, and the generative AI's response is displayed as output.
[1060] Step 9:
[1061] The dialogue log of the generation AI is saved by the server using a log saving means. The saved log is used as training data for the next training. At this time, the dialogue content of the generation AI is used as input data, and the dialogue log saved as output is generated.
[1062] Step 10:
[1063] Elderly people use a requesting tool to order meals or request assistance and send a request from their device. The request is received by a university student and output as an executable service. Meal order information is used as input data, and a notification of request receipt is generated as output.
[1064] Step 11:
[1065] The university student uses the receiving means to confirm the elderly person's request and delivers the meal through the delivery management means. The specific delivery schedule and delivery contents are managed and notified to the elderly person. The delivery schedule and delivery contents are used as input data, and a delivery completion report is generated as output.
[1066] Through these processing steps, the system can support the elderly in their daily lives and provide real-world experience to university students.
[1067] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1068] This invention relates to a system that matches elderly people with young people (especially university students) and supports their daily lives while eliminating feelings of loneliness using an emotion engine. The system aims to reduce feelings of loneliness for elderly people, enable them to live fulfilling daily lives, and provide opportunities for young people to gain experience in the real world. Furthermore, the emotion engine recognizes the user's emotions, providing more personalized services.
[1069] Program Overview
[1070] Registration Steps
[1071] 1. User (elderly)
[1072] Seniors use their devices to download the app and create an account.
[1073] Elderly people enter information such as their area of residence, hobbies, whether they have a car, and desired services (e.g., transportation, shopping accompaniment, conversation partner).
[1074] 2. Devices (elderly people's smartphones)
[1075] The information entered by the elderly person is converted into JSON format and sent to the server.
[1076] 3. Server
[1077] The server receives the information sent by the user and stores it in a database.
[1078] Similarly, university student users input their profile, schedule, and available services and send them to the server.
[1079] Matching Step
[1080] 1. Server
[1081] The requests of registered elderly people and the profiles of university students are obtained and a matching algorithm is run.
[1082] Generate a list of the most suitable college students as matching candidates.
[1083] 2. Server
[1084] The server then sends a notification to the potential matched university students, which includes basic information about the elderly person (e.g., residential area, desired services).
[1085] 3. Device (university student's smartphone)
[1086] The university student's terminal receives the matching notification and displays detailed information to the university student user.
[1087] 4. User (University Student)
[1088] College students can review the matching details and choose to accept or decline.
[1089] 5. Device (university student's smartphone)
[1090] The university student's selection is sent to the server.
[1091] 6. Server
[1092] The server receives the student's selection and sends a notification to the elderly person if they accept. If a match is made, detailed service content and schedules are provided to both parties.
[1093] Supported by generative AI
[1094] 1. Server
[1095] The server collects voice data and personality information from college students and trains a generative AI model.
[1096] If university students are absent, the generative AI will have the ability to automatically converse with the elderly.
[1097] 2. Users (elderly people)
[1098] Elderly people can interact with the generative AI through devices they are familiar with.
[1099] 3. Devices (elderly people's smartphones)
[1100] The elderly person's device activates the generation AI's dialogue function, and a dialogue between the generation AI and the elderly person begins.
[1101] 4. Server
[1102] The server stores the dialogue logs of the generated AI and uses them as training data for the next time.
[1103] Emotion engine integration
[1104] 1. Server
[1105] The server analyzes the emotional state of the elderly person using an emotion engine, which has the ability to recognize the user's emotions from voice and text data.
[1106] 2. Means of interaction
[1107] The emotion engine dynamically adjusts the dialogue content for the elderly based on their emotional state. For example, if the elderly feels sad, it will offer words of encouragement or topics to cheer them up.
[1108] 3. Log storage method
[1109] Emotion data analyzed by the emotion engine is stored along with the dialogue log, allowing the generative AI to deliver more personalized dialogue based on past emotional data.
[1110] Income and expenditure management and administrative procedure support
[1111] 1. Server
[1112] The server manages data on service fees for seniors and app fees for university students, calculates the university students' remuneration, and determines payment information.
[1113] 2. Users (elderly people)
[1114] Seniors can pay for services within the app.
[1115] 3. Devices (elderly people's smartphones)
[1116] The terminal transmits the payment information to the server.
[1117] 4. Server
[1118] After receiving payment confirmation, the server notifies the elderly person and, if necessary, supports administrative procedures for applying for nursing care insurance, etc.
[1119] As a result, a system integrating an emotion engine can analyze the emotional state of elderly people and provide more personalized dialogue and support, significantly reducing their sense of loneliness and helping them live richer lives.
[1120] The processing flow will be explained below.
[1121] Step 1:
[1122] Users (seniors) download the app using their devices and create an account. After creating the account, they log in and enter information such as their area of residence, hobbies, whether they have a car, and desired services (e.g., transportation, shopping accompaniment, conversation partner).
[1123] Step 2:
[1124] The terminal (elderly person's smartphone) converts the information entered by the elderly person into JSON format and sends it to the server.
[1125] Step 3:
[1126] The server receives the information sent by the user and stores it in a database. Similarly, university student users input their profile, schedule, and available services and send them to the server.
[1127] Step 4:
[1128] The server retrieves the profiles of university students based on the elderly person's requests and conditions and runs a matching algorithm to generate a list of university students who best fit the elderly person's needs.
[1129] Step 5:
[1130] The server then sends a notification to the potential matched university students, which includes basic information about the elderly person (e.g., residential area, desired services).
[1131] Step 6:
[1132] The terminal (the university student's smartphone) receives the matching notification and displays detailed information to the university student user.
[1133] Step 7:
[1134] The user (college student) checks the matching details and chooses to accept or reject.
[1135] Step 8:
[1136] The terminal (the university student's smartphone) sends the student's selection to the server.
[1137] Step 9:
[1138] The server receives the student's selection and notifies the elderly person if they accept. If a match is made, detailed service content and schedules are provided to both parties.
[1139] Step 10:
[1140] The server collects the voice data and personality information of university students and trains the generative AI model. When the university students are absent, the generative AI prepares a function to automatically converse with the elderly.
[1141] Step 11:
[1142] When the university student is not present, the user (elderly person) can interact with the generating AI through the terminal.
[1143] Step 12:
[1144] The device (elderly person's smartphone) activates the Generative AI's dialogue function and begins a dialogue between the Generative AI and the elderly person. At that time, the Generative AI uses the elderly person's voice and text data to perform emotion analysis using its emotion engine.
[1145] Step 13:
[1146] The server stores the dialogue logs generated by the generation AI and the emotion analysis data generated by the emotion engine, and uses these as training data for the next time.
[1147] Step 14:
[1148] The server uses an emotion engine to analyze the elderly person's emotional state and dynamically adjust the dialogue content, for example, if the elderly person feels sad, it will provide words of encouragement or topics to cheer them up.
[1149] Step 15:
[1150] The server manages data on service fees for seniors and app fees for university students, calculates the university students' remuneration, and determines payment information.
[1151] Step 16:
[1152] Users (elderly people) can pay for the service within the app.
[1153] Step 17:
[1154] The terminal (elderly person's smartphone) sends payment information to the server.
[1155] Step 18:
[1156] After receiving payment confirmation, the server notifies the elderly person and, if necessary, supports administrative procedures for applying for nursing care insurance, etc.
[1157] Example 2
[1158] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1159] In modern society, elderly people face serious problems such as loneliness and lack of support for daily life. It is not easy for them to properly communicate their needs and requirements and match them with the right support provider. Furthermore, there is a lack of services that cater to the emotional state of the elderly, leaving many elderly people seeking mental health care. Meanwhile, young people have fewer opportunities to gain real-world experience and lack social involvement. Therefore, there is a need for a system that can properly match elderly people with young people and provide personalized services based on emotion recognition.
[1160] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1161] In this invention, the server includes: an input means for the elderly to input their requests and requirements; an input means for the young person to input their profile and the services they can provide; a storage means for storing the elderly's requests and requirements and the young person's profile in a database; a matching means for selecting an appropriate young person based on the elderly's requests and requirements; a notification means for sending a matching notification to the selected young person; a dialogue means for the generation AI to engage in a dialogue based on the young person's voice data and personality information; a log storage means for saving the dialogue log of the generation AI; an emotion analysis means for analyzing the emotional state of the elderly using an emotion engine; and a dialogue adjustment means for adjusting the dialogue content based on the emotion analysis results. This makes it possible to reduce the elderly's sense of loneliness and provide personalized emotional support while providing young people with opportunities to gain experience in the real world.
[1162] "Input means" refers to devices or interfaces that allow older people and younger people to input information such as their needs, profiles, and available services.
[1163] The "storage means" is a function or device for storing the requests and conditions of the elderly and the profile information of the young people in a database.
[1164] The "matching means" refers to the algorithms and processing functions for selecting the most suitable young person based on the elderly person's requests and conditions.
[1165] The "notification means" is a function or device for sending a notification regarding a match to the selected young person.
[1166] "Dialogue means" refers to a function or device that enables the generation AI to engage in dialogue with the elderly based on the voice data and personality information of the young person.
[1167] "Log storage means" refers to a function or device for storing a log of the dialogue conducted by the generation AI.
[1168] The "emotion analysis means" is a function or device for analyzing the emotional state of the elderly person using an emotion engine.
[1169] The "dialogue adjustment means" is a function or device for dynamically adjusting the dialogue content provided to the elderly based on the emotion analysis results.
[1170] The "income and expenditure management means" is a function or device for managing service usage fees for the elderly and app usage fees for young people.
[1171] A "remuneration calculation means" is a function or device for calculating a youth's remuneration and determining payment information.
[1172] "Administrative procedure support means" refers to a function or device that supports administrative procedures so that elderly people can use nursing care insurance, etc.
[1173] The present invention is a system that matches elderly people with young people, alleviates feelings of loneliness using an emotion engine, and supports daily life. The system includes the following means.
[1174] Registration method
[1175] Elderly and young people use devices such as smartphones to input their respective requests, profiles, and available services. For example, elderly people input their residential area, hobbies, and desired services (e.g., transportation, shopping accompaniment, conversation partner). Meanwhile, young people input their own profiles, schedules, and available services. This information is converted into JSON format by the device and sent to the server as an HTTP POST request.
[1176] Preservation means
[1177] The server analyzes the received JSON data and stores it in a database, allowing the requests and conditions of the elderly and the profile information of the young people to be managed in a unified manner.
[1178] Matching Method
[1179] The server retrieves the elderly person's needs and the young person's profile from the database and runs a matching algorithm that generates a list of suitable young people using criteria such as geographical proximity and similar interests, thereby selecting the young person who best suits the elderly person's needs.
[1180] Notification means
[1181] The server then sends a push notification to the selected young person, which includes basic information such as the elderly person's residential area and desired service. The young person receives the notification on their smartphone and checks the detailed information.
[1182] Interaction methods
[1183] The generative AI will converse with the elderly based on the younger person's voice data and personality information. For example, if the younger person is not present, the generative AI will automatically ask the elderly questions such as, "How was your day?" The elderly can enjoy everyday conversations through the generative AI.
[1184] Log storage method
[1185] The server stores the logs of the conversations that the AI has had and uses them as training data for the next time. This allows the AI to provide more personalized conversations based on past conversation data.
[1186] Emotion analysis means
[1187] An emotion engine is used to analyze the emotional state of the elderly person from their voice and text data, for example, by analyzing their tone of voice and word choice to determine their emotional state.
[1188] Dialogue coordination means
[1189] The server dynamically adjusts the dialogue content based on the results of emotion analysis. For example, if an elderly person appears sad, the AI generator can be configured to offer encouraging words.
[1190] Income and expenditure management methods
[1191] The server manages the service fees for seniors and the app fees for young people. The server calculates the remuneration for young people and determines payment information.
[1192] Administrative procedure support tools
[1193] The server supports administrative procedures so that elderly people can use nursing care insurance, etc. The server collects necessary information and assists elderly people in the appropriate procedures.
[1194] Specific examples
[1195] As a concrete example of how this works, the following prompt might be entered:
[1196] Elderly Registration Procedure:
[1197] 1. Seniors download the app on their smartphones and click the "Sign Up" button.
[1198] 2. Enter your name, age, address, hobbies, and desired service (e.g., accompanying you shopping), then press the "Submit" button.
[1199] Matching Procedure:
[1200] 1. The server retrieves the elderly person's preferences and the young person's profile data and uses an algorithm to perform the best match.
[1201] 2. A "new match notification" will be sent to the young person's smartphone, and when the user opens the app, detailed information will be displayed.
[1202] 3. When the young person clicks the consent button, the selection information is sent to the server and the elderly person is notified.
[1203] Generative AI support:
[1204] 1. If the younger person is not present, the generating AI will ask the older person, "How are you doing lately?"
[1205] 2. If the elderly person answers, "I feel a little lonely," the generating AI continues, "What do you like to do when you feel lonely?"
[1206] Through these aspects, the present invention can significantly reduce the sense of loneliness felt by the elderly and provide a valuable opportunity for young people to gain real-world experience.
[1207] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1208] Step 1:
[1209] User (elderly)
[1210] Seniors use their smartphones to download the app and create an account.
[1211] Input: Name, age, address, hobbies, desired service (e.g., shopping accompaniment)
[1212] Action: Enter the required information on the app's sign-up screen and press the "Submit" button.
[1213] Output: The user's basic information is saved on the device and converted to JSON format in the next step.
[1214] Step 2:
[1215] Device (elderly person's smartphone)
[1216] The information entered by the user is converted into JSON format and sent to the server as an HTTP POST request.
[1217] Input: Basic information entered by the user (name, age, address, hobbies, desired service)
[1218] Behavior: Converts input data into JSON format and sends it to the server.
[1219] Output: JSON formatted data is sent to the server.
[1220] Step 3:
[1221] server
[1222] Parse the received JSON data and save it in the database.
[1223] Input: Basic information data of elderly people in JSON format
[1224] What it does: Parses JSON data and stores it in a database. It performs the parsing process and maps each field to the appropriate database column.
[1225] Output: Basic information of the elderly is saved in the database.
[1226] Step 4:
[1227] User (younger people)
[1228] Young people fill out their profile and the services they can offer.
[1229] Input: Name, age, address, hobbies, available services (e.g. conversation partner, shopping accompaniment)
[1230] Action: Enter the required information on the app's sign-up screen and press the "Submit" button.
[1231] Output: The user's basic information is saved on the device and converted to JSON format in the next step.
[1232] Step 5:
[1233] Devices (young people's smartphones)
[1234] The information entered by the young person is converted into JSON format and sent to the server as an HTTP POST request.
[1235] Input: Basic information entered by the young person (name, age, address, hobbies, available services)
[1236] Behavior: Converts input data into JSON format and sends it to the server.
[1237] Output: JSON formatted data is sent to the server.
[1238] Step 6:
[1239] server
[1240] Parse the received JSON data and save it in the database.
[1241] Input: Basic information data of young people in JSON format
[1242] What it does: Parses JSON data and stores it in a database. It performs the parsing process and maps each field to the appropriate database column.
[1243] Output: Basic information about the young person is saved in the database.
[1244] Step 7:
[1245] server
[1246] The database retrieves the elderly person's requests and the young person's profile, and then runs a matching algorithm.
[1247] Input: Elderly requests and young people's profiles stored in a database
[1248] How it works: It uses an algorithm to match people based on criteria such as geographic proximity or shared interests.
[1249] Output: Generate a list of the most suitable young people.
[1250] Step 8:
[1251] server
[1252] Push notifications are sent to selected young people.
[1253] Input: List of most suitable young people, basic information of elderly people
[1254] How it works: A push notification is generated and sent to the selected young person, including the senior's location and desired services.
[1255] Output: A notification is sent to the young person's smartphone.
[1256] Step 9:
[1257] Devices (young people's smartphones)
[1258] Receive notifications and view more information.
[1259] Input: Push notification from the server
[1260] What it does: The app receives a notification and displays more information to the user.
[1261] Output: A screen will be displayed where the user (young person) can review the details and choose to accept or decline.
[1262] Step 10:
[1263] User (younger people)
[1264] Review the details and accept or reject the match.
[1265] Input: Match details
[1266] Action: The young person operates the screen and chooses whether to accept or reject the request. To accept, they click the "Accept" button, and to reject, they click the "Reject" button.
[1267] Output: An accept or reject choice is created and sent to the server in the next step.
[1268] Step 11:
[1269] Devices (young people's smartphones)
[1270] The accept or reject choice is sent to the server.
[1271] Input: Accept or reject selection information
[1272] What it does: Sends the selection to the server as an HTTP POST request.
[1273] Output: The accept or reject choice is sent to the server.
[1274] Step 12:
[1275] server
[1276] The younger person's selection is received and, if accepted, a notification is sent to the older person.
[1277] Input: Young person's consent or denial selection information
[1278] What it does: Parse the selection and, if accepted, generate and send a push notification to the senior.
[1279] Output: If accepted, a match confirmation notification is sent to the senior.
[1280] Step 13:
[1281] server
[1282] The generative AI trains the dialogue module based on young people's voice data and personality information.
[1283] Input: Young person's voice data and personality information
[1284] How it works: A generative AI model is used to analyze young people's voice data and personality information, which is then used as training data.
[1285] Output: A trained generative AI model
[1286] Step 14:
[1287] User (elderly)
[1288] Elderly people can interact with the generating AI through the devices they use.
[1289] Input: Senior voice or text input
[1290] How it works: Dialogue is conducted in real time using generative AI. For example, the generative AI asks, "How are you doing lately?"
[1291] Output: Dialogue data between the elderly person and the generative AI
[1292] Step 15:
[1293] Device (elderly person's smartphone)
[1294] Activate the generation AI's dialogue function and begin the dialogue.
[1295] Input: Voice or text input by seniors
[1296] Behavior: Recognizes input and initiates a dialogue with the generative AI.
[1297] Output: Voice or text data during the conversation
[1298] Step 16:
[1299] server
[1300] The conversation logs of the generating AI are saved and used as training data for the next time.
[1301] Input: Conversation log between the generative AI and the elderly person
[1302] What it does: Saves the conversation log to a database and uses it for the next generative AI training.
[1303] Output: Saved interaction logs
[1304] Step 17:
[1305] server
[1306] An emotion engine is used to analyze the emotional state of the elderly and dynamically adjust the dialogue content.
[1307] Input: Elderly person's voice or text data
[1308] How it works: Analyzes data using an emotion engine to determine emotional state.
[1309] Output: Dialogue based on emotional state
[1310] Step 18:
[1311] server
[1312] Manages service fees for the elderly and app fees for young people and calculates rewards.
[1313] Input: Service usage history of elderly people, service provision history of young people
[1314] Operation: Manages usage fees and calculates remuneration using the financial management tool. Determines payment information and notifies the senior.
[1315] Output: User fee management information for elderly people, reward information for young people
[1316] Step 19:
[1317] server
[1318] We support administrative procedures so that elderly people can use nursing care insurance and other services.
[1319] Input: Elderly user status, necessary administrative procedures
[1320] Function: Collects necessary information and assists with application procedures for nursing care insurance, etc.
[1321] Output: Supporting information for administrative procedures
[1322] Through these concrete steps, the system can reduce loneliness among older people and provide real-world experience for younger people.
[1323] (Application example 2)
[1324] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1325] There is a need for a system that can effectively support elderly people in their daily lives and alleviate their feelings of loneliness. Strengthening security for elderly people is also important, and it is desirable to be able to quickly detect and respond to any abnormalities related to this. Furthermore, simplifying the procedures and cost management for receiving this support is also a challenge.
[1326] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: input means for the elderly person to input their requests and requirements; input means for the user to input their profile and available services; storage means for storing the elderly person's requests and requirements and the user's profile in a database; matching means for selecting an appropriate user based on the elderly person's requests and requirements; notification means for sending a matching notification to the selected user; dialogue means for the generation AI to engage in dialogue based on the user's voice data and personality information; log storage means for saving the dialogue log of the generation AI; analysis means for analyzing the elderly person's emotional state using an emotion engine; adjustment means for dynamically adjusting the dialogue content for the elderly person based on the analysis results; and abnormality notification means for sending a notification when a security-related abnormality is detected. This makes it possible to reduce the elderly person's sense of loneliness, support their daily lives, and strengthen security.
[1327] "Elderly" refers to people who are getting older and require support from others and professional help.
[1328] "Requests and conditions" refer to the matters and requests that are necessary for elderly people to receive life support and interactive services.
[1329] "Users" are all people who use the system, including young people and students, who provide services to support the elderly in particular.
[1330] "Profile" refers to information that describes a user's basic personal information, qualifications, and the services that can be provided.
[1331] "Database" refers to a system for effectively managing stored information and making it easy to search and reference.
[1332] "Matching" refers to the process of matching the requests, conditions, and profile information of elderly people and users to find the optimal match.
[1333] "Notification" refers to the system sending a message to the selected user to inform them of the matching result.
[1334] "Generative AI" refers to artificial intelligence technology that generates dialogue based on a user's voice data and personality information.
[1335] "Emotion engine" refers to technology for analyzing a user's emotional state from voice and text data.
[1336] "Analysis results" refers to information about the user's emotional state analyzed by the emotion engine.
[1337] "Abnormal" refers to an unusual emotional state or security issue, often a situation that requires immediate attention.
[1338] "Security" refers to protective and conservation measures to ensure that elderly people can live in peace.
[1339] "Log" refers to recorded data such as past interactions and system operation history.
[1340] "Notification means" refers to methods or functions for notifying specific people or systems of abnormalities or important information.
[1341] "Adjustment means" refers to a function that enables the system to dynamically change the content of dialogue and the content of services according to the needs of the user.
[1342] The present invention relates to a system for relieving the sense of loneliness of elderly people, supporting their daily lives, and strengthening security. This system aims to provide an environment in which elderly people can live with peace of mind.
[1343] System configuration
[1344] Hardware
[1345] Smartphones: Devices used by the elderly, used as a means of input and communication.
[1346] Server: Hosts the database, generative AI models, and emotion engine.
[1347] Sensors: Sensors to monitor the elderly person's environmental variables as needed (e.g., temperature and humidity sensors).
[1348] software
[1349] Emotion engine: Voice analysis technology using NVIDIA DeepStream SDK.
[1350] Generative AI model: A dialogue generation engine using OpenAI's GPT-3.
[1351] Database: AWS RDS is used.
[1352] Data processing and calculation
[1353] The server stores the input information of the elderly and users (in this case, young people and students) in a database and performs matching based on this information. The emotional state of the elderly is analyzed using an emotion engine, and the generation AI engages in dialogue as necessary. The detailed process of the system is explained below.
[1354] 1. Data Collection
[1355] Elderly people use their smartphones to input their requests and conditions (such as their residential area, hobbies, desired service content, etc.) This information is converted into JSON format and sent to the server.
[1356] 2. Storage of Information
[1357] The server stores the elderly's requests and conditions, as well as user profile information (qualifications, available services, etc.) in a database.
[1358] 3. Matching
[1359] The server matches the elderly person's requests and conditions with the user's profile to find the best match, and sends a match notification to the selected user.
[1360] 4. Emotion analysis
[1361] The emotion engine analyzes the emotional state of elderly people from their daily conversations and voice data, and this emotional state data is stored on a server.
[1362] 5. Generative AI Dialogue
[1363] If an abnormality in the elderly person's emotional state is detected, a generative AI model (GPT-3) generates a dialogue to provide reassurance. Specific prompt examples:
[1364] "You seem a little down, is there something bothering you?"
[1365] 6. Data storage and abnormality notification
[1366] The conversation logs with the generative AI are stored in a database and used as training data for the next round. If the emotion engine detects an abnormality, it will send a notification to relatives or a monitoring center. The notification will include the current emotional state and past logs.
[1367] This will help reduce the sense of loneliness among the elderly, support them in their daily lives, and strengthen security.
[1368] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1369] Step 1:
[1370] input:
[1371] Elderly people use their smartphones to input their requests and conditions (e.g., area of residence, hobbies, desired services).
[1372] process:
[1373] The terminal converts the input information into JSON format and sends it to the server.
[1374] output:
[1375] The elderly person's requests and requirements are sent to the server.
[1376] Specific behavior:
[1377] Seniors access the app on their smartphones, enter their details into various input fields, and press the submit button. This information is encoded in JSON format by the smartphone app and sent to the server's API.
[1378] Step 2:
[1379] input:
[1380] The user (university student) uses a smartphone to enter their profile and the services that can be provided.
[1381] process:
[1382] The terminal converts the input information into JSON format and sends it to the server.
[1383] output:
[1384] The user's profile and information about available services are sent to the server.
[1385] Specific behavior:
[1386] A user (a university student) accesses the smartphone app, enters details into various input fields, and presses the submit button. This information is encoded into JSON format by the smartphone app and sent to the server's API.
[1387] Step 3:
[1388] input:
[1389] The elderly person's requests and conditions, as well as the user's profile information, are sent to the server.
[1390] process:
[1391] The server stores this information in a database.
[1392] output:
[1393] The elderly's requests and conditions, as well as user profile information, are stored in a database.
[1394] Specific behavior:
[1395] The server parses the received JSON data, extracts each field, and stores it in a database using AWS RDS.
[1396] Step 4:
[1397] input:
[1398] The elderly's requests and conditions, as well as user profile information, are stored in a database.
[1399] process:
[1400] The server runs a matching algorithm to select suitable users based on the elderly person's needs and requirements.
[1401] output:
[1402] A list of matched users.
[1403] Specific behavior:
[1404] The server retrieves the elderly's requests and conditions and user profile information from the database, then runs a matching algorithm to select the most suitable user. It compares each request and condition and lists users with the highest match.
[1405] Step 5:
[1406] input:
[1407] A list of matched users.
[1408] process:
[1409] The server sends a match notification to the selected users.
[1410] output:
[1411] A notification is sent to the user's device.
[1412] Specific behavior:
[1413] The server sends a notification to each user's smartphone based on the list of matched users, which includes basic information about the elderly person (e.g., residential area, desired service).
[1414] Step 6:
[1415] input:
[1416] A match notification sent to the user's device.
[1417] process:
[1418] The user (university student) checks the notification and chooses to accept or decline.
[1419] output:
[1420] The user's choice (accept or decline) is sent to the server.
[1421] Specific behavior:
[1422] The user (university student) checks the notification on their smartphone and taps the option to accept or decline. The result of the selection is sent to the server in JSON format.
[1423] Step 7:
[1424] input:
[1425] User's choice (accept or deny).
[1426] process:
[1427] The server receives the user's selection and, if accepted, provides both parties with detailed service content and schedule.
[1428] output:
[1429] Specific service content and schedules are provided to the elderly and users.
[1430] Specific behavior:
[1431] The server receives the user's selection and, if accepted, notifies the elderly person and the user of the service details and schedule. This notification content is also sent in JSON format.
[1432] Step 8:
[1433] input:
[1434] Daily conversations and voice data of elderly people.
[1435] process:
[1436] Using an emotion engine, the emotional state of elderly people is analyzed from voice data.
[1437] output:
[1438] Emotional state data of older adults.
[1439] Specific behavior:
[1440] The voice data spoken by the elderly is sent via smartphone to the emotion engine, which uses DeepStream SDK to analyze the voice data and identify the emotional state. The results are sent to a server and stored in a database.
[1441] Step 9:
[1442] input:
[1443] Emotional state data of older adults.
[1444] process:
[1445] The generative AI model generates dialogue based on emotional state data and engages in conversation with the elderly.
[1446] output:
[1447] Dialogue text from a generative AI model.
[1448] Specific behavior:
[1449] The generative AI model (GPT-3) receives the elderly person's emotional state data as input and generates appropriate dialogue. Specific prompt examples:
[1450] "You seem a little down, is there something bothering you?"
[1451] The content of the conversation is displayed as text on the elderly person's smartphone.
[1452] Step 10:
[1453] input:
[1454] Interaction logs from generative AI models.
[1455] process:
[1456] The server stores a log of interactions with the generated AI and, if necessary, sends a notification if an abnormality is detected.
[1457] output:
[1458] Saving conversation logs and sending abnormality notifications.
[1459] Specific behavior:
[1460] The conversation log with the generative AI is sent to the server and stored in a database. If the emotion engine detects an abnormality, the server will send a notification to the user's relatives or a monitoring center. This notification will include the user's current emotional state and past logs.
[1461] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1462] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1463] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1464] [Third embodiment]
[1465] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1466] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[1467] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1468] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1469] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1470] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1471] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1472] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1473] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1474] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1475] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1476] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1477] This invention is a system that matches elderly people with young people (especially university students) and supports their daily lives while eliminating feelings of loneliness. The system aims to reduce feelings of loneliness for elderly people and enable them to live fulfilling daily lives, while providing opportunities for young people to gain experience in the real world.
[1478] Program Overview
[1479] Registration Steps
[1480] 1. User (elderly)
[1481] Seniors use their devices to download the app and create an account.
[1482] Elderly people enter information such as their area of residence, hobbies, whether they have a car, and desired services (e.g., transportation, shopping accompaniment, conversation partner).
[1483] 2. Devices (elderly people's smartphones)
[1484] The information entered by the elderly person is converted into JSON format and sent to the server.
[1485] 3. Server
[1486] The server receives the information sent by the user and stores it in a database.
[1487] Similarly, university students (users) input their profile, schedule, and available services and send them to the server.
[1488] Matching Step
[1489] 1. Server
[1490] The requests of registered elderly people and the profiles of university students are obtained and a matching algorithm is run.
[1491] Generate a list of the most suitable college students as matching candidates.
[1492] 2. Server
[1493] The server then sends a notification to the potential matched university students, including basic information about the elderly person (e.g., residential area, desired services).
[1494] 3. Device (university student's smartphone)
[1495] The university student's terminal receives the matching notification and displays detailed information to the university student user.
[1496] 4. User (University Student)
[1497] College students can review the matching details and choose to accept or decline.
[1498] 5. Device (university student's smartphone)
[1499] The university student's selection is sent to the server.
[1500] 6. Server
[1501] The server receives the university student's selection and notifies the senior citizen if he or she accepts.
[1502] If a match is made, detailed service details and schedules will be provided to both parties.
[1503] Supported by generative AI
[1504] 1. Server
[1505] The server collects voice data and personality information from college students and trains a generative AI model.
[1506] If university students are absent, the generative AI will have the ability to automatically converse with the elderly.
[1507] 2. Users (elderly people)
[1508] Elderly people can interact with the generative AI through devices they are familiar with.
[1509] 3. Devices (elderly people's smartphones)
[1510] The elderly person's device activates the generation AI's dialogue function, and a dialogue between the generation AI and the elderly person begins.
[1511] 4. Server
[1512] The server stores the dialogue logs of the generated AI and uses them as training data for the next time.
[1513] Income and expenditure management and administrative procedure support
[1514] 1. Server
[1515] The server manages data on service usage fees for elderly people and app usage fees for university students.
[1516] Calculate compensation for college students and determine payment information.
[1517] 2. Users (elderly people)
[1518] Seniors can pay for services within the app.
[1519] 3. Devices (elderly people's smartphones)
[1520] The terminal transmits the payment information to the server.
[1521] 4. Server
[1522] After receiving payment confirmation, the server notifies the elderly person and, if necessary, supports administrative procedures for applying for nursing care insurance, etc.
[1523] This will allow the elderly to enjoy their daily lives more happily and youthfully, and young people to gain meaningful social experiences. Furthermore, the conversational support provided by generative AI will significantly reduce the sense of loneliness felt by the elderly.
[1524] The processing flow will be explained below.
[1525] Step 1:
[1526] Users (seniors) download the app using their devices and create an account. After creating the account, they log in and enter information such as their area of residence, hobbies, whether they have a car, and desired services (e.g., transportation, shopping accompaniment, conversation partner).
[1527] Step 2:
[1528] The terminal (elderly person's smartphone) converts the information entered by the elderly person into JSON format and sends it to the server.
[1529] Step 3:
[1530] The server receives the information sent by the user and stores it in a database. Similarly, university student users also input their profile, schedule, and available services and send them to the server.
[1531] Step 4:
[1532] The server retrieves the profiles of university students based on the elderly person's requests and conditions and runs a matching algorithm to generate a list of university students who best fit the elderly person's needs.
[1533] Step 5:
[1534] The server then sends a notification to the potential matched university students, including basic information about the elderly person (e.g., residential area, desired services).
[1535] Step 6:
[1536] The terminal (the university student's smartphone) receives the matching notification and displays detailed information to the university student user.
[1537] Step 7:
[1538] The user (college student) checks the matching details and chooses to accept or reject.
[1539] Step 8:
[1540] The terminal (the university student's smartphone) sends the student's selection to the server.
[1541] Step 9:
[1542] The server receives the student's selection and sends a notification to the elderly person if they accept. If a match is made, detailed service content and schedules are provided to both parties.
[1543] Step 10:
[1544] The server acquires the voice data and personality information of university students and trains the generative AI model, which then prepares a function for the generative AI to converse with the elderly when the university students are absent.
[1545] Step 11:
[1546] When the university student is not present, the user (elderly person) can interact with the generating AI through the terminal.
[1547] Step 12:
[1548] The device (elderly person's smartphone) activates the generative AI's dialogue function, and a dialogue between the generative AI and the elderly person begins.
[1549] Step 13:
[1550] The server stores the dialogue logs of the generated AI and uses them as training data for the future.
[1551] Step 14:
[1552] The server manages data on service fees for seniors and app fees for university students, calculates the university students' remuneration, and determines payment information.
[1553] Step 15:
[1554] Users (elderly people) can pay for the service within the app.
[1555] Step 16:
[1556] The terminal (elderly person's smartphone) sends payment information to the server.
[1557] Step 17:
[1558] After receiving payment confirmation, the server notifies the elderly person and, if necessary, supports administrative procedures for applying for nursing care insurance, etc.
[1559] Example 1
[1560] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1561] There is a need for a system that supports the elderly in their daily lives and prevents them from feeling lonely. At the same time, there are a lack of opportunities for young people to gain experience in the real world. Another issue is the lack of efficient and effective ways to match the elderly with young people. Furthermore, when university students are not available, it is important to find ways to alleviate the elderly's sense of loneliness. In addition, there is a need for a system that can comprehensively support income and expenditure management and assistance with administrative procedures.
[1562] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1563] In this invention, the server includes: an input means for elderly people to input their requests and requirements; an input means for young people to input their profile and available services; a storage means for storing the elderly people's requests and requirements and the young people's profiles in a database; a matching means for selecting an appropriate young person based on the elderly people's requests and requirements; a notification means for sending a matching notification to the selected young person; a dialogue means for the generative model to engage in dialogue based on the young person's voice data and personality information; a log storage means for storing the dialogue log of the generative model; and a service provision means for providing detailed service content and schedules for both the elderly and the young person. This makes it possible to reduce the elderly's sense of loneliness while providing young people with real-world experiences. Furthermore, elderly people can alleviate their loneliness through dialogue with the generative model even when their university students are away. Furthermore, by providing a system that comprehensively supports income and expenditure management and administrative procedures, more secure and convenient services can be realized.
[1564] "Elderly people" refers to people over a certain age who require a certain level of support in their daily lives and who may feel lonely.
[1565] "Young people" refers specifically to students and young adults seeking real-world experience.
[1566] "Input means" refers to an interface through which a user inputs specific information into the system.
[1567] "Storage means" refers to a component for recording and managing input information in a database.
[1568] "Matching methods" refer to algorithms and processes for selecting suitable young people based on the requests and conditions of older people.
[1569] "Notification means" refers to the method or system for sending the selection results and necessary information to matched young people.
[1570] A "generative model" refers to an artificial intelligence program that conducts dialogue based on young people's voice data and personality information.
[1571] "Dialogue method" refers to a method of using a generative model to enable natural language communication with the elderly.
[1572] "Log storage means" refers to a system or component for recording and storing the content and history of a conversation.
[1573] "Service provision means" refers to the method for providing detailed service content and schedule information to both the elderly and young people after a match is made.
[1574] "Income and expenditure management measures" refers to the systems and components that manage service fees for the elderly and app fees for young people.
[1575] "Remuneration calculation means" refers to a system or component for calculating a youth's compensation and determining payment information.
[1576] "Administrative procedure support measures" refers to systems and methods that support the procedures required for elderly people to access public assistance such as nursing care insurance.
[1577] MODE FOR CARRYING OUT THE INVENTION
[1578] The present invention is a system for matching elderly people with young people and supporting their daily lives. The purpose of this system is to reduce the sense of loneliness felt by elderly people and to provide young people with real-world experience. Specific embodiments of the system are described below.
[1579] 1. Registration Steps
[1580] Elderly information registration
[1581] User (elderly)
[1582] Seniors download a dedicated application onto their smartphones, create an account, and then enter their area of residence, hobbies, whether they have a car, and desired services (e.g., accompanying them on shopping trips, having someone to talk to, etc.).
[1583] Example: Elderly person A opens the app and fills out the form with "Tokyo," "reading," "none," and "accompany shopping."
[1584] Device (elderly person's smartphone)
[1585] The terminal converts the input information into JSON format and sends the information to the server.
[1586] server
[1587] The server stores the received information about the elderly person in a database.
[1588] Youth information registration
[1589] Users (young people)
[1590] Young people also download the app and create an account, filling out their profile and the services they can offer.
[1591] Devices (young people's smartphones)
[1592] The terminal converts the input information into JSON format and sends the information to the server.
[1593] server
[1594] The server stores the received information about the young people in a database.
[1595] 2. Matching step
[1596] server
[1597] The server runs a matching algorithm based on the elderly person's requests and the young person's profile information to generate a list of suitable young people, taking into account, for example, their area of residence and the services they can provide.
[1598] server
[1599] The server sends a notification to the potential matched young person, including basic information about the elderly person (e.g., residential area, desired services).
[1600] Devices (young people's smartphones)
[1601] The young person's device receives the notification and displays detailed information to the user.
[1602] Users (young people)
[1603] The young person reviews the match details and chooses to accept or decline.
[1604] Devices (young people's smartphones)
[1605] The selection results are sent to the server.
[1606] server
[1607] If the request is accepted, the server will notify the elderly person and officially establish a match. After the match is established, detailed service content and schedules will be provided to both parties.
[1608] 3. Generative AI support
[1609] server
[1610] The server receives voice data and personality information from young people and trains a generative AI model that automatically converses with the elderly when the young people are not present.
[1611] User (elderly)
[1612] Elderly people can interact with the generative AI through their smartphones.
[1613] Device (elderly person's smartphone)
[1614] The device activates the generation AI's dialogue function and begins a dialogue between the generation AI and the elderly person.
[1615] Specific operation: When elderly person A asks, "What book should I read today?", the generating AI responds, "I'll introduce you to the latest bestseller list."
[1616] server
[1617] The server stores the dialogue logs of the generated AI and uses them as training data for the next time.
[1618] 4. Income and expenditure management and administrative procedure support
[1619] server
[1620] The server manages the service fees for seniors and the app fees for young people, calculates the young people's rewards, and determines payment information.
[1621] User (elderly)
[1622] Seniors can pay for services within the app.
[1623] Device (elderly person's smartphone)
[1624] Send payment information to the server.
[1625] server
[1626] After payment is confirmed, a notification will be sent and support will be provided for administrative procedures such as nursing care insurance if necessary.
[1627] Example prompts for generative AI models
[1628] "A 70-year-old elderly person, Mr. A, would like to go shopping. Please accompany him. Mr. A lives in the XX area. Mr. A's hobby is reading."
[1629] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1630] Step 1:
[1631] Elderly information registration
[1632] User (elderly)
[1633] Seniors download the app using their smartphones, create an account, and then enter their area of residence, hobbies, whether they have a car, and desired services (e.g., shopping accompaniment, conversation partner, etc.).
[1634] Input: area of residence, hobbies, whether you have a car, desired service details
[1635] Output: User information in JSON format
[1636] Specific actions: Elderly person A opens the app and fills in the form with "Tokyo," "reading," "none," and "accompany shopping."
[1637] Device (elderly person's smartphone)
[1638] The terminal converts the input information into JSON format and sends the information to the server.
[1639] Input: Information entered by the user
[1640] Output: JSON information sent to the server
[1641] server
[1642] The server stores the received information about the elderly person in a database.
[1643] Input: JSON format information sent from the terminal
[1644] Output: User information stored in the database
[1645] Step 2:
[1646] Youth information registration
[1647] Users (young people)
[1648] Young people also download the app and create an account, filling out their profile and the services they can offer.
[1649] Input: Profile information, available services
[1650] Output: User information in JSON format
[1651] Devices (young people's smartphones)
[1652] The terminal converts the input information into JSON format and sends the information to the server.
[1653] Input: Information entered by the user
[1654] Output: JSON information sent to the server
[1655] server
[1656] The server stores the received information about the young people in a database.
[1657] Input: JSON format information sent from the terminal
[1658] Output: User information stored in the database
[1659] Step 3:
[1660] Executing the Matching
[1661] server
[1662] The server runs a matching algorithm based on the elderly person's requests and the young person's profile information to generate a list of the most suitable young people.
[1663] Input: Elderly person's request, young person's profile information
[1664] Output: A list of the best young people
[1665] Specific operation: The server analyzes Tanaka's request and lists the young people who are available and who best fit his / her requirements.
[1666] Step 4:
[1667] Sending matching notifications
[1668] server
[1669] The server then sends a notification to the potential matched young person, including basic information about the elderly person (e.g., their residential area and desired services).
[1670] Input: List of young people, basic information of elderly people
[1671] Output: Notification sent to the young person
[1672] Devices (young people's smartphones)
[1673] The young person's device receives the notification and displays detailed information.
[1674] Input: Notification from the server
[1675] Output: what is displayed to the user
[1676] Specific operation: A push notification is sent to the young person's device, displaying the message, "Elderly person A wants to accompany you shopping."
[1677] Step 5:
[1678] Youth Choice
[1679] Users (young people)
[1680] The young person reviews the match details and chooses to accept or decline.
[1681] Input: Match details
[1682] Output: Choice of Accept or Reject
[1683] Devices (young people's smartphones)
[1684] The terminal transmits the selection result to the server.
[1685] Input: Accept or reject
[1686] Output: Selection results sent to the server
[1687] Step 6:
[1688] Matching confirmation and service provision
[1689] server
[1690] If the request is accepted, the server will send a notification to the elderly person to confirm the match. After the match is established, detailed service content and schedules will be provided to both parties.
[1691] Input: Young people's choice results
[1692] Output: Notification to the elderly and detailed service content and schedule
[1693] Specific operation: After the matching is accepted, the server sends the service details and schedule to the elderly and young people.
[1694] Step 7:
[1695] Supported by generative AI
[1696] server
[1697] The server receives voice data and personality information from young people and trains a generative AI model, which then converses with the elderly when they are absent.
[1698] Input: Young people's voice data, personality information
[1699] Output: A trained generative AI model
[1700] User (elderly)
[1701] Elderly people can interact with the generative AI through their smartphones.
[1702] Input: Utterance
[1703] Output: AI response
[1704] Device (elderly person's smartphone)
[1705] The device activates the generation AI's dialogue function and begins a dialogue between the generation AI and the elderly person.
[1706] Input: Senior's voice / text
[1707] Output: Response from the generation AI
[1708] Specific behavior: In response to the question, "What book should I read today?", the generative AI responds, "I'll show you the latest bestsellers."
[1709] server
[1710] The server stores the dialogue logs of the generated AI and uses them as training data for the next time.
[1711] Input: Interaction log
[1712] Output: Saved log data
[1713] Step 8:
[1714] Income and expenditure management and administrative procedure support
[1715] server
[1716] The server manages the service fees for the elderly and the app fees for the young, calculates the young's remuneration, and determines payment information.
[1717] Input: Service usage data, app usage data
[1718] Output: Income and expenditure data, payment information
[1719] User (elderly)
[1720] Seniors can pay for services within the app.
[1721] Input: Payment Information
[1722] Output: Payment for the service
[1723] Device (elderly person's smartphone)
[1724] The terminal transmits the payment information to the server.
[1725] Input: Payment data
[1726] Output: Payment information sent to the server
[1727] server
[1728] After payment is confirmed, a notification will be sent and support will be provided for administrative procedures such as nursing care insurance if necessary.
[1729] Input: Payment Verification Information
[1730] Output: Notification to the elderly and administrative procedure support
[1731] (Application example 1)
[1732] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1733] In modern society, the sense of loneliness felt by older adults and the lack of support for daily life are serious issues. Furthermore, university students have limited opportunities to gain real-world experience, limiting their future opportunities for growth and contribution to society. Furthermore, there is a lack of support for meal preparation and delivery, which is particularly difficult for older adults, and this needs to be addressed.
[1734] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1735] In this invention, the server includes: an input means for elderly people to input their requests and requirements; an input means for university students to input their profiles and available services; a storage means for storing the elderly people's requests and requirements and the university students' profiles in a database; a matching means for selecting suitable university students based on the elderly people's requests and requirements; a notification means for sending a matching notification to the selected university students; a dialogue means for the generation AI to engage in dialogue based on the university students' voice data and personality information; a log storage means for saving the dialogue log of the generation AI; a request means for elderly people to order meals and request support; a receiving means for university students to receive meal-related requests from elderly people; and a delivery management means for managing meal orders and delivery. This allows elderly people to enrich their daily lives while alleviating feelings of loneliness, and allows university students to gain real-world experience. Furthermore, the quality of life of elderly people is improved, especially by providing more support for meal preparation and delivery.
[1736] "Elderly" refers to an older person who requires special assistance in daily life.
[1737] "University student" refers to a young person enrolled in a university who is studying academic or technical subjects.
[1738] "Input means" refers to a device or interface that allows a user to input information into a system.
[1739] "Storage means" refers to the technology or device used to store input information in a database.
[1740] "Matching means" refers to the algorithms and devices used to select the most suitable elderly people and university students based on the conditions within the system.
[1741] "Notification means" refers to the technology or device used to notify the target person of selected information.
[1742] "Generative AI" refers to artificial intelligence that uses machine learning technology to generate natural language and engage in dialogue.
[1743] "Interaction means" refers to the interface or technology that enables the generative AI to interact with the user.
[1744] "Log storage means" refers to technology or devices for storing records of interactions conducted by the generating AI.
[1745] "Request means" refers to the interface or device that allows elderly people to order meals or request assistance.
[1746] "Means of receipt" refers to the technology and equipment that university students use to receive requests from elderly people.
[1747] "Delivery management means" refers to systems and technologies for managing food order and delivery information.
[1748] This invention is a system that matches elderly people with university students and supports their daily lives while reducing feelings of loneliness. This system will be described below.
[1749] The server consists of an input means for elderly people to input their requests and requirements, an input means for university students to input their profile and the services they can provide, and a storage means for saving this information. Information on elderly people and university students is saved in a database and can be searched and updated as needed.
[1750] The matching means selects a university student who meets the elderly person's needs based on the information stored in the database. A matching notification is sent to the selected university student through the notification means. This allows the elderly person and the university student to be appropriately matched.
[1751] The generative AI provides a dialogue means for conversing with elderly people based on the voice data and personality information of university students. This dialogue means includes a log storage means for saving the dialogue log of the generative AI. The generative AI automatically converses with elderly people on behalf of university students when they are absent or busy.
[1752] The system also includes a requesting mechanism for seniors to order meals and request assistance, and a receiving mechanism for university students to receive those requests. This allows for efficient management of meal preparation and delivery for seniors. It also includes a delivery management mechanism for managing information on meal orders and delivery.
[1753] To implement this invention, cloud platforms such as AWS and Google Cloud are used for the servers, ensuring high scalability and reliability of the system. Relational databases such as PostgreSQL and MongoDB or NoSQL databases are used for the databases. Front-end applications are developed using cross-platform development frameworks such as React Native and Flutter.
[1754] The generative AI uses machine learning models such as GPT-4. To enable natural conversations with the elderly, the AI uses voice data from university students as training data. The content of the conversations the AI has is saved as a log and used as training data for the next round.
[1755] Examples:
[1756] If an elderly person, Person A, wants to buy ingredients for dinner, he or she will send a request using the app. This request will be received by University student Person B, who will purchase the appropriate ingredients based on Person A's request and deliver them to Person A's home. If the University student is busy, the generated AI will converse with Person A on his or her behalf to confirm the necessary information.
[1757] Example prompt sentence:
[1758] Prompt for the senior to type: "Can you please buy the ingredients for dinner next Monday?"
[1759] A prompt sentence that a university student converses with the generative AI on his / her behalf: "I'm going shopping now. Can you give me a list of what I'm going to buy?"
[1760] This will improve the quality of life for seniors, allow university students to gain social experience, and reduce feelings of loneliness among seniors through conversational support provided by generative AI.
[1761] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1762] Step 1:
[1763] The user (senior citizen) launches the app using their smartphone and inputs their requests and conditions (area of residence, hobbies, whether they have a car, desired service details, etc.). The input information is converted to JSON format and sent to the server. At this time, the input data includes text information about the area of residence, hobbies, and desired service details, and JSON format data is generated as the output.
[1764] Step 2:
[1765] Similarly, the device (university student) inputs their profile, schedule, and available services and sends the data to the server. In this process, the input data also includes text information about the profile, schedule, and available services, and the output data is generated in JSON format.
[1766] Step 3:
[1767] The server saves the input data of the elderly and university students in a database. The database manages this information and searches and updates it as needed. In doing so, it parses the JSON data received as input and saves it in the appropriate table. The status of the save confirmation is generated as output.
[1768] Step 4:
[1769] The server runs a matching algorithm based on the information stored in the database, selecting the university student who best suits the elderly person's needs and creating a list of match candidates. This process uses the elderly person's needs and the university student's profile as input data, applies the matching algorithm, and generates a list of match candidates as output.
[1770] Step 5:
[1771] The server sends a matching notification to the selected university students. The notification includes basic information about the elderly person (e.g., residential area, desired services). In this process, the list of matching candidates and related information are used as input data, and a notification message is generated as output.
[1772] Step 6:
[1773] The device (university student) receives the matching notification and displays detailed information. The university student checks the elderly person's information and inputs whether to accept or reject the match. At this time, detailed information is displayed and the university student's selection is made as input data, and the selection result is sent to the server as output.
[1774] Step 7:
[1775] The server receives the university student's selection results and notifies the elderly person if they accept. If a match is made, detailed service content and schedules are provided to both parties. The university student's selection results are used as input data, and service content and schedule information are generated as output.
[1776] Step 8:
[1777] The generative AI converses with the elderly based on the voice data and personality information of university students. The elderly provide input for the dialogue with the generative AI, which then generates an appropriate response based on that input. The elderly person asks a question as input, and the generative AI's response is displayed as output.
[1778] Step 9:
[1779] The dialogue log of the generation AI is saved by the server using a log saving means. The saved log is used as training data for the next training. At this time, the dialogue content of the generation AI is used as input data, and the dialogue log saved as output is generated.
[1780] Step 10:
[1781] Elderly people use a requesting tool to order meals or request assistance and send a request from their device. The request is received by a university student and output as an executable service. Meal order information is used as input data, and a notification of request receipt is generated as output.
[1782] Step 11:
[1783] The university student uses the receiving means to confirm the elderly person's request and delivers the meal through the delivery management means. The specific delivery schedule and delivery contents are managed and notified to the elderly person. The delivery schedule and delivery contents are used as input data, and a delivery completion report is generated as output.
[1784] Through these processing steps, the system can support the elderly in their daily lives and provide real-world experience to university students.
[1785] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1786] This invention relates to a system that matches elderly people with young people (especially university students) and supports their daily lives while eliminating feelings of loneliness using an emotion engine. The system aims to reduce feelings of loneliness for elderly people, enable them to live fulfilling daily lives, and provide opportunities for young people to gain experience in the real world. Furthermore, the emotion engine recognizes the user's emotions, providing more personalized services.
[1787] Program Overview
[1788] Registration Steps
[1789] 1. User (elderly)
[1790] Seniors use their devices to download the app and create an account.
[1791] Elderly people enter information such as their area of residence, hobbies, whether they have a car, and desired services (e.g., transportation, shopping accompaniment, conversation partner).
[1792] 2. Devices (elderly people's smartphones)
[1793] The information entered by the elderly person is converted into JSON format and sent to the server.
[1794] 3. Server
[1795] The server receives the information sent by the user and stores it in a database.
[1796] Similarly, university student users input their profile, schedule, and available services and send them to the server.
[1797] Matching Step
[1798] 1. Server
[1799] The requests of registered elderly people and the profiles of university students are obtained and a matching algorithm is run.
[1800] Generate a list of the most suitable college students as matching candidates.
[1801] 2. Server
[1802] The server then sends a notification to the potential matched university students, which includes basic information about the elderly person (e.g., residential area, desired services).
[1803] 3. Device (university student's smartphone)
[1804] The university student's terminal receives the matching notification and displays detailed information to the university student user.
[1805] 4. User (University Student)
[1806] College students can review the matching details and choose to accept or decline.
[1807] 5. Device (university student's smartphone)
[1808] The university student's selection is sent to the server.
[1809] 6. Server
[1810] The server receives the student's selection and sends a notification to the elderly person if they accept. If a match is made, detailed service content and schedules are provided to both parties.
[1811] Supported by generative AI
[1812] 1. Server
[1813] The server collects voice data and personality information from college students and trains a generative AI model.
[1814] If university students are absent, the generative AI will have the ability to automatically converse with the elderly.
[1815] 2. Users (elderly people)
[1816] Elderly people can interact with the generative AI through devices they are familiar with.
[1817] 3. Devices (elderly people's smartphones)
[1818] The elderly person's device activates the generation AI's dialogue function, and a dialogue between the generation AI and the elderly person begins.
[1819] 4. Server
[1820] The server stores the dialogue logs of the generated AI and uses them as training data for the next time.
[1821] Emotion engine integration
[1822] 1. Server
[1823] The server analyzes the emotional state of the elderly person using an emotion engine, which has the ability to recognize the user's emotions from voice and text data.
[1824] 2. Means of interaction
[1825] The emotion engine dynamically adjusts the dialogue content for the elderly based on their emotional state. For example, if the elderly feels sad, it will offer words of encouragement or topics to cheer them up.
[1826] 3. Log storage method
[1827] Emotion data analyzed by the emotion engine is stored along with the dialogue log, allowing the generative AI to deliver more personalized dialogue based on past emotional data.
[1828] Income and expenditure management and administrative procedure support
[1829] 1. Server
[1830] The server manages data on service fees for seniors and app fees for university students, calculates the university students' remuneration, and determines payment information.
[1831] 2. Users (elderly people)
[1832] Seniors can pay for services within the app.
[1833] 3. Devices (elderly people's smartphones)
[1834] The terminal transmits the payment information to the server.
[1835] 4. Server
[1836] After receiving payment confirmation, the server notifies the elderly person and, if necessary, supports administrative procedures for applying for nursing care insurance, etc.
[1837] As a result, a system integrating an emotion engine can analyze the emotional state of elderly people and provide more personalized dialogue and support, significantly reducing their sense of loneliness and helping them live richer lives.
[1838] The processing flow will be explained below.
[1839] Step 1:
[1840] Users (seniors) download the app using their devices and create an account. After creating the account, they log in and enter information such as their area of residence, hobbies, whether they have a car, and desired services (e.g., transportation, shopping accompaniment, conversation partner).
[1841] Step 2:
[1842] The terminal (elderly person's smartphone) converts the information entered by the elderly person into JSON format and sends it to the server.
[1843] Step 3:
[1844] The server receives the information sent by the user and stores it in a database. Similarly, university student users input their profile, schedule, and available services and send them to the server.
[1845] Step 4:
[1846] The server retrieves the profiles of university students based on the elderly person's requests and conditions and runs a matching algorithm to generate a list of university students who best fit the elderly person's needs.
[1847] Step 5:
[1848] The server then sends a notification to the potential matched university students, which includes basic information about the elderly person (e.g., residential area, desired services).
[1849] Step 6:
[1850] The terminal (the university student's smartphone) receives the matching notification and displays detailed information to the university student user.
[1851] Step 7:
[1852] The user (college student) checks the matching details and chooses to accept or reject.
[1853] Step 8:
[1854] The terminal (the university student's smartphone) sends the student's selection to the server.
[1855] Step 9:
[1856] The server receives the student's selection and notifies the elderly person if they accept. If a match is made, detailed service content and schedules are provided to both parties.
[1857] Step 10:
[1858] The server collects the voice data and personality information of university students and trains the generative AI model. When the university students are absent, the generative AI prepares a function to automatically converse with the elderly.
[1859] Step 11:
[1860] When the university student is not present, the user (elderly person) can interact with the generating AI through the terminal.
[1861] Step 12:
[1862] The device (elderly person's smartphone) activates the Generative AI's dialogue function and begins a dialogue between the Generative AI and the elderly person. At that time, the Generative AI uses the elderly person's voice and text data to perform emotion analysis using its emotion engine.
[1863] Step 13:
[1864] The server stores the dialogue logs generated by the generation AI and the emotion analysis data generated by the emotion engine, and uses these as training data for the next time.
[1865] Step 14:
[1866] The server uses an emotion engine to analyze the elderly person's emotional state and dynamically adjust the dialogue content, for example, if the elderly person feels sad, it will provide words of encouragement or topics to cheer them up.
[1867] Step 15:
[1868] The server manages data on service fees for seniors and app fees for university students, calculates the university students' remuneration, and determines payment information.
[1869] Step 16:
[1870] Users (elderly people) can pay for the service within the app.
[1871] Step 17:
[1872] The terminal (elderly person's smartphone) sends payment information to the server.
[1873] Step 18:
[1874] After receiving payment confirmation, the server notifies the elderly person and, if necessary, supports administrative procedures for applying for nursing care insurance, etc.
[1875] Example 2
[1876] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1877] In modern society, elderly people face serious problems such as loneliness and lack of support for daily life. It is not easy for them to properly communicate their needs and requirements and match them with the right support provider. Furthermore, there is a lack of services that cater to the emotional state of the elderly, leaving many elderly people seeking mental health care. Meanwhile, young people have fewer opportunities to gain real-world experience and lack social involvement. Therefore, there is a need for a system that can properly match elderly people with young people and provide personalized services based on emotion recognition.
[1878] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1879] In this invention, the server includes: an input means for the elderly to input their requests and requirements; an input means for the young person to input their profile and the services they can provide; a storage means for storing the elderly's requests and requirements and the young person's profile in a database; a matching means for selecting an appropriate young person based on the elderly's requests and requirements; a notification means for sending a matching notification to the selected young person; a dialogue means for the generation AI to engage in a dialogue based on the young person's voice data and personality information; a log storage means for saving the dialogue log of the generation AI; an emotion analysis means for analyzing the emotional state of the elderly using an emotion engine; and a dialogue adjustment means for adjusting the dialogue content based on the emotion analysis results. This makes it possible to reduce the elderly's sense of loneliness and provide personalized emotional support while providing young people with opportunities to gain experience in the real world.
[1880] "Input means" refers to devices or interfaces that allow older people and younger people to input information such as their needs, profiles, and available services.
[1881] The "storage means" is a function or device for storing the requests and conditions of the elderly and the profile information of the young people in a database.
[1882] The "matching means" refers to the algorithms and processing functions for selecting the most suitable young person based on the elderly person's requests and conditions.
[1883] The "notification means" is a function or device for sending a notification regarding a match to the selected young person.
[1884] "Dialogue means" refers to a function or device that enables the generation AI to engage in dialogue with the elderly based on the voice data and personality information of the young person.
[1885] "Log storage means" refers to a function or device for storing a log of the dialogue conducted by the generation AI.
[1886] The "emotion analysis means" is a function or device for analyzing the emotional state of the elderly person using an emotion engine.
[1887] The "dialogue adjustment means" is a function or device for dynamically adjusting the dialogue content provided to the elderly based on the emotion analysis results.
[1888] The "income and expenditure management means" is a function or device for managing service usage fees for the elderly and app usage fees for young people.
[1889] A "remuneration calculation means" is a function or device for calculating a youth's remuneration and determining payment information.
[1890] "Administrative procedure support means" refers to a function or device that supports administrative procedures so that elderly people can use nursing care insurance, etc.
[1891] The present invention is a system that matches elderly people with young people, alleviates feelings of loneliness using an emotion engine, and supports daily life. The system includes the following means.
[1892] Registration method
[1893] Elderly and young people use devices such as smartphones to input their respective requests, profiles, and available services. For example, elderly people input their residential area, hobbies, and desired services (e.g., transportation, shopping accompaniment, conversation partner). Meanwhile, young people input their own profiles, schedules, and available services. This information is converted into JSON format by the device and sent to the server as an HTTP POST request.
[1894] Preservation means
[1895] The server analyzes the received JSON data and stores it in a database, allowing the requests and conditions of the elderly and the profile information of the young people to be managed in a unified manner.
[1896] Matching Method
[1897] The server retrieves the elderly person's needs and the young person's profile from the database and runs a matching algorithm that generates a list of suitable young people using criteria such as geographical proximity and similar interests, thereby selecting the young person who best suits the elderly person's needs.
[1898] Notification means
[1899] The server then sends a push notification to the selected young person, which includes basic information such as the elderly person's residential area and desired service. The young person receives the notification on their smartphone and checks the detailed information.
[1900] Interaction methods
[1901] The generative AI will converse with the elderly based on the younger person's voice data and personality information. For example, if the younger person is not present, the generative AI will automatically ask the elderly questions such as, "How was your day?" The elderly can enjoy everyday conversations through the generative AI.
[1902] Log storage method
[1903] The server stores the logs of the conversations that the AI has had and uses them as training data for the next time. This allows the AI to provide more personalized conversations based on past conversation data.
[1904] Emotion analysis means
[1905] An emotion engine is used to analyze the emotional state of the elderly person from their voice and text data, for example, by analyzing their tone of voice and word choice to determine their emotional state.
[1906] Dialogue coordination means
[1907] The server dynamically adjusts the dialogue content based on the results of emotion analysis. For example, if an elderly person appears sad, the AI generator can be configured to offer encouraging words.
[1908] Income and expenditure management methods
[1909] The server manages the service fees for seniors and the app fees for young people. The server calculates the remuneration for young people and determines payment information.
[1910] Administrative procedure support tools
[1911] The server supports administrative procedures so that elderly people can use nursing care insurance, etc. The server collects necessary information and assists elderly people in the appropriate procedures.
[1912] Specific examples
[1913] As a concrete example of how this works, the following prompt might be entered:
[1914] Elderly Registration Procedure:
[1915] 1. Seniors download the app on their smartphones and click the "Sign Up" button.
[1916] 2. Enter your name, age, address, hobbies, and desired service (e.g., accompanying you shopping), then press the "Submit" button.
[1917] Matching Procedure:
[1918] 1. The server retrieves the elderly person's preferences and the young person's profile data and uses an algorithm to perform the best match.
[1919] 2. A "new match notification" will be sent to the young person's smartphone, and when the user opens the app, detailed information will be displayed.
[1920] 3. When the young person clicks the consent button, the selection information is sent to the server and the elderly person is notified.
[1921] Generative AI support:
[1922] 1. If the younger person is not present, the generating AI will ask the older person, "How are you doing lately?"
[1923] 2. If the elderly person answers, "I feel a little lonely," the generating AI continues, "What do you like to do when you feel lonely?"
[1924] Through these aspects, the present invention can significantly reduce the sense of loneliness felt by the elderly and provide a valuable opportunity for young people to gain real-world experience.
[1925] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1926] Step 1:
[1927] User (elderly)
[1928] Seniors use their smartphones to download the app and create an account.
[1929] Input: Name, age, address, hobbies, desired service (e.g., shopping accompaniment)
[1930] Action: Enter the required information on the app's sign-up screen and press the "Submit" button.
[1931] Output: The user's basic information is saved on the device and converted to JSON format in the next step.
[1932] Step 2:
[1933] Device (elderly person's smartphone)
[1934] The information entered by the user is converted into JSON format and sent to the server as an HTTP POST request.
[1935] Input: Basic information entered by the user (name, age, address, hobbies, desired service)
[1936] Behavior: Converts input data into JSON format and sends it to the server.
[1937] Output: JSON formatted data is sent to the server.
[1938] Step 3:
[1939] server
[1940] Parse the received JSON data and save it in the database.
[1941] Input: Basic information data of elderly people in JSON format
[1942] What it does: Parses JSON data and stores it in a database. It performs the parsing process and maps each field to the appropriate database column.
[1943] Output: Basic information of the elderly is saved in the database.
[1944] Step 4:
[1945] User (younger people)
[1946] Young people fill out their profile and the services they can offer.
[1947] Input: Name, age, address, hobbies, available services (e.g. conversation partner, shopping accompaniment)
[1948] Action: Enter the required information on the app's sign-up screen and press the "Submit" button.
[1949] Output: The user's basic information is saved on the device and converted to JSON format in the next step.
[1950] Step 5:
[1951] Devices (young people's smartphones)
[1952] The information entered by the young person is converted into JSON format and sent to the server as an HTTP POST request.
[1953] Input: Basic information entered by the young person (name, age, address, hobbies, available services)
[1954] Behavior: Converts input data into JSON format and sends it to the server.
[1955] Output: JSON formatted data is sent to the server.
[1956] Step 6:
[1957] server
[1958] Parse the received JSON data and save it in the database.
[1959] Input: Basic information data of young people in JSON format
[1960] What it does: Parses JSON data and stores it in a database. It performs the parsing process and maps each field to the appropriate database column.
[1961] Output: Basic information about the young person is saved in the database.
[1962] Step 7:
[1963] server
[1964] The database retrieves the elderly person's requests and the young person's profile, and then runs a matching algorithm.
[1965] Input: Elderly requests and young people's profiles stored in a database
[1966] How it works: It uses an algorithm to match people based on criteria such as geographic proximity or shared interests.
[1967] Output: Generate a list of the most suitable young people.
[1968] Step 8:
[1969] server
[1970] Push notifications are sent to selected young people.
[1971] Input: List of most suitable young people, basic information of elderly people
[1972] How it works: A push notification is generated and sent to the selected young person, including the senior's location and desired services.
[1973] Output: A notification is sent to the young person's smartphone.
[1974] Step 9:
[1975] Devices (young people's smartphones)
[1976] Receive notifications and view more information.
[1977] Input: Push notification from the server
[1978] What it does: The app receives a notification and displays more information to the user.
[1979] Output: A screen will be displayed where the user (young person) can review the details and choose to accept or decline.
[1980] Step 10:
[1981] User (younger people)
[1982] Review the details and accept or reject the match.
[1983] Input: Match details
[1984] Action: The young person operates the screen and chooses whether to accept or reject the request. To accept, they click the "Accept" button, and to reject, they click the "Reject" button.
[1985] Output: An accept or reject choice is created and sent to the server in the next step.
[1986] Step 11:
[1987] Devices (young people's smartphones)
[1988] The accept or reject choice is sent to the server.
[1989] Input: Accept or reject selection information
[1990] What it does: Sends the selection to the server as an HTTP POST request.
[1991] Output: The accept or reject choice is sent to the server.
[1992] Step 12:
[1993] server
[1994] The younger person's selection is received and, if accepted, a notification is sent to the older person.
[1995] Input: Young person's consent or denial selection information
[1996] What it does: Parse the selection and, if accepted, generate and send a push notification to the senior.
[1997] Output: If accepted, a match confirmation notification is sent to the senior.
[1998] Step 13:
[1999] server
[2000] The generative AI trains the dialogue module based on young people's voice data and personality information.
[2001] Input: Young person's voice data and personality information
[2002] How it works: A generative AI model is used to analyze young people's voice data and personality information, which is then used as training data.
[2003] Output: A trained generative AI model
[2004] Step 14:
[2005] User (elderly)
[2006] Elderly people can interact with the generating AI through the devices they use.
[2007] Input: Senior voice or text input
[2008] How it works: Dialogue is conducted in real time using generative AI. For example, the generative AI asks, "How are you doing lately?"
[2009] Output: Dialogue data between the elderly person and the generative AI
[2010] Step 15:
[2011] Device (elderly person's smartphone)
[2012] Activate the generation AI's dialogue function and begin the dialogue.
[2013] Input: Voice or text input by seniors
[2014] Behavior: Recognizes input and initiates a dialogue with the generative AI.
[2015] Output: Voice or text data during the conversation
[2016] Step 16:
[2017] server
[2018] The conversation logs of the generating AI are saved and used as training data for the next time.
[2019] Input: Conversation log between the generative AI and the elderly person
[2020] What it does: Saves the conversation log to a database and uses it for the next generative AI training.
[2021] Output: Saved interaction logs
[2022] Step 17:
[2023] server
[2024] An emotion engine is used to analyze the emotional state of the elderly and dynamically adjust the dialogue content.
[2025] Input: Elderly person's voice or text data
[2026] How it works: Analyzes data using an emotion engine to determine emotional state.
[2027] Output: Dialogue based on emotional state
[2028] Step 18:
[2029] server
[2030] Manages service fees for the elderly and app fees for young people and calculates rewards.
[2031] Input: Service usage history of elderly people, service provision history of young people
[2032] Operation: Manages usage fees and calculates remuneration using the financial management tool. Determines payment information and notifies the senior.
[2033] Output: User fee management information for elderly people, reward information for young people
[2034] Step 19:
[2035] server
[2036] We support administrative procedures so that elderly people can use nursing care insurance and other services.
[2037] Input: Elderly user status, necessary administrative procedures
[2038] Function: Collects necessary information and assists with application procedures for nursing care insurance, etc.
[2039] Output: Supporting information for administrative procedures
[2040] Through these concrete steps, the system can reduce loneliness among older people and provide real-world experience for younger people.
[2041] (Application example 2)
[2042] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[2043] There is a need for a system that can effectively support elderly people in their daily lives and alleviate their feelings of loneliness. Strengthening security for elderly people is also important, and it is desirable to be able to quickly detect and respond to any abnormalities related to this. Furthermore, simplifying the procedures and cost management for receiving this support is also a challenge.
[2044] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: input means for the elderly person to input their requests and requirements; input means for the user to input their profile and available services; storage means for storing the elderly person's requests and requirements and the user's profile in a database; matching means for selecting an appropriate user based on the elderly person's requests and requirements; notification means for sending a matching notification to the selected user; dialogue means for the generation AI to engage in dialogue based on the user's voice data and personality information; log storage means for saving the dialogue log of the generation AI; analysis means for analyzing the elderly person's emotional state using an emotion engine; adjustment means for dynamically adjusting the dialogue content for the elderly person based on the analysis results; and abnormality notification means for sending a notification when a security-related abnormality is detected. This makes it possible to reduce the elderly person's sense of loneliness, support their daily lives, and strengthen security.
[2045] "Elderly" refers to people who are getting older and require support from others and professional help.
[2046] "Requests and conditions" refer to the matters and requests that are necessary for elderly people to receive life support and interactive services.
[2047] "Users" are all people who use the system, including young people and students, who provide services to support the elderly in particular.
[2048] "Profile" refers to information that describes a user's basic personal information, qualifications, and the services that can be provided.
[2049] "Database" refers to a system for effectively managing stored information and making it easy to search and reference.
[2050] "Matching" refers to the process of matching the requests, conditions, and profile information of elderly people and users to find the optimal match.
[2051] "Notification" refers to the system sending a message to the selected user to inform them of the matching result.
[2052] "Generative AI" refers to artificial intelligence technology that generates dialogue based on a user's voice data and personality information.
[2053] "Emotion engine" refers to technology for analyzing a user's emotional state from voice and text data.
[2054] "Analysis results" refers to information about the user's emotional state analyzed by the emotion engine.
[2055] "Abnormal" refers to an unusual emotional state or security issue, often a situation that requires immediate attention.
[2056] "Security" refers to protective and conservation measures to ensure that elderly people can live in peace.
[2057] "Log" refers to recorded data such as past interactions and system operation history.
[2058] "Notification means" refers to methods or functions for notifying specific people or systems of abnormalities or important information.
[2059] "Adjustment means" refers to a function that enables the system to dynamically change the content of dialogue and the content of services according to the needs of the user.
[2060] The present invention relates to a system for relieving the sense of loneliness of elderly people, supporting their daily lives, and strengthening security. This system aims to provide an environment in which elderly people can live with peace of mind.
[2061] System configuration
[2062] Hardware
[2063] Smartphones: Devices used by the elderly, used as a means of input and communication.
[2064] Server: Hosts the database, generative AI models, and emotion engine.
[2065] Sensors: Sensors to monitor the elderly person's environmental variables as needed (e.g., temperature and humidity sensors).
[2066] software
[2067] Emotion engine: Voice analysis technology using NVIDIA DeepStream SDK.
[2068] Generative AI model: A dialogue generation engine using OpenAI's GPT-3.
[2069] Database: AWS RDS is used.
[2070] Data processing and calculation
[2071] The server stores the input information of the elderly and users (in this case, young people and students) in a database and performs matching based on this information. The emotional state of the elderly is analyzed using an emotion engine, and the generation AI engages in dialogue as necessary. The detailed process of the system is explained below.
[2072] 1. Data Collection
[2073] Elderly people use their smartphones to input their requests and conditions (such as their residential area, hobbies, desired service content, etc.) This information is converted into JSON format and sent to the server.
[2074] 2. Storage of Information
[2075] The server stores the elderly's requests and conditions, as well as user profile information (qualifications, available services, etc.) in a database.
[2076] 3. Matching
[2077] The server matches the elderly person's requests and conditions with the user's profile to find the best match, and sends a match notification to the selected user.
[2078] 4. Emotion analysis
[2079] The emotion engine analyzes the emotional state of elderly people from their daily conversations and voice data, and this emotional state data is stored on a server.
[2080] 5. Generative AI Dialogue
[2081] If an abnormality in the elderly person's emotional state is detected, a generative AI model (GPT-3) generates a dialogue to provide reassurance. Specific prompt examples:
[2082] "You seem a little down, is there something bothering you?"
[2083] 6. Data storage and abnormality notification
[2084] The conversation logs with the generative AI are stored in a database and used as training data for the next round. If the emotion engine detects an abnormality, it will send a notification to relatives or a monitoring center. The notification will include the current emotional state and past logs.
[2085] This will help reduce the sense of loneliness among the elderly, support them in their daily lives, and strengthen security.
[2086] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[2087] Step 1:
[2088] input:
[2089] Elderly people use their smartphones to input their requests and conditions (e.g., area of residence, hobbies, desired services).
[2090] process:
[2091] The terminal converts the input information into JSON format and sends it to the server.
[2092] output:
[2093] The elderly person's requests and requirements are sent to the server.
[2094] Specific behavior:
[2095] Seniors access the app on their smartphones, enter their details into various input fields, and press the submit button. This information is encoded in JSON format by the smartphone app and sent to the server's API.
[2096] Step 2:
[2097] input:
[2098] The user (university student) uses a smartphone to enter their profile and the services that can be provided.
[2099] process:
[2100] The terminal converts the input information into JSON format and sends it to the server.
[2101] output:
[2102] The user's profile and information about available services are sent to the server.
[2103] Specific behavior:
[2104] A user (a university student) accesses the smartphone app, enters details into various input fields, and presses the submit button. This information is encoded into JSON format by the smartphone app and sent to the server's API.
[2105] Step 3:
[2106] input:
[2107] The elderly person's requests and conditions, as well as the user's profile information, are sent to the server.
[2108] process:
[2109] The server stores this information in a database.
[2110] output:
[2111] The elderly's requests and conditions, as well as user profile information, are stored in a database.
[2112] Specific behavior:
[2113] The server parses the received JSON data, extracts each field, and stores it in a database using AWS RDS.
[2114] Step 4:
[2115] input:
[2116] The elderly's requests and conditions, as well as user profile information, are stored in a database.
[2117] process:
[2118] The server runs a matching algorithm to select suitable users based on the elderly person's needs and requirements.
[2119] output:
[2120] A list of matched users.
[2121] Specific behavior:
[2122] The server retrieves the elderly's requests and conditions and user profile information from the database, then runs a matching algorithm to select the most suitable user. It compares each request and condition and lists users with the highest match.
[2123] Step 5:
[2124] input:
[2125] A list of matched users.
[2126] process:
[2127] The server sends a match notification to the selected users.
[2128] output:
[2129] A notification is sent to the user's device.
[2130] Specific behavior:
[2131] The server sends a notification to each user's smartphone based on the list of matched users, which includes basic information about the elderly person (e.g., residential area, desired service).
[2132] Step 6:
[2133] input:
[2134] A match notification sent to the user's device.
[2135] process:
[2136] The user (university student) checks the notification and chooses to accept or decline.
[2137] output:
[2138] The user's choice (accept or decline) is sent to the server.
[2139] Specific behavior:
[2140] The user (university student) checks the notification on their smartphone and taps the option to accept or decline. The result of the selection is sent to the server in JSON format.
[2141] Step 7:
[2142] input:
[2143] User's choice (accept or deny).
[2144] process:
[2145] The server receives the user's selection and, if accepted, provides both parties with detailed service content and schedule.
[2146] output:
[2147] Specific service content and schedules are provided to the elderly and users.
[2148] Specific behavior:
[2149] The server receives the user's selection and, if accepted, notifies the elderly person and the user of the service details and schedule. This notification content is also sent in JSON format.
[2150] Step 8:
[2151] input:
[2152] Daily conversations and voice data of elderly people.
[2153] process:
[2154] Using an emotion engine, the emotional state of elderly people is analyzed from voice data.
[2155] output:
[2156] Emotional state data of older adults.
[2157] Specific behavior:
[2158] The voice data spoken by the elderly is sent via smartphone to the emotion engine, which uses DeepStream SDK to analyze the voice data and identify the emotional state. The results are sent to a server and stored in a database.
[2159] Step 9:
[2160] input:
[2161] Emotional state data of older adults.
[2162] process:
[2163] The generative AI model generates dialogue based on emotional state data and engages in conversation with the elderly.
[2164] output:
[2165] Dialogue text from a generative AI model.
[2166] Specific behavior:
[2167] The generative AI model (GPT-3) receives the elderly person's emotional state data as input and generates appropriate dialogue. Specific prompt examples:
[2168] "You seem a little down, is there something bothering you?"
[2169] The content of the conversation is displayed as text on the elderly person's smartphone.
[2170] Step 10:
[2171] input:
[2172] Interaction logs from generative AI models.
[2173] process:
[2174] The server stores a log of interactions with the generated AI and, if necessary, sends a notification if an abnormality is detected.
[2175] output:
[2176] Saving conversation logs and sending abnormality notifications.
[2177] Specific behavior:
[2178] The conversation log with the generative AI is sent to the server and stored in a database. If the emotion engine detects an abnormality, the server will send a notification to the user's relatives or a monitoring center. This notification will include the user's current emotional state and past logs.
[2179] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[2180] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[2181] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[2182] [Fourth embodiment]
[2183] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[2184] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[2185] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[2186] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[2187] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[2188] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[2189] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[2190] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[2191] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[2192] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[2193] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[2194] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[2195] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2196] This invention is a system that matches elderly people with young people (especially university students) and supports their daily lives while eliminating feelings of loneliness. The system aims to reduce feelings of loneliness for elderly people and enable them to live fulfilling daily lives, while providing opportunities for young people to gain experience in the real world.
[2197] Program Overview
[2198] Registration Steps
[2199] 1. User (elderly)
[2200] Seniors use their devices to download the app and create an account.
[2201] Elderly people enter information such as their area of residence, hobbies, whether they have a car, and desired services (e.g., transportation, shopping accompaniment, conversation partner).
[2202] 2. Devices (elderly people's smartphones)
[2203] The information entered by the elderly person is converted into JSON format and sent to the server.
[2204] 3. Server
[2205] The server receives the information sent by the user and stores it in a database.
[2206] Similarly, university students (users) input their profile, schedule, and available services and send them to the server.
[2207] Matching Step
[2208] 1. Server
[2209] The requests of registered elderly people and the profiles of university students are obtained and a matching algorithm is run.
[2210] Generate a list of the most suitable college students as matching candidates.
[2211] 2. Server
[2212] The server then sends a notification to the potential matched university students, including basic information about the elderly person (e.g., residential area, desired services).
[2213] 3. Device (university student's smartphone)
[2214] The university student's terminal receives the matching notification and displays detailed information to the university student user.
[2215] 4. User (University Student)
[2216] College students can review the matching details and choose to accept or decline.
[2217] 5. Device (university student's smartphone)
[2218] The university student's selection is sent to the server.
[2219] 6. Server
[2220] The server receives the university student's selection and notifies the senior citizen if he or she accepts.
[2221] If a match is made, detailed service details and schedules will be provided to both parties.
[2222] Supported by generative AI
[2223] 1. Server
[2224] The server collects voice data and personality information from college students and trains a generative AI model.
[2225] If university students are absent, the generative AI will have the ability to automatically converse with the elderly.
[2226] 2. Users (elderly people)
[2227] Elderly people can interact with the generative AI through devices they are familiar with.
[2228] 3. Devices (elderly people's smartphones)
[2229] The elderly person's device activates the generation AI's dialogue function, and a dialogue between the generation AI and the elderly person begins.
[2230] 4. Server
[2231] The server stores the dialogue logs of the generated AI and uses them as training data for the next time.
[2232] Income and expenditure management and administrative procedure support
[2233] 1. Server
[2234] The server manages data on service usage fees for elderly people and app usage fees for university students.
[2235] Calculate compensation for college students and determine payment information.
[2236] 2. Users (elderly people)
[2237] Seniors can pay for services within the app.
[2238] 3. Devices (elderly people's smartphones)
[2239] The terminal transmits the payment information to the server.
[2240] 4. Server
[2241] After receiving payment confirmation, the server notifies the elderly person and, if necessary, supports administrative procedures for applying for nursing care insurance, etc.
[2242] This will allow the elderly to enjoy their daily lives more happily and youthfully, and young people to gain meaningful social experiences. Furthermore, the conversational support provided by generative AI will significantly reduce the sense of loneliness felt by the elderly.
[2243] The processing flow will be explained below.
[2244] Step 1:
[2245] Users (seniors) download the app using their devices and create an account. After creating the account, they log in and enter information such as their area of residence, hobbies, whether they have a car, and desired services (e.g., transportation, shopping accompaniment, conversation partner).
[2246] Step 2:
[2247] The terminal (elderly person's smartphone) converts the information entered by the elderly person into JSON format and sends it to the server.
[2248] Step 3:
[2249] The server receives the information sent by the user and stores it in a database. Similarly, university student users also input their profile, schedule, and available services and send them to the server.
[2250] Step 4:
[2251] The server retrieves the profiles of university students based on the elderly person's requests and conditions and runs a matching algorithm to generate a list of university students who best fit the elderly person's needs.
[2252] Step 5:
[2253] The server then sends a notification to the potential matched university students, including basic information about the elderly person (e.g., residential area, desired services).
[2254] Step 6:
[2255] The terminal (the university student's smartphone) receives the matching notification and displays detailed information to the university student user.
[2256] Step 7:
[2257] The user (college student) checks the matching details and chooses to accept or reject.
[2258] Step 8:
[2259] The terminal (the university student's smartphone) sends the student's selection to the server.
[2260] Step 9:
[2261] The server receives the student's selection and sends a notification to the elderly person if they accept. If a match is made, detailed service content and schedules are provided to both parties.
[2262] Step 10:
[2263] The server acquires the voice data and personality information of university students and trains the generative AI model, which then prepares a function for the generative AI to converse with the elderly when the university students are absent.
[2264] Step 11:
[2265] When the university student is not present, the user (elderly person) can interact with the generating AI through the terminal.
[2266] Step 12:
[2267] The device (elderly person's smartphone) activates the generative AI's dialogue function, and a dialogue between the generative AI and the elderly person begins.
[2268] Step 13:
[2269] The server stores the dialogue logs of the generated AI and uses them as training data for the future.
[2270] Step 14:
[2271] The server manages data on service fees for seniors and app fees for university students, calculates the university students' remuneration, and determines payment information.
[2272] Step 15:
[2273] Users (elderly people) can pay for the service within the app.
[2274] Step 16:
[2275] The terminal (elderly person's smartphone) sends payment information to the server.
[2276] Step 17:
[2277] After receiving payment confirmation, the server notifies the elderly person and, if necessary, supports administrative procedures for applying for nursing care insurance, etc.
[2278] Example 1
[2279] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2280] There is a need for a system that supports the elderly in their daily lives and prevents them from feeling lonely. At the same time, there are a lack of opportunities for young people to gain experience in the real world. Another issue is the lack of efficient and effective ways to match the elderly with young people. Furthermore, when university students are not available, it is important to find ways to alleviate the elderly's sense of loneliness. In addition, there is a need for a system that can comprehensively support income and expenditure management and assistance with administrative procedures.
[2281] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[2282] In this invention, the server includes: an input means for elderly people to input their requests and requirements; an input means for young people to input their profile and available services; a storage means for storing the elderly people's requests and requirements and the young people's profiles in a database; a matching means for selecting an appropriate young person based on the elderly people's requests and requirements; a notification means for sending a matching notification to the selected young person; a dialogue means for the generative model to engage in dialogue based on the young person's voice data and personality information; a log storage means for storing the dialogue log of the generative model; and a service provision means for providing detailed service content and schedules for both the elderly and the young person. This makes it possible to reduce the elderly's sense of loneliness while providing young people with real-world experiences. Furthermore, elderly people can alleviate their loneliness through dialogue with the generative model even when their university students are away. Furthermore, by providing a system that comprehensively supports income and expenditure management and administrative procedures, more secure and convenient services can be realized.
[2283] "Elderly people" refers to people over a certain age who require a certain level of support in their daily lives and who may feel lonely.
[2284] "Young people" refers specifically to students and young adults seeking real-world experience.
[2285] "Input means" refers to an interface through which a user inputs specific information into the system.
[2286] "Storage means" refers to a component for recording and managing input information in a database.
[2287] "Matching methods" refer to algorithms and processes for selecting suitable young people based on the requests and conditions of older people.
[2288] "Notification means" refers to the method or system for sending the selection results and necessary information to matched young people.
[2289] A "generative model" refers to an artificial intelligence program that conducts dialogue based on young people's voice data and personality information.
[2290] "Dialogue method" refers to a method of using a generative model to enable natural language communication with the elderly.
[2291] "Log storage means" refers to a system or component for recording and storing the content and history of a conversation.
[2292] "Service provision means" refers to the method for providing detailed service content and schedule information to both the elderly and young people after a match is made.
[2293] "Income and expenditure management measures" refers to the systems and components that manage service fees for the elderly and app fees for young people.
[2294] "Remuneration calculation means" refers to a system or component for calculating a youth's compensation and determining payment information.
[2295] "Administrative procedure support measures" refers to systems and methods that support the procedures required for elderly people to access public assistance such as nursing care insurance.
[2296] MODE FOR CARRYING OUT THE INVENTION
[2297] The present invention is a system for matching elderly people with young people and supporting their daily lives. The purpose of this system is to reduce the sense of loneliness felt by elderly people and to provide young people with real-world experience. Specific embodiments of the system are described below.
[2298] 1. Registration Steps
[2299] Elderly information registration
[2300] User (elderly)
[2301] Seniors download a dedicated application onto their smartphones, create an account, and then enter their area of residence, hobbies, whether they have a car, and desired services (e.g., accompanying them on shopping trips, having someone to talk to, etc.).
[2302] Example: Elderly person A opens the app and fills out the form with "Tokyo," "reading," "none," and "accompany shopping."
[2303] Device (elderly person's smartphone)
[2304] The terminal converts the input information into JSON format and sends the information to the server.
[2305] server
[2306] The server stores the received information about the elderly person in a database.
[2307] Youth information registration
[2308] Users (young people)
[2309] Young people also download the app and create an account, filling out their profile and the services they can offer.
[2310] Devices (young people's smartphones)
[2311] The terminal converts the input information into JSON format and sends the information to the server.
[2312] server
[2313] The server stores the received information about the young people in a database.
[2314] 2. Matching step
[2315] server
[2316] The server runs a matching algorithm based on the elderly person's requests and the young person's profile information to generate a list of suitable young people, taking into account, for example, their area of residence and the services they can provide.
[2317] server
[2318] The server sends a notification to the potential matched young person, including basic information about the elderly person (e.g., residential area, desired services).
[2319] Devices (young people's smartphones)
[2320] The young person's device receives the notification and displays detailed information to the user.
[2321] Users (young people)
[2322] The young person reviews the match details and chooses to accept or decline.
[2323] Devices (young people's smartphones)
[2324] The selection results are sent to the server.
[2325] server
[2326] If the request is accepted, the server will notify the elderly person and officially establish a match. After the match is established, detailed service content and schedules will be provided to both parties.
[2327] 3. Generative AI support
[2328] server
[2329] The server receives voice data and personality information from young people and trains a generative AI model that automatically converses with the elderly when the young people are not present.
[2330] User (elderly)
[2331] Elderly people can interact with the generative AI through their smartphones.
[2332] Device (elderly person's smartphone)
[2333] The device activates the generation AI's dialogue function and begins a dialogue between the generation AI and the elderly person.
[2334] Specific operation: When elderly person A asks, "What book should I read today?", the generating AI responds, "I'll introduce you to the latest bestseller list."
[2335] server
[2336] The server stores the dialogue logs of the generated AI and uses them as training data for the next time.
[2337] 4. Income and expenditure management and administrative procedure support
[2338] server
[2339] The server manages the service fees for seniors and the app fees for young people, calculates the young people's rewards, and determines payment information.
[2340] User (elderly)
[2341] Seniors can pay for services within the app.
[2342] Device (elderly person's smartphone)
[2343] Send payment information to the server.
[2344] server
[2345] After payment is confirmed, a notification will be sent and support will be provided for administrative procedures such as nursing care insurance if necessary.
[2346] Example prompts for generative AI models
[2347] "A 70-year-old elderly person, Mr. A, would like to go shopping. Please accompany him. Mr. A lives in the XX area. Mr. A's hobby is reading."
[2348] The flow of the identification process in the first embodiment will be described with reference to FIG.
[2349] Step 1:
[2350] Elderly information registration
[2351] User (elderly)
[2352] Seniors download the app using their smartphones, create an account, and then enter their area of residence, hobbies, whether they have a car, and desired services (e.g., shopping accompaniment, conversation partner, etc.).
[2353] Input: area of residence, hobbies, whether you have a car, desired service details
[2354] Output: User information in JSON format
[2355] Specific actions: Elderly person A opens the app and fills in the form with "Tokyo," "reading," "none," and "accompany shopping."
[2356] Device (elderly person's smartphone)
[2357] The terminal converts the input information into JSON format and sends the information to the server.
[2358] Input: Information entered by the user
[2359] Output: JSON information sent to the server
[2360] server
[2361] The server stores the received information about the elderly person in a database.
[2362] Input: JSON format information sent from the terminal
[2363] Output: User information stored in the database
[2364] Step 2:
[2365] Youth information registration
[2366] Users (young people)
[2367] Young people also download the app and create an account, filling out their profile and the services they can offer.
[2368] Input: Profile information, available services
[2369] Output: User information in JSON format
[2370] Devices (young people's smartphones)
[2371] The terminal converts the input information into JSON format and sends the information to the server.
[2372] Input: Information entered by the user
[2373] Output: JSON information sent to the server
[2374] server
[2375] The server stores the received information about the young people in a database.
[2376] Input: JSON format information sent from the terminal
[2377] Output: User information stored in the database
[2378] Step 3:
[2379] Executing the Matching
[2380] server
[2381] The server runs a matching algorithm based on the elderly person's requests and the young person's profile information to generate a list of the most suitable young people.
[2382] Input: Elderly person's request, young person's profile information
[2383] Output: A list of the best young people
[2384] Specific operation: The server analyzes Tanaka's request and lists the young people who are available and who best fit his / her requirements.
[2385] Step 4:
[2386] Sending matching notifications
[2387] server
[2388] The server then sends a notification to the potential matched young person, including basic information about the elderly person (e.g., their residential area and desired services).
[2389] Input: List of young people, basic information of elderly people
[2390] Output: Notification sent to the young person
[2391] Devices (young people's smartphones)
[2392] The young person's device receives the notification and displays detailed information.
[2393] Input: Notification from the server
[2394] Output: what is displayed to the user
[2395] Specific operation: A push notification is sent to the young person's device, displaying the message, "Elderly person A wants to accompany you shopping."
[2396] Step 5:
[2397] Youth Choice
[2398] Users (young people)
[2399] The young person reviews the match details and chooses to accept or decline.
[2400] Input: Match details
[2401] Output: Choice of Accept or Reject
[2402] Devices (young people's smartphones)
[2403] The terminal transmits the selection result to the server.
[2404] Input: Accept or reject
[2405] Output: Selection results sent to the server
[2406] Step 6:
[2407] Matching confirmation and service provision
[2408] server
[2409] If the request is accepted, the server will send a notification to the elderly person to confirm the match. After the match is established, detailed service content and schedules will be provided to both parties.
[2410] Input: Young people's choice results
[2411] Output: Notification to the elderly and detailed service content and schedule
[2412] Specific operation: After the matching is accepted, the server sends the service details and schedule to the elderly and young people.
[2413] Step 7:
[2414] Supported by generative AI
[2415] server
[2416] The server receives voice data and personality information from young people and trains a generative AI model, which then converses with the elderly when they are absent.
[2417] Input: Young people's voice data, personality information
[2418] Output: A trained generative AI model
[2419] User (elderly)
[2420] Elderly people can interact with the generative AI through their smartphones.
[2421] Input: Utterance
[2422] Output: AI response
[2423] Device (elderly person's smartphone)
[2424] The device activates the generation AI's dialogue function and begins a dialogue between the generation AI and the elderly person.
[2425] Input: Senior's voice / text
[2426] Output: Response from the generation AI
[2427] Specific behavior: In response to the question, "What book should I read today?", the generative AI responds, "I'll show you the latest bestsellers."
[2428] server
[2429] The server stores the dialogue logs of the generated AI and uses them as training data for the next time.
[2430] Input: Interaction log
[2431] Output: Saved log data
[2432] Step 8:
[2433] Income and expenditure management and administrative procedure support
[2434] server
[2435] The server manages the service fees for the elderly and the app fees for the young, calculates the young's remuneration, and determines payment information.
[2436] Input: Service usage data, app usage data
[2437] Output: Income and expenditure data, payment information
[2438] User (elderly)
[2439] Seniors can pay for services within the app.
[2440] Input: Payment Information
[2441] Output: Payment for the service
[2442] Device (elderly person's smartphone)
[2443] The terminal transmits the payment information to the server.
[2444] Input: Payment data
[2445] Output: Payment information sent to the server
[2446] server
[2447] After payment is confirmed, a notification will be sent and support will be provided for administrative procedures such as nursing care insurance if necessary.
[2448] Input: Payment Verification Information
[2449] Output: Notification to the elderly and administrative procedure support
[2450] (Application example 1)
[2451] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2452] In modern society, the sense of loneliness felt by older adults and the lack of support for daily life are serious issues. Furthermore, university students have limited opportunities to gain real-world experience, limiting their future opportunities for growth and contribution to society. Furthermore, there is a lack of support for meal preparation and delivery, which is particularly difficult for older adults, and this needs to be addressed.
[2453] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[2454] In this invention, the server includes: an input means for elderly people to input their requests and requirements; an input means for university students to input their profiles and available services; a storage means for storing the elderly people's requests and requirements and the university students' profiles in a database; a matching means for selecting suitable university students based on the elderly people's requests and requirements; a notification means for sending a matching notification to the selected university students; a dialogue means for the generation AI to engage in dialogue based on the university students' voice data and personality information; a log storage means for saving the dialogue log of the generation AI; a request means for elderly people to order meals and request support; a receiving means for university students to receive meal-related requests from elderly people; and a delivery management means for managing meal orders and delivery. This allows elderly people to enrich their daily lives while alleviating feelings of loneliness, and allows university students to gain real-world experience. Furthermore, the quality of life of elderly people is improved, especially by providing more support for meal preparation and delivery.
[2455] "Elderly" refers to an older person who requires special assistance in daily life.
[2456] "University student" refers to a young person enrolled in a university who is studying academic or technical subjects.
[2457] "Input means" refers to a device or interface that allows a user to input information into a system.
[2458] "Storage means" refers to the technology or device used to store input information in a database.
[2459] "Matching means" refers to the algorithms and devices used to select the most suitable elderly people and university students based on the conditions within the system.
[2460] "Notification means" refers to the technology or device used to notify the target person of selected information.
[2461] "Generative AI" refers to artificial intelligence that uses machine learning technology to generate natural language and engage in dialogue.
[2462] "Interaction means" refers to the interface or technology that enables the generative AI to interact with the user.
[2463] "Log storage means" refers to technology or devices for storing records of interactions conducted by the generating AI.
[2464] "Request means" refers to the interface or device that allows elderly people to order meals or request assistance.
[2465] "Means of receipt" refers to the technology and equipment that university students use to receive requests from elderly people.
[2466] "Delivery management means" refers to systems and technologies for managing food order and delivery information.
[2467] This invention is a system that matches elderly people with university students and supports their daily lives while reducing feelings of loneliness. This system will be described below.
[2468] The server consists of an input means for elderly people to input their requests and requirements, an input means for university students to input their profile and the services they can provide, and a storage means for saving this information. Information on elderly people and university students is saved in a database and can be searched and updated as needed.
[2469] The matching means selects a university student who meets the elderly person's needs based on the information stored in the database. A matching notification is sent to the selected university student through the notification means. This allows the elderly person and the university student to be appropriately matched.
[2470] The generative AI provides a dialogue means for conversing with elderly people based on the voice data and personality information of university students. This dialogue means includes a log storage means for saving the dialogue log of the generative AI. The generative AI automatically converses with elderly people on behalf of university students when they are absent or busy.
[2471] The system also includes a requesting mechanism for seniors to order meals and request assistance, and a receiving mechanism for university students to receive those requests. This allows for efficient management of meal preparation and delivery for seniors. It also includes a delivery management mechanism for managing information on meal orders and delivery.
[2472] To implement this invention, cloud platforms such as AWS and Google Cloud are used for the servers, ensuring high scalability and reliability of the system. Relational databases such as PostgreSQL and MongoDB or NoSQL databases are used for the databases. Front-end applications are developed using cross-platform development frameworks such as React Native and Flutter.
[2473] The generative AI uses machine learning models such as GPT-4. To enable natural conversations with the elderly, the AI uses voice data from university students as training data. The content of the conversations the AI has is saved as a log and used as training data for the next round.
[2474] Examples:
[2475] If an elderly person, Person A, wants to buy ingredients for dinner, he or she will send a request using the app. This request will be received by University student Person B, who will purchase the appropriate ingredients based on Person A's request and deliver them to Person A's home. If the University student is busy, the generated AI will converse with Person A on his or her behalf to confirm the necessary information.
[2476] Example prompt sentence:
[2477] Prompt for the senior to type: "Can you please buy the ingredients for dinner next Monday?"
[2478] A prompt sentence that a university student converses with the generative AI on his / her behalf: "I'm going shopping now. Can you give me a list of what I'm going to buy?"
[2479] This will improve the quality of life for seniors, allow university students to gain social experience, and reduce feelings of loneliness among seniors through conversational support provided by generative AI.
[2480] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[2481] Step 1:
[2482] The user (senior citizen) launches the app using their smartphone and inputs their requests and conditions (area of residence, hobbies, whether they have a car, desired service details, etc.). The input information is converted to JSON format and sent to the server. At this time, the input data includes text information about the area of residence, hobbies, and desired service details, and JSON format data is generated as the output.
[2483] Step 2:
[2484] Similarly, the device (university student) inputs their profile, schedule, and available services and sends the data to the server. In this process, the input data also includes text information about the profile, schedule, and available services, and the output data is generated in JSON format.
[2485] Step 3:
[2486] The server saves the input data of the elderly and university students in a database. The database manages this information and searches and updates it as needed. In doing so, it parses the JSON data received as input and saves it in the appropriate table. The status of the save confirmation is generated as output.
[2487] Step 4:
[2488] The server runs a matching algorithm based on the information stored in the database, selecting the university student who best suits the elderly person's needs and creating a list of match candidates. This process uses the elderly person's needs and the university student's profile as input data, applies the matching algorithm, and generates a list of match candidates as output.
[2489] Step 5:
[2490] The server sends a matching notification to the selected university students. The notification includes basic information about the elderly person (e.g., residential area, desired services). In this process, the list of matching candidates and related information are used as input data, and a notification message is generated as output.
[2491] Step 6:
[2492] The device (university student) receives the matching notification and displays detailed information. The university student checks the elderly person's information and inputs whether to accept or reject the match. At this time, detailed information is displayed and the university student's selection is made as input data, and the selection result is sent to the server as output.
[2493] Step 7:
[2494] The server receives the university student's selection results and notifies the elderly person if they accept. If a match is made, detailed service content and schedules are provided to both parties. The university student's selection results are used as input data, and service content and schedule information are generated as output.
[2495] Step 8:
[2496] The generative AI converses with the elderly based on the voice data and personality information of university students. The elderly provide input for the dialogue with the generative AI, which then generates an appropriate response based on that input. The elderly person asks a question as input, and the generative AI's response is displayed as output.
[2497] Step 9:
[2498] The dialogue log of the generation AI is saved by the server using a log saving means. The saved log is used as training data for the next training. At this time, the dialogue content of the generation AI is used as input data, and the dialogue log saved as output is generated.
[2499] Step 10:
[2500] Elderly people use a requesting tool to order meals or request assistance and send a request from their device. The request is received by a university student and output as an executable service. Meal order information is used as input data, and a notification of request receipt is generated as output.
[2501] Step 11:
[2502] The university student uses the receiving means to confirm the elderly person's request and delivers the meal through the delivery management means. The specific delivery schedule and delivery contents are managed and notified to the elderly person. The delivery schedule and delivery contents are used as input data, and a delivery completion report is generated as output.
[2503] Through these processing steps, the system can support the elderly in their daily lives and provide real-world experience to university students.
[2504] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[2505] This invention relates to a system that matches elderly people with young people (especially university students) and supports their daily lives while eliminating feelings of loneliness using an emotion engine. The system aims to reduce feelings of loneliness for elderly people, enable them to live fulfilling daily lives, and provide opportunities for young people to gain experience in the real world. Furthermore, the emotion engine recognizes the user's emotions, providing more personalized services.
[2506] Program Overview
[2507] Registration Steps
[2508] 1. User (elderly)
[2509] Seniors use their devices to download the app and create an account.
[2510] Elderly people enter information such as their area of residence, hobbies, whether they have a car, and desired services (e.g., transportation, shopping accompaniment, conversation partner).
[2511] 2. Devices (elderly people's smartphones)
[2512] The information entered by the elderly person is converted into JSON format and sent to the server.
[2513] 3. Server
[2514] The server receives the information sent by the user and stores it in a database.
[2515] Similarly, university student users input their profile, schedule, and available services and send them to the server.
[2516] Matching Step
[2517] 1. Server
[2518] The requests of registered elderly people and the profiles of university students are obtained and a matching algorithm is run.
[2519] Generate a list of the most suitable college students as matching candidates.
[2520] 2. Server
[2521] The server then sends a notification to the potential matched university students, which includes basic information about the elderly person (e.g., residential area, desired services).
[2522] 3. Device (university student's smartphone)
[2523] The university student's terminal receives the matching notification and displays detailed information to the university student user.
[2524] 4. User (University Student)
[2525] College students can review the matching details and choose to accept or decline.
[2526] 5. Device (university student's smartphone)
[2527] The university student's selection is sent to the server.
[2528] 6. Server
[2529] The server receives the student's selection and sends a notification to the elderly person if they accept. If a match is made, detailed service content and schedules are provided to both parties.
[2530] Supported by generative AI
[2531] 1. Server
[2532] The server collects voice data and personality information from college students and trains a generative AI model.
[2533] If university students are absent, the generative AI will have the ability to automatically converse with the elderly.
[2534] 2. Users (elderly people)
[2535] Elderly people can interact with the generative AI through devices they are familiar with.
[2536] 3. Devices (elderly people's smartphones)
[2537] The elderly person's device activates the generation AI's dialogue function, and a dialogue between the generation AI and the elderly person begins.
[2538] 4. Server
[2539] The server stores the dialogue logs of the generated AI and uses them as training data for the next time.
[2540] Emotion engine integration
[2541] 1. Server
[2542] The server analyzes the emotional state of the elderly person using an emotion engine, which has the ability to recognize the user's emotions from voice and text data.
[2543] 2. Means of interaction
[2544] The emotion engine dynamically adjusts the dialogue content for the elderly based on their emotional state. For example, if the elderly feels sad, it will offer words of encouragement or topics to cheer them up.
[2545] 3. Log storage method
[2546] Emotion data analyzed by the emotion engine is stored along with the dialogue log, allowing the generative AI to deliver more personalized dialogue based on past emotional data.
[2547] Income and expenditure management and administrative procedure support
[2548] 1. Server
[2549] The server manages data on service fees for seniors and app fees for university students, calculates the university students' remuneration, and determines payment information.
[2550] 2. Users (elderly people)
[2551] Seniors can pay for services within the app.
[2552] 3. Devices (elderly people's smartphones)
[2553] The terminal transmits the payment information to the server.
[2554] 4. Server
[2555] After receiving payment confirmation, the server notifies the elderly person and, if necessary, supports administrative procedures for applying for nursing car...
Claims
1. An input means for elderly people to input their requests and conditions; An input method for university students to input their profile and the services they can provide; A storage means for storing the requests and conditions of the elderly and the profiles of the university students in a database; A matching method to select appropriate university students based on the elderly's requests and conditions, and a notification means for sending a matching notification to the selected university student; A dialogue method in which the generative AI conducts a dialogue based on the voice data and personality information of university students, A log storage means for storing the dialogue log of the generation AI; A system including:
2. An income and expenditure management tool for managing service fees for elderly people and app fees for university students; a compensation calculation means for calculating compensation for the university student and determining payment information; The system of claim 1 , comprising:
3. 2. The system according to claim 1, further comprising administrative procedure support means for supporting administrative procedures so that elderly people can use nursing care insurance or the like.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A