system
The system addresses inefficiencies in device account management by using a ring-shaped device to transmit unique identification information for seamless, secure, and real-time personalized services across devices, particularly in autonomous driving and smart environments.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-26
- Publication Date
- 2026-03-10
AI Technical Summary
Existing systems require users to manually enter account information and settings across devices, leading to inefficiencies, configuration errors, and security risks, and struggle to provide precise, real-time personalized services, especially in autonomous driving and smart devices.
A system utilizing a ring-shaped device that transmits unique identification information via RFID to an edge computer, which sends an API request to a back-end server to retrieve user data, enabling seamless and secure personalized services across devices.
Enables easy and secure portability of user information, allowing for real-time customized services by integrating edge computing and back-end servers, enhancing user convenience and reducing configuration errors.
Smart Images

Figure 2026041318000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Currently, to provide personalized services across various devices, users must enter multiple account information and settings into each device. This is a time-consuming process that not only reduces user convenience but also increases the risk of configuration errors and security risks. Furthermore, in the context of autonomous driving systems and smart devices, precise, real-time personalized services are required, but this has been difficult to achieve with conventional systems. [Means for solving the problem]
[0005] The present invention provides a system that uses a communication means that holds individual identification information to centrally manage individual user information and provide customized services in real time via edge computer means and back-end server means. The communication means is installed in a ring-shaped device, and transmits the individual identification information via wireless communication technology, enabling easy and safe portability of user information. This allows users to seamlessly enjoy personalized services across different devices and environments.
[0006] "Individual identification information" refers to a unique ID or address that uniquely identifies each user.
[0007] "Communication means" is a general term for hardware and software for transmitting and receiving information, and here refers specifically to the wireless communication technology installed in the ring-shaped device.
[0008] An "edge computing means" is a computing device located at the edge of a network that processes information received from nearby devices and sends it to an appropriate server.
[0009] The "back-end server means" is a server that receives a request from a client, retrieves the necessary data from a database, and returns the data.
[0010] "User Data" generally refers to information associated with a particular user, including name, preferences, interests, etc.
[0011] "Customized services" are individualized services provided based on a specific user's preferences and behavioral history.
[0012] A "database" is a collection of digital information that is structured to allow efficient searching, management, and updating of large amounts of data. [Brief explanation of the drawings]
[0013] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram illustrating a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0014] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0015] First, the terms used in the following description will be explained.
[0016] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0017] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0018] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0019] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0021] [First embodiment]
[0022] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0023] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0024] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0025] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0026] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0028] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0029] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0030] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0031] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0032] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0033] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0034] The present invention provides customized services to users through a system including a ring-shaped device that holds individual identification information, an edge computer, and a back-end server. An embodiment of each component of the system will be described.
[0035] 1. Ring-shaped device
[0036] The ring-shaped device worn by the user has a built-in unique identification information (UUID), which is transmitted to the edge computer using RFID technology.
[0037] 2. Edge Computers
[0038] The edge computer is equipped with an RFID reader that receives the UUID from the ring device, and then uses the received UUID to send an API request to the backend server, requesting the corresponding user data.
[0039] The edge computer uses the user data returned from the server to generate services customized for the user. For example, in the case of an autonomous driving system, it can obtain individual user ride settings and destination data and apply them to the autonomous vehicle.
[0040] 3. Backend Server
[0041] The backend server receives the request from the edge computer and searches the database for the corresponding user data based on the UUID. The searched user data is returned to the edge computer, and the user is provided with a customized service.
[0042] Program function description
[0043] Ring-shaped device
[0044] When a user wears the ring and moves near an edge computer, the ring-type device transmits a UUID. Due to its simple structure, the ring-type device can transmit the UUID at all times without the need for battery replacement or setting changes.
[0045] Edge Computer
[0046] The edge computer receives the UUID from the ring device, then uses this UUID to send an API request to the backend server to retrieve the corresponding user data. Based on the retrieved user data, the edge computer displays and provides information and services optimized for the user.
[0047] Backend Server
[0048] The backend server retrieves user data from a database based on the UUID sent from the edge computer. This data includes the user's name, preferences, and interests, and returns it to the edge computer. The edge computer then uses this information to provide customized services to the user.
[0049] Specific examples
[0050] For example, suppose a user arrives at a shopping center and approaches a display with an edge computer. The ring-shaped device transmits a UUID, which the edge computer receives. The edge computer then sends an API request to the backend server to retrieve the corresponding user's purchasing history and favorite product information.
[0051] Based on the information received from the backend server, the edge computer can display the user's name and provide personalized product recommendations and the latest promotional information, providing the user with a personalized shopping experience.
[0052] In this way, the present invention is a system that is centered around a ring-shaped device carried by the user, and that can provide customized services in real time simply and effectively by linking with an edge computer and a back-end server.
[0053] The processing flow will be explained below.
[0054] Step 1:
[0055] The user puts on the ring
[0056] A user wears a ring-shaped device and moves close to an edge computer. The ring-shaped device contains a unique UUID, which is transmitted to the edge computer via RFID technology.
[0057] Step 2:
[0058] The device receives the UUID
[0059] The edge computer receives the UUID signal from the ring-shaped device using an RFID reader. The UUID is used as unique identification information and proceeds to the next step.
[0060] Step 3:
[0061] The device sends an API request
[0062] The edge computer uses the received UUID to send an API request to the backend server, which includes the UUID as a parameter. The API request is made using the HTTP protocol.
[0063] Step 4:
[0064] The server receives the API request
[0065] The server receives the API request from the edge computer, extracts the UUID from the request, and begins the process of searching the user database.
[0066] Step 5:
[0067] The server retrieves the user data
[0068] The server searches its database for information based on the received UUID. This is a fast search process that extracts the corresponding user data, such as username, preferences, and interests.
[0069] Step 6:
[0070] The server returns a response
[0071] The server converts the user data obtained from the search into JSON format and returns it to the edge computer, where the user data includes the user's name, preferences, and interests.
[0072] Step 7:
[0073] The terminal receives user data.
[0074] The edge computer receives the user data in JSON format from the server, giving the edge computer detailed information about the user.
[0075] Step 8:
[0076] The terminal generates customized services
[0077] The edge computer analyzes the received user data and generates services optimized for the specific user (for example, product recommendations based on browsing history or settings for self-driving cars).
[0078] Step 9:
[0079] Providing customized services to users
[0080] The edge computer presents the generated customized services to the user through a display or other interface, allowing the user to receive individually personalized information and services.
[0081] This series of processes allows users to easily enjoy customized services in real time from edge computers simply by wearing the ring-shaped device.
[0082] Example 1
[0083] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0084] In conventional service provision systems that use user data, it is difficult to obtain individual user identification information in real time and quickly provide customized services. In addition, the lack of cooperation between components makes it difficult to achieve a seamless user experience.
[0085] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0086] In this invention, the server includes a communication means for holding individual identification information, an edge computer means for extracting the individual identification information received via the communication means, a backend server means for receiving the individual identification information from the edge computer means and returning user data, a means for generating and providing a service customized for a specific user using the user data, a means for the edge computer means to send an API request to the backend server means based on the individual identification information, a means for the backend server means to receive the API request and search for corresponding user data, and a means for returning the user data to the edge computer means. This makes it possible to obtain individual identification information possessed by a user in real time and quickly provide a customized service.
[0087] "Individual identification information" is information that uniquely identifies a specific individual or object.
[0088] A "communication means" is a means for sending and receiving data.
[0089] An "edge computing means" is a computing device for performing data collection, analysis, and processing near the site.
[0090] The "back-end server means" is a server device that manages data to provide various services and responds to requests from other systems and devices.
[0091] "User Data" is information associated with a particular user, including name, preferences, interests, purchasing history, and the like.
[0092] An "API request" is a request format for requesting specific processing or data provision from other programs or services.
[0093] A "ring-shaped information transmitting device" is a ring-shaped device used to transmit individual identification information.
[0094] "Wireless communication technology" is a technology that transmits data via wireless radio waves without using cables.
[0095] The present invention is a system that includes a ring-shaped information transmission device that holds individual identification information, an edge computer, and a back-end server, and provides customized services to users. Specific embodiments for carrying out the invention are described below.
[0096] Ring-shaped information transmission device
[0097] The ring-shaped information transmission device worn by the user has a built-in unique identification information (UUID). This device periodically transmits the UUID to the edge computer using RFID technology. The device does not require a battery and is designed to constantly transmit the UUID.
[0098] Edge Computer
[0099] The edge computer is equipped with an RFID reader that receives UUIDs from ring-shaped information transmission devices worn by users. Based on the received UUID, the edge computer sends API requests to a backend server, requesting specific user data. This processing is performed in real time, and the edge computer has the ability to instantly generate and provide information and services optimized for the user.
[0100] As a specific example, the edge computer sends a prompt sentence to the backend server saying, "User A's UUID has been received. What is User A's favorite drink?"
[0101] Backend Server
[0102] When the backend server receives an API request sent from the edge computer, it searches for the user data in the database based on the UUID, finds the corresponding user data, and sends it back to the edge computer.
[0103] Specifically, the backend server retrieves the entry corresponding to "UUID:12345" from the database and returns "User A's name, purchase history, and favorite information" to the edge computer as a response.
[0104] Specific examples
[0105] For example, suppose a user arrives at a shopping center and approaches a display where an edge computer is installed. The ring-shaped information transmission device worn by the user transmits a UUID, which is received by the edge computer. The edge computer immediately sends an API request to the backend server, asking for the user data corresponding to UUID:12345.
[0106] The backend server retrieves the relevant user data (such as purchase history and favorite product information) from the database and sends it back to the edge computer. Based on the received information, the edge computer displays the user's name, recommended products, operation guides, and other information on the display screen. In this way, the user can enjoy a personalized shopping experience.
[0107] Prompt Sentence Examples
[0108] Here are some examples of prompts:
[0109] "User A has been identified. Please show us the best product recommendations for User A."
[0110] "User B has arrived at the shopping center. Please generate a list of recommended products based on User B's purchasing history."
[0111] "User C has arrived at the entrance. Please display promotional information based on User C's interests."
[0112] As a result, the present invention makes it possible to efficiently provide customized services in real time by combining a ring-shaped information transmission device carried by a user, an edge computer, and a back-end server.
[0113] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0114] Step 1:
[0115] A user wears a ring-shaped information transmission device and moves near the system. This ring-shaped device periodically transmits unique identification information (UUID). This UUID is sent to the edge computer via a communication means. The input is the UUID of the ring-shaped device held by the user, and the output is the UUID received by the edge computer. In concrete terms, the ring-shaped device sends "UUID:12345" to the edge computer.
[0116] Step 2:
[0117] The edge computer receives the UUID sent from the ring-shaped device. The input is the UUID received from the communication means, and the output is the UUID used to construct the API request. The edge computer captures the UUID with its built-in RFID reader and stores it in memory. Specifically, "UUID:12345" is stored in the edge computer's memory.
[0118] Step 3:
[0119] The edge computer sends an API request to the backend server based on the UUID it obtained. The input is the UUID obtained in step 2, and the output is the API request sent to the backend server. Using the HTTP protocol, a request such as "GET / user-data?uuid=12345" is sent to the backend server. Specifically, the edge computer sends an API request including "UUID:12345" to the backend server.
[0120] Step 4:
[0121] The backend server receives the API request sent from the edge computer and searches the database to retrieve the corresponding user data. The input is the UUID in the API request, and the output is the user data. The backend server searches the corresponding entry in the database and retrieves the user's name, settings, favorite information, etc. Specifically, the backend server retrieves "User A's name, purchase history, and favorite information" based on "UUID:12345."
[0122] Step 5:
[0123] The backend server returns the acquired user data to the edge computer. The input is user data, and the output is user data sent to the edge computer. Specifically, the backend server returns "User A's name, purchase history, and favorite information" to the edge computer.
[0124] Step 6:
[0125] The edge computer uses the user data it receives to generate and provide a service customized for a specific user. The input is the user data received from the backend server, and the output is a customized service that is displayed to the user. Specifically, the edge computer displays a message on the display such as, "Hello, User A! Here are some recommended products for you."
[0126] Through the above processing steps, the system can efficiently provide users with customized services in real time.
[0127] (Application example 1)
[0128] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0129] Current autonomous vehicles generally require users to manually adjust the seat position and configure the entertainment system each time they enter the vehicle, a process that is inconvenient and time-consuming. Another issue is that it is difficult to provide a comfortable riding experience because it is not easy to customize for each user. There is a need to solve these problems and provide a riding environment optimized for each user.
[0130] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0131] In this invention, the server includes a communication means for holding individual identification information, an edge computer means for extracting the individual identification information received via the communication means, a backend server means for receiving the individual identification information from the edge computer means and returning user data, a means for providing a service customized for a specific user using the user data, and a means for customizing a seat position or an entertainment system in an automated vehicle using the user data, thereby making it possible to provide a personalized riding environment for the user in the automated vehicle.
[0132] "Individual identification information" is information for uniquely identifying a user.
[0133] The "communication means" is a means for transmitting individual identification information to the edge computer means.
[0134] The "edge computer means" is a computer device for receiving individual identification information and requesting data from the backend server means based on the individual identification information.
[0135] The "back-end server means" is a server device that searches for user data based on the individual identification information received from the edge computer means and returns the data.
[0136] "User Data" is information about a particular user and is used to provide customized services.
[0137] "Customized Services" refers to services that are tailored based on a user's individual identity and user data.
[0138] An "automated vehicle" is a vehicle that navigates and performs functions autonomously without user interaction.
[0139] "Seat position" refers to the physical arrangement of seats within an automated vehicle, as adjusted for each user.
[0140] An "entertainment system" is an in-vehicle system that plays media content such as music and videos and is configured according to the user's preferences.
[0141] To implement this invention, the system includes the following major components:
[0142] 1. Ring-shaped device
[0143] The ring-shaped device is worn by the user and holds unique identification information (UUID). This device transmits the UUID to the edge computer means using RFID technology. This device does not require battery replacement or setting changes and can always transmit the UUID.
[0144] 2. Edge computing means
[0145] The edge computer means is installed in the vehicle and includes an RFID reader. The edge computer means receives the UUID from the ring-shaped device. The edge computer means then uses the UUID to send an API request to the backend server means to obtain corresponding user data. Based on the obtained user data, the edge computer applies user-specific settings to the in-vehicle OS to customize the seat position and entertainment system.
[0146] example:
[0147] When a user wears the ring-shaped device and gets into an autonomous vehicle, the edge computer means in the vehicle immediately recognizes the UUID and retrieves the user's vehicle settings from the backend server means, resulting in a personalized riding experience, such as automatically adjusting the seat position and playing the user's favorite music playlist.
[0148] 3. Backend Server Measures
[0149] The back-end server means is installed on the cloud and searches for corresponding user data from a database based on the UUID and returns it to the edge computer means. This data includes the user's name, seat position settings, music playlist, favorite destinations, etc., and based on this, the edge computer provides customized services to the user.
[0150] 4. Smartphone Applications
[0151] Using a smartphone application, users can configure their car interior settings in advance (e.g., preferred temperature settings, seat position, music playlist, etc.) The application synchronizes data with edge computing means and back-end server means to enhance the user experience.
[0152] Example prompt sentence:
[0153] Write code that receives the UUID of a ring-shaped device worn by a user, retrieves user settings from a backend server in the cloud, and automatically adjusts seat position and music playlist in an autonomous vehicle. Technologies used include RFID, edge computing, and API communication.
[0154] Specific hardware and software used
[0155] Ring-type device: A device that holds unique identification information (UUID) and transmits it to an edge computer using RFID technology.
[0156] Edge computer: A computing device installed inside a vehicle that is equipped with an RFID reader.
[0157] Back-end server: A server device installed on the cloud that has a database for storing user data.
[0158] API: An application programming interface that allows edge computers to communicate data with backend servers.
[0159] In-vehicle OS: The operating system installed in self-driving vehicles.
[0160] Smartphone app: An application that allows users to configure settings in advance.
[0161] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0162] Step 1:
[0163] When a user wears a ring-type device and gets into a vehicle, the ring-type device transmits a UUID using RFID technology. The input is the UUID held by the ring-type device, and the output is the UUID received by the RFID reader.
[0164] Step 2:
[0165] The edge computer means receives a UUID through an RFID reader installed in the vehicle. The input here is the UUID received by the RFID reader, and the output is an API request carrying the UUID. The edge computer means sends the API request to the backend server means using this UUID.
[0166] Step 3:
[0167] The backend server means receives an API request including a UUID from the edge computer means. The input is the UUID sent from the edge computer means, and the output is a response including corresponding user data. The backend server means searches for the user data from the database based on the UUID and returns the result to the edge computer means.
[0168] Step 4:
[0169] The edge computer means acquires the user data received from the backend server means and transmits it to the in-vehicle OS. The input is the user data from the backend server means, and the output is the customization information transmitted to the in-vehicle OS.
[0170] Step 5:
[0171] The in-vehicle OS customizes the seat position and entertainment system based on the received user data. The input is the user data sent from the edge computing means, and the output is the adjusted seat position and entertainment system settings. Specifically, the seat position is automatically adjusted to the user's preferences, and the user's favorite music playlist begins playing.
[0172] Step 6:
[0173] Users can check and change settings in advance using a smartphone application. The input is setting change information operated by the user, which is synchronized with the edge computer means and the back-end server means. The output is updated customization information, which is applied to the vehicle. Specifically, the user sets temperature settings or a new music playlist on the smartphone app, and this is reflected in the vehicle.
[0174] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0175] The present invention provides customized services to users by combining an emotion engine with a system including a ring-shaped device that holds individual identification information, an edge computer, and a back-end server. An embodiment of each component of the system will be described below.
[0176] 1. Ring-shaped device
[0177] The ring-shaped device worn by the user has a built-in unique identification information (UUID), which is transmitted to the edge computer using RFID technology.
[0178] 2. Edge Computers
[0179] The edge computer is equipped with an RFID reader that receives the UUID from the ring device. The edge computer uses the received UUID to send an API request to the backend server to request the corresponding user data. The edge computer also has an emotion engine that recognizes the user's emotions.
[0180] The emotion engine uses a microphone and a camera to analyze the user's voice and facial expressions to recognize the user's emotion information, which includes the user's emotional and psychological state, and is added to the user database.
[0181] 3. Backend Server
[0182] The backend server receives the request from the edge computer and searches the database for the corresponding user data based on the UUID. The searched user data is returned to the edge computer, and the user is provided with a customized service.
[0183] The back-end server updates the user database based on the emotion information acquired by the emotion engine the next time a service is provided, allowing for more precise and tailored services to be provided to the user.
[0184] Program function description
[0185] Ring-shaped device
[0186] When a user wears the ring and moves near an edge computer, the ring-type device transmits a UUID. Due to its simple structure, the ring-type device can transmit the UUID at all times without the need for battery replacement or setting changes.
[0187] Edge Computer
[0188] The edge computer receives the UUID from the ring device, then uses this UUID to send an API request to the backend server to retrieve the corresponding user data, and then uses an emotion engine to recognize the user's emotion.
[0189] The user's emotion data acquired by the emotion engine is added to the user data and used when providing services. For example, if the user has an anxious expression, the edge computer will display relaxing content.
[0190] Backend Server
[0191] The backend server searches the database for user data based on the UUID sent from the edge computer, including the user's name, preferences, and emotional information, and returns this data to the edge computer.
[0192] Furthermore, the database is updated based on the emotional data acquired by the emotion engine, and this information is used the next time the service is provided. For example, if a user showed an anxious expression during the previous session, the next time the service is provided, that state will be taken into consideration.
[0193] Specific examples
[0194] For example, suppose a user arrives at a shopping center and approaches a display with an edge computer. The ring-shaped device transmits a UUID, which the edge computer receives. The edge computer then sends an API request to the backend server to retrieve the corresponding user's purchasing history and favorite product information.
[0195] At the same time, the edge computer uses an emotion engine to analyze the user's current emotional state. For example, if the edge computer detects that the user is smiling, it can use that information to display promotional content accompanied by cheerful, upbeat music.
[0196] The backend server returns a list of products tailored to the user's name and purchase history to the edge computer, which can then provide the user with the most appropriate information and services, and provide a more personalized experience based on the results of the emotion engine.
[0197] As such, the present invention is a system that provides highly customized services in real time by linking an edge computer, an emotion engine, and a back-end server, with a ring-shaped device carried by the user at its core.
[0198] The processing flow will be explained below.
[0199] Step 1:
[0200] The user puts on the ring
[0201] A user wears a ring-shaped device and moves close to an edge computer. The ring-shaped device contains a unique UUID, which is transmitted to the edge computer via RFID technology.
[0202] Step 2:
[0203] The device receives the UUID
[0204] The edge computer receives the UUID signal from the ring-shaped device through an RFID reader. The received UUID is processed within the edge computer and proceeds to the next step.
[0205] Step 3:
[0206] The device sends an API request
[0207] The edge computer uses the received UUID to send an API request to the backend server, requesting the corresponding user data. The API request is sent using the HTTP protocol.
[0208] Step 4:
[0209] The server receives and processes the API request.
[0210] The backend server receives the API request sent from the edge computer, parses the UUID included in the request, and uses this information as a database lookup key.
[0211] Step 5:
[0212] The server searches for and returns the user data
[0213] The backend server searches for user data in a database based on the UUID, and the searched data is returned to the edge computer in JSON format. The user data includes name, preferences, and interests.
[0214] Step 6:
[0215] The terminal receives user data.
[0216] The edge computer receives and analyzes the user data returned from the server, thereby obtaining detailed information about the user.
[0217] Step 7:
[0218] The device activates the emotion engine
[0219] The edge computer activates the emotion engine, which begins the process of recognizing the user's emotions. The emotion engine uses a microphone and camera to analyze the user's voice and facial expressions.
[0220] Step 8:
[0221] The device analyzes emotional information
[0222] The emotion engine analyzes the acquired voice and facial expression data to estimate the user's emotional state. For example, emotional information such as "joy" if the user smiles, or "anxiety" if the user looks confused is generated.
[0223] Step 9:
[0224] The device adds emotional information to the user data.
[0225] The emotional information acquired by the edge computer is added to the user data and used for more specific customization. The emotional information is updated in real time and will be used the next time the service is provided.
[0226] Step 10:
[0227] Providing customized services to users
[0228] The edge computer generates customized services based on the received user data and emotional information. For example, if the user is in a relaxed state, it will provide relaxing content.
[0229] Step 11:
[0230] The server updates the user database
[0231] The backend server records the latest emotion information sent from the edge computer in a user database so that it can be used the next time a service is provided, thereby providing services that take user emotions into greater consideration.
[0232] Through this series of processes, users can enjoy real-time, highly customized services provided by edge computers and back-end servers simply by wearing the ring-shaped device.
[0233] Example 2
[0234] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0235] Conventional user service provision systems have difficulty recognizing a user's emotional state in real time and personalizing services. This has resulted in an inability to provide flexible services that respond to a user's temporary emotions, potentially resulting in a decrease in satisfaction. Furthermore, these systems are limited to providing services on an ad hoc basis, and the collection of data that can be used for future services is insufficient.
[0236] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0237] In this invention, the server includes a communication device means for storing individual identification information, an edge computer means for extracting the individual identification information received via the communication device means, a back-end computer means for receiving the individual identification information from the edge computer means and returning user data, an emotion engine means for analyzing the user data and further analyzing voice and facial expressions to obtain emotional information, a means for providing a service customized for a specific user using the emotional information and user data, and a means for storing the emotional information in a user database and utilizing it for subsequent service provision. This makes it possible to recognize the user's emotional state in real time and provide personalized services based on that. Furthermore, by utilizing the obtained emotional information when providing subsequent services, it is possible to provide even more precise services tailored to the user.
[0238] "Individual identification information" is information for uniquely identifying a user, such as a UUID (universal unique identifier).
[0239] The "communication device means" is a device that holds and transmits individual identification information, and corresponds to a ring-shaped device or the like.
[0240] The "edge computing means" is a device that receives individual identification information from the communication device means and sends a request to the back-end computing means, and specifically corresponds to a computer with a built-in RFID reader.
[0241] The "back-end computer means" is a device that searches for and returns corresponding user data based on the individual identification information received from the edge computer means, and corresponds to a server that manages a database.
[0242] The "emotion engine means" is a device that analyzes the user's voice, facial expressions, etc., and acquires emotional information, and specifically corresponds to a computer with a built-in microphone and camera.
[0243] A "user database" is a database that records data and emotional information about users, and is managed by back-end computing means.
[0244] The "means for providing customized services" refers to devices and systems for providing services and content tailored to a particular user based on user data and emotional information.
[0245] The present invention is a system that provides customized services to users by combining a communication device that holds individual identification information, an edge computer, a back-end computer, and an emotion engine.
[0246] Ring-shaped device
[0247] The ring-shaped device worn by the user has a built-in unique identification information (UUID), which is transmitted to the edge computer using RFID technology.
[0248] example
[0249] When a user wears the ring and moves near an edge computer, the ring-type device transmits a UUID. Due to its simple structure, the ring-type device can transmit the UUID at all times without the need for battery replacement or setting changes.
[0250] Edge Calculator
[0251] The edge computer is equipped with an RFID reader that receives the UUID from the ring-shaped device. It then uses the received UUID to send an API request to the backend computer, requesting the corresponding user data. Furthermore, the edge computer is equipped with an emotion engine that analyzes the user's voice and facial expressions to obtain emotional information. This emotional information is added to a user database, which includes the user's emotional and psychological state.
[0252] example
[0253] When the edge computer receives the UUID from the ring-shaped device, it uses this UUID to send an API request to the backend computer. At the same time, it uses an emotion engine to analyze the user's facial expressions and voice. For example, if the user is smiling, it displays promotional content with cheerful, fun music based on that information.
[0254] Backend Calculator
[0255] The backend computer receives a request from the edge computer and searches the database for the corresponding user data based on the UUID. The searched user data is returned to the edge computer, and a customized service is provided to the user. In addition, the emotion information obtained by the emotion engine is saved in the user database and used the next time the service is provided. This update enables the provision of more precise and user-specific services.
[0256] example
[0257] When the backend computer receives the UUID, it immediately searches the database to retrieve the user's name, purchase history, preferences, past emotional information, etc. For example, if the user looked anxious in the previous session, the next time it provides a service that takes that state into account.
[0258] Specific examples
[0259] For example, suppose a user arrives at a shopping center and approaches a display equipped with an edge computer. The ring-shaped device transmits a UUID, which the edge computer receives. The edge computer then sends an API request to the backend computer to obtain the corresponding user's purchasing history and favorite product information. At the same time, the edge computer uses its emotion engine to analyze the user's current emotional state. If the edge computer recognizes that the user is smiling, it uses this information to display promotional content accompanied by cheerful, upbeat music. Based on the user data returned from the backend computer, the edge computer provides the user with optimal information and services.
[0260] Example prompt sentence:
[0261] "Write a program that receives a user's UUID from the edge computer and sends a request to the backend computer based on that UUID. Also, add a function that analyzes the user's voice and facial expressions to recognize emotions, and provides appropriate services to the user based on the results."
[0262] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0263] Step 1:
[0264] The user wears the ring-shaped device and moves close to the edge computer.
[0265] Input: A ring-like device with the user's UUID embedded
[0266] Output: Sending UUID
[0267] Specific operation: The ring-shaped device uses built-in RFID technology to transmit a UUID to the edge computer.
[0268] Step 2:
[0269] The edge computer receives the UUID from the ring.
[0270] Input: UUID sent from the ring device
[0271] Output: Received UUID
[0272] Specific operation: The RFID reader on the edge computer receives the UUID and forwards the data to the internal system.
[0273] Step 3:
[0274] The edge computer uses the received UUID to send an API request to the backend computer, requesting user data.
[0275] Input: Received UUID
[0276] Output: Request for relevant user data
[0277] Specific operation: The edge computer sends the UUID as an HTTP POST request to the backend computer, requesting user data.
[0278] Step 4:
[0279] The back-end computer retrieves the user data from the database based on the UUID and returns it to the edge computer.
[0280] Input: API request containing UUID
[0281] Output: The corresponding user data
[0282] Specific operation: The back-end computer executes a database query to retrieve data such as the user's name, preferences, and past emotional information, and returns this to the edge computer.
[0283] Step 5:
[0284] The edge computer receives the returned user data and analyzes the user's emotions.
[0285] Input: Returned user data, as well as user voice and facial expression data
[0286] Output: User's emotional information
[0287] Specific operation: The edge computer uses the built-in microphone and camera to capture the user's voice and facial expressions, and then analyzes their emotional state using an emotion engine.
[0288] Step 6:
[0289] Edge computers provide customized services based on user data and emotional information.
[0290] Input: Returned user data and parsed emotion information
[0291] Output: customized services and content
[0292] Specific operation: The edge computer uses the analyzed emotional information and user data to display services and content that are optimal for the user. For example, if the user looks anxious, it will play relaxing music.
[0293] Step 7:
[0294] The edge computer sends the emotion information to the back-end computer and updates the user database.
[0295] Input: Parsed emotion information
[0296] Output: Updated user database
[0297] Specific operation: The edge computer sends the acquired emotion information to the back-end computer, which stores it in the user database and uses it the next time the service is provided.
[0298] (Application example 2)
[0299] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0300] While conventional systems can provide customized services based on a user's individual identification information, it is difficult to recognize a user's emotional state in real time and provide optimal content based on that emotion. Furthermore, there is a lack of system-wide sharing of feedback based on emotional information and utilization of it in future services. As a result, improvements to the user experience are limited, and truly personalized services cannot be provided.
[0301] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0302] In this invention, the server includes communication means for holding individual identification information, edge computer means for extracting the individual identification information received via the communication means, backend server means for receiving the individual identification information from the edge computer means and returning user data, means for providing a service customized to a specific user using the user data, emotion recognition means for recognizing the emotional state of the user using the edge computer means, and means for providing optimal content to the user based on the emotion information acquired by the emotion recognition means. This makes it possible to provide a truly personalized service based on both the individual identification information and the emotional state of the user.
[0303] "Individual identification information" is information used to uniquely identify a specific user.
[0304] "Communication means" refers to devices or technologies for transmitting or receiving individual identification information.
[0305] An "edge computer means" is a device or system that receives individual identification information from a communication means and performs processing based on that information.
[0306] The "back-end server means" is a server system that searches for and returns user data based on the individual identification information received from the edge computer means.
[0307] "Emotion recognition means" refers to a device or software for analyzing and recognizing the user's emotional state.
[0308] The "means for providing customized services" refers to a function or system that provides services and content optimized for a specific user based on user data and emotional information.
[0309] A "ring-shaped device" is a ring-shaped device that holds individual identification information and transmits that information via a communication means.
[0310] "Wireless communication technology" is a technology that uses radio waves to send and receive data.
[0311] The present invention is a system that uses a ring-shaped device that holds individual identification information, an edge computer, and a back-end server, and further combines emotion recognition means to provide customized services to users. Detailed embodiments of the present invention will be described below.
[0312] 1. Ring-shaped device
[0313] The ring-shaped device worn by the user has a built-in unique identification information (UUID). This device transmits the UUID to the edge computer using wireless communication technology (such as RFID). Due to its simple structure, the ring-shaped device can always transmit the UUID without the need for battery replacement or setting changes.
[0314] 2. Edge Computers
[0315] The edge computer is equipped with an RFID reader to receive the UUID from the ring-shaped device. Based on the acquired UUID, the edge computer sends an API request to the backend server to retrieve the corresponding user data. In addition, the edge computer is equipped with an emotion recognition means to analyze the user's emotional state, and analyzes the user's facial expressions and voice in real time using a camera and microphone.
[0316] 3. Backend Server
[0317] The backend server searches the database based on the UUID sent from the edge computer and returns the corresponding user data. This user data includes the user's name, purchase history, preferences, etc. The backend server also updates the database based on the emotion information sent from the edge computer and uses it for the next service provision.
[0318] Specific examples
[0319] For example, consider the case where a user arrives at a shopping mall and approaches an edge computer installed at the entrance. When the ring-shaped device sends a UUID to the edge computer, the edge computer receives the UUID and sends an API request to the backend server. The backend server searches the user database to obtain the user's purchasing history and preferences, and returns the information to the edge computer.
[0320] At the same time, the edge computer uses its built-in camera and microphone to analyze the user's facial expressions and tone of voice to assess their emotional state. For example, if the user is smiling, the edge computer will use that information to display cheerful and upbeat content. Conversely, if the user looks anxious, it will provide relaxing content.
[0321] Prompt Sentence Examples
[0322] You can input prompts like the following into your generative AI model:
[0323] "UUID: 123e4567-e89b-12d3-a456-426614174000
[0324] Emotional state: happy
[0325] Username: Taro
[0326] Purchase history: [Product A, Product B, Product C]
[0327] Favorite Item: Item D
[0328] Produced message:
[0329] Hello Taro! Looks like you're having fun today! I highly recommend this product!
[0330] In this way, the system of the present invention can provide a more personalized service based on both the user's individual identity and real-time emotional state, thereby improving the user experience.
[0331] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0332] Step 1:
[0333] A user arrives at a commercial facility and wears a ring-shaped device. When the user moves close to the edge computer, the ring-shaped device transmits a UUID.
[0334] Input: UUID from the ring device
[0335] Output: UUID received by edge computer
[0336] Specific operation: When a user wears a ring-shaped device and moves around an edge computer in a commercial facility, the ring-shaped device continues to transmit a UUID.
[0337] Step 2:
[0338] The edge computer uses an RFID reader to receive the UUID from the ring-shaped device.
[0339] Input: UUID signal
[0340] Output: Get UUID
[0341] Specific operation: The UUID signal from the ring-shaped device is received by the RFID reader in the edge computer, and the UUID is stored in the edge computer.
[0342] Step 3:
[0343] The edge computer uses the acquired UUID to send an API request to the backend server, requesting the corresponding user data.
[0344] Input: UUID
[0345] Output: User database query
[0346] Specific operation: Based on the UUID, the edge computer sends an HTTP request to the backend server, instructing it to search for user information.
[0347] Step 4:
[0348] The backend server searches the database based on the UUID from the edge computer and obtains the corresponding user data.
[0349] Input: Query based on UUID
[0350] Output: User data
[0351] Specific operation: The backend server searches the database and extracts data such as the user's past purchase history and favorite products corresponding to the UUID.
[0352] Step 5:
[0353] The back-end server returns the acquired user data to the edge computer.
[0354] Input: User data
[0355] Output: Data response
[0356] Specific operation: The backend server formats the extracted user data and generates an HTTP response to send back to the edge computer.
[0357] Step 6:
[0358] The edge computer uses a camera and microphone to analyze the user's facial expressions and tone of voice, and evaluates the user's emotional state using emotion recognition means.
[0359] Input: Camera video, microphone audio data
[0360] Output: Emotional information
[0361] Specific operation: The edge computer uses a camera and microphone to collect video and audio data, analyzes the data with an emotion recognition algorithm, and classifies the user's emotional state.
[0362] Step 7:
[0363] Based on the user data and emotional information acquired by the edge computer, content optimal for the user is generated and displayed on a display device such as a monitor.
[0364] Input: User data, emotional information
[0365] Output: Customized content
[0366] Specific operation: The edge computer integrates user data and emotional information to generate specific promotional content and information, which is then displayed on the display and provided to the user.
[0367] Step 8:
[0368] At the same time that the generated content is provided to the user, the edge computer transmits the acquired emotion information to the backend server, which updates the user database.
[0369] Input: Emotion information
[0370] Output: Database update request
[0371] Specific operation: The edge computer sends the collected emotion information to the backend server as an HTTP request, and uses that information to instruct the backend server to update the user database to the latest version.
[0372] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0373] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0374] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0375] [Second embodiment]
[0376] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0377] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0378] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0379] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0380] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0381] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0382] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0383] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0384] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0385] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0386] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0387] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0388] The present invention provides customized services to users through a system including a ring-shaped device that holds individual identification information, an edge computer, and a back-end server. An embodiment of each component of the system will be described.
[0389] 1. Ring-shaped device
[0390] The ring-shaped device worn by the user has a built-in unique identification information (UUID), which is transmitted to the edge computer using RFID technology.
[0391] 2. Edge Computers
[0392] The edge computer is equipped with an RFID reader that receives the UUID from the ring device, and then uses the received UUID to send an API request to the backend server, requesting the corresponding user data.
[0393] The edge computer uses the user data returned from the server to generate services customized for the user. For example, in the case of an autonomous driving system, it can obtain individual user ride settings and destination data and apply them to the autonomous vehicle.
[0394] 3. Backend Server
[0395] The backend server receives the request from the edge computer and searches the database for the corresponding user data based on the UUID. The searched user data is returned to the edge computer, and the user is provided with a customized service.
[0396] Program function description
[0397] Ring-shaped device
[0398] When a user wears the ring and moves near an edge computer, the ring-type device transmits a UUID. Due to its simple structure, the ring-type device can transmit the UUID at all times without the need for battery replacement or setting changes.
[0399] Edge Computer
[0400] The edge computer receives the UUID from the ring device, then uses this UUID to send an API request to the backend server to retrieve the corresponding user data. Based on the retrieved user data, the edge computer displays and provides information and services optimized for the user.
[0401] Backend Server
[0402] The backend server retrieves user data from a database based on the UUID sent from the edge computer. This data includes the user's name, preferences, and interests, and returns it to the edge computer. The edge computer then uses this information to provide customized services to the user.
[0403] Specific examples
[0404] For example, suppose a user arrives at a shopping center and approaches a display with an edge computer. The ring-shaped device transmits a UUID, which the edge computer receives. The edge computer then sends an API request to the backend server to retrieve the corresponding user's purchasing history and favorite product information.
[0405] Based on the information received from the backend server, the edge computer can display the user's name and provide personalized product recommendations and the latest promotional information, providing the user with a personalized shopping experience.
[0406] In this way, the present invention is a system that is centered around a ring-shaped device carried by the user, and that can provide customized services in real time simply and effectively by linking with an edge computer and a back-end server.
[0407] The processing flow will be explained below.
[0408] Step 1:
[0409] The user puts on the ring
[0410] A user wears a ring-shaped device and moves close to an edge computer. The ring-shaped device contains a unique UUID, which is transmitted to the edge computer via RFID technology.
[0411] Step 2:
[0412] The device receives the UUID
[0413] The edge computer receives the UUID signal from the ring-shaped device using an RFID reader. The UUID is used as unique identification information and proceeds to the next step.
[0414] Step 3:
[0415] The device sends an API request
[0416] The edge computer uses the received UUID to send an API request to the backend server, which includes the UUID as a parameter. The API request is made using the HTTP protocol.
[0417] Step 4:
[0418] The server receives the API request
[0419] The server receives the API request from the edge computer, extracts the UUID from the request, and begins the process of searching the user database.
[0420] Step 5:
[0421] The server retrieves the user data
[0422] The server searches its database for information based on the received UUID. This is a fast search process that extracts the corresponding user data, such as username, preferences, and interests.
[0423] Step 6:
[0424] The server returns a response
[0425] The server converts the user data obtained from the search into JSON format and returns it to the edge computer, where the user data includes the user's name, preferences, and interests.
[0426] Step 7:
[0427] The terminal receives user data.
[0428] The edge computer receives the user data in JSON format from the server, giving the edge computer detailed information about the user.
[0429] Step 8:
[0430] The terminal generates customized services
[0431] The edge computer analyzes the received user data and generates services optimized for the specific user (for example, product recommendations based on browsing history or settings for self-driving cars).
[0432] Step 9:
[0433] Providing customized services to users
[0434] The edge computer presents the generated customized services to the user through a display or other interface, allowing the user to receive individually personalized information and services.
[0435] This series of processes allows users to easily enjoy customized services in real time from edge computers simply by wearing the ring-shaped device.
[0436] Example 1
[0437] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0438] In conventional service provision systems that use user data, it is difficult to obtain individual user identification information in real time and quickly provide customized services. In addition, the lack of cooperation between components makes it difficult to achieve a seamless user experience.
[0439] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0440] In this invention, the server includes a communication means for holding individual identification information, an edge computer means for extracting the individual identification information received via the communication means, a backend server means for receiving the individual identification information from the edge computer means and returning user data, a means for generating and providing a service customized for a specific user using the user data, a means for the edge computer means to send an API request to the backend server means based on the individual identification information, a means for the backend server means to receive the API request and search for corresponding user data, and a means for returning the user data to the edge computer means. This makes it possible to obtain individual identification information possessed by a user in real time and quickly provide a customized service.
[0441] "Individual identification information" is information that uniquely identifies a specific individual or object.
[0442] A "communication means" is a means for sending and receiving data.
[0443] An "edge computing means" is a computing device for performing data collection, analysis, and processing near the site.
[0444] The "back-end server means" is a server device that manages data to provide various services and responds to requests from other systems and devices.
[0445] "User Data" is information associated with a particular user, including name, preferences, interests, purchasing history, and the like.
[0446] An "API request" is a request format for requesting specific processing or data provision from other programs or services.
[0447] A "ring-shaped information transmitting device" is a ring-shaped device used to transmit individual identification information.
[0448] "Wireless communication technology" is a technology that transmits data via wireless radio waves without using cables.
[0449] The present invention is a system that includes a ring-shaped information transmission device that holds individual identification information, an edge computer, and a back-end server, and provides customized services to users. Specific embodiments for carrying out the invention are described below.
[0450] Ring-shaped information transmission device
[0451] The ring-shaped information transmission device worn by the user has a built-in unique identification information (UUID). This device periodically transmits the UUID to the edge computer using RFID technology. The device does not require a battery and is designed to constantly transmit the UUID.
[0452] Edge Computer
[0453] The edge computer is equipped with an RFID reader that receives UUIDs from ring-shaped information transmission devices worn by users. Based on the received UUID, the edge computer sends API requests to a backend server, requesting specific user data. This processing is performed in real time, and the edge computer has the ability to instantly generate and provide information and services optimized for the user.
[0454] As a specific example, the edge computer sends a prompt sentence to the backend server saying, "User A's UUID has been received. What is User A's favorite drink?"
[0455] Backend Server
[0456] When the backend server receives an API request sent from the edge computer, it searches for the user data in the database based on the UUID, finds the corresponding user data, and sends it back to the edge computer.
[0457] Specifically, the backend server retrieves the entry corresponding to "UUID:12345" from the database and returns "User A's name, purchase history, and favorite information" to the edge computer as a response.
[0458] Specific examples
[0459] For example, suppose a user arrives at a shopping center and approaches a display where an edge computer is installed. The ring-shaped information transmission device worn by the user transmits a UUID, which is received by the edge computer. The edge computer immediately sends an API request to the backend server, asking for the user data corresponding to UUID:12345.
[0460] The backend server retrieves the relevant user data (such as purchase history and favorite product information) from the database and sends it back to the edge computer. Based on the received information, the edge computer displays the user's name, recommended products, operation guides, and other information on the display screen. In this way, the user can enjoy a personalized shopping experience.
[0461] Prompt Sentence Examples
[0462] Here are some examples of prompts:
[0463] "User A has been identified. Please show us the best product recommendations for User A."
[0464] "User B has arrived at the shopping center. Please generate a list of recommended products based on User B's purchasing history."
[0465] "User C has arrived at the entrance. Please display promotional information based on User C's interests."
[0466] As a result, the present invention makes it possible to efficiently provide customized services in real time by combining a ring-shaped information transmission device carried by a user, an edge computer, and a back-end server.
[0467] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0468] Step 1:
[0469] A user wears a ring-shaped information transmission device and moves near the system. This ring-shaped device periodically transmits unique identification information (UUID). This UUID is sent to the edge computer via a communication means. The input is the UUID of the ring-shaped device held by the user, and the output is the UUID received by the edge computer. In concrete terms, the ring-shaped device sends "UUID:12345" to the edge computer.
[0470] Step 2:
[0471] The edge computer receives the UUID sent from the ring-shaped device. The input is the UUID received from the communication means, and the output is the UUID used to construct the API request. The edge computer captures the UUID with its built-in RFID reader and stores it in memory. Specifically, "UUID:12345" is stored in the edge computer's memory.
[0472] Step 3:
[0473] The edge computer sends an API request to the backend server based on the UUID it obtained. The input is the UUID obtained in step 2, and the output is the API request sent to the backend server. Using the HTTP protocol, a request such as "GET / user-data?uuid=12345" is sent to the backend server. Specifically, the edge computer sends an API request including "UUID:12345" to the backend server.
[0474] Step 4:
[0475] The backend server receives the API request sent from the edge computer and searches the database to retrieve the corresponding user data. The input is the UUID in the API request, and the output is the user data. The backend server searches the corresponding entry in the database and retrieves the user's name, settings, favorite information, etc. Specifically, the backend server retrieves "User A's name, purchase history, and favorite information" based on "UUID:12345."
[0476] Step 5:
[0477] The backend server returns the acquired user data to the edge computer. The input is user data, and the output is user data sent to the edge computer. Specifically, the backend server returns "User A's name, purchase history, and favorite information" to the edge computer.
[0478] Step 6:
[0479] The edge computer uses the user data it receives to generate and provide a service customized for a specific user. The input is the user data received from the backend server, and the output is a customized service that is displayed to the user. Specifically, the edge computer displays a message on the display such as, "Hello, User A! Here are some recommended products for you."
[0480] Through the above processing steps, the system can efficiently provide users with customized services in real time.
[0481] (Application example 1)
[0482] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0483] Current autonomous vehicles generally require users to manually adjust the seat position and configure the entertainment system each time they enter the vehicle, a process that is inconvenient and time-consuming. Another issue is that it is difficult to provide a comfortable riding experience because it is not easy to customize for each user. There is a need to solve these problems and provide a riding environment optimized for each user.
[0484] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0485] In this invention, the server includes a communication means for holding individual identification information, an edge computer means for extracting the individual identification information received via the communication means, a backend server means for receiving the individual identification information from the edge computer means and returning user data, a means for providing a service customized for a specific user using the user data, and a means for customizing a seat position or an entertainment system in an automated vehicle using the user data, thereby making it possible to provide a personalized riding environment for the user in the automated vehicle.
[0486] "Individual identification information" is information for uniquely identifying a user.
[0487] The "communication means" is a means for transmitting individual identification information to the edge computer means.
[0488] The "edge computer means" is a computer device for receiving individual identification information and requesting data from the backend server means based on the individual identification information.
[0489] The "back-end server means" is a server device that searches for user data based on the individual identification information received from the edge computer means and returns the data.
[0490] "User Data" is information about a particular user and is used to provide customized services.
[0491] "Customized Services" refers to services that are tailored based on a user's individual identity and user data.
[0492] An "automated vehicle" is a vehicle that navigates and performs functions autonomously without user interaction.
[0493] "Seat position" refers to the physical arrangement of seats within an automated vehicle, as adjusted for each user.
[0494] An "entertainment system" is an in-vehicle system that plays media content such as music and videos and is configured according to the user's preferences.
[0495] To implement this invention, the system includes the following major components:
[0496] 1. Ring-shaped device
[0497] The ring-shaped device is worn by the user and holds unique identification information (UUID). This device transmits the UUID to the edge computer means using RFID technology. This device does not require battery replacement or setting changes and can always transmit the UUID.
[0498] 2. Edge computing means
[0499] The edge computer means is installed in the vehicle and includes an RFID reader. The edge computer means receives the UUID from the ring-shaped device. The edge computer means then uses the UUID to send an API request to the backend server means to obtain corresponding user data. Based on the obtained user data, the edge computer applies user-specific settings to the in-vehicle OS to customize the seat position and entertainment system.
[0500] example:
[0501] When a user wears the ring-shaped device and gets into an autonomous vehicle, the edge computer means in the vehicle immediately recognizes the UUID and retrieves the user's vehicle settings from the backend server means, resulting in a personalized riding experience, such as automatically adjusting the seat position and playing the user's favorite music playlist.
[0502] 3. Backend Server Measures
[0503] The back-end server means is installed on the cloud and searches for corresponding user data from a database based on the UUID and returns it to the edge computer means. This data includes the user's name, seat position settings, music playlist, favorite destinations, etc., and based on this, the edge computer provides customized services to the user.
[0504] 4. Smartphone Applications
[0505] Using a smartphone application, users can configure their car interior settings in advance (e.g., preferred temperature settings, seat position, music playlist, etc.) The application synchronizes data with edge computing means and back-end server means to enhance the user experience.
[0506] Example prompt sentence:
[0507] Write code that receives the UUID of a ring-shaped device worn by a user, retrieves user settings from a backend server in the cloud, and automatically adjusts seat position and music playlist in an autonomous vehicle. Technologies used include RFID, edge computing, and API communication.
[0508] Specific hardware and software used
[0509] Ring-type device: A device that holds unique identification information (UUID) and transmits it to an edge computer using RFID technology.
[0510] Edge computer: A computing device installed inside a vehicle that is equipped with an RFID reader.
[0511] Back-end server: A server device installed on the cloud that has a database for storing user data.
[0512] API: An application programming interface that allows edge computers to communicate data with backend servers.
[0513] In-vehicle OS: The operating system installed in self-driving vehicles.
[0514] Smartphone app: An application that allows users to configure settings in advance.
[0515] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0516] Step 1:
[0517] When a user wears a ring-type device and gets into a vehicle, the ring-type device transmits a UUID using RFID technology. The input is the UUID held by the ring-type device, and the output is the UUID received by the RFID reader.
[0518] Step 2:
[0519] The edge computer means receives a UUID through an RFID reader installed in the vehicle. The input here is the UUID received by the RFID reader, and the output is an API request carrying the UUID. The edge computer means sends the API request to the backend server means using this UUID.
[0520] Step 3:
[0521] The backend server means receives an API request including a UUID from the edge computer means. The input is the UUID sent from the edge computer means, and the output is a response including corresponding user data. The backend server means searches for the user data from the database based on the UUID and returns the result to the edge computer means.
[0522] Step 4:
[0523] The edge computer means acquires the user data received from the backend server means and transmits it to the in-vehicle OS. The input is the user data from the backend server means, and the output is the customization information transmitted to the in-vehicle OS.
[0524] Step 5:
[0525] The in-vehicle OS customizes the seat position and entertainment system based on the received user data. The input is the user data sent from the edge computing means, and the output is the adjusted seat position and entertainment system settings. Specifically, the seat position is automatically adjusted to the user's preferences, and the user's favorite music playlist begins playing.
[0526] Step 6:
[0527] Users can check and change settings in advance using a smartphone application. The input is setting change information operated by the user, which is synchronized with the edge computer means and the back-end server means. The output is updated customization information, which is applied to the vehicle. Specifically, the user sets temperature settings or a new music playlist on the smartphone app, and this is reflected in the vehicle.
[0528] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0529] The present invention provides customized services to users by combining an emotion engine with a system including a ring-shaped device that holds individual identification information, an edge computer, and a back-end server. An embodiment of each component of the system will be described below.
[0530] 1. Ring-shaped device
[0531] The ring-shaped device worn by the user has a built-in unique identification information (UUID), which is transmitted to the edge computer using RFID technology.
[0532] 2. Edge Computers
[0533] The edge computer is equipped with an RFID reader that receives the UUID from the ring device. The edge computer uses the received UUID to send an API request to the backend server to request the corresponding user data. The edge computer also has an emotion engine that recognizes the user's emotions.
[0534] The emotion engine uses a microphone and a camera to analyze the user's voice and facial expressions to recognize the user's emotion information, which includes the user's emotional and psychological state, and is added to the user database.
[0535] 3. Backend Server
[0536] The backend server receives the request from the edge computer and searches the database for the corresponding user data based on the UUID. The searched user data is returned to the edge computer, and the user is provided with a customized service.
[0537] The back-end server updates the user database based on the emotion information acquired by the emotion engine the next time a service is provided, allowing for more precise and tailored services to be provided to the user.
[0538] Program function description
[0539] Ring-shaped device
[0540] When a user wears the ring and moves near an edge computer, the ring-type device transmits a UUID. Due to its simple structure, the ring-type device can transmit the UUID at all times without the need for battery replacement or setting changes.
[0541] Edge Computer
[0542] The edge computer receives the UUID from the ring device, then uses this UUID to send an API request to the backend server to retrieve the corresponding user data, and then uses an emotion engine to recognize the user's emotion.
[0543] The user's emotion data acquired by the emotion engine is added to the user data and used when providing services. For example, if the user has an anxious expression, the edge computer will display relaxing content.
[0544] Backend Server
[0545] The backend server searches the database for user data based on the UUID sent from the edge computer, including the user's name, preferences, and emotional information, and returns this data to the edge computer.
[0546] Furthermore, the database is updated based on the emotional data acquired by the emotion engine, and this information is used the next time the service is provided. For example, if a user showed an anxious expression during the previous session, the next time the service is provided, that state will be taken into consideration.
[0547] Specific examples
[0548] For example, suppose a user arrives at a shopping center and approaches a display with an edge computer. The ring-shaped device transmits a UUID, which the edge computer receives. The edge computer then sends an API request to the backend server to retrieve the corresponding user's purchasing history and favorite product information.
[0549] At the same time, the edge computer uses an emotion engine to analyze the user's current emotional state. For example, if the edge computer detects that the user is smiling, it can use that information to display promotional content accompanied by cheerful, upbeat music.
[0550] The backend server returns a list of products tailored to the user's name and purchase history to the edge computer, which can then provide the user with the most appropriate information and services, and provide a more personalized experience based on the results of the emotion engine.
[0551] As such, the present invention is a system that provides highly customized services in real time by linking an edge computer, an emotion engine, and a back-end server, with a ring-shaped device carried by the user at its core.
[0552] The processing flow will be explained below.
[0553] Step 1:
[0554] The user puts on the ring
[0555] A user wears a ring-shaped device and moves close to an edge computer. The ring-shaped device contains a unique UUID, which is transmitted to the edge computer via RFID technology.
[0556] Step 2:
[0557] The device receives the UUID
[0558] The edge computer receives the UUID signal from the ring-shaped device through an RFID reader. The received UUID is processed within the edge computer and proceeds to the next step.
[0559] Step 3:
[0560] The device sends an API request
[0561] The edge computer uses the received UUID to send an API request to the backend server, requesting the corresponding user data. The API request is sent using the HTTP protocol.
[0562] Step 4:
[0563] The server receives and processes the API request.
[0564] The backend server receives the API request sent from the edge computer, parses the UUID included in the request, and uses this information as a database lookup key.
[0565] Step 5:
[0566] The server searches for and returns the user data
[0567] The backend server searches for user data in a database based on the UUID, and the searched data is returned to the edge computer in JSON format. The user data includes name, preferences, and interests.
[0568] Step 6:
[0569] The terminal receives user data.
[0570] The edge computer receives and analyzes the user data returned from the server, thereby obtaining detailed information about the user.
[0571] Step 7:
[0572] The device activates the emotion engine
[0573] The edge computer activates the emotion engine, which begins the process of recognizing the user's emotions. The emotion engine uses a microphone and camera to analyze the user's voice and facial expressions.
[0574] Step 8:
[0575] The device analyzes emotional information
[0576] The emotion engine analyzes the acquired voice and facial expression data to estimate the user's emotional state. For example, emotional information such as "joy" if the user smiles, or "anxiety" if the user looks confused is generated.
[0577] Step 9:
[0578] The device adds emotional information to the user data.
[0579] The emotional information acquired by the edge computer is added to the user data and used for more specific customization. The emotional information is updated in real time and will be used the next time the service is provided.
[0580] Step 10:
[0581] Providing customized services to users
[0582] The edge computer generates customized services based on the received user data and emotional information. For example, if the user is in a relaxed state, it will provide relaxing content.
[0583] Step 11:
[0584] The server updates the user database
[0585] The backend server records the latest emotion information sent from the edge computer in a user database so that it can be used the next time a service is provided, thereby providing services that take user emotions into greater consideration.
[0586] Through this series of processes, users can enjoy real-time, highly customized services provided by edge computers and back-end servers simply by wearing the ring-shaped device.
[0587] Example 2
[0588] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0589] Conventional user service provision systems have difficulty recognizing a user's emotional state in real time and personalizing services. This has resulted in an inability to provide flexible services that respond to a user's temporary emotions, potentially resulting in a decrease in satisfaction. Furthermore, these systems are limited to providing services on an ad hoc basis, and the collection of data that can be used for future services is insufficient.
[0590] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0591] In this invention, the server includes a communication device means for storing individual identification information, an edge computer means for extracting the individual identification information received via the communication device means, a back-end computer means for receiving the individual identification information from the edge computer means and returning user data, an emotion engine means for analyzing the user data and further analyzing voice and facial expressions to obtain emotional information, a means for providing a service customized for a specific user using the emotional information and user data, and a means for storing the emotional information in a user database and utilizing it for subsequent service provision. This makes it possible to recognize the user's emotional state in real time and provide personalized services based on that. Furthermore, by utilizing the obtained emotional information when providing subsequent services, it is possible to provide even more precise services tailored to the user.
[0592] "Individual identification information" is information for uniquely identifying a user, such as a UUID (universal unique identifier).
[0593] The "communication device means" is a device that holds and transmits individual identification information, and corresponds to a ring-shaped device or the like.
[0594] The "edge computing means" is a device that receives individual identification information from the communication device means and sends a request to the back-end computing means, and specifically corresponds to a computer with a built-in RFID reader.
[0595] The "back-end computer means" is a device that searches for and returns corresponding user data based on the individual identification information received from the edge computer means, and corresponds to a server that manages a database.
[0596] The "emotion engine means" is a device that analyzes the user's voice, facial expressions, etc., and acquires emotional information, and specifically corresponds to a computer with a built-in microphone and camera.
[0597] A "user database" is a database that records data and emotional information about users, and is managed by back-end computing means.
[0598] The "means for providing customized services" refers to devices and systems for providing services and content tailored to a particular user based on user data and emotional information.
[0599] The present invention is a system that provides customized services to users by combining a communication device that holds individual identification information, an edge computer, a back-end computer, and an emotion engine.
[0600] Ring-shaped device
[0601] The ring-shaped device worn by the user has a built-in unique identification information (UUID), which is transmitted to the edge computer using RFID technology.
[0602] example
[0603] When a user wears the ring and moves near an edge computer, the ring-type device transmits a UUID. Due to its simple structure, the ring-type device can transmit the UUID at all times without the need for battery replacement or setting changes.
[0604] Edge Calculator
[0605] The edge computer is equipped with an RFID reader that receives the UUID from the ring-shaped device. It then uses the received UUID to send an API request to the backend computer, requesting the corresponding user data. Furthermore, the edge computer is equipped with an emotion engine that analyzes the user's voice and facial expressions to obtain emotional information. This emotional information is added to a user database, which includes the user's emotional and psychological state.
[0606] example
[0607] When the edge computer receives the UUID from the ring-shaped device, it uses this UUID to send an API request to the backend computer. At the same time, it uses an emotion engine to analyze the user's facial expressions and voice. For example, if the user is smiling, it displays promotional content with cheerful, fun music based on that information.
[0608] Backend Calculator
[0609] The backend computer receives a request from the edge computer and searches the database for the corresponding user data based on the UUID. The searched user data is returned to the edge computer, and a customized service is provided to the user. In addition, the emotion information obtained by the emotion engine is saved in the user database and used the next time the service is provided. This update enables the provision of more precise and user-specific services.
[0610] example
[0611] When the backend computer receives the UUID, it immediately searches the database to retrieve the user's name, purchase history, preferences, past emotional information, etc. For example, if the user looked anxious in the previous session, the next time it provides a service that takes that state into account.
[0612] Specific examples
[0613] For example, suppose a user arrives at a shopping center and approaches a display equipped with an edge computer. The ring-shaped device transmits a UUID, which the edge computer receives. The edge computer then sends an API request to the backend computer to obtain the corresponding user's purchasing history and favorite product information. At the same time, the edge computer uses its emotion engine to analyze the user's current emotional state. If the edge computer recognizes that the user is smiling, it uses this information to display promotional content accompanied by cheerful, upbeat music. Based on the user data returned from the backend computer, the edge computer provides the user with optimal information and services.
[0614] Example prompt sentence:
[0615] "Write a program that receives a user's UUID from the edge computer and sends a request to the backend computer based on that UUID. Also, add a function that analyzes the user's voice and facial expressions to recognize emotions, and provides appropriate services to the user based on the results."
[0616] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0617] Step 1:
[0618] The user wears the ring-shaped device and moves close to the edge computer.
[0619] Input: A ring-like device with the user's UUID embedded
[0620] Output: Sending UUID
[0621] Specific operation: The ring-shaped device uses built-in RFID technology to transmit a UUID to the edge computer.
[0622] Step 2:
[0623] The edge computer receives the UUID from the ring.
[0624] Input: UUID sent from the ring device
[0625] Output: Received UUID
[0626] Specific operation: The RFID reader on the edge computer receives the UUID and forwards the data to the internal system.
[0627] Step 3:
[0628] The edge computer uses the received UUID to send an API request to the backend computer, requesting user data.
[0629] Input: Received UUID
[0630] Output: Request for relevant user data
[0631] Specific operation: The edge computer sends the UUID as an HTTP POST request to the backend computer, requesting user data.
[0632] Step 4:
[0633] The back-end computer retrieves the user data from the database based on the UUID and returns it to the edge computer.
[0634] Input: API request containing UUID
[0635] Output: The corresponding user data
[0636] Specific operation: The back-end computer executes a database query to retrieve data such as the user's name, preferences, and past emotional information, and returns this to the edge computer.
[0637] Step 5:
[0638] The edge computer receives the returned user data and analyzes the user's emotions.
[0639] Input: Returned user data, as well as user voice and facial expression data
[0640] Output: User's emotional information
[0641] Specific operation: The edge computer uses the built-in microphone and camera to capture the user's voice and facial expressions, and then analyzes their emotional state using an emotion engine.
[0642] Step 6:
[0643] Edge computers provide customized services based on user data and emotional information.
[0644] Input: Returned user data and parsed emotion information
[0645] Output: customized services and content
[0646] Specific operation: The edge computer uses the analyzed emotional information and user data to display services and content that are optimal for the user. For example, if the user looks anxious, it will play relaxing music.
[0647] Step 7:
[0648] The edge computer sends the emotion information to the back-end computer and updates the user database.
[0649] Input: Parsed emotion information
[0650] Output: Updated user database
[0651] Specific operation: The edge computer sends the acquired emotion information to the back-end computer, which stores it in the user database and uses it the next time the service is provided.
[0652] (Application example 2)
[0653] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0654] While conventional systems can provide customized services based on a user's individual identification information, it is difficult to recognize a user's emotional state in real time and provide optimal content based on that emotion. Furthermore, there is a lack of system-wide sharing of feedback based on emotional information and utilization of it in future services. As a result, improvements to the user experience are limited, and truly personalized services cannot be provided.
[0655] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0656] In this invention, the server includes communication means for holding individual identification information, edge computer means for extracting the individual identification information received via the communication means, backend server means for receiving the individual identification information from the edge computer means and returning user data, means for providing a service customized to a specific user using the user data, emotion recognition means for recognizing the emotional state of the user using the edge computer means, and means for providing optimal content to the user based on the emotion information acquired by the emotion recognition means. This makes it possible to provide a truly personalized service based on both the individual identification information and the emotional state of the user.
[0657] "Individual identification information" is information used to uniquely identify a specific user.
[0658] "Communication means" refers to devices or technologies for transmitting or receiving individual identification information.
[0659] An "edge computer means" is a device or system that receives individual identification information from a communication means and performs processing based on that information.
[0660] The "back-end server means" is a server system that searches for and returns user data based on the individual identification information received from the edge computer means.
[0661] "Emotion recognition means" refers to a device or software for analyzing and recognizing the user's emotional state.
[0662] The "means for providing customized services" refers to a function or system that provides services and content optimized for a specific user based on user data and emotional information.
[0663] A "ring-shaped device" is a ring-shaped device that holds individual identification information and transmits that information via a communication means.
[0664] "Wireless communication technology" is a technology that uses radio waves to send and receive data.
[0665] The present invention is a system that uses a ring-shaped device that holds individual identification information, an edge computer, and a back-end server, and further combines emotion recognition means to provide customized services to users. Detailed embodiments of the present invention will be described below.
[0666] 1. Ring-shaped device
[0667] The ring-shaped device worn by the user has a built-in unique identification information (UUID). This device transmits the UUID to the edge computer using wireless communication technology (such as RFID). Due to its simple structure, the ring-shaped device can always transmit the UUID without the need for battery replacement or setting changes.
[0668] 2. Edge Computers
[0669] The edge computer is equipped with an RFID reader to receive the UUID from the ring-shaped device. Based on the acquired UUID, the edge computer sends an API request to the backend server to retrieve the corresponding user data. In addition, the edge computer is equipped with an emotion recognition means to analyze the user's emotional state, and analyzes the user's facial expressions and voice in real time using a camera and microphone.
[0670] 3. Backend Server
[0671] The backend server searches the database based on the UUID sent from the edge computer and returns the corresponding user data. This user data includes the user's name, purchase history, preferences, etc. The backend server also updates the database based on the emotion information sent from the edge computer and uses it for the next service provision.
[0672] Specific examples
[0673] For example, consider the case where a user arrives at a shopping mall and approaches an edge computer installed at the entrance. When the ring-shaped device sends a UUID to the edge computer, the edge computer receives the UUID and sends an API request to the backend server. The backend server searches the user database to obtain the user's purchasing history and preferences, and returns the information to the edge computer.
[0674] At the same time, the edge computer uses its built-in camera and microphone to analyze the user's facial expressions and tone of voice to assess their emotional state. For example, if the user is smiling, the edge computer will use that information to display cheerful and upbeat content. Conversely, if the user looks anxious, it will provide relaxing content.
[0675] Prompt Sentence Examples
[0676] You can input prompts like the following into your generative AI model:
[0677] "UUID: 123e4567-e89b-12d3-a456-426614174000
[0678] Emotional state: happy
[0679] Username: Taro
[0680] Purchase history: [Product A, Product B, Product C]
[0681] Favorite Item: Item D
[0682] Produced message:
[0683] Hello Taro! Looks like you're having fun today! I highly recommend this product!
[0684] In this way, the system of the present invention can provide a more personalized service based on both the user's individual identity and real-time emotional state, thereby improving the user experience.
[0685] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0686] Step 1:
[0687] A user arrives at a commercial facility and wears a ring-shaped device. When the user moves close to the edge computer, the ring-shaped device transmits a UUID.
[0688] Input: UUID from the ring device
[0689] Output: UUID received by edge computer
[0690] Specific operation: When a user wears a ring-shaped device and moves around an edge computer in a commercial facility, the ring-shaped device continues to transmit a UUID.
[0691] Step 2:
[0692] The edge computer uses an RFID reader to receive the UUID from the ring-shaped device.
[0693] Input: UUID signal
[0694] Output: Get UUID
[0695] Specific operation: The UUID signal from the ring-shaped device is received by the RFID reader in the edge computer, and the UUID is stored in the edge computer.
[0696] Step 3:
[0697] The edge computer uses the acquired UUID to send an API request to the backend server, requesting the corresponding user data.
[0698] Input: UUID
[0699] Output: User database query
[0700] Specific operation: Based on the UUID, the edge computer sends an HTTP request to the backend server, instructing it to search for user information.
[0701] Step 4:
[0702] The backend server searches the database based on the UUID from the edge computer and obtains the corresponding user data.
[0703] Input: Query based on UUID
[0704] Output: User data
[0705] Specific operation: The backend server searches the database and extracts data such as the user's past purchase history and favorite products corresponding to the UUID.
[0706] Step 5:
[0707] The back-end server returns the acquired user data to the edge computer.
[0708] Input: User data
[0709] Output: Data response
[0710] Specific operation: The backend server formats the extracted user data and generates an HTTP response to send back to the edge computer.
[0711] Step 6:
[0712] The edge computer uses a camera and microphone to analyze the user's facial expressions and tone of voice, and evaluates the user's emotional state using emotion recognition means.
[0713] Input: Camera video, microphone audio data
[0714] Output: Emotional information
[0715] Specific operation: The edge computer uses a camera and microphone to collect video and audio data, analyzes the data with an emotion recognition algorithm, and classifies the user's emotional state.
[0716] Step 7:
[0717] Based on the user data and emotional information acquired by the edge computer, content optimal for the user is generated and displayed on a display device such as a monitor.
[0718] Input: User data, emotional information
[0719] Output: Customized content
[0720] Specific operation: The edge computer integrates user data and emotional information to generate specific promotional content and information, which is then displayed on the display and provided to the user.
[0721] Step 8:
[0722] At the same time that the generated content is provided to the user, the edge computer transmits the acquired emotion information to the backend server, which updates the user database.
[0723] Input: Emotion information
[0724] Output: Database update request
[0725] Specific operation: The edge computer sends the collected emotion information to the backend server as an HTTP request, and uses that information to instruct the backend server to update the user database to the latest version.
[0726] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0727] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0728] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[0729] [Third embodiment]
[0730] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[0731] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[0732] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0733] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[0734] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0735] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0736] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0737] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0738] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0739] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0740] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0741] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[0742] The present invention provides customized services to users through a system including a ring-shaped device that holds individual identification information, an edge computer, and a back-end server. An embodiment of each component of the system will be described.
[0743] 1. Ring-shaped device
[0744] The ring-shaped device worn by the user has a built-in unique identification information (UUID), which is transmitted to the edge computer using RFID technology.
[0745] 2. Edge Computers
[0746] The edge computer is equipped with an RFID reader that receives the UUID from the ring device, and then uses the received UUID to send an API request to the backend server, requesting the corresponding user data.
[0747] The edge computer uses the user data returned from the server to generate services customized for the user. For example, in the case of an autonomous driving system, it can obtain individual user ride settings and destination data and apply them to the autonomous vehicle.
[0748] 3. Backend Server
[0749] The backend server receives the request from the edge computer and searches the database for the corresponding user data based on the UUID. The searched user data is returned to the edge computer, and the user is provided with a customized service.
[0750] Program function description
[0751] Ring-shaped device
[0752] When a user wears the ring and moves near an edge computer, the ring-type device transmits a UUID. Due to its simple structure, the ring-type device can transmit the UUID at all times without the need for battery replacement or setting changes.
[0753] Edge Computer
[0754] The edge computer receives the UUID from the ring device, then uses this UUID to send an API request to the backend server to retrieve the corresponding user data. Based on the retrieved user data, the edge computer displays and provides information and services optimized for the user.
[0755] Backend Server
[0756] The backend server retrieves user data from a database based on the UUID sent from the edge computer. This data includes the user's name, preferences, and interests, and returns it to the edge computer. The edge computer then uses this information to provide customized services to the user.
[0757] Specific examples
[0758] For example, suppose a user arrives at a shopping center and approaches a display with an edge computer. The ring-shaped device transmits a UUID, which the edge computer receives. The edge computer then sends an API request to the backend server to retrieve the corresponding user's purchasing history and favorite product information.
[0759] Based on the information received from the backend server, the edge computer can display the user's name and provide personalized product recommendations and the latest promotional information, providing the user with a personalized shopping experience.
[0760] In this way, the present invention is a system that is centered around a ring-shaped device carried by the user, and that can provide customized services in real time simply and effectively by linking with an edge computer and a back-end server.
[0761] The processing flow will be explained below.
[0762] Step 1:
[0763] The user puts on the ring
[0764] A user wears a ring-shaped device and moves close to an edge computer. The ring-shaped device contains a unique UUID, which is transmitted to the edge computer via RFID technology.
[0765] Step 2:
[0766] The device receives the UUID
[0767] The edge computer receives the UUID signal from the ring-shaped device using an RFID reader. The UUID is used as unique identification information and proceeds to the next step.
[0768] Step 3:
[0769] The device sends an API request
[0770] The edge computer uses the received UUID to send an API request to the backend server, which includes the UUID as a parameter. The API request is made using the HTTP protocol.
[0771] Step 4:
[0772] The server receives the API request
[0773] The server receives the API request from the edge computer, extracts the UUID from the request, and begins the process of searching the user database.
[0774] Step 5:
[0775] The server retrieves the user data
[0776] The server searches its database for information based on the received UUID. This is a fast search process that extracts the corresponding user data, such as username, preferences, and interests.
[0777] Step 6:
[0778] The server returns a response
[0779] The server converts the user data obtained from the search into JSON format and returns it to the edge computer, where the user data includes the user's name, preferences, and interests.
[0780] Step 7:
[0781] The terminal receives user data.
[0782] The edge computer receives the user data in JSON format from the server, giving the edge computer detailed information about the user.
[0783] Step 8:
[0784] The terminal generates customized services
[0785] The edge computer analyzes the received user data and generates services optimized for the specific user (for example, product recommendations based on browsing history or settings for self-driving cars).
[0786] Step 9:
[0787] Providing customized services to users
[0788] The edge computer presents the generated customized services to the user through a display or other interface, allowing the user to receive individually personalized information and services.
[0789] This series of processes allows users to easily enjoy customized services in real time from edge computers simply by wearing the ring-shaped device.
[0790] Example 1
[0791] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0792] In conventional service provision systems that use user data, it is difficult to obtain individual user identification information in real time and quickly provide customized services. In addition, the lack of cooperation between components makes it difficult to achieve a seamless user experience.
[0793] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0794] In this invention, the server includes a communication means for holding individual identification information, an edge computer means for extracting the individual identification information received via the communication means, a backend server means for receiving the individual identification information from the edge computer means and returning user data, a means for generating and providing a service customized for a specific user using the user data, a means for the edge computer means to send an API request to the backend server means based on the individual identification information, a means for the backend server means to receive the API request and search for corresponding user data, and a means for returning the user data to the edge computer means. This makes it possible to obtain individual identification information possessed by a user in real time and quickly provide a customized service.
[0795] "Individual identification information" is information that uniquely identifies a specific individual or object.
[0796] A "communication means" is a means for sending and receiving data.
[0797] An "edge computing means" is a computing device for performing data collection, analysis, and processing near the site.
[0798] The "back-end server means" is a server device that manages data to provide various services and responds to requests from other systems and devices.
[0799] "User Data" is information associated with a particular user, including name, preferences, interests, purchasing history, and the like.
[0800] An "API request" is a request format for requesting specific processing or data provision from other programs or services.
[0801] A "ring-shaped information transmitting device" is a ring-shaped device used to transmit individual identification information.
[0802] "Wireless communication technology" is a technology that transmits data via wireless radio waves without using cables.
[0803] The present invention is a system that includes a ring-shaped information transmission device that holds individual identification information, an edge computer, and a back-end server, and provides customized services to users. Specific embodiments for carrying out the invention are described below.
[0804] Ring-shaped information transmission device
[0805] The ring-shaped information transmission device worn by the user has a built-in unique identification information (UUID). This device periodically transmits the UUID to the edge computer using RFID technology. The device does not require a battery and is designed to constantly transmit the UUID.
[0806] Edge Computer
[0807] The edge computer is equipped with an RFID reader that receives UUIDs from ring-shaped information transmission devices worn by users. Based on the received UUID, the edge computer sends API requests to a backend server, requesting specific user data. This processing is performed in real time, and the edge computer has the ability to instantly generate and provide information and services optimized for the user.
[0808] As a specific example, the edge computer sends a prompt sentence to the backend server saying, "User A's UUID has been received. What is User A's favorite drink?"
[0809] Backend Server
[0810] When the backend server receives an API request sent from the edge computer, it searches for the user data in the database based on the UUID, finds the corresponding user data, and sends it back to the edge computer.
[0811] Specifically, the backend server retrieves the entry corresponding to "UUID:12345" from the database and returns "User A's name, purchase history, and favorite information" to the edge computer as a response.
[0812] Specific examples
[0813] For example, suppose a user arrives at a shopping center and approaches a display where an edge computer is installed. The ring-shaped information transmission device worn by the user transmits a UUID, which is received by the edge computer. The edge computer immediately sends an API request to the backend server, asking for the user data corresponding to UUID:12345.
[0814] The backend server retrieves the relevant user data (such as purchase history and favorite product information) from the database and sends it back to the edge computer. Based on the received information, the edge computer displays the user's name, recommended products, operation guides, and other information on the display screen. In this way, the user can enjoy a personalized shopping experience.
[0815] Prompt Sentence Examples
[0816] Here are some examples of prompts:
[0817] "User A has been identified. Please show us the best product recommendations for User A."
[0818] "User B has arrived at the shopping center. Please generate a list of recommended products based on User B's purchasing history."
[0819] "User C has arrived at the entrance. Please display promotional information based on User C's interests."
[0820] As a result, the present invention makes it possible to efficiently provide customized services in real time by combining a ring-shaped information transmission device carried by a user, an edge computer, and a back-end server.
[0821] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0822] Step 1:
[0823] A user wears a ring-shaped information transmission device and moves near the system. This ring-shaped device periodically transmits unique identification information (UUID). This UUID is sent to the edge computer via a communication means. The input is the UUID of the ring-shaped device held by the user, and the output is the UUID received by the edge computer. In concrete terms, the ring-shaped device sends "UUID:12345" to the edge computer.
[0824] Step 2:
[0825] The edge computer receives the UUID sent from the ring-shaped device. The input is the UUID received from the communication means, and the output is the UUID used to construct the API request. The edge computer captures the UUID with its built-in RFID reader and stores it in memory. Specifically, "UUID:12345" is stored in the edge computer's memory.
[0826] Step 3:
[0827] The edge computer sends an API request to the backend server based on the UUID it obtained. The input is the UUID obtained in step 2, and the output is the API request sent to the backend server. Using the HTTP protocol, a request such as "GET / user-data?uuid=12345" is sent to the backend server. Specifically, the edge computer sends an API request including "UUID:12345" to the backend server.
[0828] Step 4:
[0829] The backend server receives the API request sent from the edge computer and searches the database to retrieve the corresponding user data. The input is the UUID in the API request, and the output is the user data. The backend server searches the corresponding entry in the database and retrieves the user's name, settings, favorite information, etc. Specifically, the backend server retrieves "User A's name, purchase history, and favorite information" based on "UUID:12345."
[0830] Step 5:
[0831] The backend server returns the acquired user data to the edge computer. The input is user data, and the output is user data sent to the edge computer. Specifically, the backend server returns "User A's name, purchase history, and favorite information" to the edge computer.
[0832] Step 6:
[0833] The edge computer uses the user data it receives to generate and provide a service customized for a specific user. The input is the user data received from the backend server, and the output is a customized service that is displayed to the user. Specifically, the edge computer displays a message on the display such as, "Hello, User A! Here are some recommended products for you."
[0834] Through the above processing steps, the system can efficiently provide users with customized services in real time.
[0835] (Application example 1)
[0836] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0837] Current autonomous vehicles generally require users to manually adjust the seat position and configure the entertainment system each time they enter the vehicle, a process that is inconvenient and time-consuming. Another issue is that it is difficult to provide a comfortable riding experience because it is not easy to customize for each user. There is a need to solve these problems and provide a riding environment optimized for each user.
[0838] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0839] In this invention, the server includes a communication means for holding individual identification information, an edge computer means for extracting the individual identification information received via the communication means, a backend server means for receiving the individual identification information from the edge computer means and returning user data, a means for providing a service customized for a specific user using the user data, and a means for customizing a seat position or an entertainment system in an automated vehicle using the user data, thereby making it possible to provide a personalized riding environment for the user in the automated vehicle.
[0840] "Individual identification information" is information for uniquely identifying a user.
[0841] The "communication means" is a means for transmitting individual identification information to the edge computer means.
[0842] The "edge computer means" is a computer device for receiving individual identification information and requesting data from the backend server means based on the individual identification information.
[0843] The "back-end server means" is a server device that searches for user data based on the individual identification information received from the edge computer means and returns the data.
[0844] "User Data" is information about a particular user and is used to provide customized services.
[0845] "Customized Services" refers to services that are tailored based on a user's individual identity and user data.
[0846] An "automated vehicle" is a vehicle that navigates and performs functions autonomously without user interaction.
[0847] "Seat position" refers to the physical arrangement of seats within an automated vehicle, as adjusted for each user.
[0848] An "entertainment system" is an in-vehicle system that plays media content such as music and videos and is configured according to the user's preferences.
[0849] To implement this invention, the system includes the following major components:
[0850] 1. Ring-shaped device
[0851] The ring-shaped device is worn by the user and holds unique identification information (UUID). This device transmits the UUID to the edge computer means using RFID technology. This device does not require battery replacement or setting changes and can always transmit the UUID.
[0852] 2. Edge computing means
[0853] The edge computer means is installed in the vehicle and includes an RFID reader. The edge computer means receives the UUID from the ring-shaped device. The edge computer means then uses the UUID to send an API request to the backend server means to obtain corresponding user data. Based on the obtained user data, the edge computer applies user-specific settings to the in-vehicle OS to customize the seat position and entertainment system.
[0854] example:
[0855] When a user wears the ring-shaped device and gets into an autonomous vehicle, the edge computer means in the vehicle immediately recognizes the UUID and retrieves the user's vehicle settings from the backend server means, resulting in a personalized riding experience, such as automatically adjusting the seat position and playing the user's favorite music playlist.
[0856] 3. Backend Server Measures
[0857] The back-end server means is installed on the cloud and searches for corresponding user data from a database based on the UUID and returns it to the edge computer means. This data includes the user's name, seat position settings, music playlist, favorite destinations, etc., and based on this, the edge computer provides customized services to the user.
[0858] 4. Smartphone Applications
[0859] Using a smartphone application, users can configure their car interior settings in advance (e.g., preferred temperature settings, seat position, music playlist, etc.) The application synchronizes data with edge computing means and back-end server means to enhance the user experience.
[0860] Example prompt sentence:
[0861] Write code that receives the UUID of a ring-shaped device worn by a user, retrieves user settings from a backend server in the cloud, and automatically adjusts seat position and music playlist in an autonomous vehicle. Technologies used include RFID, edge computing, and API communication.
[0862] Specific hardware and software used
[0863] Ring-type device: A device that holds unique identification information (UUID) and transmits it to an edge computer using RFID technology.
[0864] Edge computer: A computing device installed inside a vehicle that is equipped with an RFID reader.
[0865] Back-end server: A server device installed on the cloud that has a database for storing user data.
[0866] API: An application programming interface that allows edge computers to communicate data with backend servers.
[0867] In-vehicle OS: The operating system installed in self-driving vehicles.
[0868] Smartphone app: An application that allows users to configure settings in advance.
[0869] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0870] Step 1:
[0871] When a user wears a ring-type device and gets into a vehicle, the ring-type device transmits a UUID using RFID technology. The input is the UUID held by the ring-type device, and the output is the UUID received by the RFID reader.
[0872] Step 2:
[0873] The edge computer means receives a UUID through an RFID reader installed in the vehicle. The input here is the UUID received by the RFID reader, and the output is an API request carrying the UUID. The edge computer means sends the API request to the backend server means using this UUID.
[0874] Step 3:
[0875] The backend server means receives an API request including a UUID from the edge computer means. The input is the UUID sent from the edge computer means, and the output is a response including corresponding user data. The backend server means searches for the user data from the database based on the UUID and returns the result to the edge computer means.
[0876] Step 4:
[0877] The edge computer means acquires the user data received from the backend server means and transmits it to the in-vehicle OS. The input is the user data from the backend server means, and the output is the customization information transmitted to the in-vehicle OS.
[0878] Step 5:
[0879] The in-vehicle OS customizes the seat position and entertainment system based on the received user data. The input is the user data sent from the edge computing means, and the output is the adjusted seat position and entertainment system settings. Specifically, the seat position is automatically adjusted to the user's preferences, and the user's favorite music playlist begins playing.
[0880] Step 6:
[0881] Users can check and change settings in advance using a smartphone application. The input is setting change information operated by the user, which is synchronized with the edge computer means and the back-end server means. The output is updated customization information, which is applied to the vehicle. Specifically, the user sets temperature settings or a new music playlist on the smartphone app, and this is reflected in the vehicle.
[0882] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0883] The present invention provides customized services to users by combining an emotion engine with a system including a ring-shaped device that holds individual identification information, an edge computer, and a back-end server. An embodiment of each component of the system will be described below.
[0884] 1. Ring-shaped device
[0885] The ring-shaped device worn by the user has a built-in unique identification information (UUID), which is transmitted to the edge computer using RFID technology.
[0886] 2. Edge Computers
[0887] The edge computer is equipped with an RFID reader that receives the UUID from the ring device. The edge computer uses the received UUID to send an API request to the backend server to request the corresponding user data. The edge computer also has an emotion engine that recognizes the user's emotions.
[0888] The emotion engine uses a microphone and a camera to analyze the user's voice and facial expressions to recognize the user's emotion information, which includes the user's emotional and psychological state, and is added to the user database.
[0889] 3. Backend Server
[0890] The backend server receives the request from the edge computer and searches the database for the corresponding user data based on the UUID. The searched user data is returned to the edge computer, and the user is provided with a customized service.
[0891] The back-end server updates the user database based on the emotion information acquired by the emotion engine the next time a service is provided, allowing for more precise and tailored services to be provided to the user.
[0892] Program function description
[0893] Ring-shaped device
[0894] When a user wears the ring and moves near an edge computer, the ring-type device transmits a UUID. Due to its simple structure, the ring-type device can transmit the UUID at all times without the need for battery replacement or setting changes.
[0895] Edge Computer
[0896] The edge computer receives the UUID from the ring device, then uses this UUID to send an API request to the backend server to retrieve the corresponding user data, and then uses an emotion engine to recognize the user's emotion.
[0897] The user's emotion data acquired by the emotion engine is added to the user data and used when providing services. For example, if the user has an anxious expression, the edge computer will display relaxing content.
[0898] Backend Server
[0899] The backend server searches the database for user data based on the UUID sent from the edge computer, including the user's name, preferences, and emotional information, and returns this data to the edge computer.
[0900] Furthermore, the database is updated based on the emotional data acquired by the emotion engine, and this information is used the next time the service is provided. For example, if a user showed an anxious expression during the previous session, the next time the service is provided, that state will be taken into consideration.
[0901] Specific examples
[0902] For example, suppose a user arrives at a shopping center and approaches a display with an edge computer. The ring-shaped device transmits a UUID, which the edge computer receives. The edge computer then sends an API request to the backend server to retrieve the corresponding user's purchasing history and favorite product information.
[0903] At the same time, the edge computer uses an emotion engine to analyze the user's current emotional state. For example, if the edge computer detects that the user is smiling, it can use that information to display promotional content accompanied by cheerful, upbeat music.
[0904] The backend server returns a list of products tailored to the user's name and purchase history to the edge computer, which can then provide the user with the most appropriate information and services, and provide a more personalized experience based on the results of the emotion engine.
[0905] As such, the present invention is a system that provides highly customized services in real time by linking an edge computer, an emotion engine, and a back-end server, with a ring-shaped device carried by the user at its core.
[0906] The processing flow will be explained below.
[0907] Step 1:
[0908] The user puts on the ring
[0909] A user wears a ring-shaped device and moves close to an edge computer. The ring-shaped device contains a unique UUID, which is transmitted to the edge computer via RFID technology.
[0910] Step 2:
[0911] The device receives the UUID
[0912] The edge computer receives the UUID signal from the ring-shaped device through an RFID reader. The received UUID is processed within the edge computer and proceeds to the next step.
[0913] Step 3:
[0914] The device sends an API request
[0915] The edge computer uses the received UUID to send an API request to the backend server, requesting the corresponding user data. The API request is sent using the HTTP protocol.
[0916] Step 4:
[0917] The server receives and processes the API request.
[0918] The backend server receives the API request sent from the edge computer, parses the UUID included in the request, and uses this information as a database lookup key.
[0919] Step 5:
[0920] The server searches for and returns the user data
[0921] The backend server searches for user data in a database based on the UUID, and the searched data is returned to the edge computer in JSON format. The user data includes name, preferences, and interests.
[0922] Step 6:
[0923] The terminal receives user data.
[0924] The edge computer receives and analyzes the user data returned from the server, thereby obtaining detailed information about the user.
[0925] Step 7:
[0926] The device activates the emotion engine
[0927] The edge computer activates the emotion engine, which begins the process of recognizing the user's emotions. The emotion engine uses a microphone and camera to analyze the user's voice and facial expressions.
[0928] Step 8:
[0929] The device analyzes emotional information
[0930] The emotion engine analyzes the acquired voice and facial expression data to estimate the user's emotional state. For example, emotional information such as "joy" if the user smiles, or "anxiety" if the user looks confused is generated.
[0931] Step 9:
[0932] The device adds emotional information to the user data.
[0933] The emotional information acquired by the edge computer is added to the user data and used for more specific customization. The emotional information is updated in real time and will be used the next time the service is provided.
[0934] Step 10:
[0935] Providing customized services to users
[0936] The edge computer generates customized services based on the received user data and emotional information. For example, if the user is in a relaxed state, it will provide relaxing content.
[0937] Step 11:
[0938] The server updates the user database
[0939] The backend server records the latest emotion information sent from the edge computer in a user database so that it can be used the next time a service is provided, thereby providing services that take user emotions into greater consideration.
[0940] Through this series of processes, users can enjoy real-time, highly customized services provided by edge computers and back-end servers simply by wearing the ring-shaped device.
[0941] Example 2
[0942] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0943] Conventional user service provision systems have difficulty recognizing a user's emotional state in real time and personalizing services. This has resulted in an inability to provide flexible services that respond to a user's temporary emotions, potentially resulting in a decrease in satisfaction. Furthermore, these systems are limited to providing services on an ad hoc basis, and the collection of data that can be used for future services is insufficient.
[0944] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0945] In this invention, the server includes a communication device means for storing individual identification information, an edge computer means for extracting the individual identification information received via the communication device means, a back-end computer means for receiving the individual identification information from the edge computer means and returning user data, an emotion engine means for analyzing the user data and further analyzing voice and facial expressions to obtain emotional information, a means for providing a service customized for a specific user using the emotional information and user data, and a means for storing the emotional information in a user database and utilizing it for subsequent service provision. This makes it possible to recognize the user's emotional state in real time and provide personalized services based on that. Furthermore, by utilizing the obtained emotional information when providing subsequent services, it is possible to provide even more precise services tailored to the user.
[0946] "Individual identification information" is information for uniquely identifying a user, such as a UUID (universal unique identifier).
[0947] The "communication device means" is a device that holds and transmits individual identification information, and corresponds to a ring-shaped device or the like.
[0948] The "edge computing means" is a device that receives individual identification information from the communication device means and sends a request to the back-end computing means, and specifically corresponds to a computer with a built-in RFID reader.
[0949] The "back-end computer means" is a device that searches for and returns corresponding user data based on the individual identification information received from the edge computer means, and corresponds to a server that manages a database.
[0950] The "emotion engine means" is a device that analyzes the user's voice, facial expressions, etc., and acquires emotional information, and specifically corresponds to a computer with a built-in microphone and camera.
[0951] A "user database" is a database that records data and emotional information about users, and is managed by back-end computing means.
[0952] The "means for providing customized services" refers to devices and systems for providing services and content tailored to a particular user based on user data and emotional information.
[0953] The present invention is a system that provides customized services to users by combining a communication device that holds individual identification information, an edge computer, a back-end computer, and an emotion engine.
[0954] Ring-shaped device
[0955] The ring-shaped device worn by the user has a built-in unique identification information (UUID), which is transmitted to the edge computer using RFID technology.
[0956] example
[0957] When a user wears the ring and moves near an edge computer, the ring-type device transmits a UUID. Due to its simple structure, the ring-type device can transmit the UUID at all times without the need for battery replacement or setting changes.
[0958] Edge Calculator
[0959] The edge computer is equipped with an RFID reader that receives the UUID from the ring-shaped device. It then uses the received UUID to send an API request to the backend computer, requesting the corresponding user data. Furthermore, the edge computer is equipped with an emotion engine that analyzes the user's voice and facial expressions to obtain emotional information. This emotional information is added to a user database, which includes the user's emotional and psychological state.
[0960] example
[0961] When the edge computer receives the UUID from the ring-shaped device, it uses this UUID to send an API request to the backend computer. At the same time, it uses an emotion engine to analyze the user's facial expressions and voice. For example, if the user is smiling, it displays promotional content with cheerful, fun music based on that information.
[0962] Backend Calculator
[0963] The backend computer receives a request from the edge computer and searches the database for the corresponding user data based on the UUID. The searched user data is returned to the edge computer, and a customized service is provided to the user. In addition, the emotion information obtained by the emotion engine is saved in the user database and used the next time the service is provided. This update enables the provision of more precise and user-specific services.
[0964] example
[0965] When the backend computer receives the UUID, it immediately searches the database to retrieve the user's name, purchase history, preferences, past emotional information, etc. For example, if the user looked anxious in the previous session, the next time it provides a service that takes that state into account.
[0966] Specific examples
[0967] For example, suppose a user arrives at a shopping center and approaches a display equipped with an edge computer. The ring-shaped device transmits a UUID, which the edge computer receives. The edge computer then sends an API request to the backend computer to obtain the corresponding user's purchasing history and favorite product information. At the same time, the edge computer uses its emotion engine to analyze the user's current emotional state. If the edge computer recognizes that the user is smiling, it uses this information to display promotional content accompanied by cheerful, upbeat music. Based on the user data returned from the backend computer, the edge computer provides the user with optimal information and services.
[0968] Example prompt sentence:
[0969] "Write a program that receives a user's UUID from the edge computer and sends a request to the backend computer based on that UUID. Also, add a function that analyzes the user's voice and facial expressions to recognize emotions, and provides appropriate services to the user based on the results."
[0970] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0971] Step 1:
[0972] The user wears the ring-shaped device and moves close to the edge computer.
[0973] Input: A ring-like device with the user's UUID embedded
[0974] Output: Sending UUID
[0975] Specific operation: The ring-shaped device uses built-in RFID technology to transmit a UUID to the edge computer.
[0976] Step 2:
[0977] The edge computer receives the UUID from the ring.
[0978] Input: UUID sent from the ring device
[0979] Output: Received UUID
[0980] Specific operation: The RFID reader on the edge computer receives the UUID and forwards the data to the internal system.
[0981] Step 3:
[0982] The edge computer uses the received UUID to send an API request to the backend computer, requesting user data.
[0983] Input: Received UUID
[0984] Output: Request for relevant user data
[0985] Specific operation: The edge computer sends the UUID as an HTTP POST request to the backend computer, requesting user data.
[0986] Step 4:
[0987] The back-end computer retrieves the user data from the database based on the UUID and returns it to the edge computer.
[0988] Input: API request containing UUID
[0989] Output: The corresponding user data
[0990] Specific operation: The back-end computer executes a database query to retrieve data such as the user's name, preferences, and past emotional information, and returns this to the edge computer.
[0991] Step 5:
[0992] The edge computer receives the returned user data and analyzes the user's emotions.
[0993] Input: Returned user data, as well as user voice and facial expression data
[0994] Output: User's emotional information
[0995] Specific operation: The edge computer uses the built-in microphone and camera to capture the user's voice and facial expressions, and then analyzes their emotional state using an emotion engine.
[0996] Step 6:
[0997] Edge computers provide customized services based on user data and emotional information.
[0998] Input: Returned user data and parsed emotion information
[0999] Output: customized services and content
[1000] Specific operation: The edge computer uses the analyzed emotional information and user data to display services and content that are optimal for the user. For example, if the user looks anxious, it will play relaxing music.
[1001] Step 7:
[1002] The edge computer sends the emotion information to the back-end computer and updates the user database.
[1003] Input: Parsed emotion information
[1004] Output: Updated user database
[1005] Specific operation: The edge computer sends the acquired emotion information to the back-end computer, which stores it in the user database and uses it the next time the service is provided.
[1006] (Application example 2)
[1007] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1008] While conventional systems can provide customized services based on a user's individual identification information, it is difficult to recognize a user's emotional state in real time and provide optimal content based on that emotion. Furthermore, there is a lack of system-wide sharing of feedback based on emotional information and utilization of it in future services. As a result, improvements to the user experience are limited, and truly personalized services cannot be provided.
[1009] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1010] In this invention, the server includes communication means for holding individual identification information, edge computer means for extracting the individual identification information received via the communication means, backend server means for receiving the individual identification information from the edge computer means and returning user data, means for providing a service customized to a specific user using the user data, emotion recognition means for recognizing the emotional state of the user using the edge computer means, and means for providing optimal content to the user based on the emotion information acquired by the emotion recognition means. This makes it possible to provide a truly personalized service based on both the individual identification information and the emotional state of the user.
[1011] "Individual identification information" is information used to uniquely identify a specific user.
[1012] "Communication means" refers to devices or technologies for transmitting or receiving individual identification information.
[1013] An "edge computer means" is a device or system that receives individual identification information from a communication means and performs processing based on that information.
[1014] The "back-end server means" is a server system that searches for and returns user data based on the individual identification information received from the edge computer means.
[1015] "Emotion recognition means" refers to a device or software for analyzing and recognizing the user's emotional state.
[1016] The "means for providing customized services" refers to a function or system that provides services and content optimized for a specific user based on user data and emotional information.
[1017] A "ring-shaped device" is a ring-shaped device that holds individual identification information and transmits that information via a communication means.
[1018] "Wireless communication technology" is a technology that uses radio waves to send and receive data.
[1019] The present invention is a system that uses a ring-shaped device that holds individual identification information, an edge computer, and a back-end server, and further combines emotion recognition means to provide customized services to users. Detailed embodiments of the present invention will be described below.
[1020] 1. Ring-shaped device
[1021] The ring-shaped device worn by the user has a built-in unique identification information (UUID). This device transmits the UUID to the edge computer using wireless communication technology (such as RFID). Due to its simple structure, the ring-shaped device can always transmit the UUID without the need for battery replacement or setting changes.
[1022] 2. Edge Computers
[1023] The edge computer is equipped with an RFID reader to receive the UUID from the ring-shaped device. Based on the acquired UUID, the edge computer sends an API request to the backend server to retrieve the corresponding user data. In addition, the edge computer is equipped with an emotion recognition means to analyze the user's emotional state, and analyzes the user's facial expressions and voice in real time using a camera and microphone.
[1024] 3. Backend Server
[1025] The backend server searches the database based on the UUID sent from the edge computer and returns the corresponding user data. This user data includes the user's name, purchase history, preferences, etc. The backend server also updates the database based on the emotion information sent from the edge computer and uses it for the next service provision.
[1026] Specific examples
[1027] For example, consider the case where a user arrives at a shopping mall and approaches an edge computer installed at the entrance. When the ring-shaped device sends a UUID to the edge computer, the edge computer receives the UUID and sends an API request to the backend server. The backend server searches the user database to obtain the user's purchasing history and preferences, and returns the information to the edge computer.
[1028] At the same time, the edge computer uses its built-in camera and microphone to analyze the user's facial expressions and tone of voice to assess their emotional state. For example, if the user is smiling, the edge computer will use that information to display cheerful and upbeat content. Conversely, if the user looks anxious, it will provide relaxing content.
[1029] Prompt Sentence Examples
[1030] You can input prompts like the following into your generative AI model:
[1031] "UUID: 123e4567-e89b-12d3-a456-426614174000
[1032] Emotional state: happy
[1033] Username: Taro
[1034] Purchase history: [Product A, Product B, Product C]
[1035] Favorite Item: Item D
[1036] Produced message:
[1037] Hello Taro! Looks like you're having fun today! I highly recommend this product!
[1038] In this way, the system of the present invention can provide a more personalized service based on both the user's individual identity and real-time emotional state, thereby improving the user experience.
[1039] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1040] Step 1:
[1041] A user arrives at a commercial facility and wears a ring-shaped device. When the user moves close to the edge computer, the ring-shaped device transmits a UUID.
[1042] Input: UUID from the ring device
[1043] Output: UUID received by edge computer
[1044] Specific operation: When a user wears a ring-shaped device and moves around an edge computer in a commercial facility, the ring-shaped device continues to transmit a UUID.
[1045] Step 2:
[1046] The edge computer uses an RFID reader to receive the UUID from the ring-shaped device.
[1047] Input: UUID signal
[1048] Output: Get UUID
[1049] Specific operation: The UUID signal from the ring-shaped device is received by the RFID reader in the edge computer, and the UUID is stored in the edge computer.
[1050] Step 3:
[1051] The edge computer uses the acquired UUID to send an API request to the backend server, requesting the corresponding user data.
[1052] Input: UUID
[1053] Output: User database query
[1054] Specific operation: Based on the UUID, the edge computer sends an HTTP request to the backend server, instructing it to search for user information.
[1055] Step 4:
[1056] The backend server searches the database based on the UUID from the edge computer and obtains the corresponding user data.
[1057] Input: Query based on UUID
[1058] Output: User data
[1059] Specific operation: The backend server searches the database and extracts data such as the user's past purchase history and favorite products corresponding to the UUID.
[1060] Step 5:
[1061] The back-end server returns the acquired user data to the edge computer.
[1062] Input: User data
[1063] Output: Data response
[1064] Specific operation: The backend server formats the extracted user data and generates an HTTP response to send back to the edge computer.
[1065] Step 6:
[1066] The edge computer uses a camera and microphone to analyze the user's facial expressions and tone of voice, and evaluates the user's emotional state using emotion recognition means.
[1067] Input: Camera video, microphone audio data
[1068] Output: Emotional information
[1069] Specific operation: The edge computer uses a camera and microphone to collect video and audio data, analyzes the data with an emotion recognition algorithm, and classifies the user's emotional state.
[1070] Step 7:
[1071] Based on the user data and emotional information acquired by the edge computer, content optimal for the user is generated and displayed on a display device such as a monitor.
[1072] Input: User data, emotional information
[1073] Output: Customized content
[1074] Specific operation: The edge computer integrates user data and emotional information to generate specific promotional content and information, which is then displayed on the display and provided to the user.
[1075] Step 8:
[1076] At the same time that the generated content is provided to the user, the edge computer transmits the acquired emotion information to the backend server, which updates the user database.
[1077] Input: Emotion information
[1078] Output: Database update request
[1079] Specific operation: The edge computer sends the collected emotion information to the backend server as an HTTP request, and uses that information to instruct the backend server to update the user database to the latest version.
[1080] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1081] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1082] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1083] [Fourth embodiment]
[1084] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1085] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1086] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1087] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1088] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1089] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1090] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1091] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1092] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1093] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1094] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1095] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1096] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1097] The present invention provides customized services to users through a system including a ring-shaped device that holds individual identification information, an edge computer, and a back-end server. An embodiment of each component of the system will be described.
[1098] 1. Ring-shaped device
[1099] The ring-shaped device worn by the user has a built-in unique identification information (UUID), which is transmitted to the edge computer using RFID technology.
[1100] 2. Edge Computers
[1101] The edge computer is equipped with an RFID reader that receives the UUID from the ring device, and then uses the received UUID to send an API request to the backend server, requesting the corresponding user data.
[1102] The edge computer uses the user data returned from the server to generate services customized for the user. For example, in the case of an autonomous driving system, it can obtain individual user ride settings and destination data and apply them to the autonomous vehicle.
[1103] 3. Backend Server
[1104] The backend server receives the request from the edge computer and searches the database for the corresponding user data based on the UUID. The searched user data is returned to the edge computer, and the user is provided with a customized service.
[1105] Program function description
[1106] Ring-shaped device
[1107] When a user wears the ring and moves near an edge computer, the ring-type device transmits a UUID. Due to its simple structure, the ring-type device can transmit the UUID at all times without the need for battery replacement or setting changes.
[1108] Edge Computer
[1109] The edge computer receives the UUID from the ring device, then uses this UUID to send an API request to the backend server to retrieve the corresponding user data. Based on the retrieved user data, the edge computer displays and provides information and services optimized for the user.
[1110] Backend Server
[1111] The backend server retrieves user data from a database based on the UUID sent from the edge computer. This data includes the user's name, preferences, and interests, and returns it to the edge computer. The edge computer then uses this information to provide customized services to the user.
[1112] Specific examples
[1113] For example, suppose a user arrives at a shopping center and approaches a display with an edge computer. The ring-shaped device transmits a UUID, which the edge computer receives. The edge computer then sends an API request to the backend server to retrieve the corresponding user's purchasing history and favorite product information.
[1114] Based on the information received from the backend server, the edge computer can display the user's name and provide personalized product recommendations and the latest promotional information, providing the user with a personalized shopping experience.
[1115] In this way, the present invention is a system that is centered around a ring-shaped device carried by the user, and that can provide customized services in real time simply and effectively by linking with an edge computer and a back-end server.
[1116] The processing flow will be explained below.
[1117] Step 1:
[1118] The user puts on the ring
[1119] A user wears a ring-shaped device and moves close to an edge computer. The ring-shaped device contains a unique UUID, which is transmitted to the edge computer via RFID technology.
[1120] Step 2:
[1121] The device receives the UUID
[1122] The edge computer receives the UUID signal from the ring-shaped device using an RFID reader. The UUID is used as unique identification information and proceeds to the next step.
[1123] Step 3:
[1124] The device sends an API request
[1125] The edge computer uses the received UUID to send an API request to the backend server, which includes the UUID as a parameter. The API request is made using the HTTP protocol.
[1126] Step 4:
[1127] The server receives the API request
[1128] The server receives the API request from the edge computer, extracts the UUID from the request, and begins the process of searching the user database.
[1129] Step 5:
[1130] The server retrieves the user data
[1131] The server searches its database for information based on the received UUID. This is a fast search process that extracts the corresponding user data, such as username, preferences, and interests.
[1132] Step 6:
[1133] The server returns a response
[1134] The server converts the user data obtained from the search into JSON format and returns it to the edge computer, where the user data includes the user's name, preferences, and interests.
[1135] Step 7:
[1136] The terminal receives user data.
[1137] The edge computer receives the user data in JSON format from the server, giving the edge computer detailed information about the user.
[1138] Step 8:
[1139] The terminal generates customized services
[1140] The edge computer analyzes the received user data and generates services optimized for the specific user (for example, product recommendations based on browsing history or settings for self-driving cars).
[1141] Step 9:
[1142] Providing customized services to users
[1143] The edge computer presents the generated customized services to the user through a display or other interface, allowing the user to receive individually personalized information and services.
[1144] This series of processes allows users to easily enjoy customized services in real time from edge computers simply by wearing the ring-shaped device.
[1145] Example 1
[1146] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1147] In conventional service provision systems that use user data, it is difficult to obtain individual user identification information in real time and quickly provide customized services. In addition, the lack of cooperation between components makes it difficult to achieve a seamless user experience.
[1148] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1149] In this invention, the server includes a communication means for holding individual identification information, an edge computer means for extracting the individual identification information received via the communication means, a backend server means for receiving the individual identification information from the edge computer means and returning user data, a means for generating and providing a service customized for a specific user using the user data, a means for the edge computer means to send an API request to the backend server means based on the individual identification information, a means for the backend server means to receive the API request and search for corresponding user data, and a means for returning the user data to the edge computer means. This makes it possible to obtain individual identification information possessed by a user in real time and quickly provide a customized service.
[1150] "Individual identification information" is information that uniquely identifies a specific individual or object.
[1151] A "communication means" is a means for sending and receiving data.
[1152] An "edge computing means" is a computing device for performing data collection, analysis, and processing near the site.
[1153] The "back-end server means" is a server device that manages data to provide various services and responds to requests from other systems and devices.
[1154] "User Data" is information associated with a particular user, including name, preferences, interests, purchasing history, and the like.
[1155] An "API request" is a request format for requesting specific processing or data provision from other programs or services.
[1156] A "ring-shaped information transmitting device" is a ring-shaped device used to transmit individual identification information.
[1157] "Wireless communication technology" is a technology that transmits data via wireless radio waves without using cables.
[1158] The present invention is a system that includes a ring-shaped information transmission device that holds individual identification information, an edge computer, and a back-end server, and provides customized services to users. Specific embodiments for carrying out the invention are described below.
[1159] Ring-shaped information transmission device
[1160] The ring-shaped information transmission device worn by the user has a built-in unique identification information (UUID). This device periodically transmits the UUID to the edge computer using RFID technology. The device does not require a battery and is designed to constantly transmit the UUID.
[1161] Edge Computer
[1162] The edge computer is equipped with an RFID reader that receives UUIDs from ring-shaped information transmission devices worn by users. Based on the received UUID, the edge computer sends API requests to a backend server, requesting specific user data. This processing is performed in real time, and the edge computer has the ability to instantly generate and provide information and services optimized for the user.
[1163] As a specific example, the edge computer sends a prompt sentence to the backend server saying, "User A's UUID has been received. What is User A's favorite drink?"
[1164] Backend Server
[1165] When the backend server receives an API request sent from the edge computer, it searches for the user data in the database based on the UUID, finds the corresponding user data, and sends it back to the edge computer.
[1166] Specifically, the backend server retrieves the entry corresponding to "UUID:12345" from the database and returns "User A's name, purchase history, and favorite information" to the edge computer as a response.
[1167] Specific examples
[1168] For example, suppose a user arrives at a shopping center and approaches a display where an edge computer is installed. The ring-shaped information transmission device worn by the user transmits a UUID, which is received by the edge computer. The edge computer immediately sends an API request to the backend server, asking for the user data corresponding to UUID:12345.
[1169] The backend server retrieves the relevant user data (such as purchase history and favorite product information) from the database and sends it back to the edge computer. Based on the received information, the edge computer displays the user's name, recommended products, operation guides, and other information on the display screen. In this way, the user can enjoy a personalized shopping experience.
[1170] Prompt Sentence Examples
[1171] Here are some examples of prompts:
[1172] "User A has been identified. Please show us the best product recommendations for User A."
[1173] "User B has arrived at the shopping center. Please generate a list of recommended products based on User B's purchasing history."
[1174] "User C has arrived at the entrance. Please display promotional information based on User C's interests."
[1175] As a result, the present invention makes it possible to efficiently provide customized services in real time by combining a ring-shaped information transmission device carried by a user, an edge computer, and a back-end server.
[1176] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1177] Step 1:
[1178] A user wears a ring-shaped information transmission device and moves near the system. This ring-shaped device periodically transmits unique identification information (UUID). This UUID is sent to the edge computer via a communication means. The input is the UUID of the ring-shaped device held by the user, and the output is the UUID received by the edge computer. In concrete terms, the ring-shaped device sends "UUID:12345" to the edge computer.
[1179] Step 2:
[1180] The edge computer receives the UUID sent from the ring-shaped device. The input is the UUID received from the communication means, and the output is the UUID used to construct the API request. The edge computer captures the UUID with its built-in RFID reader and stores it in memory. Specifically, "UUID:12345" is stored in the edge computer's memory.
[1181] Step 3:
[1182] The edge computer sends an API request to the backend server based on the UUID it obtained. The input is the UUID obtained in step 2, and the output is the API request sent to the backend server. Using the HTTP protocol, a request such as "GET / user-data?uuid=12345" is sent to the backend server. Specifically, the edge computer sends an API request including "UUID:12345" to the backend server.
[1183] Step 4:
[1184] The backend server receives the API request sent from the edge computer and searches the database to retrieve the corresponding user data. The input is the UUID in the API request, and the output is the user data. The backend server searches the corresponding entry in the database and retrieves the user's name, settings, favorite information, etc. Specifically, the backend server retrieves "User A's name, purchase history, and favorite information" based on "UUID:12345."
[1185] Step 5:
[1186] The backend server returns the acquired user data to the edge computer. The input is user data, and the output is user data sent to the edge computer. Specifically, the backend server returns "User A's name, purchase history, and favorite information" to the edge computer.
[1187] Step 6:
[1188] The edge computer uses the user data it receives to generate and provide a service customized for a specific user. The input is the user data received from the backend server, and the output is a customized service that is displayed to the user. Specifically, the edge computer displays a message on the display such as, "Hello, User A! Here are some recommended products for you."
[1189] Through the above processing steps, the system can efficiently provide users with customized services in real time.
[1190] (Application example 1)
[1191] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1192] Current autonomous vehicles generally require users to manually adjust the seat position and configure the entertainment system each time they enter the vehicle, a process that is inconvenient and time-consuming. Another issue is that it is difficult to provide a comfortable riding experience because it is not easy to customize for each user. There is a need to solve these problems and provide a riding environment optimized for each user.
[1193] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1194] In this invention, the server includes a communication means for holding individual identification information, an edge computer means for extracting the individual identification information received via the communication means, a backend server means for receiving the individual identification information from the edge computer means and returning user data, a means for providing a service customized for a specific user using the user data, and a means for customizing a seat position or an entertainment system in an automated vehicle using the user data, thereby making it possible to provide a personalized riding environment for the user in the automated vehicle.
[1195] "Individual identification information" is information for uniquely identifying a user.
[1196] The "communication means" is a means for transmitting individual identification information to the edge computer means.
[1197] The "edge computer means" is a computer device for receiving individual identification information and requesting data from the backend server means based on the individual identification information.
[1198] The "back-end server means" is a server device that searches for user data based on the individual identification information received from the edge computer means and returns the data.
[1199] "User Data" is information about a particular user and is used to provide customized services.
[1200] "Customized Services" refers to services that are tailored based on a user's individual identity and user data.
[1201] An "automated vehicle" is a vehicle that navigates and performs functions autonomously without user interaction.
[1202] "Seat position" refers to the physical arrangement of seats within an automated vehicle, as adjusted for each user.
[1203] An "entertainment system" is an in-vehicle system that plays media content such as music and videos and is configured according to the user's preferences.
[1204] To implement this invention, the system includes the following major components:
[1205] 1. Ring-shaped device
[1206] The ring-shaped device is worn by the user and holds unique identification information (UUID). This device transmits the UUID to the edge computer means using RFID technology. This device does not require battery replacement or setting changes and can always transmit the UUID.
[1207] 2. Edge computing means
[1208] The edge computer means is installed in the vehicle and includes an RFID reader. The edge computer means receives the UUID from the ring-shaped device. The edge computer means then uses the UUID to send an API request to the backend server means to obtain corresponding user data. Based on the obtained user data, the edge computer applies user-specific settings to the in-vehicle OS to customize the seat position and entertainment system.
[1209] example:
[1210] When a user wears the ring-shaped device and gets into an autonomous vehicle, the edge computer means in the vehicle immediately recognizes the UUID and retrieves the user's vehicle settings from the backend server means, resulting in a personalized riding experience, such as automatically adjusting the seat position and playing the user's favorite music playlist.
[1211] 3. Backend Server Measures
[1212] The back-end server means is installed on the cloud and searches for corresponding user data from a database based on the UUID and returns it to the edge computer means. This data includes the user's name, seat position settings, music playlist, favorite destinations, etc., and based on this, the edge computer provides customized services to the user.
[1213] 4. Smartphone Applications
[1214] Using a smartphone application, users can configure their car interior settings in advance (e.g., preferred temperature settings, seat position, music playlist, etc.) The application synchronizes data with edge computing means and back-end server means to enhance the user experience.
[1215] Example prompt sentence:
[1216] Write code that receives the UUID of a ring-shaped device worn by a user, retrieves user settings from a backend server in the cloud, and automatically adjusts seat position and music playlist in an autonomous vehicle. Technologies used include RFID, edge computing, and API communication.
[1217] Specific hardware and software used
[1218] Ring-type device: A device that holds unique identification information (UUID) and transmits it to an edge computer using RFID technology.
[1219] Edge computer: A computing device installed inside a vehicle that is equipped with an RFID reader.
[1220] Back-end server: A server device installed on the cloud that has a database for storing user data.
[1221] API: An application programming interface that allows edge computers to communicate data with backend servers.
[1222] In-vehicle OS: The operating system installed in self-driving vehicles.
[1223] Smartphone app: An application that allows users to configure settings in advance.
[1224] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1225] Step 1:
[1226] When a user wears a ring-type device and gets into a vehicle, the ring-type device transmits a UUID using RFID technology. The input is the UUID held by the ring-type device, and the output is the UUID received by the RFID reader.
[1227] Step 2:
[1228] The edge computer means receives a UUID through an RFID reader installed in the vehicle. The input here is the UUID received by the RFID reader, and the output is an API request carrying the UUID. The edge computer means sends the API request to the backend server means using this UUID.
[1229] Step 3:
[1230] The backend server means receives an API request including a UUID from the edge computer means. The input is the UUID sent from the edge computer means, and the output is a response including corresponding user data. The backend server means searches for the user data from the database based on the UUID and returns the result to the edge computer means.
[1231] Step 4:
[1232] The edge computer means acquires the user data received from the backend server means and transmits it to the in-vehicle OS. The input is the user data from the backend server means, and the output is the customization information transmitted to the in-vehicle OS.
[1233] Step 5:
[1234] The in-vehicle OS customizes the seat position and entertainment system based on the received user data. The input is the user data sent from the edge computing means, and the output is the adjusted seat position and entertainment system settings. Specifically, the seat position is automatically adjusted to the user's preferences, and the user's favorite music playlist begins playing.
[1235] Step 6:
[1236] Users can check and change settings in advance using a smartphone application. The input is setting change information operated by the user, which is synchronized with the edge computer means and the back-end server means. The output is updated customization information, which is applied to the vehicle. Specifically, the user sets temperature settings or a new music playlist on the smartphone app, and this is reflected in the vehicle.
[1237] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1238] The present invention provides customized services to users by combining an emotion engine with a system including a ring-shaped device that holds individual identification information, an edge computer, and a back-end server. An embodiment of each component of the system will be described below.
[1239] 1. Ring-shaped device
[1240] The ring-shaped device worn by the user has a built-in unique identification information (UUID), which is transmitted to the edge computer using RFID technology.
[1241] 2. Edge Computers
[1242] The edge computer is equipped with an RFID reader that receives the UUID from the ring device. The edge computer uses the received UUID to send an API request to the backend server to request the corresponding user data. The edge computer also has an emotion engine that recognizes the user's emotions.
[1243] The emotion engine uses a microphone and a camera to analyze the user's voice and facial expressions to recognize the user's emotion information, which includes the user's emotional and psychological state, and is added to the user database.
[1244] 3. Backend Server
[1245] The backend server receives the request from the edge computer and searches the database for the corresponding user data based on the UUID. The searched user data is returned to the edge computer, and the user is provided with a customized service.
[1246] The back-end server updates the user database based on the emotion information acquired by the emotion engine the next time a service is provided, allowing for more precise and tailored services to be provided to the user.
[1247] Program function description
[1248] Ring-shaped device
[1249] When a user wears the ring and moves near an edge computer, the ring-type device transmits a UUID. Due to its simple structure, the ring-type device can transmit the UUID at all times without the need for battery replacement or setting changes.
[1250] Edge Computer
[1251] The edge computer receives the UUID from the ring device, then uses this UUID to send an API request to the backend server to retrieve the corresponding user data, and then uses an emotion engine to recognize the user's emotion.
[1252] The user's emotion data acquired by the emotion engine is added to the user data and used when providing services. For example, if the user has an anxious expression, the edge computer will display relaxing content.
[1253] Backend Server
[1254] The backend server searches the database for user data based on the UUID sent from the edge computer, including the user's name, preferences, and emotional information, and returns this data to the edge computer.
[1255] Furthermore, the database is updated based on the emotional data acquired by the emotion engine, and this information is used the next time the service is provided. For example, if a user showed an anxious expression during the previous session, the next time the service is provided, that state will be taken into consideration.
[1256] Specific examples
[1257] For example, suppose a user arrives at a shopping center and approaches a display with an edge computer. The ring-shaped device transmits a UUID, which the edge computer receives. The edge computer then sends an API request to the backend server to retrieve the corresponding user's purchasing history and favorite product information.
[1258] At the same time, the edge computer uses an emotion engine to analyze the user's current emotional state. For example, if the edge computer detects that the user is smiling, it can use that information to display promotional content accompanied by cheerful, upbeat music.
[1259] The backend server returns a list of products tailored to the user's name and purchase history to the edge computer, which can then provide the user with the most appropriate information and services, and provide a more personalized experience based on the results of the emotion engine.
[1260] As such, the present invention is a system that provides highly customized services in real time by linking an edge computer, an emotion engine, and a back-end server, with a ring-shaped device carried by the user at its core.
[1261] The processing flow will be explained below.
[1262] Step 1:
[1263] The user puts on the ring
[1264] A user wears a ring-shaped device and moves close to an edge computer. The ring-shaped device contains a unique UUID, which is transmitted to the edge computer via RFID technology.
[1265] Step 2:
[1266] The device receives the UUID
[1267] The edge computer receives the UUID signal from the ring-shaped device through an RFID reader. The received UUID is processed within the edge computer and proceeds to the next step.
[1268] Step 3:
[1269] The device sends an API request
[1270] The edge computer uses the received UUID to send an API request to the backend server, requesting the corresponding user data. The API request is sent using the HTTP protocol.
[1271] Step 4:
[1272] The server receives and processes the API request.
[1273] The backend server receives the API request sent from the edge computer, parses the UUID included in the request, and uses this information as a database lookup key.
[1274] Step 5:
[1275] The server searches for and returns the user data
[1276] The backend server searches for user data in a database based on the UUID, and the searched data is returned to the edge computer in JSON format. The user data includes name, preferences, and interests.
[1277] Step 6:
[1278] The terminal receives user data.
[1279] The edge computer receives and analyzes the user data returned from the server, thereby obtaining detailed information about the user.
[1280] Step 7:
[1281] The device activates the emotion engine
[1282] The edge computer activates the emotion engine, which begins the process of recognizing the user's emotions. The emotion engine uses a microphone and camera to analyze the user's voice and facial expressions.
[1283] Step 8:
[1284] The device analyzes emotional information
[1285] The emotion engine analyzes the acquired voice and facial expression data to estimate the user's emotional state. For example, emotional information such as "joy" if the user smiles, or "anxiety" if the user looks confused is generated.
[1286] Step 9:
[1287] The device adds emotional information to the user data.
[1288] The emotional information acquired by the edge computer is added to the user data and used for more specific customization. The emotional information is updated in real time and will be used the next time the service is provided.
[1289] Step 10:
[1290] Providing customized services to users
[1291] The edge computer generates customized services based on the received user data and emotional information. For example, if the user is in a relaxed state, it will provide relaxing content.
[1292] Step 11:
[1293] The server updates the user database
[1294] The backend server records the latest emotion information sent from the edge computer in a user database so that it can be used the next time a service is provided, thereby providing services that take user emotions into greater consideration.
[1295] Through this series of processes, users can enjoy real-time, highly customized services provided by edge computers and back-end servers simply by wearing the ring-shaped device.
[1296] Example 2
[1297] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1298] Conventional user service provision systems have difficulty recognizing a user's emotional state in real time and personalizing services. This has resulted in an inability to provide flexible services that respond to a user's temporary emotions, potentially resulting in a decrease in satisfaction. Furthermore, these systems are limited to providing services on an ad hoc basis, and the collection of data that can be used for future services is insufficient.
[1299] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1300] In this invention, the server includes a communication device means for storing individual identification information, an edge computer means for extracting the individual identification information received via the communication device means, a back-end computer means for receiving the individual identification information from the edge computer means and returning user data, an emotion engine means for analyzing the user data and further analyzing voice and facial expressions to obtain emotional information, a means for providing a service customized for a specific user using the emotional information and user data, and a means for storing the emotional information in a user database and utilizing it for subsequent service provision. This makes it possible to recognize the user's emotional state in real time and provide personalized services based on that. Furthermore, by utilizing the obtained emotional information when providing subsequent services, it is possible to provide even more precise services tailored to the user.
[1301] "Individual identification information" is information for uniquely identifying a user, such as a UUID (universal unique identifier).
[1302] The "communication device means" is a device that holds and transmits individual identification information, and corresponds to a ring-shaped device or the like.
[1303] The "edge computing means" is a device that receives individual identification information from the communication device means and sends a request to the back-end computing means, and specifically corresponds to a computer with a built-in RFID reader.
[1304] The "back-end computer means" is a device that searches for and returns corresponding user data based on the individual identification information received from the edge computer means, and corresponds to a server that manages a database.
[1305] The "emotion engine means" is a device that analyzes the user's voice, facial expressions, etc., and acquires emotional information, and specifically corresponds to a computer with a built-in microphone and camera.
[1306] A "user database" is a database that records data and emotional information about users, and is managed by back-end computing means.
[1307] The "means for providing customized services" refers to devices and systems for providing services and content tailored to a particular user based on user data and emotional information.
[1308] The present invention is a system that provides customized services to users by combining a communication device that holds individual identification information, an edge computer, a back-end computer, and an emotion engine.
[1309] Ring-shaped device
[1310] The ring-shaped device worn by the user has a built-in unique identification information (UUID), which is transmitted to the edge computer using RFID technology.
[1311] example
[1312] When a user wears the ring and moves near an edge computer, the ring-type device transmits a UUID. Due to its simple structure, the ring-type device can transmit the UUID at all times without the need for battery replacement or setting changes.
[1313] Edge Calculator
[1314] The edge computer is equipped with an RFID reader that receives the UUID from the ring-shaped device. It then uses the received UUID to send an API request to the backend computer, requesting the corresponding user data. Furthermore, the edge computer is equipped with an emotion engine that analyzes the user's voice and facial expressions to obtain emotional information. This emotional information is added to a user database, which includes the user's emotional and psychological state.
[1315] example
[1316] When the edge computer receives the UUID from the ring-shaped device, it uses this UUID to send an API request to the backend computer. At the same time, it uses an emotion engine to analyze the user's facial expressions and voice. For example, if the user is smiling, it displays promotional content with cheerful, fun music based on that information.
[1317] Backend Calculator
[1318] The backend computer receives a request from the edge computer and searches the database for the corresponding user data based on the UUID. The searched user data is returned to the edge computer, and a customized service is provided to the user. In addition, the emotion information obtained by the emotion engine is saved in the user database and used the next time the service is provided. This update enables the provision of more precise and user-specific services.
[1319] example
[1320] When the backend computer receives the UUID, it immediately searches the database to retrieve the user's name, purchase history, preferences, past emotional information, etc. For example, if the user looked anxious in the previous session, the next time it provides a service that takes that state into account.
[1321] Specific examples
[1322] For example, suppose a user arrives at a shopping center and approaches a display equipped with an edge computer. The ring-shaped device transmits a UUID, which the edge computer receives. The edge computer then sends an API request to the backend computer to obtain the corresponding user's purchasing history and favorite product information. At the same time, the edge computer uses its emotion engine to analyze the user's current emotional state. If the edge computer recognizes that the user is smiling, it uses this information to display promotional content accompanied by cheerful, upbeat music. Based on the user data returned from the backend computer, the edge computer provides the user with optimal information and services.
[1323] Example prompt sentence:
[1324] "Write a program that receives a user's UUID from the edge computer and sends a request to the backend computer based on that UUID. Also, add a function that analyzes the user's voice and facial expressions to recognize emotions, and provides appropriate services to the user based on the results."
[1325] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1326] Step 1:
[1327] The user wears the ring-shaped device and moves close to the edge computer.
[1328] Input: A ring-like device with the user's UUID embedded
[1329] Output: Sending UUID
[1330] Specific operation: The ring-shaped device uses built-in RFID technology to transmit a UUID to the edge computer.
[1331] Step 2:
[1332] The edge computer receives the UUID from the ring.
[1333] Input: UUID sent from the ring device
[1334] Output: Received UUID
[1335] Specific operation: The RFID reader on the edge computer receives the UUID and forwards the data to the internal system.
[1336] Step 3:
[1337] The edge computer uses the received UUID to send an API request to the backend computer, requesting user data.
[1338] Input: Received UUID
[1339] Output: Request for relevant user data
[1340] Specific operation: The edge computer sends the UUID as an HTTP POST request to the backend computer, requesting user data.
[1341] Step 4:
[1342] The back-end computer retrieves the user data from the database based on the UUID and returns it to the edge computer.
[1343] Input: API request containing UUID
[1344] Output: The corresponding user data
[1345] Specific operation: The back-end computer executes a database query to retrieve data such as the user's name, preferences, and past emotional information, and returns this to the edge computer.
[1346] Step 5:
[1347] The edge computer receives the returned user data and analyzes the user's emotions.
[1348] Input: Returned user data, as well as user voice and facial expression data
[1349] Output: User's emotional information
[1350] Specific operation: The edge computer uses the built-in microphone and camera to capture the user's voice and facial expressions, and then analyzes their emotional state using an emotion engine.
[1351] Step 6:
[1352] Edge computers provide customized services based on user data and emotional information.
[1353] Input: Returned user data and parsed emotion information
[1354] Output: customized services and content
[1355] Specific operation: The edge computer uses the analyzed emotional information and user data to display services and content that are optimal for the user. For example, if the user looks anxious, it will play relaxing music.
[1356] Step 7:
[1357] The edge computer sends the emotion information to the back-end computer and updates the user database.
[1358] Input: Parsed emotion information
[1359] Output: Updated user database
[1360] Specific operation: The edge computer sends the acquired emotion information to the back-end computer, which stores it in the user database and uses it the next time the service is provided.
[1361] (Application example 2)
[1362] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1363] While conventional systems can provide customized services based on a user's individual identification information, it is difficult to recognize a user's emotional state in real time and provide optimal content based on that emotion. Furthermore, there is a lack of system-wide sharing of feedback based on emotional information and utilization of it in future services. As a result, improvements to the user experience are limited, and truly personalized services cannot be provided.
[1364] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1365] In this invention, the server includes communication means for holding individual identification information, edge computer means for extracting the individual identification information received via the communication means, backend server means for receiving the individual identification information from the edge computer means and returning user data, means for providing a service customized to a specific user using the user data, emotion recognition means for recognizing the emotional state of the user using the edge computer means, and means for providing optimal content to the user based on the emotion information acquired by the emotion recognition means. This makes it possible to provide a truly personalized service based on both the individual identification information and the emotional state of the user.
[1366] "Individual identification information" is information used to uniquely identify a specific user.
[1367] "Communication means" refers to devices or technologies for transmitting or receiving individual identification information.
[1368] An "edge computer means" is a device or system that receives individual identification information from a communication means and performs processing based on that information.
[1369] The "back-end server means" is a server system that searches for and returns user data based on the individual identification information received from the edge computer means.
[1370] "Emotion recognition means" refers to a device or software for analyzing and recognizing the user's emotional state.
[1371] The "means for providing customized services" refers to a function or system that provides services and content optimized for a specific user based on user data and emotional information.
[1372] A "ring-shaped device" is a ring-shaped device that holds individual identification information and transmits that information via a communication means.
[1373] "Wireless communication technology" is a technology that uses radio waves to send and receive data.
[1374] The present invention is a system that uses a ring-shaped device that holds individual identification information, an edge computer, and a back-end server, and further combines emotion recognition means to provide customized services to users. Detailed embodiments of the present invention will be described below.
[1375] 1. Ring-shaped device
[1376] The ring-shaped device worn by the user has a built-in unique identification information (UUID). This device transmits the UUID to the edge computer using wireless communication technology (such as RFID). Due to its simple structure, the ring-shaped device can always transmit the UUID without the need for battery replacement or setting changes.
[1377] 2. Edge Computers
[1378] The edge computer is equipped with an RFID reader to receive the UUID from the ring-shaped device. Based on the acquired UUID, the edge computer sends an API request to the backend server to retrieve the corresponding user data. In addition, the edge computer is equipped with an emotion recognition means to analyze the user's emotional state, and analyzes the user's facial expressions and voice in real time using a camera and microphone.
[1379] 3. Backend Server
[1380] The backend server searches the database based on the UUID sent from the edge computer and returns the corresponding user data. This user data includes the user's name, purchase history, preferences, etc. The backend server also updates the database based on the emotion information sent from the edge computer and uses it for the next service provision.
[1381] Specific examples
[1382] For example, consider the case where a user arrives at a shopping mall and approaches an edge computer installed at the entrance. When the ring-shaped device sends a UUID to the edge computer, the edge computer receives the UUID and sends an API request to the backend server. The backend server searches the user database to obtain the user's purchasing history and preferences, and returns the information to the edge computer.
[1383] At the same time, the edge computer uses its built-in camera and microphone to analyze the user's facial expressions and tone of voice to assess their emotional state. For example, if the user is smiling, the edge computer will use that information to display cheerful and upbeat content. Conversely, if the user looks anxious, it will provide relaxing content.
[1384] Prompt Sentence Examples
[1385] You can input prompts like the following into your generative AI model:
[1386] "UUID: 123e4567-e89b-12d3-a456-426614174000
[1387] Emotional state: happy
[1388] Username: Taro
[1389] Purchase history: [Product A, Product B, Product C]
[1390] Favorite Item: Item D
[1391] Produced message:
[1392] Hello Taro! Looks like you're having fun today! I highly recommend this product!
[1393] In this way, the system of the present invention can provide a more personalized service based on both the user's individual identity and real-time emotional state, thereby improving the user experience.
[1394] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1395] Step 1:
[1396] A user arrives at a commercial facility and wears a ring-shaped device. When the user moves close to the edge computer, the ring-shaped device transmits a UUID.
[1397] Input: UUID from the ring device
[1398] Output: UUID received by edge computer
[1399] Specific operation: When a user wears a ring-shaped device and moves around an edge computer in a commercial facility, the ring-shaped device continues to transmit a UUID.
[1400] Step 2:
[1401] The edge computer uses an RFID reader to receive the UUID from the ring-shaped device.
[1402] Input: UUID signal
[1403] Output: Get UUID
[1404] Specific operation: The UUID signal from the ring-shaped device is received by the RFID reader in the edge computer, and the UUID is stored in the edge computer.
[1405] Step 3:
[1406] The edge computer uses the acquired UUID to send an API request to the backend server, requesting the corresponding user data.
[1407] Input: UUID
[1408] Output: User database query
[1409] Specific operation: Based on the UUID, the edge computer sends an HTTP request to the backend server, instructing it to search for user information.
[1410] Step 4:
[1411] The backend server searches the database based on the UUID from the edge computer and obtains the corresponding user data.
[1412] Input: Query based on UUID
[1413] Output: User data
[1414] Specific operation: The backend server searches the database and extracts data such as the user's past purchase history and favorite products corresponding to the UUID.
[1415] Step 5:
[1416] The back-end server returns the acquired user data to the edge computer.
[1417] Input: User data
[1418] Output: Data response
[1419] Specific operation: The backend server formats the extracted user data and generates an HTTP response to send back to the edge computer.
[1420] Step 6:
[1421] The edge computer uses a camera and microphone to analyze the user's facial expressions and tone of voice, and evaluates the user's emotional state using emotion recognition means.
[1422] Input: Camera video, microphone audio data
[1423] Output: Emotional information
[1424] Specific operation: The edge computer uses a camera and microphone to collect video and audio data, analyzes the data with an emotion recognition algorithm, and classifies the user's emotional state.
[1425] Step 7:
[1426] Based on the user data and emotional information acquired by the edge computer, content optimal for the user is generated and displayed on a display device such as a monitor.
[1427] Input: User data, emotional information
[1428] Output: Customized content
[1429] Specific operation: The edge computer integrates user data and emotional information to generate specific promotional content and information, which is then displayed on the display and provided to the user.
[1430] Step 8:
[1431] At the same time that the generated content is provided to the user, the edge computer transmits the acquired emotion information to the backend server, which updates the user database.
[1432] Input: Emotion information
[1433] Output: Database update request
[1434] Specific operation: The edge computer sends the collected emotion information to the backend server as an HTTP request, and uses that information to instruct the backend server to update the user database to the latest version.
[1435] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[1436] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1437] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.
[1438] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[1439] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.
[1440] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.
[1441] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).
[1442] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.
[1443] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."
[1444] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.
[1445] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).
[1446] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.
[1447] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.
[1448] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[1449] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.
[1450] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.
[1451] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.
[1452] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.
[1453] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.
[1454] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.
[1455] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.
[1456] The following is further disclosed regarding the above embodiment.
[1457] (Claim 1)
[1458] a communication means for holding individual identification information;
[1459] an edge computer means for extracting the individual identification information received via the communication means;
[1460] a back-end server means for receiving the individual identification information from the edge computer means and returning user data;
[1461] means for providing a customized service to a specific user using the user data;
[1462] A system including:
[1463] (Claim 2)
[1464] The system of claim 1, wherein the individual identification information is transmitted by a ring-type device.
[1465] (Claim 3)
[1466] 10. The system of claim 1, wherein the edge computer means receives the individual identification information using wireless communication technology.
[1467] (Claim 4)
[1468] 2. The system according to claim 1, wherein the back-end server means searches a database for corresponding user data based on the individual identification information received from the edge computer means.
[1469] (Claim 5)
[1470] The system of claim 1 , wherein the user data includes a user's name, preferences, and interests.
[1471] "Example 1"
[1472] (Claim 1)
[1473] a communication means for holding individual identification information;
[1474] an edge computer means for extracting the individual identification information received via the communication means;
[1475] a back-end server means for receiving the individual identification information from the edge computer means and returning user data;
[1476] means for generating and providing customized services to specific users using said user data;
[1477] a means for transmitting an API request to a backend server means based on the individual identification information by the edge computer means;
[1478] a means for receiving the API request and searching for the corresponding user data by the backend server means;
[1479] means for returning the user data to the edge computer means;
[1480] A system including:
[1481] (Claim 2)
[1482] 2. The system according to claim 1, wherein the individual identification information is transmitted using a ring-shaped information transmitting device.
[1483] (Claim 3)
[1484] 10. The system of claim 1, wherein the edge computer means receives the individual identification information using wireless communication technology.
[1485] "Application Example 1"
[1486] (Claim 1)
[1487] a communication means for holding individual identification information;
[1488] an edge computer means for extracting the individual identification information received via the communication means;
[1489] a back-end server means for receiving the individual identification information from the edge computer means and returning user data;
[1490] means for providing a customized service to a specific user using the user data;
[1491] means for utilizing said user data to customize seat positions and entertainment systems within an automated vehicle;
[1492] A system including:
[1493] (Claim 2)
[1494] The system of claim 1, wherein the individual identification information is transmitted by a ring-type device.
[1495] (Claim 3)
[1496] 10. The system of claim 1, wherein the edge computer means receives the individual identification information using wireless communication technology.
[1497] "Example 2: Combining Emotion Engines"
[1498] (Claim 1)
[1499] a communication device means for holding individual identification information;
[1500] edge computing means for extracting individual identification information received via said communication device means;
[1501] a back-end computer means for receiving the individual identification information from the edge computer means and returning user data;
[1502] emotion engine means for analyzing the user data and further analyzing voice and facial expressions to acquire emotion information;
[1503] a means for providing a service customized to a specific user by using the emotion information and user data;
[1504] means for storing the emotion information in a user database and utilizing it for subsequent service provision;
[1505] A system including:
[1506] (Claim 2)
[1507] 2. The system of claim 1, wherein the individual identification information is transmitted by a ring-type device.
[1508] (Claim 3)
[1509] 10. The system of claim 1, wherein the edge computing means receives the individual identification information using wireless communication technology, and the emotion engine means utilizes a microphone and a camera.
[1510] "Application example 2 when combining emotion engines"
[1511] (Claim 1)
[1512] a communication means for holding individual identification information;
[1513] an edge computer means for extracting the individual identification information received via the communication means;
[1514] a back-end server means for receiving the individual identification information from the edge computer means and returning user data;
[1515] means for providing a customized service to a specific user using the user data;
[1516] an emotion recognition means for recognizing an emotional state of a user by the edge computer means;
[1517] means for providing optimal content to a user based on emotion information acquired by said emotion recognition means;
[1518] A system including:
[1519] (Claim 2)
[1520] The system of claim 1, wherein the individual identification information is transmitted by a ring-type device.
[1521] (Claim 3)
[1522] 10. The system of claim 1, wherein the edge computer means receives the individual identification information using wireless communication technology. [Explanation of symbols]
[1523] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>
Claims
1. a communication means for holding individual identification information; an edge computer means for extracting the individual identification information received via the communication means; a back-end server means for receiving the individual identification information from the edge computer means and returning user data; means for providing a customized service to a specific user using the user data; A system including:
2. The system of claim 1 , wherein the individual identification information is transmitted by a ring-type device.
3. The system of claim 1 , wherein the edge computer means receives the individual identification information using wireless communication technology.
4. 2. The system according to claim 1, wherein said back-end server means searches a database for corresponding user data based on the individual identification information received from said edge computer means.
5. The system of claim 1 , wherein the user data includes a user's name, preferences, and interests.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A