system

Abstract

Provide a system. A means for acquiring a user's current location; A means for searching for location information of the nearest toilet based on the acquired current location; means for providing information on the cleanliness and facilities of the nearest toilet that has been searched for; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] When people suddenly feel the need to defecate or urinate while out and about, it is difficult to quickly and easily find an available toilet. Furthermore, there is a lack of information about the cleanliness and facilities of available toilets (baby care facilities, ostomate-friendly toilets, etc.), making it difficult to select an appropriate toilet, causing anxiety and dissatisfaction for users. Furthermore, there is a lack of means to check in advance how clean a toilet is and whether the facilities are in place, which reduces convenience. These issues need to be resolved. [Means for solving the problem]

[0005] The present invention provides a system that includes a means for acquiring a user's current location, a means for searching for the location information of the nearest restroom based on the acquired current location, and a means for providing the cleanliness level and facility information of the searched nearest restroom. In this system, the facility information provided includes information on the presence or absence of baby care facilities and ostomate-friendly toilets. The system also includes a means for the user to check the interior of the restroom in advance using AR or VR functions before displaying the cleanliness level and facility information of the restroom. This allows the user to quickly find a clean, appropriately equipped restroom that is the closest to their location, enabling them to use it with peace of mind. This eliminates anxiety and frustration when dealing with sudden defecation or urination needs while out and about, improving the convenience of using restrooms.

[0006] "User" refers to an individual who uses the restroom search system.

[0007] "Current location" refers to real-time geographical location information when a user uses the restroom search system.

[0008] "Restroom location information" refers to information that indicates the physical location of a particular restroom.

[0009] "Cleanliness" refers to the standard used to evaluate the hygienic condition of a toilet.

[0010] "Facility information" refers to information about the type and condition of various facilities provided in the restroom.

[0011] "Baby care facilities" refers to facilities necessary for caring for infants and young children (e.g., diaper changing stations, nursing rooms, etc.).

[0012] An "ostomate-friendly toilet" is a toilet designed to be easily usable by people with artificial anuses or bladders.

[0013] "AR," also known as "augmented reality," refers to the technology of overlaying digital information onto real-world images.

[0014] "VR," also known as "virtual reality," refers to technology that allows users to experience a virtual environment generated by a computer.

[0015] "System" refers to the technical devices and programs that comprise the overall components that obtain the user's current location and provide information on the nearest restroom. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] The toilet search system of the present invention acquires the user's current location and provides information on the location, cleanliness, and facilities of the nearest toilet based on that location. This system enables the user to quickly find an appropriate toilet when they suddenly feel the urge to defecate or urinate, providing a more comfortable and secure environment for going out.

[0038] System Configuration

[0039] The system consists of a user's terminal (such as a smartphone), a server, and a communication network that links these together.

[0040] 1. Obtaining the user's current location

[0041] User: Launch the toilet search app and allow it to use location information.

[0042] Device: Uses GPS to obtain the user's current location, which serves as the basis for subsequent processing.

[0043] 2. Sending a request to the server

[0044] Device: Sends the acquired current location information to the server.

[0045] Server: Receives location information and searches the database for the nearest toilet.

[0046] 3. Obtaining information about nearby toilets

[0047] Server: Obtains information on multiple toilets closest to the user's current location from the database, including toilet location information, cleanliness level, and facility information (whether or not there are baby care facilities and ostomate-friendly toilets).

[0048] Terminal: Receives the toilet information returned from the server and displays it to the user.

[0049] 4. Check restroom locations in advance using AR / VR

[0050] User: Select a specific toilet from the displayed list of toilets.

[0051] Terminal: Sends the ID of the selected toilet to the server and obtains the corresponding AR / VR data.

[0052] Server: Provides AR / VR data that allows users to see the inside of a toilet.

[0053] Terminal: Displays the acquired AR / VR data, allowing users to check the interior of the toilet in advance.

[0054] 5. Posting and saving user reviews

[0055] User: After using the restroom, enter a review on the app.

[0056] Terminal: Sends review information (user ID, toilet ID, rating, comment) to the server.

[0057] Server: Saves the review information to a database and updates the toilet's rating, allowing other users to choose a toilet based on the reviews.

[0058] Specific examples

[0059] For example, suppose a user suddenly feels the urge to defecate at a tourist spot. The user opens a toilet search app and allows the use of location information. The device obtains the current location and sends this information to the server. The server searches the database for information on the nearest toilet and sends it back to the user's device. The user selects a specific toilet from the provided list and checks its cleanliness and facilities. The user can also use AR / VR to check the interior of the toilet in advance. After using the toilet, the user enters a review in the app and sends it to the server. This review is saved in the database and can be used as reference by other users when using the toilet.

[0060] The system of the present invention allows users to quickly find a suitable toilet, making it easier to maintain a clean and comfortable toilet environment. In addition, by utilizing user reviews, it also contributes to improving the toilet environment.

[0061] The processing flow will be explained below.

[0062] Step 1:

[0063] The user launches the toilet search app and allows the use of location information.

[0064] Step 2:

[0065] The device uses the GPS function to obtain the user's current location.

[0066] Step 3:

[0067] The current location information acquired by the terminal is sent to the server.

[0068] Step 4:

[0069] The server receives the location information and accesses a database to search for restrooms near the current location.

[0070] Step 5:

[0071] The server obtains the location information, cleanliness level, and facility information (including whether or not there are baby care facilities and ostomate-friendly toilets) of the relevant toilets from the database and generates a list.

[0072] Step 6:

[0073] The server returns the generated toilet information list to the terminal.

[0074] Step 7:

[0075] The terminal displays the received toilet information list to the user.

[0076] Step 8:

[0077] The user selects a particular toilet from the displayed list of toilets.

[0078] Step 9:

[0079] The device sends the ID of the selected toilet to the server and requests the corresponding AR / VR data.

[0080] Step 10:

[0081] The server provides the requested AR / VR data of the toilet and sends it to the device.

[0082] Step 11:

[0083] The device displays the received AR / VR data, allowing users to check the interior of the toilet in advance.

[0084] Step 12:

[0085] After using the restroom, the user writes a review in the app.

[0086] Step 13:

[0087] The device sends review information (user ID, toilet ID, rating, comment) to the server.

[0088] Step 14:

[0089] The server stores the received review information in a database.

[0090] Step 15:

[0091] The server updates the toilet's rating based on the saved review information.

[0092] By repeating the above steps, the system of the present invention allows the user to always obtain the latest and most appropriate toilet information.

[0093] Example 1

[0094] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0095] Conventional toilet search systems make it difficult for users to quickly and appropriately find the nearest toilet when they suddenly feel the need to defecate or urinate. It is also difficult to check the cleanliness and facility information of the toilet beforehand, which creates the problem of not feeling at ease until actually using the toilet. Furthermore, there has been no effective system that properly collects user reviews after using the toilet and allows other users to refer to those reviews.

[0096] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0097] In this invention, the server includes means for acquiring the user's current location, means for searching for location information, cleanliness level, and facility information of the nearest toilet based on the acquired current location, means for displaying the searched toilet information on the user's terminal, means for providing augmented reality or virtual reality data that allows the user to check the interior of the selected toilet in advance, and means for inputting user reviews after using the toilet, sending the reviews to the server, and storing them in a database. This allows users to quickly find the nearest toilet, check the cleanliness level and facilities, and check the interior of the toilet in advance. A system is also realized that collects reviews after using the toilet, allowing other users to refer to the reviews.

[0098] "Current location" is information about the latitude and longitude of the user's current location, obtained using the GPS function of the device used by the user.

[0099] A "server" is a computer system that receives requests from user terminals via a network, performs the necessary processing, and provides information.

[0100] A "terminal" is an electronic device used by a user, such as a computer, smartphone, or tablet.

[0101] "Toilet location information" is latitude and longitude data that indicates the specific location of the nearest toilet.

[0102] "Cleanliness" is information that indicates an evaluation of the cleanliness and sanitary condition of the toilet.

[0103] "Facility information" refers to facility information such as whether or not the restroom has baby care facilities or an ostomate-friendly toilet.

[0104] "AR" stands for augmented reality, a technology that displays computer-generated information overlaid on real-world scenery.

[0105] "VR" stands for virtual reality, a technology that allows you to experience a computer-generated virtual environment.

[0106] A "database" is a system for efficiently managing a collection of data and performing operations such as searching, saving, and updating.

[0107] A "review" is a detailed description of a user's impressions and evaluations after using a toilet.

[0108] The toilet search system of the present invention acquires the user's current location and provides information on the location, cleanliness, and facilities of the nearest toilet based on that location. The system aims to enable users to quickly find an appropriate toilet when they suddenly feel the urge to defecate or urinate, providing an environment in which they can go out more comfortably and safely.

[0109] System configuration

[0110] The system consists of a user's terminal (such as a smartphone), a server, and a communication network that links these together.

[0111] Get the user's current location

[0112] The user launches the toilet search app and allows the app to use location information. The device uses its GPS function to obtain the user's current location. Specifically, the LocationManager API is used on the ANDROID (registered trademark) platform, and the CoreLocation framework is used on the iOS platform. The obtained location information is sent to the server in JSON format.

[0113] Sending a request to the server

[0114] The device sends an HTTP POST request containing its current location data to the server, which sends the location information via a REST API to an endpoint such as "https: / / example.com / api / nearest_toilets," which causes the server to make a database query to find the nearest toilets.

[0115] Obtaining information about nearby toilets

[0116] The server retrieves information about the nearest restroom from a MySQL® database based on the location information. The retrieved information includes the restroom's location, cleanliness, baby care facilities, and whether or not it has an ostomate-friendly restroom. The retrieved information is returned to the user's device in JSON format.

[0117] Advance toilet check using AR / VR

[0118] The user selects a specific toilet from a provided list. The device then sends the selected toilet's ID to the server, which then provides the corresponding AR / VR data. This data is generated using frameworks such as Unity, ARKit, and ARCore. The user can check the interior of the toilet in advance on their device, including a 360-degree view.

[0119] Posting and saving user reviews

[0120] After using the restroom, users enter a review on the app. The review includes a star rating and comments, and the device sends it to the server as an HTTP POST request. The server saves the review information in a database and updates the restroom's rating. This allows other users to use the review as a reference when choosing a restroom.

[0121] Specific examples

[0122] For example, if a user suddenly feels the need to defecate at a tourist spot, the user launches a restroom search app and agrees to a prompt to allow the use of location information. The following prompt is displayed: "Please obtain the location information of restrooms." If the user selects permission, the device obtains the current location and sends it to the server. The server searches for the nearest restroom information and sends it back to the user's device. The user selects a specific restroom from the displayed list and checks its cleanliness and facilities. The user can also use the AR / VR function to check the interior of the restroom in advance. The user then uses the restroom, enters a review in the app, and sends it to the server. This review is stored in a database and can be used as reference by other users when using the restroom.

[0123] This invention allows users to quickly find a suitable toilet and ensure a clean and comfortable toilet environment. Furthermore, by utilizing user reviews, it contributes to improving the quality of toilets.

[0124] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0125] Step 1:

[0126] The user launches the toilet search app and allows it to use location information.

[0127] Input: User launches app and agrees to location permission prompt

[0128] How it works: When a user launches the toilet search app on their smartphone, a prompt appears asking for permission to use location information. If the user selects "Allow," a notification is sent to the device.

[0129] Output: A flag indicating permission was granted

[0130] Step 2:

[0131] The device obtains the user's current location

[0132] Input: Location permission flag

[0133] Behavior: The device activates the GPS function and obtains the current latitude and longitude using the LocationManager API on Android and CoreLocation on iOS.

[0134] Output: Current location (latitude and longitude)

[0135] Step 3:

[0136] The device sends its current location to the server

[0137] Input: Current location information (latitude and longitude)

[0138] Operation: The device sends the acquired latitude and longitude in JSON format to the server as an HTTP POST request. The Uri is, for example, "https: / / example.com / api / nearest_toilets".

[0139] Output: Result status of request sent to server

[0140] Step 4:

[0141] The server searches for information about the nearest toilet

[0142] Input: User's current location (latitude and longitude)

[0143] How it works: Based on the current location received, the server queries a MySQL database to find the nearest restrooms, including their location, cleanliness, and amenities.

[0144] Output: Toilet information (location, cleanliness, facility information)

[0145] Step 5:

[0146] The server sends the toilet information to the terminal.

[0147] Input: Nearest toilet information (location, cleanliness, facilities information)

[0148] How it works: The server converts the acquired toilet information into JSON format and sends it to the user's device as an HTTP response.

[0149] Output: Toilet information in JSON format

[0150] Step 6:

[0151] The device analyzes the toilet information and displays it to the user

[0152] Input: JSON format toilet information received from the server

[0153] How it works: The device parses the received JSON data and displays the location, cleanliness, and facility information of the toilets in a list format on the app screen.

[0154] Output: A list of toilets available to the user

[0155] Step 7:

[0156] User selects a specific restroom and requests AR / VR data

[0157] Input: The ID of the toilet selected by the user

[0158] How it works: When a user selects a specific toilet from the displayed list, the device sends an HTTP POST request including the toilet's ID to the server, requesting AR / VR data.

[0159] Output: AR / VR data request to the server

[0160] Step 8:

[0161] The server provides AR / VR data for the specified toilet.

[0162] Input: The ID of the toilet selected by the user

[0163] How it works: The server retrieves AR / VR data corresponding to the toilet ID from the database and sends this data to the user's device. This data is generated using Unity or ARKit / ARCore.

[0164] Output: AR / VR data

[0165] Step 9:

[0166] The device analyzes the AR / VR data and displays it to the user

[0167] Input: AR / VR data received from the server

[0168] How it works: The device analyzes the received AR / VR data and displays the interior of the toilet to the user in a 360-degree view or augmented reality.

[0169] Output: Display AR / VR view

[0170] Step 10:

[0171] A user uses the restroom and writes a review

[0172] Input: User review information (user ID, toilet ID, rating, comment)

[0173] How it works: After using the restroom, the user enters a review in the app, including a rating and comment.

[0174] Output: Review completed flag

[0175] Step 11:

[0176] The device sends the review information to the server

[0177] Input: Review information (user ID, toilet ID, rating, comment)

[0178] How it works: The device sends the review information to the server as an HTTP POST request.

[0179] Output: Result status of review data sent to the server

[0180] Step 12:

[0181] The server saves the review to a database and updates the restroom's rating.

[0182] Input: Review information submitted by the user

[0183] Operation: The server saves the received review information in a database and updates the rating information of the toilet, allowing other users to use the rating information when selecting a toilet.

[0184] Output: Status of review saved to database

[0185] (Application example 1)

[0186] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0187] When food delivery partners suddenly need to defecate or urinate while on the job, it is difficult to quickly find a suitable restroom, which impairs work efficiency and a comfortable working environment. In addition, there is no way to check the cleanliness or facility information of the restroom in advance, which can make users feel uneasy.

[0188] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0189] In this invention, the server includes means for acquiring the user's current location, means for searching for location information of the nearest restroom based on the acquired current location, means for providing information on the cleanliness and facilities of the searched nearest restroom, means for allowing the interior of the searched restroom to be checked in advance using an AR or VR function, and means for inputting and sending reviews of the restroom used. This enables food delivery partners to quickly find an appropriate restroom even while on the job and use it with peace of mind, improving work efficiency and a comfortable working environment.

[0190] "User" refers to a food delivery partner and a user who uses this system to search for a toilet.

[0191] "Means for acquiring the current location" refers to a technology that uses a GPS function to identify the user's current location.

[0192] The "means for searching for location information of the nearest toilet" is a technology that searches a database for the location of nearby toilets based on the user's current location.

[0193] "Means for providing information on the cleanliness of toilets and toilet facilities" refers to a technology that provides users with information on the cleanliness and facilities (such as the presence or absence of baby care facilities and ostomate-friendly toilets) of the toilets that have been searched for.

[0194] "A means for checking the interior of the searched toilet in advance using AR or VR functions" is a system that allows users to visually check the interior of the toilet they specify in advance using augmented reality (AR) or virtual reality (VR) technology.

[0195] "Means for inputting and transmitting reviews of toilets used" refers to a technology that allows users to input reviews about the toilet's usability and cleanliness after using it, and transmit these to a server.

[0196] The restroom search system for food delivery partners of the present invention acquires the user's current location and provides information on the location, cleanliness, and facilities of the nearest restroom based on that location. This system enables users to quickly find an appropriate restroom when they suddenly need to defecate or urinate, improving the efficiency of delivery work and providing a comfortable working environment.

[0197] System Configuration

[0198] The system consists of a user terminal (such as a smartphone), a server, and a communication network that connects them. Specific examples of hardware and software are as follows:

[0199] 1. User Device

[0200] Hardware: Smartphone (with GPS function)

[0201] Software: Mobile app development frameworks (React Native, Flutter (registered trademark), etc.)

[0202] 2. Server

[0203] Software: Node.js, Express

[0204] Database: MongoDB, PostgreSQL

[0205] AR / VR libraries: Unity, ARKit, ARCore

[0206] System Operation

[0207] 1. Obtaining the user's current location

[0208] User: Launch the toilet search app and allow it to use location information.

[0209] Device: Uses GPS to obtain the user's current location, which serves as the basis for subsequent processing.

[0210] 2. Sending a request to the server

[0211] Device: Sends the acquired current location information to the server.

[0212] Server: Receives location information and searches the database for the nearest toilet.

[0213] 3. Obtaining information about nearby toilets

[0214] Server: Obtains information on multiple toilets closest to the user's current location from the database, including toilet location information, cleanliness level, and facility information (whether or not there are baby care facilities and ostomate-friendly toilets).

[0215] Terminal: Receives the toilet information returned from the server and displays it to the user.

[0216] 4. Check restroom locations in advance using AR / VR

[0217] User: Select a specific toilet from the displayed list of toilets.

[0218] Terminal: Sends the ID of the selected toilet to the server and obtains the corresponding AR / VR data.

[0219] Server: Provides AR / VR data that allows users to see the inside of a toilet.

[0220] Terminal: Displays the acquired AR / VR data, allowing users to check the interior of the toilet in advance.

[0221] 5. Posting and saving user reviews

[0222] User: After using the restroom, enter a review on the app.

[0223] Terminal: Sends review information (user ID, toilet ID, rating, comment) to the server.

[0224] Server: Saves the review information to a database and updates the toilet's rating, allowing other users to choose a toilet based on the reviews.

[0225] Specific examples

[0226] For example, if a delivery partner suddenly needs to go to the bathroom while delivering food, they can open a restroom search app and submit their location information. The app will then display the nearest clean restroom. Delivery partners can use the AR / VR function to check the interior of the restroom in advance, allowing them to use it with peace of mind. They can then post a review, which other delivery partners can use as a reference.

[0227] Example prompts to input to the generative AI model

[0228] "Describe a restroom finder app that helps delivery partners quickly find a clean restroom when they suddenly need to go to the bathroom while at work."

[0229] By using this prompt, the generative AI model can provide more detailed explanations of specific applications and usage scenarios.

[0230] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0231] Step 1:

[0232] Get the user's current location

[0233] Input: The user launches the toilet search app and allows it to use location information.

[0234] Processing: The device acquires the current location information using the smartphone's GPS function. The acquired current location information is stored in a variable within the program.

[0235] Output: Current location information (latitude, longitude).

[0236] Step 2:

[0237] Sending a request to the server

[0238] Input: Current location information obtained in step 1.

[0239] Processing: The current location information acquired by the device is sent to the server using the REST API.

[0240] Output: The request to the server.

[0241] Step 3:

[0242] Obtaining information about nearby toilets

[0243] Input: Current location information sent to the server in step 2.

[0244] Processing: Based on the current location information received by the server, search the database for the nearest toilet information (location, cleanliness level, facility information). Prepare the search results in JSON format.

[0245] Output: Nearest toilet information (JSON format).

[0246] Step 4:

[0247] Receiving and displaying toilet information

[0248] Input: Nearest toilet information sent from the server in step 3.

[0249] Processing: The device receives the response from the server and displays the toilet information on the app screen.

[0250] Output: A list of toilets that the user can check.

[0251] Step 5:

[0252] Advance toilet check using AR / VR

[0253] Input: The user selects a specific toilet from a list of toilets.

[0254] Processing: The device sends the ID of the selected restroom to the server and requests the corresponding AR / VR data. The server receives this request, retrieves the corresponding AR / VR data from the database, and sends it to the device. The AR / VR data received by the device is displayed on the app screen.

[0255] Output: AR / VR data display of the toilet.

[0256] Step 6:

[0257] Posting and saving user reviews

[0258] Input: The user enters a review (rating, comments) after using the toilet.

[0259] Processing: The terminal sends the entered review information (user ID, restroom ID, rating, comment) to the server. The server saves the received review information in the database and updates the existing restroom rating data.

[0260] Output: Saves review information to a database and updates ratings.

[0261] The above steps will create a system that allows food delivery partners to find suitable restrooms with peace of mind and obtain information quickly and reliably.

[0262] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0263] The toilet search system of the present invention acquires the user's current location and provides information on the location, cleanliness, and facilities of the nearest toilet based on that location. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the system customizes the toilet search results according to the user's emotional state. This allows the user to quickly find a more comfortable and suitable toilet.

[0264] System Configuration

[0265] The system consists of a user's device (such as a smartphone), a server, an emotion engine, and a communication network that connects these.

[0266] 1. Obtaining the user's current location

[0267] User: Launch the toilet search app and allow it to use location information.

[0268] Device: Uses GPS to obtain the user's current location, which serves as the basis for subsequent processing.

[0269] 2. Sending a request to the server

[0270] Device: Sends the acquired current location information to the server.

[0271] Server: Receives location information and searches the database for the nearest toilet.

[0272] 3. Obtaining information about nearby toilets

[0273] Server: Obtains information on multiple toilets closest to the user's current location from the database, including toilet location information, cleanliness level, and facility information (whether or not there are baby care facilities and ostomate-friendly toilets).

[0274] Terminal: Receives the toilet information returned from the server and displays it to the user.

[0275] 4. Check restroom locations in advance using AR / VR

[0276] User: Select a specific toilet from the displayed list of toilets.

[0277] Terminal: Sends the ID of the selected toilet to the server and obtains the corresponding AR / VR data.

[0278] Server: Provides AR / VR data that allows users to see the inside of a toilet.

[0279] Terminal: Displays the acquired AR / VR data, allowing users to check the interior of the toilet in advance.

[0280] 5. Posting and saving user reviews

[0281] User: After using the restroom, enter a review on the app.

[0282] Terminal: Sends review information (user ID, toilet ID, rating, comment) to the server.

[0283] Server: Saves the review information to a database and updates the restroom's rating.

[0284] 6. Use of Emotion Engines

[0285] The device runs an emotion engine to recognize the user's emotions. This emotion engine analyzes inputs such as facial expressions and voice to identify the user's emotional state.

[0286] Terminal: Sends the recognized emotional state to the server.

[0287] Server: Recommends the best restroom based on the user's emotional state. For example, if the user is in a high state of urgency, it will prioritize the nearest restroom, while if the user is relaxed, it will recommend a clean restroom with good facilities.

[0288] Server: Sends the search results for suitable toilets to the terminal and displays them to the user.

[0289] Specific examples

[0290] For example, suppose a user suddenly feels the urge to defecate in a busy downtown area. The user opens a toilet search app and allows the use of location information. The device obtains the current location and sends this information to the server. The server searches the database for the nearest toilet information and sends it back to the user's device. The user selects a specific toilet from the provided list and checks its cleanliness and facilities. The user can also use AR / VR to check the interior of the toilet in advance.

[0291] Furthermore, the device's emotion engine recognizes the user's emotions from their facial expressions and voice, and sends that information to the server. If the user is feeling nervous, toilets with high urgency will be suggested first, and after using the toilet, the user can leave a review and rate it. This allows the accumulation of information that will be useful to other users.

[0292] The system of the present invention allows users to quickly find a suitable restroom, making it easier to maintain a clean and comfortable restroom environment. Furthermore, by utilizing the emotion engine, the system can suggest the most suitable restroom based on the user's level of urgency, providing a more personalized service. This can increase user satisfaction.

[0293] The processing flow will be explained below.

[0294] Step 1:

[0295] The user launches the toilet search app and allows the use of location information.

[0296] Step 2:

[0297] The device uses the GPS function to obtain the user's current location.

[0298] Step 3:

[0299] The current location information acquired by the terminal is sent to the server.

[0300] Step 4:

[0301] The server receives the location information and accesses a database to search for restrooms near the current location.

[0302] Step 5:

[0303] The server obtains the location information, cleanliness level, and facility information (including whether or not there are baby care facilities and ostomate-friendly toilets) of the relevant toilets from the database and generates a list.

[0304] Step 6:

[0305] The server returns the generated toilet information list to the terminal.

[0306] Step 7:

[0307] The terminal displays the received toilet information list to the user.

[0308] Step 8:

[0309] The user selects a particular toilet from the displayed list of toilets.

[0310] Step 9:

[0311] The device sends the ID of the selected toilet to the server and requests the corresponding AR / VR data.

[0312] Step 10:

[0313] The server provides the requested AR / VR data of the toilet and sends it to the device.

[0314] Step 11:

[0315] The device displays the received AR / VR data, allowing users to check the interior of the toilet in advance.

[0316] Step 12:

[0317] After using the restroom, the user writes a review in the app.

[0318] Step 13:

[0319] The device sends review information (user ID, toilet ID, rating, comment) to the server.

[0320] Step 14:

[0321] The server stores the review information in a database.

[0322] Step 15:

[0323] The server updates the toilet's rating based on the saved review information.

[0324] Step 16:

[0325] The device activates an emotion engine to recognize the user's emotions. This emotion engine analyzes inputs such as the user's facial expressions and voice to identify the user's emotional state.

[0326] Step 17:

[0327] The device transmits the recognized emotional state to the server.

[0328] Step 18:

[0329] The server will suggest the best restroom based on the user's emotional state. For example, if the user is in a high state of urgency, it will prioritize the nearest restroom, while if the user is relaxed, it will recommend a clean restroom with good facilities.

[0330] Step 19:

[0331] The server sends the search results for suitable toilets to the terminal and displays them to the user.

[0332] By repeating the above steps, the system of the present invention allows users to always obtain the latest and most appropriate toilet information. By providing highly directional information, it is possible to meet the diverse needs of users.

[0333] Example 2

[0334] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0335] There is a demand for a system that allows users to find restrooms quickly and comfortably, but conventional restroom search systems simply provide location information and basic information without considering the user's condition. This makes it difficult to find the best restroom for an emergency or specific situation. Furthermore, since users cannot check the interior of the restroom in advance, it is difficult for users to choose a restroom they can use with confidence. This issue needs to be resolved.

[0336] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0337] In this invention, the server includes a means for acquiring the user's current location, a means for searching for the location information of the nearest restroom based on the acquired current location, a means for providing the cleanliness level and facility information of the searched nearest restroom, a means for analyzing the user's emotional state, and a means for suggesting the most suitable restroom based on the analyzed emotional state. This allows the user to quickly find the most suitable restroom based on their emotional state and level of urgency. Furthermore, the interior can be checked in advance using AR and VR functions, providing even greater peace of mind.

[0338] The "means for acquiring the user's current location" refers to a device or software that acquires the user's current location information using the user's mobile device or GPS function.

[0339] The "means for searching for the location information of the nearest toilet based on the acquired current location" is a processing device or software that searches for and provides the location information of the toilet closest to the user from a database based on the acquired location information.

[0340] "Means for providing information on the cleanliness of the nearest toilets found in a search and on the facilities of the toilets" refers to a device or software that provides users with information on the cleanliness of the toilets found in the search results and on the facilities (such as whether or not they have baby care facilities or ostomate-friendly toilets).

[0341] The "means for analyzing the user's emotional state" is a device or software for analyzing the user's facial expressions and voice to identify the user's current emotional state.

[0342] The "means for suggesting the most suitable toilet based on the analyzed emotional state" is a processing device or software for suggesting the most suitable toilet to the user based on the analyzed emotional state.

[0343] "Baby care facilities" are facilities for caring for infants and young children (for example, diaper changing tables and breastfeeding spaces).

[0344] An "ostomate-friendly toilet" is a toilet facility designed to be comfortable for people with a stoma.

[0345] The "AR function" is a technology that uses augmented reality technology to overlay digital information on real-world toilet information.

[0346] The "VR function" is a technology that uses virtual reality technology to allow users to virtually experience the inside of a toilet through 360-degree video and other means.

[0347] The restroom search system according to the present invention is composed of a user's terminal (such as a smartphone), a server, an emotion engine, and a communication network linking these together.

[0348] First, the user launches the toilet search app on their smartphone and allows the app to use their location information. At this time, the device uses its built-in GPS to obtain the user's current location. The obtained location information is then sent by the device to a server, which then searches a database for information on the nearest toilet based on the received location information.

[0349] The server retrieves information on multiple toilets closest to the user's current location from the database. This information includes the toilet's location, cleanliness, whether it has baby care facilities, and whether it has an ostomate-friendly toilet. The retrieved toilet information is then sent back to the terminal and displayed to the user.

[0350] The user can select a specific toilet from the displayed list. At that time, the device sends the selected toilet's ID to the server, and the server retrieves the toilet's AR / VR data and sends it back to the device. This allows the user to check the interior of the toilet in advance.

[0351] The system also includes an emotion engine. The emotion engine installed in the device analyzes the user's facial expressions and voice to recognize their emotional state. The recognized emotional state is sent to the server, which then uses that information to suggest the most suitable restroom. For example, if the user is nervous, a restroom with a high level of urgency will be suggested first. On the other hand, if the user is relaxed, a restroom that is clean and well-equipped will be recommended. The server recalculates the search results for suitable restrooms, sends them to the device, and displays them to the user.

[0352] As a concrete example, consider a case where a user suddenly feels the urge to defecate in a busy downtown area. The user opens a restroom search app on their smartphone and allows the use of location information. The device obtains their current location and sends that information to the server. The server then searches the database for information about the nearest restroom and sends it back to the user's device. The user selects a specific restroom from the provided list and checks its cleanliness and facilities. The user can also use the AR / VR function to check the interior of the restroom in advance.

[0353] Furthermore, the device's emotion engine recognizes the user's emotions from their facial expressions and voice, and sends this information to the server. If the user is nervous, toilets with a high level of urgency are suggested first, and after using the toilet, the user can leave a review and rate it. This accumulates information that is also useful for other users. This system allows users to quickly find the appropriate toilet, making it easier to ensure a clean and comfortable toilet environment. Furthermore, by utilizing the emotion engine, the system suggests the optimal toilet based on the user's level of urgency, providing a more personalized service. This increases user satisfaction.

[0354] Example prompt sentence:

[0355] "Please tell me about a system that acquires current location, searches for the nearest restroom, and provides information on cleanliness and facilities."

[0356] "Please explain in detail about the system that recognizes the user's emotions and suggests the best toilet for them."

[0357] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0358] Step 1:

[0359] Input: The user launches a toilet search app on their smartphone and allows location access.

[0360] Operation: The device's GPS function is activated and the user's current location (latitude and longitude) is obtained.

[0361] Output: The latitude and longitude of the current location is obtained.

[0362] Step 2:

[0363] Input: Latitude and longitude information of your current location.

[0364] Operation: The device sends the current location information it has acquired to the server via an HTTP POST request.

[0365] Output: Current location information is sent to the server.

[0366] Step 3:

[0367] Input: The user's current location (latitude and longitude).

[0368] How it works: The server analyzes the location information received and searches the toilet information database for the nearest toilet. It performs location-based searches using SQL queries, etc.

[0369] Output: Data including the location, cleanliness, and facilities of the nearest toilets is obtained.

[0370] Step 4:

[0371] Input: Location, cleanliness and facilities of nearest restroom.

[0372] How it works: The server converts the search results into JSON format data and sends it to the device.

[0373] Output: Toilet information in JSON format is sent to the device.

[0374] Step 5:

[0375] Input: Restroom information in JSON format.

[0376] Operation: The device analyzes the toilet information it receives and displays it on the app in a user-friendly format (map or list format).

[0377] Output: The user is shown the nearest toilet information.

[0378] Step 6:

[0379] Input: The action of the user selecting a specific toilet from a list of toilets.

[0380] Operation: The device generates request data including the ID of the selected toilet and sends it to the server.

[0381] Output: Toilet ID information is sent to the server.

[0382] Step 7:

[0383] Input: Specific restroom ID information.

[0384] How it works: The server retrieves the AR / VR data for the corresponding toilet based on the toilet ID.

[0385] Output: AR / VR data is obtained.

[0386] Step 8:

[0387] Input: AR / VR data.

[0388] Operation: The server sends the acquired AR / VR data to the device.

[0389] Output: AR / VR data is sent to the device.

[0390] Step 9:

[0391] Input: AR / VR data sent from the server.

[0392] How it works: The device analyzes the AR / VR data it receives and displays a 3D model and 360-degree image of the inside of the toilet, allowing the user to see it.

[0393] Output: The user can preview the inside of the toilet.

[0394] Step 10:

[0395] Input: User's facial and voice data.

[0396] How it works: The device's emotion engine analyzes facial and voice data to recognize the user's emotional state.

[0397] Output: The user's emotional state is recognized.

[0398] Step 11:

[0399] Input: Recognized user emotional state data.

[0400] How it works: The device sends the recognized emotional state to the server.

[0401] Output: Emotional state data is sent to the server.

[0402] Step 12:

[0403] Input: User emotional state data.

[0404] How it works: The server re-searches for the best restroom for the user based on their emotional state. For example, if the user is in a high state of urgency, it prioritizes distance, and if the user is relaxed, it prioritizes cleanliness and facilities.

[0405] Output: The best toilet information is recalculated.

[0406] Step 13:

[0407] Input: Recalculated optimal toilet information.

[0408] How it works: The server sends the best toilet information to the device.

[0409] Output: The best toilet information is sent to the device.

[0410] Step 14:

[0411] Input: Best Restroom Information.

[0412] What it does: The device will redisplay the best restroom information in the app.

[0413] Output: The best toilet information is displayed to the user.

[0414] Step 15:

[0415] Input: The action of a user entering review information (ratings, comments) on the app after using the restroom.

[0416] How it works: The device sends review information to the server.

[0417] Output: The review information is sent to the server.

[0418] Step 16:

[0419] Input: Review information submitted by the user.

[0420] Behavior: The server receives the review information, stores it in a database, and updates the rating of the restroom.

[0421] Output: The toilet rating is updated and saved in the database.

[0422] (Application example 2)

[0423] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0424] In modern society, finding and using restrooms is a serious problem for people who work in food delivery or other jobs that require long travel times. Efficient search is especially important when a user needs to find a restroom quickly or when high levels of cleanliness or special facilities are required. Furthermore, being unable to find a suitable restroom when in a hurry can lead to reduced work efficiency and stress for the user. Therefore, there is a need for a system that can provide optimal restroom information based on the user's current emotional state and quickly find a suitable restroom.

[0425] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring the user's current location, means for searching for location information of the nearest toilet based on the acquired current location, means for providing the cleanliness level and toilet facility information of the searched nearest toilet, means for recognizing the user's emotional state, and means for customizing the search results according to the user's emotional state. This makes it possible to provide optimal toilet information based on the user's current location and emotional state.

[0426] The "means for acquiring the user's current location" is a technology for identifying the user's current geographical location using a location information system (for example, GPS).

[0427] The "means for searching for the location information of the nearest toilet" is a system that searches a database for the location of the nearest toilet based on the acquired current location of the user.

[0428] "Means for providing information on the cleanliness of the toilet and toilet facilities" refers to technology that conveys to users the cleanliness of the toilet and facility information (for example, whether or not there are baby care facilities or ostomate-friendly toilets).

[0429] The "means for recognizing the user's emotional state" is a system that uses technologies such as facial expression recognition and voice analysis to identify the user's emotional state (e.g., tension, relaxation).

[0430] "Means for customizing search results" refers to technology that optimizes the toilet information provided based on the user's emotional state and current location, and presents the best options for the user.

[0431] "Means for checking the inside of a restroom in advance using AR or VR functions" refers to technology that uses augmented reality (AR) or virtual reality (VR) to allow users to visually check the inside of a restroom before actually visiting.

[0432] The "means for preferentially suggesting the nearest toilet" is a system that preferentially recommends the geographically closest toilet when a user needs to use the toilet in an emergency.

[0433] The "means for suggesting well-equipped restrooms" is a technology that recommends clean, well-equipped restrooms when a user is in a relaxed state and searching for a restroom.

[0434] "Means for collecting feedback from users and providing that information to other users" refers to a system that collects reviews and ratings from users after using the restroom and shares them with the next user.

[0435] "Means for identifying a user's emotional state using facial recognition and voice analysis" refers to technology that recognizes a user's emotions in real time by analyzing image and voice data.

[0436] The system realized based on this invention not only acquires the user's current location and provides information on the nearest restroom, but also customizes search results according to the user's emotional state to provide the most appropriate restroom information for the user. Specific details for implementing this system are described below.

[0437] Hardware and software used

[0438] Hardware: Smartphone (with GPS function), server

[0439] Software: Python, Django, GeoDjango (spatial data processing), Microsoft® Azure® Cognitive Services (sentiment analysis)

[0440] Get the user's current location

[0441] The device (smartphone) uses GPS to obtain the user's current location, which serves as the basis for the toilet search.

[0442] Communicating with the Server

[0443] The device sends the acquired current location information to the server. The server uses GeoDjango to search the database for information on the nearest restroom to the current location. The server also acquires information on the restroom's location, cleanliness, and facilities (including whether or not there are baby care facilities and ostomate-friendly restrooms).

[0444] Providing toilet information

[0445] The server sends the searched toilet information to the terminal, which displays it to the user as a toilet list. The user can select a specific toilet from the list and check its cleanliness and facility information.

[0446] Advance toilet check using AR / VR

[0447] When a user selects a specific restroom, the device sends the restroom's ID to the server and retrieves the corresponding AR / VR data, allowing the user to preview the interior of the restroom using AR / VR.

[0448] Use of emotion engine

[0449] The device activates an emotion engine to recognize the user's emotional state from their facial expressions and voice. This information is sent to the server, which then recommends the most appropriate restroom based on the user's emotional state. For example, if the user is in a high state of urgency, the server will prioritize the nearest restroom, while if the user is relaxed, the server will recommend a clean restroom with excellent facilities.

[0450] Post a user review

[0451] After using the restroom, users can enter a review on the app. This review information is sent from the device to the server and stored in a database. This allows the accumulation of information that will be useful when other users use the restroom.

[0452] Specific examples

[0453] If a food delivery user needs to go to the toilet suddenly, he or she opens the app and allows location information to be used. The device obtains the current location and sends this information to the server. If the system recognizes an emergency situation using the emotion engine, the nearest toilet will be displayed first.

[0454] Prompt Sentence Examples

[0455] "Search and display the nearest restroom based on your current location."

[0456] "The user's emotional state is tension, so please prioritize suggesting the nearest restroom."

[0457] This invention allows users to quickly find a suitable restroom, ensuring a comfortable environment for use. The use of an emotion engine allows the most suitable service to be provided to each individual user, thereby improving user satisfaction.

[0458] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0459] Step 1: Get the user's current location

[0460] Input: The user launches the application and allows location information to be obtained.

[0461] Data processing: The device uses the GPS function to obtain the user's current location (latitude, longitude).

[0462] Output: Latitude and longitude data of current location.

[0463] Specific operation: When a user launches the app and allows it to use location information, the device activates the GPS function to determine the user's current location.

[0464] Step 2: Send location information to the server

[0465] Input: The latitude and longitude data of the device's current location.

[0466] Data processing: The acquired location information is sent to the server.

[0467] Output: Latitude and longitude information received by the server.

[0468] Specific operation: The device uses the communication module to send current location data to the server.

[0469] Step 3: Find the nearest toilet

[0470] Input: The user's current location information received by the server.

[0471] Data processing: Use GeoDjango to search the database for toilet information (location, cleanliness, and facility information) closest to the current location.

[0472] Output: A list of nearby toilets.

[0473] Specific operation: Based on the received current location, the server executes a database query to collect information about nearby toilets.

[0474] Step 4: Providing restroom information

[0475] Input: A list of toilet information searched by the server.

[0476] Data processing: Send the toilet information list to the terminal.

[0477] Output: Toilet information list received by the device.

[0478] Specific operation: The server sends the toilet information obtained as a search result to the terminal and displays it to the user.

[0479] Step 5: Pre-check the toilets using AR / VR

[0480] Input: Toilet ID when user selects a specific toilet.

[0481] Data processing: The toilet ID is sent from the device to the server, and the corresponding AR / VR data is obtained.

[0482] Output: Captured AR / VR data.

[0483] Specific operation: Based on the toilet ID received from the server, the corresponding AR / VR data is obtained and the interior of the toilet is visually displayed to the user.

[0484] Step 6: Recognizing User Emotions

[0485] Input: User's facial expression data and voice data.

[0486] Data processing: Use Microsoft Azure Cognitive Services to analyze the user's emotional state.

[0487] Output: Parsed emotional state data.

[0488] Specific operation: The device analyzes facial expressions and voice data obtained from the user and calls an API to identify the user's emotional state.

[0489] Step 7: Toilet suggestions based on emotional state

[0490] Input: Emotional state data, and toilet information list.

[0491] Data processing: Filtering the best toilets based on your emotional state.

[0492] Output: A list of toilet information that matches the user's emotions.

[0493] Specific operation: The server receives the emotional state data and selects the most suitable toilet based on the urgency.

[0494] Step 8: Leave a review after using the restroom

[0495] Input: User review information (rating, comments).

[0496] Data processing: Review information is sent from the device to the server and stored in a database.

[0497] Output: Review information stored in a database.

[0498] Specific operation: After using the restroom, the user enters a review, which is then sent from the device to the server and saved.

[0499] In this way, through specific operations for each step, a comfortable and convenient toilet search system can be provided for the user.

[0500] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0501] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0502] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0503] [Second embodiment]

[0504] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0505] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0506] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0507] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0508] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0509] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0510] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0511] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0512] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0513] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0514] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0515] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0516] The toilet search system of the present invention acquires the user's current location and provides information on the location, cleanliness, and facilities of the nearest toilet based on that location. This system enables the user to quickly find an appropriate toilet when they suddenly feel the urge to defecate or urinate, providing a more comfortable and secure environment for going out.

[0517] System Configuration

[0518] The system consists of a user's terminal (such as a smartphone), a server, and a communication network that links these together.

[0519] 1. Obtaining the user's current location

[0520] User: Launch the toilet search app and allow it to use location information.

[0521] Device: Uses GPS to obtain the user's current location, which serves as the basis for subsequent processing.

[0522] 2. Sending a request to the server

[0523] Device: Sends the acquired current location information to the server.

[0524] Server: Receives location information and searches the database for the nearest toilet.

[0525] 3. Obtaining information about nearby toilets

[0526] Server: Obtains information on multiple toilets closest to the user's current location from the database, including toilet location information, cleanliness level, and facility information (whether or not there are baby care facilities and ostomate-friendly toilets).

[0527] Terminal: Receives the toilet information returned from the server and displays it to the user.

[0528] 4. Check restroom locations in advance using AR / VR

[0529] User: Select a specific toilet from the displayed list of toilets.

[0530] Terminal: Sends the ID of the selected toilet to the server and obtains the corresponding AR / VR data.

[0531] Server: Provides AR / VR data that allows users to see the inside of a toilet.

[0532] Terminal: Displays the acquired AR / VR data, allowing users to check the interior of the toilet in advance.

[0533] 5. Posting and saving user reviews

[0534] User: After using the restroom, enter a review on the app.

[0535] Terminal: Sends review information (user ID, toilet ID, rating, comment) to the server.

[0536] Server: Saves the review information to a database and updates the toilet's rating, allowing other users to choose a toilet based on the reviews.

[0537] Specific examples

[0538] For example, suppose a user suddenly feels the urge to defecate at a tourist spot. The user opens a toilet search app and allows the use of location information. The device obtains the current location and sends this information to the server. The server searches the database for information on the nearest toilet and sends it back to the user's device. The user selects a specific toilet from the provided list and checks its cleanliness and facilities. The user can also use AR / VR to check the interior of the toilet in advance. After using the toilet, the user enters a review in the app and sends it to the server. This review is saved in the database and can be used as reference by other users when using the toilet.

[0539] The system of the present invention allows users to quickly find a suitable toilet, making it easier to maintain a clean and comfortable toilet environment. In addition, by utilizing user reviews, it also contributes to improving the toilet environment.

[0540] The processing flow will be explained below.

[0541] Step 1:

[0542] The user launches the toilet search app and allows the use of location information.

[0543] Step 2:

[0544] The device uses the GPS function to obtain the user's current location.

[0545] Step 3:

[0546] The current location information acquired by the terminal is sent to the server.

[0547] Step 4:

[0548] The server receives the location information and accesses a database to search for restrooms near the current location.

[0549] Step 5:

[0550] The server obtains the location information, cleanliness level, and facility information (including whether or not there are baby care facilities and ostomate-friendly toilets) of the relevant toilets from the database and generates a list.

[0551] Step 6:

[0552] The server returns the generated toilet information list to the terminal.

[0553] Step 7:

[0554] The terminal displays the received toilet information list to the user.

[0555] Step 8:

[0556] The user selects a particular toilet from the displayed list of toilets.

[0557] Step 9:

[0558] The device sends the ID of the selected toilet to the server and requests the corresponding AR / VR data.

[0559] Step 10:

[0560] The server provides the requested AR / VR data of the toilet and sends it to the device.

[0561] Step 11:

[0562] The device displays the received AR / VR data, allowing users to check the interior of the toilet in advance.

[0563] Step 12:

[0564] After using the restroom, the user writes a review in the app.

[0565] Step 13:

[0566] The device sends review information (user ID, toilet ID, rating, comment) to the server.

[0567] Step 14:

[0568] The server stores the received review information in a database.

[0569] Step 15:

[0570] The server updates the toilet's rating based on the saved review information.

[0571] By repeating the above steps, the system of the present invention allows the user to always obtain the latest and most appropriate toilet information.

[0572] Example 1

[0573] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0574] Conventional toilet search systems make it difficult for users to quickly and appropriately find the nearest toilet when they suddenly feel the need to defecate or urinate. It is also difficult to check the cleanliness and facility information of the toilet beforehand, which creates the problem of not feeling at ease until actually using the toilet. Furthermore, there has been no effective system that properly collects user reviews after using the toilet and allows other users to refer to those reviews.

[0575] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0576] In this invention, the server includes means for acquiring the user's current location, means for searching for location information, cleanliness level, and facility information of the nearest toilet based on the acquired current location, means for displaying the searched toilet information on the user's terminal, means for providing augmented reality or virtual reality data that allows the user to check the interior of the selected toilet in advance, and means for inputting user reviews after using the toilet, sending the reviews to the server, and storing them in a database. This allows users to quickly find the nearest toilet, check the cleanliness level and facilities, and check the interior of the toilet in advance. A system is also realized that collects reviews after using the toilet, allowing other users to refer to the reviews.

[0577] "Current location" is information about the latitude and longitude of the user's current location, obtained using the GPS function of the device used by the user.

[0578] A "server" is a computer system that receives requests from user terminals via a network, performs the necessary processing, and provides information.

[0579] A "terminal" is an electronic device used by a user, such as a computer, smartphone, or tablet.

[0580] "Toilet location information" is latitude and longitude data that indicates the specific location of the nearest toilet.

[0581] "Cleanliness" is information that indicates an evaluation of the cleanliness and sanitary condition of the toilet.

[0582] "Facility information" refers to facility information such as whether or not the restroom has baby care facilities or an ostomate-friendly toilet.

[0583] "AR" stands for augmented reality, a technology that displays computer-generated information overlaid on real-world scenery.

[0584] "VR" stands for virtual reality, a technology that allows you to experience a computer-generated virtual environment.

[0585] A "database" is a system for efficiently managing a collection of data and performing operations such as searching, saving, and updating.

[0586] A "review" is a detailed description of a user's impressions and evaluations after using a toilet.

[0587] The toilet search system of the present invention acquires the user's current location and provides information on the location, cleanliness, and facilities of the nearest toilet based on that location. The system aims to enable users to quickly find an appropriate toilet when they suddenly feel the urge to defecate or urinate, providing an environment in which they can go out more comfortably and safely.

[0588] System configuration

[0589] The system consists of a user's terminal (such as a smartphone), a server, and a communication network that links these together.

[0590] Get the user's current location

[0591] The user launches the toilet search app and allows the app to use location information. The device uses its GPS function to obtain the user's current location. Specifically, the LocationManager API is used on the Android platform, and the CoreLocation framework is used on the iOS platform. The obtained location information is sent to the server in JSON format.

[0592] Sending a request to the server

[0593] The device sends an HTTP POST request containing its current location data to the server, which sends the location information via a REST API to an endpoint such as "https: / / example.com / api / nearest_toilets," which causes the server to make a database query to find the nearest toilets.

[0594] Obtaining information about nearby toilets

[0595] The server retrieves information about the nearest restroom from a MySQL database based on the user's location. The retrieved information includes the restroom's location, cleanliness, baby care facilities, and whether or not it has an ostomate-friendly restroom. The retrieved information is then returned to the user's device in JSON format.

[0596] Advance toilet check using AR / VR

[0597] The user selects a specific toilet from a provided list. The device then sends the selected toilet's ID to the server, which then provides the corresponding AR / VR data. This data is generated using frameworks such as Unity, ARKit, and ARCore. The user can check the interior of the toilet in advance on their device, including a 360-degree view.

[0598] Posting and saving user reviews

[0599] After using the restroom, users enter a review on the app. The review includes a star rating and comments, and the device sends it to the server as an HTTP POST request. The server saves the review information in a database and updates the restroom's rating. This allows other users to use the review as a reference when choosing a restroom.

[0600] Specific examples

[0601] For example, if a user suddenly feels the need to defecate at a tourist spot, the user launches a restroom search app and agrees to a prompt to allow the use of location information. The following prompt is displayed: "Please obtain the location information of restrooms." If the user selects permission, the device obtains the current location and sends it to the server. The server searches for the nearest restroom information and sends it back to the user's device. The user selects a specific restroom from the displayed list and checks its cleanliness and facilities. The user can also use the AR / VR function to check the interior of the restroom in advance. The user then uses the restroom, enters a review in the app, and sends it to the server. This review is stored in a database and can be used as reference by other users when using the restroom.

[0602] This invention allows users to quickly find a suitable toilet and ensure a clean and comfortable toilet environment. Furthermore, by utilizing user reviews, it contributes to improving the quality of toilets.

[0603] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0604] Step 1:

[0605] The user launches the toilet search app and allows it to use location information.

[0606] Input: User launches app and agrees to location permission prompt

[0607] How it works: When a user launches the toilet search app on their smartphone, a prompt appears asking for permission to use location information. If the user selects "Allow," a notification is sent to the device.

[0608] Output: A flag indicating permission was granted

[0609] Step 2:

[0610] The device obtains the user's current location

[0611] Input: Location permission flag

[0612] Behavior: The device activates the GPS function and obtains the current latitude and longitude using the LocationManager API on Android and CoreLocation on iOS.

[0613] Output: Current location (latitude and longitude)

[0614] Step 3:

[0615] The device sends its current location to the server

[0616] Input: Current location information (latitude and longitude)

[0617] Operation: The device sends the acquired latitude and longitude in JSON format to the server as an HTTP POST request. The Uri is, for example, "https: / / example.com / api / nearest_toilets".

[0618] Output: Result status of request sent to server

[0619] Step 4:

[0620] The server searches for information about the nearest toilet

[0621] Input: User's current location (latitude and longitude)

[0622] How it works: Based on the current location received, the server queries a MySQL database to find the nearest restrooms, including their location, cleanliness, and amenities.

[0623] Output: Toilet information (location, cleanliness, facility information)

[0624] Step 5:

[0625] The server sends the toilet information to the terminal.

[0626] Input: Nearest toilet information (location, cleanliness, facilities information)

[0627] How it works: The server converts the acquired toilet information into JSON format and sends it to the user's device as an HTTP response.

[0628] Output: Toilet information in JSON format

[0629] Step 6:

[0630] The device analyzes the toilet information and displays it to the user

[0631] Input: JSON format toilet information received from the server

[0632] How it works: The device parses the received JSON data and displays the location, cleanliness, and facility information of the toilets in a list format on the app screen.

[0633] Output: A list of toilets available to the user

[0634] Step 7:

[0635] User selects a specific restroom and requests AR / VR data

[0636] Input: The ID of the toilet selected by the user

[0637] How it works: When a user selects a specific toilet from the displayed list, the device sends an HTTP POST request including the toilet's ID to the server, requesting AR / VR data.

[0638] Output: AR / VR data request to the server

[0639] Step 8:

[0640] The server provides AR / VR data for the specified toilet.

[0641] Input: The ID of the toilet selected by the user

[0642] How it works: The server retrieves AR / VR data corresponding to the toilet ID from the database and sends this data to the user's device. This data is generated using Unity or ARKit / ARCore.

[0643] Output: AR / VR data

[0644] Step 9:

[0645] The device analyzes the AR / VR data and displays it to the user

[0646] Input: AR / VR data received from the server

[0647] How it works: The device analyzes the received AR / VR data and displays the interior of the toilet to the user in a 360-degree view or augmented reality.

[0648] Output: Display AR / VR view

[0649] Step 10:

[0650] A user uses the restroom and writes a review

[0651] Input: User review information (user ID, toilet ID, rating, comment)

[0652] How it works: After using the restroom, the user enters a review in the app, including a rating and comment.

[0653] Output: Review completed flag

[0654] Step 11:

[0655] The device sends the review information to the server

[0656] Input: Review information (user ID, toilet ID, rating, comment)

[0657] How it works: The device sends the review information to the server as an HTTP POST request.

[0658] Output: Result status of review data sent to the server

[0659] Step 12:

[0660] The server saves the review to a database and updates the restroom's rating.

[0661] Input: Review information submitted by the user

[0662] Operation: The server saves the received review information in a database and updates the rating information of the toilet, allowing other users to use the rating information when selecting a toilet.

[0663] Output: Status of review saved to database

[0664] (Application example 1)

[0665] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0666] When food delivery partners suddenly need to defecate or urinate while on the job, it is difficult to quickly find a suitable restroom, which impairs work efficiency and a comfortable working environment. In addition, there is no way to check the cleanliness or facility information of the restroom in advance, which can make users feel uneasy.

[0667] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0668] In this invention, the server includes means for acquiring the user's current location, means for searching for location information of the nearest restroom based on the acquired current location, means for providing information on the cleanliness and facilities of the searched nearest restroom, means for allowing the interior of the searched restroom to be checked in advance using an AR or VR function, and means for inputting and sending reviews of the restroom used. This enables food delivery partners to quickly find an appropriate restroom even while on the job and use it with peace of mind, improving work efficiency and a comfortable working environment.

[0669] "User" refers to a food delivery partner and a user who uses this system to search for a toilet.

[0670] "Means for acquiring the current location" refers to a technology that uses a GPS function to identify the user's current location.

[0671] The "means for searching for location information of the nearest toilet" is a technology that searches a database for the location of nearby toilets based on the user's current location.

[0672] "Means for providing information on the cleanliness of toilets and toilet facilities" refers to a technology that provides users with information on the cleanliness and facilities (such as the presence or absence of baby care facilities and ostomate-friendly toilets) of the toilets that have been searched for.

[0673] "A means for checking the interior of the searched toilet in advance using AR or VR functions" is a system that allows users to visually check the interior of the toilet they specify in advance using augmented reality (AR) or virtual reality (VR) technology.

[0674] "Means for inputting and transmitting reviews of toilets used" refers to a technology that allows users to input reviews about the toilet's usability and cleanliness after using it, and transmit these to a server.

[0675] The restroom search system for food delivery partners of the present invention acquires the user's current location and provides information on the location, cleanliness, and facilities of the nearest restroom based on that location. This system enables users to quickly find an appropriate restroom when they suddenly need to defecate or urinate, improving the efficiency of delivery work and providing a comfortable working environment.

[0676] System Configuration

[0677] The system consists of a user terminal (such as a smartphone), a server, and a communication network that connects them. Specific examples of hardware and software are as follows:

[0678] 1. User Device

[0679] Hardware: Smartphone (with GPS function)

[0680] Software: Mobile app development frameworks (React Native, Flutter, etc.)

[0681] 2. Server

[0682] Software: Node.js, Express

[0683] Database: MongoDB, PostgreSQL

[0684] AR / VR libraries: Unity, ARKit, ARCore

[0685] System Operation

[0686] 1. Obtaining the user's current location

[0687] User: Launch the toilet search app and allow it to use location information.

[0688] Device: Uses GPS to obtain the user's current location, which serves as the basis for subsequent processing.

[0689] 2. Sending a request to the server

[0690] Device: Sends the acquired current location information to the server.

[0691] Server: Receives location information and searches the database for the nearest toilet.

[0692] 3. Obtaining information about nearby toilets

[0693] Server: Obtains information on multiple toilets closest to the user's current location from the database, including toilet location information, cleanliness level, and facility information (whether or not there are baby care facilities and ostomate-friendly toilets).

[0694] Terminal: Receives the toilet information returned from the server and displays it to the user.

[0695] 4. Check restroom locations in advance using AR / VR

[0696] User: Select a specific toilet from the displayed list of toilets.

[0697] Terminal: Sends the ID of the selected toilet to the server and obtains the corresponding AR / VR data.

[0698] Server: Provides AR / VR data that allows users to see the inside of a toilet.

[0699] Terminal: Displays the acquired AR / VR data, allowing users to check the interior of the toilet in advance.

[0700] 5. Posting and saving user reviews

[0701] User: After using the restroom, enter a review on the app.

[0702] Terminal: Sends review information (user ID, toilet ID, rating, comment) to the server.

[0703] Server: Saves the review information to a database and updates the toilet's rating, allowing other users to choose a toilet based on the reviews.

[0704] Specific examples

[0705] For example, if a delivery partner suddenly needs to go to the bathroom while delivering food, they can open a restroom search app and submit their location information. The app will then display the nearest clean restroom. Delivery partners can use the AR / VR function to check the interior of the restroom in advance, allowing them to use it with peace of mind. They can then post a review, which other delivery partners can use as a reference.

[0706] Example prompts to input to the generative AI model

[0707] "Describe a restroom finder app that helps delivery partners quickly find a clean restroom when they suddenly need to go to the bathroom while at work."

[0708] By using this prompt, the generative AI model can provide more detailed explanations of specific applications and usage scenarios.

[0709] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0710] Step 1:

[0711] Get the user's current location

[0712] Input: The user launches the toilet search app and allows it to use location information.

[0713] Processing: The device acquires the current location information using the smartphone's GPS function. The acquired current location information is stored in a variable within the program.

[0714] Output: Current location information (latitude, longitude).

[0715] Step 2:

[0716] Sending a request to the server

[0717] Input: Current location information obtained in step 1.

[0718] Processing: The current location information acquired by the device is sent to the server using the REST API.

[0719] Output: The request to the server.

[0720] Step 3:

[0721] Obtaining information about nearby toilets

[0722] Input: Current location information sent to the server in step 2.

[0723] Processing: Based on the current location information received by the server, search the database for the nearest toilet information (location, cleanliness level, facility information). Prepare the search results in JSON format.

[0724] Output: Nearest toilet information (JSON format).

[0725] Step 4:

[0726] Receiving and displaying toilet information

[0727] Input: Nearest toilet information sent from the server in step 3.

[0728] Processing: The device receives the response from the server and displays the toilet information on the app screen.

[0729] Output: A list of toilets that the user can check.

[0730] Step 5:

[0731] Advance toilet check using AR / VR

[0732] Input: The user selects a specific toilet from a list of toilets.

[0733] Processing: The device sends the ID of the selected restroom to the server and requests the corresponding AR / VR data. The server receives this request, retrieves the corresponding AR / VR data from the database, and sends it to the device. The AR / VR data received by the device is displayed on the app screen.

[0734] Output: AR / VR data display of the toilet.

[0735] Step 6:

[0736] Posting and saving user reviews

[0737] Input: The user enters a review (rating, comments) after using the toilet.

[0738] Processing: The terminal sends the entered review information (user ID, restroom ID, rating, comment) to the server. The server saves the received review information in the database and updates the existing restroom rating data.

[0739] Output: Saves review information to a database and updates ratings.

[0740] The above steps will create a system that allows food delivery partners to find suitable restrooms with peace of mind and obtain information quickly and reliably.

[0741] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0742] The toilet search system of the present invention acquires the user's current location and provides information on the location, cleanliness, and facilities of the nearest toilet based on that location. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the system customizes the toilet search results according to the user's emotional state. This allows the user to quickly find a more comfortable and suitable toilet.

[0743] System Configuration

[0744] The system consists of a user's device (such as a smartphone), a server, an emotion engine, and a communication network that connects these.

[0745] 1. Obtaining the user's current location

[0746] User: Launch the toilet search app and allow it to use location information.

[0747] Device: Uses GPS to obtain the user's current location, which serves as the basis for subsequent processing.

[0748] 2. Sending a request to the server

[0749] Device: Sends the acquired current location information to the server.

[0750] Server: Receives location information and searches the database for the nearest toilet.

[0751] 3. Obtaining information about nearby toilets

[0752] Server: Obtains information on multiple toilets closest to the user's current location from the database, including toilet location information, cleanliness level, and facility information (whether or not there are baby care facilities and ostomate-friendly toilets).

[0753] Terminal: Receives the toilet information returned from the server and displays it to the user.

[0754] 4. Check restroom locations in advance using AR / VR

[0755] User: Select a specific toilet from the displayed list of toilets.

[0756] Terminal: Sends the ID of the selected toilet to the server and obtains the corresponding AR / VR data.

[0757] Server: Provides AR / VR data that allows users to see the inside of a toilet.

[0758] Terminal: Displays the acquired AR / VR data, allowing users to check the interior of the toilet in advance.

[0759] 5. Posting and saving user reviews

[0760] User: After using the restroom, enter a review on the app.

[0761] Terminal: Sends review information (user ID, toilet ID, rating, comment) to the server.

[0762] Server: Saves the review information to a database and updates the restroom's rating.

[0763] 6. Use of Emotion Engines

[0764] The device runs an emotion engine to recognize the user's emotions. This emotion engine analyzes inputs such as facial expressions and voice to identify the user's emotional state.

[0765] Terminal: Sends the recognized emotional state to the server.

[0766] Server: Recommends the best restroom based on the user's emotional state. For example, if the user is in a high state of urgency, it will prioritize the nearest restroom, while if the user is relaxed, it will recommend a clean restroom with good facilities.

[0767] Server: Sends the search results for suitable toilets to the terminal and displays them to the user.

[0768] Specific examples

[0769] For example, suppose a user suddenly feels the urge to defecate in a busy downtown area. The user opens a toilet search app and allows the use of location information. The device obtains the current location and sends this information to the server. The server searches the database for the nearest toilet information and sends it back to the user's device. The user selects a specific toilet from the provided list and checks its cleanliness and facilities. The user can also use AR / VR to check the interior of the toilet in advance.

[0770] Furthermore, the device's emotion engine recognizes the user's emotions from their facial expressions and voice, and sends that information to the server. If the user is feeling nervous, toilets with high urgency will be suggested first, and after using the toilet, the user can leave a review and rate it. This allows the accumulation of information that will be useful to other users.

[0771] The system of the present invention allows users to quickly find a suitable restroom, making it easier to maintain a clean and comfortable restroom environment. Furthermore, by utilizing the emotion engine, the system can suggest the most suitable restroom based on the user's level of urgency, providing a more personalized service. This can increase user satisfaction.

[0772] The processing flow will be explained below.

[0773] Step 1:

[0774] The user launches the toilet search app and allows the use of location information.

[0775] Step 2:

[0776] The device uses the GPS function to obtain the user's current location.

[0777] Step 3:

[0778] The current location information acquired by the terminal is sent to the server.

[0779] Step 4:

[0780] The server receives the location information and accesses a database to search for restrooms near the current location.

[0781] Step 5:

[0782] The server obtains the location information, cleanliness level, and facility information (including whether or not there are baby care facilities and ostomate-friendly toilets) of the relevant toilets from the database and generates a list.

[0783] Step 6:

[0784] The server returns the generated toilet information list to the terminal.

[0785] Step 7:

[0786] The terminal displays the received toilet information list to the user.

[0787] Step 8:

[0788] The user selects a particular toilet from the displayed list of toilets.

[0789] Step 9:

[0790] The device sends the ID of the selected toilet to the server and requests the corresponding AR / VR data.

[0791] Step 10:

[0792] The server provides the requested AR / VR data of the toilet and sends it to the device.

[0793] Step 11:

[0794] The device displays the received AR / VR data, allowing users to check the interior of the toilet in advance.

[0795] Step 12:

[0796] After using the restroom, the user writes a review in the app.

[0797] Step 13:

[0798] The device sends review information (user ID, toilet ID, rating, comment) to the server.

[0799] Step 14:

[0800] The server stores the review information in a database.

[0801] Step 15:

[0802] The server updates the toilet's rating based on the saved review information.

[0803] Step 16:

[0804] The device activates an emotion engine to recognize the user's emotions. This emotion engine analyzes inputs such as the user's facial expressions and voice to identify the user's emotional state.

[0805] Step 17:

[0806] The device transmits the recognized emotional state to the server.

[0807] Step 18:

[0808] The server will suggest the best restroom based on the user's emotional state. For example, if the user is in a high state of urgency, it will prioritize the nearest restroom, while if the user is relaxed, it will recommend a clean restroom with good facilities.

[0809] Step 19:

[0810] The server sends the search results for suitable toilets to the terminal and displays them to the user.

[0811] By repeating the above steps, the system of the present invention allows users to always obtain the latest and most appropriate toilet information. By providing highly directional information, it is possible to meet the diverse needs of users.

[0812] Example 2

[0813] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0814] There is a demand for a system that allows users to find restrooms quickly and comfortably, but conventional restroom search systems simply provide location information and basic information without considering the user's condition. This makes it difficult to find the best restroom for an emergency or specific situation. Furthermore, since users cannot check the interior of the restroom in advance, it is difficult for users to choose a restroom they can use with confidence. This issue needs to be resolved.

[0815] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0816] In this invention, the server includes a means for acquiring the user's current location, a means for searching for the location information of the nearest restroom based on the acquired current location, a means for providing the cleanliness level and facility information of the searched nearest restroom, a means for analyzing the user's emotional state, and a means for suggesting the most suitable restroom based on the analyzed emotional state. This allows the user to quickly find the most suitable restroom based on their emotional state and level of urgency. Furthermore, the interior can be checked in advance using AR and VR functions, providing even greater peace of mind.

[0817] The "means for acquiring the user's current location" refers to a device or software that acquires the user's current location information using the user's mobile device or GPS function.

[0818] The "means for searching for the location information of the nearest toilet based on the acquired current location" is a processing device or software that searches for and provides the location information of the toilet closest to the user from a database based on the acquired location information.

[0819] "Means for providing information on the cleanliness of the nearest toilets found in a search and on the facilities of the toilets" refers to a device or software that provides users with information on the cleanliness of the toilets found in the search results and on the facilities (such as whether or not they have baby care facilities or ostomate-friendly toilets).

[0820] The "means for analyzing the user's emotional state" is a device or software for analyzing the user's facial expressions and voice to identify the user's current emotional state.

[0821] The "means for suggesting the most suitable toilet based on the analyzed emotional state" is a processing device or software for suggesting the most suitable toilet to the user based on the analyzed emotional state.

[0822] "Baby care facilities" are facilities for caring for infants and young children (for example, diaper changing tables and breastfeeding spaces).

[0823] An "ostomate-friendly toilet" is a toilet facility designed to be comfortable for people with a stoma.

[0824] The "AR function" is a technology that uses augmented reality technology to overlay digital information on real-world toilet information.

[0825] The "VR function" is a technology that uses virtual reality technology to allow users to virtually experience the inside of a toilet through 360-degree video and other means.

[0826] The restroom search system according to the present invention is composed of a user's terminal (such as a smartphone), a server, an emotion engine, and a communication network linking these together.

[0827] First, the user launches the toilet search app on their smartphone and allows the app to use their location information. At this time, the device uses its built-in GPS to obtain the user's current location. The obtained location information is then sent by the device to a server, which then searches a database for information on the nearest toilet based on the received location information.

[0828] The server retrieves information on multiple toilets closest to the user's current location from the database. This information includes the toilet's location, cleanliness, whether it has baby care facilities, and whether it has an ostomate-friendly toilet. The retrieved toilet information is then sent back to the terminal and displayed to the user.

[0829] The user can select a specific toilet from the displayed list. At that time, the device sends the selected toilet's ID to the server, and the server retrieves the toilet's AR / VR data and sends it back to the device. This allows the user to check the interior of the toilet in advance.

[0830] The system also includes an emotion engine. The emotion engine installed in the device analyzes the user's facial expressions and voice to recognize their emotional state. The recognized emotional state is sent to the server, which then uses that information to suggest the most suitable restroom. For example, if the user is nervous, a restroom with a high level of urgency will be suggested first. On the other hand, if the user is relaxed, a restroom that is clean and well-equipped will be recommended. The server recalculates the search results for suitable restrooms, sends them to the device, and displays them to the user.

[0831] As a concrete example, consider a case where a user suddenly feels the urge to defecate in a busy downtown area. The user opens a restroom search app on their smartphone and allows the use of location information. The device obtains their current location and sends that information to the server. The server then searches the database for information about the nearest restroom and sends it back to the user's device. The user selects a specific restroom from the provided list and checks its cleanliness and facilities. The user can also use the AR / VR function to check the interior of the restroom in advance.

[0832] Furthermore, the device's emotion engine recognizes the user's emotions from their facial expressions and voice, and sends this information to the server. If the user is nervous, toilets with a high level of urgency are suggested first, and after using the toilet, the user can leave a review and rate it. This accumulates information that is also useful for other users. This system allows users to quickly find the appropriate toilet, making it easier to ensure a clean and comfortable toilet environment. Furthermore, by utilizing the emotion engine, the system suggests the optimal toilet based on the user's level of urgency, providing a more personalized service. This increases user satisfaction.

[0833] Example prompt sentence:

[0834] "Please tell me about a system that acquires current location, searches for the nearest restroom, and provides information on cleanliness and facilities."

[0835] "Please explain in detail about the system that recognizes the user's emotions and suggests the best toilet for them."

[0836] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0837] Step 1:

[0838] Input: The user launches a toilet search app on their smartphone and allows location access.

[0839] Operation: The device's GPS function is activated and the user's current location (latitude and longitude) is obtained.

[0840] Output: The latitude and longitude of the current location is obtained.

[0841] Step 2:

[0842] Input: Latitude and longitude information of your current location.

[0843] Operation: The device sends the current location information it has acquired to the server via an HTTP POST request.

[0844] Output: Current location information is sent to the server.

[0845] Step 3:

[0846] Input: The user's current location (latitude and longitude).

[0847] How it works: The server analyzes the location information received and searches the toilet information database for the nearest toilet. It performs location-based searches using SQL queries, etc.

[0848] Output: Data including the location, cleanliness, and facilities of the nearest toilets is obtained.

[0849] Step 4:

[0850] Input: Location, cleanliness and facilities of nearest restroom.

[0851] How it works: The server converts the search results into JSON format data and sends it to the device.

[0852] Output: Toilet information in JSON format is sent to the device.

[0853] Step 5:

[0854] Input: Restroom information in JSON format.

[0855] Operation: The device analyzes the toilet information it receives and displays it on the app in a user-friendly format (map or list format).

[0856] Output: The user is shown the nearest toilet information.

[0857] Step 6:

[0858] Input: The action of the user selecting a specific toilet from a list of toilets.

[0859] Operation: The device generates request data including the ID of the selected toilet and sends it to the server.

[0860] Output: Toilet ID information is sent to the server.

[0861] Step 7:

[0862] Input: Specific restroom ID information.

[0863] How it works: The server retrieves the AR / VR data for the corresponding toilet based on the toilet ID.

[0864] Output: AR / VR data is obtained.

[0865] Step 8:

[0866] Input: AR / VR data.

[0867] Operation: The server sends the acquired AR / VR data to the device.

[0868] Output: AR / VR data is sent to the device.

[0869] Step 9:

[0870] Input: AR / VR data sent from the server.

[0871] How it works: The device analyzes the AR / VR data it receives and displays a 3D model and 360-degree image of the inside of the toilet, allowing the user to see it.

[0872] Output: The user can preview the inside of the toilet.

[0873] Step 10:

[0874] Input: User's facial and voice data.

[0875] How it works: The device's emotion engine analyzes facial and voice data to recognize the user's emotional state.

[0876] Output: The user's emotional state is recognized.

[0877] Step 11:

[0878] Input: Recognized user emotional state data.

[0879] How it works: The device sends the recognized emotional state to the server.

[0880] Output: Emotional state data is sent to the server.

[0881] Step 12:

[0882] Input: User emotional state data.

[0883] How it works: The server re-searches for the best restroom for the user based on their emotional state. For example, if the user is in a high state of urgency, it prioritizes distance, and if the user is relaxed, it prioritizes cleanliness and facilities.

[0884] Output: The best toilet information is recalculated.

[0885] Step 13:

[0886] Input: Recalculated optimal toilet information.

[0887] How it works: The server sends the best toilet information to the device.

[0888] Output: The best toilet information is sent to the device.

[0889] Step 14:

[0890] Input: Best Restroom Information.

[0891] What it does: The device will redisplay the best restroom information in the app.

[0892] Output: The best toilet information is displayed to the user.

[0893] Step 15:

[0894] Input: The action of a user entering review information (ratings, comments) on the app after using the restroom.

[0895] How it works: The device sends review information to the server.

[0896] Output: The review information is sent to the server.

[0897] Step 16:

[0898] Input: Review information submitted by the user.

[0899] Behavior: The server receives the review information, stores it in a database, and updates the rating of the restroom.

[0900] Output: The toilet rating is updated and saved in the database.

[0901] (Application example 2)

[0902] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0903] In modern society, finding and using restrooms is a serious problem for people who work in food delivery or other jobs that require long travel times. Efficient search is especially important when a user needs to find a restroom quickly or when high levels of cleanliness or special facilities are required. Furthermore, being unable to find a suitable restroom when in a hurry can lead to reduced work efficiency and stress for the user. Therefore, there is a need for a system that can provide optimal restroom information based on the user's current emotional state and quickly find a suitable restroom.

[0904] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring the user's current location, means for searching for location information of the nearest toilet based on the acquired current location, means for providing the cleanliness level and toilet facility information of the searched nearest toilet, means for recognizing the user's emotional state, and means for customizing the search results according to the user's emotional state. This makes it possible to provide optimal toilet information based on the user's current location and emotional state.

[0905] The "means for acquiring the user's current location" is a technology for identifying the user's current geographical location using a location information system (for example, GPS).

[0906] The "means for searching for the location information of the nearest toilet" is a system that searches a database for the location of the nearest toilet based on the acquired current location of the user.

[0907] "Means for providing information on the cleanliness of the toilet and toilet facilities" refers to technology that conveys to users the cleanliness of the toilet and facility information (for example, whether or not there are baby care facilities or ostomate-friendly toilets).

[0908] The "means for recognizing the user's emotional state" is a system that uses technologies such as facial expression recognition and voice analysis to identify the user's emotional state (e.g., tension, relaxation).

[0909] "Means for customizing search results" refers to technology that optimizes the toilet information provided based on the user's emotional state and current location, and presents the best options for the user.

[0910] "Means for checking the inside of a restroom in advance using AR or VR functions" refers to technology that uses augmented reality (AR) or virtual reality (VR) to allow users to visually check the inside of a restroom before actually visiting.

[0911] The "means for preferentially suggesting the nearest toilet" is a system that preferentially recommends the geographically closest toilet when a user needs to use the toilet in an emergency.

[0912] The "means for suggesting well-equipped restrooms" is a technology that recommends clean, well-equipped restrooms when a user is in a relaxed state and searching for a restroom.

[0913] "Means for collecting feedback from users and providing that information to other users" refers to a system that collects reviews and ratings from users after using the restroom and shares them with the next user.

[0914] "Means for identifying a user's emotional state using facial recognition and voice analysis" refers to technology that recognizes a user's emotions in real time by analyzing image and voice data.

[0915] The system realized based on this invention not only acquires the user's current location and provides information on the nearest restroom, but also customizes search results according to the user's emotional state to provide the most appropriate restroom information for the user. Specific details for implementing this system are described below.

[0916] Hardware and software used

[0917] Hardware: Smartphone (with GPS function), server

[0918] Software: Python, Django, GeoDjango (spatial data processing), Microsoft Azure Cognitive Services (sentiment analysis)

[0919] Get the user's current location

[0920] The device (smartphone) uses GPS to obtain the user's current location, which serves as the basis for the toilet search.

[0921] Communicating with the Server

[0922] The device sends the acquired current location information to the server. The server uses GeoDjango to search the database for information on the nearest restroom to the current location. The server also acquires information on the restroom's location, cleanliness, and facilities (including whether or not there are baby care facilities and ostomate-friendly restrooms).

[0923] Providing toilet information

[0924] The server sends the searched toilet information to the terminal, which displays it to the user as a toilet list. The user can select a specific toilet from the list and check its cleanliness and facility information.

[0925] Advance toilet check using AR / VR

[0926] When a user selects a specific restroom, the device sends the restroom's ID to the server and retrieves the corresponding AR / VR data, allowing the user to preview the interior of the restroom using AR / VR.

[0927] Use of emotion engine

[0928] The device activates an emotion engine to recognize the user's emotional state from their facial expressions and voice. This information is sent to the server, which then recommends the most appropriate restroom based on the user's emotional state. For example, if the user is in a high state of urgency, the server will prioritize the nearest restroom, while if the user is relaxed, the server will recommend a clean restroom with excellent facilities.

[0929] Post a user review

[0930] After using the restroom, users can enter a review on the app. This review information is sent from the device to the server and stored in a database. This allows the accumulation of information that will be useful when other users use the restroom.

[0931] Specific examples

[0932] If a food delivery user needs to go to the toilet suddenly, he or she opens the app and allows location information to be used. The device obtains the current location and sends this information to the server. If the system recognizes an emergency situation using the emotion engine, the nearest toilet will be displayed first.

[0933] Prompt Sentence Examples

[0934] "Search and display the nearest restroom based on your current location."

[0935] "The user's emotional state is tension, so please prioritize suggesting the nearest restroom."

[0936] This invention allows users to quickly find a suitable restroom, ensuring a comfortable environment for use. The use of an emotion engine allows the most suitable service to be provided to each individual user, thereby improving user satisfaction.

[0937] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0938] Step 1: Get the user's current location

[0939] Input: The user launches the application and allows location information to be obtained.

[0940] Data processing: The device uses the GPS function to obtain the user's current location (latitude, longitude).

[0941] Output: Latitude and longitude data of current location.

[0942] Specific operation: When a user launches the app and allows it to use location information, the device activates the GPS function to determine the user's current location.

[0943] Step 2: Send location information to the server

[0944] Input: The latitude and longitude data of the device's current location.

[0945] Data processing: The acquired location information is sent to the server.

[0946] Output: Latitude and longitude information received by the server.

[0947] Specific operation: The device uses the communication module to send current location data to the server.

[0948] Step 3: Find the nearest toilet

[0949] Input: The user's current location information received by the server.

[0950] Data processing: Use GeoDjango to search the database for toilet information (location, cleanliness, and facility information) closest to the current location.

[0951] Output: A list of nearby toilets.

[0952] Specific operation: Based on the received current location, the server executes a database query to collect information about nearby toilets.

[0953] Step 4: Providing restroom information

[0954] Input: A list of toilet information searched by the server.

[0955] Data processing: Send the toilet information list to the terminal.

[0956] Output: Toilet information list received by the device.

[0957] Specific operation: The server sends the toilet information obtained as a search result to the terminal and displays it to the user.

[0958] Step 5: Pre-check the toilets using AR / VR

[0959] Input: Toilet ID when user selects a specific toilet.

[0960] Data processing: The toilet ID is sent from the device to the server, and the corresponding AR / VR data is obtained.

[0961] Output: Captured AR / VR data.

[0962] Specific operation: Based on the toilet ID received from the server, the corresponding AR / VR data is obtained and the interior of the toilet is visually displayed to the user.

[0963] Step 6: Recognizing User Emotions

[0964] Input: User's facial expression data and voice data.

[0965] Data processing: Use Microsoft Azure Cognitive Services to analyze the user's emotional state.

[0966] Output: Parsed emotional state data.

[0967] Specific operation: The device analyzes facial expressions and voice data obtained from the user and calls an API to identify the user's emotional state.

[0968] Step 7: Toilet suggestions based on emotional state

[0969] Input: Emotional state data, and toilet information list.

[0970] Data processing: Filtering the best toilets based on your emotional state.

[0971] Output: A list of toilet information that matches the user's emotions.

[0972] Specific operation: The server receives the emotional state data and selects the most suitable toilet based on the urgency.

[0973] Step 8: Leave a review after using the restroom

[0974] Input: User review information (rating, comments).

[0975] Data processing: Review information is sent from the device to the server and stored in a database.

[0976] Output: Review information stored in a database.

[0977] Specific operation: After using the restroom, the user enters a review, which is then sent from the device to the server and saved.

[0978] In this way, through specific operations for each step, a comfortable and convenient toilet search system can be provided for the user.

[0979] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0980] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0981] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0982] [Third embodiment]

[0983] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0984] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0985] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0986] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0987] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0988] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0989] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0990] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0991] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0992] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0993] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0994] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0995] The toilet search system of the present invention acquires the user's current location and provides information on the location, cleanliness, and facilities of the nearest toilet based on that location. This system enables the user to quickly find an appropriate toilet when they suddenly feel the urge to defecate or urinate, providing a more comfortable and secure environment for going out.

[0996] System Configuration

[0997] The system consists of a user's terminal (such as a smartphone), a server, and a communication network that links these together.

[0998] 1. Obtaining the user's current location

[0999] User: Launch the toilet search app and allow it to use location information.

[1000] Device: Uses GPS to obtain the user's current location, which serves as the basis for subsequent processing.

[1001] 2. Sending a request to the server

[1002] Device: Sends the acquired current location information to the server.

[1003] Server: Receives location information and searches the database for the nearest toilet.

[1004] 3. Obtaining information about nearby toilets

[1005] Server: Obtains information on multiple toilets closest to the user's current location from the database, including toilet location information, cleanliness level, and facility information (whether or not there are baby care facilities and ostomate-friendly toilets).

[1006] Terminal: Receives the toilet information returned from the server and displays it to the user.

[1007] 4. Check restroom locations in advance using AR / VR

[1008] User: Select a specific toilet from the displayed list of toilets.

[1009] Terminal: Sends the ID of the selected toilet to the server and obtains the corresponding AR / VR data.

[1010] Server: Provides AR / VR data that allows users to see the inside of a toilet.

[1011] Terminal: Displays the acquired AR / VR data, allowing users to check the interior of the toilet in advance.

[1012] 5. Posting and saving user reviews

[1013] User: After using the restroom, enter a review on the app.

[1014] Terminal: Sends review information (user ID, toilet ID, rating, comment) to the server.

[1015] Server: Saves the review information to a database and updates the toilet's rating, allowing other users to choose a toilet based on the reviews.

[1016] Specific examples

[1017] For example, suppose a user suddenly feels the urge to defecate at a tourist spot. The user opens a toilet search app and allows the use of location information. The device obtains the current location and sends this information to the server. The server searches the database for information on the nearest toilet and sends it back to the user's device. The user selects a specific toilet from the provided list and checks its cleanliness and facilities. The user can also use AR / VR to check the interior of the toilet in advance. After using the toilet, the user enters a review in the app and sends it to the server. This review is saved in the database and can be used as reference by other users when using the toilet.

[1018] The system of the present invention allows users to quickly find a suitable toilet, making it easier to maintain a clean and comfortable toilet environment. In addition, by utilizing user reviews, it also contributes to improving the toilet environment.

[1019] The processing flow will be explained below.

[1020] Step 1:

[1021] The user launches the toilet search app and allows the use of location information.

[1022] Step 2:

[1023] The device uses the GPS function to obtain the user's current location.

[1024] Step 3:

[1025] The current location information acquired by the terminal is sent to the server.

[1026] Step 4:

[1027] The server receives the location information and accesses a database to search for restrooms near the current location.

[1028] Step 5:

[1029] The server obtains the location information, cleanliness level, and facility information (including whether or not there are baby care facilities and ostomate-friendly toilets) of the relevant toilets from the database and generates a list.

[1030] Step 6:

[1031] The server returns the generated toilet information list to the terminal.

[1032] Step 7:

[1033] The terminal displays the received toilet information list to the user.

[1034] Step 8:

[1035] The user selects a particular toilet from the displayed list of toilets.

[1036] Step 9:

[1037] The device sends the ID of the selected toilet to the server and requests the corresponding AR / VR data.

[1038] Step 10:

[1039] The server provides the requested AR / VR data of the toilet and sends it to the device.

[1040] Step 11:

[1041] The device displays the received AR / VR data, allowing users to check the interior of the toilet in advance.

[1042] Step 12:

[1043] After using the restroom, the user writes a review in the app.

[1044] Step 13:

[1045] The device sends review information (user ID, toilet ID, rating, comment) to the server.

[1046] Step 14:

[1047] The server stores the received review information in a database.

[1048] Step 15:

[1049] The server updates the toilet's rating based on the saved review information.

[1050] By repeating the above steps, the system of the present invention allows the user to always obtain the latest and most appropriate toilet information.

[1051] Example 1

[1052] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1053] Conventional toilet search systems make it difficult for users to quickly and appropriately find the nearest toilet when they suddenly feel the need to defecate or urinate. It is also difficult to check the cleanliness and facility information of the toilet beforehand, which creates the problem of not feeling at ease until actually using the toilet. Furthermore, there has been no effective system that properly collects user reviews after using the toilet and allows other users to refer to those reviews.

[1054] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1055] In this invention, the server includes means for acquiring the user's current location, means for searching for location information, cleanliness level, and facility information of the nearest toilet based on the acquired current location, means for displaying the searched toilet information on the user's terminal, means for providing augmented reality or virtual reality data that allows the user to check the interior of the selected toilet in advance, and means for inputting user reviews after using the toilet, sending the reviews to the server, and storing them in a database. This allows users to quickly find the nearest toilet, check the cleanliness level and facilities, and check the interior of the toilet in advance. A system is also realized that collects reviews after using the toilet, allowing other users to refer to the reviews.

[1056] "Current location" is information about the latitude and longitude of the user's current location, obtained using the GPS function of the device used by the user.

[1057] A "server" is a computer system that receives requests from user terminals via a network, performs the necessary processing, and provides information.

[1058] A "terminal" is an electronic device used by a user, such as a computer, smartphone, or tablet.

[1059] "Toilet location information" is latitude and longitude data that indicates the specific location of the nearest toilet.

[1060] "Cleanliness" is information that indicates an evaluation of the cleanliness and sanitary condition of the toilet.

[1061] "Facility information" refers to facility information such as whether or not the restroom has baby care facilities or an ostomate-friendly toilet.

[1062] "AR" stands for augmented reality, a technology that displays computer-generated information overlaid on real-world scenery.

[1063] "VR" stands for virtual reality, a technology that allows you to experience a computer-generated virtual environment.

[1064] A "database" is a system for efficiently managing a collection of data and performing operations such as searching, saving, and updating.

[1065] A "review" is a detailed description of a user's impressions and evaluations after using a toilet.

[1066] The toilet search system of the present invention acquires the user's current location and provides information on the location, cleanliness, and facilities of the nearest toilet based on that location. The system aims to enable users to quickly find an appropriate toilet when they suddenly feel the urge to defecate or urinate, providing an environment in which they can go out more comfortably and safely.

[1067] System configuration

[1068] The system consists of a user's terminal (such as a smartphone), a server, and a communication network that links these together.

[1069] Get the user's current location

[1070] The user launches the toilet search app and allows the app to use location information. The device uses its GPS function to obtain the user's current location. Specifically, the LocationManager API is used on the Android platform, and the CoreLocation framework is used on the iOS platform. The obtained location information is sent to the server in JSON format.

[1071] Sending a request to the server

[1072] The device sends an HTTP POST request containing its current location data to the server, which sends the location information via a REST API to an endpoint such as "https: / / example.com / api / nearest_toilets," which causes the server to make a database query to find the nearest toilets.

[1073] Obtaining information about nearby toilets

[1074] The server retrieves information about the nearest restroom from a MySQL database based on the user's location. The retrieved information includes the restroom's location, cleanliness, baby care facilities, and whether or not it has an ostomate-friendly restroom. The retrieved information is then returned to the user's device in JSON format.

[1075] Advance toilet check using AR / VR

[1076] The user selects a specific toilet from a provided list. The device then sends the selected toilet's ID to the server, which then provides the corresponding AR / VR data. This data is generated using frameworks such as Unity, ARKit, and ARCore. The user can check the interior of the toilet in advance on their device, including a 360-degree view.

[1077] Posting and saving user reviews

[1078] After using the restroom, users enter a review on the app. The review includes a star rating and comments, and the device sends it to the server as an HTTP POST request. The server saves the review information in a database and updates the restroom's rating. This allows other users to use the review as a reference when choosing a restroom.

[1079] Specific examples

[1080] For example, if a user suddenly feels the need to defecate at a tourist spot, the user launches a restroom search app and agrees to a prompt to allow the use of location information. The following prompt is displayed: "Please obtain the location information of restrooms." If the user selects permission, the device obtains the current location and sends it to the server. The server searches for the nearest restroom information and sends it back to the user's device. The user selects a specific restroom from the displayed list and checks its cleanliness and facilities. The user can also use the AR / VR function to check the interior of the restroom in advance. The user then uses the restroom, enters a review in the app, and sends it to the server. This review is stored in a database and can be used as reference by other users when using the restroom.

[1081] This invention allows users to quickly find a suitable toilet and ensure a clean and comfortable toilet environment. Furthermore, by utilizing user reviews, it contributes to improving the quality of toilets.

[1082] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1083] Step 1:

[1084] The user launches the toilet search app and allows it to use location information.

[1085] Input: User launches app and agrees to location permission prompt

[1086] How it works: When a user launches the toilet search app on their smartphone, a prompt appears asking for permission to use location information. If the user selects "Allow," a notification is sent to the device.

[1087] Output: A flag indicating permission was granted

[1088] Step 2:

[1089] The device obtains the user's current location

[1090] Input: Location permission flag

[1091] Behavior: The device activates the GPS function and obtains the current latitude and longitude using the LocationManager API on Android and CoreLocation on iOS.

[1092] Output: Current location (latitude and longitude)

[1093] Step 3:

[1094] The device sends its current location to the server

[1095] Input: Current location information (latitude and longitude)

[1096] Operation: The device sends the acquired latitude and longitude in JSON format to the server as an HTTP POST request. The Uri is, for example, "https: / / example.com / api / nearest_toilets".

[1097] Output: Result status of request sent to server

[1098] Step 4:

[1099] The server searches for information about the nearest toilet

[1100] Input: User's current location (latitude and longitude)

[1101] How it works: Based on the current location received, the server queries a MySQL database to find the nearest restrooms, including their location, cleanliness, and amenities.

[1102] Output: Toilet information (location, cleanliness, facility information)

[1103] Step 5:

[1104] The server sends the toilet information to the terminal.

[1105] Input: Nearest toilet information (location, cleanliness, facilities information)

[1106] How it works: The server converts the acquired toilet information into JSON format and sends it to the user's device as an HTTP response.

[1107] Output: Toilet information in JSON format

[1108] Step 6:

[1109] The device analyzes the toilet information and displays it to the user

[1110] Input: JSON format toilet information received from the server

[1111] How it works: The device parses the received JSON data and displays the location, cleanliness, and facility information of the toilets in a list format on the app screen.

[1112] Output: A list of toilets available to the user

[1113] Step 7:

[1114] User selects a specific restroom and requests AR / VR data

[1115] Input: The ID of the toilet selected by the user

[1116] How it works: When a user selects a specific toilet from the displayed list, the device sends an HTTP POST request including the toilet's ID to the server, requesting AR / VR data.

[1117] Output: AR / VR data request to the server

[1118] Step 8:

[1119] The server provides AR / VR data for the specified toilet.

[1120] Input: The ID of the toilet selected by the user

[1121] How it works: The server retrieves AR / VR data corresponding to the toilet ID from the database and sends this data to the user's device. This data is generated using Unity or ARKit / ARCore.

[1122] Output: AR / VR data

[1123] Step 9:

[1124] The device analyzes the AR / VR data and displays it to the user

[1125] Input: AR / VR data received from the server

[1126] How it works: The device analyzes the received AR / VR data and displays the interior of the toilet to the user in a 360-degree view or augmented reality.

[1127] Output: Display AR / VR view

[1128] Step 10:

[1129] A user uses the restroom and writes a review

[1130] Input: User review information (user ID, toilet ID, rating, comment)

[1131] How it works: After using the restroom, the user enters a review in the app, including a rating and comment.

[1132] Output: Review completed flag

[1133] Step 11:

[1134] The device sends the review information to the server

[1135] Input: Review information (user ID, toilet ID, rating, comment)

[1136] How it works: The device sends the review information to the server as an HTTP POST request.

[1137] Output: Result status of review data sent to the server

[1138] Step 12:

[1139] The server saves the review to a database and updates the restroom's rating.

[1140] Input: Review information submitted by the user

[1141] Operation: The server saves the received review information in a database and updates the rating information of the toilet, allowing other users to use the rating information when selecting a toilet.

[1142] Output: Status of review saved to database

[1143] (Application example 1)

[1144] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1145] When food delivery partners suddenly need to defecate or urinate while on the job, it is difficult to quickly find a suitable restroom, which impairs work efficiency and a comfortable working environment. In addition, there is no way to check the cleanliness or facility information of the restroom in advance, which can make users feel uneasy.

[1146] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1147] In this invention, the server includes means for acquiring the user's current location, means for searching for location information of the nearest restroom based on the acquired current location, means for providing information on the cleanliness and facilities of the searched nearest restroom, means for allowing the interior of the searched restroom to be checked in advance using an AR or VR function, and means for inputting and sending reviews of the restroom used. This enables food delivery partners to quickly find an appropriate restroom even while on the job and use it with peace of mind, improving work efficiency and a comfortable working environment.

[1148] "User" refers to a food delivery partner and a user who uses this system to search for a toilet.

[1149] "Means for acquiring the current location" refers to a technology that uses a GPS function to identify the user's current location.

[1150] The "means for searching for location information of the nearest toilet" is a technology that searches a database for the location of nearby toilets based on the user's current location.

[1151] "Means for providing information on the cleanliness of toilets and toilet facilities" refers to a technology that provides users with information on the cleanliness and facilities (such as the presence or absence of baby care facilities and ostomate-friendly toilets) of the toilets that have been searched for.

[1152] "A means for checking the interior of the searched toilet in advance using AR or VR functions" is a system that allows users to visually check the interior of the toilet they specify in advance using augmented reality (AR) or virtual reality (VR) technology.

[1153] "Means for inputting and transmitting reviews of toilets used" refers to a technology that allows users to input reviews about the toilet's usability and cleanliness after using it, and transmit these to a server.

[1154] The restroom search system for food delivery partners of the present invention acquires the user's current location and provides information on the location, cleanliness, and facilities of the nearest restroom based on that location. This system enables users to quickly find an appropriate restroom when they suddenly need to defecate or urinate, improving the efficiency of delivery work and providing a comfortable working environment.

[1155] System Configuration

[1156] The system consists of a user terminal (such as a smartphone), a server, and a communication network that connects them. Specific examples of hardware and software are as follows:

[1157] 1. User Device

[1158] Hardware: Smartphone (with GPS function)

[1159] Software: Mobile app development frameworks (React Native, Flutter, etc.)

[1160] 2. Server

[1161] Software: Node.js, Express

[1162] Database: MongoDB, PostgreSQL

[1163] AR / VR libraries: Unity, ARKit, ARCore

[1164] System Operation

[1165] 1. Obtaining the user's current location

[1166] User: Launch the toilet search app and allow it to use location information.

[1167] Device: Uses GPS to obtain the user's current location, which serves as the basis for subsequent processing.

[1168] 2. Sending a request to the server

[1169] Device: Sends the acquired current location information to the server.

[1170] Server: Receives location information and searches the database for the nearest toilet.

[1171] 3. Obtaining information about nearby toilets

[1172] Server: Obtains information on multiple toilets closest to the user's current location from the database, including toilet location information, cleanliness level, and facility information (whether or not there are baby care facilities and ostomate-friendly toilets).

[1173] Terminal: Receives the toilet information returned from the server and displays it to the user.

[1174] 4. Check restroom locations in advance using AR / VR

[1175] User: Select a specific toilet from the displayed list of toilets.

[1176] Terminal: Sends the ID of the selected toilet to the server and obtains the corresponding AR / VR data.

[1177] Server: Provides AR / VR data that allows users to see the inside of a toilet.

[1178] Terminal: Displays the acquired AR / VR data, allowing users to check the interior of the toilet in advance.

[1179] 5. Posting and saving user reviews

[1180] User: After using the restroom, enter a review on the app.

[1181] Terminal: Sends review information (user ID, toilet ID, rating, comment) to the server.

[1182] Server: Saves the review information to a database and updates the toilet's rating, allowing other users to choose a toilet based on the reviews.

[1183] Specific examples

[1184] For example, if a delivery partner suddenly needs to go to the bathroom while delivering food, they can open a restroom search app and submit their location information. The app will then display the nearest clean restroom. Delivery partners can use the AR / VR function to check the interior of the restroom in advance, allowing them to use it with peace of mind. They can then post a review, which other delivery partners can use as a reference.

[1185] Example prompts to input to the generative AI model

[1186] "Describe a restroom finder app that helps delivery partners quickly find a clean restroom when they suddenly need to go to the bathroom while at work."

[1187] By using this prompt, the generative AI model can provide more detailed explanations of specific applications and usage scenarios.

[1188] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1189] Step 1:

[1190] Get the user's current location

[1191] Input: The user launches the toilet search app and allows it to use location information.

[1192] Processing: The device acquires the current location information using the smartphone's GPS function. The acquired current location information is stored in a variable within the program.

[1193] Output: Current location information (latitude, longitude).

[1194] Step 2:

[1195] Sending a request to the server

[1196] Input: Current location information obtained in step 1.

[1197] Processing: The current location information acquired by the device is sent to the server using the REST API.

[1198] Output: The request to the server.

[1199] Step 3:

[1200] Obtaining information about nearby toilets

[1201] Input: Current location information sent to the server in step 2.

[1202] Processing: Based on the current location information received by the server, search the database for the nearest toilet information (location, cleanliness level, facility information). Prepare the search results in JSON format.

[1203] Output: Nearest toilet information (JSON format).

[1204] Step 4:

[1205] Receiving and displaying toilet information

[1206] Input: Nearest toilet information sent from the server in step 3.

[1207] Processing: The device receives the response from the server and displays the toilet information on the app screen.

[1208] Output: A list of toilets that the user can check.

[1209] Step 5:

[1210] Advance toilet check using AR / VR

[1211] Input: The user selects a specific toilet from a list of toilets.

[1212] Processing: The device sends the ID of the selected restroom to the server and requests the corresponding AR / VR data. The server receives this request, retrieves the corresponding AR / VR data from the database, and sends it to the device. The AR / VR data received by the device is displayed on the app screen.

[1213] Output: AR / VR data display of the toilet.

[1214] Step 6:

[1215] Posting and saving user reviews

[1216] Input: The user enters a review (rating, comments) after using the toilet.

[1217] Processing: The terminal sends the entered review information (user ID, restroom ID, rating, comment) to the server. The server saves the received review information in the database and updates the existing restroom rating data.

[1218] Output: Saves review information to a database and updates ratings.

[1219] The above steps will create a system that allows food delivery partners to find suitable restrooms with peace of mind and obtain information quickly and reliably.

[1220] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1221] The toilet search system of the present invention acquires the user's current location and provides information on the location, cleanliness, and facilities of the nearest toilet based on that location. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the system customizes the toilet search results according to the user's emotional state. This allows the user to quickly find a more comfortable and suitable toilet.

[1222] System Configuration

[1223] The system consists of a user's device (such as a smartphone), a server, an emotion engine, and a communication network that connects these.

[1224] 1. Obtaining the user's current location

[1225] User: Launch the toilet search app and allow it to use location information.

[1226] Device: Uses GPS to obtain the user's current location, which serves as the basis for subsequent processing.

[1227] 2. Sending a request to the server

[1228] Device: Sends the acquired current location information to the server.

[1229] Server: Receives location information and searches the database for the nearest toilet.

[1230] 3. Obtaining information about nearby toilets

[1231] Server: Obtains information on multiple toilets closest to the user's current location from the database, including toilet location information, cleanliness level, and facility information (whether or not there are baby care facilities and ostomate-friendly toilets).

[1232] Terminal: Receives the toilet information returned from the server and displays it to the user.

[1233] 4. Check restroom locations in advance using AR / VR

[1234] User: Select a specific toilet from the displayed list of toilets.

[1235] Terminal: Sends the ID of the selected toilet to the server and obtains the corresponding AR / VR data.

[1236] Server: Provides AR / VR data that allows users to see the inside of a toilet.

[1237] Terminal: Displays the acquired AR / VR data, allowing users to check the interior of the toilet in advance.

[1238] 5. Posting and saving user reviews

[1239] User: After using the restroom, enter a review on the app.

[1240] Terminal: Sends review information (user ID, toilet ID, rating, comment) to the server.

[1241] Server: Saves the review information to a database and updates the restroom's rating.

[1242] 6. Use of Emotion Engines

[1243] The device runs an emotion engine to recognize the user's emotions. This emotion engine analyzes inputs such as facial expressions and voice to identify the user's emotional state.

[1244] Terminal: Sends the recognized emotional state to the server.

[1245] Server: Recommends the best restroom based on the user's emotional state. For example, if the user is in a high state of urgency, it will prioritize the nearest restroom, while if the user is relaxed, it will recommend a clean restroom with good facilities.

[1246] Server: Sends the search results for suitable toilets to the terminal and displays them to the user.

[1247] Specific examples

[1248] For example, suppose a user suddenly feels the urge to defecate in a busy downtown area. The user opens a toilet search app and allows the use of location information. The device obtains the current location and sends this information to the server. The server searches the database for the nearest toilet information and sends it back to the user's device. The user selects a specific toilet from the provided list and checks its cleanliness and facilities. The user can also use AR / VR to check the interior of the toilet in advance.

[1249] Furthermore, the device's emotion engine recognizes the user's emotions from their facial expressions and voice, and sends that information to the server. If the user is feeling nervous, toilets with high urgency will be suggested first, and after using the toilet, the user can leave a review and rate it. This allows the accumulation of information that will be useful to other users.

[1250] The system of the present invention allows users to quickly find a suitable restroom, making it easier to maintain a clean and comfortable restroom environment. Furthermore, by utilizing the emotion engine, the system can suggest the most suitable restroom based on the user's level of urgency, providing a more personalized service. This can increase user satisfaction.

[1251] The processing flow will be explained below.

[1252] Step 1:

[1253] The user launches the toilet search app and allows the use of location information.

[1254] Step 2:

[1255] The device uses the GPS function to obtain the user's current location.

[1256] Step 3:

[1257] The current location information acquired by the terminal is sent to the server.

[1258] Step 4:

[1259] The server receives the location information and accesses a database to search for restrooms near the current location.

[1260] Step 5:

[1261] The server obtains the location information, cleanliness level, and facility information (including whether or not there are baby care facilities and ostomate-friendly toilets) of the relevant toilets from the database and generates a list.

[1262] Step 6:

[1263] The server returns the generated toilet information list to the terminal.

[1264] Step 7:

[1265] The terminal displays the received toilet information list to the user.

[1266] Step 8:

[1267] The user selects a particular toilet from the displayed list of toilets.

[1268] Step 9:

[1269] The device sends the ID of the selected toilet to the server and requests the corresponding AR / VR data.

[1270] Step 10:

[1271] The server provides the requested AR / VR data of the toilet and sends it to the device.

[1272] Step 11:

[1273] The device displays the received AR / VR data, allowing users to check the interior of the toilet in advance.

[1274] Step 12:

[1275] After using the restroom, the user writes a review in the app.

[1276] Step 13:

[1277] The device sends review information (user ID, toilet ID, rating, comment) to the server.

[1278] Step 14:

[1279] The server stores the review information in a database.

[1280] Step 15:

[1281] The server updates the toilet's rating based on the saved review information.

[1282] Step 16:

[1283] The device activates an emotion engine to recognize the user's emotions. This emotion engine analyzes inputs such as the user's facial expressions and voice to identify the user's emotional state.

[1284] Step 17:

[1285] The device transmits the recognized emotional state to the server.

[1286] Step 18:

[1287] The server will suggest the best restroom based on the user's emotional state. For example, if the user is in a high state of urgency, it will prioritize the nearest restroom, while if the user is relaxed, it will recommend a clean restroom with good facilities.

[1288] Step 19:

[1289] The server sends the search results for suitable toilets to the terminal and displays them to the user.

[1290] By repeating the above steps, the system of the present invention allows users to always obtain the latest and most appropriate toilet information. By providing highly directional information, it is possible to meet the diverse needs of users.

[1291] Example 2

[1292] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1293] There is a demand for a system that allows users to find restrooms quickly and comfortably, but conventional restroom search systems simply provide location information and basic information without considering the user's condition. This makes it difficult to find the best restroom for an emergency or specific situation. Furthermore, since users cannot check the interior of the restroom in advance, it is difficult for users to choose a restroom they can use with confidence. This issue needs to be resolved.

[1294] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1295] In this invention, the server includes a means for acquiring the user's current location, a means for searching for the location information of the nearest restroom based on the acquired current location, a means for providing the cleanliness level and facility information of the searched nearest restroom, a means for analyzing the user's emotional state, and a means for suggesting the most suitable restroom based on the analyzed emotional state. This allows the user to quickly find the most suitable restroom based on their emotional state and level of urgency. Furthermore, the interior can be checked in advance using AR and VR functions, providing even greater peace of mind.

[1296] The "means for acquiring the user's current location" refers to a device or software that acquires the user's current location information using the user's mobile device or GPS function.

[1297] The "means for searching for the location information of the nearest toilet based on the acquired current location" is a processing device or software that searches for and provides the location information of the toilet closest to the user from a database based on the acquired location information.

[1298] "Means for providing information on the cleanliness of the nearest toilets found in a search and on the facilities of the toilets" refers to a device or software that provides users with information on the cleanliness of the toilets found in the search results and on the facilities (such as whether or not they have baby care facilities or ostomate-friendly toilets).

[1299] The "means for analyzing the user's emotional state" is a device or software for analyzing the user's facial expressions and voice to identify the user's current emotional state.

[1300] The "means for suggesting the most suitable toilet based on the analyzed emotional state" is a processing device or software for suggesting the most suitable toilet to the user based on the analyzed emotional state.

[1301] "Baby care facilities" are facilities for caring for infants and young children (for example, diaper changing tables and breastfeeding spaces).

[1302] An "ostomate-friendly toilet" is a toilet facility designed to be comfortable for people with a stoma.

[1303] The "AR function" is a technology that uses augmented reality technology to overlay digital information on real-world toilet information.

[1304] The "VR function" is a technology that uses virtual reality technology to allow users to virtually experience the inside of a toilet through 360-degree video and other means.

[1305] The restroom search system according to the present invention is composed of a user's terminal (such as a smartphone), a server, an emotion engine, and a communication network linking these together.

[1306] First, the user launches the toilet search app on their smartphone and allows the app to use their location information. At this time, the device uses its built-in GPS to obtain the user's current location. The obtained location information is then sent by the device to a server, which then searches a database for information on the nearest toilet based on the received location information.

[1307] The server retrieves information on multiple toilets closest to the user's current location from the database. This information includes the toilet's location, cleanliness, whether it has baby care facilities, and whether it has an ostomate-friendly toilet. The retrieved toilet information is then sent back to the terminal and displayed to the user.

[1308] The user can select a specific toilet from the displayed list. At that time, the device sends the selected toilet's ID to the server, and the server retrieves the toilet's AR / VR data and sends it back to the device. This allows the user to check the interior of the toilet in advance.

[1309] The system also includes an emotion engine. The emotion engine installed in the device analyzes the user's facial expressions and voice to recognize their emotional state. The recognized emotional state is sent to the server, which then uses that information to suggest the most suitable restroom. For example, if the user is nervous, a restroom with a high level of urgency will be suggested first. On the other hand, if the user is relaxed, a restroom that is clean and well-equipped will be recommended. The server recalculates the search results for suitable restrooms, sends them to the device, and displays them to the user.

[1310] As a concrete example, consider a case where a user suddenly feels the urge to defecate in a busy downtown area. The user opens a restroom search app on their smartphone and allows the use of location information. The device obtains their current location and sends that information to the server. The server then searches the database for information about the nearest restroom and sends it back to the user's device. The user selects a specific restroom from the provided list and checks its cleanliness and facilities. The user can also use the AR / VR function to check the interior of the restroom in advance.

[1311] Furthermore, the device's emotion engine recognizes the user's emotions from their facial expressions and voice, and sends this information to the server. If the user is nervous, toilets with a high level of urgency are suggested first, and after using the toilet, the user can leave a review and rate it. This accumulates information that is also useful for other users. This system allows users to quickly find the appropriate toilet, making it easier to ensure a clean and comfortable toilet environment. Furthermore, by utilizing the emotion engine, the system suggests the optimal toilet based on the user's level of urgency, providing a more personalized service. This increases user satisfaction.

[1312] Example prompt sentence:

[1313] "Please tell me about a system that acquires current location, searches for the nearest restroom, and provides information on cleanliness and facilities."

[1314] "Please explain in detail about the system that recognizes the user's emotions and suggests the best toilet for them."

[1315] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1316] Step 1:

[1317] Input: The user launches a toilet search app on their smartphone and allows location access.

[1318] Operation: The device's GPS function is activated and the user's current location (latitude and longitude) is obtained.

[1319] Output: The latitude and longitude of the current location is obtained.

[1320] Step 2:

[1321] Input: Latitude and longitude information of your current location.

[1322] Operation: The device sends the current location information it has acquired to the server via an HTTP POST request.

[1323] Output: Current location information is sent to the server.

[1324] Step 3:

[1325] Input: The user's current location (latitude and longitude).

[1326] How it works: The server analyzes the location information received and searches the toilet information database for the nearest toilet. It performs location-based searches using SQL queries, etc.

[1327] Output: Data including the location, cleanliness, and facilities of the nearest toilets is obtained.

[1328] Step 4:

[1329] Input: Location, cleanliness and facilities of nearest restroom.

[1330] How it works: The server converts the search results into JSON format data and sends it to the device.

[1331] Output: Toilet information in JSON format is sent to the device.

[1332] Step 5:

[1333] Input: Restroom information in JSON format.

[1334] Operation: The device analyzes the toilet information it receives and displays it on the app in a user-friendly format (map or list format).

[1335] Output: The user is shown the nearest toilet information.

[1336] Step 6:

[1337] Input: The action of the user selecting a specific toilet from a list of toilets.

[1338] Operation: The device generates request data including the ID of the selected toilet and sends it to the server.

[1339] Output: Toilet ID information is sent to the server.

[1340] Step 7:

[1341] Input: Specific restroom ID information.

[1342] How it works: The server retrieves the AR / VR data for the corresponding toilet based on the toilet ID.

[1343] Output: AR / VR data is obtained.

[1344] Step 8:

[1345] Input: AR / VR data.

[1346] Operation: The server sends the acquired AR / VR data to the device.

[1347] Output: AR / VR data is sent to the device.

[1348] Step 9:

[1349] Input: AR / VR data sent from the server.

[1350] How it works: The device analyzes the AR / VR data it receives and displays a 3D model and 360-degree image of the inside of the toilet, allowing the user to see it.

[1351] Output: The user can preview the inside of the toilet.

[1352] Step 10:

[1353] Input: User's facial and voice data.

[1354] How it works: The device's emotion engine analyzes facial and voice data to recognize the user's emotional state.

[1355] Output: The user's emotional state is recognized.

[1356] Step 11:

[1357] Input: Recognized user emotional state data.

[1358] How it works: The device sends the recognized emotional state to the server.

[1359] Output: Emotional state data is sent to the server.

[1360] Step 12:

[1361] Input: User emotional state data.

[1362] How it works: The server re-searches for the best restroom for the user based on their emotional state. For example, if the user is in a high state of urgency, it prioritizes distance, and if the user is relaxed, it prioritizes cleanliness and facilities.

[1363] Output: The best toilet information is recalculated.

[1364] Step 13:

[1365] Input: Recalculated optimal toilet information.

[1366] How it works: The server sends the best toilet information to the device.

[1367] Output: The best toilet information is sent to the device.

[1368] Step 14:

[1369] Input: Best Restroom Information.

[1370] What it does: The device will redisplay the best restroom information in the app.

[1371] Output: The best toilet information is displayed to the user.

[1372] Step 15:

[1373] Input: The action of a user entering review information (ratings, comments) on the app after using the restroom.

[1374] How it works: The device sends review information to the server.

[1375] Output: The review information is sent to the server.

[1376] Step 16:

[1377] Input: Review information submitted by the user.

[1378] Behavior: The server receives the review information, stores it in a database, and updates the rating of the restroom.

[1379] Output: The toilet rating is updated and saved in the database.

[1380] (Application example 2)

[1381] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1382] In modern society, finding and using restrooms is a serious problem for people who work in food delivery or other jobs that require long travel times. Efficient search is especially important when a user needs to find a restroom quickly or when high levels of cleanliness or special facilities are required. Furthermore, being unable to find a suitable restroom when in a hurry can lead to reduced work efficiency and stress for the user. Therefore, there is a need for a system that can provide optimal restroom information based on the user's current emotional state and quickly find a suitable restroom.

[1383] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring the user's current location, means for searching for location information of the nearest toilet based on the acquired current location, means for providing the cleanliness level and toilet facility information of the searched nearest toilet, means for recognizing the user's emotional state, and means for customizing the search results according to the user's emotional state. This makes it possible to provide optimal toilet information based on the user's current location and emotional state.

[1384] The "means for acquiring the user's current location" is a technology for identifying the user's current geographical location using a location information system (for example, GPS).

[1385] The "means for searching for the location information of the nearest toilet" is a system that searches a database for the location of the nearest toilet based on the acquired current location of the user.

[1386] "Means for providing information on the cleanliness of the toilet and toilet facilities" refers to technology that conveys to users the cleanliness of the toilet and facility information (for example, whether or not there are baby care facilities or ostomate-friendly toilets).

[1387] The "means for recognizing the user's emotional state" is a system that uses technologies such as facial expression recognition and voice analysis to identify the user's emotional state (e.g., tension, relaxation).

[1388] "Means for customizing search results" refers to technology that optimizes the toilet information provided based on the user's emotional state and current location, and presents the best options for the user.

[1389] "Means for checking the inside of a restroom in advance using AR or VR functions" refers to technology that uses augmented reality (AR) or virtual reality (VR) to allow users to visually check the inside of a restroom before actually visiting.

[1390] The "means for preferentially suggesting the nearest toilet" is a system that preferentially recommends the geographically closest toilet when a user needs to use the toilet in an emergency.

[1391] The "means for suggesting well-equipped restrooms" is a technology that recommends clean, well-equipped restrooms when a user is in a relaxed state and searching for a restroom.

[1392] "Means for collecting feedback from users and providing that information to other users" refers to a system that collects reviews and ratings from users after using the restroom and shares them with the next user.

[1393] "Means for identifying a user's emotional state using facial recognition and voice analysis" refers to technology that recognizes a user's emotions in real time by analyzing image and voice data.

[1394] The system realized based on this invention not only acquires the user's current location and provides information on the nearest restroom, but also customizes search results according to the user's emotional state to provide the most appropriate restroom information for the user. Specific details for implementing this system are described below.

[1395] Hardware and software used

[1396] Hardware: Smartphone (with GPS function), server

[1397] Software: Python, Django, GeoDjango (spatial data processing), Microsoft Azure Cognitive Services (sentiment analysis)

[1398] Get the user's current location

[1399] The device (smartphone) uses GPS to obtain the user's current location, which serves as the basis for the toilet search.

[1400] Communicating with the Server

[1401] The device sends the acquired current location information to the server. The server uses GeoDjango to search the database for information on the nearest restroom to the current location. The server also acquires information on the restroom's location, cleanliness, and facilities (including whether or not there are baby care facilities and ostomate-friendly restrooms).

[1402] Providing toilet information

[1403] The server sends the searched toilet information to the terminal, which displays it to the user as a toilet list. The user can select a specific toilet from the list and check its cleanliness and facility information.

[1404] Advance toilet check using AR / VR

[1405] When a user selects a specific restroom, the device sends the restroom's ID to the server and retrieves the corresponding AR / VR data, allowing the user to preview the interior of the restroom using AR / VR.

[1406] Use of emotion engine

[1407] The device activates an emotion engine to recognize the user's emotional state from their facial expressions and voice. This information is sent to the server, which then recommends the most appropriate restroom based on the user's emotional state. For example, if the user is in a high state of urgency, the server will prioritize the nearest restroom, while if the user is relaxed, the server will recommend a clean restroom with excellent facilities.

[1408] Post a user review

[1409] After using the restroom, users can enter a review on the app. This review information is sent from the device to the server and stored in a database. This allows the accumulation of information that will be useful when other users use the restroom.

[1410] Specific examples

[1411] If a food delivery user needs to go to the toilet suddenly, he or she opens the app and allows location information to be used. The device obtains the current location and sends this information to the server. If the system recognizes an emergency situation using the emotion engine, the nearest toilet will be displayed first.

[1412] Prompt Sentence Examples

[1413] "Search and display the nearest restroom based on your current location."

[1414] "The user's emotional state is tension, so please prioritize suggesting the nearest restroom."

[1415] This invention allows users to quickly find a suitable restroom, ensuring a comfortable environment for use. The use of an emotion engine allows the most suitable service to be provided to each individual user, thereby improving user satisfaction.

[1416] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1417] Step 1: Get the user's current location

[1418] Input: The user launches the application and allows location information to be obtained.

[1419] Data processing: The device uses the GPS function to obtain the user's current location (latitude, longitude).

[1420] Output: Latitude and longitude data of current location.

[1421] Specific operation: When a user launches the app and allows it to use location information, the device activates the GPS function to determine the user's current location.

[1422] Step 2: Send location information to the server

[1423] Input: The latitude and longitude data of the device's current location.

[1424] Data processing: The acquired location information is sent to the server.

[1425] Output: Latitude and longitude information received by the server.

[1426] Specific operation: The device uses the communication module to send current location data to the server.

[1427] Step 3: Find the nearest toilet

[1428] Input: The user's current location information received by the server.

[1429] Data processing: Use GeoDjango to search the database for toilet information (location, cleanliness, and facility information) closest to the current location.

[1430] Output: A list of nearby toilets.

[1431] Specific operation: Based on the received current location, the server executes a database query to collect information about nearby toilets.

[1432] Step 4: Providing restroom information

[1433] Input: A list of toilet information searched by the server.

[1434] Data processing: Send the toilet information list to the terminal.

[1435] Output: Toilet information list received by the device.

[1436] Specific operation: The server sends the toilet information obtained as a search result to the terminal and displays it to the user.

[1437] Step 5: Pre-check the toilets using AR / VR

[1438] Input: Toilet ID when user selects a specific toilet.

[1439] Data processing: The toilet ID is sent from the device to the server, and the corresponding AR / VR data is obtained.

[1440] Output: Captured AR / VR data.

[1441] Specific operation: Based on the toilet ID received from the server, the corresponding AR / VR data is obtained and the interior of the toilet is visually displayed to the user.

[1442] Step 6: Recognizing User Emotions

[1443] Input: User's facial expression data and voice data.

[1444] Data processing: Use Microsoft Azure Cognitive Services to analyze the user's emotional state.

[1445] Output: Parsed emotional state data.

[1446] Specific operation: The device analyzes facial expressions and voice data obtained from the user and calls an API to identify the user's emotional state.

[1447] Step 7: Toilet suggestions based on emotional state

[1448] Input: Emotional state data, and toilet information list.

[1449] Data processing: Filtering the best toilets based on your emotional state.

[1450] Output: A list of toilet information that matches the user's emotions.

[1451] Specific operation: The server receives the emotional state data and selects the most suitable toilet based on the urgency.

[1452] Step 8: Leave a review after using the restroom

[1453] Input: User review information (rating, comments).

[1454] Data processing: Review information is sent from the device to the server and stored in a database.

[1455] Output: Review information stored in a database.

[1456] Specific operation: After using the restroom, the user enters a review, which is then sent from the device to the server and saved.

[1457] In this way, through specific operations for each step, a comfortable and convenient toilet search system can be provided for the user.

[1458] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1459] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1460] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1461] [Fourth embodiment]

[1462] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1463] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1464] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1465] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1466] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1467] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1468] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1469] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1470] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1471] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1472] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1473] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1474] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1475] The toilet search system of the present invention acquires the user's current location and provides information on the location, cleanliness, and facilities of the nearest toilet based on that location. This system enables the user to quickly find an appropriate toilet when they suddenly feel the urge to defecate or urinate, providing a more comfortable and secure environment for going out.

[1476] System Configuration

[1477] The system consists of a user's terminal (such as a smartphone), a server, and a communication network that links these together.

[1478] 1. Obtaining the user's current location

[1479] User: Launch the toilet search app and allow it to use location information.

[1480] Device: Uses GPS to obtain the user's current location, which serves as the basis for subsequent processing.

[1481] 2. Sending a request to the server

[1482] Device: Sends the acquired current location information to the server.

[1483] Server: Receives location information and searches the database for the nearest toilet.

[1484] 3. Obtaining information about nearby toilets

[1485] Server: Obtains information on multiple toilets closest to the user's current location from the database, including toilet location information, cleanliness level, and facility information (whether or not there are baby care facilities and ostomate-friendly toilets).

[1486] Terminal: Receives the toilet information returned from the server and displays it to the user.

[1487] 4. Check restroom locations in advance using AR / VR

[1488] User: Select a specific toilet from the displayed list of toilets.

[1489] Terminal: Sends the ID of the selected toilet to the server and obtains the corresponding AR / VR data.

[1490] Server: Provides AR / VR data that allows users to see the inside of a toilet.

[1491] Terminal: Displays the acquired AR / VR data, allowing users to check the interior of the toilet in advance.

[1492] 5. Posting and saving user reviews

[1493] User: After using the restroom, enter a review on the app.

[1494] Terminal: Sends review information (user ID, toilet ID, rating, comment) to the server.

[1495] Server: Saves the review information to a database and updates the toilet's rating, allowing other users to choose a toilet based on the reviews.

[1496] Specific examples

[1497] For example, suppose a user suddenly feels the urge to defecate at a tourist spot. The user opens a toilet search app and allows the use of location information. The device obtains the current location and sends this information to the server. The server searches the database for information on the nearest toilet and sends it back to the user's device. The user selects a specific toilet from the provided list and checks its cleanliness and facilities. The user can also use AR / VR to check the interior of the toilet in advance. After using the toilet, the user enters a review in the app and sends it to the server. This review is saved in the database and can be used as reference by other users when using the toilet.

[1498] The system of the present invention allows users to quickly find a suitable toilet, making it easier to maintain a clean and comfortable toilet environment. In addition, by utilizing user reviews, it also contributes to improving the toilet environment.

[1499] The processing flow will be explained below.

[1500] Step 1:

[1501] The user launches the toilet search app and allows the use of location information.

[1502] Step 2:

[1503] The device uses the GPS function to obtain the user's current location.

[1504] Step 3:

[1505] The current location information acquired by the terminal is sent to the server.

[1506] Step 4:

[1507] The server receives the location information and accesses a database to search for restrooms near the current location.

[1508] Step 5:

[1509] The server obtains the location information, cleanliness level, and facility information (including whether or not there are baby care facilities and ostomate-friendly toilets) of the relevant toilets from the database and generates a list.

[1510] Step 6:

[1511] The server returns the generated toilet information list to the terminal.

[1512] Step 7:

[1513] The terminal displays the received toilet information list to the user.

[1514] Step 8:

[1515] The user selects a particular toilet from the displayed list of toilets.

[1516] Step 9:

[1517] The device sends the ID of the selected toilet to the server and requests the corresponding AR / VR data.

[1518] Step 10:

[1519] The server provides the requested AR / VR data of the toilet and sends it to the device.

[1520] Step 11:

[1521] The device displays the received AR / VR data, allowing users to check the interior of the toilet in advance.

[1522] Step 12:

[1523] After using the restroom, the user writes a review in the app.

[1524] Step 13:

[1525] The device sends review information (user ID, toilet ID, rating, comment) to the server.

[1526] Step 14:

[1527] The server stores the received review information in a database.

[1528] Step 15:

[1529] The server updates the toilet's rating based on the saved review information.

[1530] By repeating the above steps, the system of the present invention allows the user to always obtain the latest and most appropriate toilet information.

[1531] Example 1

[1532] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1533] Conventional toilet search systems make it difficult for users to quickly and appropriately find the nearest toilet when they suddenly feel the need to defecate or urinate. It is also difficult to check the cleanliness and facility information of the toilet beforehand, which creates the problem of not feeling at ease until actually using the toilet. Furthermore, there has been no effective system that properly collects user reviews after using the toilet and allows other users to refer to those reviews.

[1534] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1535] In this invention, the server includes means for acquiring the user's current location, means for searching for location information, cleanliness level, and facility information of the nearest toilet based on the acquired current location, means for displaying the searched toilet information on the user's terminal, means for providing augmented reality or virtual reality data that allows the user to check the interior of the selected toilet in advance, and means for inputting user reviews after using the toilet, sending the reviews to the server, and storing them in a database. This allows users to quickly find the nearest toilet, check the cleanliness level and facilities, and check the interior of the toilet in advance. A system is also realized that collects reviews after using the toilet, allowing other users to refer to the reviews.

[1536] "Current location" is information about the latitude and longitude of the user's current location, obtained using the GPS function of the device used by the user.

[1537] A "server" is a computer system that receives requests from user terminals via a network, performs the necessary processing, and provides information.

[1538] A "terminal" is an electronic device used by a user, such as a computer, smartphone, or tablet.

[1539] "Toilet location information" is latitude and longitude data that indicates the specific location of the nearest toilet.

[1540] "Cleanliness" is information that indicates an evaluation of the cleanliness and sanitary condition of the toilet.

[1541] "Facility information" refers to facility information such as whether or not the restroom has baby care facilities or an ostomate-friendly toilet.

[1542] "AR" stands for augmented reality, a technology that displays computer-generated information overlaid on real-world scenery.

[1543] "VR" stands for virtual reality, a technology that allows you to experience a computer-generated virtual environment.

[1544] A "database" is a system for efficiently managing a collection of data and performing operations such as searching, saving, and updating.

[1545] A "review" is a detailed description of a user's impressions and evaluations after using a toilet.

[1546] The toilet search system of the present invention acquires the user's current location and provides information on the location, cleanliness, and facilities of the nearest toilet based on that location. The system aims to enable users to quickly find an appropriate toilet when they suddenly feel the urge to defecate or urinate, providing an environment in which they can go out more comfortably and safely.

[1547] System configuration

[1548] The system consists of a user's terminal (such as a smartphone), a server, and a communication network that links these together.

[1549] Get the user's current location

[1550] The user launches the toilet search app and allows the app to use location information. The device uses its GPS function to obtain the user's current location. Specifically, the LocationManager API is used on the Android platform, and the CoreLocation framework is used on the iOS platform. The obtained location information is sent to the server in JSON format.

[1551] Sending a request to the server

[1552] The device sends an HTTP POST request containing its current location data to the server, which sends the location information via a REST API to an endpoint such as "https: / / example.com / api / nearest_toilets," which causes the server to make a database query to find the nearest toilets.

[1553] Obtaining information about nearby toilets

[1554] The server retrieves information about the nearest restroom from a MySQL database based on the user's location. The retrieved information includes the restroom's location, cleanliness, baby care facilities, and whether or not it has an ostomate-friendly restroom. The retrieved information is then returned to the user's device in JSON format.

[1555] Advance toilet check using AR / VR

[1556] The user selects a specific toilet from a provided list. The device then sends the selected toilet's ID to the server, which then provides the corresponding AR / VR data. This data is generated using frameworks such as Unity, ARKit, and ARCore. The user can check the interior of the toilet in advance on their device, including a 360-degree view.

[1557] Posting and saving user reviews

[1558] After using the restroom, users enter a review on the app. The review includes a star rating and comments, and the device sends it to the server as an HTTP POST request. The server saves the review information in a database and updates the restroom's rating. This allows other users to use the review as a reference when choosing a restroom.

[1559] Specific examples

[1560] For example, if a user suddenly feels the need to defecate at a tourist spot, the user launches a restroom search app and agrees to a prompt to allow the use of location information. The following prompt is displayed: "Please obtain the location information of restrooms." If the user selects permission, the device obtains the current location and sends it to the server. The server searches for the nearest restroom information and sends it back to the user's device. The user selects a specific restroom from the displayed list and checks its cleanliness and facilities. The user can also use the AR / VR function to check the interior of the restroom in advance. The user then uses the restroom, enters a review in the app, and sends it to the server. This review is stored in a database and can be used as reference by other users when using the restroom.

[1561] This invention allows users to quickly find a suitable toilet and ensure a clean and comfortable toilet environment. Furthermore, by utilizing user reviews, it contributes to improving the quality of toilets.

[1562] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1563] Step 1:

[1564] The user launches the toilet search app and allows it to use location information.

[1565] Input: User launches app and agrees to location permission prompt

[1566] How it works: When a user launches the toilet search app on their smartphone, a prompt appears asking for permission to use location information. If the user selects "Allow," a notification is sent to the device.

[1567] Output: A flag indicating permission was granted

[1568] Step 2:

[1569] The device obtains the user's current location

[1570] Input: Location permission flag

[1571] Behavior: The device activates the GPS function and obtains the current latitude and longitude using the LocationManager API on Android and CoreLocation on iOS.

[1572] Output: Current location (latitude and longitude)

[1573] Step 3:

[1574] The device sends its current location to the server

[1575] Input: Current location information (latitude and longitude)

[1576] Operation: The device sends the acquired latitude and longitude in JSON format to the server as an HTTP POST request. The Uri is, for example, "https: / / example.com / api / nearest_toilets".

[1577] Output: Result status of request sent to server

[1578] Step 4:

[1579] The server searches for information about the nearest toilet

[1580] Input: User's current location (latitude and longitude)

[1581] How it works: Based on the current location received, the server queries a MySQL database to find the nearest restrooms, including their location, cleanliness, and amenities.

[1582] Output: Toilet information (location, cleanliness, facility information)

[1583] Step 5:

[1584] The server sends the toilet information to the terminal.

[1585] Input: Nearest toilet information (location, cleanliness, facilities information)

[1586] How it works: The server converts the acquired toilet information into JSON format and sends it to the user's device as an HTTP response.

[1587] Output: Toilet information in JSON format

[1588] Step 6:

[1589] The device analyzes the toilet information and displays it to the user

[1590] Input: JSON format toilet information received from the server

[1591] How it works: The device parses the received JSON data and displays the location, cleanliness, and facility information of the toilets in a list format on the app screen.

[1592] Output: A list of toilets available to the user

[1593] Step 7:

[1594] User selects a specific restroom and requests AR / VR data

[1595] Input: The ID of the toilet selected by the user

[1596] How it works: When a user selects a specific toilet from the displayed list, the device sends an HTTP POST request including the toilet's ID to the server, requesting AR / VR data.

[1597] Output: AR / VR data request to the server

[1598] Step 8:

[1599] The server provides AR / VR data for the specified toilet.

[1600] Input: The ID of the toilet selected by the user

[1601] How it works: The server retrieves AR / VR data corresponding to the toilet ID from the database and sends this data to the user's device. This data is generated using Unity or ARKit / ARCore.

[1602] Output: AR / VR data

[1603] Step 9:

[1604] The device analyzes the AR / VR data and displays it to the user

[1605] Input: AR / VR data received from the server

[1606] How it works: The device analyzes the received AR / VR data and displays the interior of the toilet to the user in a 360-degree view or augmented reality.

[1607] Output: Display AR / VR view

[1608] Step 10:

[1609] A user uses the restroom and writes a review

[1610] Input: User review information (user ID, toilet ID, rating, comment)

[1611] How it works: After using the restroom, the user enters a review in the app, including a rating and comment.

[1612] Output: Review completed flag

[1613] Step 11:

[1614] The device sends the review information to the server

[1615] Input: Review information (user ID, toilet ID, rating, comment)

[1616] How it works: The device sends the review information to the server as an HTTP POST request.

[1617] Output: Result status of review data sent to the server

[1618] Step 12:

[1619] The server saves the review to a database and updates the restroom's rating.

[1620] Input: Review information submitted by the user

[1621] Operation: The server saves the received review information in a database and updates the rating information of the toilet, allowing other users to use the rating information when selecting a toilet.

[1622] Output: Status of review saved to database

[1623] (Application example 1)

[1624] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1625] When food delivery partners suddenly need to defecate or urinate while on the job, it is difficult to quickly find a suitable restroom, which impairs work efficiency and a comfortable working environment. In addition, there is no way to check the cleanliness or facility information of the restroom in advance, which can make users feel uneasy.

[1626] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1627] In this invention, the server includes means for acquiring the user's current location, means for searching for location information of the nearest restroom based on the acquired current location, means for providing information on the cleanliness and facilities of the searched nearest restroom, means for allowing the interior of the searched restroom to be checked in advance using an AR or VR function, and means for inputting and sending reviews of the restroom used. This enables food delivery partners to quickly find an appropriate restroom even while on the job and use it with peace of mind, improving work efficiency and a comfortable working environment.

[1628] "User" refers to a food delivery partner and a user who uses this system to search for a toilet.

[1629] "Means for acquiring the current location" refers to a technology that uses a GPS function to identify the user's current location.

[1630] The "means for searching for location information of the nearest toilet" is a technology that searches a database for the location of nearby toilets based on the user's current location.

[1631] "Means for providing information on the cleanliness of toilets and toilet facilities" refers to a technology that provides users with information on the cleanliness and facilities (such as the presence or absence of baby care facilities and ostomate-friendly toilets) of the toilets that have been searched for.

[1632] "A means for checking the interior of the searched toilet in advance using AR or VR functions" is a system that allows users to visually check the interior of the toilet they specify in advance using augmented reality (AR) or virtual reality (VR) technology.

[1633] "Means for inputting and transmitting reviews of toilets used" refers to a technology that allows users to input reviews about the toilet's usability and cleanliness after using it, and transmit these to a server.

[1634] The restroom search system for food delivery partners of the present invention acquires the user's current location and provides information on the location, cleanliness, and facilities of the nearest restroom based on that location. This system enables users to quickly find an appropriate restroom when they suddenly need to defecate or urinate, improving the efficiency of delivery work and providing a comfortable working environment.

[1635] System Configuration

[1636] The system consists of a user terminal (such as a smartphone), a server, and a communication network that connects them. Specific examples of hardware and software are as follows:

[1637] 1. User Device

[1638] Hardware: Smartphone (with GPS function)

[1639] Software: Mobile app development frameworks (React Native, Flutter, etc.)

[1640] 2. Server

[1641] Software: Node.js, Express

[1642] Database: MongoDB, PostgreSQL

[1643] AR / VR libraries: Unity, ARKit, ARCore

[1644] System Operation

[1645] 1. Obtaining the user's current location

[1646] User: Launch the toilet search app and allow it to use location information.

[1647] Device: Uses GPS to obtain the user's current location, which serves as the basis for subsequent processing.

[1648] 2. Sending a request to the server

[1649] Device: Sends the acquired current location information to the server.

[1650] Server: Receives location information and searches the database for the nearest toilet.

[1651] 3. Obtaining information about nearby toilets

[1652] Server: Obtains information on multiple toilets closest to the user's current location from the database, including toilet location information, cleanliness level, and facility information (whether or not there are baby care facilities and ostomate-friendly toilets).

[1653] Terminal: Receives the toilet information returned from the server and displays it to the user.

[1654] 4. Check restroom locations in advance using AR / VR

[1655] User: Select a specific toilet from the displayed list of toilets.

[1656] Terminal: Sends the ID of the selected toilet to the server and obtains the corresponding AR / VR data.

[1657] Server: Provides AR / VR data that allows users to see the inside of a toilet.

[1658] Terminal: Displays the acquired AR / VR data, allowing users to check the interior of the toilet in advance.

[1659] 5. Posting and saving user reviews

[1660] User: After using the restroom, enter a review on the app.

[1661] Terminal: Sends review information (user ID, toilet ID, rating, comment) to the server.

[1662] Server: Saves the review information to a database and updates the toilet's rating, allowing other users to choose a toilet based on the reviews.

[1663] Specific examples

[1664] For example, if a delivery partner suddenly needs to go to the bathroom while delivering food, they can open a restroom search app and submit their location information. The app will then display the nearest clean restroom. Delivery partners can use the AR / VR function to check the interior of the restroom in advance, allowing them to use it with peace of mind. They can then post a review, which other delivery partners can use as a reference.

[1665] Example prompts to input to the generative AI model

[1666] "Describe a restroom finder app that helps delivery partners quickly find a clean restroom when they suddenly need to go to the bathroom while at work."

[1667] By using this prompt, the generative AI model can provide more detailed explanations of specific applications and usage scenarios.

[1668] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1669] Step 1:

[1670] Get the user's current location

[1671] Input: The user launches the toilet search app and allows it to use location information.

[1672] Processing: The device acquires the current location information using the smartphone's GPS function. The acquired current location information is stored in a variable within the program.

[1673] Output: Current location information (latitude, longitude).

[1674] Step 2:

[1675] Sending a request to the server

[1676] Input: Current location information obtained in step 1.

[1677] Processing: The current location information acquired by the device is sent to the server using the REST API.

[1678] Output: The request to the server.

[1679] Step 3:

[1680] Obtaining information about nearby toilets

[1681] Input: Current location information sent to the server in step 2.

[1682] Processing: Based on the current location information received by the server, search the database for the nearest toilet information (location, cleanliness level, facility information). Prepare the search results in JSON format.

[1683] Output: Nearest toilet information (JSON format).

[1684] Step 4:

[1685] Receiving and displaying toilet information

[1686] Input: Nearest toilet information sent from the server in step 3.

[1687] Processing: The device receives the response from the server and displays the toilet information on the app screen.

[1688] Output: A list of toilets that the user can check.

[1689] Step 5:

[1690] Advance toilet check using AR / VR

[1691] Input: The user selects a specific toilet from a list of toilets.

[1692] Processing: The device sends the ID of the selected restroom to the server and requests the corresponding AR / VR data. The server receives this request, retrieves the corresponding AR / VR data from the database, and sends it to the device. The AR / VR data received by the device is displayed on the app screen.

[1693] Output: AR / VR data display of the toilet.

[1694] Step 6:

[1695] Posting and saving user reviews

[1696] Input: The user enters a review (rating, comments) after using the toilet.

[1697] Processing: The terminal sends the entered review information (user ID, restroom ID, rating, comment) to the server. The server saves the received review information in the database and updates the existing restroom rating data.

[1698] Output: Saves review information to a database and updates ratings.

[1699] The above steps will create a system that allows food delivery partners to find suitable restrooms with peace of mind and obtain information quickly and reliably.

[1700] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1701] The toilet search system of the present invention acquires the user's current location and provides information on the location, cleanliness, and facilities of the nearest toilet based on that location. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the system customizes the toilet search results according to the user's emotional state. This allows the user to quickly find a more comfortable and suitable toilet.

[1702] System Configuration

[1703] The system consists of a user's device (such as a smartphone), a server, an emotion engine, and a communication network that connects these.

[1704] 1. Obtaining the user's current location

[1705] User: Launch the toilet search app and allow it to use location information.

[1706] Device: Uses GPS to obtain the user's current location, which serves as the basis for subsequent processing.

[1707] 2. Sending a request to the server

[1708] Device: Sends the acquired current location information to the server.

[1709] Server: Receives location information and searches the database for the nearest toilet.

[1710] 3. Obtaining information about nearby toilets

[1711] Server: Obtains information on multiple toilets closest to the user's current location from the database, including toilet location information, cleanliness level, and facility information (whether or not there are baby care facilities and ostomate-friendly toilets).

[1712] Terminal: Receives the toilet information returned from the server and displays it to the user.

[1713] 4. Check restroom locations in advance using AR / VR

[1714] User: Select a specific toilet from the displayed list of toilets.

[1715] Terminal: Sends the ID of the selected toilet to the server and obtains the corresponding AR / VR data.

[1716] Server: Provides AR / VR data that allows users to see the inside of a toilet.

[1717] Terminal: Displays the acquired AR / VR data, allowing users to check the interior of the toilet in advance.

[1718] 5. Posting and saving user reviews

[1719] User: After using the restroom, enter a review on the app.

[1720] Terminal: Sends review information (user ID, toilet ID, rating, comment) to the server.

[1721] Server: Saves the review information to a database and updates the restroom's rating.

[1722] 6. Use of Emotion Engines

[1723] The device runs an emotion engine to recognize the user's emotions. This emotion engine analyzes inputs such as facial expressions and voice to identify the user's emotional state.

[1724] Terminal: Sends the recognized emotional state to the server.

[1725] Server: Recommends the best restroom based on the user's emotional state. For example, if the user is in a high state of urgency, it will prioritize the nearest restroom, while if the user is relaxed, it will recommend a clean restroom with good facilities.

[1726] Server: Sends the search results for suitable toilets to the terminal and displays them to the user.

[1727] Specific examples

[1728] For example, suppose a user suddenly feels the urge to defecate in a busy downtown area. The user opens a toilet search app and allows the use of location information. The device obtains the current location and sends this information to the server. The server searches the database for the nearest toilet information and sends it back to the user's device. The user selects a specific toilet from the provided list and checks its cleanliness and facilities. The user can also use AR / VR to check the interior of the toilet in advance.

[1729] Furthermore, the device's emotion engine recognizes the user's emotions from their facial expressions and voice, and sends that information to the server. If the user is feeling nervous, toilets with high urgency will be suggested first, and after using the toilet, the user can leave a review and rate it. This allows the accumulation of information that will be useful to other users.

[1730] The system of the present invention allows users to quickly find a suitable restroom, making it easier to maintain a clean and comfortable restroom environment. Furthermore, by utilizing the emotion engine, the system can suggest the most suitable restroom based on the user's level of urgency, providing a more personalized service. This can increase user satisfaction.

[1731] The processing flow will be explained below.

[1732] Step 1:

[1733] The user launches the toilet search app and allows the use of location information.

[1734] Step 2:

[1735] The device uses the GPS function to obtain the user's current location.

[1736] Step 3:

[1737] The current location information acquired by the terminal is sent to the server.

[1738] Step 4:

[1739] The server receives the location information and accesses a database to search for restrooms near the current location.

[1740] Step 5:

[1741] The server obtains the location information, cleanliness level, and facility information (including whether or not there are baby care facilities and ostomate-friendly toilets) of the relevant toilets from the database and generates a list.

[1742] Step 6:

[1743] The server returns the generated toilet information list to the terminal.

[1744] Step 7:

[1745] The terminal displays the received toilet information list to the user.

[1746] Step 8:

[1747] The user selects a particular toilet from the displayed list of toilets.

[1748] Step 9:

[1749] The device sends the ID of the selected toilet to the server and requests the corresponding AR / VR data.

[1750] Step 10:

[1751] The server provides the requested AR / VR data of the toilet and sends it to the device.

[1752] Step 11:

[1753] The device displays the received AR / VR data, allowing users to check the interior of the toilet in advance.

[1754] Step 12:

[1755] After using the restroom, the user writes a review in the app.

[1756] Step 13:

[1757] The device sends review information (user ID, toilet ID, rating, comment) to the server.

[1758] Step 14:

[1759] The server stores the review information in a database.

[1760] Step 15:

[1761] The server updates the toilet's rating based on the saved review information.

[1762] Step 16:

[1763] The device activates an emotion engine to recognize the user's emotions. This emotion engine analyzes inputs such as the user's facial expressions and voice to identify the user's emotional state.

[1764] Step 17:

[1765] The device transmits the recognized emotional state to the server.

[1766] Step 18:

[1767] The server will suggest the best restroom based on the user's emotional state. For example, if the user is in a high state of urgency, it will prioritize the nearest restroom, while if the user is relaxed, it will recommend a clean restroom with good facilities.

[1768] Step 19:

[1769] The server sends the search results for suitable toilets to the terminal and displays them to the user.

[1770] By repeating the above steps, the system of the present invention allows users to always obtain the latest and most appropriate toilet information. By providing highly directional information, it is possible to meet the diverse needs of users.

[1771] Example 2

[1772] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1773] There is a demand for a system that allows users to find restrooms quickly and comfortably, but conventional restroom search systems simply provide location information and basic information without considering the user's condition. This makes it difficult to find the best restroom for an emergency or specific situation. Furthermore, since users cannot check the interior of the restroom in advance, it is difficult for users to choose a restroom they can use with confidence. This issue needs to be resolved.

[1774] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1775] In this invention, the server includes a means for acquiring the user's current location, a means for searching for the location information of the nearest restroom based on the acquired current location, a means for providing the cleanliness level and facility information of the searched nearest restroom, a means for analyzing the user's emotional state, and a means for suggesting the most suitable restroom based on the analyzed emotional state. This allows the user to quickly find the most suitable restroom based on their emotional state and level of urgency. Furthermore, the interior can be checked in advance using AR and VR functions, providing even greater peace of mind.

[1776] The "means for acquiring the user's current location" refers to a device or software that acquires the user's current location information using the user's mobile device or GPS function.

[1777] The "means for searching for the location information of the nearest toilet based on the acquired current location" is a processing device or software that searches for and provides the location information of the toilet closest to the user from a database based on the acquired location information.

[1778] "Means for providing information on the cleanliness of the nearest toilets found in a search and on the facilities of the toilets" refers to a device or software that provides users with information on the cleanliness of the toilets found in the search results and on the facilities (such as whether or not they have baby care facilities or ostomate-friendly toilets).

[1779] The "means for analyzing the user's emotional state" is a device or software for analyzing the user's facial expressions and voice to identify the user's current emotional state.

[1780] The "means for suggesting the most suitable toilet based on the analyzed emotional state" is a processing device or software for suggesting the most suitable toilet to the user based on the analyzed emotional state.

[1781] "Baby care facilities" are facilities for caring for infants and young children (for example, diaper changing tables and breastfeeding spaces).

[1782] An "ostomate-friendly toilet" is a toilet facility designed to be comfortable for people with a stoma.

[1783] The "AR function" is a technology that uses augmented reality technology to overlay digital information on real-world toilet information.

[1784] The "VR function" is a technology that uses virtual reality technology to allow users to virtually experience the inside of a toilet through 360-degree video and other means.

[1785] The restroom search system according to the present invention is composed of a user's terminal (such as a smartphone), a server, an emotion engine, and a communication network linking these together.

[1786] First, the user launches the toilet search app on their smartphone and allows the app to use their location information. At this time, the device uses its built-in GPS to obtain the user's current location. The obtained location information is then sent by the device to a server, which then searches a database for information on the nearest toilet based on the received location information.

[1787] The server retrieves information on multiple toilets closest to the user's current location from the database. This information includes the toilet's location, cleanliness, whether it has baby care facilities, and whether it has an ostomate-friendly toilet. The retrieved toilet information is then sent back to the terminal and displayed to the user.

[1788] The user can select a specific toilet from the displayed list. At that time, the device sends the selected toilet's ID to the server, and the server retrieves the toilet's AR / VR data and sends it back to the device. This allows the user to check the interior of the toilet in advance.

[1789] The system also includes an emotion engine. The emotion engine installed in the device analyzes the user's facial expressions and voice to recognize their emotional state. The recognized emotional state is sent to the server, which then uses that information to suggest the most suitable restroom. For example, if the user is nervous, a restroom with a high level of urgency will be suggested first. On the other hand, if the user is relaxed, a restroom that is clean and well-equipped will be recommended. The server recalculates the search results for suitable restrooms, sends them to the device, and displays them to the user.

[1790] As a concrete example, consider a case where a user suddenly feels the urge to defecate in a busy downtown area. The user opens a restroom search app on their smartphone and allows the use of location information. The device obtains their current location and sends that information to the server. The server then searches the database for information about the nearest restroom and sends it back to the user's device. The user selects a specific restroom from the provided list and checks its cleanliness and facilities. The user can also use the AR / VR function to check the interior of the restroom in advance.

[1791] Furthermore, the device's emotion engine recognizes the user's emotions from their facial expressions and voice, and sends this information to the server. If the user is nervous, toilets with a high level of urgency are suggested first, and after using the toilet, the user can leave a review and rate it. This accumulates information that is also useful for other users. This system allows users to quickly find the appropriate toilet, making it easier to ensure a clean and comfortable toilet environment. Furthermore, by utilizing the emotion engine, the system suggests the optimal toilet based on the user's level of urgency, providing a more personalized service. This increases user satisfaction.

[1792] Example prompt sentence:

[1793] "Please tell me about a system that acquires current location, searches for the nearest restroom, and provides information on cleanliness and facilities."

[1794] "Please explain in detail about the system that recognizes the user's emotions and suggests the best toilet for them."

[1795] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1796] Step 1:

[1797] Input: The user launches a toilet search app on their smartphone and allows location access.

[1798] Operation: The device's GPS function is activated and the user's current location (latitude and longitude) is obtained.

[1799] Output: The latitude and longitude of the current location is obtained.

[1800] Step 2:

[1801] Input: Latitude and longitude information of your current location.

[1802] Operation: The device sends the current location information it has acquired to the server via an HTTP POST request.

[1803] Output: Current location information is sent to the server.

[1804] Step 3:

[1805] Input: The user's current location (latitude and longitude).

[1806] How it works: The server analyzes the location information received and searches the toilet information database for the nearest toilet. It performs location-based searches using SQL queries, etc.

[1807] Output: Data including the location, cleanliness, and facilities of the nearest toilets is obtained.

[1808] Step 4:

[1809] Input: Location, cleanliness and facilities of nearest restroom.

[1810] How it works: The server converts the search results into JSON format data and sends it to the device.

[1811] Output: Toilet information in JSON format is sent to the device.

[1812] Step 5:

[1813] Input: Restroom information in JSON format.

[1814] Operation: The device analyzes the toilet information it receives and displays it on the app in a user-friendly format (map or list format).

[1815] Output: The user is shown the nearest toilet information.

[1816] Step 6:

[1817] Input: The action of the user selecting a specific toilet from a list of toilets.

[1818] Operation: The device generates request data including the ID of the selected toilet and sends it to the server.

[1819] Output: Toilet ID information is sent to the server.

[1820] Step 7:

[1821] Input: Specific restroom ID information.

[1822] How it works: The server retrieves the AR / VR data for the corresponding toilet based on the toilet ID.

[1823] Output: AR / VR data is obtained.

[1824] Step 8:

[1825] Input: AR / VR data.

[1826] Operation: The server sends the acquired AR / VR data to the device.

[1827] Output: AR / VR data is sent to the device.

[1828] Step 9:

[1829] Input: AR / VR data sent from the server.

[1830] How it works: The device analyzes the AR / VR data it receives and displays a 3D model and 360-degree image of the inside of the toilet, allowing the user to see it.

[1831] Output: The user can preview the inside of the toilet.

[1832] Step 10:

[1833] Input: User's facial and voice data.

[1834] How it works: The device's emotion engine analyzes facial and voice data to recognize the user's emotional state.

[1835] Output: The user's emotional state is recognized.

[1836] Step 11:

[1837] Input: Recognized user emotional state data.

[1838] How it works: The device sends the recognized emotional state to the server.

[1839] Output: Emotional state data is sent to the server.

[1840] Step 12:

[1841] Input: User emotional state data.

[1842] How it works: The server re-searches for the best restroom for the user based on their emotional state. For example, if the user is in a high state of urgency, it prioritizes distance, and if the user is relaxed, it prioritizes cleanliness and facilities.

[1843] Output: The best toilet information is recalculated.

[1844] Step 13:

[1845] Input: Recalculated optimal toilet information.

[1846] How it works: The server sends the best toilet information to the device.

[1847] Output: The best toilet information is sent to the device.

[1848] Step 14:

[1849] Input: Best Restroom Information.

[1850] What it does: The device will redisplay the best restroom information in the app.

[1851] Output: The best toilet information is displayed to the user.

[1852] Step 15:

[1853] Input: The action of a user entering review information (ratings, comments) on the app after using the restroom.

[1854] How it works: The device sends review information to the server.

[1855] Output: The review information is sent to the server.

[1856] Step 16:

[1857] Input: Review information submitted by the user.

[1858] Behavior: The server receives the review information, stores it in a database, and updates the rating of the restroom.

[1859] Output: The toilet rating is updated and saved in the database.

[1860] (Application example 2)

[1861] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1862] In modern society, finding and using restrooms is a serious problem for people who work in food delivery or other jobs that require long travel times. Efficient search is especially important when a user needs to find a restroom quickly or when high levels of cleanliness or special facilities are required. Furthermore, being unable to find a suitable restroom when in a hurry can lead to reduced work efficiency and stress for the user. Therefore, there is a need for a system that can provide optimal restroom information based on the user's current emotional state and quickly find a suitable restroom.

[1863] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring the user's current location, means for searching for location information of the nearest toilet based on the acquired current location, means for providing the cleanliness level and toilet facility information of the searched nearest toilet, means for recognizing the user's emotional state, and means for customizing the search results according to the user's emotional state. This makes it possible to provide optimal toilet information based on the user's current location and emotional state.

[1864] The "means for acquiring the user's current location" is a technology for identifying the user's current geographical location using a location information system (for example, GPS).

[1865] The "means for searching for the location information of the nearest toilet" is a system that searches a database for the location of the nearest toilet based on the acquired current location of the user.

[1866] "Means for providing information on the cleanliness of the toilet and toilet facilities" refers to technology that conveys to users the cleanliness of the toilet and facility information (for example, whether or not there are baby care facilities or ostomate-friendly toilets).

[1867] The "means for recognizing the user's emotional state" is a system that uses technologies such as facial expression recognition and voice analysis to identify the user's emotional state (e.g., tension, relaxation).

[1868] "Means for customizing search results" refers to technology that optimizes the toilet information provided based on the user's emotional state and current location, and presents the best options for the user.

[1869] "Means for checking the inside of a restroom in advance using AR or VR functions" refers to technology that uses augmented reality (AR) or virtual reality (VR) to allow users to visually check the inside of a restroom before actually visiting.

[1870] The "means for preferentially suggesting the nearest toilet" is a system that preferentially recommends the geographically closest toilet when a user needs to use the toilet in an emergency.

[1871] The "means for suggesting well-equipped restrooms" is a technology that recommends clean, well-equipped restrooms when a user is in a relaxed state and searching for a restroom.

[1872] "Means for collecting feedback from users and providing that information to other users" refers to a system that collects reviews and ratings from users after using the restroom and shares them with the next user.

[1873] "Means for identifying a user's emotional state using facial recognition and voice analysis" refers to technology that recognizes a user's emotions in real time by analyzing image and voice data.

[1874] The system realized based on this invention not only acquires the user's current location and provides information on the nearest restroom, but also customizes search results according to the user's emotional state to provide the most appropriate restroom information for the user. Specific details for implementing this system are described below.

[1875] Hardware and software used

[1876] Hardware: Smartphone (with GPS function), server

[1877] Software: Python, Django, GeoDjango (spatial data processing), Microsoft Azure Cognitive Services (sentiment analysis)

[1878] Get the user's current location

[1879] The device (smartphone) uses GPS to obtain the user's current location, which serves as the basis for the toilet search.

[1880] Communicating with the Server

[1881] The device sends the acquired current location information to the server. The server uses GeoDjango to search the database for information on the nearest restroom to the current location. The server also acquires information on the restroom's location, cleanliness, and facilities (including whether or not there are baby care facilities and ostomate-friendly restrooms).

[1882] Providing toilet information

[1883] The server sends the searched toilet information to the terminal, which displays it to the user as a toilet list. The user can select a specific toilet from the list and check its cleanliness and facility information.

[1884] Advance toilet check using AR / VR

[1885] When a user selects a specific restroom, the device sends the restroom's ID to the server and retrieves the corresponding AR / VR data, allowing the user to preview the interior of the restroom using AR / VR.

[1886] Use of emotion engine

[1887] The device activates an emotion engine to recognize the user's emotional state from their facial expressions and voice. This information is sent to the server, which then recommends the most appropriate restroom based on the user's emotional state. For example, if the user is in a high state of urgency, the server will prioritize the nearest restroom, while if the user is relaxed, the server will recommend a clean restroom with excellent facilities.

[1888] Post a user review

[1889] After using the restroom, users can enter a review on the app. This review information is sent from the device to the server and stored in a database. This allows the accumulation of information that will be useful when other users use the restroom.

[1890] Specific examples

[1891] If a food delivery user needs to go to the toilet suddenly, he or she opens the app and allows location information to be used. The device obtains the current location and sends this information to the server. If the system recognizes an emergency situation using the emotion engine, the nearest toilet will be displayed first.

[1892] Prompt Sentence Examples

[1893] "Search and display the nearest restroom based on your current location."

[1894] "The user's emotional state is tension, so please prioritize suggesting the nearest restroom."

[1895] This invention allows users to quickly find a suitable restroom, ensuring a comfortable environment for use. The use of an emotion engine allows the most suitable service to be provided to each individual user, thereby improving user satisfaction.

[1896] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1897] Step 1: Get the user's current location

[1898] Input: The user launches the application and allows location information to be obtained.

[1899] Data processing: The device uses the GPS function to obtain the user's current location (latitude, longitude).

[1900] Output: Latitude and longitude data of current location.

[1901] Specific operation: When a user launches the app and allows it to use location information, the device activates the GPS function to determine the user's current location.

[1902] Step 2: Send location information to the server

[1903] Input: The latitude and longitude data of the device's current location.

[1904] Data processing: The acquired location information is sent to the server.

[1905] Output: Latitude and longitude information received by the server.

[1906] Specific operation: The device uses the communication module to send current location data to the server.

[1907] Step 3: Find the nearest toilet

[1908] Input: The user's current location information received by the server.

[1909] Data processing: Use GeoDjango to search the database for toilet information (location, cleanliness, and facility information) closest to the current location.

[1910] Output: A list of nearby toilets.

[1911] Specific operation: Based on the received current location, the server executes a database query to collect information about nearby toilets.

[1912] Step 4: Providing restroom information

[1913] Input: A list of toilet information searched by the server.

[1914] Data processing: Send the toilet information list to the terminal.

[1915] Output: Toilet information list received by the device.

[1916] Specific operation: The server sends the toilet information obtained as a search result to the terminal and displays it to the user.

[1917] Step 5: Pre-check the toilets using AR / VR

[1918] Input: Toilet ID when user selects a specific toilet.

[1919] Data processing: The toilet ID is sent from the device to the server, and the corresponding AR / VR data is obtained.

[1920] Output: Captured AR / VR data.

[1921] Specific operation: Based on the toilet ID received from the server, the corresponding AR / VR data is obtained and the interior of the toilet is visually displayed to the user.

[1922] Step 6: Recognizing User Emotions

[1923] Input: User's facial expression data and voice data.

[1924] Data processing: Use Microsoft Azure Cognitive Services to analyze the user's emotional state.

[1925] Output: Parsed emotional state data.

[1926] Specific operation: The device analyzes facial expressions and voice data obtained from the user and calls an API to identify the user's emotional state.

[1927] Step 7: Toilet suggestions based on emotional state

[1928] Input: Emotional state data, and toilet information list.

[1929] Data processing: Filtering the best toilets based on your emotional state.

[1930] Output: A list of toilet information that matches the user's emotions.

[1931] Specific operation: The server receives the emotional state data and selects the most suitable toilet based on the urgency.

[1932] Step 8: Leave a review after using the restroom

[1933] Input: User review information (rating, comments).

[1934] Data processing: Review information is sent from the device to the server and stored in a database.

[1935] Output: Review information stored in a database.

[1936] Specific operation: After using the restroom, the user enters a review, which is then sent from the device to the server and saved.

[1937] In this way, through specific operations for each step, a comfortable and convenient toilet search system can be provided for the user.

[1938] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1939] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1940] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1941] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1942] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1943] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1944] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1945] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1946] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1947] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1948] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1949] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1950] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1951] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1952] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1953] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1954] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1955] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1956] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1957] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1958] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1959] The following is further disclosed regarding the above embodiment.

[1960] (Claim 1)

[1961] means for obtaining a user's current location;

[1962] A means for searching for location information of the nearest toilet based on the acquired current location;

[1963] means for providing information on the cleanliness and facilities of the nearest toilet that has been searched for;

[1964] A system including:

[1965] (Claim 2)

[1966] 2. The system according to claim 1, further comprising a means for providing said toilet facility information including whether or not there is a baby care facility and an ostomate-friendly toilet.

[1967] (Claim 3)

[1968] The system according to claim 1, further comprising a means for allowing a user to check the interior of the toilet in advance using an AR or VR function before the toilet cleanliness and facility information is displayed.

[1969] "Example 1"

[1970] (Claim 1)

[1971] means for obtaining a user's current location;

[1972] A means for searching for location information, cleanliness level and facility information of the nearest toilet based on the acquired current location;

[1973] means for displaying the retrieved toilet information on a user's terminal;

[1974] means for providing augmented reality or virtual reality data that allows the user to preview the interior of the selected toilet;

[1975] A method for users to input their reviews after using the restroom, send them to a server, and store them in a database.

[1976] A system including:

[1977] (Claim 2)

[1978] 2. The system according to claim 1, further comprising means for providing information on toilet facilities including whether or not there are baby care facilities and ostomate-friendly toilets as the toilet facility information.

[1979] (Claim 3)

[1980] 10. The system of claim 1, further comprising means for storing a review in a database and updating a rating of the toilet after the user submits the review to the server.

[1981] "Application Example 1"

[1982] (Claim 1)

[1983] means for obtaining a user's current location;

[1984] A means for searching for location information of the nearest toilet based on the acquired current location;

[1985] means for providing information on the cleanliness and facilities of the nearest toilet that has been searched for;

[1986] A way to check the interior of the toilet you searched for in advance using AR or VR functions,

[1987] A means to input and submit reviews of toilets used,

[1988] A system including:

[1989] (Claim 2)

[1990] 2. The system according to claim 1, further comprising a means for providing information on facilities of the toilet including whether or not the toilet has baby care facilities and an ostomate-friendly toilet.

[1991] (Claim 3)

[1992] The system according to claim 1, characterized in that it has a means for a user to check the interior of the toilet in advance using an AR or VR function before displaying the toilet cleanliness and facility information.

[1993] "Example 2: Combining Emotion Engines"

[1994] (Claim 1)

[1995] means for obtaining a user's current location;

[1996] A means for searching for location information of the nearest toilet based on the acquired current location;

[1997] means for providing information on the cleanliness and facilities of the nearest toilet that has been searched for;

[1998] means for analyzing the emotional state of a user;

[1999] A means for suggesting the best toilet based on the analyzed emotional state;

[2000] A system including:

[2001] (Claim 2)

[2002] 2. The system according to claim 1, further comprising a means for providing information on facilities of the toilet including whether or not the toilet has baby care facilities and an ostomate-friendly toilet.

[2003] (Claim 3)

[2004] The system according to claim 1, characterized in that it has a means for a user to check the interior of the toilet in advance using an AR or VR function before displaying the toilet cleanliness and facility information.

[2005] "Application example 2 when combining emotion engines"

[2006] (Claim 1)

[2007] means for obtaining a user's current location;

[2008] A means for searching for location information of the nearest toilet based on the acquired current location;

[2009] means for providing information on the cleanliness and facilities of the nearest toilet that has been searched for;

[2010] means for recognizing the emotional state of a user;

[2011] a means for customizing search results according to a user's emotional state;

[2012] A system including:

[2013] (Claim 2)

[2014] 2. The system according to claim 1, further comprising a means for providing information on facilities of the toilet including whether or not the toilet has baby care facilities and an ostomate-friendly toilet.

[2015] (Claim 3)

[2016] The system according to claim 1, characterized in that it has a means for a user to check the interior of the toilet in advance using an AR or VR function before displaying the toilet cleanliness and facility information.

[2017] (Claim 4)

[2018] The system according to claim 1, characterized in that it has a means for suggesting the nearest toilet preferentially when the user is in a high state of urgency, and suggesting a toilet with better facilities when the user is in a relaxed state, depending on the user's emotional state.

[2019] (Claim 5)

[2020] The system according to claim 1, further comprising means for collecting feedback from users based on toilet evaluation information obtained from the database and providing the information to other users.

[2021] (Claim 6)

[2022] 2. The system of claim 1, further comprising means for identifying the emotional state of the user using facial expression recognition and / or voice analysis. [Explanation of symbols]

[2023] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. means for obtaining a user's current location; A means for searching for location information of the nearest toilet based on the acquired current location; means for providing information on the cleanliness and facilities of the nearest toilet that has been searched for; A system including:

2. 2. The system according to claim 1, further comprising means for providing information on facilities of the toilet including whether or not the toilet has baby care facilities and an ostomate-friendly toilet.

3. The system according to claim 1, further comprising a means for allowing a user to check the interior of the toilet in advance using an AR or VR function before the toilet cleanliness and facility information is displayed.

Images