System

Abstract

A system is provided.SOLUTION: A system comprising: a means for a user to specify a desire to be seated through a dedicated application; a means for detecting vacant seat information and a user's action using an image acquisition device; a means for selecting a candidate to be urged to move a seat among users based on the vacant seat information analyzed using an analysis device; and a means for performing point processing when movement approval of a preceding customer is obtained.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Restaurants and other facilities often have a problem where counter seats or every other seat remain empty for a certain period of time. This makes it difficult for multiple customers to sit next to each other, reducing the store's turnover rate and efficiency, while also causing customers to wait, resulting in inefficiency. Another problem is that it is psychologically difficult to encourage previous customers to move to a different seat. There is a need for a system that can resolve these issues and provide efficient seating management and a comfortable customer experience in stores and facilities. [Means for solving the problem]

[0005] The present invention is a system that includes a means for users to specify their seating preferences through a dedicated app, a means for detecting vacant seat information and user behavior using an image capture device, a means for selecting candidates for encouraging users to move seats based on vacant seat information analyzed using an analysis device, a means for inquiring of the candidate preceding customers about whether they are willing to move seats using a display device installed at the seat, a means for processing points when the preceding customer agrees to move using an action approval means, and a means for acquiring the latest seat information and providing it to the user. This makes it possible to improve seat turnover in the store, reduce waiting times for customers, and provide a comfortable usage environment.

[0006] "Means for users to specify seating preferences through a dedicated app" refers to a means by which users use devices such as smartphones or tablets to select seating preferences through a specific application and send reservations or requests to a server.

[0007] "Means for detecting vacant seat information and user behavior using an image capture device" refers to a means for capturing the seating situation in the store and user behavior in real time using an image capture device such as a camera or sensor, and sending the data to a server for analysis.

[0008] "Means for selecting candidates to encourage users to move seats based on vacant seat information analyzed using an analytical device" refers to a means of using an analytical device equipped with AI and machine learning algorithms to analyze acquired image data and create a list of users who are eligible to move seats based on the availability of seats and the progress of users with their meals.

[0009] "Means for using a display device installed in a seat to inquire of a potential passenger whether or not they can move to another seat" refers to a means for installing a display device such as a tablet or a display in the seat of a previous passenger and displaying a screen asking whether or not the move is possible.

[0010] "Means for processing points when a previous customer's consent to move is obtained using an operation approval means" refers to a system means for confirming the approval of a previous customer when they consent to a seat change and adding or subtracting points.

[0011] "Means for obtaining the latest seat information and informing the user" refers to the means for obtaining updated seat information after the final seat movement is completed and notifying the user of that information through the app. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0013] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0014] First, the terms used in the following description will be explained.

[0015] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0016] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0017] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0018] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0019] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0020] [First embodiment]

[0021] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0022] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0023] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0024] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0025] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0026] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0027] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0028] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0029] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0030] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0031] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0032] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0033] The present invention provides a system for optimizing the use of vacant seats in stores and facilities, and realizes efficient seat management and comfortable seating, particularly at counter seats in restaurants and other establishments.

[0034] System Overview

[0035] This system allows customers to specify their seating preferences through a dedicated app, and AI analyzes and guides them to available seats in the restaurant, matching customers who want to sit next to each other with customers who are available to move to other seats. Specifically, the system includes the following measures:

[0036] How to specify seating preference using a dedicated app

[0037] Vacant seat information detection means using an image capture device

[0038] Matching candidate selection means by analysis device

[0039] Means for inquiring whether movement is possible or not using a display device

[0040] Point processing means by operation approval means

[0041] Acquisition and guidance of the latest seat information

[0042] Program processing explanation

[0043] 1. User launches app

[0044] The user launches the dedicated app on their smartphone and logs in.

[0045] The terminal sends the login information to the server to start the session.

[0046] 2. Select "Sit side by side"

[0047] The user selects the "Sit Side by Side" option from the app's menu.

[0048] The terminal sends this request to the server.

[0049] 3. Detecting vacant seat information

[0050] The server receives video data from cameras in the store in real time.

[0051] The server uses AI (analysis device) to analyze the received data and obtain information on available seats and user behavior.

[0052] 4. Selection of match candidates

[0053] Based on the analysis results, the server creates a list of seats (matching candidates) that can be moved to.

[0054] 5. Inquiry about transfer availability

[0055] The server sends a request to the listed seats asking whether or not to move to them.

[0056] The terminal (a display device installed at the previous customer's seat) displays the option of whether or not to move.

[0057] The user (previous customer) accepts or rejects the move on the screen.

[0058] 6. Points Processing

[0059] The terminal sends a response to the server approving the move.

[0060] If the user (previous customer) agrees to the move, the server manages the addition or subtraction of points.

[0061] 7. Seat Transfers and Renewals

[0062] The user (previous customer) moves to the new seat specified.

[0063] The server updates the database with the latest seating information and reflects it in real time.

[0064] 8. Seating instructions

[0065] The terminal (dedicated app) notifies the user who wishes to sit down of the available seat after the move.

[0066] The user sits down at the seat he or she is assigned.

[0067] Specific examples

[0068] Couples visiting the store

[0069] Let's take the example of a couple, A and B, visiting a restaurant.

[0070] 1. User A launches the dedicated app on their smartphone and logs in.

[0071] 2. User A selects the "Sit side by side" option in the app.

[0072] 3. The server receives the video from the in-store camera and the analysis device analyzes it. It determines that there is currently one vacant seat at the counter.

[0073] 4. The server lists existing customers who can be moved as matching candidates.

[0074] 5. The server sends a request to the tablet installed at the seat of the previous customer listed on the list to inquire whether they can move.

[0075] 6. User B (previous customer) accepts the move on his tablet.

[0076] 7. The server grants 100 points to User B and subtracts 100 points from User A.

[0077] 8. User B moves to a new seat.

[0078] 9. The server updates the latest seat information and notifies the app.

[0079] 10. User A and his partner sit next to each other at the seats they were assigned.

[0080] The above specific examples enable efficient seat management and improved user satisfaction.

[0081] The processing flow will be explained below.

[0082] Step 1:

[0083] The user launches a dedicated app on their smartphone and logs in.

[0084] Step 2:

[0085] The terminal sends the user's login information to the server, and the server authenticates the user information and starts a session.

[0086] Step 3:

[0087] The user selects the "Sit Side by Side" option from the app's menu.

[0088] Step 4:

[0089] The terminal transmits the selection information of the "sit side by side" option to the server.

[0090] Step 5:

[0091] The server receives video data from cameras in the store in real time.

[0092] Step 6:

[0093] The server's AI (analysis device) analyzes the video data and obtains information about available seats and user behavior.

[0094] Step 7:

[0095] Based on the analysis results, the server creates a list of seats (matching candidates) that can be moved to.

[0096] Step 8:

[0097] The server sends a question to the tablet installed at the seat of the previous customer listed on the server asking whether they wish to move.

[0098] Step 9:

[0099] The terminal (a tablet at the previous customer's seat) displays the option to move or not.

[0100] Step 10:

[0101] The user (previous customer) selects whether or not to move using a tablet and sends the result to the server.

[0102] Step 11:

[0103] The server receives the result of the transfer approval and processes the addition or subtraction of points.

[0104] Step 12:

[0105] The server will give 100 points to the user who moved (the previous customer) and subtract 100 points from the user who requested to "sit next to each other."

[0106] Step 13:

[0107] The user (previous customer) moves to the new seat specified.

[0108] Step 14:

[0109] The server updates the database with the latest seat information.

[0110] Step 15:

[0111] The server notifies the app of the updated seat information.

[0112] Step 16:

[0113] The terminal (dedicated app) notifies the user who wishes to sit down of the available seat after the move.

[0114] Step 17:

[0115] The user sits down at the seat he or she is assigned.

[0116] The above are the specific processing steps of the program in this system.

[0117] Example 1

[0118] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0119] Traditionally, seating management in stores and facilities has relied heavily on human labor, and there has been a challenge in restaurants and other establishments, where it is difficult to find suitable empty seats when customers want to sit together at counter seats. Furthermore, when trying to make effective use of empty seats by having previous customers move, this arrangement becomes cumbersome, and there is a risk of customer satisfaction decreasing. A system that can solve these issues and improve efficient seating management and customer satisfaction has been sought.

[0120] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0121] In this invention, the server includes: means for users to specify their seating preferences through a dedicated app on a mobile device; means for detecting vacant seat information and user behavior using a monitoring device; means for selecting candidates for encouraging users to move seats based on vacant seat information analyzed using an analysis device; means for inquiring of the candidate preceding passengers about whether they are willing to move seats using a display device installed at the seat; means for processing points when the preceding passenger agrees to move using an action approval means; means for acquiring the latest seat information and notifying the user; and means for managing the addition and subtraction of points based on the result of the move approval. This enables efficient seat management and smooth adjustments due to the movement of users who want to sit next to each other or preceding passengers, thereby improving user satisfaction.

[0122] "User" refers to an individual or group that uses a dedicated app to specify their seating preference.

[0123] A "dedicated app" refers to software that runs on mobile devices such as smartphones and tablets and allows passengers to specify their seating preferences.

[0124] "Mobile Device" refers to smartphones, tablets, and similar portable electronic devices.

[0125] "Monitoring devices" refers to devices such as cameras used to monitor the situation inside the store in real time and detect vacant seats and customer behavior.

[0126] "Vacancy information" refers to information indicating the current occupancy status (vacant or full) of each seat in the store.

[0127] "Analysis device" refers to AI or software that analyzes data obtained from monitoring devices and determines seat availability and user behavior.

[0128] "Matching candidates" refers to a list of existing passengers who can move seats, selected by the analysis device.

[0129] "Display device" refers to an electronic display or tablet installed in a seat to show passengers the option of whether or not to move.

[0130] "Movement availability inquiry" refers to a message sent from the server to the display device asking the previous passenger whether or not it is possible to move seats.

[0131] The "action approval means" refers to a means for recognizing the action of a previous passenger to accept or reject a seat change and processing the result of the action.

[0132] "Points Processing" means the act of adding or subtracting points from a Customer's account in response to the acceptance or denial of a seat change.

[0133] "Latest seating information" refers to updated seating arrangements and availability information based on current seat usage.

[0134] "Notification" refers to a message sent to inform users of updated seating information.

[0135] This invention is a system for optimizing the use of vacant seats in stores and facilities. It realizes efficient seat management and comfortable seating, particularly at counter seats in restaurants and other establishments. An embodiment of this system is described in detail below.

[0136] System Overview

[0137] This system allows customers to specify their seating preferences through a dedicated app, and then uses AI and various hardware to analyze and guide information about available seats in the restaurant, matching customers who want to sit next to each other with existing customers who are available to move to their seats.The system mainly includes the following components.

[0138] A way for users to specify their seating preference through a dedicated app on their mobile device

[0139] A means for detecting seat availability and user behavior using a monitoring device

[0140] A means for selecting candidates to encourage users to move seats based on vacant seat information analyzed using an analysis device

[0141] A means for inquiring about the availability of seats to potential passengers using a display device installed in the seat

[0142] A means for processing points when the previous customer's movement is approved using the operation approval means.

[0143] A means of obtaining the latest seat information and notifying users

[0144] A means to manage the addition or subtraction of points based on the result of transfer approval

[0145] Hardware and Software Configuration

[0146] 1. Mobile devices (smartphones and tablets):

[0147] Users can use this to launch a dedicated app and specify their login and seating preferences.

[0148] 2. Surveillance equipment (in-store cameras):

[0149] The cameras monitor all seats in the restaurant, monitoring vacant seats and customer behavior in real time.

[0150] 3. Analysis equipment (server including AI):

[0151] The server receives the video data sent from the camera and uses AI to analyze seat availability and user behavior.

[0152] 4. Display device (seat-mounted tablet):

[0153] The server sends an inquiry as to whether or not the movement is possible to the display device, and the display device displays options on the screen.

[0154] The user (previous customer) accepts or rejects the move.

[0155] 5. Points Management System:

[0156] The server manages the addition and subtraction of points based on the result of the transfer approval.

[0157] 6. Latest seat information notification system:

[0158] The server updates the database with the latest seat information and notifies the user.

[0159] Specific examples

[0160] Couples visiting the store

[0161] The specific flow of system operation when couple A and B visit a restaurant is shown below:

[0162] User A launches the dedicated app on their smartphone and logs in.

[0163] User A selects the "Sit side by side" option in the app.

[0164] The server receives real-time video footage from the in-store camera and analyzes it using AI, detecting that there is currently one vacant seat at the counter.

[0165] Based on the analysis results, the server lists the available seats as match candidates. The seats of the listed seats are equipped with display devices.

[0166] The server sends a query about whether or not the user can move to the display device installed at the seat of the previous user listed on the server. A pop-up message asking whether or not the user can move appears on the display device screen.

[0167] User B (the previous customer) accepts the move on the display screen. To accept, he simply touches the "Accept" button.

[0168] The server will grant 100 points to user B and subtract 100 points from user A. The information about the addition and subtraction of points will be notified to both users.

[0169] User B moves to a new seat. The position information of the new seat is displayed on the display device, so User B moves while referring to it.

[0170] The server updates the seat information and notifies User A's dedicated app. The notification includes the message "Your seat is ready."

[0171] User A and his partner sit next to each other at the seats they were assigned.

[0172] Prompt Sentence Examples

[0173] "Generate a sentence to explain the system's processing when a couple visits a restaurant and requests to sit next to each other."

[0174] With the above configuration, the present invention realizes efficient seat management and improved customer satisfaction at counter seats in restaurants and other establishments.

[0175] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0176] Program processing steps

[0177] Step 1:

[0178] The user launches the dedicated app on their mobile device and logs in, entering their user ID and password.

[0179] The terminal authenticates the user by sending login information to the server. The output is whether authentication was successful and the session ID.

[0180] Specifically, the user enters their ID and password on the app's login screen and touches the "Login" button. The device then sends this information to the server, which then authenticates them using the database.

[0181] Step 2:

[0182] The user selects the "Sit side by side" option from the app menu. The input is the user's selection.

[0183] The terminal sends this request to the server, and the output is a request to the server.

[0184] Specifically, the user selects the "Sit next to each other" option on the app's menu screen and touches the select button. The device then sends the selection information to the server.

[0185] Step 3:

[0186] The server receives video data from cameras in the store in real time. The input is the camera video data.

[0187] The server uses AI (analysis equipment) to analyze the video data and obtain information on available seats and user behavior. The output is the analysis result: available seat information.

[0188] Specifically, the server sends video data from the camera to an analysis device, and the AI ​​analyzes the data to create information about available seats.

[0189] Step 4:

[0190] The server uses the analysis results to detect available seats and available passengers. The input is the analysis results.

[0191] The server lists the previous customers who can be moved. The output is a list of the previous customers who can be moved.

[0192] Specifically, the server analyzes the analysis results and creates a list of existing customers who meet the conditions and can be moved.

[0193] Step 5:

[0194] The server sends a request to the seat of the previous user listed in the list to ask whether the user can move to that seat. The input is the list of previous users and the move request.

[0195] The terminal (display device) displays the option of whether to move to the seat of the previous customer. The output is the choice of whether to move or not.

[0196] Specifically, the server sends information to each display device based on a list of previous customers, and the display device displays a pop-up screen with options for whether or not to move. The previous customer touches the option to make a selection.

[0197] Step 6:

[0198] The terminal sends a response of acceptance of the move to the server. The input is the choice of acceptance or rejection of the previous user.

[0199] The server receives the user's transfer approval result, adds or subtracts points, and outputs the updated points.

[0200] Specifically, the display device sends the selection result to the server, which then adds or subtracts points and notifies the user of the result.

[0201] Step 7:

[0202] The user (previous customer) moves to the specified new seat. The input is the new seat information.

[0203] The server updates the database with the latest seating information. The output is the updated seating information.

[0204] Specifically, the preceding customer follows the instructions on the display device to move to a new seat, and the server updates the seat information accordingly.

[0205] Step 8:

[0206] The terminal notifies the user requesting a seat of the latest available seat information. The input is the updated seat information.

[0207] The user sits down at the seat they were assigned. The output is that the user has sat down.

[0208] Specifically, the server notifies a dedicated app of vacant seat information, and the user receives the information, moves to the designated seat, and takes a seat.

[0209] Through the above steps, a system is completed that realizes efficient seat management and improved user satisfaction.

[0210] (Application example 1)

[0211] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0212] Seating management has become a major issue in restaurants and various facilities today. In particular, there is a need to efficiently manage demand for seating alongside one another, such as at counter seats, and information on available seats in real time, but conventional systems have not been able to meet this need. Furthermore, there is a lack of incentives and smooth communication between customers when switching seats, creating a need for a method to achieve efficient and satisfying seating management. Furthermore, it is difficult to analyze customer trends in real time and provide appropriate guidance.

[0213] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0214] In this invention, the server includes: means for a user to specify a seating preference through a dedicated application; means for detecting vacant seat information and user behavior using an image capture device; means for selecting candidate seats to encourage users to move to based on vacant seat information analyzed using an analysis device; means for inquiring of the candidate preceding customer regarding seat relocation using a display device installed at the seat; means for processing points when the preceding customer agrees to the move using an action approval means; means for acquiring the latest seat information and providing guidance to the user; means for displaying vacant seat information and candidate seat status in real time via a smart device; means for providing optimal guidance to the user based on destination seat information; and means for managing the user's point balance and adding or subtracting points as the seat is moved. This enables more efficient and satisfying seat management and realizes the user's seating preferences.

[0215] A "dedicated application" is software with specific functions that allow users to specify seating preferences.

[0216] An "image capture device" is a device that uses a device such as a camera to capture information about vacant seats in a store and the behavior of customers, and acquires the data.

[0217] The "analysis device" is a device that analyzes seat availability information and user behavior based on acquired image data and determines optimal seat usage.

[0218] A "display device" is a device that is installed in a seat and displays information and inquiries about whether or not movement is possible to users and previous passengers.

[0219] The "action approval means" is a means for confirming that a previous passenger has consented to a seat change and for processing points.

[0220] "Latest seat information" refers to information that reflects the current seat usage and availability in real time.

[0221] A "smart device" is an electronic device such as a smartphone or tablet that can display information and communicate.

[0222] "Point balance" is a numerical value indicating the total amount of points owned by a user.

[0223] "Vacant seat information" is information indicating which seats are available in the restaurant.

[0224] "Customer behavior" is information that indicates the movement and behavior of the customer within the store.

[0225] This invention provides a system for efficiently managing seats in brick-and-mortar stores and realizing the seating preferences of customers. As a specific example, it targets the management of counter seats in restaurants.

[0226] System Configuration

[0227] 1. Dedicated application:

[0228] Users launch the application on their smartphone and specify their preference for seating next to each other. The application has functions such as login, checking available seat information, checking potential seat changes, and managing points.

[0229] 2. Image acquisition device:

[0230] IP cameras and other devices installed in the restaurant capture real-time footage of seat usage, and this video data is sent to a server.

[0231] 3. Analysis equipment:

[0232] Analysis software connected to the server analyzes the received video data using image analysis libraries such as OpenCV to obtain information on available seats and user behavior.

[0233] 4. Display device:

[0234] We use tablets and displays installed in the seats, which display a screen asking the previous passenger if they would like to move seats.

[0235] 5. Operational Approval Methods:

[0236] If the previous customer agrees to the seat change, the information is sent to the server and points are added or subtracted. Points are managed using a database.

[0237] 6. Acquisition and notification of seat availability information:

[0238] Based on the analysis results, the server updates the database with the latest seating information and notifies users in real time via a smartphone application.

[0239] Specific Examples

[0240] Couples visiting the store

[0241] Let's explain a scenario where A and B come to a restaurant as a couple.

[0242] Step 1: Person A launches the dedicated app on their smartphone and logs in.

[0243] Step 2: Person A selects the "Sit side by side" option in the app.

[0244] Step 3: The server receives real-time video data from the in-store camera, and the analysis device analyzes the data. Information about vacant seats and the behavior of previous customers are detected.

[0245] Step 4: The server lists the existing customers who can be moved as matching candidates.

[0246] Step 5: The server sends a request to the tablet installed in the seat of the previous passenger to inquire whether they are allowed to move.

[0247] Step 6: Mr. B (the previous customer) accepts the move on the tablet, and points are awarded upon the previous customer's acceptance.

[0248] Step 7: The server updates the database with the latest seat information and notifies the user.

[0249] Step 8: Mr. A and his partner sit next to each other in the seats they were assigned.

[0250] Prompt Sentence Examples

[0251] A couple visits a restaurant using the "Smart Seat" app. They register their preference to sit next to each other, and the app analyzes the available seating information in the restaurant. They are matched with a customer who is available to move, and the customer agrees to the move using points. Generate appropriate prompts and explain the specific steps.

[0252] This system allows customers to use seats comfortably and efficiently, and also allows stores to optimize seat management.In addition, by introducing a point system, it becomes easier to get cooperation from previous customers.

[0253] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0254] Step 1:

[0255] The user launches the dedicated application on their smartphone and logs in.

[0256] Input: User ID and password

[0257] Data processing and calculation: The terminal sends the login information to the server, and the server performs authentication. After authentication, the session begins.

[0258] Output: Successful login status and user information

[0259] Step 2:

[0260] The user selects the "Sit Side by Side" option from the application's menu.

[0261] Input: User's seat preference option selection

[0262] Data processing and calculation: The terminal sends the user's desired data to the server, which receives the request and begins processing.

[0263] Output: The preference to sit next to each other is recorded on the server.

[0264] Step 3:

[0265] The server receives video data from cameras in the store in real time.

[0266] Input: Video data from the camera

[0267] Data processing and calculation: The server acquires the video data and performs image analysis using an analysis device. OpenCV is used to extract seat availability information and user behavior.

[0268] Output: Analysis results of vacant seats and user behavior data

[0269] Step 4:

[0270] Based on the analysis results, the server lists seats of existing customers that can be moved to (matching candidates).

[0271] Input: Vacant seat information and user behavior data

[0272] Data processing and calculation: The server uses a clustering algorithm such as DBSCAN to identify potential customers.

[0273] Output: Match candidate list

[0274] Step 5:

[0275] The server sends a request to the seat of the previous occupant listed in the list.

[0276] Input: Match candidate list

[0277] Data processing and calculation: The server sends a query to the listed previous customer's terminal asking whether or not the transfer is possible.

[0278] Output: The move / non-move selection screen displayed on the customer's device

[0279] Step 6:

[0280] The user (previous customer) checks the options displayed on the terminal regarding whether or not to move, and accepts or rejects the move.

[0281] Input: Select whether to move the previous customer

[0282] Data processing and calculation: The terminal sends the selection information of the previous customer to the server, and performs approval processing using the operation approval means.

[0283] Output: Move acceptance or rejection status

[0284] Step 7:

[0285] The server processes points when the previous customer's permission to move is obtained.

[0286] Input: Previous customer's travel consent information

[0287] Data processing and calculation: The server performs point addition and subtraction processing and updates the user's point balance in the database.

[0288] Output: Point update information

[0289] Step 8:

[0290] The server obtains the latest seat information and provides it to the user.

[0291] Input: Final seat status and movement results

[0292] Data processing and calculation: The server updates the database with the latest seat information and notifies the user via the terminal.

[0293] Output: Latest seat information notification

[0294] Step 9:

[0295] The user (the user who has been guided to the new seat) moves to the designated new seat and sits down.

[0296] Input: User seating information

[0297] Data processing and calculation: Confirm that the user has completed their movement and that the system is operating normally.

[0298] Output: Status of the user having taken the new seat

[0299] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0300] The following describes in detail an embodiment of the present invention that combines an emotion engine. The present invention is a system for optimizing the use of vacant seats in stores and facilities, and achieves efficient seating management and comfortable seating, particularly at counter seats in restaurants and other establishments. The adoption of an emotion engine aims to further improve user satisfaction.

[0301] System Overview

[0302] The system includes the following means:

[0303] 1. How to specify your seating preference using a dedicated app

[0304] 2. Means for detecting vacant seat information using an image capture device

[0305] 3. Method for selecting matching candidates by the analysis device

[0306] 4. Means for inquiring whether movement is possible or not using a display device

[0307] 5. Point processing means by operation approval means

[0308] 6. Acquisition and guidance of the latest seat information

[0309] 7. Emotion Recognition Method Using Emotion Engine

[0310] With this configuration, users can specify their seating preferences through a dedicated app, and the combination of AI analysis and an emotion engine ensures efficient seat management and comfortable seating.

[0311] Program processing explanation

[0312] 1. User launches app

[0313] The user launches a dedicated app on their smartphone and logs in.

[0314] The terminal sends login information to the server, and the server authenticates the user information and starts the session.

[0315] 2. Select "Sit side by side"

[0316] The user selects the "Sit Side by Side" option from the app's menu.

[0317] The terminal sends this request to the server.

[0318] 3. Detecting vacant seat information

[0319] The server receives video data from cameras in the store in real time.

[0320] The server's AI (analysis device) analyzes the video data and detects seat availability and user behavior.

[0321] 4. Emotional Recognition

[0322] The server's emotion engine analyzes the user's facial expressions and voice to recognize their emotions.

[0323] 5. Selection of match candidates

[0324] Based on the analyzed seat availability information and emotion data, the server creates a list of seats (matching candidates) that are available for movement to.

[0325] 6. Inquiry about transfer availability

[0326] The server sends a question about whether the user can move to the tablet installed at the listed seat.

[0327] The terminal (a tablet at the previous customer's seat) displays the option to move or not.

[0328] The user (previous customer) selects whether or not to move using a tablet, and the emotion engine increases the likelihood of the move being accepted.

[0329] 7. Points Processing

[0330] The terminal sends a response to the server approving the move.

[0331] If the user (previous customer) agrees to the move, the server manages the addition or subtraction of points.

[0332] 8. Seat Movement and Latest Updates

[0333] The user (previous customer) moves to the new seat specified.

[0334] The server updates the database with the latest seating information and reflects it in real time.

[0335] 9. Seating Instructions

[0336] The terminal (dedicated app) notifies users who wish to sit down of the latest available seat information.

[0337] The user sits down at the seat he or she is assigned.

[0338] Specific examples

[0339] Couples visiting the store

[0340] Let's take the example of a couple, A and B, visiting a restaurant.

[0341] 1. User A launches the dedicated app on their smartphone and logs in.

[0342] 2. User A selects the "Sit side by side" option in the app.

[0343] 3. The server receives video from the in-store camera, and the AI ​​and emotion engine analyze it. Along with the seat availability information, it recognizes that there is one vacant seat at the counter and the user's emotion.

[0344] 4. The server lists available customers as matching candidates based on the seat availability information and emotion data.

[0345] 5. The server sends a request to the tablet installed at the seat of the previous customer listed on the list to inquire whether they can move.

[0346] 6. When User B (the previous customer) agrees to the move on the tablet, the emotion engine analyzes User B's emotions and determines that there is a low possibility of refusal.

[0347] 7. The server grants 100 points to User B and subtracts 100 points from User A.

[0348] 8. User B moves to a new seat.

[0349] 9. The server updates the seat information and notifies the app.

[0350] 10. User A and his partner sit next to each other at the seats they were assigned.

[0351] By utilizing the emotion engine, it becomes possible to manage seats taking into account the user's emotions, which is expected to improve user satisfaction.

[0352] The processing flow will be explained below.

[0353] Step 1:

[0354] The user launches a dedicated app on their smartphone and logs in.

[0355] Step 2:

[0356] The terminal sends the user's login information to the server, and the server authenticates the user information and starts a session.

[0357] Step 3:

[0358] The user selects the "Sit Side by Side" option from the app's menu.

[0359] Step 4:

[0360] The terminal transmits the selection information of the "sit side by side" option to the server.

[0361] Step 5:

[0362] The server receives video data from cameras in the store in real time.

[0363] Step 6:

[0364] The server's AI (analysis device) analyzes the video data and detects vacant seat information and user behavior.

[0365] Step 7:

[0366] The server's emotion engine analyzes the user's facial expressions and voice from camera and microphone input data and recognizes their emotions.

[0367] Step 8:

[0368] Based on the analyzed seat availability information and emotion data, the server creates a list of seats (matching candidates) that are available for movement to.

[0369] Step 9:

[0370] The server sends a question about whether the user can move to the tablet installed at the listed seat.

[0371] Step 10:

[0372] The terminal (a tablet at the previous customer's seat) displays the option to move or not.

[0373] Step 11:

[0374] The user (previous customer) selects whether or not to move using a tablet.

[0375] Step 12:

[0376] The server's emotion engine analyzes the emotions of the previous customer, and if it determines that there is little resistance to movement, it increases the priority.

[0377] Step 13:

[0378] The device (tablet) sends a response to the server approving the move.

[0379] Step 14:

[0380] The server receives the result of the transfer approval and processes the addition or subtraction of points.

[0381] Step 15:

[0382] The server will give 100 points to the user (previous customer) and subtract 100 points from the user who requested to "sit next to each other."

[0383] Step 16:

[0384] The user (previous customer) moves to the new seat specified.

[0385] Step 17:

[0386] The server updates the database with the latest seat information.

[0387] Step 18:

[0388] The server notifies the app of the updated seat information.

[0389] Step 19:

[0390] The terminal (dedicated app) notifies the user who wishes to sit down of the available seat after the move.

[0391] Step 20:

[0392] The user sits down at the seat he or she is assigned.

[0393] These are the specific processing steps of the program in this system. By adding an emotion engine, it is possible to take the user's emotions into consideration and provide a more natural and comfortable experience.

[0394] Example 2

[0395] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0396] Conventional systems have not been able to fully optimize seat utilization and improve customer satisfaction in restaurants and other facilities. In particular, in situations such as counter seating, achieving both efficient seat management and comfortable seating for customers is a challenge. Furthermore, flexible seating arrangements that take customer emotions into consideration are difficult, which can lead to lower customer satisfaction.

[0397] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for a user to specify a seating preference through a dedicated app; a means for detecting vacant seat information and user behavior using an image capture device; a means for selecting candidates for seat movement among users based on vacant seat information analyzed using an analysis device; a means for inquiring of the candidate preceding passenger regarding seat movement availability using a display device installed at the seat; a means for processing points when the preceding passenger agrees to the seat movement using an action approval means; a means for recognizing the user's emotions using an analysis device and using the data to determine whether to move seats; and a means for acquiring the latest seat information and providing the user with information. This enables efficient seat management, realizes flexible seat movement that takes user emotions into consideration, and is expected to improve user satisfaction.

[0398] A "user" is someone who operates a dedicated app or system to specify their seating preference or move to another seat.

[0399] A "dedicated app" is application software that allows users to specify seat preferences and travel on devices such as smartphones and tablets.

[0400] An "image capture device" is a camera or sensor installed in a store or facility to capture information on available seats and user behavior in real time.

[0401] "Vacant seat information" refers to data indicating whether seats are available in a store or facility.

[0402] "Customer behavior" refers to the actions and activities that customers perform in the store, which are detected by cameras and sensors.

[0403] The "analysis device" refers to hardware or software that analyzes data obtained from the image capture device and recognizes seat availability information and user emotions.

[0404] A "display device" is a screen installed at a seat that displays information and questions to passengers.

[0405] The "action approval means" refers to a mechanism or means for confirming that the user has approved the seat change, and is related to the processing of points.

[0406] "Point processing" refers to the process of adding or subtracting points when a seat change occurs between users.

[0407] An "emotion engine" is software or hardware that analyzes a user's facial expressions and voice and recognizes their emotions.

[0408] "Real-time" is a term that indicates that data acquisition, analysis, and information updates are immediate.

[0409] A "database" is a digital information storage location for centrally managing seating information, user behavior, point information, etc.

[0410] "Guidance means" refers to the mechanism or method for informing users of the latest seat information and providing guidance.

[0411] "Counter seats" are seats set up along the counter in restaurants and other establishments.

[0412] The present invention is a system for optimizing the use of vacant seats in stores and facilities, and realizes efficient seating management and comfortable seating, particularly at counter seats in restaurants and other establishments. By adopting an emotion engine, the system aims to further improve user satisfaction. Specific embodiments for implementing this system are described below.

[0413] System Overview

[0414] The system includes the following means:

[0415] 1. User launches app

[0416] The user launches a dedicated app on their smartphone and logs in. The device sends the login information to the server, which then authenticates the user information and starts the session.

[0417] 2. Specify seating preference

[0418] The user selects the "sit next to each other" option in the app, and the device sends this preference to the server.

[0419] 3. Detecting vacant seat information

[0420] The server receives video data from cameras in the store in real time, and an AI analysis device analyzes the video data to detect seat vacancies and customer behavior.

[0421] 4. User Emotion Recognition

[0422] The server's emotion engine analyzes the user's facial expressions and voice to recognize their emotions. The emotion engine is software or hardware that analyzes the user's facial expressions and voice to recognize their emotions.

[0423] 5. Selection of migration candidates

[0424] Based on the analyzed seat availability information and emotion data, the server creates a list of seats available for existing occupants to move to.

[0425] 6. Inquiry about transfer availability

[0426] The server sends a question about whether or not the customer wants to move to a tablet installed on the list of seats, and the customer selects whether or not they want to move on the tablet. The terminal then sends the selection information to the server.

[0427] 7. Points Processing

[0428] If the server receives approval for the seat change, it adds or subtracts points. The operation approval means is a mechanism or means for confirming that the user has approved the seat change, and is related to point processing.

[0429] 8. Seat Movement and Database Update

[0430] The user (previous customer) moves to a new seat, and the server updates the database with the latest seat information, reflecting it in real time.

[0431] 9. Seating Instructions

[0432] Based on the latest information on available seats, the server uses a dedicated app to notify the user requesting a seat of the latest information, and the user then takes the seat indicated to them.

[0433] Hardware and software used

[0434] Dedicated app: Application software that allows users to specify their seating preferences on a smartphone or tablet.

[0435] Image acquisition devices: Cameras and sensors installed in the store.

[0436] Analysis device: An AI system for analyzing video and audio data.

[0437] Emotion engine: Software or hardware that analyzes a user's facial expressions and voice to recognize emotions.

[0438] Display device: A screen such as a tablet.

[0439] Operation approval means: A system for adding or subtracting points.

[0440] Specific examples

[0441] Couples visiting the store

[0442] 1. User A launches the dedicated app on their smartphone and logs in.

[0443] 2. User A selects the "Sit side by side" option in the app.

[0444] 3. The server receives footage from the in-store camera, and the AI ​​and emotion engine analyze it.

[0445] 4. The server creates a list of available customers based on seat availability information and emotion data.

[0446] 5. The server sends a query to the tablet installed in the target seat asking whether the move is possible.

[0447] 6. User B (the previous customer) accepts the move on his tablet, and the server receives this information.

[0448] 7. The server processes the points and awards them to User B.

[0449] 8. User B moves to a new seat and the server updates the seat information.

[0450] 9. The dedicated app notifies User A of the latest available seat information, and User A takes the designated seat.

[0451] Prompt Sentence Examples

[0452] Below are some examples of prompt sentences to input to the generative AI model.

[0453] "Please explain in detail your seating management system for restaurants, including the specific steps of the system and how users use the app."

[0454] This prompt can be used to get a detailed explanation of the system, as well as additional information on how to specifically utilize the emotion engine and how the point system operates.

[0455] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0456] Step 1:

[0457] User launches app

[0458] The user launches the dedicated app on their smartphone.

[0459] The user enters their ID and password on the login screen and clicks the login button.

[0460] The terminal encrypts the entered login information and sends it to the server.

[0461] The server receives the login information and authenticates it by checking it against the database. The input is the user's ID and password, and the output is the authentication result (success / failure).

[0462] If the authentication is successful, the server generates a session ID and returns it to the terminal.

[0463] Step 2:

[0464] Specify seating preference

[0465] The user selects the "Sit Side by Side" option from the app's menu.

[0466] The terminal sends the user's preference to the server, indicating that they want to sit next to each other. The input is the user's preference, and the output is a confirmation of the transmission to the server.

[0467] The server records the desired information in a database and starts obtaining seat availability information.

[0468] Step 3:

[0469] Detecting vacant seat information

[0470] The server receives video data from cameras in the store in real time.

[0471] The analysis device analyzes the video data and detects seat availability and user behavior. The input is real-time video data, and the output is seat availability information and user behavior data.

[0472] The server stores the analysis results in a database.

[0473] Step 4:

[0474] User emotion recognition

[0475] The server's emotion engine analyzes the acquired video and audio data.

[0476] The emotion engine recognizes emotions from the user's facial expressions and voice. The input is video and audio data, and the output is the user's emotional data.

[0477] The server records the emotion data in a database.

[0478] Step 5:

[0479] Selection of candidates for transfer

[0480] The server creates a list of seats available for existing occupants to move to based on vacant seat information and emotion data.

[0481] The list is created by taking into consideration whether the seats are close to empty or whether the emotional data is positive. The input is empty seat information and emotional data, and the output is a list of candidates for movement.

[0482] The server stores the migration candidate list in a database.

[0483] Step 6:

[0484] Inquiry about whether moving is possible

[0485] The server sends a question about whether or not the user can move to a tablet installed on the seat on the candidate list.

[0486] The customer's tablet displays the question "Do you want to move?" and offers options. The input is a list of possible moves, and the output is a display of options for whether or not to move.

[0487] The user (previous customer) selects "move" or "don't move" on the tablet. The device sends the selected move permission information to the server.

[0488] Step 7:

[0489] Processing points

[0490] If the server approves the move, it adds or subtracts points.

[0491] The server adds the points of the previous customer and subtracts the points of the requesting customer. The input is the travel approval information, and the output is the point addition / subtraction result.

[0492] The server stores the point information in a database.

[0493] Step 8:

[0494] Seat movement and database updates

[0495] The user (previous customer) moves to the new seat indicated.

[0496] The server updates the seating information to the database, reflecting the overall seating situation in real time. The input is the movement fact, and the output is the updated seating data.

[0497] Step 9:

[0498] Seating instructions

[0499] Based on the latest seat availability information, the server uses a dedicated app to send notifications to users who wish to sit down.

[0500] The terminal (dedicated app) displays a notification to the user who wishes to sit and guides them to the seat they are assigned. The input is the latest vacant seat information, and the output is a notification to the user.

[0501] The user follows the notification and takes the designated seat.

[0502] (Application example 2)

[0503] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0504] Seating management in restaurants is an important factor in ensuring customers have a comfortable experience. However, especially during busy times at restaurants, customers often find it difficult to sit next to each other or in the seats they desire. Furthermore, seating is often assigned without regard for customers' feelings, often resulting in an unsatisfactory experience. This reduces customer satisfaction at restaurants. Another problem is the lack of smooth communication between customers who wish to move seats and those already seated.

[0505] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for a user to specify a seating preference through a dedicated app; a means for detecting vacant seat information and user behavior using an image capture device; a means for selecting candidates for seats to be encouraged among users based on vacant seat information analyzed using an analysis device; a means for inquiring of the candidate preceding passengers about whether they are willing to move seats using a display device installed at the seat; a means for processing points when the preceding passenger agrees to the move using an action approval means; a means for acquiring the latest seat information and providing guidance to the user; a means for recognizing the user's emotions using an emotion engine; and a means for suggesting an appropriate seat based on emotion recognition data. This enables comfortable seat management that takes the user's emotions into consideration and smooth communication in response to a move request.

[0506] A "user" is a customer who wishes to use a seat at a store.

[0507] A "dedicated app" is software that is installed on personal devices such as smartphones and tablets and used to manage seating at stores.

[0508] An "image capture device" is a camera or sensor that captures images and videos of the inside of a store in real time.

[0509] "Vacant seat information" is data indicating the status of seats currently not in use within the restaurant.

[0510] "Behavior" refers to actions such as movements and movements that customers make within the store.

[0511] The "analysis device" is a computer device that analyzes the acquired images and data to determine whether there are vacant seats and the behavior of users.

[0512] A "display device" is a device for visually displaying information, such as a display or tablet.

[0513] "Previous customer" refers to a user who is already seated.

[0514] "Movement possible" refers to an inquiry as to whether it is possible to move from the current seat to another seat.

[0515] The "action approval means" is a means for expressing the intention to approve or reject a seat change.

[0516] "Points" are rewards or incentives that are awarded to users when they agree to a seat change, or that are deducted from those who wish to move.

[0517] "Latest seat information" is data showing the current seat availability and usage status in the latest state.

[0518] An "emotion engine" is an algorithm or software that analyzes facial expressions and voice to recognize the user's emotional state.

[0519] "Emotion recognition data" is data that indicates the emotional state of the user as determined by the emotion engine.

[0520] "Appropriate seating" refers to the seating that is deemed to best match the user's preferences and emotional state.

[0521] Below, we will explain in detail a system that optimizes the use of empty seats in physical stores by combining an emotion engine.

[0522] System configuration

[0523] The system includes the following main hardware and software:

[0524] Hardware

[0525] 1. Smartphone

[0526] This is a device on which users can install a dedicated app and log in and specify their preferred seat.

[0527] 2. In-store cameras

[0528] This is a device that obtains information on available seats in the store and customer behavior in real time.

[0529] 3. In-store tablets

[0530] This device is used to ask seated users whether they wish to move seats.

[0531] software

[0532] 1. Dedicated app

[0533] It is software that is installed on a smartphone and allows the user to interact with the system.

[0534] 2. Emotion Engine

[0535] These are algorithms and software that analyze facial expressions and voice data to recognize the user's emotions.

[0536] Example: Face++, Affectiva SDK

[0537] 3. Data Analysis Software

[0538] This software analyzes the captured video and data to determine seat availability and user behavior.

[0539] Examples: OpenCV, TensorFlow

[0540] 4. Points Management System

[0541] This is a system for managing the addition and subtraction of points between users.

[0542] Examples: Firebase, AWS DynamoDB

[0543] 5. Real-time streaming services

[0544] This is a service that transmits video data from cameras in-store to a server in real time.

[0545] Examples: Amazon Kinesis, Google Cloud Pub / Sub

[0546] Program processing

[0547] The server performs seat management based on the following series of procedures.

[0548] 1. A way for users to specify their seating preference through a dedicated app

[0549] The server receives the request from the smartphone, authenticates the login information, and starts the session.

[0550] 2. Means of detecting vacant seat information and user behavior using an image capture device

[0551] The server receives video data from cameras in the store in real time and analyzes seat availability and customer behavior.

[0552] 3. A method for selecting candidates to encourage seat changes among users based on the analyzed vacant seat information

[0553] Based on the information on available seats, the server creates a list of seats available for existing customers and selects candidates.

[0554] 4. A means for inquiring about the availability of seats to potential passengers using a display device installed in the seat.

[0555] The server will then use a tablet in the store to ask the previous customers on his list whether they would like to move seats.

[0556] 5. A means for processing points when the previous customer's permission to move is obtained using the operation approval means.

[0557] The server receives the previous customer's permission to move and adds or subtracts points.

[0558] 6. A means of obtaining the latest seating information and providing it to users

[0559] The server updates the database with the latest available seat information and notifies the user.

[0560] 7. A method for recognizing user emotions using an emotion engine

[0561] The server analyzes the user's facial expressions and voice data using an emotion engine to recognize emotions.

[0562] 8. A method to suggest appropriate seats based on emotion recognition data

[0563] The server will suggest the most appropriate seat to the user based on emotion recognition data.

[0564] Specific examples

[0565] Couples visiting the store

[0566] 1. User A launches the dedicated app on their smartphone and logs in.

[0567] 2. User A selects the "Sit side by side" option in the app.

[0568] 3. The server receives footage from the in-store camera, and data analysis software and an emotion engine analyze seat availability and customer emotions.

[0569] 4. The server creates a list of available customers based on seat availability information and emotion data.

[0570] 5. The server sends a request to the tablet installed at the previous customer's seat to inquire whether they can move.

[0571] 6. When the previous customer accepts the move using the tablet, points are awarded using the point management system.

[0572] 7. The previous customer moves to a new seat, and the server updates the database with the latest seat information.

[0573] 8. User A sits next to the seat assigned to him.

[0574] Example prompts for generative AI models

[0575] Generate a program for a seating optimization system for a brick-and-mortar store based on the following requirements:

[0576] 1. A feature that allows users to log in using a smartphone app.

[0577] 2. A function that receives real-time video footage from cameras inside the store and analyzes seat availability information.

[0578] 3. Facial expression and voice analysis function using an emotion engine.

[0579] 4. A function that suggests suitable seats based on seat availability information and sentiment data.

[0580] 5. Ability to send and approve transfer requests to existing seat users via tablet.

[0581] 6. Ability to award points to users who approve the move.

[0582] 7. A function that notifies users of the latest available seat information and provides guidance in real time.

[0583] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0584] Step 1:

[0585] The user launches a dedicated app on their smartphone and logs in. The device sends the user's authentication information to the server, which then checks the user information against a database to start a session. The input data is the username and password, and the output data is a flag indicating successful authentication and a session ID. Through this process, the server recognizes the user as legitimate and allows them to use the app.

[0586] Step 2:

[0587] The user selects the "Sit side by side" option from the app menu. The device sends this preference to the server. The input data is the "Sit side by side" preference, and the output data is the seating preference option sent to the server. In this step, the server records the user's seating preference.

[0588] Step 3:

[0589] The server receives video data from cameras in the store in real time. It then analyzes the video data using data analysis software (e.g., OpenCV, TensorFlow) to detect seat availability and customer behavior. The input data is the video stream, and the output data is seat availability information and customer behavior data. The server uses the acquired seat availability information to determine the current seating situation.

[0590] Step 4:

[0591] The server's emotion engine (e.g., Face++, Affectiva) analyzes the user's facial expressions and voice from the video data to recognize emotions. The input data is the user's facial expressions and voice data, and the output data is the emotion recognition results. This allows the server to understand the user's mood and state.

[0592] Step 5:

[0593] Based on the analyzed vacant seat information and emotion data, the server lists seats (matching candidates) that the user can move to in order to suggest an appropriate seat. The input data is vacant seat information and emotion recognition data, and the output data is a list of previous users. This allows the server to identify the most suitable seat for the user.

[0594] Step 6:

[0595] The server sends a request to the tablet installed at the seat of the preceding customer on the list to inquire about whether or not the customer can move. The input data is the message requesting the move, and the output data is the question about whether or not the customer can move, which is displayed on the tablet. The server notifies the preceding customer of the move request via the tablet.

[0596] Step 7:

[0597] The customer who is already seated selects whether or not they wish to move using a tablet. The input data is the choice made by the customer, and the output data is the selection result sent to the server. The terminal sends this data to the server, and the server receives the result.

[0598] Step 8:

[0599] The server receives the previous customer's response of approval for the move and processes the points using the operation approval means. The input data is the selection result of the move approval, and the output data is the point increase / decrease information. The server uses the point management system to award points to the approver and subtract points from the applicant.

[0600] Step 9:

[0601] The previous customer moves to the new seat they have assigned, and the new seat information is updated in the database. The input data is the new seat information, and the output data is the updated seat data. The server saves this data in the database, and reflects the latest seat information in real time.

[0602] Step 10:

[0603] Finally, the server notifies the user's smartphone of the latest available seat information, and the user sits in the seat indicated. The input data is the latest available seat information, and the output data is the guidance information displayed on the user's smartphone. This allows the user to smoothly sit in the designated seat.

[0604] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0605] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0606] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0607] [Second embodiment]

[0608] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0609] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0610] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0611] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0612] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0613] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0614] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0615] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0616] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0617] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0618] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0619] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0620] The present invention provides a system for optimizing the use of vacant seats in stores and facilities, and realizes efficient seat management and comfortable seating, particularly at counter seats in restaurants and other establishments.

[0621] System Overview

[0622] This system allows customers to specify their seating preferences through a dedicated app, and AI analyzes and guides them to available seats in the restaurant, matching customers who want to sit next to each other with customers who are available to move to other seats. Specifically, the system includes the following measures:

[0623] How to specify seating preference using a dedicated app

[0624] Vacant seat information detection means using an image capture device

[0625] Matching candidate selection means by analysis device

[0626] Means for inquiring whether movement is possible or not using a display device

[0627] Point processing means by operation approval means

[0628] Acquisition and guidance of the latest seat information

[0629] Program processing explanation

[0630] 1. User launches app

[0631] The user launches the dedicated app on their smartphone and logs in.

[0632] The terminal sends the login information to the server to start the session.

[0633] 2. Select "Sit side by side"

[0634] The user selects the "Sit Side by Side" option from the app's menu.

[0635] The terminal sends this request to the server.

[0636] 3. Detecting vacant seat information

[0637] The server receives video data from cameras in the store in real time.

[0638] The server uses AI (analysis device) to analyze the received data and obtain information on available seats and user behavior.

[0639] 4. Selection of match candidates

[0640] Based on the analysis results, the server creates a list of seats (matching candidates) that can be moved to.

[0641] 5. Inquiry about transfer availability

[0642] The server sends a request to the listed seats asking whether or not to move to them.

[0643] The terminal (a display device installed at the previous customer's seat) displays the option of whether or not to move.

[0644] The user (previous customer) accepts or rejects the move on the screen.

[0645] 6. Points Processing

[0646] The terminal sends a response to the server approving the move.

[0647] If the user (previous customer) agrees to the move, the server manages the addition or subtraction of points.

[0648] 7. Seat Transfers and Renewals

[0649] The user (previous customer) moves to the new seat specified.

[0650] The server updates the database with the latest seating information and reflects it in real time.

[0651] 8. Seating instructions

[0652] The terminal (dedicated app) notifies the user who wishes to sit down of the available seat after the move.

[0653] The user sits down at the seat he or she is assigned.

[0654] Specific examples

[0655] Couples visiting the store

[0656] Let's take the example of a couple, A and B, visiting a restaurant.

[0657] 1. User A launches the dedicated app on their smartphone and logs in.

[0658] 2. User A selects the "Sit side by side" option in the app.

[0659] 3. The server receives the video from the in-store camera and the analysis device analyzes it. It determines that there is currently one vacant seat at the counter.

[0660] 4. The server lists existing customers who can be moved as matching candidates.

[0661] 5. The server sends a request to the tablet installed at the seat of the previous customer listed on the list to inquire whether they can move.

[0662] 6. User B (previous customer) accepts the move on his tablet.

[0663] 7. The server grants 100 points to User B and subtracts 100 points from User A.

[0664] 8. User B moves to a new seat.

[0665] 9. The server updates the latest seat information and notifies the app.

[0666] 10. User A and his partner sit next to each other at the seats they were assigned.

[0667] The above specific examples enable efficient seat management and improved user satisfaction.

[0668] The processing flow will be explained below.

[0669] Step 1:

[0670] The user launches a dedicated app on their smartphone and logs in.

[0671] Step 2:

[0672] The terminal sends the user's login information to the server, and the server authenticates the user information and starts a session.

[0673] Step 3:

[0674] The user selects the "Sit Side by Side" option from the app's menu.

[0675] Step 4:

[0676] The terminal transmits the selection information of the "sit side by side" option to the server.

[0677] Step 5:

[0678] The server receives video data from cameras in the store in real time.

[0679] Step 6:

[0680] The server's AI (analysis device) analyzes the video data and obtains information about available seats and user behavior.

[0681] Step 7:

[0682] Based on the analysis results, the server creates a list of seats (matching candidates) that can be moved to.

[0683] Step 8:

[0684] The server sends a question to the tablet installed at the seat of the previous customer listed on the server asking whether they wish to move.

[0685] Step 9:

[0686] The terminal (a tablet at the previous customer's seat) displays the option to move or not.

[0687] Step 10:

[0688] The user (previous customer) selects whether or not to move using a tablet and sends the result to the server.

[0689] Step 11:

[0690] The server receives the result of the transfer approval and processes the addition or subtraction of points.

[0691] Step 12:

[0692] The server will give 100 points to the user who moved (the previous customer) and subtract 100 points from the user who requested to "sit next to each other."

[0693] Step 13:

[0694] The user (previous customer) moves to the new seat specified.

[0695] Step 14:

[0696] The server updates the database with the latest seat information.

[0697] Step 15:

[0698] The server notifies the app of the updated seat information.

[0699] Step 16:

[0700] The terminal (dedicated app) notifies the user who wishes to sit down of the available seat after the move.

[0701] Step 17:

[0702] The user sits down at the seat he or she is assigned.

[0703] The above are the specific processing steps of the program in this system.

[0704] Example 1

[0705] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0706] Traditionally, seating management in stores and facilities has relied heavily on human labor, and there has been a challenge in restaurants and other establishments, where it is difficult to find suitable empty seats when customers want to sit together at counter seats. Furthermore, when trying to make effective use of empty seats by having previous customers move, this arrangement becomes cumbersome, and there is a risk of customer satisfaction decreasing. A system that can solve these issues and improve efficient seating management and customer satisfaction has been sought.

[0707] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0708] In this invention, the server includes: means for users to specify their seating preferences through a dedicated app on a mobile device; means for detecting vacant seat information and user behavior using a monitoring device; means for selecting candidates for encouraging users to move seats based on vacant seat information analyzed using an analysis device; means for inquiring of the candidate preceding passengers about whether they are willing to move seats using a display device installed at the seat; means for processing points when the preceding passenger agrees to move using an action approval means; means for acquiring the latest seat information and notifying the user; and means for managing the addition and subtraction of points based on the result of the move approval. This enables efficient seat management and smooth adjustments due to the movement of users who want to sit next to each other or preceding passengers, thereby improving user satisfaction.

[0709] "User" refers to an individual or group that uses a dedicated app to specify their seating preference.

[0710] A "dedicated app" refers to software that runs on mobile devices such as smartphones and tablets and allows passengers to specify their seating preferences.

[0711] "Mobile Device" refers to smartphones, tablets, and similar portable electronic devices.

[0712] "Monitoring devices" refers to devices such as cameras used to monitor the situation inside the store in real time and detect vacant seats and customer behavior.

[0713] "Vacancy information" refers to information indicating the current occupancy status (vacant or full) of each seat in the store.

[0714] "Analysis device" refers to AI or software that analyzes data obtained from monitoring devices and determines seat availability and user behavior.

[0715] "Matching candidates" refers to a list of existing passengers who can move seats, selected by the analysis device.

[0716] "Display device" refers to an electronic display or tablet installed in a seat to show passengers the option of whether or not to move.

[0717] "Movement availability inquiry" refers to a message sent from the server to the display device asking the previous passenger whether or not it is possible to move seats.

[0718] The "action approval means" refers to a means for recognizing the action of a previous passenger to accept or reject a seat change and processing the result of the action.

[0719] "Points Processing" means the act of adding or subtracting points from a Customer's account in response to the acceptance or denial of a seat change.

[0720] "Latest seating information" refers to updated seating arrangements and availability information based on current seat usage.

[0721] "Notification" refers to a message sent to inform users of updated seating information.

[0722] This invention is a system for optimizing the use of vacant seats in stores and facilities. It realizes efficient seat management and comfortable seating, particularly at counter seats in restaurants and other establishments. An embodiment of this system is described in detail below.

[0723] System Overview

[0724] This system allows customers to specify their seating preferences through a dedicated app, and then uses AI and various hardware to analyze and guide information about available seats in the restaurant, matching customers who want to sit next to each other with existing customers who are available to move to their seats.The system mainly includes the following components.

[0725] A way for users to specify their seating preference through a dedicated app on their mobile device

[0726] A means for detecting seat availability and user behavior using a monitoring device

[0727] A means for selecting candidates to encourage users to move seats based on vacant seat information analyzed using an analysis device

[0728] A means for inquiring about the availability of seats to potential passengers using a display device installed in the seat

[0729] A means for processing points when the previous customer's movement is approved using the operation approval means.

[0730] A means of obtaining the latest seat information and notifying users

[0731] A means to manage the addition or subtraction of points based on the result of transfer approval

[0732] Hardware and Software Configuration

[0733] 1. Mobile devices (smartphones and tablets):

[0734] Users can use this to launch a dedicated app and specify their login and seating preferences.

[0735] 2. Surveillance equipment (in-store cameras):

[0736] The cameras monitor all seats in the restaurant, monitoring vacant seats and customer behavior in real time.

[0737] 3. Analysis equipment (server including AI):

[0738] The server receives the video data sent from the camera and uses AI to analyze seat availability and user behavior.

[0739] 4. Display device (seat-mounted tablet):

[0740] The server sends an inquiry as to whether or not the movement is possible to the display device, and the display device displays options on the screen.

[0741] The user (previous customer) accepts or rejects the move.

[0742] 5. Points Management System:

[0743] The server manages the addition and subtraction of points based on the result of the transfer approval.

[0744] 6. Latest seat information notification system:

[0745] The server updates the database with the latest seat information and notifies the user.

[0746] Specific examples

[0747] Couples visiting the store

[0748] The specific flow of system operation when couple A and B visit a restaurant is shown below:

[0749] User A launches the dedicated app on their smartphone and logs in.

[0750] User A selects the "Sit side by side" option in the app.

[0751] The server receives real-time video footage from the in-store camera and analyzes it using AI, detecting that there is currently one vacant seat at the counter.

[0752] Based on the analysis results, the server lists the available seats as match candidates. The seats of the listed seats are equipped with display devices.

[0753] The server sends a query about whether or not the user can move to the display device installed at the seat of the previous user listed on the server. A pop-up message asking whether or not the user can move appears on the display device screen.

[0754] User B (the previous customer) accepts the move on the display screen. To accept, he simply touches the "Accept" button.

[0755] The server will grant 100 points to user B and subtract 100 points from user A. The information about the addition and subtraction of points will be notified to both users.

[0756] User B moves to a new seat. The position information of the new seat is displayed on the display device, so User B moves while referring to it.

[0757] The server updates the seat information and notifies User A's dedicated app. The notification includes the message "Your seat is ready."

[0758] User A and his partner sit next to each other at the seats they were assigned.

[0759] Prompt Sentence Examples

[0760] "Generate a sentence to explain the system's processing when a couple visits a restaurant and requests to sit next to each other."

[0761] With the above configuration, the present invention realizes efficient seat management and improved customer satisfaction at counter seats in restaurants and other establishments.

[0762] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0763] Program processing steps

[0764] Step 1:

[0765] The user launches the dedicated app on their mobile device and logs in, entering their user ID and password.

[0766] The terminal authenticates the user by sending login information to the server. The output is whether authentication was successful and the session ID.

[0767] Specifically, the user enters their ID and password on the app's login screen and touches the "Login" button. The device then sends this information to the server, which then authenticates them using the database.

[0768] Step 2:

[0769] The user selects the "Sit side by side" option from the app menu. The input is the user's selection.

[0770] The terminal sends this request to the server, and the output is a request to the server.

[0771] Specifically, the user selects the "Sit next to each other" option on the app's menu screen and touches the select button. The device then sends the selection information to the server.

[0772] Step 3:

[0773] The server receives video data from cameras in the store in real time. The input is the camera video data.

[0774] The server uses AI (analysis equipment) to analyze the video data and obtain information on available seats and user behavior. The output is the analysis result: available seat information.

[0775] Specifically, the server sends video data from the camera to an analysis device, and the AI ​​analyzes the data to create information about available seats.

[0776] Step 4:

[0777] The server uses the analysis results to detect available seats and available passengers. The input is the analysis results.

[0778] The server lists the previous customers who can be moved. The output is a list of the previous customers who can be moved.

[0779] Specifically, the server analyzes the analysis results and creates a list of existing customers who meet the conditions and can be moved.

[0780] Step 5:

[0781] The server sends a request to the seat of the previous user listed in the list to ask whether the user can move to that seat. The input is the list of previous users and the move request.

[0782] The terminal (display device) displays the option of whether to move to the seat of the previous customer. The output is the choice of whether to move or not.

[0783] Specifically, the server sends information to each display device based on a list of previous customers, and the display device displays a pop-up screen with options for whether or not to move. The previous customer touches the option to make a selection.

[0784] Step 6:

[0785] The terminal sends a response of acceptance of the move to the server. The input is the choice of acceptance or rejection of the previous user.

[0786] The server receives the user's transfer approval result, adds or subtracts points, and outputs the updated points.

[0787] Specifically, the display device sends the selection result to the server, which then adds or subtracts points and notifies the user of the result.

[0788] Step 7:

[0789] The user (previous customer) moves to the specified new seat. The input is the new seat information.

[0790] The server updates the database with the latest seating information. The output is the updated seating information.

[0791] Specifically, the preceding customer follows the instructions on the display device to move to a new seat, and the server updates the seat information accordingly.

[0792] Step 8:

[0793] The terminal notifies the user requesting a seat of the latest available seat information. The input is the updated seat information.

[0794] The user sits down at the seat they were assigned. The output is that the user has sat down.

[0795] Specifically, the server notifies a dedicated app of vacant seat information, and the user receives the information, moves to the designated seat, and takes a seat.

[0796] Through the above steps, a system is completed that realizes efficient seat management and improved user satisfaction.

[0797] (Application example 1)

[0798] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0799] Seating management has become a major issue in restaurants and various facilities today. In particular, there is a need to efficiently manage demand for seating alongside one another, such as at counter seats, and information on available seats in real time, but conventional systems have not been able to meet this need. Furthermore, there is a lack of incentives and smooth communication between customers when switching seats, creating a need for a method to achieve efficient and satisfying seating management. Furthermore, it is difficult to analyze customer trends in real time and provide appropriate guidance.

[0800] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0801] In this invention, the server includes: means for a user to specify a seating preference through a dedicated application; means for detecting vacant seat information and user behavior using an image capture device; means for selecting candidate seats to encourage users to move to based on vacant seat information analyzed using an analysis device; means for inquiring of the candidate preceding customer regarding seat relocation using a display device installed at the seat; means for processing points when the preceding customer agrees to the move using an action approval means; means for acquiring the latest seat information and providing guidance to the user; means for displaying vacant seat information and candidate seat status in real time via a smart device; means for providing optimal guidance to the user based on destination seat information; and means for managing the user's point balance and adding or subtracting points as the seat is moved. This enables more efficient and satisfying seat management and realizes the user's seating preferences.

[0802] A "dedicated application" is software with specific functions that allow users to specify seating preferences.

[0803] An "image capture device" is a device that uses a device such as a camera to capture information about vacant seats in a store and the behavior of customers, and acquires the data.

[0804] The "analysis device" is a device that analyzes seat availability information and user behavior based on acquired image data and determines optimal seat usage.

[0805] A "display device" is a device that is installed in a seat and displays information and inquiries about whether or not movement is possible to users and previous passengers.

[0806] The "action approval means" is a means for confirming that a previous passenger has consented to a seat change and for processing points.

[0807] "Latest seat information" refers to information that reflects the current seat usage and availability in real time.

[0808] A "smart device" is an electronic device such as a smartphone or tablet that can display information and communicate.

[0809] "Point balance" is a numerical value indicating the total amount of points owned by a user.

[0810] "Vacant seat information" is information indicating which seats are available in the restaurant.

[0811] "Customer behavior" is information that indicates the movement and behavior of the customer within the store.

[0812] This invention provides a system for efficiently managing seats in brick-and-mortar stores and realizing the seating preferences of customers. As a specific example, it targets the management of counter seats in restaurants.

[0813] System Configuration

[0814] 1. Dedicated application:

[0815] Users launch the application on their smartphone and specify their preference for seating next to each other. The application has functions such as login, checking available seat information, checking potential seat changes, and managing points.

[0816] 2. Image acquisition device:

[0817] IP cameras and other devices installed in the restaurant capture real-time footage of seat usage, and this video data is sent to a server.

[0818] 3. Analysis equipment:

[0819] Analysis software connected to the server analyzes the received video data using image analysis libraries such as OpenCV to obtain information on available seats and user behavior.

[0820] 4. Display device:

[0821] We use tablets and displays installed in the seats, which display a screen asking the previous passenger if they would like to move seats.

[0822] 5. Operational Approval Methods:

[0823] If the previous customer agrees to the seat change, the information is sent to the server and points are added or subtracted. Points are managed using a database.

[0824] 6. Acquisition and notification of seat availability information:

[0825] Based on the analysis results, the server updates the database with the latest seating information and notifies users in real time via a smartphone application.

[0826] Specific Examples

[0827] Couples visiting the store

[0828] Let's explain a scenario where A and B come to a restaurant as a couple.

[0829] Step 1: Person A launches the dedicated app on their smartphone and logs in.

[0830] Step 2: Person A selects the "Sit side by side" option in the app.

[0831] Step 3: The server receives real-time video data from the in-store camera, and the analysis device analyzes the data. Information about vacant seats and the behavior of previous customers are detected.

[0832] Step 4: The server lists the existing customers who can be moved as matching candidates.

[0833] Step 5: The server sends a request to the tablet installed in the seat of the previous passenger to inquire whether they are allowed to move.

[0834] Step 6: Mr. B (the previous customer) accepts the move on the tablet, and points are awarded upon the previous customer's acceptance.

[0835] Step 7: The server updates the database with the latest seat information and notifies the user.

[0836] Step 8: Mr. A and his partner sit next to each other in the seats they were assigned.

[0837] Prompt Sentence Examples

[0838] A couple visits a restaurant using the "Smart Seat" app. They register their preference to sit next to each other, and the app analyzes the available seating information in the restaurant. They are matched with a customer who is available to move, and the customer agrees to the move using points. Generate appropriate prompts and explain the specific steps.

[0839] This system allows customers to use seats comfortably and efficiently, and also allows stores to optimize seat management.In addition, by introducing a point system, it becomes easier to get cooperation from previous customers.

[0840] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0841] Step 1:

[0842] The user launches the dedicated application on their smartphone and logs in.

[0843] Input: User ID and password

[0844] Data processing and calculation: The terminal sends the login information to the server, and the server performs authentication. After authentication, the session begins.

[0845] Output: Successful login status and user information

[0846] Step 2:

[0847] The user selects the "Sit Side by Side" option from the application's menu.

[0848] Input: User's seat preference option selection

[0849] Data processing and calculation: The terminal sends the user's desired data to the server, which receives the request and begins processing.

[0850] Output: The preference to sit next to each other is recorded on the server.

[0851] Step 3:

[0852] The server receives video data from cameras in the store in real time.

[0853] Input: Video data from the camera

[0854] Data processing and calculation: The server acquires the video data and performs image analysis using an analysis device. OpenCV is used to extract seat availability information and user behavior.

[0855] Output: Analysis results of vacant seats and user behavior data

[0856] Step 4:

[0857] Based on the analysis results, the server lists seats of existing customers that can be moved to (matching candidates).

[0858] Input: Vacant seat information and user behavior data

[0859] Data processing and calculation: The server uses a clustering algorithm such as DBSCAN to identify potential customers.

[0860] Output: Match candidate list

[0861] Step 5:

[0862] The server sends a request to the seat of the previous occupant listed in the list.

[0863] Input: Match candidate list

[0864] Data processing and calculation: The server sends a query to the listed previous customer's terminal asking whether or not the transfer is possible.

[0865] Output: The move / non-move selection screen displayed on the customer's device

[0866] Step 6:

[0867] The user (previous customer) checks the options displayed on the terminal regarding whether or not to move, and accepts or rejects the move.

[0868] Input: Select whether to move the previous customer

[0869] Data processing and calculation: The terminal sends the selection information of the previous customer to the server, and performs approval processing using the operation approval means.

[0870] Output: Move acceptance or rejection status

[0871] Step 7:

[0872] The server processes points when the previous customer's permission to move is obtained.

[0873] Input: Previous customer's travel consent information

[0874] Data processing and calculation: The server performs point addition and subtraction processing and updates the user's point balance in the database.

[0875] Output: Point update information

[0876] Step 8:

[0877] The server obtains the latest seat information and provides it to the user.

[0878] Input: Final seat status and movement results

[0879] Data processing and calculation: The server updates the database with the latest seat information and notifies the user via the terminal.

[0880] Output: Latest seat information notification

[0881] Step 9:

[0882] The user (the user who has been guided to the new seat) moves to the designated new seat and sits down.

[0883] Input: User seating information

[0884] Data processing and calculation: Confirm that the user has completed their movement and that the system is operating normally.

[0885] Output: Status of the user having taken the new seat

[0886] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0887] The following describes in detail an embodiment of the present invention that combines an emotion engine. The present invention is a system for optimizing the use of vacant seats in stores and facilities, and achieves efficient seating management and comfortable seating, particularly at counter seats in restaurants and other establishments. The adoption of an emotion engine aims to further improve user satisfaction.

[0888] System Overview

[0889] The system includes the following means:

[0890] 1. How to specify your seating preference using a dedicated app

[0891] 2. Means for detecting vacant seat information using an image capture device

[0892] 3. Method for selecting matching candidates by the analysis device

[0893] 4. Means for inquiring whether movement is possible or not using a display device

[0894] 5. Point processing means by operation approval means

[0895] 6. Acquisition and guidance of the latest seat information

[0896] 7. Emotion Recognition Method Using Emotion Engine

[0897] With this configuration, users can specify their seating preferences through a dedicated app, and the combination of AI analysis and an emotion engine ensures efficient seat management and comfortable seating.

[0898] Program processing explanation

[0899] 1. User launches app

[0900] The user launches a dedicated app on their smartphone and logs in.

[0901] The terminal sends login information to the server, and the server authenticates the user information and starts the session.

[0902] 2. Select "Sit side by side"

[0903] The user selects the "Sit Side by Side" option from the app's menu.

[0904] The terminal sends this request to the server.

[0905] 3. Detecting vacant seat information

[0906] The server receives video data from cameras in the store in real time.

[0907] The server's AI (analysis device) analyzes the video data and detects seat availability and user behavior.

[0908] 4. Emotional Recognition

[0909] The server's emotion engine analyzes the user's facial expressions and voice to recognize their emotions.

[0910] 5. Selection of match candidates

[0911] Based on the analyzed seat availability information and emotion data, the server creates a list of seats (matching candidates) that are available for movement to.

[0912] 6. Inquiry about transfer availability

[0913] The server sends a question about whether the user can move to the tablet installed at the listed seat.

[0914] The terminal (a tablet at the previous customer's seat) displays the option to move or not.

[0915] The user (previous customer) selects whether or not to move using a tablet, and the emotion engine increases the likelihood of the move being accepted.

[0916] 7. Points Processing

[0917] The terminal sends a response to the server approving the move.

[0918] If the user (previous customer) agrees to the move, the server manages the addition or subtraction of points.

[0919] 8. Seat Movement and Latest Updates

[0920] The user (previous customer) moves to the new seat specified.

[0921] The server updates the database with the latest seating information and reflects it in real time.

[0922] 9. Seating Instructions

[0923] The terminal (dedicated app) notifies users who wish to sit down of the latest available seat information.

[0924] The user sits down at the seat he or she is assigned.

[0925] Specific examples

[0926] Couples visiting the store

[0927] Let's take the example of a couple, A and B, visiting a restaurant.

[0928] 1. User A launches the dedicated app on their smartphone and logs in.

[0929] 2. User A selects the "Sit side by side" option in the app.

[0930] 3. The server receives video from the in-store camera, and the AI ​​and emotion engine analyze it. Along with the seat availability information, it recognizes that there is one vacant seat at the counter and the user's emotion.

[0931] 4. The server lists available customers as matching candidates based on the seat availability information and emotion data.

[0932] 5. The server sends a request to the tablet installed at the seat of the previous customer listed on the list to inquire whether they can move.

[0933] 6. When User B (the previous customer) agrees to the move on the tablet, the emotion engine analyzes User B's emotions and determines that there is a low possibility of refusal.

[0934] 7. The server grants 100 points to User B and subtracts 100 points from User A.

[0935] 8. User B moves to a new seat.

[0936] 9. The server updates the seat information and notifies the app.

[0937] 10. User A and his partner sit next to each other at the seats they were assigned.

[0938] By utilizing the emotion engine, it becomes possible to manage seats taking into account the user's emotions, which is expected to improve user satisfaction.

[0939] The processing flow will be explained below.

[0940] Step 1:

[0941] The user launches a dedicated app on their smartphone and logs in.

[0942] Step 2:

[0943] The terminal sends the user's login information to the server, and the server authenticates the user information and starts a session.

[0944] Step 3:

[0945] The user selects the "Sit Side by Side" option from the app's menu.

[0946] Step 4:

[0947] The terminal transmits the selection information of the "sit side by side" option to the server.

[0948] Step 5:

[0949] The server receives video data from cameras in the store in real time.

[0950] Step 6:

[0951] The server's AI (analysis device) analyzes the video data and detects vacant seat information and user behavior.

[0952] Step 7:

[0953] The server's emotion engine analyzes the user's facial expressions and voice from camera and microphone input data and recognizes their emotions.

[0954] Step 8:

[0955] Based on the analyzed seat availability information and emotion data, the server creates a list of seats (matching candidates) that are available for movement to.

[0956] Step 9:

[0957] The server sends a question about whether the user can move to the tablet installed at the listed seat.

[0958] Step 10:

[0959] The terminal (a tablet at the previous customer's seat) displays the option to move or not.

[0960] Step 11:

[0961] The user (previous customer) selects whether or not to move using a tablet.

[0962] Step 12:

[0963] The server's emotion engine analyzes the emotions of the previous customer, and if it determines that there is little resistance to movement, it increases the priority.

[0964] Step 13:

[0965] The device (tablet) sends a response to the server approving the move.

[0966] Step 14:

[0967] The server receives the result of the transfer approval and processes the addition or subtraction of points.

[0968] Step 15:

[0969] The server will give 100 points to the user (previous customer) and subtract 100 points from the user who requested to "sit next to each other."

[0970] Step 16:

[0971] The user (previous customer) moves to the new seat specified.

[0972] Step 17:

[0973] The server updates the database with the latest seat information.

[0974] Step 18:

[0975] The server notifies the app of the updated seat information.

[0976] Step 19:

[0977] The terminal (dedicated app) notifies the user who wishes to sit down of the available seat after the move.

[0978] Step 20:

[0979] The user sits down at the seat he or she is assigned.

[0980] These are the specific processing steps of the program in this system. By adding an emotion engine, it is possible to take the user's emotions into consideration and provide a more natural and comfortable experience.

[0981] Example 2

[0982] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0983] Conventional systems have not been able to fully optimize seat utilization and improve customer satisfaction in restaurants and other facilities. In particular, in situations such as counter seating, achieving both efficient seat management and comfortable seating for customers is a challenge. Furthermore, flexible seating arrangements that take customer emotions into consideration are difficult, which can lead to lower customer satisfaction.

[0984] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for a user to specify a seating preference through a dedicated app; a means for detecting vacant seat information and user behavior using an image capture device; a means for selecting candidates for seat movement among users based on vacant seat information analyzed using an analysis device; a means for inquiring of the candidate preceding passenger regarding seat movement availability using a display device installed at the seat; a means for processing points when the preceding passenger agrees to the seat movement using an action approval means; a means for recognizing the user's emotions using an analysis device and using the data to determine whether to move seats; and a means for acquiring the latest seat information and providing the user with information. This enables efficient seat management, realizes flexible seat movement that takes user emotions into consideration, and is expected to improve user satisfaction.

[0985] A "user" is someone who operates a dedicated app or system to specify their seating preference or move to another seat.

[0986] A "dedicated app" is application software that allows users to specify seat preferences and travel on devices such as smartphones and tablets.

[0987] An "image capture device" is a camera or sensor installed in a store or facility to capture information on available seats and user behavior in real time.

[0988] "Vacant seat information" refers to data indicating whether seats are available in a store or facility.

[0989] "Customer behavior" refers to the actions and activities that customers perform in the store, which are detected by cameras and sensors.

[0990] The "analysis device" refers to hardware or software that analyzes data obtained from the image capture device and recognizes seat availability information and user emotions.

[0991] A "display device" is a screen installed at a seat that displays information and questions to passengers.

[0992] The "action approval means" refers to a mechanism or means for confirming that the user has approved the seat change, and is related to the processing of points.

[0993] "Point processing" refers to the process of adding or subtracting points when a seat change occurs between users.

[0994] An "emotion engine" is software or hardware that analyzes a user's facial expressions and voice and recognizes their emotions.

[0995] "Real-time" is a term that indicates that data acquisition, analysis, and information updates are immediate.

[0996] A "database" is a digital information storage location for centrally managing seating information, user behavior, point information, etc.

[0997] "Guidance means" refers to the mechanism or method for informing users of the latest seat information and providing guidance.

[0998] "Counter seats" are seats set up along the counter in restaurants and other establishments.

[0999] The present invention is a system for optimizing the use of vacant seats in stores and facilities, and realizes efficient seating management and comfortable seating, particularly at counter seats in restaurants and other establishments. By adopting an emotion engine, the system aims to further improve user satisfaction. Specific embodiments for implementing this system are described below.

[1000] System Overview

[1001] The system includes the following means:

[1002] 1. User launches app

[1003] The user launches a dedicated app on their smartphone and logs in. The device sends the login information to the server, which then authenticates the user information and starts the session.

[1004] 2. Specify seating preference

[1005] The user selects the "sit next to each other" option in the app, and the device sends this preference to the server.

[1006] 3. Detecting vacant seat information

[1007] The server receives video data from cameras in the store in real time, and an AI analysis device analyzes the video data to detect seat vacancies and customer behavior.

[1008] 4. User Emotion Recognition

[1009] The server's emotion engine analyzes the user's facial expressions and voice to recognize their emotions. The emotion engine is software or hardware that analyzes the user's facial expressions and voice to recognize their emotions.

[1010] 5. Selection of migration candidates

[1011] Based on the analyzed seat availability information and emotion data, the server creates a list of seats available for existing occupants to move to.

[1012] 6. Inquiry about transfer availability

[1013] The server sends a question about whether or not the customer wants to move to a tablet installed on the list of seats, and the customer selects whether or not they want to move on the tablet. The terminal then sends the selection information to the server.

[1014] 7. Points Processing

[1015] If the server receives approval for the seat change, it adds or subtracts points. The operation approval means is a mechanism or means for confirming that the user has approved the seat change, and is related to point processing.

[1016] 8. Seat Movement and Database Update

[1017] The user (previous customer) moves to a new seat, and the server updates the database with the latest seat information, reflecting it in real time.

[1018] 9. Seating Instructions

[1019] Based on the latest information on available seats, the server uses a dedicated app to notify the user requesting a seat of the latest information, and the user then takes the seat indicated to them.

[1020] Hardware and software used

[1021] Dedicated app: Application software that allows users to specify their seating preferences on a smartphone or tablet.

[1022] Image acquisition devices: Cameras and sensors installed in the store.

[1023] Analysis device: An AI system for analyzing video and audio data.

[1024] Emotion engine: Software or hardware that analyzes a user's facial expressions and voice to recognize emotions.

[1025] Display device: A screen such as a tablet.

[1026] Operation approval means: A system for adding or subtracting points.

[1027] Specific examples

[1028] Couples visiting the store

[1029] 1. User A launches the dedicated app on their smartphone and logs in.

[1030] 2. User A selects the "Sit side by side" option in the app.

[1031] 3. The server receives footage from the in-store camera, and the AI ​​and emotion engine analyze it.

[1032] 4. The server creates a list of available customers based on seat availability information and emotion data.

[1033] 5. The server sends a query to the tablet installed in the target seat asking whether the move is possible.

[1034] 6. User B (the previous customer) accepts the move on his tablet, and the server receives this information.

[1035] 7. The server processes the points and awards them to User B.

[1036] 8. User B moves to a new seat and the server updates the seat information.

[1037] 9. The dedicated app notifies User A of the latest available seat information, and User A takes the designated seat.

[1038] Prompt Sentence Examples

[1039] Below are some examples of prompt sentences to input to the generative AI model.

[1040] "Please explain in detail your seating management system for restaurants, including the specific steps of the system and how users use the app."

[1041] This prompt can be used to get a detailed explanation of the system, as well as additional information on how to specifically utilize the emotion engine and how the point system operates.

[1042] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1043] Step 1:

[1044] User launches app

[1045] The user launches the dedicated app on their smartphone.

[1046] The user enters their ID and password on the login screen and clicks the login button.

[1047] The terminal encrypts the entered login information and sends it to the server.

[1048] The server receives the login information and authenticates it by checking it against the database. The input is the user's ID and password, and the output is the authentication result (success / failure).

[1049] If the authentication is successful, the server generates a session ID and returns it to the terminal.

[1050] Step 2:

[1051] Specify seating preference

[1052] The user selects the "Sit Side by Side" option from the app's menu.

[1053] The terminal sends the user's preference to the server, indicating that they want to sit next to each other. The input is the user's preference, and the output is a confirmation of the transmission to the server.

[1054] The server records the desired information in a database and starts obtaining seat availability information.

[1055] Step 3:

[1056] Detecting vacant seat information

[1057] The server receives video data from cameras in the store in real time.

[1058] The analysis device analyzes the video data and detects seat availability and user behavior. The input is real-time video data, and the output is seat availability information and user behavior data.

[1059] The server stores the analysis results in a database.

[1060] Step 4:

[1061] User emotion recognition

[1062] The server's emotion engine analyzes the acquired video and audio data.

[1063] The emotion engine recognizes emotions from the user's facial expressions and voice. The input is video and audio data, and the output is the user's emotional data.

[1064] The server records the emotion data in a database.

[1065] Step 5:

[1066] Selection of candidates for transfer

[1067] The server creates a list of seats available for existing occupants to move to based on vacant seat information and emotion data.

[1068] The list is created by taking into consideration whether the seats are close to empty or whether the emotional data is positive. The input is empty seat information and emotional data, and the output is a list of candidates for movement.

[1069] The server stores the migration candidate list in a database.

[1070] Step 6:

[1071] Inquiry about whether moving is possible

[1072] The server sends a question about whether or not the user can move to a tablet installed on the seat on the candidate list.

[1073] The customer's tablet displays the question "Do you want to move?" and offers options. The input is a list of possible moves, and the output is a display of options for whether or not to move.

[1074] The user (previous customer) selects "move" or "don't move" on the tablet. The device sends the selected move permission information to the server.

[1075] Step 7:

[1076] Processing points

[1077] If the server approves the move, it adds or subtracts points.

[1078] The server adds the points of the previous customer and subtracts the points of the requesting customer. The input is the travel approval information, and the output is the point addition / subtraction result.

[1079] The server stores the point information in a database.

[1080] Step 8:

[1081] Seat movement and database updates

[1082] The user (previous customer) moves to the new seat indicated.

[1083] The server updates the seating information to the database, reflecting the overall seating situation in real time. The input is the movement fact, and the output is the updated seating data.

[1084] Step 9:

[1085] Seating instructions

[1086] Based on the latest seat availability information, the server uses a dedicated app to send notifications to users who wish to sit down.

[1087] The terminal (dedicated app) displays a notification to the user who wishes to sit and guides them to the seat they are assigned. The input is the latest vacant seat information, and the output is a notification to the user.

[1088] The user follows the notification and takes the designated seat.

[1089] (Application example 2)

[1090] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1091] Seating management in restaurants is an important factor in ensuring customers have a comfortable experience. However, especially during busy times at restaurants, customers often find it difficult to sit next to each other or in the seats they desire. Furthermore, seating is often assigned without regard for customers' feelings, often resulting in an unsatisfactory experience. This reduces customer satisfaction at restaurants. Another problem is the lack of smooth communication between customers who wish to move seats and those already seated.

[1092] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for a user to specify a seating preference through a dedicated app; a means for detecting vacant seat information and user behavior using an image capture device; a means for selecting candidates for seats to be encouraged among users based on vacant seat information analyzed using an analysis device; a means for inquiring of the candidate preceding passengers about whether they are willing to move seats using a display device installed at the seat; a means for processing points when the preceding passenger agrees to the move using an action approval means; a means for acquiring the latest seat information and providing guidance to the user; a means for recognizing the user's emotions using an emotion engine; and a means for suggesting an appropriate seat based on emotion recognition data. This enables comfortable seat management that takes the user's emotions into consideration and smooth communication in response to a move request.

[1093] A "user" is a customer who wishes to use a seat at a store.

[1094] A "dedicated app" is software that is installed on personal devices such as smartphones and tablets and used to manage seating at stores.

[1095] An "image capture device" is a camera or sensor that captures images and videos of the inside of a store in real time.

[1096] "Vacant seat information" is data indicating the status of seats currently not in use within the restaurant.

[1097] "Behavior" refers to actions such as movements and movements that customers make within the store.

[1098] The "analysis device" is a computer device that analyzes the acquired images and data to determine whether there are vacant seats and the behavior of users.

[1099] A "display device" is a device for visually displaying information, such as a display or tablet.

[1100] "Previous customer" refers to a user who is already seated.

[1101] "Movement possible" refers to an inquiry as to whether it is possible to move from the current seat to another seat.

[1102] The "action approval means" is a means for expressing the intention to approve or reject a seat change.

[1103] "Points" are rewards or incentives that are awarded to users when they agree to a seat change, or that are deducted from those who wish to move.

[1104] "Latest seat information" is data showing the current seat availability and usage status in the latest state.

[1105] An "emotion engine" is an algorithm or software that analyzes facial expressions and voice to recognize the user's emotional state.

[1106] "Emotion recognition data" is data that indicates the emotional state of the user as determined by the emotion engine.

[1107] "Appropriate seating" refers to the seating that is deemed to best match the user's preferences and emotional state.

[1108] Below, we will explain in detail a system that optimizes the use of empty seats in physical stores by combining an emotion engine.

[1109] System configuration

[1110] The system includes the following main hardware and software:

[1111] Hardware

[1112] 1. Smartphone

[1113] This is a device on which users can install a dedicated app and log in and specify their preferred seat.

[1114] 2. In-store cameras

[1115] This is a device that obtains information on available seats in the store and customer behavior in real time.

[1116] 3. In-store tablets

[1117] This device is used to ask seated users whether they wish to move seats.

[1118] software

[1119] 1. Dedicated app

[1120] It is software that is installed on a smartphone and allows the user to interact with the system.

[1121] 2. Emotion Engine

[1122] These are algorithms and software that analyze facial expressions and voice data to recognize the user's emotions.

[1123] Example: Face++, Affectiva SDK

[1124] 3. Data Analysis Software

[1125] This software analyzes the captured video and data to determine seat availability and user behavior.

[1126] Examples: OpenCV, TensorFlow

[1127] 4. Points Management System

[1128] This is a system for managing the addition and subtraction of points between users.

[1129] Examples: Firebase, AWS DynamoDB

[1130] 5. Real-time streaming services

[1131] This is a service that transmits video data from cameras in-store to a server in real time.

[1132] Examples: Amazon Kinesis, Google Cloud Pub / Sub

[1133] Program processing

[1134] The server performs seat management based on the following series of procedures.

[1135] 1. A way for users to specify their seating preference through a dedicated app

[1136] The server receives the request from the smartphone, authenticates the login information, and starts the session.

[1137] 2. Means of detecting vacant seat information and user behavior using an image capture device

[1138] The server receives video data from cameras in the store in real time and analyzes seat availability and customer behavior.

[1139] 3. A method for selecting candidates to encourage seat changes among users based on the analyzed vacant seat information

[1140] Based on the information on available seats, the server creates a list of seats available for existing customers and selects candidates.

[1141] 4. A means for inquiring about the availability of seats to potential passengers using a display device installed in the seat.

[1142] The server will then use a tablet in the store to ask the previous customers on his list whether they would like to move seats.

[1143] 5. A means for processing points when the previous customer's permission to move is obtained using the operation approval means.

[1144] The server receives the previous customer's permission to move and adds or subtracts points.

[1145] 6. A means of obtaining the latest seating information and providing it to users

[1146] The server updates the database with the latest available seat information and notifies the user.

[1147] 7. A method for recognizing user emotions using an emotion engine

[1148] The server analyzes the user's facial expressions and voice data using an emotion engine to recognize emotions.

[1149] 8. A method to suggest appropriate seats based on emotion recognition data

[1150] The server will suggest the most appropriate seat to the user based on emotion recognition data.

[1151] Specific examples

[1152] Couples visiting the store

[1153] 1. User A launches the dedicated app on their smartphone and logs in.

[1154] 2. User A selects the "Sit side by side" option in the app.

[1155] 3. The server receives footage from the in-store camera, and data analysis software and an emotion engine analyze seat availability and customer emotions.

[1156] 4. The server creates a list of available customers based on seat availability information and emotion data.

[1157] 5. The server sends a request to the tablet installed at the previous customer's seat to inquire whether they can move.

[1158] 6. When the previous customer accepts the move using the tablet, points are awarded using the point management system.

[1159] 7. The previous customer moves to a new seat, and the server updates the database with the latest seat information.

[1160] 8. User A sits next to the seat assigned to him.

[1161] Example prompts for generative AI models

[1162] Generate a program for a seating optimization system for a brick-and-mortar store based on the following requirements:

[1163] 1. A feature that allows users to log in using a smartphone app.

[1164] 2. A function that receives real-time video footage from cameras inside the store and analyzes seat availability information.

[1165] 3. Facial expression and voice analysis function using an emotion engine.

[1166] 4. A function that suggests suitable seats based on seat availability information and sentiment data.

[1167] 5. Ability to send and approve transfer requests to existing seat users via tablet.

[1168] 6. Ability to award points to users who approve the move.

[1169] 7. A function that notifies users of the latest available seat information and provides guidance in real time.

[1170] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1171] Step 1:

[1172] The user launches a dedicated app on their smartphone and logs in. The device sends the user's authentication information to the server, which then checks the user information against a database to start a session. The input data is the username and password, and the output data is a flag indicating successful authentication and a session ID. Through this process, the server recognizes the user as legitimate and allows them to use the app.

[1173] Step 2:

[1174] The user selects the "Sit side by side" option from the app menu. The device sends this preference to the server. The input data is the "Sit side by side" preference, and the output data is the seating preference option sent to the server. In this step, the server records the user's seating preference.

[1175] Step 3:

[1176] The server receives video data from cameras in the store in real time. It then analyzes the video data using data analysis software (e.g., OpenCV, TensorFlow) to detect seat availability and customer behavior. The input data is the video stream, and the output data is seat availability information and customer behavior data. The server uses the acquired seat availability information to determine the current seating situation.

[1177] Step 4:

[1178] The server's emotion engine (e.g., Face++, Affectiva) analyzes the user's facial expressions and voice from the video data to recognize emotions. The input data is the user's facial expressions and voice data, and the output data is the emotion recognition results. This allows the server to understand the user's mood and state.

[1179] Step 5:

[1180] Based on the analyzed vacant seat information and emotion data, the server lists seats (matching candidates) that the user can move to in order to suggest an appropriate seat. The input data is vacant seat information and emotion recognition data, and the output data is a list of previous users. This allows the server to identify the most suitable seat for the user.

[1181] Step 6:

[1182] The server sends a request to the tablet installed at the seat of the preceding customer on the list to inquire about whether or not the customer can move. The input data is the message requesting the move, and the output data is the question about whether or not the customer can move, which is displayed on the tablet. The server notifies the preceding customer of the move request via the tablet.

[1183] Step 7:

[1184] The customer who is already seated selects whether or not they wish to move using a tablet. The input data is the choice made by the customer, and the output data is the selection result sent to the server. The terminal sends this data to the server, and the server receives the result.

[1185] Step 8:

[1186] The server receives the previous customer's response of approval for the move and processes the points using the operation approval means. The input data is the selection result of the move approval, and the output data is the point increase / decrease information. The server uses the point management system to award points to the approver and subtract points from the applicant.

[1187] Step 9:

[1188] The previous customer moves to the new seat they have assigned, and the new seat information is updated in the database. The input data is the new seat information, and the output data is the updated seat data. The server saves this data in the database, and reflects the latest seat information in real time.

[1189] Step 10:

[1190] Finally, the server notifies the user's smartphone of the latest available seat information, and the user sits in the seat indicated. The input data is the latest available seat information, and the output data is the guidance information displayed on the user's smartphone. This allows the user to smoothly sit in the designated seat.

[1191] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1192] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1193] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1194] [Third embodiment]

[1195] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1196] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1197] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1198] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1199] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1200] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1201] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1202] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1203] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1204] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1205] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1206] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1207] The present invention provides a system for optimizing the use of vacant seats in stores and facilities, and realizes efficient seat management and comfortable seating, particularly at counter seats in restaurants and other establishments.

[1208] System Overview

[1209] This system allows customers to specify their seating preferences through a dedicated app, and AI analyzes and guides them to available seats in the restaurant, matching customers who want to sit next to each other with customers who are available to move to other seats. Specifically, the system includes the following measures:

[1210] How to specify seating preference using a dedicated app

[1211] Vacant seat information detection means using an image capture device

[1212] Matching candidate selection means by analysis device

[1213] Means for inquiring whether movement is possible or not using a display device

[1214] Point processing means by operation approval means

[1215] Acquisition and guidance of the latest seat information

[1216] Program processing explanation

[1217] 1. User launches app

[1218] The user launches the dedicated app on their smartphone and logs in.

[1219] The terminal sends the login information to the server to start the session.

[1220] 2. Select "Sit side by side"

[1221] The user selects the "Sit Side by Side" option from the app's menu.

[1222] The terminal sends this request to the server.

[1223] 3. Detecting vacant seat information

[1224] The server receives video data from cameras in the store in real time.

[1225] The server uses AI (analysis device) to analyze the received data and obtain information on available seats and user behavior.

[1226] 4. Selection of match candidates

[1227] Based on the analysis results, the server creates a list of seats (matching candidates) that can be moved to.

[1228] 5. Inquiry about transfer availability

[1229] The server sends a request to the listed seats asking whether or not to move to them.

[1230] The terminal (a display device installed at the previous customer's seat) displays the option of whether or not to move.

[1231] The user (previous customer) accepts or rejects the move on the screen.

[1232] 6. Points Processing

[1233] The terminal sends a response to the server approving the move.

[1234] If the user (previous customer) agrees to the move, the server manages the addition or subtraction of points.

[1235] 7. Seat Transfers and Renewals

[1236] The user (previous customer) moves to the new seat specified.

[1237] The server updates the database with the latest seating information and reflects it in real time.

[1238] 8. Seating instructions

[1239] The terminal (dedicated app) notifies the user who wishes to sit down of the available seat after the move.

[1240] The user sits down at the seat he or she is assigned.

[1241] Specific examples

[1242] Couples visiting the store

[1243] Let's take the example of a couple, A and B, visiting a restaurant.

[1244] 1. User A launches the dedicated app on their smartphone and logs in.

[1245] 2. User A selects the "Sit side by side" option in the app.

[1246] 3. The server receives the video from the in-store camera and the analysis device analyzes it. It determines that there is currently one vacant seat at the counter.

[1247] 4. The server lists existing customers who can be moved as matching candidates.

[1248] 5. The server sends a request to the tablet installed at the seat of the previous customer listed on the list to inquire whether they can move.

[1249] 6. User B (previous customer) accepts the move on his tablet.

[1250] 7. The server grants 100 points to User B and subtracts 100 points from User A.

[1251] 8. User B moves to a new seat.

[1252] 9. The server updates the latest seat information and notifies the app.

[1253] 10. User A and his partner sit next to each other at the seats they were assigned.

[1254] The above specific examples enable efficient seat management and improved user satisfaction.

[1255] The processing flow will be explained below.

[1256] Step 1:

[1257] The user launches a dedicated app on their smartphone and logs in.

[1258] Step 2:

[1259] The terminal sends the user's login information to the server, and the server authenticates the user information and starts a session.

[1260] Step 3:

[1261] The user selects the "Sit Side by Side" option from the app's menu.

[1262] Step 4:

[1263] The terminal transmits the selection information of the "sit side by side" option to the server.

[1264] Step 5:

[1265] The server receives video data from cameras in the store in real time.

[1266] Step 6:

[1267] The server's AI (analysis device) analyzes the video data and obtains information about available seats and user behavior.

[1268] Step 7:

[1269] Based on the analysis results, the server creates a list of seats (matching candidates) that can be moved to.

[1270] Step 8:

[1271] The server sends a question to the tablet installed at the seat of the previous customer listed on the server asking whether they wish to move.

[1272] Step 9:

[1273] The terminal (a tablet at the previous customer's seat) displays the option to move or not.

[1274] Step 10:

[1275] The user (previous customer) selects whether or not to move using a tablet and sends the result to the server.

[1276] Step 11:

[1277] The server receives the result of the transfer approval and processes the addition or subtraction of points.

[1278] Step 12:

[1279] The server will give 100 points to the user who moved (the previous customer) and subtract 100 points from the user who requested to "sit next to each other."

[1280] Step 13:

[1281] The user (previous customer) moves to the new seat specified.

[1282] Step 14:

[1283] The server updates the database with the latest seat information.

[1284] Step 15:

[1285] The server notifies the app of the updated seat information.

[1286] Step 16:

[1287] The terminal (dedicated app) notifies the user who wishes to sit down of the available seat after the move.

[1288] Step 17:

[1289] The user sits down at the seat he or she is assigned.

[1290] The above are the specific processing steps of the program in this system.

[1291] Example 1

[1292] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1293] Traditionally, seating management in stores and facilities has relied heavily on human labor, and there has been a challenge in restaurants and other establishments, where it is difficult to find suitable empty seats when customers want to sit together at counter seats. Furthermore, when trying to make effective use of empty seats by having previous customers move, this arrangement becomes cumbersome, and there is a risk of customer satisfaction decreasing. A system that can solve these issues and improve efficient seating management and customer satisfaction has been sought.

[1294] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1295] In this invention, the server includes: means for users to specify their seating preferences through a dedicated app on a mobile device; means for detecting vacant seat information and user behavior using a monitoring device; means for selecting candidates for encouraging users to move seats based on vacant seat information analyzed using an analysis device; means for inquiring of the candidate preceding passengers about whether they are willing to move seats using a display device installed at the seat; means for processing points when the preceding passenger agrees to move using an action approval means; means for acquiring the latest seat information and notifying the user; and means for managing the addition and subtraction of points based on the result of the move approval. This enables efficient seat management and smooth adjustments due to the movement of users who want to sit next to each other or preceding passengers, thereby improving user satisfaction.

[1296] "User" refers to an individual or group that uses a dedicated app to specify their seating preference.

[1297] A "dedicated app" refers to software that runs on mobile devices such as smartphones and tablets and allows passengers to specify their seating preferences.

[1298] "Mobile Device" refers to smartphones, tablets, and similar portable electronic devices.

[1299] "Monitoring devices" refers to devices such as cameras used to monitor the situation inside the store in real time and detect vacant seats and customer behavior.

[1300] "Vacancy information" refers to information indicating the current occupancy status (vacant or full) of each seat in the store.

[1301] "Analysis device" refers to AI or software that analyzes data obtained from monitoring devices and determines seat availability and user behavior.

[1302] "Matching candidates" refers to a list of existing passengers who can move seats, selected by the analysis device.

[1303] "Display device" refers to an electronic display or tablet installed in a seat to show passengers the option of whether or not to move.

[1304] "Movement availability inquiry" refers to a message sent from the server to the display device asking the previous passenger whether or not it is possible to move seats.

[1305] The "action approval means" refers to a means for recognizing the action of a previous passenger to accept or reject a seat change and processing the result of the action.

[1306] "Points Processing" means the act of adding or subtracting points from a Customer's account in response to the acceptance or denial of a seat change.

[1307] "Latest seating information" refers to updated seating arrangements and availability information based on current seat usage.

[1308] "Notification" refers to a message sent to inform users of updated seating information.

[1309] This invention is a system for optimizing the use of vacant seats in stores and facilities. It realizes efficient seat management and comfortable seating, particularly at counter seats in restaurants and other establishments. An embodiment of this system is described in detail below.

[1310] System Overview

[1311] This system allows customers to specify their seating preferences through a dedicated app, and then uses AI and various hardware to analyze and guide information about available seats in the restaurant, matching customers who want to sit next to each other with existing customers who are available to move to their seats.The system mainly includes the following components.

[1312] A way for users to specify their seating preference through a dedicated app on their mobile device

[1313] A means for detecting seat availability and user behavior using a monitoring device

[1314] A means for selecting candidates to encourage users to move seats based on vacant seat information analyzed using an analysis device

[1315] A means for inquiring about the availability of seats to potential passengers using a display device installed in the seat

[1316] A means for processing points when the previous customer's movement is approved using the operation approval means.

[1317] A means of obtaining the latest seat information and notifying users

[1318] A means to manage the addition or subtraction of points based on the result of transfer approval

[1319] Hardware and Software Configuration

[1320] 1. Mobile devices (smartphones and tablets):

[1321] Users can use this to launch a dedicated app and specify their login and seating preferences.

[1322] 2. Surveillance equipment (in-store cameras):

[1323] The cameras monitor all seats in the restaurant, monitoring vacant seats and customer behavior in real time.

[1324] 3. Analysis equipment (server including AI):

[1325] The server receives the video data sent from the camera and uses AI to analyze seat availability and user behavior.

[1326] 4. Display device (seat-mounted tablet):

[1327] The server sends an inquiry as to whether or not the movement is possible to the display device, and the display device displays options on the screen.

[1328] The user (previous customer) accepts or rejects the move.

[1329] 5. Points Management System:

[1330] The server manages the addition and subtraction of points based on the result of the transfer approval.

[1331] 6. Latest seat information notification system:

[1332] The server updates the database with the latest seat information and notifies the user.

[1333] Specific examples

[1334] Couples visiting the store

[1335] The specific flow of system operation when couple A and B visit a restaurant is shown below:

[1336] User A launches the dedicated app on their smartphone and logs in.

[1337] User A selects the "Sit side by side" option in the app.

[1338] The server receives real-time video footage from the in-store camera and analyzes it using AI, detecting that there is currently one vacant seat at the counter.

[1339] Based on the analysis results, the server lists the available seats as match candidates. The seats of the listed seats are equipped with display devices.

[1340] The server sends a query about whether or not the user can move to the display device installed at the seat of the previous user listed on the server. A pop-up message asking whether or not the user can move appears on the display device screen.

[1341] User B (the previous customer) accepts the move on the display screen. To accept, he simply touches the "Accept" button.

[1342] The server will grant 100 points to user B and subtract 100 points from user A. The information about the addition and subtraction of points will be notified to both users.

[1343] User B moves to a new seat. The position information of the new seat is displayed on the display device, so User B moves while referring to it.

[1344] The server updates the seat information and notifies User A's dedicated app. The notification includes the message "Your seat is ready."

[1345] User A and his partner sit next to each other at the seats they were assigned.

[1346] Prompt Sentence Examples

[1347] "Generate a sentence to explain the system's processing when a couple visits a restaurant and requests to sit next to each other."

[1348] With the above configuration, the present invention realizes efficient seat management and improved customer satisfaction at counter seats in restaurants and other establishments.

[1349] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1350] Program processing steps

[1351] Step 1:

[1352] The user launches the dedicated app on their mobile device and logs in, entering their user ID and password.

[1353] The terminal authenticates the user by sending login information to the server. The output is whether authentication was successful and the session ID.

[1354] Specifically, the user enters their ID and password on the app's login screen and touches the "Login" button. The device then sends this information to the server, which then authenticates them using the database.

[1355] Step 2:

[1356] The user selects the "Sit side by side" option from the app menu. The input is the user's selection.

[1357] The terminal sends this request to the server, and the output is a request to the server.

[1358] Specifically, the user selects the "Sit next to each other" option on the app's menu screen and touches the select button. The device then sends the selection information to the server.

[1359] Step 3:

[1360] The server receives video data from cameras in the store in real time. The input is the camera video data.

[1361] The server uses AI (analysis equipment) to analyze the video data and obtain information on available seats and user behavior. The output is the analysis result: available seat information.

[1362] Specifically, the server sends video data from the camera to an analysis device, and the AI ​​analyzes the data to create information about available seats.

[1363] Step 4:

[1364] The server uses the analysis results to detect available seats and available passengers. The input is the analysis results.

[1365] The server lists the previous customers who can be moved. The output is a list of the previous customers who can be moved.

[1366] Specifically, the server analyzes the analysis results and creates a list of existing customers who meet the conditions and can be moved.

[1367] Step 5:

[1368] The server sends a request to the seat of the previous user listed in the list to ask whether the user can move to that seat. The input is the list of previous users and the move request.

[1369] The terminal (display device) displays the option of whether to move to the seat of the previous customer. The output is the choice of whether to move or not.

[1370] Specifically, the server sends information to each display device based on a list of previous customers, and the display device displays a pop-up screen with options for whether or not to move. The previous customer touches the option to make a selection.

[1371] Step 6:

[1372] The terminal sends a response of acceptance of the move to the server. The input is the choice of acceptance or rejection of the previous user.

[1373] The server receives the user's transfer approval result, adds or subtracts points, and outputs the updated points.

[1374] Specifically, the display device sends the selection result to the server, which then adds or subtracts points and notifies the user of the result.

[1375] Step 7:

[1376] The user (previous customer) moves to the specified new seat. The input is the new seat information.

[1377] The server updates the database with the latest seating information. The output is the updated seating information.

[1378] Specifically, the preceding customer follows the instructions on the display device to move to a new seat, and the server updates the seat information accordingly.

[1379] Step 8:

[1380] The terminal notifies the user requesting a seat of the latest available seat information. The input is the updated seat information.

[1381] The user sits down at the seat they were assigned. The output is that the user has sat down.

[1382] Specifically, the server notifies a dedicated app of vacant seat information, and the user receives the information, moves to the designated seat, and takes a seat.

[1383] Through the above steps, a system is completed that realizes efficient seat management and improved user satisfaction.

[1384] (Application example 1)

[1385] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1386] Seating management has become a major issue in restaurants and various facilities today. In particular, there is a need to efficiently manage demand for seating alongside one another, such as at counter seats, and information on available seats in real time, but conventional systems have not been able to meet this need. Furthermore, there is a lack of incentives and smooth communication between customers when switching seats, creating a need for a method to achieve efficient and satisfying seating management. Furthermore, it is difficult to analyze customer trends in real time and provide appropriate guidance.

[1387] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1388] In this invention, the server includes: means for a user to specify a seating preference through a dedicated application; means for detecting vacant seat information and user behavior using an image capture device; means for selecting candidate seats to encourage users to move to based on vacant seat information analyzed using an analysis device; means for inquiring of the candidate preceding customer regarding seat relocation using a display device installed at the seat; means for processing points when the preceding customer agrees to the move using an action approval means; means for acquiring the latest seat information and providing guidance to the user; means for displaying vacant seat information and candidate seat status in real time via a smart device; means for providing optimal guidance to the user based on destination seat information; and means for managing the user's point balance and adding or subtracting points as the seat is moved. This enables more efficient and satisfying seat management and realizes the user's seating preferences.

[1389] A "dedicated application" is software with specific functions that allow users to specify seating preferences.

[1390] An "image capture device" is a device that uses a device such as a camera to capture information about vacant seats in a store and the behavior of customers, and acquires the data.

[1391] The "analysis device" is a device that analyzes seat availability information and user behavior based on acquired image data and determines optimal seat usage.

[1392] A "display device" is a device that is installed in a seat and displays information and inquiries about whether or not movement is possible to users and previous passengers.

[1393] The "action approval means" is a means for confirming that a previous passenger has consented to a seat change and for processing points.

[1394] "Latest seat information" refers to information that reflects the current seat usage and availability in real time.

[1395] A "smart device" is an electronic device such as a smartphone or tablet that can display information and communicate.

[1396] "Point balance" is a numerical value indicating the total amount of points owned by a user.

[1397] "Vacant seat information" is information indicating which seats are available in the restaurant.

[1398] "Customer behavior" is information that indicates the movement and behavior of the customer within the store.

[1399] This invention provides a system for efficiently managing seats in brick-and-mortar stores and realizing the seating preferences of customers. As a specific example, it targets the management of counter seats in restaurants.

[1400] System Configuration

[1401] 1. Dedicated application:

[1402] Users launch the application on their smartphone and specify their preference for seating next to each other. The application has functions such as login, checking available seat information, checking potential seat changes, and managing points.

[1403] 2. Image acquisition device:

[1404] IP cameras and other devices installed in the restaurant capture real-time footage of seat usage, and this video data is sent to a server.

[1405] 3. Analysis equipment:

[1406] Analysis software connected to the server analyzes the received video data using image analysis libraries such as OpenCV to obtain information on available seats and user behavior.

[1407] 4. Display device:

[1408] We use tablets and displays installed in the seats, which display a screen asking the previous passenger if they would like to move seats.

[1409] 5. Operational Approval Methods:

[1410] If the previous customer agrees to the seat change, the information is sent to the server and points are added or subtracted. Points are managed using a database.

[1411] 6. Acquisition and notification of seat availability information:

[1412] Based on the analysis results, the server updates the database with the latest seating information and notifies users in real time via a smartphone application.

[1413] Specific Examples

[1414] Couples visiting the store

[1415] Let's explain a scenario where A and B come to a restaurant as a couple.

[1416] Step 1: Person A launches the dedicated app on their smartphone and logs in.

[1417] Step 2: Person A selects the "Sit side by side" option in the app.

[1418] Step 3: The server receives real-time video data from the in-store camera, and the analysis device analyzes the data. Information about vacant seats and the behavior of previous customers are detected.

[1419] Step 4: The server lists the existing customers who can be moved as matching candidates.

[1420] Step 5: The server sends a request to the tablet installed in the seat of the previous passenger to inquire whether they are allowed to move.

[1421] Step 6: Mr. B (the previous customer) accepts the move on the tablet, and points are awarded upon the previous customer's acceptance.

[1422] Step 7: The server updates the database with the latest seat information and notifies the user.

[1423] Step 8: Mr. A and his partner sit next to each other in the seats they were assigned.

[1424] Prompt Sentence Examples

[1425] A couple visits a restaurant using the "Smart Seat" app. They register their preference to sit next to each other, and the app analyzes the available seating information in the restaurant. They are matched with a customer who is available to move, and the customer agrees to the move using points. Generate appropriate prompts and explain the specific steps.

[1426] This system allows customers to use seats comfortably and efficiently, and also allows stores to optimize seat management.In addition, by introducing a point system, it becomes easier to get cooperation from previous customers.

[1427] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1428] Step 1:

[1429] The user launches the dedicated application on their smartphone and logs in.

[1430] Input: User ID and password

[1431] Data processing and calculation: The terminal sends the login information to the server, and the server performs authentication. After authentication, the session begins.

[1432] Output: Successful login status and user information

[1433] Step 2:

[1434] The user selects the "Sit Side by Side" option from the application's menu.

[1435] Input: User's seat preference option selection

[1436] Data processing and calculation: The terminal sends the user's desired data to the server, which receives the request and begins processing.

[1437] Output: The preference to sit next to each other is recorded on the server.

[1438] Step 3:

[1439] The server receives video data from cameras in the store in real time.

[1440] Input: Video data from the camera

[1441] Data processing and calculation: The server acquires the video data and performs image analysis using an analysis device. OpenCV is used to extract seat availability information and user behavior.

[1442] Output: Analysis results of vacant seats and user behavior data

[1443] Step 4:

[1444] Based on the analysis results, the server lists seats of existing customers that can be moved to (matching candidates).

[1445] Input: Vacant seat information and user behavior data

[1446] Data processing and calculation: The server uses a clustering algorithm such as DBSCAN to identify potential customers.

[1447] Output: Match candidate list

[1448] Step 5:

[1449] The server sends a request to the seat of the previous occupant listed in the list.

[1450] Input: Match candidate list

[1451] Data processing and calculation: The server sends a query to the listed previous customer's terminal asking whether or not the transfer is possible.

[1452] Output: The move / non-move selection screen displayed on the customer's device

[1453] Step 6:

[1454] The user (previous customer) checks the options displayed on the terminal regarding whether or not to move, and accepts or rejects the move.

[1455] Input: Select whether to move the previous customer

[1456] Data processing and calculation: The terminal sends the selection information of the previous customer to the server, and performs approval processing using the operation approval means.

[1457] Output: Move acceptance or rejection status

[1458] Step 7:

[1459] The server processes points when the previous customer's permission to move is obtained.

[1460] Input: Previous customer's travel consent information

[1461] Data processing and calculation: The server performs point addition and subtraction processing and updates the user's point balance in the database.

[1462] Output: Point update information

[1463] Step 8:

[1464] The server obtains the latest seat information and provides it to the user.

[1465] Input: Final seat status and movement results

[1466] Data processing and calculation: The server updates the database with the latest seat information and notifies the user via the terminal.

[1467] Output: Latest seat information notification

[1468] Step 9:

[1469] The user (the user who has been guided to the new seat) moves to the designated new seat and sits down.

[1470] Input: User seating information

[1471] Data processing and calculation: Confirm that the user has completed their movement and that the system is operating normally.

[1472] Output: Status of the user having taken the new seat

[1473] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1474] The following describes in detail an embodiment of the present invention that combines an emotion engine. The present invention is a system for optimizing the use of vacant seats in stores and facilities, and achieves efficient seating management and comfortable seating, particularly at counter seats in restaurants and other establishments. The adoption of an emotion engine aims to further improve user satisfaction.

[1475] System Overview

[1476] The system includes the following means:

[1477] 1. How to specify your seating preference using a dedicated app

[1478] 2. Means for detecting vacant seat information using an image capture device

[1479] 3. Method for selecting matching candidates by the analysis device

[1480] 4. Means for inquiring whether movement is possible or not using a display device

[1481] 5. Point processing means by operation approval means

[1482] 6. Acquisition and guidance of the latest seat information

[1483] 7. Emotion Recognition Method Using Emotion Engine

[1484] With this configuration, users can specify their seating preferences through a dedicated app, and the combination of AI analysis and an emotion engine ensures efficient seat management and comfortable seating.

[1485] Program processing explanation

[1486] 1. User launches app

[1487] The user launches a dedicated app on their smartphone and logs in.

[1488] The terminal sends login information to the server, and the server authenticates the user information and starts the session.

[1489] 2. Select "Sit side by side"

[1490] The user selects the "Sit Side by Side" option from the app's menu.

[1491] The terminal sends this request to the server.

[1492] 3. Detecting vacant seat information

[1493] The server receives video data from cameras in the store in real time.

[1494] The server's AI (analysis device) analyzes the video data and detects seat availability and user behavior.

[1495] 4. Emotional Recognition

[1496] The server's emotion engine analyzes the user's facial expressions and voice to recognize their emotions.

[1497] 5. Selection of match candidates

[1498] Based on the analyzed seat availability information and emotion data, the server creates a list of seats (matching candidates) that are available for movement to.

[1499] 6. Inquiry about transfer availability

[1500] The server sends a question about whether the user can move to the tablet installed at the listed seat.

[1501] The terminal (a tablet at the previous customer's seat) displays the option to move or not.

[1502] The user (previous customer) selects whether or not to move using a tablet, and the emotion engine increases the likelihood of the move being accepted.

[1503] 7. Points Processing

[1504] The terminal sends a response to the server approving the move.

[1505] If the user (previous customer) agrees to the move, the server manages the addition or subtraction of points.

[1506] 8. Seat Movement and Latest Updates

[1507] The user (previous customer) moves to the new seat specified.

[1508] The server updates the database with the latest seating information and reflects it in real time.

[1509] 9. Seating Instructions

[1510] The terminal (dedicated app) notifies users who wish to sit down of the latest available seat information.

[1511] The user sits down at the seat he or she is assigned.

[1512] Specific examples

[1513] Couples visiting the store

[1514] Let's take the example of a couple, A and B, visiting a restaurant.

[1515] 1. User A launches the dedicated app on their smartphone and logs in.

[1516] 2. User A selects the "Sit side by side" option in the app.

[1517] 3. The server receives video from the in-store camera, and the AI ​​and emotion engine analyze it. Along with the seat availability information, it recognizes that there is one vacant seat at the counter and the user's emotion.

[1518] 4. The server lists available customers as matching candidates based on the seat availability information and emotion data.

[1519] 5. The server sends a request to the tablet installed at the seat of the previous customer listed on the list to inquire whether they can move.

[1520] 6. When User B (the previous customer) agrees to the move on the tablet, the emotion engine analyzes User B's emotions and determines that there is a low possibility of refusal.

[1521] 7. The server grants 100 points to User B and subtracts 100 points from User A.

[1522] 8. User B moves to a new seat.

[1523] 9. The server updates the seat information and notifies the app.

[1524] 10. User A and his partner sit next to each other at the seats they were assigned.

[1525] By utilizing the emotion engine, it becomes possible to manage seats taking into account the user's emotions, which is expected to improve user satisfaction.

[1526] The processing flow will be explained below.

[1527] Step 1:

[1528] The user launches a dedicated app on their smartphone and logs in.

[1529] Step 2:

[1530] The terminal sends the user's login information to the server, and the server authenticates the user information and starts a session.

[1531] Step 3:

[1532] The user selects the "Sit Side by Side" option from the app's menu.

[1533] Step 4:

[1534] The terminal transmits the selection information of the "sit side by side" option to the server.

[1535] Step 5:

[1536] The server receives video data from cameras in the store in real time.

[1537] Step 6:

[1538] The server's AI (analysis device) analyzes the video data and detects vacant seat information and user behavior.

[1539] Step 7:

[1540] The server's emotion engine analyzes the user's facial expressions and voice from camera and microphone input data and recognizes their emotions.

[1541] Step 8:

[1542] Based on the analyzed seat availability information and emotion data, the server creates a list of seats (matching candidates) that are available for movement to.

[1543] Step 9:

[1544] The server sends a question about whether the user can move to the tablet installed at the listed seat.

[1545] Step 10:

[1546] The terminal (a tablet at the previous customer's seat) displays the option to move or not.

[1547] Step 11:

[1548] The user (previous customer) selects whether or not to move using a tablet.

[1549] Step 12:

[1550] The server's emotion engine analyzes the emotions of the previous customer, and if it determines that there is little resistance to movement, it increases the priority.

[1551] Step 13:

[1552] The device (tablet) sends a response to the server approving the move.

[1553] Step 14:

[1554] The server receives the result of the transfer approval and processes the addition or subtraction of points.

[1555] Step 15:

[1556] The server will give 100 points to the user (previous customer) and subtract 100 points from the user who requested to "sit next to each other."

[1557] Step 16:

[1558] The user (previous customer) moves to the new seat specified.

[1559] Step 17:

[1560] The server updates the database with the latest seat information.

[1561] Step 18:

[1562] The server notifies the app of the updated seat information.

[1563] Step 19:

[1564] The terminal (dedicated app) notifies the user who wishes to sit down of the available seat after the move.

[1565] Step 20:

[1566] The user sits down at the seat he or she is assigned.

[1567] These are the specific processing steps of the program in this system. By adding an emotion engine, it is possible to take the user's emotions into consideration and provide a more natural and comfortable experience.

[1568] Example 2

[1569] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1570] Conventional systems have not been able to fully optimize seat utilization and improve customer satisfaction in restaurants and other facilities. In particular, in situations such as counter seating, achieving both efficient seat management and comfortable seating for customers is a challenge. Furthermore, flexible seating arrangements that take customer emotions into consideration are difficult, which can lead to lower customer satisfaction.

[1571] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for a user to specify a seating preference through a dedicated app; a means for detecting vacant seat information and user behavior using an image capture device; a means for selecting candidates for seat movement among users based on vacant seat information analyzed using an analysis device; a means for inquiring of the candidate preceding passenger regarding seat movement availability using a display device installed at the seat; a means for processing points when the preceding passenger agrees to the seat movement using an action approval means; a means for recognizing the user's emotions using an analysis device and using the data to determine whether to move seats; and a means for acquiring the latest seat information and providing the user with information. This enables efficient seat management, realizes flexible seat movement that takes user emotions into consideration, and is expected to improve user satisfaction.

[1572] A "user" is someone who operates a dedicated app or system to specify their seating preference or move to another seat.

[1573] A "dedicated app" is application software that allows users to specify seat preferences and travel on devices such as smartphones and tablets.

[1574] An "image capture device" is a camera or sensor installed in a store or facility to capture information on available seats and user behavior in real time.

[1575] "Vacant seat information" refers to data indicating whether seats are available in a store or facility.

[1576] "Customer behavior" refers to the actions and activities that customers perform in the store, which are detected by cameras and sensors.

[1577] The "analysis device" refers to hardware or software that analyzes data obtained from the image capture device and recognizes seat availability information and user emotions.

[1578] A "display device" is a screen installed at a seat that displays information and questions to passengers.

[1579] The "action approval means" refers to a mechanism or means for confirming that the user has approved the seat change, and is related to the processing of points.

[1580] "Point processing" refers to the process of adding or subtracting points when a seat change occurs between users.

[1581] An "emotion engine" is software or hardware that analyzes a user's facial expressions and voice and recognizes their emotions.

[1582] "Real-time" is a term that indicates that data acquisition, analysis, and information updates are immediate.

[1583] A "database" is a digital information storage location for centrally managing seating information, user behavior, point information, etc.

[1584] "Guidance means" refers to the mechanism or method for informing users of the latest seat information and providing guidance.

[1585] "Counter seats" are seats set up along the counter in restaurants and other establishments.

[1586] The present invention is a system for optimizing the use of vacant seats in stores and facilities, and realizes efficient seating management and comfortable seating, particularly at counter seats in restaurants and other establishments. By adopting an emotion engine, the system aims to further improve user satisfaction. Specific embodiments for implementing this system are described below.

[1587] System Overview

[1588] The system includes the following means:

[1589] 1. User launches app

[1590] The user launches a dedicated app on their smartphone and logs in. The device sends the login information to the server, which then authenticates the user information and starts the session.

[1591] 2. Specify seating preference

[1592] The user selects the "sit next to each other" option in the app, and the device sends this preference to the server.

[1593] 3. Detecting vacant seat information

[1594] The server receives video data from cameras in the store in real time, and an AI analysis device analyzes the video data to detect seat vacancies and customer behavior.

[1595] 4. User Emotion Recognition

[1596] The server's emotion engine analyzes the user's facial expressions and voice to recognize their emotions. The emotion engine is software or hardware that analyzes the user's facial expressions and voice to recognize their emotions.

[1597] 5. Selection of migration candidates

[1598] Based on the analyzed seat availability information and emotion data, the server creates a list of seats available for existing occupants to move to.

[1599] 6. Inquiry about transfer availability

[1600] The server sends a question about whether or not the customer wants to move to a tablet installed on the list of seats, and the customer selects whether or not they want to move on the tablet. The terminal then sends the selection information to the server.

[1601] 7. Points Processing

[1602] If the server receives approval for the seat change, it adds or subtracts points. The operation approval means is a mechanism or means for confirming that the user has approved the seat change, and is related to point processing.

[1603] 8. Seat Movement and Database Update

[1604] The user (previous customer) moves to a new seat, and the server updates the database with the latest seat information, reflecting it in real time.

[1605] 9. Seating Instructions

[1606] Based on the latest information on available seats, the server uses a dedicated app to notify the user requesting a seat of the latest information, and the user then takes the seat indicated to them.

[1607] Hardware and software used

[1608] Dedicated app: Application software that allows users to specify their seating preferences on a smartphone or tablet.

[1609] Image acquisition devices: Cameras and sensors installed in the store.

[1610] Analysis device: An AI system for analyzing video and audio data.

[1611] Emotion engine: Software or hardware that analyzes a user's facial expressions and voice to recognize emotions.

[1612] Display device: A screen such as a tablet.

[1613] Operation approval means: A system for adding or subtracting points.

[1614] Specific examples

[1615] Couples visiting the store

[1616] 1. User A launches the dedicated app on their smartphone and logs in.

[1617] 2. User A selects the "Sit side by side" option in the app.

[1618] 3. The server receives footage from the in-store camera, and the AI ​​and emotion engine analyze it.

[1619] 4. The server creates a list of available customers based on seat availability information and emotion data.

[1620] 5. The server sends a query to the tablet installed in the target seat asking whether the move is possible.

[1621] 6. User B (the previous customer) accepts the move on his tablet, and the server receives this information.

[1622] 7. The server processes the points and awards them to User B.

[1623] 8. User B moves to a new seat and the server updates the seat information.

[1624] 9. The dedicated app notifies User A of the latest available seat information, and User A takes the designated seat.

[1625] Prompt Sentence Examples

[1626] Below are some examples of prompt sentences to input to the generative AI model.

[1627] "Please explain in detail your seating management system for restaurants, including the specific steps of the system and how users use the app."

[1628] This prompt can be used to get a detailed explanation of the system, as well as additional information on how to specifically utilize the emotion engine and how the point system operates.

[1629] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1630] Step 1:

[1631] User launches app

[1632] The user launches the dedicated app on their smartphone.

[1633] The user enters their ID and password on the login screen and clicks the login button.

[1634] The terminal encrypts the entered login information and sends it to the server.

[1635] The server receives the login information and authenticates it by checking it against the database. The input is the user's ID and password, and the output is the authentication result (success / failure).

[1636] If the authentication is successful, the server generates a session ID and returns it to the terminal.

[1637] Step 2:

[1638] Specify seating preference

[1639] The user selects the "Sit Side by Side" option from the app's menu.

[1640] The terminal sends the user's preference to the server, indicating that they want to sit next to each other. The input is the user's preference, and the output is a confirmation of the transmission to the server.

[1641] The server records the desired information in a database and starts obtaining seat availability information.

[1642] Step 3:

[1643] Detecting vacant seat information

[1644] The server receives video data from cameras in the store in real time.

[1645] The analysis device analyzes the video data and detects seat availability and user behavior. The input is real-time video data, and the output is seat availability information and user behavior data.

[1646] The server stores the analysis results in a database.

[1647] Step 4:

[1648] User emotion recognition

[1649] The server's emotion engine analyzes the acquired video and audio data.

[1650] The emotion engine recognizes emotions from the user's facial expressions and voice. The input is video and audio data, and the output is the user's emotional data.

[1651] The server records the emotion data in a database.

[1652] Step 5:

[1653] Selection of candidates for transfer

[1654] The server creates a list of seats available for existing occupants to move to based on vacant seat information and emotion data.

[1655] The list is created by taking into consideration whether the seats are close to empty or whether the emotional data is positive. The input is empty seat information and emotional data, and the output is a list of candidates for movement.

[1656] The server stores the migration candidate list in a database.

[1657] Step 6:

[1658] Inquiry about whether moving is possible

[1659] The server sends a question about whether or not the user can move to a tablet installed on the seat on the candidate list.

[1660] The customer's tablet displays the question "Do you want to move?" and offers options. The input is a list of possible moves, and the output is a display of options for whether or not to move.

[1661] The user (previous customer) selects "move" or "don't move" on the tablet. The device sends the selected move permission information to the server.

[1662] Step 7:

[1663] Processing points

[1664] If the server approves the move, it adds or subtracts points.

[1665] The server adds the points of the previous customer and subtracts the points of the requesting customer. The input is the travel approval information, and the output is the point addition / subtraction result.

[1666] The server stores the point information in a database.

[1667] Step 8:

[1668] Seat movement and database updates

[1669] The user (previous customer) moves to the new seat indicated.

[1670] The server updates the seating information to the database, reflecting the overall seating situation in real time. The input is the movement fact, and the output is the updated seating data.

[1671] Step 9:

[1672] Seating instructions

[1673] Based on the latest seat availability information, the server uses a dedicated app to send notifications to users who wish to sit down.

[1674] The terminal (dedicated app) displays a notification to the user who wishes to sit and guides them to the seat they are assigned. The input is the latest vacant seat information, and the output is a notification to the user.

[1675] The user follows the notification and takes the designated seat.

[1676] (Application example 2)

[1677] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1678] Seating management in restaurants is an important factor in ensuring customers have a comfortable experience. However, especially during busy times at restaurants, customers often find it difficult to sit next to each other or in the seats they desire. Furthermore, seating is often assigned without regard for customers' feelings, often resulting in an unsatisfactory experience. This reduces customer satisfaction at restaurants. Another problem is the lack of smooth communication between customers who wish to move seats and those already seated.

[1679] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for a user to specify a seating preference through a dedicated app; a means for detecting vacant seat information and user behavior using an image capture device; a means for selecting candidates for seats to be encouraged among users based on vacant seat information analyzed using an analysis device; a means for inquiring of the candidate preceding passengers about whether they are willing to move seats using a display device installed at the seat; a means for processing points when the preceding passenger agrees to the move using an action approval means; a means for acquiring the latest seat information and providing guidance to the user; a means for recognizing the user's emotions using an emotion engine; and a means for suggesting an appropriate seat based on emotion recognition data. This enables comfortable seat management that takes the user's emotions into consideration and smooth communication in response to a move request.

[1680] A "user" is a customer who wishes to use a seat at a store.

[1681] A "dedicated app" is software that is installed on personal devices such as smartphones and tablets and used to manage seating at stores.

[1682] An "image capture device" is a camera or sensor that captures images and videos of the inside of a store in real time.

[1683] "Vacant seat information" is data indicating the status of seats currently not in use within the restaurant.

[1684] "Behavior" refers to actions such as movements and movements that customers make within the store.

[1685] The "analysis device" is a computer device that analyzes the acquired images and data to determine whether there are vacant seats and the behavior of users.

[1686] A "display device" is a device for visually displaying information, such as a display or tablet.

[1687] "Previous customer" refers to a user who is already seated.

[1688] "Movement possible" refers to an inquiry as to whether it is possible to move from the current seat to another seat.

[1689] The "action approval means" is a means for expressing the intention to approve or reject a seat change.

[1690] "Points" are rewards or incentives that are awarded to users when they agree to a seat change, or that are deducted from those who wish to move.

[1691] "Latest seat information" is data showing the current seat availability and usage status in the latest state.

[1692] An "emotion engine" is an algorithm or software that analyzes facial expressions and voice to recognize the user's emotional state.

[1693] "Emotion recognition data" is data that indicates the emotional state of the user as determined by the emotion engine.

[1694] "Appropriate seating" refers to the seating that is deemed to best match the user's preferences and emotional state.

[1695] Below, we will explain in detail a system that optimizes the use of empty seats in physical stores by combining an emotion engine.

[1696] System configuration

[1697] The system includes the following main hardware and software:

[1698] Hardware

[1699] 1. Smartphone

[1700] This is a device on which users can install a dedicated app and log in and specify their preferred seat.

[1701] 2. In-store cameras

[1702] This is a device that obtains information on available seats in the store and customer behavior in real time.

[1703] 3. In-store tablets

[1704] This device is used to ask seated users whether they wish to move seats.

[1705] software

[1706] 1. Dedicated app

[1707] It is software that is installed on a smartphone and allows the user to interact with the system.

[1708] 2. Emotion Engine

[1709] These are algorithms and software that analyze facial expressions and voice data to recognize the user's emotions.

[1710] Example: Face++, Affectiva SDK

[1711] 3. Data Analysis Software

[1712] This software analyzes the captured video and data to determine seat availability and user behavior.

[1713] Examples: OpenCV, TensorFlow

[1714] 4. Points Management System

[1715] This is a system for managing the addition and subtraction of points between users.

[1716] Examples: Firebase, AWS DynamoDB

[1717] 5. Real-time streaming services

[1718] This is a service that transmits video data from cameras in-store to a server in real time.

[1719] Examples: Amazon Kinesis, Google Cloud Pub / Sub

[1720] Program processing

[1721] The server performs seat management based on the following series of procedures.

[1722] 1. A way for users to specify their seating preference through a dedicated app

[1723] The server receives the request from the smartphone, authenticates the login information, and starts the session.

[1724] 2. Means of detecting vacant seat information and user behavior using an image capture device

[1725] The server receives video data from cameras in the store in real time and analyzes seat availability and customer behavior.

[1726] 3. A method for selecting candidates to encourage seat changes among users based on the analyzed vacant seat information

[1727] Based on the information on available seats, the server creates a list of seats available for existing customers and selects candidates.

[1728] 4. A means for inquiring about the availability of seats to potential passengers using a display device installed in the seat.

[1729] The server will then use a tablet in the store to ask the previous customers on his list whether they would like to move seats.

[1730] 5. A means for processing points when the previous customer's permission to move is obtained using the operation approval means.

[1731] The server receives the previous customer's permission to move and adds or subtracts points.

[1732] 6. A means of obtaining the latest seating information and providing it to users

[1733] The server updates the database with the latest available seat information and notifies the user.

[1734] 7. A method for recognizing user emotions using an emotion engine

[1735] The server analyzes the user's facial expressions and voice data using an emotion engine to recognize emotions.

[1736] 8. A method to suggest appropriate seats based on emotion recognition data

[1737] The server will suggest the most appropriate seat to the user based on emotion recognition data.

[1738] Specific examples

[1739] Couples visiting the store

[1740] 1. User A launches the dedicated app on their smartphone and logs in.

[1741] 2. User A selects the "Sit side by side" option in the app.

[1742] 3. The server receives footage from the in-store camera, and data analysis software and an emotion engine analyze seat availability and customer emotions.

[1743] 4. The server creates a list of available customers based on seat availability information and emotion data.

[1744] 5. The server sends a request to the tablet installed at the previous customer's seat to inquire whether they can move.

[1745] 6. When the previous customer accepts the move using the tablet, points are awarded using the point management system.

[1746] 7. The previous customer moves to a new seat, and the server updates the database with the latest seat information.

[1747] 8. User A sits next to the seat assigned to him.

[1748] Example prompts for generative AI models

[1749] Generate a program for a seating optimization system for a brick-and-mortar store based on the following requirements:

[1750] 1. A feature that allows users to log in using a smartphone app.

[1751] 2. A function that receives real-time video footage from cameras inside the store and analyzes seat availability information.

[1752] 3. Facial expression and voice analysis function using an emotion engine.

[1753] 4. A function that suggests suitable seats based on seat availability information and sentiment data.

[1754] 5. Ability to send and approve transfer requests to existing seat users via tablet.

[1755] 6. Ability to award points to users who approve the move.

[1756] 7. A function that notifies users of the latest available seat information and provides guidance in real time.

[1757] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1758] Step 1:

[1759] The user launches a dedicated app on their smartphone and logs in. The device sends the user's authentication information to the server, which then checks the user information against a database to start a session. The input data is the username and password, and the output data is a flag indicating successful authentication and a session ID. Through this process, the server recognizes the user as legitimate and allows them to use the app.

[1760] Step 2:

[1761] The user selects the "Sit side by side" option from the app menu. The device sends this preference to the server. The input data is the "Sit side by side" preference, and the output data is the seating preference option sent to the server. In this step, the server records the user's seating preference.

[1762] Step 3:

[1763] The server receives video data from cameras in the store in real time. It then analyzes the video data using data analysis software (e.g., OpenCV, TensorFlow) to detect seat availability and customer behavior. The input data is the video stream, and the output data is seat availability information and customer behavior data. The server uses the acquired seat availability information to determine the current seating situation.

[1764] Step 4:

[1765] The server's emotion engine (e.g., Face++, Affectiva) analyzes the user's facial expressions and voice from the video data to recognize emotions. The input data is the user's facial expressions and voice data, and the output data is the emotion recognition results. This allows the server to understand the user's mood and state.

[1766] Step 5:

[1767] Based on the analyzed vacant seat information and emotion data, the server lists seats (matching candidates) that the user can move to in order to suggest an appropriate seat. The input data is vacant seat information and emotion recognition data, and the output data is a list of previous users. This allows the server to identify the most suitable seat for the user.

[1768] Step 6:

[1769] The server sends a request to the tablet installed at the seat of the preceding customer on the list to inquire about whether or not the customer can move. The input data is the message requesting the move, and the output data is the question about whether or not the customer can move, which is displayed on the tablet. The server notifies the preceding customer of the move request via the tablet.

[1770] Step 7:

[1771] The customer who is already seated selects whether or not they wish to move using a tablet. The input data is the choice made by the customer, and the output data is the selection result sent to the server. The terminal sends this data to the server, and the server receives the result.

[1772] Step 8:

[1773] The server receives the previous customer's response of approval for the move and processes the points using the operation approval means. The input data is the selection result of the move approval, and the output data is the point increase / decrease information. The server uses the point management system to award points to the approver and subtract points from the applicant.

[1774] Step 9:

[1775] The previous customer moves to the new seat they have assigned, and the new seat information is updated in the database. The input data is the new seat information, and the output data is the updated seat data. The server saves this data in the database, and reflects the latest seat information in real time.

[1776] Step 10:

[1777] Finally, the server notifies the user's smartphone of the latest available seat information, and the user sits in the seat indicated. The input data is the latest available seat information, and the output data is the guidance information displayed on the user's smartphone. This allows the user to smoothly sit in the designated seat.

[1778] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1779] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1780] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1781] [Fourth embodiment]

[1782] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1783] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1784] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1785] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1786] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1787] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1788] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1789] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1790] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1791] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1792] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1793] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1794] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1795] The present invention provides a system for optimizing the use of vacant seats in stores and facilities, and realizes efficient seat management and comfortable seating, particularly at counter seats in restaurants and other establishments.

[1796] System Overview

[1797] This system allows customers to specify their seating preferences through a dedicated app, and AI analyzes and guides them to available seats in the restaurant, matching customers who want to sit next to each other with customers who are available to move to other seats. Specifically, the system includes the following measures:

[1798] How to specify seating preference using a dedicated app

[1799] Vacant seat information detection means using an image capture device

[1800] Matching candidate selection means by analysis device

[1801] Means for inquiring whether movement is possible or not using a display device

[1802] Point processing means by operation approval means

[1803] Acquisition and guidance of the latest seat information

[1804] Program processing explanation

[1805] 1. User launches app

[1806] The user launches the dedicated app on their smartphone and logs in.

[1807] The terminal sends the login information to the server to start the session.

[1808] 2. Select "Sit side by side"

[1809] The user selects the "Sit Side by Side" option from the app's menu.

[1810] The terminal sends this request to the server.

[1811] 3. Detecting vacant seat information

[1812] The server receives video data from cameras in the store in real time.

[1813] The server uses AI (analysis device) to analyze the received data and obtain information on available seats and user behavior.

[1814] 4. Selection of match candidates

[1815] Based on the analysis results, the server creates a list of seats (matching candidates) that can be moved to.

[1816] 5. Inquiry about transfer availability

[1817] The server sends a request to the listed seats asking whether or not to move to them.

[1818] The terminal (a display device installed at the previous customer's seat) displays the option of whether or not to move.

[1819] The user (previous customer) accepts or rejects the move on the screen.

[1820] 6. Points Processing

[1821] The terminal sends a response to the server approving the move.

[1822] If the user (previous customer) agrees to the move, the server manages the addition or subtraction of points.

[1823] 7. Seat Transfers and Renewals

[1824] The user (previous customer) moves to the new seat specified.

[1825] The server updates the database with the latest seating information and reflects it in real time.

[1826] 8. Seating instructions

[1827] The terminal (dedicated app) notifies the user who wishes to sit down of the available seat after the move.

[1828] The user sits down at the seat he or she is assigned.

[1829] Specific examples

[1830] Couples visiting the store

[1831] Let's take the example of a couple, A and B, visiting a restaurant.

[1832] 1. User A launches the dedicated app on their smartphone and logs in.

[1833] 2. User A selects the "Sit side by side" option in the app.

[1834] 3. The server receives the video from the in-store camera and the analysis device analyzes it. It determines that there is currently one vacant seat at the counter.

[1835] 4. The server lists existing customers who can be moved as matching candidates.

[1836] 5. The server sends a request to the tablet installed at the seat of the previous customer listed on the list to inquire whether they can move.

[1837] 6. User B (previous customer) accepts the move on his tablet.

[1838] 7. The server grants 100 points to User B and subtracts 100 points from User A.

[1839] 8. User B moves to a new seat.

[1840] 9. The server updates the latest seat information and notifies the app.

[1841] 10. User A and his partner sit next to each other at the seats they were assigned.

[1842] The above specific examples enable efficient seat management and improved user satisfaction.

[1843] The processing flow will be explained below.

[1844] Step 1:

[1845] The user launches a dedicated app on their smartphone and logs in.

[1846] Step 2:

[1847] The terminal sends the user's login information to the server, and the server authenticates the user information and starts a session.

[1848] Step 3:

[1849] The user selects the "Sit Side by Side" option from the app's menu.

[1850] Step 4:

[1851] The terminal transmits the selection information of the "sit side by side" option to the server.

[1852] Step 5:

[1853] The server receives video data from cameras in the store in real time.

[1854] Step 6:

[1855] The server's AI (analysis device) analyzes the video data and obtains information about available seats and user behavior.

[1856] Step 7:

[1857] Based on the analysis results, the server creates a list of seats (matching candidates) that can be moved to.

[1858] Step 8:

[1859] The server sends a question to the tablet installed at the seat of the previous customer listed on the server asking whether they wish to move.

[1860] Step 9:

[1861] The terminal (a tablet at the previous customer's seat) displays the option to move or not.

[1862] Step 10:

[1863] The user (previous customer) selects whether or not to move using a tablet and sends the result to the server.

[1864] Step 11:

[1865] The server receives the result of the transfer approval and processes the addition or subtraction of points.

[1866] Step 12:

[1867] The server will give 100 points to the user who moved (the previous customer) and subtract 100 points from the user who requested to "sit next to each other."

[1868] Step 13:

[1869] The user (previous customer) moves to the new seat specified.

[1870] Step 14:

[1871] The server updates the database with the latest seat information.

[1872] Step 15:

[1873] The server notifies the app of the updated seat information.

[1874] Step 16:

[1875] The terminal (dedicated app) notifies the user who wishes to sit down of the available seat after the move.

[1876] Step 17:

[1877] The user sits down at the seat he or she is assigned.

[1878] The above are the specific processing steps of the program in this system.

[1879] Example 1

[1880] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1881] Traditionally, seating management in stores and facilities has relied heavily on human labor, and there has been a challenge in restaurants and other establishments, where it is difficult to find suitable empty seats when customers want to sit together at counter seats. Furthermore, when trying to make effective use of empty seats by having previous customers move, this arrangement becomes cumbersome, and there is a risk of customer satisfaction decreasing. A system that can solve these issues and improve efficient seating management and customer satisfaction has been sought.

[1882] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1883] In this invention, the server includes: means for users to specify their seating preferences through a dedicated app on a mobile device; means for detecting vacant seat information and user behavior using a monitoring device; means for selecting candidates for encouraging users to move seats based on vacant seat information analyzed using an analysis device; means for inquiring of the candidate preceding passengers about whether they are willing to move seats using a display device installed at the seat; means for processing points when the preceding passenger agrees to move using an action approval means; means for acquiring the latest seat information and notifying the user; and means for managing the addition and subtraction of points based on the result of the move approval. This enables efficient seat management and smooth adjustments due to the movement of users who want to sit next to each other or preceding passengers, thereby improving user satisfaction.

[1884] "User" refers to an individual or group that uses a dedicated app to specify their seating preference.

[1885] A "dedicated app" refers to software that runs on mobile devices such as smartphones and tablets and allows passengers to specify their seating preferences.

[1886] "Mobile Device" refers to smartphones, tablets, and similar portable electronic devices.

[1887] "Monitoring devices" refers to devices such as cameras used to monitor the situation inside the store in real time and detect vacant seats and customer behavior.

[1888] "Vacancy information" refers to information indicating the current occupancy status (vacant or full) of each seat in the store.

[1889] "Analysis device" refers to AI or software that analyzes data obtained from monitoring devices and determines seat availability and user behavior.

[1890] "Matching candidates" refers to a list of existing passengers who can move seats, selected by the analysis device.

[1891] "Display device" refers to an electronic display or tablet installed in a seat to show passengers the option of whether or not to move.

[1892] "Movement availability inquiry" refers to a message sent from the server to the display device asking the previous passenger whether or not it is possible to move seats.

[1893] The "action approval means" refers to a means for recognizing the action of a previous passenger to accept or reject a seat change and processing the result of the action.

[1894] "Points Processing" means the act of adding or subtracting points from a Customer's account in response to the acceptance or denial of a seat change.

[1895] "Latest seating information" refers to updated seating arrangements and availability information based on current seat usage.

[1896] "Notification" refers to a message sent to inform users of updated seating information.

[1897] This invention is a system for optimizing the use of vacant seats in stores and facilities. It realizes efficient seat management and comfortable seating, particularly at counter seats in restaurants and other establishments. An embodiment of this system is described in detail below.

[1898] System Overview

[1899] This system allows customers to specify their seating preferences through a dedicated app, and then uses AI and various hardware to analyze and guide information about available seats in the restaurant, matching customers who want to sit next to each other with existing customers who are available to move to their seats.The system mainly includes the following components.

[1900] A way for users to specify their seating preference through a dedicated app on their mobile device

[1901] A means for detecting seat availability and user behavior using a monitoring device

[1902] A means for selecting candidates to encourage users to move seats based on vacant seat information analyzed using an analysis device

[1903] A means for inquiring about the availability of seats to potential passengers using a display device installed in the seat

[1904] A means for processing points when the previous customer's movement is approved using the operation approval means.

[1905] A means of obtaining the latest seat information and notifying users

[1906] A means to manage the addition or subtraction of points based on the result of transfer approval

[1907] Hardware and Software Configuration

[1908] 1. Mobile devices (smartphones and tablets):

[1909] Users can use this to launch a dedicated app and specify their login and seating preferences.

[1910] 2. Surveillance equipment (in-store cameras):

[1911] The cameras monitor all seats in the restaurant, monitoring vacant seats and customer behavior in real time.

[1912] 3. Analysis equipment (server including AI):

[1913] The server receives the video data sent from the camera and uses AI to analyze seat availability and user behavior.

[1914] 4. Display device (seat-mounted tablet):

[1915] The server sends an inquiry as to whether or not the movement is possible to the display device, and the display device displays options on the screen.

[1916] The user (previous customer) accepts or rejects the move.

[1917] 5. Points Management System:

[1918] The server manages the addition and subtraction of points based on the result of the transfer approval.

[1919] 6. Latest seat information notification system:

[1920] The server updates the database with the latest seat information and notifies the user.

[1921] Specific examples

[1922] Couples visiting the store

[1923] The specific flow of system operation when couple A and B visit a restaurant is shown below:

[1924] User A launches the dedicated app on their smartphone and logs in.

[1925] User A selects the "Sit side by side" option in the app.

[1926] The server receives real-time video footage from the in-store camera and analyzes it using AI, detecting that there is currently one vacant seat at the counter.

[1927] Based on the analysis results, the server lists the available seats as match candidates. The seats of the listed seats are equipped with display devices.

[1928] The server sends a query about whether or not the user can move to the display device installed at the seat of the previous user listed on the server. A pop-up message asking whether or not the user can move appears on the display device screen.

[1929] User B (the previous customer) accepts the move on the display screen. To accept, he simply touches the "Accept" button.

[1930] The server will grant 100 points to user B and subtract 100 points from user A. The information about the addition and subtraction of points will be notified to both users.

[1931] User B moves to a new seat. The position information of the new seat is displayed on the display device, so User B moves while referring to it.

[1932] The server updates the seat information and notifies User A's dedicated app. The notification includes the message "Your seat is ready."

[1933] User A and his partner sit next to each other at the seats they were assigned.

[1934] Prompt Sentence Examples

[1935] "Generate a sentence to explain the system's processing when a couple visits a restaurant and requests to sit next to each other."

[1936] With the above configuration, the present invention realizes efficient seat management and improved customer satisfaction at counter seats in restaurants and other establishments.

[1937] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1938] Program processing steps

[1939] Step 1:

[1940] The user launches the dedicated app on their mobile device and logs in, entering their user ID and password.

[1941] The terminal authenticates the user by sending login information to the server. The output is whether authentication was successful and the session ID.

[1942] Specifically, the user enters their ID and password on the app's login screen and touches the "Login" button. The device then sends this information to the server, which then authenticates them using the database.

[1943] Step 2:

[1944] The user selects the "Sit side by side" option from the app menu. The input is the user's selection.

[1945] The terminal sends this request to the server, and the output is a request to the server.

[1946] Specifically, the user selects the "Sit next to each other" option on the app's menu screen and touches the select button. The device then sends the selection information to the server.

[1947] Step 3:

[1948] The server receives video data from cameras in the store in real time. The input is the camera video data.

[1949] The server uses AI (analysis equipment) to analyze the video data and obtain information on available seats and user behavior. The output is the analysis result: available seat information.

[1950] Specifically, the server sends video data from the camera to an analysis device, and the AI ​​analyzes the data to create information about available seats.

[1951] Step 4:

[1952] The server uses the analysis results to detect available seats and available passengers. The input is the analysis results.

[1953] The server lists the previous customers who can be moved. The output is a list of the previous customers who can be moved.

[1954] Specifically, the server analyzes the analysis results and creates a list of existing customers who meet the conditions and can be moved.

[1955] Step 5:

[1956] The server sends a request to the seat of the previous user listed in the list to ask whether the user can move to that seat. The input is the list of previous users and the move request.

[1957] The terminal (display device) displays the option of whether to move to the seat of the previous customer. The output is the choice of whether to move or not.

[1958] Specifically, the server sends information to each display device based on a list of previous customers, and the display device displays a pop-up screen with options for whether or not to move. The previous customer touches the option to make a selection.

[1959] Step 6:

[1960] The terminal sends a response of acceptance of the move to the server. The input is the choice of acceptance or rejection of the previous user.

[1961] The server receives the user's transfer approval result, adds or subtracts points, and outputs the updated points.

[1962] Specifically, the display device sends the selection result to the server, which then adds or subtracts points and notifies the user of the result.

[1963] Step 7:

[1964] The user (previous customer) moves to the specified new seat. The input is the new seat information.

[1965] The server updates the database with the latest seating information. The output is the updated seating information.

[1966] Specifically, the preceding customer follows the instructions on the display device to move to a new seat, and the server updates the seat information accordingly.

[1967] Step 8:

[1968] The terminal notifies the user requesting a seat of the latest available seat information. The input is the updated seat information.

[1969] The user sits down at the seat they were assigned. The output is that the user has sat down.

[1970] Specifically, the server notifies a dedicated app of vacant seat information, and the user receives the information, moves to the designated seat, and takes a seat.

[1971] Through the above steps, a system is completed that realizes efficient seat management and improved user satisfaction.

[1972] (Application example 1)

[1973] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1974] Seating management has become a major issue in restaurants and various facilities today. In particular, there is a need to efficiently manage demand for seating alongside one another, such as at counter seats, and information on available seats in real time, but conventional systems have not been able to meet this need. Furthermore, there is a lack of incentives and smooth communication between customers when switching seats, creating a need for a method to achieve efficient and satisfying seating management. Furthermore, it is difficult to analyze customer trends in real time and provide appropriate guidance.

[1975] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1976] In this invention, the server includes: means for a user to specify a seating preference through a dedicated application; means for detecting vacant seat information and user behavior using an image capture device; means for selecting candidate seats to encourage users to move to based on vacant seat information analyzed using an analysis device; means for inquiring of the candidate preceding customer regarding seat relocation using a display device installed at the seat; means for processing points when the preceding customer agrees to the move using an action approval means; means for acquiring the latest seat information and providing guidance to the user; means for displaying vacant seat information and candidate seat status in real time via a smart device; means for providing optimal guidance to the user based on destination seat information; and means for managing the user's point balance and adding or subtracting points as the seat is moved. This enables more efficient and satisfying seat management and realizes the user's seating preferences.

[1977] A "dedicated application" is software with specific functions that allow users to specify seating preferences.

[1978] An "image capture device" is a device that uses a device such as a camera to capture information about vacant seats in a store and the behavior of customers, and acquires the data.

[1979] The "analysis device" is a device that analyzes seat availability information and user behavior based on acquired image data and determines optimal seat usage.

[1980] A "display device" is a device that is installed in a seat and displays information and inquiries about whether or not movement is possible to users and previous passengers.

[1981] The "action approval means" is a means for confirming that a previous passenger has consented to a seat change and for processing points.

[1982] "Latest seat information" refers to information that reflects the current seat usage and availability in real time.

[1983] A "smart device" is an electronic device such as a smartphone or tablet that can display information and communicate.

[1984] "Point balance" is a numerical value indicating the total amount of points owned by a user.

[1985] "Vacant seat information" is information indicating which seats are available in the restaurant.

[1986] "Customer behavior" is information that indicates the movement and behavior of the customer within the store.

[1987] This invention provides a system for efficiently managing seats in brick-and-mortar stores and realizing the seating preferences of customers. As a specific example, it targets the management of counter seats in restaurants.

[1988] System Configuration

[1989] 1. Dedicated application:

[1990] Users launch the application on their smartphone and specify their preference for seating next to each other. The application has functions such as login, checking available seat information, checking potential seat changes, and managing points.

[1991] 2. Image acquisition device:

[1992] IP cameras and other devices installed in the restaurant capture real-time footage of seat usage, and this video data is sent to a server.

[1993] 3. Analysis equipment:

[1994] Analysis software connected to the server analyzes the received video data using image analysis libraries such as OpenCV to obtain information on available seats and user behavior.

[1995] 4. Display device:

[1996] We use tablets and displays installed in the seats, which display a screen asking the previous passenger if they would like to move seats.

[1997] 5. Operational Approval Methods:

[1998] If the previous customer agrees to the seat change, the information is sent to the server and points are added or subtracted. Points are managed using a database.

[1999] 6. Acquisition and notification of seat availability information:

[2000] Based on the analysis results, the server updates the database with the latest seating information and notifies users in real time via a smartphone application.

[2001] Specific Examples

[2002] Couples visiting the store

[2003] Let's explain a scenario where A and B come to a restaurant as a couple.

[2004] Step 1: Person A launches the dedicated app on their smartphone and logs in.

[2005] Step 2: Person A selects the "Sit side by side" option in the app.

[2006] Step 3: The server receives real-time video data from the in-store camera, and the analysis device analyzes the data. Information about vacant seats and the behavior of previous customers are detected.

[2007] Step 4: The server lists the existing customers who can be moved as matching candidates.

[2008] Step 5: The server sends a request to the tablet installed in the seat of the previous passenger to inquire whether they are allowed to move.

[2009] Step 6: Mr. B (the previous customer) accepts the move on the tablet, and points are awarded upon the previous customer's acceptance.

[2010] Step 7: The server updates the database with the latest seat information and notifies the user.

[2011] Step 8: Mr. A and his partner sit next to each other in the seats they were assigned.

[2012] Prompt Sentence Examples

[2013] A couple visits a restaurant using the "Smart Seat" app. They register their preference to sit next to each other, and the app analyzes the available seating information in the restaurant. They are matched with a customer who is available to move, and the customer agrees to the move using points. Generate appropriate prompts and explain the specific steps.

[2014] This system allows customers to use seats comfortably and efficiently, and also allows stores to optimize seat management.In addition, by introducing a point system, it becomes easier to get cooperation from previous customers.

[2015] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2016] Step 1:

[2017] The user launches the dedicated application on their smartphone and logs in.

[2018] Input: User ID and password

[2019] Data processing and calculation: The terminal sends the login information to the server, and the server performs authentication. After authentication, the session begins.

[2020] Output: Successful login status and user information

[2021] Step 2:

[2022] The user selects the "Sit Side by Side" option from the application's menu.

[2023] Input: User's seat preference option selection

[2024] Data processing and calculation: The terminal sends the user's desired data to the server, which receives the request and begins processing.

[2025] Output: The preference to sit next to each other is recorded on the server.

[2026] Step 3:

[2027] The server receives video data from cameras in the store in real time.

[2028] Input: Video data from the camera

[2029] Data processing and calculation: The server acquires the video data and performs image analysis using an analysis device. OpenCV is used to extract seat availability information and user behavior.

[2030] Output: Analysis results of vacant seats and user behavior data

[2031] Step 4:

[2032] Based on the analysis results, the server lists seats of existing customers that can be moved to (matching candidates).

[2033] Input: Vacant seat information and user behavior data

[2034] Data processing and calculation: The server uses a clustering algorithm such as DBSCAN to identify potential customers.

[2035] Output: Match candidate list

[2036] Step 5:

[2037] The server sends a request to the seat of the previous occupant listed in the list.

[2038] Input: Match candidate list

[2039] Data processing and calculation: The server sends a query to the listed previous customer's terminal asking whether or not the transfer is possible.

[2040] Output: The move / non-move selection screen displayed on the customer's device

[2041] Step 6:

[2042] The user (previous customer) checks the options displayed on the terminal regarding whether or not to move, and accepts or rejects the move.

[2043] Input: Select whether to move the previous customer

[2044] Data processing and calculation: The terminal sends the selection information of the previous customer to the server, and performs approval processing using the operation approval means.

[2045] Output: Move acceptance or rejection status

[2046] Step 7:

[2047] The server processes points when the previous customer's permission to move is obtained.

[2048] Input: Previous customer's travel consent information

[2049] Data processing and calculation: The server performs point addition and subtraction processing and updates the user's point balance in the database.

[2050] Output: Point update information

[2051] Step 8:

[2052] The server obtains the latest seat information and provides it to the user.

[2053] Input: Final seat status and movement results

[2054] Data processing and calculation: The server updates the database with the latest seat information and notifies the user via the terminal.

[2055] Output: Latest seat information notification

[2056] Step 9:

[2057] The user (the user who has been guided to the new seat) moves to the designated new seat and sits down.

[2058] Input: User seating information

[2059] Data processing and calculation: Confirm that the user has completed their movement and that the system is operating normally.

[2060] Output: Status of the user having taken the new seat

[2061] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2062] The following describes in detail an embodiment of the present invention that combines an emotion engine. The present invention is a system for optimizing the use of vacant seats in stores and facilities, and achieves efficient seating management and comfortable seating, particularly at counter seats in restaurants and other establishments. The adoption of an emotion engine aims to further improve user satisfaction.

[2063] System Overview

[2064] The system includes the following means:

[2065] 1. How to specify your seating preference using a dedicated app

[2066] 2. Means for detecting vacant seat information using an image capture device

[2067] 3. Method for selecting matching candidates by the analysis device

[2068] 4. Means for inquiring whether movement is possible or not using a display device

[2069] 5. Point processing means by operation approval means

[2070] 6. Acquisition and guidance of the latest seat information

[2071] 7. Emotion Recognition Method Using Emotion Engine

[2072] With this configuration, users can specify their seating preferences through a dedicated app, and the combination of AI analysis and an emotion engine ensures efficient seat management and comfortable seating.

[2073] Program processing explanation

[2074] 1. User launches app

[2075] The user launches a dedicated app on their smartphone and logs in.

[2076] The terminal sends login information to the server, and the server authenticates the user information and starts the session.

[2077] 2. Select "Sit side by side"

[2078] The user selects the "Sit Side by Side" option from the app's menu.

[2079] The terminal sends this request to the server.

[2080] 3. Detecting vacant seat information

[2081] The server receives video data from cameras in the store in real time.

[2082] The server's AI (analysis device) analyzes the video data and detects seat availability and user behavior.

[2083] 4. Emotional Recognition

[2084] The server's emotion engine analyzes the user's facial expressions and voice to recognize their emotions.

[2085] 5. Selection of match candidates

[2086] Based on the analyzed seat availability information and emotion data, the server creates a list of seats (matching candidates) that are available for movement to.

[2087] 6. Inquiry about transfer availability

[2088] The server sends a question about whether the user can move to the tablet installed at the listed seat.

[2089] The terminal (a tablet at the previous customer's seat) displays the option to move or not.

[2090] The user (previous customer) selects whether or not to move using a tablet, and the emotion engine increases the likelihood of the move being accepted.

[2091] 7. Points Processing

[2092] The terminal sends a response to the server approving the move.

[2093] If the user (previous customer) agrees to the move, the server manages the addition or subtraction of points.

[2094] 8. Seat Movement and Latest Updates

[2095] The user (previous customer) moves to the new seat specified.

[2096] The server updates the database with the latest seating information and reflects it in real time.

[2097] 9. Seating Instructions

[2098] The terminal (dedicated app) notifies users who wish to sit down of the latest available seat information.

[2099] The user sits down at the seat he or she is assigned.

[2100] Specific examples

[2101] Couples visiting the store

[2102] Let's take the example of a couple, A and B, visiting a restaurant.

[2103] 1. User A launches the dedicated app on their smartphone and logs in.

[2104] 2. User A selects the "Sit side by side" option in the app.

[2105] 3. The server receives video from the in-store camera, and the AI ​​and emotion engine analyze it. Along with the seat availability information, it recognizes that there is one vacant seat at the counter and the user's emotion.

[2106] 4. The server lists available customers as matching candidates based on the seat availability information and emotion data.

[2107] 5. The server sends a request to the tablet installed at the seat of the previous customer listed on the list to inquire whether they can move.

[2108] 6. When User B (the previous customer) agrees to the move on the tablet, the emotion engine analyzes User B's emotions and determines that there is a low possibility of refusal.

[2109] 7. The server grants 100 points to User B and subtracts 100 points from User A.

[2110] 8. User B moves to a new seat.

[2111] 9. The server updates the seat information and notifies the app.

[2112] 10. User A and his partner sit next to each other at the seats they were assigned.

[2113] By utilizing the emotion engine, it becomes possible to manage seats taking into account the user's emotions, which is expected to improve user satisfaction.

[2114] The processing flow will be explained below.

[2115] Step 1:

[2116] The user launches a dedicated app on their smartphone and logs in.

[2117] Step 2:

[2118] The terminal sends the user's login information to the server, and the server authenticates the user information and starts a session.

[2119] Step 3:

[2120] The user selects the "Sit Side by Side" option from the app's menu.

[2121] Step 4:

[2122] The terminal transmits the selection information of the "sit side by side" option to the server.

[2123] Step 5:

[2124] The server receives video data from cameras in the store in real time.

[2125] Step 6:

[2126] The server's AI (analysis device) analyzes the video data and detects vacant seat information and user behavior.

[2127] Step 7:

[2128] The server's emotion engine analyzes the user's facial expressions and voice from camera and microphone input data and recognizes their emotions.

[2129] Step 8:

[2130] Based on the analyzed seat availability information and emotion data, the server creates a list of seats (matching candidates) that are available for movement to.

[2131] Step 9:

[2132] The server sends a question about whether the user can move to the tablet installed at the listed seat.

[2133] Step 10:

[2134] The terminal (a tablet at the previous customer's seat) displays the option to move or not.

[2135] Step 11:

[2136] The user (previous customer) selects whether or not to move using a tablet.

[2137] Step 12:

[2138] The server's emotion engine analyzes the emotions of the previous customer, and if it determines that there is little resistance to movement, it increases the priority.

[2139] Step 13:

[2140] The device (tablet) sends a response to the server approving the move.

[2141] Step 14:

[2142] The server receives the result of the transfer approval and processes the addition or subtraction of points.

[2143] Step 15:

[2144] The server will give 100 points to the user (previous customer) and subtract 100 points from the user who requested to "sit next to each other."

[2145] Step 16:

[2146] The user (previous customer) moves to the new seat specified.

[2147] Step 17:

[2148] The server updates the database with the latest seat information.

[2149] Step 18:

[2150] The server notifies the app of the updated seat information.

[2151] Step 19:

[2152] The terminal (dedicated app) notifies the user who wishes to sit down of the available seat after the move.

[2153] Step 20:

[2154] The user sits down at the seat he or she is assigned.

[2155] These are the specific processing steps of the program in this system. By adding an emotion engine, it is possible to take the user's emotions into consideration and provide a more natural and comfortable experience.

[2156] Example 2

[2157] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2158] Conventional systems have not been able to fully optimize seat utilization and improve customer satisfaction in restaurants and other facilities. In particular, in situations such as counter seating, achieving both efficient seat management and comfortable seating for customers is a challenge. Furthermore, flexible seating arrangements that take customer emotions into consideration are difficult, which can lead to lower customer satisfaction.

[2159] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: a means for a user to specify a seating preference through a dedicated app; a means for detecting vacant seat information and user behavior using an image capture device; a means for selecting candidates for seat movement among users based on vacant seat information analyzed using an analysis device; a means for inquiring of the candidate preceding passenger regarding seat movement availability using a display device installed at the seat; a means for processing points when the preceding passenger agrees to the seat movement using an action approval means; a means for recognizing the user's emotions using an analysis device and using the data to determine whether to move seats; and a means for acquiring the latest seat information and providing the user with information. This enables efficient seat management, realizes flexible seat movement that takes user emotions into consideration, and is expected to improve user satisfaction.

[2160] A "user" is someone who operates a dedicated app or system to specify their seating preference or move to another seat.

[2161] A "dedicated app" is application software that allows users to specify seat preferences and travel on devices such as smartphones and tablets.

[2162] An "image capture device" is a camera or sensor installed in a store or facility to capture information on available seats and user behavior in real time.

[2163] "Vacant seat information" refers to data indicating whether seats are available in a store or facility.

[2164] "Customer behavior" refers to the actions and activities that customers perform in the store, which are detected by cameras and sensors.

[2165] The "analysis device" refers to hardware or software that analyzes data obtained from the image capture device and recognizes seat availability information and user emotions.

[2166] A "display device" is a screen installed at a seat that displays information and questions to passengers.

[2167] The "action approval means" refers to a mechanism or means for confirming that the user has approved the seat change, and is related to the processing of points.

[2168] "Point processing" refers to the process of adding or subtracting points when a seat change occurs between users.

[2169] An "emotion engine" is software or hardware that analyzes a user's facial expressions and voice and recognizes their emotions.

[2170] "Real-time" is a term that indicates that data acquisition, analysis, and information updates are immediate.

[2171] A "database" is a digital information storage location for centrally managing seating information, user behavior, point information, etc.

[2172] "Guidance means" refers to the mechanism or method for informing users of the latest seat information and providing guidance.

[2173] "Counter seats" are seats set up along the counter in restaurants and other establishments.

[2174] The present invention is a system for optimizing the use of vacant seats in stores and facilities, and realizes efficient seating management and comfortable seating, particularly at counter seats in restaurants and other establishments. By adopting an emotion engine, the system aims to further improve user satisfaction. Specific embodiments for implementing this system are described below.

[2175] System Overview

[2176] The system includes the following means:

[2177] 1. User launches app

[2178] The user launches a dedicated app on their smartphone and logs in. The device sends the login information to the server, which then authenticates the user information and starts the session.

[2179] 2. Specify seating preference

[2180] The user selects the "sit next to each other" option in the app, and the device sends this preference to the server.

[2181] 3. Detecting vacant seat information

[2182] The server receives video data from cameras in the store in real time, and an AI analysis device analyzes the video data to detect seat vacancies and customer behavior.

[2183] 4. User Emotion Recognition

[2184] The server's emotion engine analyzes the user's facial expressions and voice to recognize their emotions. The emotion engine is software or hardware that analyzes the user's facial expressions and voice to recognize their emotions.

[2185] 5. Selection of migration candidates

[2186] Based on the analyzed seat availability information and emotion data, the server creates a list of seats available for existing occupants to move to.

[2187] 6. Inquiry about transfer availability

[2188] The server sends a question about whether or not the customer wants to move to a tablet installed on the list of seats, and the customer selects whether or not they want to move on the tablet. The terminal then sends the selection information to the server.

[2189] 7. Points Processing

[2190] If the server receives approval for the seat change, it adds or subtracts points. The operation approval means is a mechanism or means for confirming that the user has approved the seat change, and is related to point processing.

[2191] 8. Seat Movement and Database Update

[2192] The user (previous customer) moves to a new seat, and the server updates the database with the latest seat information, reflecting it in real time.

[2193] 9. Seating Instructions

[2194] Based on the latest information on available seats, the server uses a dedicated app to notify the user requesting a seat of the latest information, and the user then takes the seat indicated to them.

[2195] Hardware and software used

[2196] Dedicated app: Application software that allows users to specify their seating preferences on a smartphone or tablet.

[2197] Image acquisition devices: Cameras and sensors installed in the store.

[2198] Analysis device: An AI system for analyzing video and audio data.

[2199] Emotion engine: Software or hardware that analyzes a user's facial expressions and voice to recognize emotions.

[2200] Display device: A screen such as a tablet.

[2201] Operation approval means: A system for adding or subtracting points.

[2202] Specific examples

[2203] Couples visiting the store

[2204] 1. User A launches the dedicated app on their smartphone and logs in.

[2205] 2. User A selects the "Sit side by side" option in the app.

[2206] 3. The server receives footage from the in-store camera, and the AI ​​and emotion engine analyze it.

[2207] 4. The server creates a list of available customers based on seat availability information and emotion data.

[2208] 5. The server sends a query to the tablet installed in the target seat asking whether the move is possible.

[2209] 6. User B (the previous customer) accepts the move on his tablet, and the server receives this information.

[2210] 7. The server processes the points and awards them to User B.

[2211] 8. User B moves to a new seat and the server updates the seat information.

[2212] 9. The dedicated app notifies User A of the latest available seat information, and User A takes the designated seat.

[2213] Prompt Sentence Examples

[2214] Below are some examples of prompt sentences to input to the generative AI model.

[2215] "Please explain in detail your seating management system for restaurants, including the specific steps of the system and how users use the app."

[2216] This prompt can be used to get a detailed explanation of the system, as well as additional information on how to specifically utilize the emotion engine and how the point system operates.

[2217] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2218] Step 1:

[2219] User launches app

[2220] The user launches the dedicated app on their smartphone.

[2221] The user enters their ID and password on the login screen and clicks the login button.

[2222] The terminal encrypts the entered login information and sends it to the server.

[2223] The server receives the login information and authenticates it by checking it against the database. The input is the user's ID and password, and the output is the authentication result (success / failure).

[2224] If the authentication is successful, the server generates a session ID and returns it to the terminal.

[2225] Step 2:

[2226] Specify seating preference

[2227] The user selects the "Sit Side by Side" option from the app's menu.

[2228] The terminal sends the user's preference to the server, indicating that they want to sit next to each other. The input is the user's preference, and the output is a confirmation of the transmission to the server.

[2229] The server records the desired information in a database and starts obtaining seat availability information.

[2230] Step 3:

[2231] Detecting vacant seat information

[2232] The server receives video data from cameras in the store in real time.

[2233] The analysis device analyzes the video data and detects seat availability and user behavior. The input is real-time video data, and the output is seat availability information and user behavior data.

[2234] The server stores the analysis results in a database.

[2235] Step 4:

[2236] User emotion recognition

[2237] The server's emotion engine analyzes the acquired video and audio data.

[2238] The emotion engine recognizes emotions from the user's facial expressions and voice. The input is video and audio data, and the output is the user's emotional data.

[2239] The server records the emotion data in a database.

[2240] Step 5:

[2241] Selection of candidates for transfer

[2242] The server creates a list of seats available for existing occupants to move to based on vacant seat information and emotion data.

[2243] The list is created by taking into consideration whether the seats are close to empty or whether the emotional data is positive. The input is empty seat information and emotional data, and the output is a list of candidates for movement.

[2244] The server stores the migration candidate list in a database.

[2245] Step 6:

[2246] Inquiry about whether moving is possible

[2247] The server sends a question about whether or not the user can move to a tablet installed on the seat on the candidate list.

[2248] The customer's tablet displays the question "Do you want to move?" and offers options. The input is a list of possible moves, and the output is a display of options for whether or not to move.

[2249] The user (previous customer) selects "move" or "don't move" on the tablet. The device sends the selected move permission information to the server.

[2250] Step 7:

[2251] Processing points

[2252] If the server approves the move, it adds or subtracts points.

[2253] The server adds the points of the previous customer and subtracts the points of the requesting customer. The input is the travel approval information, and the output is the point addition / subtraction result.

[2254] The server stores the point information in a database.

[2255] Step 8:

[2256] Seat movement and database updates

[2257] The user (previous customer) moves to the new seat indicated.

[2258] The server updates the seating information to the database, reflecting the overall seating situation in real time. The input is the movement fact, and the output is the updated seating data.

[2259] Step 9:

[2260] Seating instructions

[2261] Based on the latest seat availability information, the server uses a dedicated app to send notifications to users who wish to sit down.

[2262] The terminal (dedicated app) displays a notification to the user who wishes to sit and guides them to the seat they are assigned. The input is the latest vacant seat information, and the output is a notification to the user.

[2263] The user follows the notification and takes the designated seat.

[2264] (Application example 2)

[2265] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2266] Seating management in restaurants is an important factor in ensuring customers have a comfortable experience. However, especially during busy times at restaurants, customers often find it difficult to sit next to each other or in the seats they desire. Furthermore, seating is often assigned without regard for customers' feelings, often resulting in an unsatisfactory experience. This reduces customer satisfaction at restaurants. Another problem is the lack of smooth communication between customers who wish to move seats and those already seated.

[2267] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for a user to specify a seating preference through a dedicated app; a means for detecting vacant seat information and user behavior using an image capture device; a means for selecting candidates for seats to be encouraged among users based on vacant seat information analyzed using an analysis device; a means for inquiring of the candidate preceding passengers about whether they are willing to move seats using a display device installed at the seat; a means for processing points when the preceding passenger agrees to the move using an action approval means; a means for acquiring the latest seat information and providing guidance to the user; a means for recognizing the user's emotions using an emotion engine; and a means for suggesting an appropriate seat based on emotion recognition data. This enables comfortable seat management that takes the user's emotions into consideration and smooth communication in response to a move request.

[2268] A "user" is a customer who wishes to use a seat at a store.

[2269] A "dedicated app" is software that is installed on personal devices such as smartphones and tablets and used to manage seating at stores.

[2270] An "image capture device" is a camera or sensor that captures images and videos of the inside of a store in real time.

[2271] "Vacant seat information" is data indicating the status of seats currently not in use within the restaurant.

[2272] "Behavior" refers to actions such as movements and movements that customers make within the store.

[2273] The "analysis device" is a computer device that analyzes the acquired images and data to determine whether there are vacant seats and the behavior of users.

[2274] A "display device" is a device for visually displaying information, such as a display or tablet.

[2275] "Previous customer" refers to a user who is already seated.

[2276] "Movement possible" refers to an inquiry as to whether it is possible to move from the current seat to another seat.

[2277] The "action approval means" is a means for expressing the intention to approve or reject a seat change.

[2278] "Points" are rewards or incentives that are awarded to users when they agree to a seat change, or that are deducted from those who wish to move.

[2279] "Latest seat information" is data showing the current seat availability and usage status in the latest state.

[2280] An "emotion engine" is an algorithm or software that analyzes facial expressions and voice to recognize the user's emotional state.

[2281] "Emotion recognition data" is data that indicates the emotional state of the user as determined by the emotion engine.

[2282] "Appropriate seating" refers to the seating that is deemed to best match the user's preferences and emotional state.

[2283] Below, we will explain in detail a system that optimizes the use of empty seats in physical stores by combining an emotion engine.

[2284] System configuration

[2285] The system includes the following main hardware and software:

[2286] Hardware

[2287] 1. Smartphone

[2288] This is a device on which users can install a dedicated app and log in and specify their preferred seat.

[2289] 2. In-store cameras

[2290] This is a device that obtains information on available seats in the store and customer behavior in real time.

[2291] 3. In-store tablets

[2292] This device is used to ask seated users whether they wish to move seats.

[2293] software

[2294] 1. Dedicated app

[2295] It is software that is installed on a smartphone and allows the user to interact with the system.

[2296] 2. Emotion Engine

[2297] These are algorithms and software that analyze facial expressions and voice data to recognize the user's emotions.

[2298] Example: Face++, Affectiva SDK

[2299] 3. Data Analysis Software

[2300] This software analyzes the captured video and data to determine seat availability and user behavior.

[2301] Examples: OpenCV, TensorFlow

[2302] 4. Points Management System

[2303] This is a system for managing the addition and subtraction of points between users.

[2304] Examples: Firebase, AWS DynamoDB

[2305] 5. Real-time streaming services

[2306] This is a service that transmits video data from cameras in-store to a server in real time.

[2307] Examples: Amazon Kinesis, Google Cloud Pub / Sub

[2308] Program processing

[2309] The server performs seat management based on the following series of procedures.

[2310] 1. A way for users to specify their seating preference through a dedicated app

[2311] The server receives the request from the smartphone, authenticates the login information, and starts the session.

[2312] 2. Means of detecting vacant seat information and user behavior using an image capture device

[2313] The server receives video data from cameras in the store in real time and analyzes seat availability and customer behavior.

[2314] 3. A method for selecting candidates to encourage seat changes among users based on the analyzed vacant seat information

[2315] Based on the information on available seats, the server creates a list of seats available for existing customers and selects candidates.

[2316] 4. A means for inquiring about the availability of seats to potential passengers using a display device installed in the seat.

[2317] The server will then use a tablet in the store to ask the previous customers on his list whether they would like to move seats.

[2318] 5. A means for processing points when the previous customer's permission to move is obtained using the operation approval means.

[2319] The server receives the previous customer's permission to move and adds or subtracts points.

[2320] 6. A means of obtaining the latest seating information and providing it to users

[2321] The server updates the database with the latest available seat information and notifies the user.

[2322] 7. A method for recognizing user emotions using an emotion engine

[2323] The server analyzes the user's facial expressions and voice data using an emotion engine to recognize emotions.

[2324] 8. A method to suggest appropriate seats based on emotion recognition data

[2325] The server will suggest the most appropriate seat to the user based on emotion recognition data.

[2326] Specific examples

[2327] Couples visiting the store

[2328] 1. User A launches the dedicated app on their smartphone and logs in.

[2329] 2. User A selects the "Sit side by side" option in the app.

[2330] 3. The server receives footage from the in-store camera, and data analysis software and an emotion engine analyze seat availability and customer emotions.

[2331] 4. The server creates a list of available customers based on seat availability information and emotion data.

[2332] 5. The server sends a request to the tablet installed at the previous customer's seat to inquire whether they can move.

[2333] 6. When the previous customer accepts the move using the tablet, points are awarded using the point management system.

[2334] 7. The previous customer moves to a new seat, and the server updates the database with the latest seat information.

[2335] 8. User A sits next to the seat assigned to him.

[2336] Example prompts for generative AI models

[2337] Generate a program for a seating optimization system for a brick-and-mortar store based on the following requirements:

[2338] 1. A feature that allows users to log in using a smartphone app.

[2339] 2. A function that receives real-time video footage from cameras inside the store and analyzes seat availability information.

[2340] 3. Facial expression and voice analysis function using an emotion engine.

[2341] 4. A function that suggests suitable seats based on seat availability information and sentiment data.

[2342] 5. Ability to send and approve transfer requests to existing seat users via tablet.

[2343] 6. Ability to award points to users who approve the move.

[2344] 7. A function that notifies users of the latest available seat information and provides guidance in real time.

[2345] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2346] Step 1:

[2347] The user launches a dedicated app on their smartphone and logs in. The device sends the user's authentication information to the server, which then checks the user information against a database to start a session. The input data is the username and password, and the output data is a flag indicating successful authentication and a session ID. Through this process, the server recognizes the user as legitimate and allows them to use the app.

[2348] Step 2:

[2349] The user selects the "Sit side by side" option from the app menu. The device sends this preference to the server. The input data is the "Sit side by side" preference, and the output data is the seating preference option sent to the server. In this step, the server records the user's seating preference.

[2350] Step 3:

[2351] The server receives video data from cameras in the store in real time. It then analyzes the video data using data analysis software (e.g., OpenCV, TensorFlow) to detect seat availability and customer behavior. The input data is the video stream, and the output data is seat availability information and customer behavior data. The server uses the acquired seat availability information to determine the current seating situation.

[2352] Step 4:

[2353] The server's emotion engine (e.g., Face++, Affectiva) analyzes the user's facial expressions and voice from the video data to recognize emotions. The input data is the user's facial expressions and voice data, and the output data is the emotion recognition results. This allows the server to understand the user's mood and state.

[2354] Step 5:

[2355] Based on the analyzed vacant seat information and emotion data, the server lists seats (matching candidates) that the user can move to in order to suggest an appropriate seat. The input data is vacant seat information and emotion recognition data, and the output data is a list of previous users. This allows the server to identify the most suitable seat for the user.

[2356] Step 6:

[2357] The server sends a request to the tablet installed at the seat of the preceding customer on the list to inquire about whether or not the customer can move. The input data is the message requesting the move, and the output data is the question about whether or not the customer can move, which is displayed on the tablet. The server notifies the preceding customer of the move request via the tablet.

[2358] Step 7:

[2359] The customer who is already seated selects whether or not they wish to move using a tablet. The input data is the choice made by the customer, and the output data is the selection result sent to the server. The terminal sends this data to the server, and the server receives the result.

[2360] Step 8:

[2361] The server receives the previous customer's response of approval for the move and processes the points using the operation approval means. The input data is the selection result of the move approval, and the output data is the point increase / decrease information. The server uses the point management system to award points to the approver and subtract points from the applicant.

[2362] Step 9:

[2363] The previous customer moves to the new seat they have assigned, and the new seat information is updated in the database. The input data is the new seat information, and the output data is the updated seat data. The server saves this data in the database, and reflects the latest seat information in real time.

[2364] Step 10:

[2365] Finally, the server notifies the user's smartphone of the latest available seat information, and the user sits in the seat indicated. The input data is the latest available seat information, and the output data is the guidance information displayed on the user's smartphone. This allows the user to smoothly sit in the designated seat.

[2366] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2367] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2368] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2369] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2370] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2371] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2372] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2373] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "react...

Claims

1. A means for users to specify their seating preference through a dedicated app, A means for detecting vacant seat information and user behavior using an image capturing device; A means for selecting candidates for encouraging users to move seats based on the vacant seat information analyzed by the analysis device; a means for inquiring of a potential preceding passenger about whether or not the seat can be moved using a display device installed in the seat; a means for processing points when the previous customer's permission to move is obtained using the operation approval means; A means of obtaining the latest seat information and providing it to users; A system including:

2. 2. The system of claim 1, further comprising means for updating the database with the latest seat information after the previous passenger moves to the new assigned seat.

3. 2. The system according to claim 1, further comprising means for analyzing the eating progress of the user together with the seat availability information in the analysis device, and determining the optimum timing for changing seats based on the results.

Images