system

Abstract

A system is provided.SOLUTION: A management device for providing a customized travel plan to a user, the management device comprising: interface means for allowing the user to input a travel plan; QR generation means for generating a QR code corresponding to travel, experience, eating and drinking, and purchase based on the travel plan of the user; transmission means for transmitting the QR code to a terminal of the user; and authentication means for performing authentication when a scanner of each station reads the QR code.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Traditional travel planning and ticket management systems struggle to provide users with a consistent travel experience. Managing different services, such as transportation, experiences, dining, and shopping, requires dedicated platforms and tickets for each, making it inconvenient for users. Manual changes to plans and reservations are also time-consuming and difficult to respond to quickly. Furthermore, they are unable to make suggestions based on user preferences, making it difficult to maximize the quality of each individual travel experience. [Means for solving the problem]

[0005] The present invention addresses the aforementioned challenges by providing a management device that provides users with customized travel plans. Specifically, the system includes an interface for users to input their travel plans, a QR generation unit that generates QR codes corresponding to travel, experiences, dining, and purchases based on the travel plan, a transmission unit that transmits the QR code to the user's device, and an authentication unit that authenticates the user when the QR code is read by a scanner at each station. This system provides a consistent travel experience and significantly improves user convenience. Furthermore, the system can maximize the quality of each individual travel experience by providing a function that recommends local activities and restaurants based on the user's profile and past behavioral data.

[0006] "Management device" refers to the entire system for providing customized travel plans to users.

[0007] "Interface means" refers to a software or hardware interface through which a user inputs their travel plans.

[0008] "QR generation means" refers to software or hardware that has the function of generating a QR code based on a user's travel plans.

[0009] "Transmission means" refers to a communication system for transmitting the generated QR code to the user's terminal.

[0010] "Authentication method" refers to a system that verifies the QR code read by the scanner at each station and performs authentication.

[0011] "Activity recommendation tool" refers to software that has the functionality to recommend local activities based on a user's profile and past behavioral data.

[0012] "Booking Method" refers to the system that accepts reservations for recommended activities and generates a corresponding QR code.

[0013] "Location information processing means" refers to a system that provides information on restaurants, activities, etc. based on the user's location information.

[0014] "Payment method" refers to a system for managing payments at restaurants and stores. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] This invention relates to a system including a management device that provides users with customized travel plans. This system automates a series of processes, from when a user inputs their travel plans, to when a QR code is generated, and to when various services are authenticated. A specific embodiment of this system will be described below.

[0037] System configuration

[0038] server:

[0039] The server is the core of the system and is responsible for QR code generation, data processing, authentication, recommendation functions, etc.

[0040] Device:

[0041] The terminal is the user's smartphone or tablet, and communicates with the server through an application.

[0042] User:

[0043] A User is an individual who plans a trip and manages and executes the trip through the system.

[0044] Program processing flow

[0045] 1. Create a travel plan and generate a QR code

[0046] User:

[0047] 1. The user opens the app and enters their travel plans, including details such as departure and return dates, destinations, transportation options, hotels, activities, and restaurants.

[0048] Device:

[0049] 1. The terminal generates a request to send the entered information to the server.

[0050] server:

[0051] 1. The server generates an integrated QR code corresponding to transportation, activities, dining, and purchases based on the received travel plan information.

[0052] 2. Send the generated QR code to your device.

[0053] Examples:

[0054] When a user completes a trip plan:

[0055] User: Enter details in the app such as "Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A."

[0056] Terminal: Sends this information to the server.

[0057] Server: Generates a QR code based on the travel plan and returns it to the device.

[0058] User: Check the QR code displayed on the app screen and take it with you on your trip.

[0059] 2. QR code authentication at each station

[0060] User:

[0061] 1. Users present their QR code at each station during their trip when moving, engaging in activities, eating, drinking, or purchasing.

[0062] scanner:

[0063] 1. Each station is equipped with a QR code scanner that reads the QR code presented by the user.

[0064] Device:

[0065] 1. Receives scan data from the scanner and sends an authentication request to the server.

[0066] server:

[0067] 1. The server verifies the data in the received QR code and performs authentication.

[0068] 2. If the authentication is successful, it sends an authentication success message to the station.

[0069] Examples:

[0070] When a user passes through a train ticket barrier:

[0071] User: Present the QR code at the station ticket gate.

[0072] Scanner: Reads the QR code and sends the data to the server.

[0073] Server: Validates the contents of the QR code and sends a success message to open the ticket gate.

[0074] User: Pass through the ticket gate.

[0075] 3. Book and participate in recommended activities

[0076] server:

[0077] 1. Recommend appropriate activities based on the user's profile and past behavioral data.

[0078] 2. Send detailed information about the recommended activity to the device.

[0079] User:

[0080] 1. The user checks the activity details, selects the one they want, and makes a reservation.

[0081] Device:

[0082] 1. Send a reservation request to the server.

[0083] server:

[0084] 1. Confirm your reservation and generate a corresponding QR code to send to your device.

[0085] Examples:

[0086] When a user books an activity locally:

[0087] Server: Based on user data, it recommends things like museum visits and local cooking classes.

[0088] User: Selects and books a "Local Cooking Class" from the recommended activities.

[0089] Server: Confirms the reservation, generates a QR code and sends it to the device.

[0090] User: Present the QR code on-site to join the class.

[0091] 4. Use and payment at restaurants

[0092] server:

[0093] 1. Based on the user's location information, recommended restaurants are selected and the information is sent to the device.

[0094] User:

[0095] 1. Choose a recommended restaurant and make a reservation or visit in person.

[0096] Device:

[0097] 1. Present the QR code when paying at a restaurant.

[0098] Restaurant terminals:

[0099] 1. Scan the QR code and send the data to the server for authentication.

[0100] server:

[0101] 1. If authentication is successful, the payment is completed.

[0102] Examples:

[0103] If the user is eating at a restaurant:

[0104] Server: Recommends nearby restaurants based on the user's location.

[0105] User: Selects a recommended restaurant and visits it.

[0106] Terminal: Present the QR code when making a payment.

[0107] Restaurant terminal: Scans the QR code and sends it to the server.

[0108] Server: Verify the payment and send a success message to the restaurant.

[0109] 5. Convenience of purchasing services

[0110] server:

[0111] 1. Providing recommended souvenirs and keepsakes based on the user's travel plans.

[0112] User:

[0113] 1. Review the recommended items and make your purchase decision.

[0114] Device:

[0115] 1. Press the purchase button to generate a QR code and display the purchase completion screen.

[0116] Store Scanner:

[0117] 1. Scan the QR code and request authentication from the server.

[0118] server:

[0119] 1. Authenticate and send a success message.

[0120] Examples:

[0121] When a user shops at a souvenir shop:

[0122] Server: Based on the user's travel plans, sends recommended souvenir information to the terminal.

[0123] User: Selects a recommended souvenir and presses the purchase button.

[0124] Device: Display the generated QR code.

[0125] Store scanner: Scans the QR code and requests authentication from the server.

[0126] Server: Authenticates and sends a success message.

[0127] This concludes the embodiment of the present invention. This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, greatly improving the travel experience.

[0128] The processing flow will be explained below.

[0129] 1. Create a travel plan and generate a QR code

[0130] User:

[0131] Step 1: Open the app and go to the "Plan Your Trip" screen.

[0132] Step 2: Enter your travel details, including origin, destination, departure date, return date, transportation options, hotels, activities, and restaurants.

[0133] Step 3: Press the "Submit" button to confirm your travel plans.

[0134] Device:

[0135] Step 1: The travel plan data entered by the user is sent to the server.

[0136] Step 2: Wait for a response from the server.

[0137] server:

[0138] Step 1: Analyze the received travel planning data and organize the necessary data corresponding to transportation, activities, dining, and purchases.

[0139] Step 2: Generate an integrated QR code based on the organized data.

[0140] Step 3: Send the generated QR code to your device.

[0141] Device:

[0142] Step 1: Display the received QR code on the app screen.

[0143] User:

[0144] Step 4: Check the QR code displayed on the app screen and take it with you on your trip.

[0145] 2. QR code authentication at each station

[0146] User:

[0147] Step 1: Present your QR code at each station.

[0148] scanner:

[0149] Step 1: Read the QR code provided by the user.

[0150] Step 2: The data from the scanned QR code is sent to the server.

[0151] Device:

[0152] Step 1: Receive scan data from the scanner and send an authentication request to the server.

[0153] server:

[0154] Step 1: Verify the data in the received QR code.

[0155] Step 2: If the authentication is successful, send an authentication success message to the station.

[0156] Step 3: If the authentication fails, send an authentication failure message to the station.

[0157] scanner:

[0158] Step 1: Receive a success or failure message and perform the corresponding action (e.g., open the ticket gate, display an error).

[0159] 3. Book and participate in recommended activities

[0160] server:

[0161] Step 1: Generate data to recommend appropriate activities based on the user's profile and past behavioral data.

[0162] Step 2: Send the generated recommended activity data to the device.

[0163] Device:

[0164] Step 1: Display detailed information about the recommended activity received to the user.

[0165] User:

[0166] Step 1: Review the activity details and select the activity you want.

[0167] Step 2: Click the "Book" button to confirm your reservation.

[0168] Device:

[0169] Step 1: Send a reservation request to the server.

[0170] server:

[0171] Step 1: Receive the booking request and confirm with the activity organizer.

[0172] Step 2: If the booking is confirmed, generate the corresponding QR code.

[0173] Step 3: Send the generated QR code to your device.

[0174] Device:

[0175] Step 1: Display the generated QR code to the user.

[0176] User:

[0177] Step 1: Present the QR code at the activity venue.

[0178] Venue scanner:

[0179] Step 1: Scan the QR code and request authentication from the server.

[0180] server:

[0181] Step 1: Verify the data in the QR code and perform authentication.

[0182] Step 2: If authentication is successful, send a success message to the venue scanner.

[0183] Venue scanner:

[0184] Step 1: Receive a success message and allow the user to participate in the activity.

[0185] 4. Use and payment at restaurants

[0186] server:

[0187] Step 1: Generate restaurant recommendation data based on the user's profile and location information.

[0188] Step 2: The generated recommendation data is sent to the terminal.

[0189] Device:

[0190] Step 1: The received restaurant recommendation information is displayed to the user.

[0191] User:

[0192] Step 1: Select a recommended restaurant and press the reservation button or visit the restaurant in person.

[0193] Device:

[0194] Step 1: Present the QR code when paying at the restaurant.

[0195] Restaurant terminals:

[0196] Step 1: Scan the QR code and send the data to the server for authentication.

[0197] server:

[0198] Step 1: Check the data in the QR code you received and authenticate your payment.

[0199] Step 2: If the authentication is successful, a success message is sent to the restaurant terminal.

[0200] Restaurant terminals:

[0201] Step 1: Receive a success message to let the user know that the payment has been completed.

[0202] 5. Convenience of purchasing services

[0203] server:

[0204] Step 1: Generate data on recommended souvenirs and keepsakes based on the user's travel plans.

[0205] Step 2: Send the generated recommendation data to the device.

[0206] Device:

[0207] Step 1: Display the received recommended item information to the user.

[0208] User:

[0209] Step 1: Check out the recommended items and click the buy button.

[0210] Device:

[0211] Step 1: Send a purchase request to the server and generate a corresponding QR code.

[0212] Step 2: Display the generated QR code to the user.

[0213] User:

[0214] Step 1: Present the QR code at the store to make a purchase.

[0215] Store Scanner:

[0216] Step 1: Scan the QR code and send it to the server for authentication.

[0217] server:

[0218] Step 1: Check the QR code data and authenticate.

[0219] Step 2: If authentication is successful, send a success message to the store's scanner.

[0220] Store Scanner:

[0221] Step 1: Receive a success message and hand over the product to the user.

[0222] This is the specific program processing flow of the present invention. This system allows users to manage the entire travel experience, including creating a travel plan, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all on a single platform.

[0223] Example 1

[0224] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0225] In conventional travel planning management systems, users must individually book and manage transportation, accommodations, activities, food and beverages, and purchases, which places a significant burden on the user's time and effort. Furthermore, the need to manage tickets and reservation information separately complicates the overall travel experience. For this reason, there is a strong demand for a system that allows users to easily and smoothly manage their entire trip and access multiple services with a single QR code.

[0226] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0227] In this invention, the server includes an interface means for a user to input a travel plan, a QR generation means for generating QR codes corresponding to travel, experiences, dining, and purchases based on the user's travel plan, a transmission means for transmitting the QR code to the user's terminal, an authentication means for authenticating the QR code when a scanner at each station reads it, and a station management means for controlling access to stations based on the authentication. This allows the user to manage their entire trip using a single QR code and easily use a variety of services.

[0228] "User" means an individual who plans, manages and executes a trip through the System.

[0229] A "management device" is a device for providing a customized travel plan to a user.

[0230] An "interface means" is a means by which a user inputs travel plans, typically in the form of an application or web interface.

[0231] The "QR generation means" is a means for generating QR codes corresponding to travel, experiences, eating and drinking, and purchases based on the user's travel plans.

[0232] The "transmission means" is a means for transmitting the generated QR code to the user's terminal.

[0233] The "authentication means" is a means for performing authentication when the QR code is read by a scanner at each station.

[0234] The "station management means" is a means for controlling access of stations based on the authentication.

[0235] The "activity recommendation means" is a means for recommending local activities based on the user's profile and past behavioral data.

[0236] The "reservation means" is a means for accepting reservations for recommended activities and generating a corresponding QR code.

[0237] The "location information processing means" is a means for providing information on recommended restaurants based on the user's location information.

[0238] "Payment method" refers to a method for managing payments at restaurants.

[0239] "Purchase authentication means" is a means of authenticating a purchase by scanning a QR code presented by the user.

[0240] This invention relates to a system including a management device that provides users with customized travel plans. This system automates a series of processes, from when a user inputs their travel plans, to when a QR code is generated, and to when various services are authenticated. A specific embodiment of this system will be described below.

[0241] System configuration

[0242] server:

[0243] The server is the core of the system and is responsible for QR code generation, data processing, authentication, and recommendation functions.

[0244] The server performs multiple functions, including analyzing travel plans, generating QR codes, recording user behavior data, managing profiles, and processing location information.

[0245] The technologies used include QR code generation libraries (e.g., qrcode, pyqrcode) and database management systems (e.g., MySQL, PostgreSQL).

[0246] Device:

[0247] The terminal is the user's smartphone or tablet, and communicates with the server through an application.

[0248] The application provides a travel planning input interface, a QR code display screen, notification functions, and location information services.

[0249] User:

[0250] A User is an individual who plans a trip and manages and executes the trip through the system.

[0251] What the program does

[0252] Create a travel plan and generate a QR code

[0253] Users open the app and enter their travel plans, including details such as departure and return dates, destinations to visit, transportation options, hotels, activities, and restaurants.

[0254] The terminal generates a request to send the input information to the server.

[0255] The server generates an integrated QR code corresponding to transportation, activities, dining, and purchases based on the received travel plan information, and sends the generated QR code to the terminal.

[0256] Specific examples

[0257] When a user completes a trip plan:

[0258] Users enter details into the app such as "Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A."

[0259] The terminal transmits this information to the server.

[0260] The server generates a QR code based on the travel plan and returns it to the device.

[0261] Users check the QR code displayed on the app screen and take it with them on their trip.

[0262] QR code authentication at each station

[0263] Users present their QR code at each station during their trip when traveling, engaging in activities, eating and drinking, or making purchases.

[0264] Each station is equipped with a scanner that reads QR codes, and reads the QR code presented by the user.

[0265] After receiving the scan data, the scanner sends an authentication request to the server.

[0266] The server verifies the received QR code data and performs authentication. If authentication is successful, it sends an authentication success message to the station.

[0267] Specific examples

[0268] When a user passes through a train ticket barrier:

[0269] The user presents the QR code at the station ticket gate.

[0270] The scanner reads the QR code and sends the data to the server.

[0271] The server verifies the contents of the QR code and sends a success message to open the ticket gate.

[0272] The user passes through the ticket gate.

[0273] Book and participate in recommended activities

[0274] Based on the user's profile and past behavioral data, the server recommends appropriate activities.

[0275] Detailed information about the recommended activity is sent to the device.

[0276] Users can check the details of the activities, select the ones they want, and make a reservation.

[0277] Send a reservation request to the server.

[0278] The server confirms the reservation and generates a corresponding QR code that is sent to the device.

[0279] Specific examples

[0280] When a user books an activity locally:

[0281] Based on user data, the server recommends things like museum visits or local cooking classes.

[0282] The user selects and books a "local cooking class" from the recommended activities.

[0283] The server confirms the reservation, generates a QR code and sends it to the device.

[0284] Users present the QR code on-site to join the class.

[0285] Use and payment at restaurants

[0286] The server selects recommended restaurants based on the user's location information and sends the information to the terminal.

[0287] The user selects a recommended restaurant and makes a reservation or visits the restaurant in person.

[0288] Present the QR code when making payment.

[0289] The QR code is scanned and the data is sent to the server for authentication.

[0290] If the authentication is successful, the payment is completed.

[0291] Specific examples

[0292] If the user is eating at a restaurant:

[0293] The server recommends nearby restaurants based on the user's location.

[0294] The user selects a recommended restaurant and visits it.

[0295] Present the QR code when making payment.

[0296] Scan the QR code and send it to the server.

[0297] Verify the payment and send a success message to the restaurant.

[0298] Convenience of purchasing services

[0299] The server presents recommended souvenirs and mementos based on the user's travel plans.

[0300] The user reviews the recommended items and decides to purchase them.

[0301] Press the purchase button to generate a QR code and display the purchase completion screen.

[0302] Scan the QR code and request authentication from the server.

[0303] Authenticate and send a success message.

[0304] Specific examples

[0305] When a user shops at a souvenir shop:

[0306] The server transmits recommended souvenir information to the terminal based on the user's travel plans.

[0307] The user selects a recommended souvenir and presses the purchase button.

[0308] Display the generated QR code.

[0309] Scan the QR code and request authentication from the server.

[0310] Authenticate and send a success message.

[0311] This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, greatly improving the travel experience.

[0312] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0313] Step 1:

[0314] User enters travel plans.

[0315] Input: Travel plan details from the user (departure date, return date, destinations, transportation options, hotels, activities, restaurants, etc.).

[0316] Data processing: The user launches the application on their smartphone and inputs their travel plans. The application encodes the input data into JSON format.

[0317] Output: JSON data containing the user's travel plan information.

[0318] Step 2:

[0319] The device sends a request to the server.

[0320] Input: Travel planning information (JSON data) entered by the user in the app.

[0321] Data processing: The device generates a POST request to the API endpoint and sends the travel plan information to the server.

[0322] Output: The HTTP POST request sent to the server.

[0323] Step 3:

[0324] The server analyzes the travel plan and generates a QR code.

[0325] Input: Travel planning information sent from the device.

[0326] Data processing: The server parses the received JSON data and checks the database for each item in the travel plan (transportation, activities, food and drink, and purchases). It checks the necessary recommendations and reservation status and generates an integrated QR code. The QR code is generated using the qrcode library.

[0327] Output: Generated QR code data (image URL).

[0328] Step 4:

[0329] The server sends a QR code to the device.

[0330] Input: Generated QR code data (image URL).

[0331] Data processing: The server encodes the QR code data as a response and sends it to the terminal as an HTTP response.

[0332] Output: The QR code data sent to the device.

[0333] Step 5:

[0334] The user presents the QR code while traveling.

[0335] Input: The QR code received from the server (displayed on the device).

[0336] Data processing: The user presents the QR code at each station during their trip (e.g., train ticket gates, tourist spots, restaurants, souvenir shops, etc.).

[0337] Output: Input to the scanner when the QR code is presented.

[0338] Step 6:

[0339] The scanner reads the QR code.

[0340] Input: QR code provided by the user.

[0341] Data processing: The scanner decodes the QR code data and prepares it to send an authentication request to the server.

[0342] Output: The data of the QR code read by the scanner.

[0343] Step 7:

[0344] The device sends an authentication request to the server.

[0345] Input: The QR code data sent by the scanner.

[0346] Data processing: The device sends an authentication request including the QR code data to the server. The request is usually sent using the POST method to an API endpoint.

[0347] Output: The authentication request sent to the server.

[0348] Step 8:

[0349] The server authenticates the QR code.

[0350] Input: QR code data sent from the device.

[0351] Data processing: The server checks the received QR code data against a database and performs authentication. If authentication is successful, it generates a success message. Authentication usually uses a token or ID matching function within the system.

[0352] Output: Authentication successful message.

[0353] Step 9:

[0354] The server sends an authentication success message to the station.

[0355] Input: Authentication success message.

[0356] Data processing: The server encodes the authentication success message and sends it to the station, which then executes the corresponding action (e.g., opening the ticket gate).

[0357] Output: Authentication success message sent to the station.

[0358] Step 10:

[0359] The user is authenticated when using the service.

[0360] Input: Authentication success message received by the station.

[0361] Data processing: The user uses the services permitted by successful authentication (e.g., travel, activity participation, meals, purchases, etc.).

[0362] Output: Service usage completed.

[0363] These steps will enable users to manage all services, from creating travel plans to QR code authentication at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, greatly improving their travel experience.

[0364] (Application example 1)

[0365] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0366] Conventional food delivery services lack convenience because they require users to go through multiple steps during the ordering, authentication, and payment processes. This can lead to users feeling overwhelmed by the ordering and payment processes, potentially damaging the delivery experience. Furthermore, users cannot receive personalized recommendations based on their past behavioral data or profiles, making it difficult to provide a personalized dining experience. There is a need to solve these issues and provide users with a more comfortable and efficient food delivery experience.

[0367] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0368] In this invention, the server includes an interface means for a user to input a meal delivery plan, a QR generation means for generating a QR code corresponding to the meal and delivery based on the user's meal delivery plan, a transmission means for transmitting the QR code to the user's information processing device, and an authentication means for performing authentication when the QR code is read by a reader at each delivery station. This allows the user to manage a series of processes, from creating a meal delivery plan to ordering, authentication, and payment, in a unified system. Furthermore, by including a recommendation means for providing recommended menus based on the user's profile and past behavioral data, an ordering means for accepting orders for the recommended menus and generating corresponding QR codes, and a location information processing means for providing recommended restaurant information based on the user's location information, it is possible to provide the user with a customized dining experience.

[0369] A "customized meal delivery plan" is a meal delivery schedule created based on a user's individual needs and preferences.

[0370] "Management Device" means a combination of hardware and software for managing and executing a meal delivery plan in an integrated manner.

[0371] "Interface means" refers to a user interface through which a user inputs a meal delivery plan, including a smartphone application or web form.

[0372] "QR generation means" refers to a program or hardware for generating a QR code based on information about a user's order or delivery.

[0373] The "transmission means" is a communication means for transmitting the generated QR code to the user's information processing device.

[0374] "Authentication means" refers to a program or device that reads the QR code, verifies its contents, and performs authentication.

[0375] A "profile" is a data set that includes a user's basic information, past behavioral data, preferences, etc.

[0376] A "recommendation method" is an algorithm or system that individually recommends appropriate restaurants and menus based on a user's profile and past behavioral data.

[0377] The "ordering means" is a function or device that accepts food and drink orders from users and generates corresponding QR codes.

[0378] The "location information processing means" is a system that acquires the user's location information and provides optimal restaurants and delivery schedules based on that information.

[0379] "Payment Instrument" means the program and device that manages and processes payments at a restaurant.

[0380] MODE FOR CARRYING OUT THE INVENTION

[0381] System configuration

[0382] server

[0383] The server is the core of this system and is responsible for QR code generation, data processing, authentication, recommendation functions, etc. The main software used includes Flask (a Python web framework), Pandas (a data manipulation library), and qrcode (a QR code generation library).

[0384] Terminal

[0385] The terminal is a user's smartphone or tablet, which is used to communicate with the server through the application. The terminal provides a user interface where the user inputs their meal delivery plan and receives a QR code.

[0386] Program processing

[0387] User input of meal delivery plan

[0388] The user uses the terminal to input a meal delivery plan, which includes information such as the food and drink they want to order, the delivery address, and the desired delivery time.

[0389] Generate and send a QR code

[0390] The information sent from the device is received by the server. The server generates a QR code corresponding to the order and delivery based on the received meal delivery plan information. The generated QR code is sent back to the device, and the user uses this QR code to have the delivery or pick up the item at the store.

[0391] Recommendation feature

[0392] The server recommends suitable food and drink options and restaurants based on the user's profile and past behavioral data. This recommendation function helps support the user's meal selection.

[0393] Authentication Process

[0394] Each restaurant and delivery station is equipped with a scanner that reads QR codes. These scanners read the QR code presented by the user and send the data to a server. The server then authenticates the data and verifies that the QR code is valid.

[0395] Payment and Order Management

[0396] The server manages the order details and processes the payment made through the QR code. The payment information is also linked to the QR code, so users can easily make payments by simply presenting the QR code.

[0397] Specific examples

[0398] When a user places a delivery order

[0399] The user uses the application to enter their user ID, the restaurant they wish to order from, and the menu item. For example, they might enter "User ID: 1, Restaurant: Japanese restaurant, Recommended menu: Sushi set." The server receives this, registers the new order, generates a QR code, and provides it to the user. The user can then present this QR code to the restaurant to confirm their order and receive delivery.

[0400] When restaurants authenticate QR codes

[0401] The restaurant uses a QR code scanner to read the QR code. The scanned data is sent to the server, which then verifies the order information based on the order ID and performs authentication. If authentication is successful, the restaurant confirms the user's order and begins delivery.

[0402] Example prompt sentence:

[0403] "When a user orders a sushi set at a Japanese restaurant, please tell me the details of the recommended menu items. User ID is 1."

[0404] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0405] Step 1:

[0406] User enters meal delivery plan

[0407] The user opens the application on their smartphone or tablet and inputs their meal delivery plan, including the type of food and drink desired, restaurant selection, delivery address, desired delivery time, etc. The input information is saved on the device via the interface means.

[0408] input:

[0409] User personal information (e.g., user ID)

[0410] Information about the food and drink you order (e.g., menu, quantity)

[0411] Delivery address

[0412] output:

[0413] Meal delivery plan information (e.g., restaurant name, menu, delivery time)

[0414] Specific behavior:

[0415] A user enters the following information into the app: "User ID: 1, Restaurant: Japanese restaurant, Recommended menu: Sushi set."

[0416] Step 2:

[0417] Sending meal delivery plan information to the server

[0418] The device sends the meal delivery plan information entered by the user to the server via an HTTP request.

[0419] input:

[0420] Meal delivery plan information stored on your device

[0421] output:

[0422] Data sent to the server

[0423] Specific behavior:

[0424] The terminal sends the input information "User ID: 1, Restaurant: Japanese restaurant, Recommended menu: Sushi set" as a request to the server.

[0425] Step 3:

[0426] Generate a QR code

[0427] The server generates a QR code based on the received meal delivery plan information. It uses the qrcode library to encode this information and create a unique QR code.

[0428] input:

[0429] Meal delivery plan information

[0430] output:

[0431] The image file path of the generated QR code

[0432] Specific behavior:

[0433] The server receives the meal delivery plan information and generates a QR code with "User ID: 1, Restaurant: Japanese restaurant, Recommended menu: Sushi set."

[0434] Step 4:

[0435] Sending a QR code to a device

[0436] The generated QR code is sent from the server to the user's device, allowing the user to view the QR code on their own device.

[0437] input:

[0438] QR code image file path

[0439] output:

[0440] QR code sent to the device

[0441] Specific behavior:

[0442] The server sends the generated QR code to the device, and the user checks the QR code on the app.

[0443] Step 5:

[0444] Providing recommended menus

[0445] The server recommends appropriate food and drink options and restaurants based on the user's profile and past behavioral data. It also analyzes past order history and personal preference data to make personalized recommendations.

[0446] input:

[0447] User profile data

[0448] Past behavioral data

[0449] output:

[0450] Recommended menu or store information

[0451] Specific behavior:

[0452] The server analyzes the profile and past order history of "User ID: 1" and recommends the recommended menu item "Sushi Set" at a Japanese restaurant.

[0453] Step 6:

[0454] Authentication at delivery stations

[0455] The user presents the QR code to receive the food or drink they ordered. At the delivery station, a QR code scanner reads the QR code and transmits the data to a server for authentication.

[0456] input:

[0457] QR code data

[0458] output:

[0459] Authentication result (success or failure)

[0460] Specific behavior:

[0461] The user presents the QR code at the delivery station, a scanner reads the QR code, and the data is sent to a server for authentication.

[0462] Step 7:

[0463] Processing payments

[0464] The server processes the payment based on the order details provided through the QR code. The payment information is also linked to the QR code, allowing the user to make the payment simply by presenting the QR code.

[0465] input:

[0466] QR code data

[0467] Payment Information

[0468] output:

[0469] Payment completion notification

[0470] Specific behavior:

[0471] The server verifies the QR code data and payment information, completes the payment, and the user receives a payment confirmation.

[0472] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0473] This invention is a system that includes a management device that provides users with customized travel plans, and further combines it with an emotion engine that recognizes the user's emotions and optimizes the travel plan. This system automates the entire process from when the user inputs their travel plan, generating a QR code, and authenticating various services, and further provides optimal suggestions in real time based on the user's emotions, thereby aiming to provide each user with the best travel experience. Below, we will explain in detail how to implement this system.

[0474] System configuration

[0475] server:

[0476] The server is the core of the system and is responsible for QR code generation, data processing, authentication, recommendation functions, and emotional data analysis.

[0477] Device:

[0478] The device is a user's smartphone or tablet, which communicates with the server through an application. An emotion engine is installed on the device and collects user emotion data.

[0479] User:

[0480] A user is an individual who plans a trip and manages and executes the trip through the system.

[0481] Program processing flow

[0482] 1. Create a travel plan and generate a QR code

[0483] User:

[0484] 1. The user opens the app and opens the "Create a Trip Plan" screen.

[0485] 2. Enter your trip details, including origin, destination, departure date, return date, transportation, hotels, activities, and restaurants.

[0486] 3. Click the "Submit" button to confirm your travel plans.

[0487] Device:

[0488] 1. The travel plan data entered by the user is sent to the server.

[0489] 2. Wait for a response from the server.

[0490] server:

[0491] 1. Analyze the received travel planning data and organize the necessary data corresponding to transportation, activities, dining, and purchases.

[0492] 2. Generate an integrated QR code based on the organized data.

[0493] 3. Send the generated QR code to the device.

[0494] Device:

[0495] 1. Display the received QR code on the app screen.

[0496] User:

[0497] 4. Check the QR code displayed on the app screen and take it with you on your trip.

[0498] Examples:

[0499] When a user completes a trip plan:

[0500] User: Enter details in the app such as "Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A."

[0501] Terminal: Sends this information to the server.

[0502] Server: Generates a QR code based on the travel plan and returns it to the device.

[0503] User: Check the QR code displayed on the app screen and take it with you on your trip.

[0504] 2. QR code authentication at each station

[0505] User:

[0506] 1. Users present their QR code at each station during their trip when moving, engaging in activities, eating, drinking, or purchasing.

[0507] scanner:

[0508] 1. Each station is equipped with a QR code scanner that reads the QR code presented by the user.

[0509] Device:

[0510] 1. Receives scan data from the scanner and sends an authentication request to the server.

[0511] server:

[0512] 1. Verify the data in the received QR code and perform authentication.

[0513] 2. If the authentication is successful, it sends an authentication success message to the station.

[0514] 3. If authentication fails, send an authentication failure message to the station.

[0515] scanner:

[0516] 1. Receive a success or failure message and perform the corresponding action (e.g., open the ticket gate, display an error).

[0517] Examples:

[0518] When a user passes through a train ticket barrier:

[0519] User: Present the QR code at the station ticket gate.

[0520] Scanner: Reads the QR code and sends the data to the server.

[0521] Server: Validates the contents of the QR code and sends a success message to open the ticket gate.

[0522] User: Pass through the ticket gate.

[0523] 3. Book and participate in recommended activities

[0524] server:

[0525] 1. Generate data that recommends appropriate activities based on the user's profile and past behavioral data.

[0526] 2. The generated recommended activity data is sent to the device.

[0527] Device:

[0528] 1. Show the user detailed information about the recommended activity they received.

[0529] User:

[0530] 1. Check the activity details and select the activity you want.

[0531] 2. Click the "Book" button to confirm your reservation.

[0532] Device:

[0533] 1. Send a reservation request to the server.

[0534] server:

[0535] 1. Receive the booking request and confirm with the activity organizer.

[0536] 2. If the booking is confirmed, generate the corresponding QR code.

[0537] 3. Send the generated QR code to the device.

[0538] Device:

[0539] 1. Display the generated QR code to the user.

[0540] User:

[0541] 1. Present the QR code at the activity venue.

[0542] Venue scanner:

[0543] 1. Scan the QR code and request authentication from the server.

[0544] server:

[0545] 1. Verify the data in the QR code and perform authentication.

[0546] 2. If authentication is successful, send a success message to the scanner at the venue.

[0547] Venue scanner:

[0548] 1. Receives a success message and allows the user to participate in the activity.

[0549] Examples:

[0550] When a user books an activity locally:

[0551] Server: Based on user data, it recommends things like museum visits and local cooking classes.

[0552] User: Selects and books a "Local Cooking Class" from the recommended activities.

[0553] Server: Confirms the reservation, generates a QR code and sends it to the device.

[0554] User: Present the QR code on-site to join the class.

[0555] 4. Use and payment at restaurants

[0556] server:

[0557] 1. Generate restaurant recommendation data based on the user's profile and location information.

[0558] 2. The generated recommendation data is sent to the device.

[0559] Device:

[0560] 1. Display the received restaurant recommendation information to the user.

[0561] User:

[0562] 1. Select a recommended restaurant and press the reservation button or visit the restaurant directly.

[0563] Device:

[0564] 1. Present the QR code when paying at a restaurant.

[0565] Restaurant terminals:

[0566] 1. Scan the QR code and send the data to the server for authentication.

[0567] server:

[0568] 1. Check the data in the received QR code and authenticate the payment.

[0569] 2. If authentication is successful, a success message is sent to the restaurant's terminal.

[0570] Restaurant terminals:

[0571] 1. A success message is received, informing the user that the payment has been completed.

[0572] Examples:

[0573] If the user is eating at a restaurant:

[0574] Server: Recommends nearby restaurants based on the user's location.

[0575] User: Selects a recommended restaurant and visits it.

[0576] Terminal: Present the QR code when making a payment.

[0577] Restaurant terminal: Scans the QR code and sends it to the server.

[0578] Server: Verify the payment and send a success message to the restaurant.

[0579] 5. Convenience of purchasing services

[0580] server:

[0581] 1. Generate recommended souvenirs and mementos based on the user's travel plans.

[0582] 2. The generated recommendation data is sent to the device.

[0583] Device:

[0584] 1. Display the received recommended item information to the user.

[0585] User:

[0586] 1. Check the recommended items and press the purchase button.

[0587] Device:

[0588] 1. Send the purchase request to the server and generate the corresponding QR code.

[0589] 2. Display the generated QR code to the user.

[0590] User:

[0591] 1. Present the QR code at the store to make a purchase.

[0592] Store Scanner:

[0593] 1. Scan the QR code and send it to the server for authentication.

[0594] server:

[0595] 1. Check the QR code data and perform authentication.

[0596] 2. If authentication is successful, send a success message to the store's scanner.

[0597] Store Scanner:

[0598] 1. Receive a success message and hand over the product to the user.

[0599] 6. Introducing the Emotion Engine

[0600] Device:

[0601] 1. An emotion engine is installed on the device, which collects emotional data by analyzing the user's facial expressions, voice, behavioral patterns, etc.

[0602] 2. Emotion data is sent to the server in real time.

[0603] server:

[0604] 1. Analyze the received emotion data and determine the user's emotional state.

[0605] 2. Dynamically optimize travel plans, recommended activities, and restaurant recommendations based on emotional state.

[0606] 3. Send the optimized information to the device.

[0607] Examples:

[0608] Update recommendations based on user sentiment changes:

[0609] Terminal: When the user shows a depressed expression, the emotion engine detects that emotion and sends the emotion data to the server.

[0610] Server: Analyzes the emotional data indicating depression and recommends new activities to lift your mood (e.g., a fun show or a relaxing spa).

[0611] Terminal: Notify the user of new recommended activities.

[0612] User: Review the recommended activities and decide to participate.

[0613] This concludes the description of the embodiment of the present invention. This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, and can also provide optimal experiences based on emotions through an emotion engine.

[0614] The processing flow will be explained below.

[0615] 1. Create a travel plan and generate a QR code

[0616] User:

[0617] Step 1: Open the app and go to the "Plan Your Trip" screen.

[0618] Step 2: Enter your travel details, including origin, destination, departure date, return date, transportation, accommodation, activities, and restaurants.

[0619] Step 3: Press the "Submit" button to confirm your travel plans.

[0620] Device:

[0621] Step 1: The travel plan data entered by the user is sent to the server.

[0622] Step 2: Wait for a response from the server.

[0623] server:

[0624] Step 1: Analyze the received travel planning data and organize the necessary data corresponding to transportation, activities, dining, and purchases.

[0625] Step 2: Generate an integrated QR code based on the organized data.

[0626] Step 3: Send the generated QR code to your device.

[0627] Device:

[0628] Step 1: Display the received QR code on the app screen.

[0629] User:

[0630] Step 4: Check the QR code displayed on the app screen and take it with you on your trip.

[0631] 2. QR code authentication at each station

[0632] User:

[0633] Step 1: Present your QR code at each station.

[0634] scanner:

[0635] Step 1: Read the QR code provided by the user.

[0636] Step 2: The data from the scanned QR code is sent to the server.

[0637] server:

[0638] Step 1: Verify the data in the received QR code.

[0639] Step 2: If the authentication is successful, send an authentication success message to the station.

[0640] Step 3: If the authentication fails, send an authentication failure message to the station.

[0641] scanner:

[0642] Step 1: Receive a success or failure message and perform the corresponding action (e.g., open the ticket gate, display an error).

[0643] 3. Book and participate in recommended activities

[0644] server:

[0645] Step 1: Generate data to recommend appropriate activities based on the user's profile and past behavioral data.

[0646] Step 2: Send the generated recommended activity data to the device.

[0647] Device:

[0648] Step 1: Display detailed information about the recommended activity received to the user.

[0649] User:

[0650] Step 1: Review the activity details and select the activity you want.

[0651] Step 2: Click the "Book" button to confirm your reservation.

[0652] Device:

[0653] Step 1: Send a reservation request to the server.

[0654] server:

[0655] Step 1: Receive the booking request and confirm with the activity organizer.

[0656] Step 2: If the booking is confirmed, generate the corresponding QR code.

[0657] Step 3: Send the generated QR code to your device.

[0658] Device:

[0659] Step 1: Display the generated QR code to the user.

[0660] User:

[0661] Step 1: Present the QR code at the activity venue.

[0662] Venue scanner:

[0663] Step 1: Scan the QR code and request authentication from the server.

[0664] server:

[0665] Step 1: Verify the data in the QR code and perform authentication.

[0666] Step 2: If authentication is successful, send a success message to the venue scanner.

[0667] Venue scanner:

[0668] Step 1: Receive a success message and allow the user to participate in the activity.

[0669] 4. Use and payment at restaurants

[0670] server:

[0671] Step 1: Generate restaurant recommendation data based on the user's profile and location information.

[0672] Step 2: The generated recommendation data is sent to the terminal.

[0673] Device:

[0674] Step 1: The received restaurant recommendation information is displayed to the user.

[0675] User:

[0676] Step 1: Select a recommended restaurant and press the reservation button or visit the restaurant in person.

[0677] Device:

[0678] Step 1: Present the QR code when paying at the restaurant.

[0679] Restaurant terminals:

[0680] Step 1: Scan the QR code and send the data to the server for authentication.

[0681] server:

[0682] Step 1: Check the data in the QR code you received and authenticate your payment.

[0683] Step 2: If the authentication is successful, a success message is sent to the restaurant terminal.

[0684] Restaurant terminals:

[0685] Step 1: Receive a success message to let the user know that the payment has been completed.

[0686] 5. Convenience of purchasing services

[0687] server:

[0688] Step 1: Generate data on recommended souvenirs and keepsakes based on the user's travel plans.

[0689] Step 2: Send the generated recommendation data to the device.

[0690] Device:

[0691] Step 1: Display the received recommended item information to the user.

[0692] User:

[0693] Step 1: Check out the recommended items and click the buy button.

[0694] Device:

[0695] Step 1: Send a purchase request to the server and generate a corresponding QR code.

[0696] Step 2: Display the generated QR code to the user.

[0697] User:

[0698] Step 1: Present the QR code at the store to make a purchase.

[0699] Store Scanner:

[0700] Step 1: Scan the QR code and send it to the server for authentication.

[0701] server:

[0702] Step 1: Check the QR code data and authenticate.

[0703] Step 2: If authentication is successful, send a success message to the store's scanner.

[0704] Store Scanner:

[0705] Step 1: Receive a success message and hand over the product to the user.

[0706] 6. Introducing the Emotion Engine

[0707] Device:

[0708] Step 1: An emotion engine is installed on the device, which collects emotion data by analyzing the user's facial expressions, voice, behavioral patterns, etc.

[0709] Step 2: Send emotion data to the server in real time.

[0710] server:

[0711] Step 1: Analyze the received emotion data and determine the user's emotional state.

[0712] Step 2: Dynamically optimize travel plans, recommended activities, and restaurants based on emotional states.

[0713] Step 3: Send the optimized information to the device.

[0714] Examples:

[0715] Update recommendations based on user sentiment changes:

[0716] Terminal: When the user shows a depressed expression, the emotion engine detects that emotion and sends the emotion data to the server.

[0717] Server: Analyzes the emotional data indicating depression and recommends new activities to lift your mood (e.g., a fun show or a relaxing spa).

[0718] Terminal: Notify the user of new recommended activities.

[0719] User: Review the recommended activities and decide to participate.

[0720] The above is the specific program processing flow of the present invention combined with the emotion engine. This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, and furthermore, the emotion engine can provide the optimal experience according to the user's emotions.

[0721] Example 2

[0722] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0723] In recent years, there has been a demand for travel planning and execution systems that can be customized to meet individual user needs. However, the process of users planning a trip is complex and time-consuming, so there is a need for a system that can easily and efficiently create a trip plan and centrally manage the information, authentication procedures, and on-site service usage required during the trip. Furthermore, there is a lack of a mechanism for optimizing trip plans and recommended activities based on the user's emotions and real-time situation. To solve these issues, a more advanced travel planning management system is needed.

[0724] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0725] In this invention, the server includes an interface means for a user to input a travel plan, a code generation means for generating QR codes corresponding to travel, experiences, dining, and purchases based on the user's travel plan, a transmission means for transmitting the codes to the user's communication device, an authentication means for authenticating the user when a reader at each station reads the codes, and an emotion analysis means for analyzing the user's emotion data and optimizing the travel plan in real time. This allows the user to easily create a travel plan, use services centrally during the trip, and enjoy a travel experience that is optimized in real time.

[0726] "User" means an individual who plans, manages and executes a trip through the System.

[0727] "Management device" refers to a collection of equipment and software for providing customized travel plans to users.

[0728] "Interface means" refers to a set of software and hardware that provides a user interface for a user to input travel plans.

[0729] "Code generation means" refers to a device and program that has the function of generating QR codes corresponding to travel, experiences, dining, and purchases based on the user's travel plans.

[0730] "Transmitting means" refers to the equipment and software for transmitting the generated code to the user's communication device.

[0731] "Authentication means" refers to a function that performs authentication when a reader at each station reads a code presented by a user.

[0732] "Emotion analysis means" refers to a device and program that has the function of analyzing the user's emotional data and optimizing travel plans in real time.

[0733] "Communication device" refers to a device such as a smartphone or tablet that a user uses to communicate with the system.

[0734] "Reading device" refers to a device that includes a scanner or camera for reading QR codes.

[0735] "Recommendation" refers to a feature that recommends local activities based on a user's profile and past behavioral data.

[0736] "Booking Method" refers to the functionality that accepts bookings for recommended activities and generates corresponding codes.

[0737] The "location information processing means" refers to a function that provides information on recommended restaurants based on the user's location information.

[0738] "Payment method" refers to the function of managing payments at restaurants.

[0739] This invention is a management system that provides users with customized travel plans, and aims to provide the best travel experience for each user by automating the process from users entering their travel plans, generating QR codes, and authenticating various services. Furthermore, by combining it with an emotion engine, it is possible to recognize user emotions and optimize travel plans in real time.

[0740] System configuration

[0741] server:

[0742] The server is the core of this system and plays the following roles:

[0743] Code generation method: Based on the travel plan data entered by the user, QR codes corresponding to transportation, activities, dining, and purchases are generated. Specifically, the QR codes are generated using the Python qrcode library.

[0744] Transmission means: The generated QR code is sent to the user's communication device as an HTTP response.

[0745] Authentication method: The QR code data sent from the reader at each station is verified and authentication is performed.

[0746] Emotion analysis means: Analyzes the received emotional data and determines the user's emotional state. This is done using a machine learning model (generative AI model).

[0747] Device:

[0748] The device is the user's smartphone or tablet and has the following functions:

[0749] Interface means: Provides a user interface for users to input travel plans. Specifically, this corresponds to a mobile application.

[0750] Communication means: The input travel plan data and emotion data are sent to the server, and a response is received from the server.

[0751] Display means: The QR code and recommended activities received from the server are displayed to the user.

[0752] Emotion engine: Analyzes the user's facial expressions, voice, and behavioral patterns to generate emotion data. Specifically, it uses the front camera and microphone and analyzes them using software libraries (e.g., OpenCV, Tensorflow).

[0753] User:

[0754] A user is an individual who uses this system and performs the following operations.

[0755] Travel Planning: Enter travel planning details using the mobile application.

[0756] Present your QR code: Present your QR code at each station during your trip.

[0757] Activity Booking: Book and participate in recommended activities.

[0758] Payment: Use QR codes to pay at restaurants and when making purchases.

[0759] Specific examples

[0760] A specific example of a user creating a travel plan and generating a QR code is as follows.

[0761] User: Enter details in the app such as "Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A."

[0762] Terminal: Sends this information to the server as an HTTP request.

[0763] Server: Generates a QR code based on the travel plan and sends it to the device as an HTTP response.

[0764] Device: Display the received QR code on the app screen.

[0765] User: Check the displayed QR code and take it with you on your trip.

[0766] Prompt Sentence Examples

[0767] "Open the travel plan creation screen and enter the following details: Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A. Press the submit button to confirm your travel plan."

[0768] This concludes the embodiment of the present invention. This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code. Furthermore, an emotion engine can be used to provide optimal experiences based on emotions.

[0769] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0770] Step 1:

[0771] User:

[0772] The user opens the app and navigates to the "Plan a Trip" screen by tapping the "Plan a Trip" button on the mobile application's home screen. As input, the user enters details of the origin, destination, departure date, return date, transportation, accommodation, activities, and food and drink. As output, this data is saved as internal data for the application.

[0773] Step 2:

[0774] Device:

[0775] When the user presses the "Submit" button, the device sends the entered travel plan data to the server as an HTTP POST request. Specifically, the device application organizes the travel plan data in JSON format and issues a request to the server's API endpoint. The input is the user's travel plan data, and the output is the JSON data sent to the server.

[0776] Step 3:

[0777] server:

[0778] The server parses the received travel plan data and retrieves data corresponding to transportation, activities, dining, and purchases from a database. It uses Python and SQL to execute database queries to extract the best options for each category selected by the user. The input is the JSON data of the travel plan, and the output is organized trip data.

[0779] Step 4:

[0780] server:

[0781] The server generates a QR code based on the organized travel data. Specifically, it uses the qrcode library to generate the QR code and create its image data. The input is the organized travel data, and the output is the QR code image data.

[0782] Step 5:

[0783] server:

[0784] The generated QR code is sent to the terminal as an HTTP response. The server includes the QR code image data in the body of the HTTP response and sends it to the terminal. The input is the QR code image data, and the output is an HTTP response containing the QR code.

[0785] Step 6:

[0786] Device:

[0787] The device displays the received QR code on the application screen. Specifically, it uses an image viewer component to display the QR code image. The input is the QR code image data from the server, and the output is the QR code displayed on the user's screen.

[0788] Step 7:

[0789] User:

[0790] During the trip, the user presents a QR code at each station by pointing the smartphone screen at the QR code reader and tapping it. The input is the user's QR code screen, and the output is the QR code data read by the scanner.

[0791] Step 8:

[0792] scanner:

[0793] The reader at each station reads the user's QR code and sends the data to the server in a specific format. Specifically, the QR code reader scans the QR code and sends the data to the server as an HTTP request. The input is the QR code data, and the output is the authentication request data sent to the server.

[0794] Step 9:

[0795] server:

[0796] The server verifies the received QR code data and performs authentication. It searches the database for the travel plan information associated with the QR code, and if there is a match, authentication is successful. The input is the QR code authentication request data, and the output is the authentication result (success or failure).

[0797] Step 10:

[0798] scanner:

[0799] The scanner receives the authentication result from the server and displays a success or failure message. For example, if successful, it performs an action such as opening a gate. The input is the authentication result message from the server, and the output is the corresponding physical action (e.g., opening or closing the gate) or a message display.

[0800] Step 11:

[0801] Device:

[0802] An emotion engine is installed on the device, which analyzes facial expressions, voice, and behavioral patterns to collect emotional data and transmits it to the server in real time. The input is the user's emotional data (facial expressions, voice, etc.), and the output is the emotional data sent to the server.

[0803] Step 12:

[0804] server:

[0805] The server analyzes the received emotional data to determine the user's emotional state, optimizing travel plans and recommended activities in real time. Specifically, it uses a machine learning algorithm to classify the emotional state and recalculate the optimal activities. The input is emotional data, and the output is optimized travel plans and activity recommendations.

[0806] Step 13:

[0807] Device:

[0808] The device notifies the user of the optimized information, specifically by displaying activity updates as push notifications or in-app messages. The input is the optimized information from the server, and the output is the updated information displayed on the user's screen.

[0809] The above is the specific processing flow of the program for this system. Users can receive consistent support from creating a travel plan, presenting a QR code, authentication, and real-time optimization according to their emotions.

[0810] (Application example 2)

[0811] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0812] While there have been systems that provide personalized travel plans, they lack the functionality to recommend optimal shopping experiences and activities in real time, taking into account the user's emotional state. Furthermore, there have been no systems that manage the purchasing experience in virtual stores and comprehensively support users' travel. This has made it difficult for users to enjoy comfortable and satisfying travel and shopping experiences in real time.

[0813] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes an interface means for a user to input a travel plan, a QR generation means for generating QR codes corresponding to travel, experiences, dining, and purchases based on the user's travel plan, a transmission means for transmitting the QR code to the user's terminal, an authentication means for authenticating the user when the QR code is read by a scanner at each station, and an emotion engine for recognizing the user's emotional state and providing an optimal shopping experience. This makes it possible to individually customize the user's travel plan and provide optimal recommendations based on the user's emotional state and a purchasing experience in a virtual store in real time.

[0814] "User" means an individual who plans a trip and manages and executes their travel and shopping experience through the System.

[0815] "Interface means" refers to input devices and software that allow a user to input travel and shopping plans.

[0816] "QR Generator" refers to hardware and software for generating a unique QR code based on a user's travel plans and purchasing information.

[0817] "Transmission means" refers to a communication device and software for transmitting the generated QR code to the user's terminal.

[0818] "Authentication means" refers to the hardware and software used to verify and authenticate the contents of a QR code when the scanner at each station reads it.

[0819] An "emotion engine" refers to algorithms and software that analyze a user's facial expressions, voice, behavioral patterns, etc. to recognize their emotional state and provide them with an optimal travel or shopping experience.

[0820] "Activity recommendation means" refers to software that recommends local activities based on a user's profile and past behavioral data.

[0821] "Booking Method" means the hardware and software used to accept reservations for Recommended Activities and generate corresponding QR Codes.

[0822] "Product recommendation means" refers to software that recommends optimal products to users based on emotional data.

[0823] "Location information processing means" refers to hardware and software for providing recommended restaurant information based on the user's current location.

[0824] "Payment Instrument" refers to payment devices and software used to manage payments at restaurants and virtual stores.

[0825] "Virtual purchasing tool" refers to software and hardware for managing purchasing activities in a virtual store and providing users with an optimal purchasing experience.

[0826] A specific system configuration and processing flow for an embodiment of the present invention will be described below: This system provides users with a customized travel plan and virtual shopping experience.

[0827] System configuration

[0828] server

[0829] The server is the core of the system and is responsible for the following functions:

[0830] 1. Booking Management: Receive and analyze the travel plan data entered by the user, organize the necessary data for transportation, activities, dining, and purchases, and generate an integrated QR code.

[0831] 2. Emotion engine analysis: Collect and analyze users' emotional data, and optimize travel plans, recommended activities, and shopping experiences based on their emotional state.

[0832] 3. Product Recommendation: Recommend the best products based on the user's profile data and sentiment data.

[0833] Terminal

[0834] The device is the user's smartphone or HMD (head-mounted display), and has the following features:

[0835] 1. Entering travel and shopping plans: The user enters travel and shopping plans through the app.

[0836] 2. Emotion engine: Analyzes the user's facial expressions, voice, and behavioral patterns in real time to collect emotional data.

[0837] 3. Display QR code: Display the integrated QR code received from the server on the app screen.

[0838] User

[0839] A user is an individual who plans and executes a trip through the system. A user performs the following actions:

[0840] 1. Create a travel plan: Open the app and enter your travel and shopping plans.

[0841] 2. Present your QR code: Present your QR code at each station during your trip for authentication.

[0842] 3. Providing Emotion Data: Provide your own emotion data through the emotion engine.

[0843] Specific example explanation

[0844] From creating travel plans to generating QR codes

[0845] 1. The user opens the "Plan Your Trip" screen in the app and enters details such as origin, destination, dates, activities, food and drink, and purchases.

[0846] 2. The terminal sends the input data to the server.

[0847] 3. The server analyzes the received data, generates an integrated QR code, and sends it to the device.

[0848] 4. The device will display the received QR code on the app screen.

[0849] 5. The user checks the QR code and takes it with them on their trip.

[0850] Emotional data analysis and activity recommendation

[0851] 1. The device activates the emotion engine and analyzes the user's facial expressions and voice data.

[0852] 2. The server analyzes the emotion data received in real time and determines the user's emotional state.

[0853] 3. The server generates recommended activities and product data based on the emotional state and sends them to the device.

[0854] 4. The device notifies the user of the received recommendation data.

[0855] 5. The user reviews the recommended activities and products and makes reservations or purchases as needed.

[0856] Prompt Sentence Examples

[0857] "Design a VR assistant application that allows users to input their shopping plans and recommends the best products through an emotion engine. This includes the ability to analyze profile data and real-time emotion data to optimize the shopping experience in the virtual store."

[0858] In this way, the present invention realizes a system that provides users with customized travel plans and shopping experiences based on their emotions. This system allows users to manage their comfortable and satisfying travel and shopping experiences with a single QR code and enjoy optimal services based on their emotions in real time.

[0859] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0860] Step 1:

[0861] The user opens the app and is taken to the "Plan a Trip" screen, where they enter their trip details, including origin, destination, departure date, return date, transportation options, hotels, activities, and restaurants.

[0862] Input: Details such as departure point, destination, itinerary, activities, food and drink, and purchases.

[0863] Output: Trip planning data.

[0864] Specific operation: The user enters their travel plans into the app and presses the "Submit" button.

[0865] Step 2:

[0866] The terminal receives the user's input data and sends it to the server.

[0867] Input: Travel planning data.

[0868] Output: Trip planning data sent to the server.

[0869] Specific operation: The terminal uses the data transmission module to transmit the travel plan data to the server.

[0870] Step 3:

[0871] The server analyzes the received travel plan data and organizes the necessary data corresponding to transportation, activities, food and drink, and purchases.

[0872] Input: Submitted travel planning data.

[0873] Output: Organized trip planning data.

[0874] Specific operation: The server uses a data analysis engine to analyze the travel plan data and organize the necessary data for each item.

[0875] Step 4:

[0876] The server generates an integrated QR code based on the organized data and sends it to the terminal.

[0877] Input: Organized travel planning data.

[0878] Output: The generated consolidated QR code.

[0879] Specific operation: The server uses the QR code generation module to generate an integrated QR code and sends it to the terminal.

[0880] Step 5:

[0881] The QR code received by the device will be displayed on the app screen.

[0882] Input: The generated integrated QR code.

[0883] Output: QR code displayed on the app screen.

[0884] Specific operation: The terminal uses the screen display module to display the QR code.

[0885] Step 6:

[0886] The user presents a QR code at each station during their journey.

[0887] Input: QR code displayed on the app screen.

[0888] Output: QR code scan request.

[0889] Specific operation: The user presents the QR code to the scanner when moving, experiencing, eating, drinking, or purchasing.

[0890] Step 7:

[0891] The scanner reads the QR code and sends an authentication request to the server.

[0892] Input: The presented QR code.

[0893] Output: The authentication request sent to the server.

[0894] Specific operation: The scanner reads the QR code and sends an authentication request to the server.

[0895] Step 8:

[0896] The server verifies the data in the QR code received and performs authentication.

[0897] Input: The received QR code data.

[0898] Output: Authentication result (success or failure).

[0899] Specific operation: The server verifies the contents of the QR code and sends the authentication result to the scanner.

[0900] Step 9:

[0901] Based on the authentication result, the scanner notifies the user of the authentication result.

[0902] Input: Authentication result.

[0903] Output: Notification of authentication success or failure.

[0904] Specific operation: If the scanner is successful, it performs a physical action (e.g., opens the ticket gate); if it fails, it displays an error message.

[0905] Step 10:

[0906] The device uses an emotion engine to analyze the user's facial expressions and voice, and transmits the emotion data to the server.

[0907] Input: User's real-time facial expressions and voice.

[0908] Output: User emotion data.

[0909] Specific operation: The device uses the emotion engine to collect data and sends that data to the server.

[0910] Step 11:

[0911] The server analyzes the user's emotional data and recommends optimal activities and products.

[0912] Input: User emotion data.

[0913] Output: Recommended activity and product data.

[0914] Specific operation: The server analyzes the emotional data, selects the most appropriate activities and products based on the user's emotional state, and sends the recommended data to the device.

[0915] Step 12:

[0916] The device notifies the user of detailed information about recommended activities and products received.

[0917] Input: Recommended activity or product data.

[0918] Output: A notification message to the user.

[0919] Specific operation: The device uses the screen display module to notify the user of recommended activities and products.

[0920] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0921] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0922] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0923] [Second embodiment]

[0924] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0925] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0926] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0927] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0928] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0929] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0930] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0931] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0932] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0933] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0934] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0935] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0936] This invention relates to a system including a management device that provides users with customized travel plans. This system automates a series of processes, from when a user inputs their travel plans, to when a QR code is generated, and to when various services are authenticated. A specific embodiment of this system will be described below.

[0937] System configuration

[0938] server:

[0939] The server is the core of the system and is responsible for QR code generation, data processing, authentication, recommendation functions, etc.

[0940] Device:

[0941] The terminal is the user's smartphone or tablet, and communicates with the server through an application.

[0942] User:

[0943] A User is an individual who plans a trip and manages and executes the trip through the system.

[0944] Program processing flow

[0945] 1. Create a travel plan and generate a QR code

[0946] User:

[0947] 1. The user opens the app and enters their travel plans, including details such as departure and return dates, destinations, transportation options, hotels, activities, and restaurants.

[0948] Device:

[0949] 1. The terminal generates a request to send the entered information to the server.

[0950] server:

[0951] 1. The server generates an integrated QR code corresponding to transportation, activities, dining, and purchases based on the received travel plan information.

[0952] 2. Send the generated QR code to your device.

[0953] Examples:

[0954] When a user completes a trip plan:

[0955] User: Enter details in the app such as "Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A."

[0956] Terminal: Sends this information to the server.

[0957] Server: Generates a QR code based on the travel plan and returns it to the device.

[0958] User: Check the QR code displayed on the app screen and take it with you on your trip.

[0959] 2. QR code authentication at each station

[0960] User:

[0961] 1. Users present their QR code at each station during their trip when moving, engaging in activities, eating, drinking, or purchasing.

[0962] scanner:

[0963] 1. Each station is equipped with a QR code scanner that reads the QR code presented by the user.

[0964] Device:

[0965] 1. Receives scan data from the scanner and sends an authentication request to the server.

[0966] server:

[0967] 1. The server verifies the data in the received QR code and performs authentication.

[0968] 2. If the authentication is successful, it sends an authentication success message to the station.

[0969] Examples:

[0970] When a user passes through a train ticket barrier:

[0971] User: Present the QR code at the station ticket gate.

[0972] Scanner: Reads the QR code and sends the data to the server.

[0973] Server: Validates the contents of the QR code and sends a success message to open the ticket gate.

[0974] User: Pass through the ticket gate.

[0975] 3. Book and participate in recommended activities

[0976] server:

[0977] 1. Recommend appropriate activities based on the user's profile and past behavioral data.

[0978] 2. Send detailed information about the recommended activity to the device.

[0979] User:

[0980] 1. The user checks the activity details, selects the one they want, and makes a reservation.

[0981] Device:

[0982] 1. Send a reservation request to the server.

[0983] server:

[0984] 1. Confirm your reservation and generate a corresponding QR code to send to your device.

[0985] Examples:

[0986] When a user books an activity locally:

[0987] Server: Based on user data, it recommends things like museum visits and local cooking classes.

[0988] User: Selects and books a "Local Cooking Class" from the recommended activities.

[0989] Server: Confirms the reservation, generates a QR code and sends it to the device.

[0990] User: Present the QR code on-site to join the class.

[0991] 4. Use and payment at restaurants

[0992] server:

[0993] 1. Based on the user's location information, recommended restaurants are selected and the information is sent to the device.

[0994] User:

[0995] 1. Choose a recommended restaurant and make a reservation or visit in person.

[0996] Device:

[0997] 1. Present the QR code when paying at a restaurant.

[0998] Restaurant terminals:

[0999] 1. Scan the QR code and send the data to the server for authentication.

[1000] server:

[1001] 1. If authentication is successful, the payment is completed.

[1002] Examples:

[1003] If the user is eating at a restaurant:

[1004] Server: Recommends nearby restaurants based on the user's location.

[1005] User: Selects a recommended restaurant and visits it.

[1006] Terminal: Present the QR code when making a payment.

[1007] Restaurant terminal: Scans the QR code and sends it to the server.

[1008] Server: Verify the payment and send a success message to the restaurant.

[1009] 5. Convenience of purchasing services

[1010] server:

[1011] 1. Providing recommended souvenirs and keepsakes based on the user's travel plans.

[1012] User:

[1013] 1. Review the recommended items and make your purchase decision.

[1014] Device:

[1015] 1. Press the purchase button to generate a QR code and display the purchase completion screen.

[1016] Store Scanner:

[1017] 1. Scan the QR code and request authentication from the server.

[1018] server:

[1019] 1. Authenticate and send a success message.

[1020] Examples:

[1021] When a user shops at a souvenir shop:

[1022] Server: Based on the user's travel plans, sends recommended souvenir information to the terminal.

[1023] User: Selects a recommended souvenir and presses the purchase button.

[1024] Device: Display the generated QR code.

[1025] Store scanner: Scans the QR code and requests authentication from the server.

[1026] Server: Authenticates and sends a success message.

[1027] This concludes the embodiment of the present invention. This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, greatly improving the travel experience.

[1028] The processing flow will be explained below.

[1029] 1. Create a travel plan and generate a QR code

[1030] User:

[1031] Step 1: Open the app and go to the "Plan Your Trip" screen.

[1032] Step 2: Enter your travel details, including origin, destination, departure date, return date, transportation options, hotels, activities, and restaurants.

[1033] Step 3: Press the "Submit" button to confirm your travel plans.

[1034] Device:

[1035] Step 1: The travel plan data entered by the user is sent to the server.

[1036] Step 2: Wait for a response from the server.

[1037] server:

[1038] Step 1: Analyze the received travel planning data and organize the necessary data corresponding to transportation, activities, dining, and purchases.

[1039] Step 2: Generate an integrated QR code based on the organized data.

[1040] Step 3: Send the generated QR code to your device.

[1041] Device:

[1042] Step 1: Display the received QR code on the app screen.

[1043] User:

[1044] Step 4: Check the QR code displayed on the app screen and take it with you on your trip.

[1045] 2. QR code authentication at each station

[1046] User:

[1047] Step 1: Present your QR code at each station.

[1048] scanner:

[1049] Step 1: Read the QR code provided by the user.

[1050] Step 2: The data from the scanned QR code is sent to the server.

[1051] Device:

[1052] Step 1: Receive scan data from the scanner and send an authentication request to the server.

[1053] server:

[1054] Step 1: Verify the data in the received QR code.

[1055] Step 2: If the authentication is successful, send an authentication success message to the station.

[1056] Step 3: If the authentication fails, send an authentication failure message to the station.

[1057] scanner:

[1058] Step 1: Receive a success or failure message and perform the corresponding action (e.g., open the ticket gate, display an error).

[1059] 3. Book and participate in recommended activities

[1060] server:

[1061] Step 1: Generate data to recommend appropriate activities based on the user's profile and past behavioral data.

[1062] Step 2: Send the generated recommended activity data to the device.

[1063] Device:

[1064] Step 1: Display detailed information about the recommended activity received to the user.

[1065] User:

[1066] Step 1: Review the activity details and select the activity you want.

[1067] Step 2: Click the "Book" button to confirm your reservation.

[1068] Device:

[1069] Step 1: Send a reservation request to the server.

[1070] server:

[1071] Step 1: Receive the booking request and confirm with the activity organizer.

[1072] Step 2: If the booking is confirmed, generate the corresponding QR code.

[1073] Step 3: Send the generated QR code to your device.

[1074] Device:

[1075] Step 1: Display the generated QR code to the user.

[1076] User:

[1077] Step 1: Present the QR code at the activity venue.

[1078] Venue scanner:

[1079] Step 1: Scan the QR code and request authentication from the server.

[1080] server:

[1081] Step 1: Verify the data in the QR code and perform authentication.

[1082] Step 2: If authentication is successful, send a success message to the venue scanner.

[1083] Venue scanner:

[1084] Step 1: Receive a success message and allow the user to participate in the activity.

[1085] 4. Use and payment at restaurants

[1086] server:

[1087] Step 1: Generate restaurant recommendation data based on the user's profile and location information.

[1088] Step 2: The generated recommendation data is sent to the terminal.

[1089] Device:

[1090] Step 1: The received restaurant recommendation information is displayed to the user.

[1091] User:

[1092] Step 1: Select a recommended restaurant and press the reservation button or visit the restaurant in person.

[1093] Device:

[1094] Step 1: Present the QR code when paying at the restaurant.

[1095] Restaurant terminals:

[1096] Step 1: Scan the QR code and send the data to the server for authentication.

[1097] server:

[1098] Step 1: Check the data in the QR code you received and authenticate your payment.

[1099] Step 2: If the authentication is successful, a success message is sent to the restaurant terminal.

[1100] Restaurant terminals:

[1101] Step 1: Receive a success message to let the user know that the payment has been completed.

[1102] 5. Convenience of purchasing services

[1103] server:

[1104] Step 1: Generate data on recommended souvenirs and keepsakes based on the user's travel plans.

[1105] Step 2: Send the generated recommendation data to the device.

[1106] Device:

[1107] Step 1: Display the received recommended item information to the user.

[1108] User:

[1109] Step 1: Check out the recommended items and click the buy button.

[1110] Device:

[1111] Step 1: Send a purchase request to the server and generate a corresponding QR code.

[1112] Step 2: Display the generated QR code to the user.

[1113] User:

[1114] Step 1: Present the QR code at the store to make a purchase.

[1115] Store Scanner:

[1116] Step 1: Scan the QR code and send it to the server for authentication.

[1117] server:

[1118] Step 1: Check the QR code data and authenticate.

[1119] Step 2: If authentication is successful, send a success message to the store's scanner.

[1120] Store Scanner:

[1121] Step 1: Receive a success message and hand over the product to the user.

[1122] This is the specific program processing flow of the present invention. This system allows users to manage the entire travel experience, including creating a travel plan, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all on a single platform.

[1123] Example 1

[1124] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1125] In conventional travel planning management systems, users must individually book and manage transportation, accommodations, activities, food and beverages, and purchases, which places a significant burden on the user's time and effort. Furthermore, the need to manage tickets and reservation information separately complicates the overall travel experience. For this reason, there is a strong demand for a system that allows users to easily and smoothly manage their entire trip and access multiple services with a single QR code.

[1126] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1127] In this invention, the server includes an interface means for a user to input a travel plan, a QR generation means for generating QR codes corresponding to travel, experiences, dining, and purchases based on the user's travel plan, a transmission means for transmitting the QR code to the user's terminal, an authentication means for authenticating the QR code when a scanner at each station reads it, and a station management means for controlling access to stations based on the authentication. This allows the user to manage their entire trip using a single QR code and easily use a variety of services.

[1128] "User" means an individual who plans, manages and executes a trip through the System.

[1129] A "management device" is a device for providing a customized travel plan to a user.

[1130] An "interface means" is a means by which a user inputs travel plans, typically in the form of an application or web interface.

[1131] The "QR generation means" is a means for generating QR codes corresponding to travel, experiences, eating and drinking, and purchases based on the user's travel plans.

[1132] The "transmission means" is a means for transmitting the generated QR code to the user's terminal.

[1133] The "authentication means" is a means for performing authentication when the QR code is read by a scanner at each station.

[1134] The "station management means" is a means for controlling access of stations based on the authentication.

[1135] The "activity recommendation means" is a means for recommending local activities based on the user's profile and past behavioral data.

[1136] The "reservation means" is a means for accepting reservations for recommended activities and generating a corresponding QR code.

[1137] The "location information processing means" is a means for providing information on recommended restaurants based on the user's location information.

[1138] "Payment method" refers to a method for managing payments at restaurants.

[1139] "Purchase authentication means" is a means of authenticating a purchase by scanning a QR code presented by the user.

[1140] This invention relates to a system including a management device that provides users with customized travel plans. This system automates a series of processes, from when a user inputs their travel plans, to when a QR code is generated, and to when various services are authenticated. A specific embodiment of this system will be described below.

[1141] System configuration

[1142] server:

[1143] The server is the core of the system and is responsible for QR code generation, data processing, authentication, and recommendation functions.

[1144] The server performs multiple functions, including analyzing travel plans, generating QR codes, recording user behavior data, managing profiles, and processing location information.

[1145] The technologies used include QR code generation libraries (e.g., qrcode, pyqrcode) and database management systems (e.g., MySQL, PostgreSQL).

[1146] Device:

[1147] The terminal is the user's smartphone or tablet, and communicates with the server through an application.

[1148] The application provides a travel planning input interface, a QR code display screen, notification functions, and location information services.

[1149] User:

[1150] A User is an individual who plans a trip and manages and executes the trip through the system.

[1151] What the program does

[1152] Create a travel plan and generate a QR code

[1153] Users open the app and enter their travel plans, including details such as departure and return dates, destinations to visit, transportation options, hotels, activities, and restaurants.

[1154] The terminal generates a request to send the input information to the server.

[1155] The server generates an integrated QR code corresponding to transportation, activities, dining, and purchases based on the received travel plan information, and sends the generated QR code to the terminal.

[1156] Specific examples

[1157] When a user completes a trip plan:

[1158] Users enter details into the app such as "Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A."

[1159] The terminal transmits this information to the server.

[1160] The server generates a QR code based on the travel plan and returns it to the device.

[1161] Users check the QR code displayed on the app screen and take it with them on their trip.

[1162] QR code authentication at each station

[1163] Users present their QR code at each station during their trip when traveling, engaging in activities, eating and drinking, or making purchases.

[1164] Each station is equipped with a scanner that reads QR codes, and reads the QR code presented by the user.

[1165] After receiving the scan data, the scanner sends an authentication request to the server.

[1166] The server verifies the received QR code data and performs authentication. If authentication is successful, it sends an authentication success message to the station.

[1167] Specific examples

[1168] When a user passes through a train ticket barrier:

[1169] The user presents the QR code at the station ticket gate.

[1170] The scanner reads the QR code and sends the data to the server.

[1171] The server verifies the contents of the QR code and sends a success message to open the ticket gate.

[1172] The user passes through the ticket gate.

[1173] Book and participate in recommended activities

[1174] Based on the user's profile and past behavioral data, the server recommends appropriate activities.

[1175] Detailed information about the recommended activity is sent to the device.

[1176] Users can check the details of the activities, select the ones they want, and make a reservation.

[1177] Send a reservation request to the server.

[1178] The server confirms the reservation and generates a corresponding QR code that is sent to the device.

[1179] Specific examples

[1180] When a user books an activity locally:

[1181] Based on user data, the server recommends things like museum visits or local cooking classes.

[1182] The user selects and books a "local cooking class" from the recommended activities.

[1183] The server confirms the reservation, generates a QR code and sends it to the device.

[1184] Users present the QR code on-site to join the class.

[1185] Use and payment at restaurants

[1186] The server selects recommended restaurants based on the user's location information and sends the information to the terminal.

[1187] The user selects a recommended restaurant and makes a reservation or visits the restaurant in person.

[1188] Present the QR code when making payment.

[1189] The QR code is scanned and the data is sent to the server for authentication.

[1190] If the authentication is successful, the payment is completed.

[1191] Specific examples

[1192] If the user is eating at a restaurant:

[1193] The server recommends nearby restaurants based on the user's location.

[1194] The user selects a recommended restaurant and visits it.

[1195] Present the QR code when making payment.

[1196] Scan the QR code and send it to the server.

[1197] Verify the payment and send a success message to the restaurant.

[1198] Convenience of purchasing services

[1199] The server presents recommended souvenirs and mementos based on the user's travel plans.

[1200] The user reviews the recommended items and decides to purchase them.

[1201] Press the purchase button to generate a QR code and display the purchase completion screen.

[1202] Scan the QR code and request authentication from the server.

[1203] Authenticate and send a success message.

[1204] Specific examples

[1205] When a user shops at a souvenir shop:

[1206] The server transmits recommended souvenir information to the terminal based on the user's travel plans.

[1207] The user selects a recommended souvenir and presses the purchase button.

[1208] Display the generated QR code.

[1209] Scan the QR code and request authentication from the server.

[1210] Authenticate and send a success message.

[1211] This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, greatly improving the travel experience.

[1212] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1213] Step 1:

[1214] User enters travel plans.

[1215] Input: Travel plan details from the user (departure date, return date, destinations, transportation options, hotels, activities, restaurants, etc.).

[1216] Data processing: The user launches the application on their smartphone and inputs their travel plans. The application encodes the input data into JSON format.

[1217] Output: JSON data containing the user's travel plan information.

[1218] Step 2:

[1219] The device sends a request to the server.

[1220] Input: Travel planning information (JSON data) entered by the user in the app.

[1221] Data processing: The device generates a POST request to the API endpoint and sends the travel plan information to the server.

[1222] Output: The HTTP POST request sent to the server.

[1223] Step 3:

[1224] The server analyzes the travel plan and generates a QR code.

[1225] Input: Travel planning information sent from the device.

[1226] Data processing: The server parses the received JSON data and checks the database for each item in the travel plan (transportation, activities, food and drink, and purchases). It checks the necessary recommendations and reservation status and generates an integrated QR code. The QR code is generated using the qrcode library.

[1227] Output: Generated QR code data (image URL).

[1228] Step 4:

[1229] The server sends a QR code to the device.

[1230] Input: Generated QR code data (image URL).

[1231] Data processing: The server encodes the QR code data as a response and sends it to the terminal as an HTTP response.

[1232] Output: The QR code data sent to the device.

[1233] Step 5:

[1234] The user presents the QR code while traveling.

[1235] Input: The QR code received from the server (displayed on the device).

[1236] Data processing: The user presents the QR code at each station during their trip (e.g., train ticket gates, tourist spots, restaurants, souvenir shops, etc.).

[1237] Output: Input to the scanner when the QR code is presented.

[1238] Step 6:

[1239] The scanner reads the QR code.

[1240] Input: QR code provided by the user.

[1241] Data processing: The scanner decodes the QR code data and prepares it to send an authentication request to the server.

[1242] Output: The data of the QR code read by the scanner.

[1243] Step 7:

[1244] The device sends an authentication request to the server.

[1245] Input: The QR code data sent by the scanner.

[1246] Data processing: The device sends an authentication request including the QR code data to the server. The request is usually sent using the POST method to an API endpoint.

[1247] Output: The authentication request sent to the server.

[1248] Step 8:

[1249] The server authenticates the QR code.

[1250] Input: QR code data sent from the device.

[1251] Data processing: The server checks the received QR code data against a database and performs authentication. If authentication is successful, it generates a success message. Authentication usually uses a token or ID matching function within the system.

[1252] Output: Authentication successful message.

[1253] Step 9:

[1254] The server sends an authentication success message to the station.

[1255] Input: Authentication success message.

[1256] Data processing: The server encodes the authentication success message and sends it to the station, which then executes the corresponding action (e.g., opening the ticket gate).

[1257] Output: Authentication success message sent to the station.

[1258] Step 10:

[1259] The user is authenticated when using the service.

[1260] Input: Authentication success message received by the station.

[1261] Data processing: The user uses the services permitted by successful authentication (e.g., travel, activity participation, meals, purchases, etc.).

[1262] Output: Service usage completed.

[1263] These steps will enable users to manage all services, from creating travel plans to QR code authentication at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, greatly improving their travel experience.

[1264] (Application example 1)

[1265] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1266] Conventional food delivery services lack convenience because they require users to go through multiple steps during the ordering, authentication, and payment processes. This can lead to users feeling overwhelmed by the ordering and payment processes, potentially damaging the delivery experience. Furthermore, users cannot receive personalized recommendations based on their past behavioral data or profiles, making it difficult to provide a personalized dining experience. There is a need to solve these issues and provide users with a more comfortable and efficient food delivery experience.

[1267] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1268] In this invention, the server includes an interface means for a user to input a meal delivery plan, a QR generation means for generating a QR code corresponding to the meal and delivery based on the user's meal delivery plan, a transmission means for transmitting the QR code to the user's information processing device, and an authentication means for performing authentication when the QR code is read by a reader at each delivery station. This allows the user to manage a series of processes, from creating a meal delivery plan to ordering, authentication, and payment, in a unified system. Furthermore, by including a recommendation means for providing recommended menus based on the user's profile and past behavioral data, an ordering means for accepting orders for the recommended menus and generating corresponding QR codes, and a location information processing means for providing recommended restaurant information based on the user's location information, it is possible to provide the user with a customized dining experience.

[1269] A "customized meal delivery plan" is a meal delivery schedule created based on a user's individual needs and preferences.

[1270] "Management Device" means a combination of hardware and software for managing and executing a meal delivery plan in an integrated manner.

[1271] "Interface means" refers to a user interface through which a user inputs a meal delivery plan, including a smartphone application or web form.

[1272] "QR generation means" refers to a program or hardware for generating a QR code based on information about a user's order or delivery.

[1273] The "transmission means" is a communication means for transmitting the generated QR code to the user's information processing device.

[1274] "Authentication means" refers to a program or device that reads the QR code, verifies its contents, and performs authentication.

[1275] A "profile" is a data set that includes a user's basic information, past behavioral data, preferences, etc.

[1276] A "recommendation method" is an algorithm or system that individually recommends appropriate restaurants and menus based on a user's profile and past behavioral data.

[1277] The "ordering means" is a function or device that accepts food and drink orders from users and generates corresponding QR codes.

[1278] The "location information processing means" is a system that acquires the user's location information and provides optimal restaurants and delivery schedules based on that information.

[1279] "Payment Instrument" means the program and device that manages and processes payments at a restaurant.

[1280] MODE FOR CARRYING OUT THE INVENTION

[1281] System configuration

[1282] server

[1283] The server is the core of this system and is responsible for QR code generation, data processing, authentication, recommendation functions, etc. The main software used includes Flask (a Python web framework), Pandas (a data manipulation library), and qrcode (a QR code generation library).

[1284] Terminal

[1285] The terminal is a user's smartphone or tablet, which is used to communicate with the server through the application. The terminal provides a user interface where the user inputs their meal delivery plan and receives a QR code.

[1286] Program processing

[1287] User input of meal delivery plan

[1288] The user uses the terminal to input a meal delivery plan, which includes information such as the food and drink they want to order, the delivery address, and the desired delivery time.

[1289] Generate and send a QR code

[1290] The information sent from the device is received by the server. The server generates a QR code corresponding to the order and delivery based on the received meal delivery plan information. The generated QR code is sent back to the device, and the user uses this QR code to have the delivery or pick up the item at the store.

[1291] Recommendation feature

[1292] The server recommends suitable food and drink options and restaurants based on the user's profile and past behavioral data. This recommendation function helps support the user's meal selection.

[1293] Authentication Process

[1294] Each restaurant and delivery station is equipped with a scanner that reads QR codes. These scanners read the QR code presented by the user and send the data to a server. The server then authenticates the data and verifies that the QR code is valid.

[1295] Payment and Order Management

[1296] The server manages the order details and processes the payment made through the QR code. The payment information is also linked to the QR code, so users can easily make payments by simply presenting the QR code.

[1297] Specific examples

[1298] When a user places a delivery order

[1299] The user uses the application to enter their user ID, the restaurant they wish to order from, and the menu item. For example, they might enter "User ID: 1, Restaurant: Japanese restaurant, Recommended menu: Sushi set." The server receives this, registers the new order, generates a QR code, and provides it to the user. The user can then present this QR code to the restaurant to confirm their order and receive delivery.

[1300] When restaurants authenticate QR codes

[1301] The restaurant uses a QR code scanner to read the QR code. The scanned data is sent to the server, which then verifies the order information based on the order ID and performs authentication. If authentication is successful, the restaurant confirms the user's order and begins delivery.

[1302] Example prompt sentence:

[1303] "When a user orders a sushi set at a Japanese restaurant, please tell me the details of the recommended menu items. User ID is 1."

[1304] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1305] Step 1:

[1306] User enters meal delivery plan

[1307] The user opens the application on their smartphone or tablet and inputs their meal delivery plan, including the type of food and drink desired, restaurant selection, delivery address, desired delivery time, etc. The input information is saved on the device via the interface means.

[1308] input:

[1309] User personal information (e.g., user ID)

[1310] Information about the food and drink you order (e.g., menu, quantity)

[1311] Delivery address

[1312] output:

[1313] Meal delivery plan information (e.g., restaurant name, menu, delivery time)

[1314] Specific behavior:

[1315] A user enters the following information into the app: "User ID: 1, Restaurant: Japanese restaurant, Recommended menu: Sushi set."

[1316] Step 2:

[1317] Sending meal delivery plan information to the server

[1318] The device sends the meal delivery plan information entered by the user to the server via an HTTP request.

[1319] input:

[1320] Meal delivery plan information stored on your device

[1321] output:

[1322] Data sent to the server

[1323] Specific behavior:

[1324] The terminal sends the input information "User ID: 1, Restaurant: Japanese restaurant, Recommended menu: Sushi set" as a request to the server.

[1325] Step 3:

[1326] Generate a QR code

[1327] The server generates a QR code based on the received meal delivery plan information. It uses the qrcode library to encode this information and create a unique QR code.

[1328] input:

[1329] Meal delivery plan information

[1330] output:

[1331] The image file path of the generated QR code

[1332] Specific behavior:

[1333] The server receives the meal delivery plan information and generates a QR code with "User ID: 1, Restaurant: Japanese restaurant, Recommended menu: Sushi set."

[1334] Step 4:

[1335] Sending a QR code to a device

[1336] The generated QR code is sent from the server to the user's device, allowing the user to view the QR code on their own device.

[1337] input:

[1338] QR code image file path

[1339] output:

[1340] QR code sent to the device

[1341] Specific behavior:

[1342] The server sends the generated QR code to the device, and the user checks the QR code on the app.

[1343] Step 5:

[1344] Providing recommended menus

[1345] The server recommends appropriate food and drink options and restaurants based on the user's profile and past behavioral data. It also analyzes past order history and personal preference data to make personalized recommendations.

[1346] input:

[1347] User profile data

[1348] Past behavioral data

[1349] output:

[1350] Recommended menu or store information

[1351] Specific behavior:

[1352] The server analyzes the profile and past order history of "User ID: 1" and recommends the recommended menu item "Sushi Set" at a Japanese restaurant.

[1353] Step 6:

[1354] Authentication at delivery stations

[1355] The user presents the QR code to receive the food or drink they ordered. At the delivery station, a QR code scanner reads the QR code and transmits the data to a server for authentication.

[1356] input:

[1357] QR code data

[1358] output:

[1359] Authentication result (success or failure)

[1360] Specific behavior:

[1361] The user presents the QR code at the delivery station, a scanner reads the QR code, and the data is sent to a server for authentication.

[1362] Step 7:

[1363] Processing payments

[1364] The server processes the payment based on the order details provided through the QR code. The payment information is also linked to the QR code, allowing the user to make the payment simply by presenting the QR code.

[1365] input:

[1366] QR code data

[1367] Payment Information

[1368] output:

[1369] Payment completion notification

[1370] Specific behavior:

[1371] The server verifies the QR code data and payment information, completes the payment, and the user receives a payment confirmation.

[1372] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1373] This invention is a system that includes a management device that provides users with customized travel plans, and further combines it with an emotion engine that recognizes the user's emotions and optimizes the travel plan. This system automates the entire process from when the user inputs their travel plan, generating a QR code, and authenticating various services, and further provides optimal suggestions in real time based on the user's emotions, thereby aiming to provide each user with the best travel experience. Below, we will explain in detail how to implement this system.

[1374] System configuration

[1375] server:

[1376] The server is the core of the system and is responsible for QR code generation, data processing, authentication, recommendation functions, and emotional data analysis.

[1377] Device:

[1378] The device is a user's smartphone or tablet, which communicates with the server through an application. An emotion engine is installed on the device and collects user emotion data.

[1379] User:

[1380] A user is an individual who plans a trip and manages and executes the trip through the system.

[1381] Program processing flow

[1382] 1. Create a travel plan and generate a QR code

[1383] User:

[1384] 1. The user opens the app and opens the "Create a Trip Plan" screen.

[1385] 2. Enter your trip details, including origin, destination, departure date, return date, transportation, hotels, activities, and restaurants.

[1386] 3. Click the "Submit" button to confirm your travel plans.

[1387] Device:

[1388] 1. The travel plan data entered by the user is sent to the server.

[1389] 2. Wait for a response from the server.

[1390] server:

[1391] 1. Analyze the received travel planning data and organize the necessary data corresponding to transportation, activities, dining, and purchases.

[1392] 2. Generate an integrated QR code based on the organized data.

[1393] 3. Send the generated QR code to the device.

[1394] Device:

[1395] 1. Display the received QR code on the app screen.

[1396] User:

[1397] 4. Check the QR code displayed on the app screen and take it with you on your trip.

[1398] Examples:

[1399] When a user completes a trip plan:

[1400] User: Enter details in the app such as "Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A."

[1401] Terminal: Sends this information to the server.

[1402] Server: Generates a QR code based on the travel plan and returns it to the device.

[1403] User: Check the QR code displayed on the app screen and take it with you on your trip.

[1404] 2. QR code authentication at each station

[1405] User:

[1406] 1. Users present their QR code at each station during their trip when moving, engaging in activities, eating, drinking, or purchasing.

[1407] scanner:

[1408] 1. Each station is equipped with a QR code scanner that reads the QR code presented by the user.

[1409] Device:

[1410] 1. Receives scan data from the scanner and sends an authentication request to the server.

[1411] server:

[1412] 1. Verify the data in the received QR code and perform authentication.

[1413] 2. If the authentication is successful, it sends an authentication success message to the station.

[1414] 3. If authentication fails, send an authentication failure message to the station.

[1415] scanner:

[1416] 1. Receive a success or failure message and perform the corresponding action (e.g., open the ticket gate, display an error).

[1417] Examples:

[1418] When a user passes through a train ticket barrier:

[1419] User: Present the QR code at the station ticket gate.

[1420] Scanner: Reads the QR code and sends the data to the server.

[1421] Server: Validates the contents of the QR code and sends a success message to open the ticket gate.

[1422] User: Pass through the ticket gate.

[1423] 3. Book and participate in recommended activities

[1424] server:

[1425] 1. Generate data that recommends appropriate activities based on the user's profile and past behavioral data.

[1426] 2. The generated recommended activity data is sent to the device.

[1427] Device:

[1428] 1. Show the user detailed information about the recommended activity they received.

[1429] User:

[1430] 1. Check the activity details and select the activity you want.

[1431] 2. Click the "Book" button to confirm your reservation.

[1432] Device:

[1433] 1. Send a reservation request to the server.

[1434] server:

[1435] 1. Receive the booking request and confirm with the activity organizer.

[1436] 2. If the booking is confirmed, generate the corresponding QR code.

[1437] 3. Send the generated QR code to the device.

[1438] Device:

[1439] 1. Display the generated QR code to the user.

[1440] User:

[1441] 1. Present the QR code at the activity venue.

[1442] Venue scanner:

[1443] 1. Scan the QR code and request authentication from the server.

[1444] server:

[1445] 1. Verify the data in the QR code and perform authentication.

[1446] 2. If authentication is successful, send a success message to the scanner at the venue.

[1447] Venue scanner:

[1448] 1. Receives a success message and allows the user to participate in the activity.

[1449] Examples:

[1450] When a user books an activity locally:

[1451] Server: Based on user data, it recommends things like museum visits and local cooking classes.

[1452] User: Selects and books a "Local Cooking Class" from the recommended activities.

[1453] Server: Confirms the reservation, generates a QR code and sends it to the device.

[1454] User: Present the QR code on-site to join the class.

[1455] 4. Use and payment at restaurants

[1456] server:

[1457] 1. Generate restaurant recommendation data based on the user's profile and location information.

[1458] 2. The generated recommendation data is sent to the device.

[1459] Device:

[1460] 1. Display the received restaurant recommendation information to the user.

[1461] User:

[1462] 1. Select a recommended restaurant and press the reservation button or visit the restaurant directly.

[1463] Device:

[1464] 1. Present the QR code when paying at a restaurant.

[1465] Restaurant terminals:

[1466] 1. Scan the QR code and send the data to the server for authentication.

[1467] server:

[1468] 1. Check the data in the received QR code and authenticate the payment.

[1469] 2. If authentication is successful, a success message is sent to the restaurant's terminal.

[1470] Restaurant terminals:

[1471] 1. A success message is received, informing the user that the payment has been completed.

[1472] Examples:

[1473] If the user is eating at a restaurant:

[1474] Server: Recommends nearby restaurants based on the user's location.

[1475] User: Selects a recommended restaurant and visits it.

[1476] Terminal: Present the QR code when making a payment.

[1477] Restaurant terminal: Scans the QR code and sends it to the server.

[1478] Server: Verify the payment and send a success message to the restaurant.

[1479] 5. Convenience of purchasing services

[1480] server:

[1481] 1. Generate recommended souvenirs and mementos based on the user's travel plans.

[1482] 2. The generated recommendation data is sent to the device.

[1483] Device:

[1484] 1. Display the received recommended item information to the user.

[1485] User:

[1486] 1. Check the recommended items and press the purchase button.

[1487] Device:

[1488] 1. Send the purchase request to the server and generate the corresponding QR code.

[1489] 2. Display the generated QR code to the user.

[1490] User:

[1491] 1. Present the QR code at the store to make a purchase.

[1492] Store Scanner:

[1493] 1. Scan the QR code and send it to the server for authentication.

[1494] server:

[1495] 1. Check the QR code data and perform authentication.

[1496] 2. If authentication is successful, send a success message to the store's scanner.

[1497] Store Scanner:

[1498] 1. Receive a success message and hand over the product to the user.

[1499] 6. Introducing the Emotion Engine

[1500] Device:

[1501] 1. An emotion engine is installed on the device, which collects emotional data by analyzing the user's facial expressions, voice, behavioral patterns, etc.

[1502] 2. Emotion data is sent to the server in real time.

[1503] server:

[1504] 1. Analyze the received emotion data and determine the user's emotional state.

[1505] 2. Dynamically optimize travel plans, recommended activities, and restaurant recommendations based on emotional state.

[1506] 3. Send the optimized information to the device.

[1507] Examples:

[1508] Update recommendations based on user sentiment changes:

[1509] Terminal: When the user shows a depressed expression, the emotion engine detects that emotion and sends the emotion data to the server.

[1510] Server: Analyzes the emotional data indicating depression and recommends new activities to lift your mood (e.g., a fun show or a relaxing spa).

[1511] Terminal: Notify the user of new recommended activities.

[1512] User: Review the recommended activities and decide to participate.

[1513] This concludes the description of the embodiment of the present invention. This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, and can also provide optimal experiences based on emotions through an emotion engine.

[1514] The processing flow will be explained below.

[1515] 1. Create a travel plan and generate a QR code

[1516] User:

[1517] Step 1: Open the app and go to the "Plan Your Trip" screen.

[1518] Step 2: Enter your travel details, including origin, destination, departure date, return date, transportation, accommodation, activities, and restaurants.

[1519] Step 3: Press the "Submit" button to confirm your travel plans.

[1520] Device:

[1521] Step 1: The travel plan data entered by the user is sent to the server.

[1522] Step 2: Wait for a response from the server.

[1523] server:

[1524] Step 1: Analyze the received travel planning data and organize the necessary data corresponding to transportation, activities, dining, and purchases.

[1525] Step 2: Generate an integrated QR code based on the organized data.

[1526] Step 3: Send the generated QR code to your device.

[1527] Device:

[1528] Step 1: Display the received QR code on the app screen.

[1529] User:

[1530] Step 4: Check the QR code displayed on the app screen and take it with you on your trip.

[1531] 2. QR code authentication at each station

[1532] User:

[1533] Step 1: Present your QR code at each station.

[1534] scanner:

[1535] Step 1: Read the QR code provided by the user.

[1536] Step 2: The data from the scanned QR code is sent to the server.

[1537] server:

[1538] Step 1: Verify the data in the received QR code.

[1539] Step 2: If the authentication is successful, send an authentication success message to the station.

[1540] Step 3: If the authentication fails, send an authentication failure message to the station.

[1541] scanner:

[1542] Step 1: Receive a success or failure message and perform the corresponding action (e.g., open the ticket gate, display an error).

[1543] 3. Book and participate in recommended activities

[1544] server:

[1545] Step 1: Generate data to recommend appropriate activities based on the user's profile and past behavioral data.

[1546] Step 2: Send the generated recommended activity data to the device.

[1547] Device:

[1548] Step 1: Display detailed information about the recommended activity received to the user.

[1549] User:

[1550] Step 1: Review the activity details and select the activity you want.

[1551] Step 2: Click the "Book" button to confirm your reservation.

[1552] Device:

[1553] Step 1: Send a reservation request to the server.

[1554] server:

[1555] Step 1: Receive the booking request and confirm with the activity organizer.

[1556] Step 2: If the booking is confirmed, generate the corresponding QR code.

[1557] Step 3: Send the generated QR code to your device.

[1558] Device:

[1559] Step 1: Display the generated QR code to the user.

[1560] User:

[1561] Step 1: Present the QR code at the activity venue.

[1562] Venue scanner:

[1563] Step 1: Scan the QR code and request authentication from the server.

[1564] server:

[1565] Step 1: Verify the data in the QR code and perform authentication.

[1566] Step 2: If authentication is successful, send a success message to the venue scanner.

[1567] Venue scanner:

[1568] Step 1: Receive a success message and allow the user to participate in the activity.

[1569] 4. Use and payment at restaurants

[1570] server:

[1571] Step 1: Generate restaurant recommendation data based on the user's profile and location information.

[1572] Step 2: The generated recommendation data is sent to the terminal.

[1573] Device:

[1574] Step 1: The received restaurant recommendation information is displayed to the user.

[1575] User:

[1576] Step 1: Select a recommended restaurant and press the reservation button or visit the restaurant in person.

[1577] Device:

[1578] Step 1: Present the QR code when paying at the restaurant.

[1579] Restaurant terminals:

[1580] Step 1: Scan the QR code and send the data to the server for authentication.

[1581] server:

[1582] Step 1: Check the data in the QR code you received and authenticate your payment.

[1583] Step 2: If the authentication is successful, a success message is sent to the restaurant terminal.

[1584] Restaurant terminals:

[1585] Step 1: Receive a success message to let the user know that the payment has been completed.

[1586] 5. Convenience of purchasing services

[1587] server:

[1588] Step 1: Generate data on recommended souvenirs and keepsakes based on the user's travel plans.

[1589] Step 2: Send the generated recommendation data to the device.

[1590] Device:

[1591] Step 1: Display the received recommended item information to the user.

[1592] User:

[1593] Step 1: Check out the recommended items and click the buy button.

[1594] Device:

[1595] Step 1: Send a purchase request to the server and generate a corresponding QR code.

[1596] Step 2: Display the generated QR code to the user.

[1597] User:

[1598] Step 1: Present the QR code at the store to make a purchase.

[1599] Store Scanner:

[1600] Step 1: Scan the QR code and send it to the server for authentication.

[1601] server:

[1602] Step 1: Check the QR code data and authenticate.

[1603] Step 2: If authentication is successful, send a success message to the store's scanner.

[1604] Store Scanner:

[1605] Step 1: Receive a success message and hand over the product to the user.

[1606] 6. Introducing the Emotion Engine

[1607] Device:

[1608] Step 1: An emotion engine is installed on the device, which collects emotion data by analyzing the user's facial expressions, voice, behavioral patterns, etc.

[1609] Step 2: Send emotion data to the server in real time.

[1610] server:

[1611] Step 1: Analyze the received emotion data and determine the user's emotional state.

[1612] Step 2: Dynamically optimize travel plans, recommended activities, and restaurants based on emotional states.

[1613] Step 3: Send the optimized information to the device.

[1614] Examples:

[1615] Update recommendations based on user sentiment changes:

[1616] Terminal: When the user shows a depressed expression, the emotion engine detects that emotion and sends the emotion data to the server.

[1617] Server: Analyzes the emotional data indicating depression and recommends new activities to lift your mood (e.g., a fun show or a relaxing spa).

[1618] Terminal: Notify the user of new recommended activities.

[1619] User: Review the recommended activities and decide to participate.

[1620] The above is the specific program processing flow of the present invention combined with the emotion engine. This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, and furthermore, the emotion engine can provide the optimal experience according to the user's emotions.

[1621] Example 2

[1622] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1623] In recent years, there has been a demand for travel planning and execution systems that can be customized to meet individual user needs. However, the process of users planning a trip is complex and time-consuming, so there is a need for a system that can easily and efficiently create a trip plan and centrally manage the information, authentication procedures, and on-site service usage required during the trip. Furthermore, there is a lack of a mechanism for optimizing trip plans and recommended activities based on the user's emotions and real-time situation. To solve these issues, a more advanced travel planning management system is needed.

[1624] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1625] In this invention, the server includes an interface means for a user to input a travel plan, a code generation means for generating QR codes corresponding to travel, experiences, dining, and purchases based on the user's travel plan, a transmission means for transmitting the codes to the user's communication device, an authentication means for authenticating the user when a reader at each station reads the codes, and an emotion analysis means for analyzing the user's emotion data and optimizing the travel plan in real time. This allows the user to easily create a travel plan, use services centrally during the trip, and enjoy a travel experience that is optimized in real time.

[1626] "User" means an individual who plans, manages and executes a trip through the System.

[1627] "Management device" refers to a collection of equipment and software for providing customized travel plans to users.

[1628] "Interface means" refers to a set of software and hardware that provides a user interface for a user to input travel plans.

[1629] "Code generation means" refers to a device and program that has the function of generating QR codes corresponding to travel, experiences, dining, and purchases based on the user's travel plans.

[1630] "Transmitting means" refers to the equipment and software for transmitting the generated code to the user's communication device.

[1631] "Authentication means" refers to a function that performs authentication when a reader at each station reads a code presented by a user.

[1632] "Emotion analysis means" refers to a device and program that has the function of analyzing the user's emotional data and optimizing travel plans in real time.

[1633] "Communication device" refers to a device such as a smartphone or tablet that a user uses to communicate with the system.

[1634] "Reading device" refers to a device that includes a scanner or camera for reading QR codes.

[1635] "Recommendation" refers to a feature that recommends local activities based on a user's profile and past behavioral data.

[1636] "Booking Method" refers to the functionality that accepts bookings for recommended activities and generates corresponding codes.

[1637] The "location information processing means" refers to a function that provides information on recommended restaurants based on the user's location information.

[1638] "Payment method" refers to the function of managing payments at restaurants.

[1639] This invention is a management system that provides users with customized travel plans, and aims to provide the best travel experience for each user by automating the process from users entering their travel plans, generating QR codes, and authenticating various services. Furthermore, by combining it with an emotion engine, it is possible to recognize user emotions and optimize travel plans in real time.

[1640] System configuration

[1641] server:

[1642] The server is the core of this system and plays the following roles:

[1643] Code generation method: Based on the travel plan data entered by the user, QR codes corresponding to transportation, activities, dining, and purchases are generated. Specifically, the QR codes are generated using the Python qrcode library.

[1644] Transmission means: The generated QR code is sent to the user's communication device as an HTTP response.

[1645] Authentication method: The QR code data sent from the reader at each station is verified and authentication is performed.

[1646] Emotion analysis means: Analyzes the received emotional data and determines the user's emotional state. This is done using a machine learning model (generative AI model).

[1647] Device:

[1648] The device is the user's smartphone or tablet and has the following functions:

[1649] Interface means: Provides a user interface for users to input travel plans. Specifically, this corresponds to a mobile application.

[1650] Communication means: The input travel plan data and emotion data are sent to the server, and a response is received from the server.

[1651] Display means: The QR code and recommended activities received from the server are displayed to the user.

[1652] Emotion engine: Analyzes the user's facial expressions, voice, and behavioral patterns to generate emotion data. Specifically, it uses the front camera and microphone and analyzes them using software libraries (e.g., OpenCV, Tensorflow).

[1653] User:

[1654] A user is an individual who uses this system and performs the following operations.

[1655] Travel Planning: Enter travel planning details using the mobile application.

[1656] Present your QR code: Present your QR code at each station during your trip.

[1657] Activity Booking: Book and participate in recommended activities.

[1658] Payment: Use QR codes to pay at restaurants and when making purchases.

[1659] Specific examples

[1660] A specific example of a user creating a travel plan and generating a QR code is as follows.

[1661] User: Enter details in the app such as "Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A."

[1662] Terminal: Sends this information to the server as an HTTP request.

[1663] Server: Generates a QR code based on the travel plan and sends it to the device as an HTTP response.

[1664] Device: Display the received QR code on the app screen.

[1665] User: Check the displayed QR code and take it with you on your trip.

[1666] Prompt Sentence Examples

[1667] "Open the travel plan creation screen and enter the following details: Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A. Press the submit button to confirm your travel plan."

[1668] This concludes the embodiment of the present invention. This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code. Furthermore, an emotion engine can be used to provide optimal experiences based on emotions.

[1669] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1670] Step 1:

[1671] User:

[1672] The user opens the app and navigates to the "Plan a Trip" screen by tapping the "Plan a Trip" button on the mobile application's home screen. As input, the user enters details of the origin, destination, departure date, return date, transportation, accommodation, activities, and food and drink. As output, this data is saved as internal data for the application.

[1673] Step 2:

[1674] Device:

[1675] When the user presses the "Submit" button, the device sends the entered travel plan data to the server as an HTTP POST request. Specifically, the device application organizes the travel plan data in JSON format and issues a request to the server's API endpoint. The input is the user's travel plan data, and the output is the JSON data sent to the server.

[1676] Step 3:

[1677] server:

[1678] The server parses the received travel plan data and retrieves data corresponding to transportation, activities, dining, and purchases from a database. It uses Python and SQL to execute database queries to extract the best options for each category selected by the user. The input is the JSON data of the travel plan, and the output is organized trip data.

[1679] Step 4:

[1680] server:

[1681] The server generates a QR code based on the organized travel data. Specifically, it uses the qrcode library to generate the QR code and create its image data. The input is the organized travel data, and the output is the QR code image data.

[1682] Step 5:

[1683] server:

[1684] The generated QR code is sent to the terminal as an HTTP response. The server includes the QR code image data in the body of the HTTP response and sends it to the terminal. The input is the QR code image data, and the output is an HTTP response containing the QR code.

[1685] Step 6:

[1686] Device:

[1687] The device displays the received QR code on the application screen. Specifically, it uses an image viewer component to display the QR code image. The input is the QR code image data from the server, and the output is the QR code displayed on the user's screen.

[1688] Step 7:

[1689] User:

[1690] During the trip, the user presents a QR code at each station by pointing the smartphone screen at the QR code reader and tapping it. The input is the user's QR code screen, and the output is the QR code data read by the scanner.

[1691] Step 8:

[1692] scanner:

[1693] The reader at each station reads the user's QR code and sends the data to the server in a specific format. Specifically, the QR code reader scans the QR code and sends the data to the server as an HTTP request. The input is the QR code data, and the output is the authentication request data sent to the server.

[1694] Step 9:

[1695] server:

[1696] The server verifies the received QR code data and performs authentication. It searches the database for the travel plan information associated with the QR code, and if there is a match, authentication is successful. The input is the QR code authentication request data, and the output is the authentication result (success or failure).

[1697] Step 10:

[1698] scanner:

[1699] The scanner receives the authentication result from the server and displays a success or failure message. For example, if successful, it performs an action such as opening a gate. The input is the authentication result message from the server, and the output is the corresponding physical action (e.g., opening or closing the gate) or a message display.

[1700] Step 11:

[1701] Device:

[1702] An emotion engine is installed on the device, which analyzes facial expressions, voice, and behavioral patterns to collect emotional data and transmits it to the server in real time. The input is the user's emotional data (facial expressions, voice, etc.), and the output is the emotional data sent to the server.

[1703] Step 12:

[1704] server:

[1705] The server analyzes the received emotional data to determine the user's emotional state, optimizing travel plans and recommended activities in real time. Specifically, it uses a machine learning algorithm to classify the emotional state and recalculate the optimal activities. The input is emotional data, and the output is optimized travel plans and activity recommendations.

[1706] Step 13:

[1707] Device:

[1708] The device notifies the user of the optimized information, specifically by displaying activity updates as push notifications or in-app messages. The input is the optimized information from the server, and the output is the updated information displayed on the user's screen.

[1709] The above is the specific processing flow of the program for this system. Users can receive consistent support from creating a travel plan, presenting a QR code, authentication, and real-time optimization according to their emotions.

[1710] (Application example 2)

[1711] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1712] While there have been systems that provide personalized travel plans, they lack the functionality to recommend optimal shopping experiences and activities in real time, taking into account the user's emotional state. Furthermore, there have been no systems that manage the purchasing experience in virtual stores and comprehensively support users' travel. This has made it difficult for users to enjoy comfortable and satisfying travel and shopping experiences in real time.

[1713] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes an interface means for a user to input a travel plan, a QR generation means for generating QR codes corresponding to travel, experiences, dining, and purchases based on the user's travel plan, a transmission means for transmitting the QR code to the user's terminal, an authentication means for authenticating the user when the QR code is read by a scanner at each station, and an emotion engine for recognizing the user's emotional state and providing an optimal shopping experience. This makes it possible to individually customize the user's travel plan and provide optimal recommendations based on the user's emotional state and a purchasing experience in a virtual store in real time.

[1714] "User" means an individual who plans a trip and manages and executes their travel and shopping experience through the System.

[1715] "Interface means" refers to input devices and software that allow a user to input travel and shopping plans.

[1716] "QR Generator" refers to hardware and software for generating a unique QR code based on a user's travel plans and purchasing information.

[1717] "Transmission means" refers to a communication device and software for transmitting the generated QR code to the user's terminal.

[1718] "Authentication means" refers to the hardware and software used to verify and authenticate the contents of a QR code when the scanner at each station reads it.

[1719] An "emotion engine" refers to algorithms and software that analyze a user's facial expressions, voice, behavioral patterns, etc. to recognize their emotional state and provide them with an optimal travel or shopping experience.

[1720] "Activity recommendation means" refers to software that recommends local activities based on a user's profile and past behavioral data.

[1721] "Booking Method" means the hardware and software used to accept reservations for Recommended Activities and generate corresponding QR Codes.

[1722] "Product recommendation means" refers to software that recommends optimal products to users based on emotional data.

[1723] "Location information processing means" refers to hardware and software for providing recommended restaurant information based on the user's current location.

[1724] "Payment Instrument" refers to payment devices and software used to manage payments at restaurants and virtual stores.

[1725] "Virtual purchasing tool" refers to software and hardware for managing purchasing activities in a virtual store and providing users with an optimal purchasing experience.

[1726] A specific system configuration and processing flow for an embodiment of the present invention will be described below: This system provides users with a customized travel plan and virtual shopping experience.

[1727] System configuration

[1728] server

[1729] The server is the core of the system and is responsible for the following functions:

[1730] 1. Booking Management: Receive and analyze the travel plan data entered by the user, organize the necessary data for transportation, activities, dining, and purchases, and generate an integrated QR code.

[1731] 2. Emotion engine analysis: Collect and analyze users' emotional data, and optimize travel plans, recommended activities, and shopping experiences based on their emotional state.

[1732] 3. Product Recommendation: Recommend the best products based on the user's profile data and sentiment data.

[1733] Terminal

[1734] The device is the user's smartphone or HMD (head-mounted display), and has the following features:

[1735] 1. Entering travel and shopping plans: The user enters travel and shopping plans through the app.

[1736] 2. Emotion engine: Analyzes the user's facial expressions, voice, and behavioral patterns in real time to collect emotional data.

[1737] 3. Display QR code: Display the integrated QR code received from the server on the app screen.

[1738] User

[1739] A user is an individual who plans and executes a trip through the system. A user performs the following actions:

[1740] 1. Create a travel plan: Open the app and enter your travel and shopping plans.

[1741] 2. Present your QR code: Present your QR code at each station during your trip for authentication.

[1742] 3. Providing Emotion Data: Provide your own emotion data through the emotion engine.

[1743] Specific example explanation

[1744] From creating travel plans to generating QR codes

[1745] 1. The user opens the "Plan Your Trip" screen in the app and enters details such as origin, destination, dates, activities, food and drink, and purchases.

[1746] 2. The terminal sends the input data to the server.

[1747] 3. The server analyzes the received data, generates an integrated QR code, and sends it to the device.

[1748] 4. The device will display the received QR code on the app screen.

[1749] 5. The user checks the QR code and takes it with them on their trip.

[1750] Emotional data analysis and activity recommendation

[1751] 1. The device activates the emotion engine and analyzes the user's facial expressions and voice data.

[1752] 2. The server analyzes the emotion data received in real time and determines the user's emotional state.

[1753] 3. The server generates recommended activities and product data based on the emotional state and sends them to the device.

[1754] 4. The device notifies the user of the received recommendation data.

[1755] 5. The user reviews the recommended activities and products and makes reservations or purchases as needed.

[1756] Prompt Sentence Examples

[1757] "Design a VR assistant application that allows users to input their shopping plans and recommends the best products through an emotion engine. This includes the ability to analyze profile data and real-time emotion data to optimize the shopping experience in the virtual store."

[1758] In this way, the present invention realizes a system that provides users with customized travel plans and shopping experiences based on their emotions. This system allows users to manage their comfortable and satisfying travel and shopping experiences with a single QR code and enjoy optimal services based on their emotions in real time.

[1759] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1760] Step 1:

[1761] The user opens the app and is taken to the "Plan a Trip" screen, where they enter their trip details, including origin, destination, departure date, return date, transportation options, hotels, activities, and restaurants.

[1762] Input: Details such as departure point, destination, itinerary, activities, food and drink, and purchases.

[1763] Output: Trip planning data.

[1764] Specific operation: The user enters their travel plans into the app and presses the "Submit" button.

[1765] Step 2:

[1766] The terminal receives the user's input data and sends it to the server.

[1767] Input: Travel planning data.

[1768] Output: Trip planning data sent to the server.

[1769] Specific operation: The terminal uses the data transmission module to transmit the travel plan data to the server.

[1770] Step 3:

[1771] The server analyzes the received travel plan data and organizes the necessary data corresponding to transportation, activities, food and drink, and purchases.

[1772] Input: Submitted travel planning data.

[1773] Output: Organized trip planning data.

[1774] Specific operation: The server uses a data analysis engine to analyze the travel plan data and organize the necessary data for each item.

[1775] Step 4:

[1776] The server generates an integrated QR code based on the organized data and sends it to the terminal.

[1777] Input: Organized travel planning data.

[1778] Output: The generated consolidated QR code.

[1779] Specific operation: The server uses the QR code generation module to generate an integrated QR code and sends it to the terminal.

[1780] Step 5:

[1781] The QR code received by the device will be displayed on the app screen.

[1782] Input: The generated integrated QR code.

[1783] Output: QR code displayed on the app screen.

[1784] Specific operation: The terminal uses the screen display module to display the QR code.

[1785] Step 6:

[1786] The user presents a QR code at each station during their journey.

[1787] Input: QR code displayed on the app screen.

[1788] Output: QR code scan request.

[1789] Specific operation: The user presents the QR code to the scanner when moving, experiencing, eating, drinking, or purchasing.

[1790] Step 7:

[1791] The scanner reads the QR code and sends an authentication request to the server.

[1792] Input: The presented QR code.

[1793] Output: The authentication request sent to the server.

[1794] Specific operation: The scanner reads the QR code and sends an authentication request to the server.

[1795] Step 8:

[1796] The server verifies the data in the QR code received and performs authentication.

[1797] Input: The received QR code data.

[1798] Output: Authentication result (success or failure).

[1799] Specific operation: The server verifies the contents of the QR code and sends the authentication result to the scanner.

[1800] Step 9:

[1801] Based on the authentication result, the scanner notifies the user of the authentication result.

[1802] Input: Authentication result.

[1803] Output: Notification of authentication success or failure.

[1804] Specific operation: If the scanner is successful, it performs a physical action (e.g., opens the ticket gate); if it fails, it displays an error message.

[1805] Step 10:

[1806] The device uses an emotion engine to analyze the user's facial expressions and voice, and transmits the emotion data to the server.

[1807] Input: User's real-time facial expressions and voice.

[1808] Output: User emotion data.

[1809] Specific operation: The device uses the emotion engine to collect data and sends that data to the server.

[1810] Step 11:

[1811] The server analyzes the user's emotional data and recommends optimal activities and products.

[1812] Input: User emotion data.

[1813] Output: Recommended activity and product data.

[1814] Specific operation: The server analyzes the emotional data, selects the most appropriate activities and products based on the user's emotional state, and sends the recommended data to the device.

[1815] Step 12:

[1816] The device notifies the user of detailed information about recommended activities and products received.

[1817] Input: Recommended activity or product data.

[1818] Output: A notification message to the user.

[1819] Specific operation: The device uses the screen display module to notify the user of recommended activities and products.

[1820] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1821] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1822] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1823] [Third embodiment]

[1824] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1825] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1826] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1827] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1828] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1829] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1830] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1831] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1832] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1833] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1834] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1835] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1836] This invention relates to a system including a management device that provides users with customized travel plans. This system automates a series of processes, from when a user inputs their travel plans, to when a QR code is generated, and to when various services are authenticated. A specific embodiment of this system will be described below.

[1837] System configuration

[1838] server:

[1839] The server is the core of the system and is responsible for QR code generation, data processing, authentication, recommendation functions, etc.

[1840] Device:

[1841] The terminal is the user's smartphone or tablet, and communicates with the server through an application.

[1842] User:

[1843] A User is an individual who plans a trip and manages and executes the trip through the system.

[1844] Program processing flow

[1845] 1. Create a travel plan and generate a QR code

[1846] User:

[1847] 1. The user opens the app and enters their travel plans, including details such as departure and return dates, destinations, transportation options, hotels, activities, and restaurants.

[1848] Device:

[1849] 1. The terminal generates a request to send the entered information to the server.

[1850] server:

[1851] 1. The server generates an integrated QR code corresponding to transportation, activities, dining, and purchases based on the received travel plan information.

[1852] 2. Send the generated QR code to your device.

[1853] Examples:

[1854] When a user completes a trip plan:

[1855] User: Enter details in the app such as "Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A."

[1856] Terminal: Sends this information to the server.

[1857] Server: Generates a QR code based on the travel plan and returns it to the device.

[1858] User: Check the QR code displayed on the app screen and take it with you on your trip.

[1859] 2. QR code authentication at each station

[1860] User:

[1861] 1. Users present their QR code at each station during their trip when moving, engaging in activities, eating, drinking, or purchasing.

[1862] scanner:

[1863] 1. Each station is equipped with a QR code scanner that reads the QR code presented by the user.

[1864] Device:

[1865] 1. Receives scan data from the scanner and sends an authentication request to the server.

[1866] server:

[1867] 1. The server verifies the data in the received QR code and performs authentication.

[1868] 2. If the authentication is successful, it sends an authentication success message to the station.

[1869] Examples:

[1870] When a user passes through a train ticket barrier:

[1871] User: Present the QR code at the station ticket gate.

[1872] Scanner: Reads the QR code and sends the data to the server.

[1873] Server: Validates the contents of the QR code and sends a success message to open the ticket gate.

[1874] User: Pass through the ticket gate.

[1875] 3. Book and participate in recommended activities

[1876] server:

[1877] 1. Recommend appropriate activities based on the user's profile and past behavioral data.

[1878] 2. Send detailed information about the recommended activity to the device.

[1879] User:

[1880] 1. The user checks the activity details, selects the one they want, and makes a reservation.

[1881] Device:

[1882] 1. Send a reservation request to the server.

[1883] server:

[1884] 1. Confirm your reservation and generate a corresponding QR code to send to your device.

[1885] Examples:

[1886] When a user books an activity locally:

[1887] Server: Based on user data, it recommends things like museum visits and local cooking classes.

[1888] User: Selects and books a "Local Cooking Class" from the recommended activities.

[1889] Server: Confirms the reservation, generates a QR code and sends it to the device.

[1890] User: Present the QR code on-site to join the class.

[1891] 4. Use and payment at restaurants

[1892] server:

[1893] 1. Based on the user's location information, recommended restaurants are selected and the information is sent to the device.

[1894] User:

[1895] 1. Choose a recommended restaurant and make a reservation or visit in person.

[1896] Device:

[1897] 1. Present the QR code when paying at a restaurant.

[1898] Restaurant terminals:

[1899] 1. Scan the QR code and send the data to the server for authentication.

[1900] server:

[1901] 1. If authentication is successful, the payment is completed.

[1902] Examples:

[1903] If the user is eating at a restaurant:

[1904] Server: Recommends nearby restaurants based on the user's location.

[1905] User: Selects a recommended restaurant and visits it.

[1906] Terminal: Present the QR code when making a payment.

[1907] Restaurant terminal: Scans the QR code and sends it to the server.

[1908] Server: Verify the payment and send a success message to the restaurant.

[1909] 5. Convenience of purchasing services

[1910] server:

[1911] 1. Providing recommended souvenirs and keepsakes based on the user's travel plans.

[1912] User:

[1913] 1. Review the recommended items and make your purchase decision.

[1914] Device:

[1915] 1. Press the purchase button to generate a QR code and display the purchase completion screen.

[1916] Store Scanner:

[1917] 1. Scan the QR code and request authentication from the server.

[1918] server:

[1919] 1. Authenticate and send a success message.

[1920] Examples:

[1921] When a user shops at a souvenir shop:

[1922] Server: Based on the user's travel plans, sends recommended souvenir information to the terminal.

[1923] User: Selects a recommended souvenir and presses the purchase button.

[1924] Device: Display the generated QR code.

[1925] Store scanner: Scans the QR code and requests authentication from the server.

[1926] Server: Authenticates and sends a success message.

[1927] This concludes the embodiment of the present invention. This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, greatly improving the travel experience.

[1928] The processing flow will be explained below.

[1929] 1. Create a travel plan and generate a QR code

[1930] User:

[1931] Step 1: Open the app and go to the "Plan Your Trip" screen.

[1932] Step 2: Enter your travel details, including origin, destination, departure date, return date, transportation options, hotels, activities, and restaurants.

[1933] Step 3: Press the "Submit" button to confirm your travel plans.

[1934] Device:

[1935] Step 1: The travel plan data entered by the user is sent to the server.

[1936] Step 2: Wait for a response from the server.

[1937] server:

[1938] Step 1: Analyze the received travel planning data and organize the necessary data corresponding to transportation, activities, dining, and purchases.

[1939] Step 2: Generate an integrated QR code based on the organized data.

[1940] Step 3: Send the generated QR code to your device.

[1941] Device:

[1942] Step 1: Display the received QR code on the app screen.

[1943] User:

[1944] Step 4: Check the QR code displayed on the app screen and take it with you on your trip.

[1945] 2. QR code authentication at each station

[1946] User:

[1947] Step 1: Present your QR code at each station.

[1948] scanner:

[1949] Step 1: Read the QR code provided by the user.

[1950] Step 2: The data from the scanned QR code is sent to the server.

[1951] Device:

[1952] Step 1: Receive scan data from the scanner and send an authentication request to the server.

[1953] server:

[1954] Step 1: Verify the data in the received QR code.

[1955] Step 2: If the authentication is successful, send an authentication success message to the station.

[1956] Step 3: If the authentication fails, send an authentication failure message to the station.

[1957] scanner:

[1958] Step 1: Receive a success or failure message and perform the corresponding action (e.g., open the ticket gate, display an error).

[1959] 3. Book and participate in recommended activities

[1960] server:

[1961] Step 1: Generate data to recommend appropriate activities based on the user's profile and past behavioral data.

[1962] Step 2: Send the generated recommended activity data to the device.

[1963] Device:

[1964] Step 1: Display detailed information about the recommended activity received to the user.

[1965] User:

[1966] Step 1: Review the activity details and select the activity you want.

[1967] Step 2: Click the "Book" button to confirm your reservation.

[1968] Device:

[1969] Step 1: Send a reservation request to the server.

[1970] server:

[1971] Step 1: Receive the booking request and confirm with the activity organizer.

[1972] Step 2: If the booking is confirmed, generate the corresponding QR code.

[1973] Step 3: Send the generated QR code to your device.

[1974] Device:

[1975] Step 1: Display the generated QR code to the user.

[1976] User:

[1977] Step 1: Present the QR code at the activity venue.

[1978] Venue scanner:

[1979] Step 1: Scan the QR code and request authentication from the server.

[1980] server:

[1981] Step 1: Verify the data in the QR code and perform authentication.

[1982] Step 2: If authentication is successful, send a success message to the venue scanner.

[1983] Venue scanner:

[1984] Step 1: Receive a success message and allow the user to participate in the activity.

[1985] 4. Use and payment at restaurants

[1986] server:

[1987] Step 1: Generate restaurant recommendation data based on the user's profile and location information.

[1988] Step 2: The generated recommendation data is sent to the terminal.

[1989] Device:

[1990] Step 1: The received restaurant recommendation information is displayed to the user.

[1991] User:

[1992] Step 1: Select a recommended restaurant and press the reservation button or visit the restaurant in person.

[1993] Device:

[1994] Step 1: Present the QR code when paying at the restaurant.

[1995] Restaurant terminals:

[1996] Step 1: Scan the QR code and send the data to the server for authentication.

[1997] server:

[1998] Step 1: Check the data in the QR code you received and authenticate your payment.

[1999] Step 2: If the authentication is successful, a success message is sent to the restaurant terminal.

[2000] Restaurant terminals:

[2001] Step 1: Receive a success message to let the user know that the payment has been completed.

[2002] 5. Convenience of purchasing services

[2003] server:

[2004] Step 1: Generate data on recommended souvenirs and keepsakes based on the user's travel plans.

[2005] Step 2: Send the generated recommendation data to the device.

[2006] Device:

[2007] Step 1: Display the received recommended item information to the user.

[2008] User:

[2009] Step 1: Check out the recommended items and click the buy button.

[2010] Device:

[2011] Step 1: Send a purchase request to the server and generate a corresponding QR code.

[2012] Step 2: Display the generated QR code to the user.

[2013] User:

[2014] Step 1: Present the QR code at the store to make a purchase.

[2015] Store Scanner:

[2016] Step 1: Scan the QR code and send it to the server for authentication.

[2017] server:

[2018] Step 1: Check the QR code data and authenticate.

[2019] Step 2: If authentication is successful, send a success message to the store's scanner.

[2020] Store Scanner:

[2021] Step 1: Receive a success message and hand over the product to the user.

[2022] This is the specific program processing flow of the present invention. This system allows users to manage the entire travel experience, including creating a travel plan, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all on a single platform.

[2023] Example 1

[2024] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2025] In conventional travel planning management systems, users must individually book and manage transportation, accommodations, activities, food and beverages, and purchases, which places a significant burden on the user's time and effort. Furthermore, the need to manage tickets and reservation information separately complicates the overall travel experience. For this reason, there is a strong demand for a system that allows users to easily and smoothly manage their entire trip and access multiple services with a single QR code.

[2026] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2027] In this invention, the server includes an interface means for a user to input a travel plan, a QR generation means for generating QR codes corresponding to travel, experiences, dining, and purchases based on the user's travel plan, a transmission means for transmitting the QR code to the user's terminal, an authentication means for authenticating the QR code when a scanner at each station reads it, and a station management means for controlling access to stations based on the authentication. This allows the user to manage their entire trip using a single QR code and easily use a variety of services.

[2028] "User" means an individual who plans, manages and executes a trip through the System.

[2029] A "management device" is a device for providing a customized travel plan to a user.

[2030] An "interface means" is a means by which a user inputs travel plans, typically in the form of an application or web interface.

[2031] The "QR generation means" is a means for generating QR codes corresponding to travel, experiences, eating and drinking, and purchases based on the user's travel plans.

[2032] The "transmission means" is a means for transmitting the generated QR code to the user's terminal.

[2033] The "authentication means" is a means for performing authentication when the QR code is read by a scanner at each station.

[2034] The "station management means" is a means for controlling access of stations based on the authentication.

[2035] The "activity recommendation means" is a means for recommending local activities based on the user's profile and past behavioral data.

[2036] The "reservation means" is a means for accepting reservations for recommended activities and generating a corresponding QR code.

[2037] The "location information processing means" is a means for providing information on recommended restaurants based on the user's location information.

[2038] "Payment method" refers to a method for managing payments at restaurants.

[2039] "Purchase authentication means" is a means of authenticating a purchase by scanning a QR code presented by the user.

[2040] This invention relates to a system including a management device that provides users with customized travel plans. This system automates a series of processes, from when a user inputs their travel plans, to when a QR code is generated, and to when various services are authenticated. A specific embodiment of this system will be described below.

[2041] System configuration

[2042] server:

[2043] The server is the core of the system and is responsible for QR code generation, data processing, authentication, and recommendation functions.

[2044] The server performs multiple functions, including analyzing travel plans, generating QR codes, recording user behavior data, managing profiles, and processing location information.

[2045] The technologies used include QR code generation libraries (e.g., qrcode, pyqrcode) and database management systems (e.g., MySQL, PostgreSQL).

[2046] Device:

[2047] The terminal is the user's smartphone or tablet, and communicates with the server through an application.

[2048] The application provides a travel planning input interface, a QR code display screen, notification functions, and location information services.

[2049] User:

[2050] A User is an individual who plans a trip and manages and executes the trip through the system.

[2051] What the program does

[2052] Create a travel plan and generate a QR code

[2053] Users open the app and enter their travel plans, including details such as departure and return dates, destinations to visit, transportation options, hotels, activities, and restaurants.

[2054] The terminal generates a request to send the input information to the server.

[2055] The server generates an integrated QR code corresponding to transportation, activities, dining, and purchases based on the received travel plan information, and sends the generated QR code to the terminal.

[2056] Specific examples

[2057] When a user completes a trip plan:

[2058] Users enter details into the app such as "Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A."

[2059] The terminal transmits this information to the server.

[2060] The server generates a QR code based on the travel plan and returns it to the device.

[2061] Users check the QR code displayed on the app screen and take it with them on their trip.

[2062] QR code authentication at each station

[2063] Users present their QR code at each station during their trip when traveling, engaging in activities, eating and drinking, or making purchases.

[2064] Each station is equipped with a scanner that reads QR codes, and reads the QR code presented by the user.

[2065] After receiving the scan data, the scanner sends an authentication request to the server.

[2066] The server verifies the received QR code data and performs authentication. If authentication is successful, it sends an authentication success message to the station.

[2067] Specific examples

[2068] When a user passes through a train ticket barrier:

[2069] The user presents the QR code at the station ticket gate.

[2070] The scanner reads the QR code and sends the data to the server.

[2071] The server verifies the contents of the QR code and sends a success message to open the ticket gate.

[2072] The user passes through the ticket gate.

[2073] Book and participate in recommended activities

[2074] Based on the user's profile and past behavioral data, the server recommends appropriate activities.

[2075] Detailed information about the recommended activity is sent to the device.

[2076] Users can check the details of the activities, select the ones they want, and make a reservation.

[2077] Send a reservation request to the server.

[2078] The server confirms the reservation and generates a corresponding QR code that is sent to the device.

[2079] Specific examples

[2080] When a user books an activity locally:

[2081] Based on user data, the server recommends things like museum visits or local cooking classes.

[2082] The user selects and books a "local cooking class" from the recommended activities.

[2083] The server confirms the reservation, generates a QR code and sends it to the device.

[2084] Users present the QR code on-site to join the class.

[2085] Use and payment at restaurants

[2086] The server selects recommended restaurants based on the user's location information and sends the information to the terminal.

[2087] The user selects a recommended restaurant and makes a reservation or visits the restaurant in person.

[2088] Present the QR code when making payment.

[2089] The QR code is scanned and the data is sent to the server for authentication.

[2090] If the authentication is successful, the payment is completed.

[2091] Specific examples

[2092] If the user is eating at a restaurant:

[2093] The server recommends nearby restaurants based on the user's location.

[2094] The user selects a recommended restaurant and visits it.

[2095] Present the QR code when making payment.

[2096] Scan the QR code and send it to the server.

[2097] Verify the payment and send a success message to the restaurant.

[2098] Convenience of purchasing services

[2099] The server presents recommended souvenirs and mementos based on the user's travel plans.

[2100] The user reviews the recommended items and decides to purchase them.

[2101] Press the purchase button to generate a QR code and display the purchase completion screen.

[2102] Scan the QR code and request authentication from the server.

[2103] Authenticate and send a success message.

[2104] Specific examples

[2105] When a user shops at a souvenir shop:

[2106] The server transmits recommended souvenir information to the terminal based on the user's travel plans.

[2107] The user selects a recommended souvenir and presses the purchase button.

[2108] Display the generated QR code.

[2109] Scan the QR code and request authentication from the server.

[2110] Authenticate and send a success message.

[2111] This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, greatly improving the travel experience.

[2112] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2113] Step 1:

[2114] User enters travel plans.

[2115] Input: Travel plan details from the user (departure date, return date, destinations, transportation options, hotels, activities, restaurants, etc.).

[2116] Data processing: The user launches the application on their smartphone and inputs their travel plans. The application encodes the input data into JSON format.

[2117] Output: JSON data containing the user's travel plan information.

[2118] Step 2:

[2119] The device sends a request to the server.

[2120] Input: Travel planning information (JSON data) entered by the user in the app.

[2121] Data processing: The device generates a POST request to the API endpoint and sends the travel plan information to the server.

[2122] Output: The HTTP POST request sent to the server.

[2123] Step 3:

[2124] The server analyzes the travel plan and generates a QR code.

[2125] Input: Travel planning information sent from the device.

[2126] Data processing: The server parses the received JSON data and checks the database for each item in the travel plan (transportation, activities, food and drink, and purchases). It checks the necessary recommendations and reservation status and generates an integrated QR code. The QR code is generated using the qrcode library.

[2127] Output: Generated QR code data (image URL).

[2128] Step 4:

[2129] The server sends a QR code to the device.

[2130] Input: Generated QR code data (image URL).

[2131] Data processing: The server encodes the QR code data as a response and sends it to the terminal as an HTTP response.

[2132] Output: The QR code data sent to the device.

[2133] Step 5:

[2134] The user presents the QR code while traveling.

[2135] Input: The QR code received from the server (displayed on the device).

[2136] Data processing: The user presents the QR code at each station during their trip (e.g., train ticket gates, tourist spots, restaurants, souvenir shops, etc.).

[2137] Output: Input to the scanner when the QR code is presented.

[2138] Step 6:

[2139] The scanner reads the QR code.

[2140] Input: QR code provided by the user.

[2141] Data processing: The scanner decodes the QR code data and prepares it to send an authentication request to the server.

[2142] Output: The data of the QR code read by the scanner.

[2143] Step 7:

[2144] The device sends an authentication request to the server.

[2145] Input: The QR code data sent by the scanner.

[2146] Data processing: The device sends an authentication request including the QR code data to the server. The request is usually sent using the POST method to an API endpoint.

[2147] Output: The authentication request sent to the server.

[2148] Step 8:

[2149] The server authenticates the QR code.

[2150] Input: QR code data sent from the device.

[2151] Data processing: The server checks the received QR code data against a database and performs authentication. If authentication is successful, it generates a success message. Authentication usually uses a token or ID matching function within the system.

[2152] Output: Authentication successful message.

[2153] Step 9:

[2154] The server sends an authentication success message to the station.

[2155] Input: Authentication success message.

[2156] Data processing: The server encodes the authentication success message and sends it to the station, which then executes the corresponding action (e.g., opening the ticket gate).

[2157] Output: Authentication success message sent to the station.

[2158] Step 10:

[2159] The user is authenticated when using the service.

[2160] Input: Authentication success message received by the station.

[2161] Data processing: The user uses the services permitted by successful authentication (e.g., travel, activity participation, meals, purchases, etc.).

[2162] Output: Service usage completed.

[2163] These steps will enable users to manage all services, from creating travel plans to QR code authentication at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, greatly improving their travel experience.

[2164] (Application example 1)

[2165] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2166] Conventional food delivery services lack convenience because they require users to go through multiple steps during the ordering, authentication, and payment processes. This can lead to users feeling overwhelmed by the ordering and payment processes, potentially damaging the delivery experience. Furthermore, users cannot receive personalized recommendations based on their past behavioral data or profiles, making it difficult to provide a personalized dining experience. There is a need to solve these issues and provide users with a more comfortable and efficient food delivery experience.

[2167] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2168] In this invention, the server includes an interface means for a user to input a meal delivery plan, a QR generation means for generating a QR code corresponding to the meal and delivery based on the user's meal delivery plan, a transmission means for transmitting the QR code to the user's information processing device, and an authentication means for performing authentication when the QR code is read by a reader at each delivery station. This allows the user to manage a series of processes, from creating a meal delivery plan to ordering, authentication, and payment, in a unified system. Furthermore, by including a recommendation means for providing recommended menus based on the user's profile and past behavioral data, an ordering means for accepting orders for the recommended menus and generating corresponding QR codes, and a location information processing means for providing recommended restaurant information based on the user's location information, it is possible to provide the user with a customized dining experience.

[2169] A "customized meal delivery plan" is a meal delivery schedule created based on a user's individual needs and preferences.

[2170] "Management Device" means a combination of hardware and software for managing and executing a meal delivery plan in an integrated manner.

[2171] "Interface means" refers to a user interface through which a user inputs a meal delivery plan, including a smartphone application or web form.

[2172] "QR generation means" refers to a program or hardware for generating a QR code based on information about a user's order or delivery.

[2173] The "transmission means" is a communication means for transmitting the generated QR code to the user's information processing device.

[2174] "Authentication means" refers to a program or device that reads the QR code, verifies its contents, and performs authentication.

[2175] A "profile" is a data set that includes a user's basic information, past behavioral data, preferences, etc.

[2176] A "recommendation method" is an algorithm or system that individually recommends appropriate restaurants and menus based on a user's profile and past behavioral data.

[2177] The "ordering means" is a function or device that accepts food and drink orders from users and generates corresponding QR codes.

[2178] The "location information processing means" is a system that acquires the user's location information and provides optimal restaurants and delivery schedules based on that information.

[2179] "Payment Instrument" means the program and device that manages and processes payments at a restaurant.

[2180] MODE FOR CARRYING OUT THE INVENTION

[2181] System configuration

[2182] server

[2183] The server is the core of this system and is responsible for QR code generation, data processing, authentication, recommendation functions, etc. The main software used includes Flask (a Python web framework), Pandas (a data manipulation library), and qrcode (a QR code generation library).

[2184] Terminal

[2185] The terminal is a user's smartphone or tablet, which is used to communicate with the server through the application. The terminal provides a user interface where the user inputs their meal delivery plan and receives a QR code.

[2186] Program processing

[2187] User input of meal delivery plan

[2188] The user uses the terminal to input a meal delivery plan, which includes information such as the food and drink they want to order, the delivery address, and the desired delivery time.

[2189] Generate and send a QR code

[2190] The information sent from the device is received by the server. The server generates a QR code corresponding to the order and delivery based on the received meal delivery plan information. The generated QR code is sent back to the device, and the user uses this QR code to have the delivery or pick up the item at the store.

[2191] Recommendation feature

[2192] The server recommends suitable food and drink options and restaurants based on the user's profile and past behavioral data. This recommendation function helps support the user's meal selection.

[2193] Authentication Process

[2194] Each restaurant and delivery station is equipped with a scanner that reads QR codes. These scanners read the QR code presented by the user and send the data to a server. The server then authenticates the data and verifies that the QR code is valid.

[2195] Payment and Order Management

[2196] The server manages the order details and processes the payment made through the QR code. The payment information is also linked to the QR code, so users can easily make payments by simply presenting the QR code.

[2197] Specific examples

[2198] When a user places a delivery order

[2199] The user uses the application to enter their user ID, the restaurant they wish to order from, and the menu item. For example, they might enter "User ID: 1, Restaurant: Japanese restaurant, Recommended menu: Sushi set." The server receives this, registers the new order, generates a QR code, and provides it to the user. The user can then present this QR code to the restaurant to confirm their order and receive delivery.

[2200] When restaurants authenticate QR codes

[2201] The restaurant uses a QR code scanner to read the QR code. The scanned data is sent to the server, which then verifies the order information based on the order ID and performs authentication. If authentication is successful, the restaurant confirms the user's order and begins delivery.

[2202] Example prompt sentence:

[2203] "When a user orders a sushi set at a Japanese restaurant, please tell me the details of the recommended menu items. User ID is 1."

[2204] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2205] Step 1:

[2206] User enters meal delivery plan

[2207] The user opens the application on their smartphone or tablet and inputs their meal delivery plan, including the type of food and drink desired, restaurant selection, delivery address, desired delivery time, etc. The input information is saved on the device via the interface means.

[2208] input:

[2209] User personal information (e.g., user ID)

[2210] Information about the food and drink you order (e.g., menu, quantity)

[2211] Delivery address

[2212] output:

[2213] Meal delivery plan information (e.g., restaurant name, menu, delivery time)

[2214] Specific behavior:

[2215] A user enters the following information into the app: "User ID: 1, Restaurant: Japanese restaurant, Recommended menu: Sushi set."

[2216] Step 2:

[2217] Sending meal delivery plan information to the server

[2218] The device sends the meal delivery plan information entered by the user to the server via an HTTP request.

[2219] input:

[2220] Meal delivery plan information stored on your device

[2221] output:

[2222] Data sent to the server

[2223] Specific behavior:

[2224] The terminal sends the input information "User ID: 1, Restaurant: Japanese restaurant, Recommended menu: Sushi set" as a request to the server.

[2225] Step 3:

[2226] Generate a QR code

[2227] The server generates a QR code based on the received meal delivery plan information. It uses the qrcode library to encode this information and create a unique QR code.

[2228] input:

[2229] Meal delivery plan information

[2230] output:

[2231] The image file path of the generated QR code

[2232] Specific behavior:

[2233] The server receives the meal delivery plan information and generates a QR code with "User ID: 1, Restaurant: Japanese restaurant, Recommended menu: Sushi set."

[2234] Step 4:

[2235] Sending a QR code to a device

[2236] The generated QR code is sent from the server to the user's device, allowing the user to view the QR code on their own device.

[2237] input:

[2238] QR code image file path

[2239] output:

[2240] QR code sent to the device

[2241] Specific behavior:

[2242] The server sends the generated QR code to the device, and the user checks the QR code on the app.

[2243] Step 5:

[2244] Providing recommended menus

[2245] The server recommends appropriate food and drink options and restaurants based on the user's profile and past behavioral data. It also analyzes past order history and personal preference data to make personalized recommendations.

[2246] input:

[2247] User profile data

[2248] Past behavioral data

[2249] output:

[2250] Recommended menu or store information

[2251] Specific behavior:

[2252] The server analyzes the profile and past order history of "User ID: 1" and recommends the recommended menu item "Sushi Set" at a Japanese restaurant.

[2253] Step 6:

[2254] Authentication at delivery stations

[2255] The user presents the QR code to receive the food or drink they ordered. At the delivery station, a QR code scanner reads the QR code and transmits the data to a server for authentication.

[2256] input:

[2257] QR code data

[2258] output:

[2259] Authentication result (success or failure)

[2260] Specific behavior:

[2261] The user presents the QR code at the delivery station, a scanner reads the QR code, and the data is sent to a server for authentication.

[2262] Step 7:

[2263] Processing payments

[2264] The server processes the payment based on the order details provided through the QR code. The payment information is also linked to the QR code, allowing the user to make the payment simply by presenting the QR code.

[2265] input:

[2266] QR code data

[2267] Payment Information

[2268] output:

[2269] Payment completion notification

[2270] Specific behavior:

[2271] The server verifies the QR code data and payment information, completes the payment, and the user receives a payment confirmation.

[2272] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2273] This invention is a system that includes a management device that provides users with customized travel plans, and further combines it with an emotion engine that recognizes the user's emotions and optimizes the travel plan. This system automates the entire process from when the user inputs their travel plan, generating a QR code, and authenticating various services, and further provides optimal suggestions in real time based on the user's emotions, thereby aiming to provide each user with the best travel experience. Below, we will explain in detail how to implement this system.

[2274] System configuration

[2275] server:

[2276] The server is the core of the system and is responsible for QR code generation, data processing, authentication, recommendation functions, and emotional data analysis.

[2277] Device:

[2278] The device is a user's smartphone or tablet, which communicates with the server through an application. An emotion engine is installed on the device and collects user emotion data.

[2279] User:

[2280] A user is an individual who plans a trip and manages and executes the trip through the system.

[2281] Program processing flow

[2282] 1. Create a travel plan and generate a QR code

[2283] User:

[2284] 1. The user opens the app and opens the "Create a Trip Plan" screen.

[2285] 2. Enter your trip details, including origin, destination, departure date, return date, transportation, hotels, activities, and restaurants.

[2286] 3. Click the "Submit" button to confirm your travel plans.

[2287] Device:

[2288] 1. The travel plan data entered by the user is sent to the server.

[2289] 2. Wait for a response from the server.

[2290] server:

[2291] 1. Analyze the received travel planning data and organize the necessary data corresponding to transportation, activities, dining, and purchases.

[2292] 2. Generate an integrated QR code based on the organized data.

[2293] 3. Send the generated QR code to the device.

[2294] Device:

[2295] 1. Display the received QR code on the app screen.

[2296] User:

[2297] 4. Check the QR code displayed on the app screen and take it with you on your trip.

[2298] Examples:

[2299] When a user completes a trip plan:

[2300] User: Enter details in the app such as "Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A."

[2301] Terminal: Sends this information to the server.

[2302] Server: Generates a QR code based on the travel plan and returns it to the device.

[2303] User: Check the QR code displayed on the app screen and take it with you on your trip.

[2304] 2. QR code authentication at each station

[2305] User:

[2306] 1. Users present their QR code at each station during their trip when moving, engaging in activities, eating, drinking, or purchasing.

[2307] scanner:

[2308] 1. Each station is equipped with a QR code scanner that reads the QR code presented by the user.

[2309] Device:

[2310] 1. Receives scan data from the scanner and sends an authentication request to the server.

[2311] server:

[2312] 1. Verify the data in the received QR code and perform authentication.

[2313] 2. If the authentication is successful, it sends an authentication success message to the station.

[2314] 3. If authentication fails, send an authentication failure message to the station.

[2315] scanner:

[2316] 1. Receive a success or failure message and perform the corresponding action (e.g., open the ticket gate, display an error).

[2317] Examples:

[2318] When a user passes through a train ticket barrier:

[2319] User: Present the QR code at the station ticket gate.

[2320] Scanner: Reads the QR code and sends the data to the server.

[2321] Server: Validates the contents of the QR code and sends a success message to open the ticket gate.

[2322] User: Pass through the ticket gate.

[2323] 3. Book and participate in recommended activities

[2324] server:

[2325] 1. Generate data that recommends appropriate activities based on the user's profile and past behavioral data.

[2326] 2. The generated recommended activity data is sent to the device.

[2327] Device:

[2328] 1. Show the user detailed information about the recommended activity they received.

[2329] User:

[2330] 1. Check the activity details and select the activity you want.

[2331] 2. Click the "Book" button to confirm your reservation.

[2332] Device:

[2333] 1. Send a reservation request to the server.

[2334] server:

[2335] 1. Receive the booking request and confirm with the activity organizer.

[2336] 2. If the booking is confirmed, generate the corresponding QR code.

[2337] 3. Send the generated QR code to the device.

[2338] Device:

[2339] 1. Display the generated QR code to the user.

[2340] User:

[2341] 1. Present the QR code at the activity venue.

[2342] Venue scanner:

[2343] 1. Scan the QR code and request authentication from the server.

[2344] server:

[2345] 1. Verify the data in the QR code and perform authentication.

[2346] 2. If authentication is successful, send a success message to the scanner at the venue.

[2347] Venue scanner:

[2348] 1. Receives a success message and allows the user to participate in the activity.

[2349] Examples:

[2350] When a user books an activity locally:

[2351] Server: Based on user data, it recommends things like museum visits and local cooking classes.

[2352] User: Selects and books a "Local Cooking Class" from the recommended activities.

[2353] Server: Confirms the reservation, generates a QR code and sends it to the device.

[2354] User: Present the QR code on-site to join the class.

[2355] 4. Use and payment at restaurants

[2356] server:

[2357] 1. Generate restaurant recommendation data based on the user's profile and location information.

[2358] 2. The generated recommendation data is sent to the device.

[2359] Device:

[2360] 1. Display the received restaurant recommendation information to the user.

[2361] User:

[2362] 1. Select a recommended restaurant and press the reservation button or visit the restaurant directly.

[2363] Device:

[2364] 1. Present the QR code when paying at a restaurant.

[2365] Restaurant terminals:

[2366] 1. Scan the QR code and send the data to the server for authentication.

[2367] server:

[2368] 1. Check the data in the received QR code and authenticate the payment.

[2369] 2. If authentication is successful, a success message is sent to the restaurant's terminal.

[2370] Restaurant terminals:

[2371] 1. A success message is received, informing the user that the payment has been completed.

[2372] Examples:

[2373] If the user is eating at a restaurant:

[2374] Server: Recommends nearby restaurants based on the user's location.

[2375] User: Selects a recommended restaurant and visits it.

[2376] Terminal: Present the QR code when making a payment.

[2377] Restaurant terminal: Scans the QR code and sends it to the server.

[2378] Server: Verify the payment and send a success message to the restaurant.

[2379] 5. Convenience of purchasing services

[2380] server:

[2381] 1. Generate recommended souvenirs and mementos based on the user's travel plans.

[2382] 2. The generated recommendation data is sent to the device.

[2383] Device:

[2384] 1. Display the received recommended item information to the user.

[2385] User:

[2386] 1. Check the recommended items and press the purchase button.

[2387] Device:

[2388] 1. Send the purchase request to the server and generate the corresponding QR code.

[2389] 2. Display the generated QR code to the user.

[2390] User:

[2391] 1. Present the QR code at the store to make a purchase.

[2392] Store Scanner:

[2393] 1. Scan the QR code and send it to the server for authentication.

[2394] server:

[2395] 1. Check the QR code data and perform authentication.

[2396] 2. If authentication is successful, send a success message to the store's scanner.

[2397] Store Scanner:

[2398] 1. Receive a success message and hand over the product to the user.

[2399] 6. Introducing the Emotion Engine

[2400] Device:

[2401] 1. An emotion engine is installed on the device, which collects emotional data by analyzing the user's facial expressions, voice, behavioral patterns, etc.

[2402] 2. Emotion data is sent to the server in real time.

[2403] server:

[2404] 1. Analyze the received emotion data and determine the user's emotional state.

[2405] 2. Dynamically optimize travel plans, recommended activities, and restaurant recommendations based on emotional state.

[2406] 3. Send the optimized information to the device.

[2407] Examples:

[2408] Update recommendations based on user sentiment changes:

[2409] Terminal: When the user shows a depressed expression, the emotion engine detects that emotion and sends the emotion data to the server.

[2410] Server: Analyzes the emotional data indicating depression and recommends new activities to lift your mood (e.g., a fun show or a relaxing spa).

[2411] Terminal: Notify the user of new recommended activities.

[2412] User: Review the recommended activities and decide to participate.

[2413] This concludes the description of the embodiment of the present invention. This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, and can also provide optimal experiences based on emotions through an emotion engine.

[2414] The processing flow will be explained below.

[2415] 1. Create a travel plan and generate a QR code

[2416] User:

[2417] Step 1: Open the app and go to the "Plan Your Trip" screen.

[2418] Step 2: Enter your travel details, including origin, destination, departure date, return date, transportation, accommodation, activities, and restaurants.

[2419] Step 3: Press the "Submit" button to confirm your travel plans.

[2420] Device:

[2421] Step 1: The travel plan data entered by the user is sent to the server.

[2422] Step 2: Wait for a response from the server.

[2423] server:

[2424] Step 1: Analyze the received travel planning data and organize the necessary data corresponding to transportation, activities, dining, and purchases.

[2425] Step 2: Generate an integrated QR code based on the organized data.

[2426] Step 3: Send the generated QR code to your device.

[2427] Device:

[2428] Step 1: Display the received QR code on the app screen.

[2429] User:

[2430] Step 4: Check the QR code displayed on the app screen and take it with you on your trip.

[2431] 2. QR code authentication at each station

[2432] User:

[2433] Step 1: Present your QR code at each station.

[2434] scanner:

[2435] Step 1: Read the QR code provided by the user.

[2436] Step 2: The data from the scanned QR code is sent to the server.

[2437] server:

[2438] Step 1: Verify the data in the received QR code.

[2439] Step 2: If the authentication is successful, send an authentication success message to the station.

[2440] Step 3: If the authentication fails, send an authentication failure message to the station.

[2441] scanner:

[2442] Step 1: Receive a success or failure message and perform the corresponding action (e.g., open the ticket gate, display an error).

[2443] 3. Book and participate in recommended activities

[2444] server:

[2445] Step 1: Generate data to recommend appropriate activities based on the user's profile and past behavioral data.

[2446] Step 2: Send the generated recommended activity data to the device.

[2447] Device:

[2448] Step 1: Display detailed information about the recommended activity received to the user.

[2449] User:

[2450] Step 1: Review the activity details and select the activity you want.

[2451] Step 2: Click the "Book" button to confirm your reservation.

[2452] Device:

[2453] Step 1: Send a reservation request to the server.

[2454] server:

[2455] Step 1: Receive the booking request and confirm with the activity organizer.

[2456] Step 2: If the booking is confirmed, generate the corresponding QR code.

[2457] Step 3: Send the generated QR code to your device.

[2458] Device:

[2459] Step 1: Display the generated QR code to the user.

[2460] User:

[2461] Step 1: Present the QR code at the activity venue.

[2462] Venue scanner:

[2463] Step 1: Scan the QR code and request authentication from the server.

[2464] server:

[2465] Step 1: Verify the data in the QR code and perform authentication.

[2466] Step 2: If authentication is successful, send a success message to the venue scanner.

[2467] Venue scanner:

[2468] Step 1: Receive a success message and allow the user to participate in the activity.

[2469] 4. Use and payment at restaurants

[2470] server:

[2471] Step 1: Generate restaurant recommendation data based on the user's profile and location information.

[2472] Step 2: The generated recommendation data is sent to the terminal.

[2473] Device:

[2474] Step 1: The received restaurant recommendation information is displayed to the user.

[2475] User:

[2476] Step 1: Select a recommended restaurant and press the reservation button or visit the restaurant in person.

[2477] Device:

[2478] Step 1: Present the QR code when paying at the restaurant.

[2479] Restaurant terminals:

[2480] Step 1: Scan the QR code and send the data to the server for authentication.

[2481] server:

[2482] Step 1: Check the data in the QR code you received and authenticate your payment.

[2483] Step 2: If the authentication is successful, a success message is sent to the restaurant terminal.

[2484] Restaurant terminals:

[2485] Step 1: Receive a success message to let the user know that the payment has been completed.

[2486] 5. Convenience of purchasing services

[2487] server:

[2488] Step 1: Generate data on recommended souvenirs and keepsakes based on the user's travel plans.

[2489] Step 2: Send the generated recommendation data to the device.

[2490] Device:

[2491] Step 1: Display the received recommended item information to the user.

[2492] User:

[2493] Step 1: Check out the recommended items and click the buy button.

[2494] Device:

[2495] Step 1: Send a purchase request to the server and generate a corresponding QR code.

[2496] Step 2: Display the generated QR code to the user.

[2497] User:

[2498] Step 1: Present the QR code at the store to make a purchase.

[2499] Store Scanner:

[2500] Step 1: Scan the QR code and send it to the server for authentication.

[2501] server:

[2502] Step 1: Check the QR code data and authenticate.

[2503] Step 2: If authentication is successful, send a success message to the store's scanner.

[2504] Store Scanner:

[2505] Step 1: Receive a success message and hand over the product to the user.

[2506] 6. Introducing the Emotion Engine

[2507] Device:

[2508] Step 1: An emotion engine is installed on the device, which collects emotion data by analyzing the user's facial expressions, voice, behavioral patterns, etc.

[2509] Step 2: Send emotion data to the server in real time.

[2510] server:

[2511] Step 1: Analyze the received emotion data and determine the user's emotional state.

[2512] Step 2: Dynamically optimize travel plans, recommended activities, and restaurants based on emotional states.

[2513] Step 3: Send the optimized information to the device.

[2514] Examples:

[2515] Update recommendations based on user sentiment changes:

[2516] Terminal: When the user shows a depressed expression, the emotion engine detects that emotion and sends the emotion data to the server.

[2517] Server: Analyzes the emotional data indicating depression and recommends new activities to lift your mood (e.g., a fun show or a relaxing spa).

[2518] Terminal: Notify the user of new recommended activities.

[2519] User: Review the recommended activities and decide to participate.

[2520] The above is the specific program processing flow of the present invention combined with the emotion engine. This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, and furthermore, the emotion engine can provide the optimal experience according to the user's emotions.

[2521] Example 2

[2522] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2523] In recent years, there has been a demand for travel planning and execution systems that can be customized to meet individual user needs. However, the process of users planning a trip is complex and time-consuming, so there is a need for a system that can easily and efficiently create a trip plan and centrally manage the information, authentication procedures, and on-site service usage required during the trip. Furthermore, there is a lack of a mechanism for optimizing trip plans and recommended activities based on the user's emotions and real-time situation. To solve these issues, a more advanced travel planning management system is needed.

[2524] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2525] In this invention, the server includes an interface means for a user to input a travel plan, a code generation means for generating QR codes corresponding to travel, experiences, dining, and purchases based on the user's travel plan, a transmission means for transmitting the codes to the user's communication device, an authentication means for authenticating the user when a reader at each station reads the codes, and an emotion analysis means for analyzing the user's emotion data and optimizing the travel plan in real time. This allows the user to easily create a travel plan, use services centrally during the trip, and enjoy a travel experience that is optimized in real time.

[2526] "User" means an individual who plans, manages and executes a trip through the System.

[2527] "Management device" refers to a collection of equipment and software for providing customized travel plans to users.

[2528] "Interface means" refers to a set of software and hardware that provides a user interface for a user to input travel plans.

[2529] "Code generation means" refers to a device and program that has the function of generating QR codes corresponding to travel, experiences, dining, and purchases based on the user's travel plans.

[2530] "Transmitting means" refers to the equipment and software for transmitting the generated code to the user's communication device.

[2531] "Authentication means" refers to a function that performs authentication when a reader at each station reads a code presented by a user.

[2532] "Emotion analysis means" refers to a device and program that has the function of analyzing the user's emotional data and optimizing travel plans in real time.

[2533] "Communication device" refers to a device such as a smartphone or tablet that a user uses to communicate with the system.

[2534] "Reading device" refers to a device that includes a scanner or camera for reading QR codes.

[2535] "Recommendation" refers to a feature that recommends local activities based on a user's profile and past behavioral data.

[2536] "Booking Method" refers to the functionality that accepts bookings for recommended activities and generates corresponding codes.

[2537] The "location information processing means" refers to a function that provides information on recommended restaurants based on the user's location information.

[2538] "Payment method" refers to the function of managing payments at restaurants.

[2539] This invention is a management system that provides users with customized travel plans, and aims to provide the best travel experience for each user by automating the process from users entering their travel plans, generating QR codes, and authenticating various services. Furthermore, by combining it with an emotion engine, it is possible to recognize user emotions and optimize travel plans in real time.

[2540] System configuration

[2541] server:

[2542] The server is the core of this system and plays the following roles:

[2543] Code generation method: Based on the travel plan data entered by the user, QR codes corresponding to transportation, activities, dining, and purchases are generated. Specifically, the QR codes are generated using the Python qrcode library.

[2544] Transmission means: The generated QR code is sent to the user's communication device as an HTTP response.

[2545] Authentication method: The QR code data sent from the reader at each station is verified and authentication is performed.

[2546] Emotion analysis means: Analyzes the received emotional data and determines the user's emotional state. This is done using a machine learning model (generative AI model).

[2547] Device:

[2548] The device is the user's smartphone or tablet and has the following functions:

[2549] Interface means: Provides a user interface for users to input travel plans. Specifically, this corresponds to a mobile application.

[2550] Communication means: The input travel plan data and emotion data are sent to the server, and a response is received from the server.

[2551] Display means: The QR code and recommended activities received from the server are displayed to the user.

[2552] Emotion engine: Analyzes the user's facial expressions, voice, and behavioral patterns to generate emotion data. Specifically, it uses the front camera and microphone and analyzes them using software libraries (e.g., OpenCV, Tensorflow).

[2553] User:

[2554] A user is an individual who uses this system and performs the following operations.

[2555] Travel Planning: Enter travel planning details using the mobile application.

[2556] Present your QR code: Present your QR code at each station during your trip.

[2557] Activity Booking: Book and participate in recommended activities.

[2558] Payment: Use QR codes to pay at restaurants and when making purchases.

[2559] Specific examples

[2560] A specific example of a user creating a travel plan and generating a QR code is as follows.

[2561] User: Enter details in the app such as "Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A."

[2562] Terminal: Sends this information to the server as an HTTP request.

[2563] Server: Generates a QR code based on the travel plan and sends it to the device as an HTTP response.

[2564] Device: Display the received QR code on the app screen.

[2565] User: Check the displayed QR code and take it with you on your trip.

[2566] Prompt Sentence Examples

[2567] "Open the travel plan creation screen and enter the following details: Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A. Press the submit button to confirm your travel plan."

[2568] This concludes the embodiment of the present invention. This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code. Furthermore, an emotion engine can be used to provide optimal experiences based on emotions.

[2569] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2570] Step 1:

[2571] User:

[2572] The user opens the app and navigates to the "Plan a Trip" screen by tapping the "Plan a Trip" button on the mobile application's home screen. As input, the user enters details of the origin, destination, departure date, return date, transportation, accommodation, activities, and food and drink. As output, this data is saved as internal data for the application.

[2573] Step 2:

[2574] Device:

[2575] When the user presses the "Submit" button, the device sends the entered travel plan data to the server as an HTTP POST request. Specifically, the device application organizes the travel plan data in JSON format and issues a request to the server's API endpoint. The input is the user's travel plan data, and the output is the JSON data sent to the server.

[2576] Step 3:

[2577] server:

[2578] The server parses the received travel plan data and retrieves data corresponding to transportation, activities, dining, and purchases from a database. It uses Python and SQL to execute database queries to extract the best options for each category selected by the user. The input is the JSON data of the travel plan, and the output is organized trip data.

[2579] Step 4:

[2580] server:

[2581] The server generates a QR code based on the organized travel data. Specifically, it uses the qrcode library to generate the QR code and create its image data. The input is the organized travel data, and the output is the QR code image data.

[2582] Step 5:

[2583] server:

[2584] The generated QR code is sent to the terminal as an HTTP response. The server includes the QR code image data in the body of the HTTP response and sends it to the terminal. The input is the QR code image data, and the output is an HTTP response containing the QR code.

[2585] Step 6:

[2586] Device:

[2587] The device displays the received QR code on the application screen. Specifically, it uses an image viewer component to display the QR code image. The input is the QR code image data from the server, and the output is the QR code displayed on the user's screen.

[2588] Step 7:

[2589] User:

[2590] During the trip, the user presents a QR code at each station by pointing the smartphone screen at the QR code reader and tapping it. The input is the user's QR code screen, and the output is the QR code data read by the scanner.

[2591] Step 8:

[2592] scanner:

[2593] The reader at each station reads the user's QR code and sends the data to the server in a specific format. Specifically, the QR code reader scans the QR code and sends the data to the server as an HTTP request. The input is the QR code data, and the output is the authentication request data sent to the server.

[2594] Step 9:

[2595] server:

[2596] The server verifies the received QR code data and performs authentication. It searches the database for the travel plan information associated with the QR code, and if there is a match, authentication is successful. The input is the QR code authentication request data, and the output is the authentication result (success or failure).

[2597] Step 10:

[2598] scanner:

[2599] The scanner receives the authentication result from the server and displays a success or failure message. For example, if successful, it performs an action such as opening a gate. The input is the authentication result message from the server, and the output is the corresponding physical action (e.g., opening or closing the gate) or a message display.

[2600] Step 11:

[2601] Device:

[2602] An emotion engine is installed on the device, which analyzes facial expressions, voice, and behavioral patterns to collect emotional data and transmits it to the server in real time. The input is the user's emotional data (facial expressions, voice, etc.), and the output is the emotional data sent to the server.

[2603] Step 12:

[2604] server:

[2605] The server analyzes the received emotional data to determine the user's emotional state, optimizing travel plans and recommended activities in real time. Specifically, it uses a machine learning algorithm to classify the emotional state and recalculate the optimal activities. The input is emotional data, and the output is optimized travel plans and activity recommendations.

[2606] Step 13:

[2607] Device:

[2608] The device notifies the user of the optimized information, specifically by displaying activity updates as push notifications or in-app messages. The input is the optimized information from the server, and the output is the updated information displayed on the user's screen.

[2609] The above is the specific processing flow of the program for this system. Users can receive consistent support from creating a travel plan, presenting a QR code, authentication, and real-time optimization according to their emotions.

[2610] (Application example 2)

[2611] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2612] While there have been systems that provide personalized travel plans, they lack the functionality to recommend optimal shopping experiences and activities in real time, taking into account the user's emotional state. Furthermore, there have been no systems that manage the purchasing experience in virtual stores and comprehensively support users' travel. This has made it difficult for users to enjoy comfortable and satisfying travel and shopping experiences in real time.

[2613] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes an interface means for a user to input a travel plan, a QR generation means for generating QR codes corresponding to travel, experiences, dining, and purchases based on the user's travel plan, a transmission means for transmitting the QR code to the user's terminal, an authentication means for authenticating the user when the QR code is read by a scanner at each station, and an emotion engine for recognizing the user's emotional state and providing an optimal shopping experience. This makes it possible to individually customize the user's travel plan and provide optimal recommendations based on the user's emotional state and a purchasing experience in a virtual store in real time.

[2614] "User" means an individual who plans a trip and manages and executes their travel and shopping experience through the System.

[2615] "Interface means" refers to input devices and software that allow a user to input travel and shopping plans.

[2616] "QR Generator" refers to hardware and software for generating a unique QR code based on a user's travel plans and purchasing information.

[2617] "Transmission means" refers to a communication device and software for transmitting the generated QR code to the user's terminal.

[2618] "Authentication means" refers to the hardware and software used to verify and authenticate the contents of a QR code when the scanner at each station reads it.

[2619] An "emotion engine" refers to algorithms and software that analyze a user's facial expressions, voice, behavioral patterns, etc. to recognize their emotional state and provide them with an optimal travel or shopping experience.

[2620] "Activity recommendation means" refers to software that recommends local activities based on a user's profile and past behavioral data.

[2621] "Booking Method" means the hardware and software used to accept reservations for Recommended Activities and generate corresponding QR Codes.

[2622] "Product recommendation means" refers to software that recommends optimal products to users based on emotional data.

[2623] "Location information processing means" refers to hardware and software for providing recommended restaurant information based on the user's current location.

[2624] "Payment Instrument" refers to payment devices and software used to manage payments at restaurants and virtual stores.

[2625] "Virtual purchasing tool" refers to software and hardware for managing purchasing activities in a virtual store and providing users with an optimal purchasing experience.

[2626] A specific system configuration and processing flow for an embodiment of the present invention will be described below: This system provides users with a customized travel plan and virtual shopping experience.

[2627] System configuration

[2628] server

[2629] The server is the core of the system and is responsible for the following functions:

[2630] 1. Booking Management: Receive and analyze the travel plan data entered by the user, organize the necessary data for transportation, activities, dining, and purchases, and generate an integrated QR code.

[2631] 2. Emotion engine analysis: Collect and analyze users' emotional data, and optimize travel plans, recommended activities, and shopping experiences based on their emotional state.

[2632] 3. Product Recommendation: Recommend the best products based on the user's profile data and sentiment data.

[2633] Terminal

[2634] The device is the user's smartphone or HMD (head-mounted display), and has the following features:

[2635] 1. Entering travel and shopping plans: The user enters travel and shopping plans through the app.

[2636] 2. Emotion engine: Analyzes the user's facial expressions, voice, and behavioral patterns in real time to collect emotional data.

[2637] 3. Display QR code: Display the integrated QR code received from the server on the app screen.

[2638] User

[2639] A user is an individual who plans and executes a trip through the system. A user performs the following actions:

[2640] 1. Create a travel plan: Open the app and enter your travel and shopping plans.

[2641] 2. Present your QR code: Present your QR code at each station during your trip for authentication.

[2642] 3. Providing Emotion Data: Provide your own emotion data through the emotion engine.

[2643] Specific example explanation

[2644] From creating travel plans to generating QR codes

[2645] 1. The user opens the "Plan Your Trip" screen in the app and enters details such as origin, destination, dates, activities, food and drink, and purchases.

[2646] 2. The terminal sends the input data to the server.

[2647] 3. The server analyzes the received data, generates an integrated QR code, and sends it to the device.

[2648] 4. The device will display the received QR code on the app screen.

[2649] 5. The user checks the QR code and takes it with them on their trip.

[2650] Emotional data analysis and activity recommendation

[2651] 1. The device activates the emotion engine and analyzes the user's facial expressions and voice data.

[2652] 2. The server analyzes the emotion data received in real time and determines the user's emotional state.

[2653] 3. The server generates recommended activities and product data based on the emotional state and sends them to the device.

[2654] 4. The device notifies the user of the received recommendation data.

[2655] 5. The user reviews the recommended activities and products and makes reservations or purchases as needed.

[2656] Prompt Sentence Examples

[2657] "Design a VR assistant application that allows users to input their shopping plans and recommends the best products through an emotion engine. This includes the ability to analyze profile data and real-time emotion data to optimize the shopping experience in the virtual store."

[2658] In this way, the present invention realizes a system that provides users with customized travel plans and shopping experiences based on their emotions. This system allows users to manage their comfortable and satisfying travel and shopping experiences with a single QR code and enjoy optimal services based on their emotions in real time.

[2659] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2660] Step 1:

[2661] The user opens the app and is taken to the "Plan a Trip" screen, where they enter their trip details, including origin, destination, departure date, return date, transportation options, hotels, activities, and restaurants.

[2662] Input: Details such as departure point, destination, itinerary, activities, food and drink, and purchases.

[2663] Output: Trip planning data.

[2664] Specific operation: The user enters their travel plans into the app and presses the "Submit" button.

[2665] Step 2:

[2666] The terminal receives the user's input data and sends it to the server.

[2667] Input: Travel planning data.

[2668] Output: Trip planning data sent to the server.

[2669] Specific operation: The terminal uses the data transmission module to transmit the travel plan data to the server.

[2670] Step 3:

[2671] The server analyzes the received travel plan data and organizes the necessary data corresponding to transportation, activities, food and drink, and purchases.

[2672] Input: Submitted travel planning data.

[2673] Output: Organized trip planning data.

[2674] Specific operation: The server uses a data analysis engine to analyze the travel plan data and organize the necessary data for each item.

[2675] Step 4:

[2676] The server generates an integrated QR code based on the organized data and sends it to the terminal.

[2677] Input: Organized travel planning data.

[2678] Output: The generated consolidated QR code.

[2679] Specific operation: The server uses the QR code generation module to generate an integrated QR code and sends it to the terminal.

[2680] Step 5:

[2681] The QR code received by the device will be displayed on the app screen.

[2682] Input: The generated integrated QR code.

[2683] Output: QR code displayed on the app screen.

[2684] Specific operation: The terminal uses the screen display module to display the QR code.

[2685] Step 6:

[2686] The user presents a QR code at each station during their journey.

[2687] Input: QR code displayed on the app screen.

[2688] Output: QR code scan request.

[2689] Specific operation: The user presents the QR code to the scanner when moving, experiencing, eating, drinking, or purchasing.

[2690] Step 7:

[2691] The scanner reads the QR code and sends an authentication request to the server.

[2692] Input: The presented QR code.

[2693] Output: The authentication request sent to the server.

[2694] Specific operation: The scanner reads the QR code and sends an authentication request to the server.

[2695] Step 8:

[2696] The server verifies the data in the QR code received and performs authentication.

[2697] Input: The received QR code data.

[2698] Output: Authentication result (success or failure).

[2699] Specific operation: The server verifies the contents of the QR code and sends the authentication result to the scanner.

[2700] Step 9:

[2701] Based on the authentication result, the scanner notifies the user of the authentication result.

[2702] Input: Authentication result.

[2703] Output: Notification of authentication success or failure.

[2704] Specific operation: If the scanner is successful, it performs a physical action (e.g., opens the ticket gate); if it fails, it displays an error message.

[2705] Step 10:

[2706] The device uses an emotion engine to analyze the user's facial expressions and voice, and transmits the emotion data to the server.

[2707] Input: User's real-time facial expressions and voice.

[2708] Output: User emotion data.

[2709] Specific operation: The device uses the emotion engine to collect data and sends that data to the server.

[2710] Step 11:

[2711] The server analyzes the user's emotional data and recommends optimal activities and products.

[2712] Input: User emotion data.

[2713] Output: Recommended activity and product data.

[2714] Specific operation: The server analyzes the emotional data, selects the most appropriate activities and products based on the user's emotional state, and sends the recommended data to the device.

[2715] Step 12:

[2716] The device notifies the user of detailed information about recommended activities and products received.

[2717] Input: Recommended activity or product data.

[2718] Output: A notification message to the user.

[2719] Specific operation: The device uses the screen display module to notify the user of recommended activities and products.

[2720] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2721] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2722] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2723] [Fourth embodiment]

[2724] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2725] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2726] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2727] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2728] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2729] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2730] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2731] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2732] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2733] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2734] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2735] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2736] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2737] This invention relates to a system including a management device that provides users with customized travel plans. This system automates a series of processes, from when a user inputs their travel plans, to when a QR code is generated, and to when various services are authenticated. A specific embodiment of this system will be described below.

[2738] System configuration

[2739] server:

[2740] The server is the core of the system and is responsible for QR code generation, data processing, authentication, recommendation functions, etc.

[2741] Device:

[2742] The terminal is the user's smartphone or tablet, and communicates with the server through an application.

[2743] User:

[2744] A User is an individual who plans a trip and manages and executes the trip through the system.

[2745] Program processing flow

[2746] 1. Create a travel plan and generate a QR code

[2747] User:

[2748] 1. The user opens the app and enters their travel plans, including details such as departure and return dates, destinations, transportation options, hotels, activities, and restaurants.

[2749] Device:

[2750] 1. The terminal generates a request to send the entered information to the server.

[2751] server:

[2752] 1. The server generates an integrated QR code corresponding to transportation, activities, dining, and purchases based on the received travel plan information.

[2753] 2. Send the generated QR code to your device.

[2754] Examples:

[2755] When a user completes a trip plan:

[2756] User: Enter details in the app such as "Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A."

[2757] Terminal: Sends this information to the server.

[2758] Server: Generates a QR code based on the travel plan and returns it to the device.

[2759] User: Check the QR code displayed on the app screen and take it with you on your trip.

[2760] 2. QR code authentication at each station

[2761] User:

[2762] 1. Users present their QR code at each station during their trip when moving, engaging in activities, eating, drinking, or purchasing.

[2763] scanner:

[2764] 1. Each station is equipped with a QR code scanner that reads the QR code presented by the user.

[2765] Device:

[2766] 1. Receives scan data from the scanner and sends an authentication request to the server.

[2767] server:

[2768] 1. The server verifies the data in the received QR code and performs authentication.

[2769] 2. If the authentication is successful, it sends an authentication success message to the station.

[2770] Examples:

[2771] When a user passes through a train ticket barrier:

[2772] User: Present the QR code at the station ticket gate.

[2773] Scanner: Reads the QR code and sends the data to the server.

[2774] Server: Validates the contents of the QR code and sends a success message to open the ticket gate.

[2775] User: Pass through the ticket gate.

[2776] 3. Book and participate in recommended activities

[2777] server:

[2778] 1. Recommend appropriate activities based on the user's profile and past behavioral data.

[2779] 2. Send detailed information about the recommended activity to the device.

[2780] User:

[2781] 1. The user checks the activity details, selects the one they want, and makes a reservation.

[2782] Device:

[2783] 1. Send a reservation request to the server.

[2784] server:

[2785] 1. Confirm your reservation and generate a corresponding QR code to send to your device.

[2786] Examples:

[2787] When a user books an activity locally:

[2788] Server: Based on user data, it recommends things like museum visits and local cooking classes.

[2789] User: Selects and books a "Local Cooking Class" from the recommended activities.

[2790] Server: Confirms the reservation, generates a QR code and sends it to the device.

[2791] User: Present the QR code on-site to join the class.

[2792] 4. Use and payment at restaurants

[2793] server:

[2794] 1. Based on the user's location information, recommended restaurants are selected and the information is sent to the device.

[2795] User:

[2796] 1. Choose a recommended restaurant and make a reservation or visit in person.

[2797] Device:

[2798] 1. Present the QR code when paying at a restaurant.

[2799] Restaurant terminals:

[2800] 1. Scan the QR code and send the data to the server for authentication.

[2801] server:

[2802] 1. If authentication is successful, the payment is completed.

[2803] Examples:

[2804] If the user is eating at a restaurant:

[2805] Server: Recommends nearby restaurants based on the user's location.

[2806] User: Selects a recommended restaurant and visits it.

[2807] Terminal: Present the QR code when making a payment.

[2808] Restaurant terminal: Scans the QR code and sends it to the server.

[2809] Server: Verify the payment and send a success message to the restaurant.

[2810] 5. Convenience of purchasing services

[2811] server:

[2812] 1. Providing recommended souvenirs and keepsakes based on the user's travel plans.

[2813] User:

[2814] 1. Review the recommended items and make your purchase decision.

[2815] Device:

[2816] 1. Press the purchase button to generate a QR code and display the purchase completion screen.

[2817] Store Scanner:

[2818] 1. Scan the QR code and request authentication from the server.

[2819] server:

[2820] 1. Authenticate and send a success message.

[2821] Examples:

[2822] When a user shops at a souvenir shop:

[2823] Server: Based on the user's travel plans, sends recommended souvenir information to the terminal.

[2824] User: Selects a recommended souvenir and presses the purchase button.

[2825] Device: Display the generated QR code.

[2826] Store scanner: Scans the QR code and requests authentication from the server.

[2827] Server: Authenticates and sends a success message.

[2828] This concludes the embodiment of the present invention. This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, greatly improving the travel experience.

[2829] The processing flow will be explained below.

[2830] 1. Create a travel plan and generate a QR code

[2831] User:

[2832] Step 1: Open the app and go to the "Plan Your Trip" screen.

[2833] Step 2: Enter your travel details, including origin, destination, departure date, return date, transportation options, hotels, activities, and restaurants.

[2834] Step 3: Press the "Submit" button to confirm your travel plans.

[2835] Device:

[2836] Step 1: The travel plan data entered by the user is sent to the server.

[2837] Step 2: Wait for a response from the server.

[2838] server:

[2839] Step 1: Analyze the received travel planning data and organize the necessary data corresponding to transportation, activities, dining, and purchases.

[2840] Step 2: Generate an integrated QR code based on the organized data.

[2841] Step 3: Send the generated QR code to your device.

[2842] Device:

[2843] Step 1: Display the received QR code on the app screen.

[2844] User:

[2845] Step 4: Check the QR code displayed on the app screen and take it with you on your trip.

[2846] 2. QR code authentication at each station

[2847] User:

[2848] Step 1: Present your QR code at each station.

[2849] scanner:

[2850] Step 1: Read the QR code provided by the user.

[2851] Step 2: The data from the scanned QR code is sent to the server.

[2852] Device:

[2853] Step 1: Receive scan data from the scanner and send an authentication request to the server.

[2854] server:

[2855] Step 1: Verify the data in the received QR code.

[2856] Step 2: If the authentication is successful, send an authentication success message to the station.

[2857] Step 3: If the authentication fails, send an authentication failure message to the station.

[2858] scanner:

[2859] Step 1: Receive a success or failure message and perform the corresponding action (e.g., open the ticket gate, display an error).

[2860] 3. Book and participate in recommended activities

[2861] server:

[2862] Step 1: Generate data to recommend appropriate activities based on the user's profile and past behavioral data.

[2863] Step 2: Send the generated recommended activity data to the device.

[2864] Device:

[2865] Step 1: Display detailed information about the recommended activity received to the user.

[2866] User:

[2867] Step 1: Review the activity details and select the activity you want.

[2868] Step 2: Click the "Book" button to confirm your reservation.

[2869] Device:

[2870] Step 1: Send a reservation request to the server.

[2871] server:

[2872] Step 1: Receive the booking request and confirm with the activity organizer.

[2873] Step 2: If the booking is confirmed, generate the corresponding QR code.

[2874] Step 3: Send the generated QR code to your device.

[2875] Device:

[2876] Step 1: Display the generated QR code to the user.

[2877] User:

[2878] Step 1: Present the QR code at the activity venue.

[2879] Venue scanner:

[2880] Step 1: Scan the QR code and request authentication from the server.

[2881] server:

[2882] Step 1: Verify the data in the QR code and perform authentication.

[2883] Step 2: If authentication is successful, send a success message to the venue scanner.

[2884] Venue scanner:

[2885] Step 1: Receive a success message and allow the user to participate in the activity.

[2886] 4. Use and payment at restaurants

[2887] server:

[2888] Step 1: Generate restaurant recommendation data based on the user's profile and location information.

[2889] Step 2: The generated recommendation data is sent to the terminal.

[2890] Device:

[2891] Step 1: The received restaurant recommendation information is displayed to the user.

[2892] User:

[2893] Step 1: Select a recommended restaurant and press the reservation button or visit the restaurant in person.

[2894] Device:

[2895] Step 1: Present the QR code when paying at the restaurant.

[2896] Restaurant terminals:

[2897] Step 1: Scan the QR code and send the data to the server for authentication.

[2898] server:

[2899] Step 1: Check the data in the QR code you received and authenticate your payment.

[2900] Step 2: If the authentication is successful, a success message is sent to the restaurant terminal.

[2901] Restaurant terminals:

[2902] Step 1: Receive a success message to let the user know that the payment has been completed.

[2903] 5. Convenience of purchasing services

[2904] server:

[2905] Step 1: Generate data on recommended souvenirs and keepsakes based on the user's travel plans.

[2906] Step 2: Send the generated recommendation data to the device.

[2907] Device:

[2908] Step 1: Display the received recommended item information to the user.

[2909] User:

[2910] Step 1: Check out the recommended items and click the buy button.

[2911] Device:

[2912] Step 1: Send a purchase request to the server and generate a corresponding QR code.

[2913] Step 2: Display the generated QR code to the user.

[2914] User:

[2915] Step 1: Present the QR code at the store to make a purchase.

[2916] Store Scanner:

[2917] Step 1: Scan the QR code and send it to the server for authentication.

[2918] server:

[2919] Step 1: Check the QR code data and authenticate.

[2920] Step 2: If authentication is successful, send a success message to the store's scanner.

[2921] Store Scanner:

[2922] Step 1: Receive a success message and hand over the product to the user.

[2923] This is the specific program processing flow of the present invention. This system allows users to manage the entire travel experience, including creating a travel plan, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all on a single platform.

[2924] Example 1

[2925] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2926] In conventional travel planning management systems, users must individually book and manage transportation, accommodations, activities, food and beverages, and purchases, which places a significant burden on the user's time and effort. Furthermore, the need to manage tickets and reservation information separately complicates the overall travel experience. For this reason, there is a strong demand for a system that allows users to easily and smoothly manage their entire trip and access multiple services with a single QR code.

[2927] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2928] In this invention, the server includes an interface means for a user to input a travel plan, a QR generation means for generating QR codes corresponding to travel, experiences, dining, and purchases based on the user's travel plan, a transmission means for transmitting the QR code to the user's terminal, an authentication means for authenticating the QR code when a scanner at each station reads it, and a station management means for controlling access to stations based on the authentication. This allows the user to manage their entire trip using a single QR code and easily use a variety of services.

[2929] "User" means an individual who plans, manages and executes a trip through the System.

[2930] A "management device" is a device for providing a customized travel plan to a user.

[2931] An "interface means" is a means by which a user inputs travel plans, typically in the form of an application or web interface.

[2932] The "QR generation means" is a means for generating QR codes corresponding to travel, experiences, eating and drinking, and purchases based on the user's travel plans.

[2933] The "transmission means" is a means for transmitting the generated QR code to the user's terminal.

[2934] The "authentication means" is a means for performing authentication when the QR code is read by a scanner at each station.

[2935] The "station management means" is a means for controlling access of stations based on the authentication.

[2936] The "activity recommendation means" is a means for recommending local activities based on the user's profile and past behavioral data.

[2937] The "reservation means" is a means for accepting reservations for recommended activities and generating a corresponding QR code.

[2938] The "location information processing means" is a means for providing information on recommended restaurants based on the user's location information.

[2939] "Payment method" refers to a method for managing payments at restaurants.

[2940] "Purchase authentication means" is a means of authenticating a purchase by scanning a QR code presented by the user.

[2941] This invention relates to a system including a management device that provides users with customized travel plans. This system automates a series of processes, from when a user inputs their travel plans, to when a QR code is generated, and to when various services are authenticated. A specific embodiment of this system will be described below.

[2942] System configuration

[2943] server:

[2944] The server is the core of the system and is responsible for QR code generation, data processing, authentication, and recommendation functions.

[2945] The server performs multiple functions, including analyzing travel plans, generating QR codes, recording user behavior data, managing profiles, and processing location information.

[2946] The technologies used include QR code generation libraries (e.g., qrcode, pyqrcode) and database management systems (e.g., MySQL, PostgreSQL).

[2947] Device:

[2948] The terminal is the user's smartphone or tablet, and communicates with the server through an application.

[2949] The application provides a travel planning input interface, a QR code display screen, notification functions, and location information services.

[2950] User:

[2951] A User is an individual who plans a trip and manages and executes the trip through the system.

[2952] What the program does

[2953] Create a travel plan and generate a QR code

[2954] Users open the app and enter their travel plans, including details such as departure and return dates, destinations to visit, transportation options, hotels, activities, and restaurants.

[2955] The terminal generates a request to send the input information to the server.

[2956] The server generates an integrated QR code corresponding to transportation, activities, dining, and purchases based on the received travel plan information, and sends the generated QR code to the terminal.

[2957] Specific examples

[2958] When a user completes a trip plan:

[2959] Users enter details into the app such as "Departure: Tokyo, Destination: Osaka, Day trip, Activity: Sightseeing, Dining: Restaurant A."

[2960] The terminal transmits this information to the server.

[2961] The server generates a QR code based on the travel plan and returns it to the device.

[2962] Users check the QR code displayed on the app screen and take it with them on their trip.

[2963] QR code authentication at each station

[2964] Users present their QR code at each station during their trip when traveling, engaging in activities, eating and drinking, or making purchases.

[2965] Each station is equipped with a scanner that reads QR codes, and reads the QR code presented by the user.

[2966] After receiving the scan data, the scanner sends an authentication request to the server.

[2967] The server verifies the received QR code data and performs authentication. If authentication is successful, it sends an authentication success message to the station.

[2968] Specific examples

[2969] When a user passes through a train ticket barrier:

[2970] The user presents the QR code at the station ticket gate.

[2971] The scanner reads the QR code and sends the data to the server.

[2972] The server verifies the contents of the QR code and sends a success message to open the ticket gate.

[2973] The user passes through the ticket gate.

[2974] Book and participate in recommended activities

[2975] Based on the user's profile and past behavioral data, the server recommends appropriate activities.

[2976] Detailed information about the recommended activity is sent to the device.

[2977] Users can check the details of the activities, select the ones they want, and make a reservation.

[2978] Send a reservation request to the server.

[2979] The server confirms the reservation and generates a corresponding QR code that is sent to the device.

[2980] Specific examples

[2981] When a user books an activity locally:

[2982] Based on user data, the server recommends things like museum visits or local cooking classes.

[2983] The user selects and books a "local cooking class" from the recommended activities.

[2984] The server confirms the reservation, generates a QR code and sends it to the device.

[2985] Users present the QR code on-site to join the class.

[2986] Use and payment at restaurants

[2987] The server selects recommended restaurants based on the user's location information and sends the information to the terminal.

[2988] The user selects a recommended restaurant and makes a reservation or visits the restaurant in person.

[2989] Present the QR code when making payment.

[2990] The QR code is scanned and the data is sent to the server for authentication.

[2991] If the authentication is successful, the payment is completed.

[2992] Specific examples

[2993] If the user is eating at a restaurant:

[2994] The server recommends nearby restaurants based on the user's location.

[2995] The user selects a recommended restaurant and visits it.

[2996] Present the QR code when making payment.

[2997] Scan the QR code and send it to the server.

[2998] Verify the payment and send a success message to the restaurant.

[2999] Convenience of purchasing services

[3000] The server presents recommended souvenirs and mementos based on the user's travel plans.

[3001] The user reviews the recommended items and decides to purchase them.

[3002] Press the purchase button to generate a QR code and display the purchase completion screen.

[3003] Scan the QR code and request authentication from the server.

[3004] Authenticate and send a success message.

[3005] Specific examples

[3006] When a user shops at a souvenir shop:

[3007] The server transmits recommended souvenir information to the terminal based on the user's travel plans.

[3008] The user selects a recommended souvenir and presses the purchase button.

[3009] Display the generated QR code.

[3010] Scan the QR code and request authentication from the server.

[3011] Authenticate and send a success message.

[3012] This system allows users to manage all services, such as creating travel plans, authenticating at each station, participating in activities, eating at restaurants, and purchasing souvenirs, all with a single QR code, greatly improving the travel experience.

[3013] The flow of the identification process in the first embodiment will be described with reference to FIG.

[3014] Step 1:

[3015] User enters travel plans.

[3016] Input: Travel plan details from the user (departure date, return date, destinations, transportation options, hotels, activities, restaurants, etc.).

[3017] Data processing: The user launches the application on their smartphone and inputs their travel plans. The application encodes the input data into JSON format.

[3018] Output: JSON data containing the user's travel plan information.

[3019] Step 2:

[3020] The device sends a request to the server.

[3021] Input: Travel planning information (JSON data) entered by the user in the app.

[3022] Data processing: The device generates a POST request to the API endpoint and sends the travel plan information to the server.

[3023] Output: The HTTP POST request sent to the server.

[3024] Step 3:

[3025] The server analyzes the travel plan and generates a QR code.

[3026] Input: Travel planning information sent from the device.

[3027] Data processing: The server parses the received JSON data and checks the database for each item in the travel plan (transportation, activities, food and drink, and purchases). It checks the necessary recommendations and reservation status and generates an integrated QR code. The QR code is generated using the qrcode library.

[3028] Output: Generated QR code data (image URL).

[3029] Step 4:

[3030] The server sends a QR code to the device.

[3031] Input: Generated QR code data (image URL).

[3032] Data processing: The server encodes the QR code data as a response and sends it to the terminal as an HTTP response.

[3033] Output: The QR code data sent to the device.

[3034] ...

Claims

1. 1. A management device for providing a customized travel plan to a user, comprising: an interface means for a user to input a travel plan; A QR code generating means for generating QR codes corresponding to travel, experiences, dining, and purchases based on the user's travel plan; A transmitting means for transmitting the QR code to a user's terminal; an authentication means for performing authentication when the QR code is read by a scanner at each station; A system including:

2. an activity recommendation means for recommending local activities based on a user's profile and past behavioral data; a reservation means for accepting reservations for the recommended activity and generating a corresponding QR code; 10. The system of claim 1, further comprising:

3. a location information processing means for providing recommended restaurant information based on the user's location information; a payment means for managing payments at the restaurant; 10. The system of claim 1, further comprising:

Images