system

Abstract

We provide the system. [Solution] A means for detecting available parking spaces using various sensors, A means of obtaining the current location information from the user's device, A method for guiding users to the nearest available space based on available space information and current location information, A means of securing the designated vacant space in advance, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In modern urban life, there is a demand for checking and securing available parking spaces, providing optimal route guidance for stores in commercial facilities, and even having an efficient online shopping experience. However, it is difficult for conventional systems to provide these functions integrally, and since each function is independent, convenience and efficiency are lacking for users. Therefore, there is a need to develop a system that integrally provides real-time checking and reservation of available parking spaces, store guidance within facilities, and online VR customer service and sales.

Means for Solving the Problems

[0005] This invention is a system that includes means for detecting available parking spaces using various sensors, means for acquiring current location information from a user's terminal, means for guiding the user to the nearest available space based on the available space information and current location information, and means for reserving a designated available space in advance. Furthermore, it includes means for managing store location information and floor map information within a shopping facility, means for receiving destination information entered from a user's terminal, means for generating an optimal route based on the destination information and current location information, and means for transmitting the generated route information to the user's terminal. In addition, by including means for acquiring inventory information for each store in real time, means for displaying a virtual space of the store based on input from a user's terminal, means for receiving product selections within the virtual space, and means for performing the purchase procedure for the selected products, this invention proposes a system that can provide a unified and efficient service to the user.

[0006] A "sensor" is a device that acquires specific information from the physical environment, and includes, for example, cameras and ultrasonic sensors.

[0007] A "parking lot" refers to a structure or area with multiple available spaces where automobiles can be temporarily parked.

[0008] "Available space" refers to an area where no vehicles are currently parked and where parking is possible.

[0009] A "device" is a device used by users to input or receive information, and includes smartphones and tablets.

[0010] "Current location information" refers to data about the geographical location of a device, obtained using the device's GPS function or similar methods.

[0011] "To guide" refers to the act of showing a user the route or method to reach their destination.

[0012] "Securing in advance" refers to the act of reserving a specific available space so that other users cannot use it.

[0013] "Store location information" refers to information about the specific location and floor of each store within a commercial facility.

[0014] A "floor map" refers to a map that shows the layout and structure of each floor of a commercial facility.

[0015] "Route information" refers to data that includes information about the optimal route from the starting point to the destination.

[0016] "Inventory information" refers to real-time data regarding the number and types of products currently available for sale at each store.

[0017] "Virtual space" refers to a virtual three-dimensional space created by a computer, providing an environment that users can interact with.

[0018] "Product selection" refers to the act of a user choosing a product they wish to purchase from a virtual or physical shop.

[0019] "Purchase process" refers to the series of steps involved in payment and delivery procedures for selected products. [Brief explanation of the drawing]

[0020] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of the data processing device and smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5]It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Embodiments for Carrying Out the Invention

[0021] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0022] First, the terms used in the following description will be explained.

[0023] In the following embodiments, the signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU (Central Processing Unit), GPU (Graphics Processing Unit), GPGPU (General-Purpose computing on Graphics Processing Units), and APU (Accelerated Processing Unit).

[0024] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0025] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0026] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0027] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0028] [First Embodiment]

[0029] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0030] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0031] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0032] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0033] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0034] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0035] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0036] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0037] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0038] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0039] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0040] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0041] This invention includes a system that uses various sensors to detect available parking spaces, guides users to the most suitable available space based on their current location, and reserves that space in advance; a system that guides users to the optimal route to a destination store within a shopping facility; and a system that allows users to select and purchase products using the virtual space of each store. The details and specific examples of the overall system's program processing are described below.

[0042] (1) Guiding and securing parking spaces in advance

[0043] Explanation of program processing

[0044] 1. The server acquires real-time data from various sensors in the parking lot (e.g., cameras and ultrasonic sensors). This allows the server to understand the current status of available parking spaces.

[0045] 2. The device obtains the user's current location information using GPS and sends it to the server.

[0046] 3. The server identifies the nearest available parking space based on information about available spaces in the parking lot and the user's current location.

[0047] 4. The terminal navigates the user in real time based on the location information of available spaces received from the server.

[0048] 5. The user taps the "Reserve" button on the app to reserve an available space in advance.

[0049] 6. The server receives the user's reservation information and sets the available space to a reserved state.

[0050] 7. The device displays a notification to the user that the reservation is complete.

[0051] Specific example

[0052] The server collects real-time data on available parking spaces for 150 cars and creates a list of available spaces.

[0053] The user opens a parking search page using a mobile app and finds the nearest available space from their current location.

[0054] The server obtains the user's current location from GPS data and presents the nearest available space (e.g., space number 35) from the list of available spaces.

[0055] The terminal will show the user the optimal route and guide them to space number 35 using voice guidance.

[0056] The user taps "Reserve Space 35" to reserve the space in advance.

[0057] The server checks the reservation information and updates it so that space 35 is not displayed to other users.

[0058] The device displays a reservation completion notification to the user.

[0059] (2) Guiding customers to the optimal store layout

[0060] Explanation of program processing

[0061] 1. The server manages the location information and floor maps of all stores within the shopping facility and stores them in a database.

[0062] 2. The user enters the store they want to visit using the terminal app.

[0063] 3. The device obtains the user's current location information via GPS and sends it to the server.

[0064] 4. The server calculates the optimal route based on the current location and destination information, and sends that route information to the terminal.

[0065] 5. The device displays the optimal route in map format and provides real-time guidance to the user.

[0066] Specific example

[0067] The user launches the smartphone app at the entrance of the shopping mall and searches for "XYZ Shop".

[0068] The server consults the floor map and confirms that the XYZ shop is located at the far end of the third floor.

[0069] The device obtains its current location information and requests the server to provide the shortest route, taking into account the location of the escalator.

[0070] The server calculates the route and generates directions such as, "Take the escalator up to the 3rd floor and turn right."

[0071] The device displays route information as a map and navigates the user.

[0072] (3) VR customer service and sales at each store

[0073] Explanation of program processing

[0074] 1. The server retrieves real-time inventory information from each store and updates the database.

[0075] 2. The user uses a mobile app to select the store where they would like to receive VR customer service.

[0076] 3. The device sends a request to the server to start the VR customer service session.

[0077] 4. The server sends access information to the virtual shop to the terminal and begins generating the VR space.

[0078] 5. Users interactively select products within the VR space and add them to their cart.

[0079] 6. The server receives the user's selection information and checks the inventory status in real time.

[0080] 7. The device displays purchasable items to the user and allows them to proceed with the purchase.

[0081] 8. The user taps the purchase button, and the payment process is completed.

[0082] 9. The server receives payment completion information and begins the process of shipping the goods.

[0083] Specific example

[0084] The server receives the latest inventory data from electronics parts store B and updates product information such as "resistor set".

[0085] The user launches a smartphone app and begins a VR customer service experience at electronics parts store B.

[0086] The server generates a VR customer service session and sends virtual shop access information to the user's device.

[0087] The terminal displays a realistic virtual shop, and the user selects a "resistor set" from the virtual shelf.

[0088] The server checks the inventory status and confirms that the selected product is available for purchase.

[0089] The user taps the "Purchase" button and completes the payment process on their device.

[0090] The server receives notification that payment has been completed and begins the process of shipping the goods.

[0091] Thus, the present invention makes it possible to realize a system that provides an integrated service including guidance on available parking spaces, store guidance within commercial facilities, and an online shopping experience for each store.

[0092] The following describes the processing flow.

[0093] (1) Guiding and securing parking spaces in advance

[0094] Specific steps in program processing

[0095] Step 1:

[0096] The server acquires data from various sensors in the parking lot (cameras, ultrasonic sensors, etc.) and determines whether or not there are available parking spaces.

[0097] Step 2:

[0098] The device obtains the user's current location information using GPS and sends that information to the server.

[0099] Step 3:

[0100] The server integrates information about available space with the user's current location to identify the nearest available space.

[0101] Step 4:

[0102] The server sends location information of the available space it has identified to the terminal.

[0103] Step 5:

[0104] Based on the location information received by the device, navigation information to an available space is displayed to the user.

[0105] Step 6:

[0106] The user follows the navigation in the app and heads to the designated empty space.

[0107] Step 7:

[0108] The user taps the "Reserve" button to send a request from their device to reserve an available space in advance.

[0109] Step 8:

[0110] The server receives the reservation request and changes the specified available space to a reserved state.

[0111] Step 9:

[0112] The server sends a reservation confirmation to the device.

[0113] Step 10:

[0114] The device displays a confirmation to the user that the reservation is complete.

[0115] (2) Guiding customers to the optimal store layout

[0116] Specific steps in program processing

[0117] Step 1:

[0118] The server manages and updates location information and floor map data for all stores within the shopping complex.

[0119] Step 2:

[0120] The user opens the app and enters the name of the store they want to visit.

[0121] Step 3:

[0122] The terminal sends the entered store name to the server.

[0123] Step 4:

[0124] The server searches for the location information of the relevant store and calculates the optimal route from the current location.

[0125] Step 5:

[0126] The device uses GPS to obtain its current location information, which is then sent to the server.

[0127] Step 6:

[0128] The server calculates the most suitable route for the user based on their current location and the location of the store, and sends that information to their device.

[0129] Step 7:

[0130] The terminal displays the route information it has received as a map and begins providing route guidance to the user.

[0131] Step 8:

[0132] The user follows the map directions on their device to reach their destination store.

[0133] (3) VR customer service and sales at each store

[0134] Specific steps in program processing

[0135] Step 1:

[0136] The server collects real-time inventory information from each store and updates the database.

[0137] Step 2:

[0138] The user selects the store where they want to receive VR customer service via a mobile app and starts the session.

[0139] Step 3:

[0140] The device sends a session start request to the server, specifying the selected store.

[0141] Step 4:

[0142] The server generates access information for the virtual shop and sends it to the terminal.

[0143] Step 5:

[0144] The device displays the entrance to the virtual shop to the user and prompts them to access it.

[0145] Step 6:

[0146] When a user enters a virtual shop, they can freely explore the VR space and select products.

[0147] Step 7:

[0148] The device sends information about the product selected by the user to the server.

[0149] Step 8:

[0150] The server checks the inventory information of the selected product and sends a list of available products to the terminal.

[0151] Step 9:

[0152] The device displays a list of purchasable items to the user and shows a screen to begin the purchase process.

[0153] Step 10:

[0154] The user selects the product they want to purchase and taps the "Purchase" button.

[0155] Step 11:

[0156] The device sends the purchase request and payment information to the server.

[0157] Step 12:

[0158] The server completes the payment process and notifies the terminal of the result.

[0159] Step 13:

[0160] The device displays a notification to the user that the payment has been completed.

[0161] This clarifies how each processing step of the system is performed, allowing users to efficiently enjoy parking reservations, store directions, and online shopping experiences.

[0162] (Example 1)

[0163] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0164] Currently, many parking lots present challenges such as difficulty in confirming and securing available parking spaces, resulting in wasted time and effort for users. Furthermore, the time required for navigating stores within shopping facilities and selecting products within each store hinders efficient shopping. Additionally, online shopping presents problems such as low user satisfaction due to the difficulty in checking inventory in real time and selecting products virtually.

[0165] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0166] In this invention, the server includes means for detecting available parking spaces using various sensors, means for acquiring current location information from the user's terminal, means for guiding the user to the nearest available space based on the available space information and current location information, means for reserving a designated available space in advance, means for the server to collect available space information in real time and store it in a database, means for the terminal to acquire the user's current location using GPS and transmit it to the server, means for the server to identify the optimal available space based on the available space information and the user's current location information, and means for the terminal to navigate the user in real time based on the location information of the available space received from the server. This not only enables efficient confirmation and reservation of available parking spaces but also reduces the effort and time required from the user. Furthermore, by including means for managing store location information and floor map information within the shopping facility, and means for receiving destination information entered from the user's terminal, generating the optimal route based on the destination information and current location information, and transmitting the generated route information to the user terminal, store guidance within the shopping facility can be facilitated smoothly. Furthermore, by including means for obtaining inventory information from each store in real time, displaying a virtual store space based on input from the user's terminal, receiving product selections within the virtual space, and processing purchases of selected products, users can select and purchase products online in real time.

[0167] A "sensor" is a device that detects physical or chemical phenomena and converts them into electrical signals.

[0168] A "parking lot" is a space or facility for temporarily parking vehicles.

[0169] "Available space" refers to unused parking spaces where vehicles can be parked.

[0170] A "device" refers to an electronic device used by a user, specifically a smartphone or tablet.

[0171] "Current location information" refers to data that indicates the current geographical location of the user or device.

[0172] A "server" is a computer system that provides services to client terminals over a network.

[0173] A "database" is a system that structures and stores large amounts of data, enabling efficient searching and manipulation.

[0174] GPS is a global positioning system used to obtain location information on Earth.

[0175] An "optimal route" is the route that minimizes both distance and time from the starting point to the destination.

[0176] "Navigate" means to guide someone on a route to their destination.

[0177] A "shopping facility" is a commercial complex that houses a large number of stores.

[0178] "Store location information" refers to data that shows where each store is located within a shopping facility.

[0179] A "floor map" is a map that shows the layout of each floor in a shopping facility.

[0180] A "virtual space" is a virtual reality space created using computer graphics.

[0181] "Inventory information" refers to data that shows the availability status of a product.

[0182] "Purchase procedure" refers to a series of operations or procedures necessary to purchase a product.

[0183] The present invention includes a system for detecting available parking spaces, guiding users to the most suitable available space based on their current location, and reserving that space in advance; a system for guiding users to the optimal route to a destination store within a shopping facility; and a system for selecting and purchasing products using the virtual space of each store. Specific embodiments of each system are shown below.

[0184] Guiding and securing parking spaces in advance

[0185] The server acquires real-time data from various sensors in the parking lot (e.g., cameras and ultrasonic sensors). Cameras use image recognition technology to detect the availability of each parking space, and ultrasonic sensors detect available spaces based on distance data. This data is sent to the server and stored in a database.

[0186] The device obtains the user's current location information using GPS and sends that information to the server. To provide highly accurate location information, the GPS function also utilizes Wi-Fi and mobile network information.

[0187] The server identifies the nearest available parking space based on information about available spaces in the parking lot and the user's current location. This is calculated using algorithms such as Dijkstra's algorithm.

[0188] The system navigates the user in real time based on location information of available spaces received by the terminal from the server. Navigation is provided via map display and voice guidance. This allows the user to intuitively understand the optimal route.

[0189] The user checks the available space on the mobile app and taps the "Reserve" button. This action sends a reservation request to the server.

[0190] The server receives the user's reservation request and updates the available space to a reserved status. The reservation information is immediately saved to the database and reflected in other terminals in real time.

[0191] The device displays a reservation confirmation notification to the user. The notification includes detailed information about the reserved space.

[0192] Specific example

[0193] The server collects real-time data on available parking spaces for 150 cars and creates a list of available spaces.

[0194] The user opens a parking search page using a mobile app and finds the nearest available space from their current location.

[0195] The server obtains the user's current location from GPS data and presents the nearest available space (e.g., space number 35) from the list of available spaces.

[0196] The terminal will show the user the optimal route and guide them to space number 35 using voice guidance.

[0197] The user taps "Reserve Space 35" to reserve the space in advance.

[0198] The server checks the reservation information and updates it so that space 35 is not displayed to other users.

[0199] The device displays a reservation completion notification to the user.

[0200] Guidance to the optimal store flow

[0201] The server manages the location information and floor maps of all stores within the shopping complex and stores them in a database. This includes the name of each store, its location on the floor, and the distance between stores.

[0202] The user enters the name of the store they want to visit using a terminal app, the terminal obtains the user's current location using GPS, and sends that information to the server. To provide highly accurate location information, the terminal also uses location information from Wi-Fi and mobile networks.

[0203] The server calculates the optimal route based on the user's current location and destination. It also considers the location of escalators and elevators, using algorithms such as Dijkstra's to determine the most efficient route for the user to reach their destination.

[0204] The device displays the optimal route information received from the server in map format. It provides real-time navigation, ensuring the user reaches their destination without getting lost.

[0205] Specific example

[0206] The user launches the smartphone app at the entrance of the shopping mall and searches for "XYZ Shop".

[0207] The server consults the floor map and confirms that the XYZ Shop is located on the 3rd floor.

[0208] The device obtains its current location information and requests the server to calculate the shortest route, taking into account the location of the escalator.

[0209] The server calculates the route and generates directions such as, "Take the escalator up to the 3rd floor and turn right."

[0210] The device displays route information as a map and navigates the user.

[0211] VR customer service and sales at each store

[0212] The server retrieves the latest inventory information from each store in real time and updates the database. This includes information such as product name, stock quantity, and price.

[0213] When a user requests a VR customer service experience at a designated store using a mobile app, the device sends the request to the server. The server receives this request, sends access information to the virtual shop, and generates the VR space.

[0214] The user interactively selects products in a VR space, and the server receives this selection information to check inventory status in real time. It instantly checks whether the selected product is in stock.

[0215] The device displays available products to the user, who then proceeds with the purchase. The user taps the "Purchase" button and enters their payment information.

[0216] The server receives payment completion information and begins the shipping process for the product. The shipping status is updated in real time, and the user receives a notification.

[0217] Specific example

[0218] The server retrieves the latest inventory data from the electronics parts store and updates product information such as "resistor sets".

[0219] The user launches a smartphone app and begins a VR customer service experience at an electronics parts store.

[0220] The server generates a VR customer service session and sends virtual shop access information to the user's device.

[0221] The terminal displays a realistic virtual shop, and the user selects a "resistor set" from the virtual shelf.

[0222] The server checks the inventory status and confirms that the selected product is available for purchase.

[0223] The user taps the "Purchase" button and completes the payment process on their device.

[0224] The server receives notification that payment has been completed and begins the process of shipping the goods.

[0225] This makes it possible to efficiently check and secure available parking spaces, guide customers to stores within shopping facilities, and perform real-time inventory checks and virtual product selections in online shopping.

[0226] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0227] Guiding and securing parking spaces in advance

[0228] Step 1:

[0229] The server acquires real-time data from various sensors in the parking lot (cameras and ultrasonic sensors). The sensors collect data from the physical environment and send it to the server. The data acquired here includes the availability of parking spaces. The server analyzes this data, identifies available parking spaces, and stores them in a database.

[0230] Input: Real-time data from sensors

[0231] Data processing: Collection and analysis of sensor data

[0232] Output: Information on available parking spaces (saved in database)

[0233] Specific operation: The camera acquires images and uses image processing techniques to identify available spaces. The ultrasonic sensor measures distance and uses that to identify available spaces.

[0234] Step 2:

[0235] The device acquires the user's current location information using GPS and transmits that information to the server. The GPS module receives signals from satellites and calculates the current location. This location information is processed within the device and transmitted to the server as high-precision location information along with WiFi and mobile network data.

[0236] Input: Location data from GPS

[0237] Data processing: Acquisition and transmission of location data

[0238] Output: Current location information (sent to server)

[0239] Specific operation: The device periodically receives GPS signals and processes the data to determine its exact current location.

[0240] Step 3:

[0241] The server identifies the nearest available parking space based on information about available spaces in the parking lot and the user's current location. The server uses route-finding algorithms such as Dijkstra's algorithm to identify the nearest unused parking space from the user's current location. This calculation result is stored on the server.

[0242] Input: Information on available parking spaces, current location information

[0243] Data processing: Optimal space identification using pathfinding algorithms.

[0244] Output: Optimal free space information (stored on the server)

[0245] Specific operation: The server retrieves available space information and current location information from the database and applies an algorithm to calculate the optimal route.

[0246] Step 4:

[0247] The device navigates the user in real time based on location information of available spaces received from the server. The device uses a navigation app to provide map display and voice guidance. This allows the user to intuitively understand the optimal route.

[0248] Input: Information on the best available space

[0249] Data processing: Generating navigation information

[0250] Output: Navigation information (displayed on the device and voice guidance)

[0251] Specific operation: The device generates visuals using map data and generates guidance voices using speech synthesis technology.

[0252] Step 5:

[0253] The user checks for available spaces on the mobile app and taps the "Reserve" button. The user's action sends a reservation request from the device to the server. Before submitting the reservation request, the user checks the details of the parking space (e.g., space number, location, etc.).

[0254] Input: User reservation request

[0255] Data processing: Generating and sending reservation requests

[0256] Output: Reservation request (sent to server)

[0257] Specific action: The user interacts with the app's interface and taps the reservation button.

[0258] Step 6:

[0259] The server receives a user's reservation request and updates the available space to a reserved status. The reservation information is immediately saved to the database and reflected in other terminals in real time. As a result, other users will no longer be able to reserve that space.

[0260] Input: Reservation Request

[0261] Data processing: Updating reservation information and saving it to the database.

[0262] Output: Updated reservation information (saved in database)

[0263] Specific operation: The server processes the reservation request and changes the corresponding record in the database to a reserved state.

[0264] Step 7:

[0265] The device displays a reservation confirmation notification to the user. The notification includes details of the reserved space (e.g., space number, reservation time, etc.). This allows the user to confirm which space they have reserved.

[0266] Input: Reservation confirmation information

[0267] Data processing: Generating and displaying reservation completion notifications.

[0268] Output: Reservation completion notification (displayed on the device)

[0269] Specific operation: The device's notification function will be used to notify the user of the reservation completion information in the form of a pop-up or alert.

[0270] Guidance to the optimal store flow

[0271] Step 1:

[0272] The server manages the location information and floor maps of all stores within the shopping complex and stores them in a database. This includes the name of each store, its location on the floor, and the distance between stores.

[0273] Input: Store location information and floor map information

[0274] Data processing: Information management and storage in databases

[0275] Output: Management information in the database

[0276] Specific operation: The server periodically updates the database to maintain the latest store location information.

[0277] Step 2:

[0278] The user uses the store search function of the terminal app to enter the name of the store to visit. The search query is sent from the terminal to the server, and the server obtains the location information of the store.

[0279] Input: User's search query

[0280] Data processing: Generation and transmission of the search query

[0281] Output: Search results (sent to the server)

[0282] Specific operation: The terminal processes the information input through the user interface and sends it to the server.

[0283] Step 3:

[0284] The terminal obtains the user's current location information via GPS and sends that information to the server. The GPS data is sent to the server together with the location information of WiFi and the mobile network.

[0285] Input: GPS data and other location information

[0286] Data processing: Acquisition and transmission of location data

[0287] Output: Current location information (sent to the server)

[0288] Specific operation: The terminal periodically updates the location information and sends it to the server.

[0289] Step 4:

[0290] The server calculates the optimal route based on the current location information and the destination information. Using the Dijkstra algorithm, it calculates the route by which the user can reach the destination most efficiently and saves the result in the server.

[0291] Input: Current location information and destination information

[0292] Data processing: Calculation and storage of the optimal route

[0293] Output: Optimal route information (stored on the server)

[0294] Specific operation: The server uses an algorithm to derive the optimal route based on the current location and destination information obtained from the database.

[0295] Step 5:

[0296] The terminal displays the optimal route information received from the server in map format, providing real-time guidance to the user. The map display is done using a GUI, and voice guidance is also used in conjunction.

[0297] Input: Optimal route information

[0298] Data processing: Generation and display of map information

[0299] Output: Navigation information (displayed on the device and voice guidance)

[0300] Specific operation: The terminal generates visual guidance based on map data and provides voice guidance using speech synthesis technology.

[0301] VR customer service and sales at each store

[0302] Step 1:

[0303] The server retrieves the latest inventory information from each store in real time and updates the database. This includes information such as product name, stock quantity, and price.

[0304] Input: Inventory information from the store

[0305] Data processing: Retrieving inventory information and updating the database.

[0306] Output: Updated inventory information (saved in the database)

[0307] Specific operation: The server periodically obtains inventory information from each store and updates the latest information in the database.

[0308] Step 2:

[0309] The user uses the mobile app to select the store where VR customer service is desired. The user selects the desired store from the store list in the terminal app, and the information is sent to the server.

[0310] Input: User's store selection information

[0311] Data processing: Generation and transmission of store selection information

[0312] Output: Store selection information (sent to the server)

[0313] Specific operation: The user operates the interface in the app to select the desired store.

[0314] Step 3:

[0315] The terminal sends a start request for the VR customer service session to the server. The server processes the request and sends the access information for the virtual store to the terminal.

[0316] Input: Start request

[0317] Data processing: Generation and transmission of the request

[0318] Output: Access information (sent to the terminal)

[0319] Specific operation: The terminal sends a request to the server and waits for a response from the server.

[0320] Step 4:

[0321] Users interactively select products in a VR space and add them to their cart. Users choose products from a virtual shelf, and this information is sent from the terminal to the server.

[0322] Input: User's selected information

[0323] Data processing: Generation and transmission of selected information

[0324] Output: Selection information (sent to server)

[0325] Specific actions: The user operates the VR interface to select products and add them to the cart.

[0326] Step 5:

[0327] The server receives the user's selection information and checks the inventory status in real time. It immediately checks whether the selected product is in stock and saves the result on the server.

[0328] Input: User's selected information

[0329] Data processing: Checking inventory status and saving results.

[0330] Output: Inventory check results (save on the server)

[0331] Specific operation: The server retrieves inventory information from the database and checks whether the selected product is in stock.

[0332] Step 6:

[0333] The device displays available products to the user, and the user proceeds with the purchase. The user taps the "Purchase" button within the app and enters their payment information.

[0334] Input: Inventory check results, user purchase request

[0335] Data processing: Generation and transmission of purchase procedure information.

[0336] Output: Purchase procedure information (sent to server)

[0337] Specific action: The device displays the purchase procedure screen, allowing the user to enter payment information.

[0338] Step 7:

[0339] The server receives payment completion information and begins the shipping process for the goods. The shipping status is updated in real time, and a notification is sent to the user.

[0340] Input: Payment completion information

[0341] Data processing: Initiation and status update of delivery procedures.

[0342] Output: Delivery status notification (sent to user)

[0343] Specific operation: The server verifies the payment information and automatically starts the shipping process. The shipping status is updated regularly and notified to the user.

[0344] (Application Example 1)

[0345] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0346] In modern urban areas and commercial facilities, finding available parking spaces is often difficult, resulting in wasted time and effort. Furthermore, locating specific stores within shopping centers can be stressful for customers. With the rise of online shopping, remote shopping from physical stores has increased, but managing inventory and product information remains complex. These challenges need to be efficiently addressed by a single system.

[0347] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0348] In this invention, the server includes means for detecting available parking spaces using various sensors, means for acquiring current location information from the user's terminal, means for guiding the user to the nearest available space based on the available space information and current location information, means for reserving a designated available space in advance, means for acquiring and updating inventory information and 3D model data of products from each store from a remote server, means for acquiring location information and gaze information from the user's smart glasses, means for detecting when the user's gaze is fixed on a specific product model and transmitting detailed information about that product to the user's smart glasses, means for waiting for a voice command from the user based on the product information displayed on the smart glasses, and means for reconfirming product inventory and proceeding with the purchase procedure based on the voice command. This enables efficient detection and navigation of available parking spaces, store guidance within shopping facilities, and product selection and purchase procedures in a virtual space.

[0349] A "sensor" is a device that detects physical phenomena and converts them into electrical signals.

[0350] A "terminal" is a computer or mobile device operated by a user.

[0351] "Current location information" refers to the user's geographical location data obtained using GPS or other location measurement technologies.

[0352] "Available space information" refers to data about parking spaces currently available within the parking lot.

[0353] A "remote server" is a computer system located in a remote location that is accessed via a network.

[0354] "Inventory information" refers to detailed data on the goods and products currently stored in the store.

[0355] "3D model data" refers to digital data that represents the three-dimensional shape of an object or product.

[0356] "Smart glasses" are glasses-type devices that display information from virtual reality and augmented reality, and have the function of tracking the user's gaze and movements.

[0357] "Eye-gaze information" refers to data about the direction and focus of a user's gaze.

[0358] A "voice command" is an input that allows the system to understand and process instructions and commands spoken by the user.

[0359] System Configuration

[0360] The system that realizes this invention uses the following main hardware and software.

[0361] Hardware: Various sensors (cameras, ultrasonic sensors, etc.), smart glasses (glasses-type devices), user terminals (smartphones and tablets), remote servers (cloud servers)

[0362] Software: GPS data acquisition library, eye tracking library, speech recognition API, 3D model display library

[0363] Data acquisition and processing

[0364] The server acquires data in real time from various sensors in the parking lot and updates the information on available parking spaces. The server also acquires inventory information and 3D model data of products from all stores within the shopping facility and updates the database. User terminals acquire their current location information using GPS and send it to the server. This enables real-time guidance on available parking spaces and reservations.

[0365] Operation using smart glasses

[0366] The user wears smart glasses, and their gaze data is acquired. The server detects when the user's gaze is fixed on a 3D model of a specific product and sends the product's details to the smart glasses. The user can then use voice commands to add the product to their cart and proceed with the purchase. During this process, the server recognizes the voice commands, reconfirms product availability, and updates the order information.

[0367] Specific example

[0368] Parking space availability and reservation: Users use their smartphones to search for available parking spaces and are shown the closest available space to their current location. When a user reserves a space through the app, the server updates the listing so that the space is not visible to other users.

[0369] Store guidance within a shopping mall: Users use their smartphones within the mall to search for their destination store. The server calculates the optimal route based on the user's current location and destination information and sends it to the user's device. Users receive real-time guidance as they head to their desired store.

[0370] Virtual Shopping Experience: Users access a virtual store using smart glasses and view 3D models of products on shelves. By fixing their gaze, detailed product information is displayed, and items can be added to the cart and purchased using voice commands. The server checks inventory information and proceeds with the purchase.

[0371] Example of a prompt

[0372] "Please provide a detailed explanation of the system that allows users to fix their gaze on products in a virtual store through smart glasses, view detailed information, add items to their cart using voice commands, and complete the purchase process."

[0373] This invention solves the problem of vacant parking spaces, improves the efficiency of store guidance within shopping facilities, and enhances the virtual shopping experience.

[0374] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0375] Step 1:

[0376] The server acquires real-time data from various sensors in the parking lot (cameras, ultrasonic sensors, etc.). Based on this data, it understands the current status of available parking spaces and updates the database. This ensures that the latest information on available spaces is available.

[0377] Input: Real-time data from various sensors

[0378] Output: Updated free space information

[0379] Step 2:

[0380] The device uses GPS to obtain the user's current location information. This location information is then transmitted to the server via data communication. This ensures the user's current location is accurately determined.

[0381] Input: GPS data

[0382] Output: Current location information

[0383] Step 3:

[0384] The server identifies the nearest available space based on the user's current location and available space information. In this process, it calculates the distance using the coordinate data of the current location and available space, and selects the most suitable available space.

[0385] Input: Current location information, available space information

[0386] Output: Location information for optimal free space

[0387] Step 4:

[0388] The terminal navigates the user to the most suitable available space based on location information received from the server. It uses map displays and voice guidance to direct the user to the available space.

[0389] Input: Location information for the best available space

[0390] Output: Navigation information

[0391] Step 5:

[0392] The user taps the "Reserve" button on the app to reserve an available space in advance. This action sends the reservation information from the device to the server.

[0393] Input: User reservation operation

[0394] Output: Reservation Information

[0395] Step 6:

[0396] The server sets the available space to reserved status based on the received reservation information. It updates the database so that the space is not displayed to other users.

[0397] Input: Reservation Information

[0398] Output: Updated free space information

[0399] Step 7:

[0400] The device displays a reservation completion notification to the user, allowing them to confirm that the reservation was successfully completed.

[0401] Input: Reservation confirmation information

[0402] Output: Booking confirmation

[0403] Step 8:

[0404] The server retrieves inventory information and 3D model data of products from each store within the shopping complex. This information is then updated in a database and used by users when they engage in virtual shopping.

[0405] Input: Store inventory information, 3D model data

[0406] Output: Updated inventory information and 3D model data

[0407] Step 9:

[0408] The user's smart glasses acquire the user's location and gaze information. This information is transmitted to the server in real time.

[0409] Input: User location information, eye-tracking information

[0410] Output: Real-time location information and line-of-sight information

[0411] Step 10:

[0412] The server detects when the user's gaze is fixed on a 3D model of a specific product and sends detailed information about that product to the smart glasses. This information includes the product name, price, and description.

[0413] Input: User eye-tracking information

[0414] Output: Product details

[0415] Step 11:

[0416] The smart glasses wait for the user's voice command (e.g., "Add to cart") based on the displayed product information. A voice recognition API is used to accurately capture the user's instructions.

[0417] Input: Product details

[0418] Output: Voice command

[0419] Step 12:

[0420] The server recognizes the voice command and reconfirms the product's inventory. After confirmation, it updates the order information and sends a notification to the user to proceed with the purchase.

[0421] Input: Voice command

[0422] Output: Updated order information, purchase procedure notification

[0423] The above outlines the specific processing steps for the entire system. This allows users to efficiently access and reserve parking spaces, find store locations, and experience virtual shopping.

[0424] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0425] This invention includes a system that uses various sensors to detect available parking spaces, guides the user to the optimal available space based on their current location, and reserves that space in advance; a system that guides the user to the optimal route to a destination store within a shopping facility; and a system that allows users to select and purchase products using the virtual space of each store. Furthermore, this invention also includes a function to optimize the user experience by incorporating an emotion engine that recognizes the user's emotions. The details and specific examples of the overall system's program processing are described below.

[0426] (1) Guiding and securing parking spaces in advance

[0427] Explanation of program processing

[0428] 1. The server acquires data from various sensors in the parking lot (e.g., cameras and ultrasonic sensors) and determines whether or not there are available parking spaces.

[0429] 2. The device obtains the user's current location information using GPS and sends that information to the server.

[0430] 3. The server integrates information about available space with the user's current location to identify the nearest available space.

[0431] 4. The server sends the location information of the available space it has identified to the terminal.

[0432] 5. Based on the location information received by the device, navigation information to an available space is displayed to the user.

[0433] 6. The user follows the navigation in the app and heads to the designated empty space.

[0434] 7. The user taps the "Reserve" button to send a request from their device to reserve an available space in advance.

[0435] 8. The server receives the reservation request and changes the specified available space to a reserved state.

[0436] 9. The server sends a reservation confirmation to the device.

[0437] 10. The device displays a confirmation to the user that the reservation is complete.

[0438] Specific example

[0439] The server collects real-time data on available parking spaces for 150 cars and creates a list of available spaces.

[0440] The user opens a parking search page using a mobile app and finds the nearest available space from their current location.

[0441] The server obtains the user's current location from GPS data and presents the nearest available space (e.g., space number 35) from the list of available spaces.

[0442] The terminal will show the user the optimal route and guide them to space number 35 using voice guidance.

[0443] The user taps "Reserve Space 35" to reserve the space in advance.

[0444] The server checks the reservation information and updates it so that space 35 is not displayed to other users.

[0445] The device displays a reservation completion notification to the user.

[0446] (2) Guiding customers to the optimal store layout

[0447] Explanation of program processing

[0448] 1. The server manages and updates location information and floor map data for all stores within the shopping facility.

[0449] 2. The user opens the app and enters the name of the store they want to visit.

[0450] 3. The terminal sends the entered store name to the server.

[0451] 4. The server searches for the location information of the relevant store and calculates the optimal route from the current location.

[0452] 5. The device sends its current location information, obtained using GPS, to the server.

[0453] 6. The server calculates the most suitable route for the user based on the user's current location and the store's location, and sends that information to the user's device.

[0454] 7. The terminal displays the received route information as a map and begins providing route guidance to the user.

[0455] 8. The user follows the map directions on their device and proceeds to the desired store.

[0456] (3) VR customer service and sales at each store

[0457] Explanation of program processing

[0458] 1. The server collects real-time inventory information from each store and updates the database.

[0459] 2. The user selects the store where they wish to receive VR customer service via the mobile app and starts the session.

[0460] 3. The terminal sends a session start request to the server, specifying the selected store.

[0461] 4. The server generates access information for the virtual shop and sends it to the terminal.

[0462] 5. The device displays the entrance to the virtual shop to the user and prompts them to access it.

[0463] 6. Once the user enters the virtual shop, they can freely explore the VR space and select products.

[0464] 7. The device sends information about the product selected by the user to the server.

[0465] 8. The server checks the inventory information of the selected product and sends a list of available products to the terminal.

[0466] 9. The device displays a list of purchasable items to the user and shows a screen to begin the purchase process.

[0467] 10. The user selects the product they want to purchase and taps the "Purchase" button.

[0468] 11. The device sends the purchase request and payment information to the server.

[0469] 12. The server completes the payment process and notifies the terminal of the result.

[0470] 13. The terminal displays a notification to the user that the payment has been completed.

[0471] (4) Use of the Emotion Engine

[0472] Explanation of how the emotion engine works

[0473] 1. The device uses the user's camera and microphone to analyze the user's facial expressions and voice tone in real time and acquire emotional information.

[0474] 2. The emotion engine analyzes emotional information and sends the user's emotional state (e.g., stress, joy, frustration) to the server.

[0475] 3. The server uses user sentiment information to dynamically change the guidance methods and displayed content.

[0476] Specific example

[0477] When the device detects stress from the user's facial expression, the server adjusts its settings to provide more concise and faster information about available spaces.

[0478] If a user gets lost in a shopping mall, the emotion engine detects their frustration, and the server adjusts the guidance information to make it easier to understand and view.

[0479] The device detects the user's excitement within the virtual shop, and the server more proactively suggests recommended products.

[0480] Thus, the present invention provides an integrated service combining a parking space availability guide, store guidance within commercial facilities, and online shopping experiences for each store, all in combination with an emotion engine, enabling the delivery of optimal services tailored to the user's emotional state.

[0481] The following describes the processing flow.

[0482] (1) Guiding and securing parking spaces in advance

[0483] Specific steps in program processing

[0484] Step 1:

[0485] The server acquires data from various sensors in the parking lot (such as cameras and ultrasonic sensors) and determines whether or not there are available parking spaces.

[0486] Step 2:

[0487] The device obtains the user's current location information using GPS and sends that information to the server.

[0488] Step 3:

[0489] The server integrates information about available space with the user's current location to identify the nearest available space.

[0490] Step 4:

[0491] The server sends location information of the available space it has identified to the terminal.

[0492] Step 5:

[0493] Based on the location information received by the device, navigation information to an available space is displayed to the user.

[0494] Step 6:

[0495] The user follows the navigation in the app and heads to the designated empty space.

[0496] Step 7:

[0497] The user taps the "Reserve" button to send a request from their device to reserve an available space in advance.

[0498] Step 8:

[0499] The server receives the reservation request and changes the specified available space to a reserved state.

[0500] Step 9:

[0501] The server sends a reservation confirmation to the device.

[0502] Step 10:

[0503] The device displays a confirmation to the user that the reservation is complete.

[0504] (2) Guiding customers to the optimal store layout

[0505] Specific steps in program processing

[0506] Step 1:

[0507] The server manages and updates location information and floor map data for all stores within the shopping complex.

[0508] Step 2:

[0509] The user opens the app and enters the name of the store they want to visit.

[0510] Step 3:

[0511] The terminal sends the entered store name to the server.

[0512] Step 4:

[0513] The server searches for the location information of the relevant store and calculates the optimal route from the current location.

[0514] Step 5:

[0515] The device uses GPS to obtain its current location information, which is then sent to the server.

[0516] Step 6:

[0517] The server calculates the most suitable route for the user based on their current location and the location of the store, and sends that information to their device.

[0518] Step 7:

[0519] The terminal displays the route information it has received as a map and begins providing route guidance to the user.

[0520] Step 8:

[0521] The user follows the map directions on their device to reach their destination store.

[0522] (3) VR customer service and sales at each store

[0523] Specific steps in program processing

[0524] Step 1:

[0525] The server collects real-time inventory information from each store and updates the database.

[0526] Step 2:

[0527] The user selects the store where they want to receive VR customer service via a mobile app and starts the session.

[0528] Step 3:

[0529] The device sends a session start request to the server, specifying the selected store.

[0530] Step 4:

[0531] The server generates access information for the virtual shop and sends it to the terminal.

[0532] Step 5:

[0533] The device displays the entrance to the virtual shop to the user and prompts them to access it.

[0534] Step 6:

[0535] When a user enters a virtual shop, they can freely explore the VR space and select products.

[0536] Step 7:

[0537] The device sends information about the product selected by the user to the server.

[0538] Step 8:

[0539] The server checks the inventory information of the selected product and sends a list of available products to the terminal.

[0540] Step 9:

[0541] The device displays a list of purchasable items to the user and shows a screen to begin the purchase process.

[0542] Step 10:

[0543] The user selects the product they want to purchase and taps the "Purchase" button.

[0544] Step 11:

[0545] The device sends the purchase request and payment information to the server.

[0546] Step 12:

[0547] The server completes the payment process and notifies the terminal of the result.

[0548] Step 13:

[0549] The device displays a notification to the user that the payment has been completed.

[0550] (4) Use of the Emotion Engine

[0551] Explanation of how the emotion engine works

[0552] Step 1:

[0553] The device uses the user's camera and microphone to analyze the user's facial expressions and voice tone in real time and acquire emotional information.

[0554] Step 2:

[0555] The emotion engine analyzes emotional information and sends the user's emotional state (e.g., stress, joy, frustration) to the server.

[0556] Step 3:

[0557] The server receives emotional information and dynamically changes the guidance method and displayed content based on the user's emotional state.

[0558] Specific example

[0559] Parking guidance case

[0560] If the device detects stress from the user's facial expressions, the server adjusts the display of guidance information to be more concise and faster.

[0561] Shopping mall information case

[0562] When the emotion engine detects that a user is lost and frustrated in a store, the server adjusts the guidance information to make it easier to understand and view.

[0563] Cases within a virtual shop

[0564] When the device detects the user's excited facial expression, the server more proactively suggests recommended products, increasing the likelihood of a purchase.

[0565] Thus, the present invention provides an integrated service combining a parking space availability guide, store guidance within commercial facilities, and online shopping experiences for each store, all in combination with an emotion engine, enabling the delivery of optimal services tailored to the user's emotional state.

[0566] (Example 2)

[0567] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0568] Conventional parking management systems can detect available spaces, acquire user location information, and provide guidance, but they fail to provide efficient guidance and services that take into account the user's emotional state. This can lead to a decline in the quality of the user experience and potentially impair user convenience. Furthermore, providing optimal services that reflect the user's emotional state is also a challenge in store guidance and virtual shopping.

[0569] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0570] In this invention, the server includes means for detecting available parking spaces using various sensors, means for acquiring current location information from the user's terminal, means for guiding the user to the nearest available parking space based on the available space information and current location information, means for reserving a designated available parking space in advance, means for acquiring emotional information, means for analyzing emotional information, and means for dynamically changing the guidance method and display content based on the emotional information. This makes it possible to provide optimal guidance according to the user's emotional state, thereby improving the quality of the user experience.

[0571] "Various sensors" is a general term for devices such as cameras and ultrasonic sensors used to detect available parking spaces and other conditions.

[0572] "User's device" refers to a mobile device such as a smartphone or tablet used by the user, and is a device used to acquire and transmit current location information and other data.

[0573] "Current location information" refers to the user's real-time location data obtained using location information acquisition technologies such as GPS.

[0574] "Available space information" refers to data obtained from various sensors regarding the availability of parking spaces.

[0575] "Guidance means" refers to methods and means for notifying users of the optimal route to available spaces or stores, and includes map displays and voice guidance.

[0576] "Prior reservation methods" refer to methods or systems that allow users to reserve a specific available space and prevent other users from using that space.

[0577] "Emotional information" refers to data on the user's emotional state obtained by analyzing the user's facial expressions, voice tone, and other information acquired using the user's camera and microphone.

[0578] "Means for analyzing emotional information" refers to analytical algorithms and systems used to determine a user's emotional state based on acquired emotional information.

[0579] "Means of dynamic modification" refers to technologies and systems that change guidance methods and displayed content in real time according to the user's emotional information.

[0580] "Store location information" refers to data that indicates the specific location of each store within a shopping facility.

[0581] "Floor map information" refers to map data that shows the layout of all stores and facilities within a shopping complex.

[0582] "Inventory information" refers to data that shows the inventory status of products held by each store.

[0583] A "virtual space" is a virtual shop space that users can access using virtual reality technology.

[0584] "Product selection" refers to the act of a user choosing a product in a virtual space with the intention of purchasing it.

[0585] "Purchase procedure" refers to a series of steps taken to complete the purchase of selected items, including entering and confirming payment information.

[0586] This invention includes a system that uses various sensors to detect available parking spaces, guides the user to the optimal available space based on their current location, and reserves that space in advance; a system that guides the user to the optimal route to a destination store within a shopping facility; and a system that allows users to select and purchase products using the virtual space of each store. Furthermore, this invention also includes a function that optimizes the user experience by incorporating an emotion engine that recognizes the user's emotions.

[0587] Guiding and securing parking spaces in advance

[0588] The server acquires data in real time from various sensors in the parking lot (cameras, ultrasonic sensors, etc.) and determines whether there are any available spaces. Specifically, it analyzes camera images to check for the presence of vehicles and uses ultrasonic sensor data to measure distances.

[0589] The device uses GPS to obtain the user's current location information and sends that information to the server. For example, a user launches the app and taps the "Get Current Location" button on the parking lot search page.

[0590] The server integrates information on available spaces with the user's current location to identify the nearest available space. The server uses GPS data to calculate distances and selects the most suitable space for the user.

[0591] The server identifies an available space and sends its location information to the terminal. Based on this location information, the terminal displays navigation information to the user to reach the available space. The user uses voice guidance or a map display to navigate to the designated space.

[0592] After the user arrives at the designated available space, they tap the "Reserve" button to reserve it in advance. The server receives the reservation request, changes the designated space to a reserved status, and sends a reservation completion notification to the user's device.

[0593] Guidance to the optimal store flow

[0594] The server manages and regularly updates location information and floor map data for all stores within the shopping complex. This ensures that the most up-to-date store layout information is maintained.

[0595] The user opens the app and enters the name of the store they want to visit. The device sends the entered store name to the server. For example, if the user enters "Starbucks," the server receives it.

[0596] The server searches for the location information of the relevant store and calculates the optimal route from the current location. The server uses GPS data to confirm the user's current location and generates the optimal route.

[0597] The device receives route information and displays it as a map. The user can follow the device's instructions to reach their destination store.

[0598] VR customer service and sales at each store

[0599] The server collects real-time inventory information from each store and updates the database. For example, when an item is sold, the inventory information is updated immediately.

[0600] The user selects a store where they would like VR customer service via the app and starts a session. The device sends the selected information to the server. The user freely explores the products in the virtual space and selects items they like.

[0601] The terminal sends information about the selected product to the server, which checks the inventory and returns a list of available products. When the user selects a product and proceeds with the purchase, payment information is sent to the server, which completes the payment process.

[0602] Using an Emotion Engine

[0603] The device uses the user's camera and microphone to analyze the user's facial expressions and voice tone in real time and acquire emotional information. For example, it might take a picture of the user's face with the camera and perform voice analysis.

[0604] The emotion engine analyzes the acquired emotional information to determine the user's emotional state (stress, joy, frustration, etc.) and sends that information to the server.

[0605] The server uses emotional information to dynamically change the guidance methods and displayed content. For example, it simplifies guidance information and emphasizes important information for users who are stressed.

[0606] This allows the system to provide optimal guidance based on the user's emotional state, integrating information on available parking spaces, store locations within commercial facilities, and even an online shopping experience. Examples of prompt messages are shown below.

[0607] Concrete examples of generative AI model prompts

[0608] Generating instructions for guiding users to available parking spaces.

[0609] Please explain the programming procedure for a system that guides users to and reserves available parking spaces. This includes the roles of the server, terminal, and user, how data is acquired from various sensors in the parking lot, how available spaces are determined, how the user's current location is obtained, how available spaces are displayed, and the reservation process. Please also include specific examples.

[0610] Store Layout Guide Explanation Generation

[0611] Please provide a detailed explanation of the program's processing for a system that guides users along the optimal store routes within a shopping facility. This includes the roles of the server, terminals, and users, the management of location information and floor map data for all stores, the input of store information the user wants to visit, and the calculation of the optimal route based on that information. Please also include specific examples.

[0612] Generating explanations for VR customer service and sales.

[0613] Please provide a detailed explanation of the program processing for each store's VR customer service and sales system. This includes the roles of the server, terminal, and user, as well as details of real-time inventory information collection, initiation of the user's VR customer service session, product selection flow, and purchase procedure. Please also include specific examples.

[0614] Emotion Engine Description Generation

[0615] Please provide a detailed explanation of the program processing for a user experience optimization system that utilizes an emotion engine. This includes the roles of the terminal, emotion engine, and server, as well as the process of analyzing the user's facial expressions and tone of voice, collecting and analyzing emotion information, and dynamically changing guidance methods and displayed content based on that emotion information. Please also include specific examples.

[0616]

[0617] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0618] Guiding and securing parking spaces in advance

[0619] Processing steps

[0620] Step 1:

[0621] The server collects data in real time from various sensors in the parking lot (cameras, ultrasonic sensors, etc.). This data is used to determine whether there are available parking spaces. Specifically, it analyzes camera images to detect the presence or absence of vehicles and analyzes distance data from ultrasonic sensors to determine if a parking space is occupied. Sensor data is the input, and information on available spaces is obtained as the output.

[0622] Step 2:

[0623] The device obtains the user's current location information using GPS and sends that information to the server. When the user launches the app and taps the "Get Current Location" button, the device obtains the user's location information and sends it to the server. GPS data is taken as input, and the current location information is obtained as output.

[0624] Step 3:

[0625] The server integrates information about available spaces with the user's current location to identify the nearest available space. The server compares GPS data with the location information (X, Y coordinates) of the available spaces, calculates the straight-line distance, and identifies the nearest available space. The input is information about available spaces and the user's current location, and the output is the location information of the nearest available space.

[0626] Step 4:

[0627] The server sends location information of the free space it has identified to the terminal. This includes the specific location of the free space (for example, "Section A, Space 35"). The input is the location information of the nearest free space, and the output is the location information of the free space to be sent to the terminal.

[0628] Step 5:

[0629] Based on the location information received by the device, navigation information to an available parking space is displayed to the user. The map display is updated, and voice guidance is also used to guide the user to the designated parking space. The input is the location information of the available parking space, and the output is navigation information.

[0630] Step 6:

[0631] After the user arrives at the designated available space, they tap the "Reserve" button to reserve it in advance. The device then sends the reservation request to the server. The input is the reservation request, and the output is the reservation request data.

[0632] Step 7:

[0633] The server receives a reservation request and changes the specified available space to a reserved state. This makes that space unavailable to other users. The input is reservation request data, and the output is a reservation completion notification.

[0634] Step 8:

[0635] The server sends a reservation completion notification to the terminal, and the terminal displays a confirmation of the reservation completion to the user. The input is the reservation completion notification, and the output is the notification information for the user.

[0636] Guidance to the optimal store flow

[0637] Processing steps

[0638] Step 1:

[0639] The server manages and regularly updates location information and floor map data for all stores within the shopping complex. New store openings and store relocation information are automatically reflected in the database. Input includes location information and floor map data for each store, and output is an updated database.

[0640] Step 2:

[0641] The user opens the app and enters the name of the store they want to visit. The device sends the entered store name to the server. The input is the store name entered by the user, and the output is the store name data sent to the server.

[0642] Step 3:

[0643] The server searches for the location information of the relevant store and calculates the optimal route from the user's current location. The server uses GPS data to confirm the user's current location and generates the optimal route. The input is store name data and current location information, and the output is optimal route information.

[0644] Step 4:

[0645] The server sends optimal route information to the terminal, and the terminal displays the received route information as a map. The input is optimal route information, and the output is map data sent to the terminal.

[0646] Step 5:

[0647] The user follows the map directions to reach their destination store. The terminal provides route guidance using both map data and voice guidance. Map data is the input, and guidance information is output.

[0648] VR customer service and sales at each store

[0649] Processing steps

[0650] Step 1:

[0651] The server collects real-time inventory information from each store and updates the database. The inventory information is automatically reflected in the database. The input is the inventory information from each store, and the output is the updated database.

[0652] Step 2:

[0653] The user selects a store where they wish to receive VR customer service via a mobile app and starts a session. The device sends the selected store information to the server. The input is the name of the store selected by the user, and the output is the session start request sent to the server.

[0654] Step 3:

[0655] The server generates access information for the virtual shop and sends it to the terminal. The terminal displays the entrance to the virtual shop to the user and prompts them to access it. The input is a session start request, and the output is the access information for the terminal.

[0656] Step 4:

[0657] The user accesses a virtual shop and freely explores the VR space. The user checks product information and selects the product they wish to purchase. The input is data from the virtual shop, and the output is information about the selected product.

[0658] Step 5:

[0659] The terminal sends information about the selected product to the server, the server checks the inventory information and sends a list of available products to the terminal. The input is information about the selected product, and the output is a list of available products.

[0660] Step 6:

[0661] The user proceeds with the purchase process, enters payment information, and taps the "Purchase" button. The device sends the purchase request and payment information to the server. The input is the purchase process data, and the output is the payment request.

[0662] Step 7:

[0663] The server completes the payment process and notifies the terminal of the result. The terminal displays a payment completion notification to the user. The input is a payment request, and the output is a payment completion notification.

[0664] Using an Emotion Engine

[0665] Processing steps

[0666] Step 1:

[0667] The device uses the user's camera and microphone to analyze the user's facial expressions and voice tone in real time and acquire emotional information. The input consists of camera images and audio data, and the output is emotional information.

[0668] Step 2:

[0669] The emotion engine analyzes the acquired emotion information and sends the user's emotional state to the server. The input is the analyzed emotion information, and the output is the data sent to the server.

[0670] Step 3:

[0671] The server uses user emotion information to dynamically change the guidance methods and displayed content. For example, for a user experiencing stress, the guidance information is simplified and important information is emphasized. Emotion information is taken as input, and the adjusted guidance information is returned as output.

[0672] (Application Example 2)

[0673] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0674] In modern shopping facilities and parking lots, there is a need to improve convenience for users to easily find parking spaces and enjoy their shopping. Traditional systems often made searching for available parking spaces and navigating to stores within shopping facilities cumbersome, causing stress to users, especially during peak hours. Furthermore, the time-consuming process of selecting desired products and checking inventory also negatively impacted the user experience. Moreover, providing services that consider user emotions was difficult, making it challenging to offer optimal services tailored to individual needs.

[0675] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for detecting available parking spaces using various sensors, means for acquiring current location information from the user's terminal, means for guiding the user to the nearest available space based on the available space information and current location information, means for reserving a designated available space in advance, means for a camera and microphone that analyzes the user's facial expressions and voice to acquire emotional information, means for dynamically changing the guidance method and display content based on the emotional information, and means for supporting store guidance and product selection within a shopping facility. As a result, users can easily search for parking spaces and have a smooth shopping experience with reduced stress. In addition, since individualized responses that take into account the user's emotions are provided, user satisfaction is improved.

[0676] "Various types of sensors" refers to multiple types of sensors such as cameras, ultrasonic sensors, and pressure sensors, which are devices that sense physical phenomena and acquire them as data.

[0677] "Available parking spaces" refer to unused spaces within a parking lot where vehicles can be parked.

[0678] "User's device" refers to an information device owned by the user, such as a smartphone, tablet, or smart glasses.

[0679] "Current location information" refers to data on the current geographical location of a user's device, obtained using location information systems such as GPS.

[0680] "Available space information" refers to data about available spaces within a parking lot, such as whether or not there are available spaces and their location.

[0681] "Securing in advance" means setting a designated available space to a reserved state so that other users cannot use it.

[0682] "Emotional information" refers to data on emotional states such as stress, joy, and frustration, which are analyzed from the user's facial expressions and voice.

[0683] "Camera and microphone" refers to an imaging device for acquiring images and a sound-collecting device for acquiring sound.

[0684] A "shopping facility" is a commercial complex where many stores are gathered, and it is a place where users purchase goods.

[0685] "Store guide" is a service that provides users with directions and location information to the store they want to visit.

[0686] A "virtual space" is a virtual space that mimics the real world, and it is an interface that allows users to select products visually and interactively.

[0687] "Inventory information" refers to data regarding the quantity and condition of products currently available at each store.

[0688] "Dynamically changing guidance methods and display content based on emotional information" means optimizing the content and expression of screen displays and voice guidance in real time based on the emotional information of the acquired user.

[0689] "Recommending products" means displaying and recommending products that are suitable for the user based on data such as the user's past purchase history and current emotional state.

[0690] This invention provides a system that detects available parking spaces, guides the user to the most suitable available space based on their current location, and reserves that space in advance. It also includes functions to guide the user to the optimal route within a shopping facility and to assist with product selection and purchase using virtual spaces within each store. Furthermore, by employing an emotion engine, the navigation and display content can be dynamically changed according to the user's emotional state.

[0691] Hardware and software to be used

[0692] Hardware:

[0693] Smartphone: GPS, camera, microphone, display

[0694] Various sensors: Cameras, ultrasonic sensors, pressure sensors

[0695] software:

[0696] Android Studio: App Development

[0697] OpenCV: Image processing library

[0698] Google Maps API: Navigation API

[0699] Overview of Program Processing

[0700] 1. Acquisition of sensor data:

[0701] The server uses various sensors (cameras, ultrasonic sensors, etc.) placed in the parking lot to detect the presence or absence of vacant spaces in real time.

[0702] The server generates information about available space based on the acquired data and stores it in the database.

[0703] 2. Obtaining current location information:

[0704] The user's smartphone uses GPS to obtain their current location and sends that information to the server.

[0705] 3. Information on available spaces:

[0706] The server integrates the available space information with the current location information to identify the nearest available space.

[0707] The system sends location information of identified vacant spaces to the user's smartphone and provides guidance via voice and on-screen display.

[0708] 4. Secure available space in advance:

[0709] When a user taps the "Reserve" button in the app, a request is sent to the server.

[0710] The server changes the specified available space to a reserved state and sends a reservation completion notification to the user's terminal.

[0711] 5. Navigation to the store:

[0712] Store location information and floor map data within the shopping facility are managed by a server.

[0713] When a user enters their destination store in the app and that information is sent to the server, the server calculates the optimal route and sends it to the user's device.

[0714] The user's smartphone performs navigation based on the route information it receives.

[0715] 6. Product selection and purchase in virtual space:

[0716] The server collects inventory information from each store in real time and updates the database.

[0717] When a user selects a virtual shop in the mobile app, that information is sent to the server.

[0718] The server generates access information for the virtual shop and sends it to the user's terminal.

[0719] When a user selects an item in a virtual shop and that information is sent to the server, the server checks the inventory and proceeds with the purchase.

[0720] 7. Dynamic guidance adjustments using an emotional engine:

[0721] The system uses the smartphone's camera and microphone to capture the user's facial expressions and voice in real time.

[0722] The emotion engine analyzes this data and sends the user's emotional information to the server.

[0723] The server dynamically changes the guidance methods and displayed content based on emotional information, providing the user with the most optimal service.

[0724] Examples of specific cases and AI prompt sentences

[0725] Specific example

[0726] Imagine a customer in a shopping mall looking for a specific store. The customer uses an app to obtain their current location via GPS and selects the name of the store they want to visit. The app then calculates the optimal route based on this information and displays it to the user. Furthermore, it analyzes the customer's facial expressions and voice through the camera and microphone, and improves navigation by simplifying the directions and providing more detailed information if the customer is experiencing stress.

[0727] Example of AI prompt message

[0728] A customer is lost in a shopping mall and is using the app. When you sense stress from their facial expression, explain how to simplify the navigation and provide more detailed instructions.

[0729] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0730] Step 1:

[0731] The server acquires real-time data on available parking spaces from various sensors (cameras, ultrasonic sensors, etc.) placed in the parking lot. The input data consists of signals representing physical phenomena transmitted from each sensor. The server analyzes these signals, determines whether or not there are available spaces, and stores the information in the database as available space information. The output data is a list of available spaces in the parking lot.

[0732] Step 2:

[0733] The terminal uses GPS to obtain the user's current location information. The input data is location signals received from GPS satellites. The terminal analyzes these signals to determine the current location and transmits this information to the server. The output data is the user's current location information.

[0734] Step 3:

[0735] The server integrates available space information and current location information to identify the available space closest to the user's terminal. The input data consists of available space information and the user's current location information. Based on this data, the server performs route calculations and generates location information for the nearest available space. The output data is the location information for the nearest available space.

[0736] Step 4:

[0737] The server sends the location information of the identified free space to the terminal. The input data is the location information of the nearest free space. The server transfers this to the user terminal via the network. The output data is the location information of the free space displayed on the user terminal.

[0738] Step 5:

[0739] The terminal displays navigation information to the user based on the received location information. The input data is the location information of the available space sent from the server. The terminal generates a map and navigation instructions based on the location information and displays them to the user. The output data is the navigation information displayed on the terminal screen.

[0740] Step 6:

[0741] The user follows the app's navigation to the designated vacant space. The input data is navigation information. The user uses this information to navigate the parking lot and reach the desired vacant space. The output is parking in the designated vacant space.

[0742] Step 7:

[0743] The user taps the "Reserve" button and sends a request from their device to reserve an available space in advance. The input data is the user's action. The device detects this action, generates a reservation request, and sends it to the server. The output data is the reservation request information.

[0744] Step 8:

[0745] The server receives a reservation request and changes the specified free space to a reserved state. The input data is the reservation request information. The server updates the free space information in the database and sets the specified free space to a reserved state. The output data is the updated free space information.

[0746] Step 9:

[0747] The server sends a reservation completion notification to the terminal. The input data is the updated available space information. The server generates a reservation completion notification and sends it to the user terminal via the network. The output data is the reservation completion notification.

[0748] Step 10:

[0749] The terminal displays a confirmation of the reservation completion to the user. The input data is the reservation completion notification sent from the server. The terminal displays this information to the user, informing them that the reservation is complete. The output data is the confirmation message displayed on the terminal screen.

[0750] Step 11:

[0751] The server manages and updates store location information and floor map data within the shopping facility. Input data consists of location and floor map information provided by each store. The server stores this data in a database, maintaining it at all times. Output data consists of the managed store location and floor map data.

[0752] Step 12:

[0753] The user opens the app and enters the name of the store they wish to visit. The input data consists of the user's actions and the store name. The device sends this information to the server. The output data is the transmitted store name information.

[0754] Step 13:

[0755] The server searches for the location information of the relevant store and calculates the optimal route from the current location. The input data is the store name information and the current location information. Based on this data, the server calculates the optimal route and generates route information. The output data is the generated route information.

[0756] Step 14:

[0757] The server sends route information to the user terminal. The input data is the generated route information. The server transmits this information to the terminal via the network. The output data is the route information sent to the user terminal.

[0758] Step 15:

[0759] The terminal displays the received route information as a map and initiates route guidance for the user. The input data is route information transmitted from the server. The terminal generates a map and route instructions and displays them to the user. The output data is the route guidance information displayed on the terminal screen.

[0760] Step 16:

[0761] The user follows the map directions on their device to reach their destination store. The input data is route guidance information. Based on this information, the user navigates within the shopping facility and reaches their destination. The output is arrival at the destination store.

[0762] Step 17:

[0763] The server collects real-time inventory information from each store and updates the database. The input data is the inventory information provided by each store. The server uses this data to keep the inventory information constantly up-to-date. The output data is the updated inventory information.

[0764] Step 18:

[0765] The user selects a virtual shop in the mobile app and starts a session. Input data consists of the user's actions and virtual shop selection information. The device sends this information to the server. Output data is the transmitted virtual shop selection information.

[0766] Step 19:

[0767] The server generates virtual shop access information and sends it to the terminal. The input data is the virtual shop selection information. The server generates access information and sends it to the user terminal. The output data is the transmitted access information.

[0768] Step 20:

[0769] The terminal displays the entrance to the virtual shop to the user and prompts them to access it. The input data is the access information sent from the server. The terminal displays the virtual shop access screen to the user. The output data is the entrance to the virtual shop displayed on the terminal screen.

[0770] Step 21:

[0771] The user enters a virtual shop, freely explores the VR space, and selects products. Input data consists of the user's actions and selections. The user selects products of interest within the VR space, and the terminal sends this information to the server. Output data is the transmitted product selection information.

[0772] Step 22:

[0773] The server checks the inventory information of the selected product and sends a list of available products to the terminal. The input data is the product selection information. The server queries the inventory information and generates a list of available products. The output data is the generated list of available products.

[0774] Step 23:

[0775] The terminal displays a list of available products to the user and shows a screen to initiate the purchase process. The input data is the list of available products sent from the server. The terminal displays this list to the user and prompts them to make a purchase. The output data is the purchase process screen displayed on the terminal screen.

[0776] Step 24:

[0777] The user selects the product they wish to purchase and taps the "Purchase" button. The input data consists of the user's actions and selections. The device collects this information and sends the purchase request and payment information to the server. The output data consists of the transmitted purchase request and payment information.

[0778] Step 25:

[0779] The server completes the payment process and notifies the terminal of the result. The input data consists of the purchase request and payment information. The server processes the payment, generates a completion notification, and sends it to the user's terminal. The output data is the sent payment completion notification.

[0780] Step 26:

[0781] The terminal displays a payment completion notification to the user. The input data is the payment completion notification sent from the server. The terminal displays this information to the user, informing them that the purchase is complete. The output data is the payment completion confirmation message displayed on the terminal screen.

[0782] Step 27:

[0783] The device uses the user's camera and microphone to analyze the user's facial expressions and voice tone in real time and acquire emotional information. The input data consists of the user's facial expression images and audio data. The device analyzes this data and sends the emotional information to the server. The output data is the transmitted emotional information.

[0784] Step 28:

[0785] The emotion engine analyzes emotional information and sends the emotional state to the server. The input data consists of the user's facial expressions and voice data. The emotion engine uses an emotion analysis algorithm to analyze the data and generate an emotional state. The output data is the generated emotional state.

[0786] Step 29:

[0787] The server dynamically changes the guidance method and displayed content based on emotional information to provide the user with the most optimal service. Input data includes emotional state, the user's current location, and destination information. The server automatically adjusts the guidance content based on this data and sends it to the user's terminal. Output data is the dynamically modified guidance information.

[0788] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0789] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0790] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0791] [Second Embodiment]

[0792] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0793] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0794] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0795] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0796] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0797] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0798] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0799] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0800] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0801] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0802] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0803] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0804] This invention includes a system that uses various sensors to detect available parking spaces, guides users to the most suitable available space based on their current location, and reserves that space in advance; a system that guides users to the optimal route to a destination store within a shopping facility; and a system that allows users to select and purchase products using the virtual space of each store. The details and specific examples of the overall system's program processing are described below.

[0805] (1) Guiding and securing parking spaces in advance

[0806] Explanation of program processing

[0807] 1. The server acquires real-time data from various sensors in the parking lot (e.g., cameras and ultrasonic sensors). This allows the server to understand the current status of available parking spaces.

[0808] 2. The device obtains the user's current location information using GPS and sends it to the server.

[0809] 3. The server identifies the nearest available parking space based on information about available spaces in the parking lot and the user's current location.

[0810] 4. The terminal navigates the user in real time based on the location information of available spaces received from the server.

[0811] 5. The user taps the "Reserve" button on the app to reserve an available space in advance.

[0812] 6. The server receives the user's reservation information and sets the available space to a reserved state.

[0813] 7. The device displays a notification to the user that the reservation is complete.

[0814] Specific example

[0815] The server collects real-time data on available parking spaces for 150 cars and creates a list of available spaces.

[0816] The user opens a parking search page using a mobile app and finds the nearest available space from their current location.

[0817] The server obtains the user's current location from GPS data and presents the nearest available space (e.g., space number 35) from the list of available spaces.

[0818] The terminal will show the user the optimal route and guide them to space number 35 using voice guidance.

[0819] The user taps "Reserve Space 35" to reserve the space in advance.

[0820] The server checks the reservation information and updates it so that space 35 is not displayed to other users.

[0821] The device displays a reservation completion notification to the user.

[0822] (2) Guiding customers to the optimal store layout

[0823] Explanation of program processing

[0824] 1. The server manages the location information and floor maps of all stores within the shopping facility and stores them in a database.

[0825] 2. The user enters the store they want to visit using the terminal app.

[0826] 3. The device obtains the user's current location information via GPS and sends it to the server.

[0827] 4. The server calculates the optimal route based on the current location and destination information, and sends that route information to the terminal.

[0828] 5. The device displays the optimal route in map format and provides real-time guidance to the user.

[0829] Specific example

[0830] The user launches the smartphone app at the entrance of the shopping mall and searches for "XYZ Shop".

[0831] The server consults the floor map and confirms that the XYZ shop is located at the far end of the third floor.

[0832] The device obtains its current location information and requests the server to provide the shortest route, taking into account the location of the escalator.

[0833] The server calculates the route and generates directions such as, "Take the escalator up to the 3rd floor and turn right."

[0834] The device displays route information as a map and navigates the user.

[0835] (3) VR customer service and sales at each store

[0836] Explanation of program processing

[0837] 1. The server retrieves real-time inventory information from each store and updates the database.

[0838] 2. The user uses a mobile app to select the store where they would like to receive VR customer service.

[0839] 3. The device sends a request to the server to start the VR customer service session.

[0840] 4. The server sends access information to the virtual shop to the terminal and begins generating the VR space.

[0841] 5. Users interactively select products within the VR space and add them to their cart.

[0842] 6. The server receives the user's selection information and checks the inventory status in real time.

[0843] 7. The device displays purchasable items to the user and allows them to proceed with the purchase.

[0844] 8. The user taps the purchase button, and the payment process is completed.

[0845] 9. The server receives payment completion information and begins the process of shipping the goods.

[0846] Specific example

[0847] The server receives the latest inventory data from electronics parts store B and updates product information such as "resistor set".

[0848] The user launches a smartphone app and begins a VR customer service experience at electronics parts store B.

[0849] The server generates a VR customer service session and sends virtual shop access information to the user's device.

[0850] The terminal displays a realistic virtual shop, and the user selects a "resistor set" from the virtual shelf.

[0851] The server checks the inventory status and confirms that the selected product is available for purchase.

[0852] The user taps the "Purchase" button and completes the payment process on their device.

[0853] The server receives notification that payment has been completed and begins the process of shipping the goods.

[0854] Thus, the present invention makes it possible to realize a system that provides an integrated service including guidance on available parking spaces, store guidance within commercial facilities, and an online shopping experience for each store.

[0855] The following describes the processing flow.

[0856] (1) Guiding and securing parking spaces in advance

[0857] Specific steps in program processing

[0858] Step 1:

[0859] The server acquires data from various sensors in the parking lot (cameras, ultrasonic sensors, etc.) and determines whether or not there are available parking spaces.

[0860] Step 2:

[0861] The device obtains the user's current location information using GPS and sends that information to the server.

[0862] Step 3:

[0863] The server integrates information about available space with the user's current location to identify the nearest available space.

[0864] Step 4:

[0865] The server sends location information of the available space it has identified to the terminal.

[0866] Step 5:

[0867] Based on the location information received by the device, navigation information to an available space is displayed to the user.

[0868] Step 6:

[0869] The user follows the navigation in the app and heads to the designated empty space.

[0870] Step 7:

[0871] The user taps the "Reserve" button to send a request from their device to reserve an available space in advance.

[0872] Step 8:

[0873] The server receives the reservation request and changes the specified available space to a reserved state.

[0874] Step 9:

[0875] The server sends a reservation confirmation to the device.

[0876] Step 10:

[0877] The device displays a confirmation to the user that the reservation is complete.

[0878] (2) Guiding customers to the optimal store layout

[0879] Specific steps in program processing

[0880] Step 1:

[0881] The server manages and updates location information and floor map data for all stores within the shopping complex.

[0882] Step 2:

[0883] The user opens the app and enters the name of the store they want to visit.

[0884] Step 3:

[0885] The terminal sends the entered store name to the server.

[0886] Step 4:

[0887] The server searches for the location information of the relevant store and calculates the optimal route from the current location.

[0888] Step 5:

[0889] The device uses GPS to obtain its current location information, which is then sent to the server.

[0890] Step 6:

[0891] The server calculates the most suitable route for the user based on their current location and the location of the store, and sends that information to their device.

[0892] Step 7:

[0893] The terminal displays the route information it has received as a map and begins providing route guidance to the user.

[0894] Step 8:

[0895] The user follows the map directions on their device to reach their destination store.

[0896] (3) VR customer service and sales at each store

[0897] Specific steps in program processing

[0898] Step 1:

[0899] The server collects real-time inventory information from each store and updates the database.

[0900] Step 2:

[0901] The user selects the store where they want to receive VR customer service via a mobile app and starts the session.

[0902] Step 3:

[0903] The device sends a session start request to the server, specifying the selected store.

[0904] Step 4:

[0905] The server generates access information for the virtual shop and sends it to the terminal.

[0906] Step 5:

[0907] The device displays the entrance to the virtual shop to the user and prompts them to access it.

[0908] Step 6:

[0909] When a user enters a virtual shop, they can freely explore the VR space and select products.

[0910] Step 7:

[0911] The device sends information about the product selected by the user to the server.

[0912] Step 8:

[0913] The server checks the inventory information of the selected product and sends a list of available products to the terminal.

[0914] Step 9:

[0915] The device displays a list of purchasable items to the user and shows a screen to begin the purchase process.

[0916] Step 10:

[0917] The user selects the product they want to purchase and taps the "Purchase" button.

[0918] Step 11:

[0919] The device sends the purchase request and payment information to the server.

[0920] Step 12:

[0921] The server completes the payment process and notifies the terminal of the result.

[0922] Step 13:

[0923] The device displays a notification to the user that the payment has been completed.

[0924] This clarifies how each processing step of the system is performed, allowing users to efficiently enjoy parking reservations, store directions, and online shopping experiences.

[0925] (Example 1)

[0926] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0927] Currently, many parking lots present challenges such as difficulty in confirming and securing available parking spaces, resulting in wasted time and effort for users. Furthermore, the time required for navigating stores within shopping facilities and selecting products within each store hinders efficient shopping. Additionally, online shopping presents problems such as low user satisfaction due to the difficulty in checking inventory in real time and selecting products virtually.

[0928] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0929] In this invention, the server includes means for detecting available parking spaces using various sensors, means for acquiring current location information from the user's terminal, means for guiding the user to the nearest available space based on the available space information and current location information, means for reserving a designated available space in advance, means for the server to collect available space information in real time and store it in a database, means for the terminal to acquire the user's current location using GPS and transmit it to the server, means for the server to identify the optimal available space based on the available space information and the user's current location information, and means for the terminal to navigate the user in real time based on the location information of the available space received from the server. This not only enables efficient confirmation and reservation of available parking spaces but also reduces the effort and time required from the user. Furthermore, by including means for managing store location information and floor map information within the shopping facility, and means for receiving destination information entered from the user's terminal, generating the optimal route based on the destination information and current location information, and transmitting the generated route information to the user terminal, store guidance within the shopping facility can be facilitated smoothly. Furthermore, by including means for obtaining inventory information from each store in real time, displaying a virtual store space based on input from the user's terminal, receiving product selections within the virtual space, and processing purchases of selected products, users can select and purchase products online in real time.

[0930] A "sensor" is a device that detects physical or chemical phenomena and converts them into electrical signals.

[0931] A "parking lot" is a space or facility for temporarily parking vehicles.

[0932] "Available space" refers to unused parking spaces where vehicles can be parked.

[0933] A "device" refers to an electronic device used by a user, specifically a smartphone or tablet.

[0934] "Current location information" refers to data that indicates the current geographical location of the user or device.

[0935] A "server" is a computer system that provides services to client terminals over a network.

[0936] A "database" is a system that structures and stores large amounts of data, enabling efficient searching and manipulation.

[0937] GPS is a global positioning system used to obtain location information on Earth.

[0938] An "optimal route" is the route that minimizes both distance and time from the starting point to the destination.

[0939] "Navigate" means to guide someone on a route to their destination.

[0940] A "shopping facility" is a commercial complex that houses a large number of stores.

[0941] "Store location information" refers to data that shows where each store is located within a shopping facility.

[0942] A "floor map" is a map that shows the layout of each floor in a shopping facility.

[0943] A "virtual space" is a virtual reality space created using computer graphics.

[0944] "Inventory information" refers to data that shows the availability status of a product.

[0945] "Purchase procedure" refers to a series of operations or procedures necessary to purchase a product.

[0946] The present invention includes a system for detecting available parking spaces, guiding users to the most suitable available space based on their current location, and reserving that space in advance; a system for guiding users to the optimal route to a destination store within a shopping facility; and a system for selecting and purchasing products using the virtual space of each store. Specific embodiments of each system are shown below.

[0947] Guiding and securing parking spaces in advance

[0948] The server acquires real-time data from various sensors in the parking lot (e.g., cameras and ultrasonic sensors). Cameras use image recognition technology to detect the availability of each parking space, and ultrasonic sensors detect available spaces based on distance data. This data is sent to the server and stored in a database.

[0949] The device obtains the user's current location information using GPS and sends that information to the server. To provide highly accurate location information, the GPS function also utilizes Wi-Fi and mobile network information.

[0950] The server identifies the nearest available parking space based on information about available spaces in the parking lot and the user's current location. This is calculated using algorithms such as Dijkstra's algorithm.

[0951] The system navigates the user in real time based on location information of available spaces received by the terminal from the server. Navigation is provided via map display and voice guidance. This allows the user to intuitively understand the optimal route.

[0952] The user checks the available space on the mobile app and taps the "Reserve" button. This action sends a reservation request to the server.

[0953] The server receives the user's reservation request and updates the available space to a reserved status. The reservation information is immediately saved to the database and reflected in other terminals in real time.

[0954] The device displays a reservation confirmation notification to the user. The notification includes detailed information about the reserved space.

[0955] Specific example

[0956] The server collects real-time data on available parking spaces for 150 cars and creates a list of available spaces.

[0957] The user opens a parking search page using a mobile app and finds the nearest available space from their current location.

[0958] The server obtains the user's current location from GPS data and presents the nearest available space (e.g., space number 35) from the list of available spaces.

[0959] The terminal will show the user the optimal route and guide them to space number 35 using voice guidance.

[0960] The user taps "Reserve Space 35" to reserve the space in advance.

[0961] The server checks the reservation information and updates it so that space 35 is not displayed to other users.

[0962] The device displays a reservation completion notification to the user.

[0963] Guidance to the optimal store flow

[0964] The server manages the location information and floor maps of all stores within the shopping complex and stores them in a database. This includes the name of each store, its location on the floor, and the distance between stores.

[0965] The user enters the name of the store they want to visit using a terminal app, the terminal obtains the user's current location using GPS, and sends that information to the server. To provide highly accurate location information, the terminal also uses location information from Wi-Fi and mobile networks.

[0966] The server calculates the optimal route based on the user's current location and destination. It also considers the location of escalators and elevators, using algorithms such as Dijkstra's to determine the most efficient route for the user to reach their destination.

[0967] The device displays the optimal route information received from the server in map format. It provides real-time navigation, ensuring the user reaches their destination without getting lost.

[0968] Specific example

[0969] The user launches the smartphone app at the entrance of the shopping mall and searches for "XYZ Shop".

[0970] The server consults the floor map and confirms that the XYZ Shop is located on the 3rd floor.

[0971] The device obtains its current location information and requests the server to calculate the shortest route, taking into account the location of the escalator.

[0972] The server calculates the route and generates directions such as, "Take the escalator up to the 3rd floor and turn right."

[0973] The device displays route information as a map and navigates the user.

[0974] VR customer service and sales at each store

[0975] The server retrieves the latest inventory information from each store in real time and updates the database. This includes information such as product name, stock quantity, and price.

[0976] When a user requests a VR customer service experience at a designated store using a mobile app, the device sends the request to the server. The server receives this request, sends access information to the virtual shop, and generates the VR space.

[0977] The user interactively selects products in a VR space, and the server receives this selection information to check inventory status in real time. It instantly checks whether the selected product is in stock.

[0978] The device displays available products to the user, who then proceeds with the purchase. The user taps the "Purchase" button and enters their payment information.

[0979] The server receives payment completion information and begins the shipping process for the product. The shipping status is updated in real time, and the user receives a notification.

[0980] Specific example

[0981] The server retrieves the latest inventory data from the electronics parts store and updates product information such as "resistor sets".

[0982] The user launches a smartphone app and begins a VR customer service experience at an electronics parts store.

[0983] The server generates a VR customer service session and sends virtual shop access information to the user's device.

[0984] The terminal displays a realistic virtual shop, and the user selects a "resistor set" from the virtual shelf.

[0985] The server checks the inventory status and confirms that the selected product is available for purchase.

[0986] The user taps the "Purchase" button and completes the payment process on their device.

[0987] The server receives notification that payment has been completed and begins the process of shipping the goods.

[0988] This makes it possible to efficiently check and secure available parking spaces, guide customers to stores within shopping facilities, and perform real-time inventory checks and virtual product selections in online shopping.

[0989] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0990] Guiding and securing parking spaces in advance

[0991] Step 1:

[0992] The server acquires real-time data from various sensors in the parking lot (cameras and ultrasonic sensors). The sensors collect data from the physical environment and send it to the server. The data acquired here includes the availability of parking spaces. The server analyzes this data, identifies available parking spaces, and stores them in a database.

[0993] Input: Real-time data from sensors

[0994] Data processing: Collection and analysis of sensor data

[0995] Output: Information on available parking spaces (saved in database)

[0996] Specific operation: The camera acquires images and uses image processing techniques to identify available spaces. The ultrasonic sensor measures distance and uses that to identify available spaces.

[0997] Step 2:

[0998] The device acquires the user's current location information using GPS and transmits that information to the server. The GPS module receives signals from satellites and calculates the current location. This location information is processed within the device and transmitted to the server as high-precision location information along with WiFi and mobile network data.

[0999] Input: Location data from GPS

[1000] Data processing: Acquisition and transmission of location data

[1001] Output: Current location information (sent to server)

[1002] Specific operation: The device periodically receives GPS signals and processes the data to determine its exact current location.

[1003] Step 3:

[1004] The server identifies the nearest available parking space based on information about available spaces in the parking lot and the user's current location. The server uses route-finding algorithms such as Dijkstra's algorithm to identify the nearest unused parking space from the user's current location. This calculation result is stored on the server.

[1005] Input: Information on available parking spaces, current location information

[1006] Data processing: Optimal space identification using pathfinding algorithms.

[1007] Output: Optimal free space information (stored on the server)

[1008] Specific operation: The server retrieves available space information and current location information from the database and applies an algorithm to calculate the optimal route.

[1009] Step 4:

[1010] The device navigates the user in real time based on location information of available spaces received from the server. The device uses a navigation app to provide map display and voice guidance. This allows the user to intuitively understand the optimal route.

[1011] Input: Information on the best available space

[1012] Data processing: Generating navigation information

[1013] Output: Navigation information (displayed on the device and voice guidance)

[1014] Specific operation: The device generates visuals using map data and generates guidance voices using speech synthesis technology.

[1015] Step 5:

[1016] The user checks for available spaces on the mobile app and taps the "Reserve" button. The user's action sends a reservation request from the device to the server. Before submitting the reservation request, the user checks the details of the parking space (e.g., space number, location, etc.).

[1017] Input: User reservation request

[1018] Data processing: Generating and sending reservation requests

[1019] Output: Reservation request (sent to server)

[1020] Specific action: The user interacts with the app's interface and taps the reservation button.

[1021] Step 6:

[1022] The server receives a user's reservation request and updates the available space to a reserved status. The reservation information is immediately saved to the database and reflected in other terminals in real time. As a result, other users will no longer be able to reserve that space.

[1023] Input: Reservation Request

[1024] Data processing: Updating reservation information and saving it to the database.

[1025] Output: Updated reservation information (saved in database)

[1026] Specific operation: The server processes the reservation request and changes the corresponding record in the database to a reserved state.

[1027] Step 7:

[1028] The device displays a reservation confirmation notification to the user. The notification includes details of the reserved space (e.g., space number, reservation time, etc.). This allows the user to confirm which space they have reserved.

[1029] Input: Reservation confirmation information

[1030] Data processing: Generating and displaying reservation completion notifications.

[1031] Output: Reservation completion notification (displayed on the device)

[1032] Specific operation: The device's notification function will be used to notify the user of the reservation completion information in the form of a pop-up or alert.

[1033] Guidance to the optimal store flow

[1034] Step 1:

[1035] The server manages the location information and floor maps of all stores within the shopping complex and stores them in a database. This includes the name of each store, its location on the floor, and the distance between stores.

[1036] Input: Store location information and floor map information

[1037] Data processing: Information management and storage in databases

[1038] Output: Management information in the database

[1039] Specific operation: The server periodically updates the database to maintain the latest store location information.

[1040] Step 2:

[1041] The user uses the store search function in the device app to enter the name of the store they want to visit. The search query is sent from the device to the server, which retrieves the store's location information.

[1042] Input: User's search query

[1043] Data processing: Generating and sending search queries

[1044] Output: Search results (sent to server)

[1045] Specific operation: The terminal processes information entered through the user interface and sends it to the server.

[1046] Step 3:

[1047] The device obtains the user's current location information via GPS and sends that information to the server. GPS data is sent to the server along with location information from Wi-Fi or mobile networks.

[1048] Input: GPS data and other location information

[1049] Data processing: Acquisition and transmission of location data

[1050] Output: Current location information (sent to server)

[1051] Specific operation: The device periodically updates its location information and sends it to the server.

[1052] Step 4:

[1053] The server calculates the optimal route based on the user's current location and destination information. Using the Dijkstra algorithm, it calculates the route that will allow the user to reach their destination most efficiently and stores the result on the server.

[1054] Input: Current location information and destination information

[1055] Data processing: Calculation and storage of the optimal route

[1056] Output: Optimal route information (stored on the server)

[1057] Specific operation: The server uses an algorithm to derive the optimal route based on the current location and destination information obtained from the database.

[1058] Step 5:

[1059] The terminal displays the optimal route information received from the server in map format, providing real-time guidance to the user. The map display is done using a GUI, and voice guidance is also used in conjunction.

[1060] Input: Optimal route information

[1061] Data processing: Generation and display of map information

[1062] Output: Navigation information (displayed on the device and voice guidance)

[1063] Specific operation: The terminal generates visual guidance based on map data and provides voice guidance using speech synthesis technology.

[1064] VR customer service and sales at each store

[1065] Step 1:

[1066] The server retrieves the latest inventory information from each store in real time and updates the database. This includes information such as product name, stock quantity, and price.

[1067] Input: Inventory information from the store

[1068] Data processing: Retrieving inventory information and updating the database.

[1069] Output: Updated inventory information (saved in database)

[1070] Specific operation: The server periodically retrieves inventory information from each store and updates the database with the latest information.

[1071] Step 2:

[1072] The user uses a mobile app to select the store where they would like to receive VR customer service. The user selects their desired store from the store list in the app, and this information is sent to the server.

[1073] Input: User's store selection information

[1074] Data processing: Generating and transmitting store selection information.

[1075] Output: Store selection information (sent to server)

[1076] Specific operation: The user interacts with the app's interface to select their desired store.

[1077] Step 3:

[1078] The device sends a request to the server to start a VR customer service session. The server processes the request and sends virtual shop access information to the device.

[1079] Input: Start Request

[1080] Data processing: Generating and sending requests

[1081] Output: Access information (sent to the terminal)

[1082] Specific operation: The terminal sends a request to the server and waits for a response from the server.

[1083] Step 4:

[1084] Users interactively select products in a VR space and add them to their cart. Users choose products from a virtual shelf, and this information is sent from the terminal to the server.

[1085] Input: User's selected information

[1086] Data processing: Generation and transmission of selected information

[1087] Output: Selection information (sent to server)

[1088] Specific actions: The user operates the VR interface to select products and add them to the cart.

[1089] Step 5:

[1090] The server receives the user's selection information and checks the inventory status in real time. It immediately checks whether the selected product is in stock and saves the result on the server.

[1091] Input: User's selected information

[1092] Data processing: Checking inventory status and saving results.

[1093] Output: Inventory check results (save on the server)

[1094] Specific operation: The server retrieves inventory information from the database and checks whether the selected product is in stock.

[1095] Step 6:

[1096] The device displays available products to the user, and the user proceeds with the purchase. The user taps the "Purchase" button within the app and enters their payment information.

[1097] Input: Inventory check results, user purchase request

[1098] Data processing: Generation and transmission of purchase procedure information.

[1099] Output: Purchase procedure information (sent to server)

[1100] Specific action: The device displays the purchase procedure screen, allowing the user to enter payment information.

[1101] Step 7:

[1102] The server receives payment completion information and begins the shipping process for the goods. The shipping status is updated in real time, and a notification is sent to the user.

[1103] Input: Payment completion information

[1104] Data processing: Initiation and status update of delivery procedures.

[1105] Output: Delivery status notification (sent to user)

[1106] Specific operation: The server verifies the payment information and automatically starts the shipping process. The shipping status is updated regularly and notified to the user.

[1107] (Application Example 1)

[1108] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[1109] In modern urban areas and commercial facilities, finding available parking spaces is often difficult, resulting in wasted time and effort. Furthermore, locating specific stores within shopping centers can be stressful for customers. With the rise of online shopping, remote shopping from physical stores has increased, but managing inventory and product information remains complex. These challenges need to be efficiently addressed by a single system.

[1110] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1111] In this invention, the server includes means for detecting available parking spaces using various sensors, means for acquiring current location information from the user's terminal, means for guiding the user to the nearest available space based on the available space information and current location information, means for reserving a designated available space in advance, means for acquiring and updating inventory information and 3D model data of products from each store from a remote server, means for acquiring location information and gaze information from the user's smart glasses, means for detecting when the user's gaze is fixed on a specific product model and transmitting detailed information about that product to the user's smart glasses, means for waiting for a voice command from the user based on the product information displayed on the smart glasses, and means for reconfirming product inventory and proceeding with the purchase procedure based on the voice command. This enables efficient detection and navigation of available parking spaces, store guidance within shopping facilities, and product selection and purchase procedures in a virtual space.

[1112] A "sensor" is a device that detects physical phenomena and converts them into electrical signals.

[1113] A "terminal" is a computer or mobile device operated by a user.

[1114] "Current location information" refers to the user's geographical location data obtained using GPS or other location measurement technologies.

[1115] "Available space information" refers to data about parking spaces currently available within the parking lot.

[1116] A "remote server" is a computer system located in a remote location that is accessed via a network.

[1117] "Inventory information" refers to detailed data on the goods and products currently stored in the store.

[1118] "3D model data" refers to digital data that represents the three-dimensional shape of an object or product.

[1119] "Smart glasses" are glasses-type devices that display information from virtual reality and augmented reality, and have the function of tracking the user's gaze and movements.

[1120] "Eye-gaze information" refers to data about the direction and focus of a user's gaze.

[1121] A "voice command" is an input that allows the system to understand and process instructions and commands spoken by the user.

[1122] System Configuration

[1123] The system that realizes this invention uses the following main hardware and software.

[1124] Hardware: Various sensors (cameras, ultrasonic sensors, etc.), smart glasses (glasses-type devices), user terminals (smartphones and tablets), remote servers (cloud servers)

[1125] Software: GPS data acquisition library, eye tracking library, speech recognition API, 3D model display library

[1126] Data acquisition and processing

[1127] The server acquires data in real time from various sensors in the parking lot and updates the information on available parking spaces. The server also acquires inventory information and 3D model data of products from all stores within the shopping facility and updates the database. User terminals acquire their current location information using GPS and send it to the server. This enables real-time guidance on available parking spaces and reservations.

[1128] Operation using smart glasses

[1129] The user wears smart glasses, and their gaze data is acquired. The server detects when the user's gaze is fixed on a 3D model of a specific product and sends the product's details to the smart glasses. The user can then use voice commands to add the product to their cart and proceed with the purchase. During this process, the server recognizes the voice commands, reconfirms product availability, and updates the order information.

[1130] Specific example

[1131] Parking space availability and reservation: Users use their smartphones to search for available parking spaces and are shown the closest available space to their current location. When a user reserves a space through the app, the server updates the listing so that the space is not visible to other users.

[1132] Store guidance within a shopping mall: Users use their smartphones within the mall to search for their destination store. The server calculates the optimal route based on the user's current location and destination information and sends it to the user's device. Users receive real-time guidance as they head to their desired store.

[1133] Virtual Shopping Experience: Users access a virtual store using smart glasses and view 3D models of products on shelves. By fixing their gaze, detailed product information is displayed, and items can be added to the cart and purchased using voice commands. The server checks inventory information and proceeds with the purchase.

[1134] Example of a prompt

[1135] "Please provide a detailed explanation of the system that allows users to fix their gaze on products in a virtual store through smart glasses, view detailed information, add items to their cart using voice commands, and complete the purchase process."

[1136] This invention solves the problem of vacant parking spaces, improves the efficiency of store guidance within shopping facilities, and enhances the virtual shopping experience.

[1137] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1138] Step 1:

[1139] The server acquires real-time data from various sensors in the parking lot (cameras, ultrasonic sensors, etc.). Based on this data, it understands the current status of available parking spaces and updates the database. This ensures that the latest information on available spaces is available.

[1140] Input: Real-time data from various sensors

[1141] Output: Updated free space information

[1142] Step 2:

[1143] The device uses GPS to obtain the user's current location information. This location information is then transmitted to the server via data communication. This ensures the user's current location is accurately determined.

[1144] Input: GPS data

[1145] Output: Current location information

[1146] Step 3:

[1147] The server identifies the nearest available space based on the user's current location and available space information. In this process, it calculates the distance using the coordinate data of the current location and available space, and selects the most suitable available space.

[1148] Input: Current location information, available space information

[1149] Output: Location information for optimal free space

[1150] Step 4:

[1151] The terminal navigates the user to the most suitable available space based on location information received from the server. It uses map displays and voice guidance to direct the user to the available space.

[1152] Input: Location information for the best available space

[1153] Output: Navigation information

[1154] Step 5:

[1155] The user taps the "Reserve" button on the app to reserve an available space in advance. This action sends the reservation information from the device to the server.

[1156] Input: User reservation operation

[1157] Output: Reservation Information

[1158] Step 6:

[1159] The server sets the available space to reserved status based on the received reservation information. It updates the database so that the space is not displayed to other users.

[1160] Input: Reservation Information

[1161] Output: Updated free space information

[1162] Step 7:

[1163] The device displays a reservation completion notification to the user, allowing them to confirm that the reservation was successfully completed.

[1164] Input: Reservation confirmation information

[1165] Output: Booking confirmation

[1166] Step 8:

[1167] The server retrieves inventory information and 3D model data of products from each store within the shopping complex. This information is then updated in a database and used by users when they engage in virtual shopping.

[1168] Input: Store inventory information, 3D model data

[1169] Output: Updated inventory information and 3D model data

[1170] Step 9:

[1171] The user's smart glasses acquire the user's location and gaze information. This information is transmitted to the server in real time.

[1172] Input: User location information, eye-tracking information

[1173] Output: Real-time location information and line-of-sight information

[1174] Step 10:

[1175] The server detects when the user's gaze is fixed on a 3D model of a specific product and sends detailed information about that product to the smart glasses. This information includes the product name, price, and description.

[1176] Input: User eye-tracking information

[1177] Output: Product details

[1178] Step 11:

[1179] The smart glasses wait for the user's voice command (e.g., "Add to cart") based on the displayed product information. A voice recognition API is used to accurately capture the user's instructions.

[1180] Input: Product details

[1181] Output: Voice command

[1182] Step 12:

[1183] The server recognizes the voice command and reconfirms the product's inventory. After confirmation, it updates the order information and sends a notification to the user to proceed with the purchase.

[1184] Input: Voice command

[1185] Output: Updated order information, purchase procedure notification

[1186] The above outlines the specific processing steps for the entire system. This allows users to efficiently access and reserve parking spaces, find store locations, and experience virtual shopping.

[1187] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1188] This invention includes a system that uses various sensors to detect available parking spaces, guides the user to the optimal available space based on their current location, and reserves that space in advance; a system that guides the user to the optimal route to a destination store within a shopping facility; and a system that allows users to select and purchase products using the virtual space of each store. Furthermore, this invention also includes a function to optimize the user experience by incorporating an emotion engine that recognizes the user's emotions. The details and specific examples of the overall system's program processing are described below.

[1189] (1) Guiding and securing parking spaces in advance

[1190] Explanation of program processing

[1191] 1. The server acquires data from various sensors in the parking lot (e.g., cameras and ultrasonic sensors) and determines whether or not there are available parking spaces.

[1192] 2. The device obtains the user's current location information using GPS and sends that information to the server.

[1193] 3. The server integrates information about available space with the user's current location to identify the nearest available space.

[1194] 4. The server sends the location information of the available space it has identified to the terminal.

[1195] 5. Based on the location information received by the device, navigation information to an available space is displayed to the user.

[1196] 6. The user follows the navigation in the app and heads to the designated empty space.

[1197] 7. The user taps the "Reserve" button to send a request from their device to reserve an available space in advance.

[1198] 8. The server receives the reservation request and changes the specified available space to a reserved state.

[1199] 9. The server sends a reservation confirmation to the device.

[1200] 10. The device displays a confirmation to the user that the reservation is complete.

[1201] Specific example

[1202] The server collects real-time data on available parking spaces for 150 cars and creates a list of available spaces.

[1203] The user opens a parking search page using a mobile app and finds the nearest available space from their current location.

[1204] The server obtains the user's current location from GPS data and presents the nearest available space (e.g., space number 35) from the list of available spaces.

[1205] The terminal will show the user the optimal route and guide them to space number 35 using voice guidance.

[1206] The user taps "Reserve Space 35" to reserve the space in advance.

[1207] The server checks the reservation information and updates it so that space 35 is not displayed to other users.

[1208] The device displays a reservation completion notification to the user.

[1209] (2) Guiding customers to the optimal store layout

[1210] Explanation of program processing

[1211] 1. The server manages and updates location information and floor map data for all stores within the shopping facility.

[1212] 2. The user opens the app and enters the name of the store they want to visit.

[1213] 3. The terminal sends the entered store name to the server.

[1214] 4. The server searches for the location information of the relevant store and calculates the optimal route from the current location.

[1215] 5. The device sends its current location information, obtained using GPS, to the server.

[1216] 6. The server calculates the most suitable route for the user based on the user's current location and the store's location, and sends that information to the user's device.

[1217] 7. The terminal displays the received route information as a map and begins providing route guidance to the user.

[1218] 8. The user follows the map directions on their device and proceeds to the desired store.

[1219] (3) VR customer service and sales at each store

[1220] Explanation of program processing

[1221] 1. The server collects real-time inventory information from each store and updates the database.

[1222] 2. The user selects the store where they wish to receive VR customer service via the mobile app and starts the session.

[1223] 3. The terminal sends a session start request to the server, specifying the selected store.

[1224] 4. The server generates access information for the virtual shop and sends it to the terminal.

[1225] 5. The device displays the entrance to the virtual shop to the user and prompts them to access it.

[1226] 6. Once the user enters the virtual shop, they can freely explore the VR space and select products.

[1227] 7. The device sends information about the product selected by the user to the server.

[1228] 8. The server checks the inventory information of the selected product and sends a list of available products to the terminal.

[1229] 9. The device displays a list of purchasable items to the user and shows a screen to begin the purchase process.

[1230] 10. The user selects the product they want to purchase and taps the "Purchase" button.

[1231] 11. The device sends the purchase request and payment information to the server.

[1232] 12. The server completes the payment process and notifies the terminal of the result.

[1233] 13. The terminal displays a notification to the user that the payment has been completed.

[1234] (4) Use of the Emotion Engine

[1235] Explanation of how the emotion engine works

[1236] 1. The device uses the user's camera and microphone to analyze the user's facial expressions and voice tone in real time and acquire emotional information.

[1237] 2. The emotion engine analyzes emotional information and sends the user's emotional state (e.g., stress, joy, frustration) to the server.

[1238] 3. The server uses user sentiment information to dynamically change the guidance methods and displayed content.

[1239] Specific example

[1240] When the device detects stress from the user's facial expression, the server adjusts its settings to provide more concise and faster information about available spaces.

[1241] If a user gets lost in a shopping mall, the emotion engine detects their frustration, and the server adjusts the guidance information to make it easier to understand and view.

[1242] The device detects the user's excitement within the virtual shop, and the server more proactively suggests recommended products.

[1243] Thus, the present invention provides an integrated service combining a parking space availability guide, store guidance within commercial facilities, and online shopping experiences for each store, all in combination with an emotion engine, enabling the delivery of optimal services tailored to the user's emotional state.

[1244] The following describes the processing flow.

[1245] (1) Guiding and securing parking spaces in advance

[1246] Specific steps in program processing

[1247] Step 1:

[1248] The server acquires data from various sensors in the parking lot (such as cameras and ultrasonic sensors) and determines whether or not there are available parking spaces.

[1249] Step 2:

[1250] The device obtains the user's current location information using GPS and sends that information to the server.

[1251] Step 3:

[1252] The server integrates information about available space with the user's current location to identify the nearest available space.

[1253] Step 4:

[1254] The server sends location information of the available space it has identified to the terminal.

[1255] Step 5:

[1256] Based on the location information received by the device, navigation information to an available space is displayed to the user.

[1257] Step 6:

[1258] The user follows the navigation in the app and heads to the designated empty space.

[1259] Step 7:

[1260] The user taps the "Reserve" button to send a request from their device to reserve an available space in advance.

[1261] Step 8:

[1262] The server receives the reservation request and changes the specified available space to a reserved state.

[1263] Step 9:

[1264] The server sends a reservation confirmation to the device.

[1265] Step 10:

[1266] The device displays a confirmation to the user that the reservation is complete.

[1267] (2) Guiding customers to the optimal store layout

[1268] Specific steps in program processing

[1269] Step 1:

[1270] The server manages and updates location information and floor map data for all stores within the shopping complex.

[1271] Step 2:

[1272] The user opens the app and enters the name of the store they want to visit.

[1273] Step 3:

[1274] The terminal sends the entered store name to the server.

[1275] Step 4:

[1276] The server searches for the location information of the relevant store and calculates the optimal route from the current location.

[1277] Step 5:

[1278] The device uses GPS to obtain its current location information, which is then sent to the server.

[1279] Step 6:

[1280] The server calculates the most suitable route for the user based on their current location and the location of the store, and sends that information to their device.

[1281] Step 7:

[1282] The terminal displays the route information it has received as a map and begins providing route guidance to the user.

[1283] Step 8:

[1284] The user follows the map directions on their device to reach their destination store.

[1285] (3) VR customer service and sales at each store

[1286] Specific steps in program processing

[1287] Step 1:

[1288] The server collects real-time inventory information from each store and updates the database.

[1289] Step 2:

[1290] The user selects the store where they want to receive VR customer service via a mobile app and starts the session.

[1291] Step 3:

[1292] The device sends a session start request to the server, specifying the selected store.

[1293] Step 4:

[1294] The server generates access information for the virtual shop and sends it to the terminal.

[1295] Step 5:

[1296] The device displays the entrance to the virtual shop to the user and prompts them to access it.

[1297] Step 6:

[1298] When a user enters a virtual shop, they can freely explore the VR space and select products.

[1299] Step 7:

[1300] The device sends information about the product selected by the user to the server.

[1301] Step 8:

[1302] The server checks the inventory information of the selected product and sends a list of available products to the terminal.

[1303] Step 9:

[1304] The device displays a list of purchasable items to the user and shows a screen to begin the purchase process.

[1305] Step 10:

[1306] The user selects the product they want to purchase and taps the "Purchase" button.

[1307] Step 11:

[1308] The device sends the purchase request and payment information to the server.

[1309] Step 12:

[1310] The server completes the payment process and notifies the terminal of the result.

[1311] Step 13:

[1312] The device displays a notification to the user that the payment has been completed.

[1313] (4) Use of the Emotion Engine

[1314] Explanation of how the emotion engine works

[1315] Step 1:

[1316] The device uses the user's camera and microphone to analyze the user's facial expressions and voice tone in real time and acquire emotional information.

[1317] Step 2:

[1318] The emotion engine analyzes emotional information and sends the user's emotional state (e.g., stress, joy, frustration) to the server.

[1319] Step 3:

[1320] The server receives emotional information and dynamically changes the guidance method and displayed content based on the user's emotional state.

[1321] Specific example

[1322] Parking guidance case

[1323] If the device detects stress from the user's facial expressions, the server adjusts the display of guidance information to be more concise and faster.

[1324] Shopping mall information case

[1325] When the emotion engine detects that a user is lost and frustrated in a store, the server adjusts the guidance information to make it easier to understand and view.

[1326] Cases within a virtual shop

[1327] When the device detects the user's excited facial expression, the server more proactively suggests recommended products, increasing the likelihood of a purchase.

[1328] Thus, the present invention provides an integrated service combining a parking space availability guide, store guidance within commercial facilities, and online shopping experiences for each store, all in combination with an emotion engine, enabling the delivery of optimal services tailored to the user's emotional state.

[1329] (Example 2)

[1330] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[1331] Conventional parking management systems can detect available spaces, acquire user location information, and provide guidance, but they fail to provide efficient guidance and services that take into account the user's emotional state. This can lead to a decline in the quality of the user experience and potentially impair user convenience. Furthermore, providing optimal services that reflect the user's emotional state is also a challenge in store guidance and virtual shopping.

[1332] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1333] In this invention, the server includes means for detecting available parking spaces using various sensors, means for acquiring current location information from the user's terminal, means for guiding the user to the nearest available parking space based on the available space information and current location information, means for reserving a designated available parking space in advance, means for acquiring emotional information, means for analyzing emotional information, and means for dynamically changing the guidance method and display content based on the emotional information. This makes it possible to provide optimal guidance according to the user's emotional state, thereby improving the quality of the user experience.

[1334] "Various sensors" is a general term for devices such as cameras and ultrasonic sensors used to detect available parking spaces and other conditions.

[1335] "User's device" refers to a mobile device such as a smartphone or tablet used by the user, and is a device used to acquire and transmit current location information and other data.

[1336] "Current location information" refers to the user's real-time location data obtained using location information acquisition technologies such as GPS.

[1337] "Available space information" refers to data obtained from various sensors regarding the availability of parking spaces.

[1338] "Guidance means" refers to methods and means for notifying users of the optimal route to available spaces or stores, and includes map displays and voice guidance.

[1339] "Prior reservation methods" refer to methods or systems that allow users to reserve a specific available space and prevent other users from using that space.

[1340] "Emotional information" refers to data on the user's emotional state obtained by analyzing the user's facial expressions, voice tone, and other information acquired using the user's camera and microphone.

[1341] "Means for analyzing emotional information" refers to analytical algorithms and systems used to determine a user's emotional state based on acquired emotional information.

[1342] "Means of dynamic modification" refers to technologies and systems that change guidance methods and displayed content in real time according to the user's emotional information.

[1343] "Store location information" refers to data that indicates the specific location of each store within a shopping facility.

[1344] "Floor map information" refers to map data that shows the layout of all stores and facilities within a shopping complex.

[1345] "Inventory information" refers to data that shows the inventory status of products held by each store.

[1346] A "virtual space" is a virtual shop space that users can access using virtual reality technology.

[1347] "Product selection" refers to the act of a user choosing a product in a virtual space with the intention of purchasing it.

[1348] "Purchase procedure" refers to a series of steps taken to complete the purchase of selected items, including entering and confirming payment information.

[1349] This invention includes a system that uses various sensors to detect available parking spaces, guides the user to the optimal available space based on their current location, and reserves that space in advance; a system that guides the user to the optimal route to a destination store within a shopping facility; and a system that allows users to select and purchase products using the virtual space of each store. Furthermore, this invention also includes a function that optimizes the user experience by incorporating an emotion engine that recognizes the user's emotions.

[1350] Guiding and securing parking spaces in advance

[1351] The server acquires data in real time from various sensors in the parking lot (cameras, ultrasonic sensors, etc.) and determines whether there are any available spaces. Specifically, it analyzes camera images to check for the presence of vehicles and uses ultrasonic sensor data to measure distances.

[1352] The device uses GPS to obtain the user's current location information and sends that information to the server. For example, a user launches the app and taps the "Get Current Location" button on the parking lot search page.

[1353] The server integrates information on available spaces with the user's current location to identify the nearest available space. The server uses GPS data to calculate distances and selects the most suitable space for the user.

[1354] The server identifies an available space and sends its location information to the terminal. Based on this location information, the terminal displays navigation information to the user to reach the available space. The user uses voice guidance or a map display to navigate to the designated space.

[1355] After the user arrives at the designated available space, they tap the "Reserve" button to reserve it in advance. The server receives the reservation request, changes the designated space to a reserved status, and sends a reservation completion notification to the user's device.

[1356] Guidance to the optimal store flow

[1357] The server manages and regularly updates location information and floor map data for all stores within the shopping complex. This ensures that the most up-to-date store layout information is maintained.

[1358] The user opens the app and enters the name of the store they want to visit. The device sends the entered store name to the server. For example, if the user enters "Starbucks," the server receives it.

[1359] The server searches for the location information of the relevant store and calculates the optimal route from the current location. The server uses GPS data to confirm the user's current location and generates the optimal route.

[1360] The device receives route information and displays it as a map. The user can follow the device's instructions to reach their destination store.

[1361] VR customer service and sales at each store

[1362] The server collects real-time inventory information from each store and updates the database. For example, when an item is sold, the inventory information is updated immediately.

[1363] The user selects a store where they would like VR customer service via the app and starts a session. The device sends the selected information to the server. The user freely explores the products in the virtual space and selects items they like.

[1364] The terminal sends information about the selected product to the server, which checks the inventory and returns a list of available products. When the user selects a product and proceeds with the purchase, payment information is sent to the server, which completes the payment process.

[1365] Using an Emotion Engine

[1366] The device uses the user's camera and microphone to analyze the user's facial expressions and voice tone in real time and acquire emotional information. For example, it might take a picture of the user's face with the camera and perform voice analysis.

[1367] The emotion engine analyzes the acquired emotional information to determine the user's emotional state (stress, joy, frustration, etc.) and sends that information to the server.

[1368] The server uses emotional information to dynamically change the guidance methods and displayed content. For example, it simplifies guidance information and emphasizes important information for users who are stressed.

[1369] This allows the system to provide optimal guidance based on the user's emotional state, integrating information on available parking spaces, store locations within commercial facilities, and even an online shopping experience. Examples of prompt messages are shown below.

[1370] Concrete examples of generative AI model prompts

[1371] Generating instructions for guiding users to available parking spaces.

[1372] Please explain the programming procedure for a system that guides users to and reserves available parking spaces. This includes the roles of the server, terminal, and user, how data is acquired from various sensors in the parking lot, how available spaces are determined, how the user's current location is obtained, how available spaces are displayed, and the reservation process. Please also include specific examples.

[1373] Store Layout Guide Explanation Generation

[1374] Please provide a detailed explanation of the program's processing for a system that guides users along the optimal store routes within a shopping facility. This includes the roles of the server, terminals, and users, the management of location information and floor map data for all stores, the input of store information the user wants to visit, and the calculation of the optimal route based on that information. Please also include specific examples.

[1375] Generating explanations for VR customer service and sales.

[1376] Please provide a detailed explanation of the program processing for each store's VR customer service and sales system. This includes the roles of the server, terminal, and user, as well as details of real-time inventory information collection, initiation of the user's VR customer service session, product selection flow, and purchase procedure. Please also include specific examples.

[1377] Emotion Engine Description Generation

[1378] Please provide a detailed explanation of the program processing for a user experience optimization system that utilizes an emotion engine. This includes the roles of the terminal, emotion engine, and server, as well as the process of analyzing the user's facial expressions and tone of voice, collecting and analyzing emotion information, and dynamically changing guidance methods and displayed content based on that emotion information. Please also include specific examples.

[1379]

[1380] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1381] Guiding and securing parking spaces in advance

[1382] Processing steps

[1383] Step 1:

[1384] The server collects data in real time from various sensors in the parking lot (cameras, ultrasonic sensors, etc.). This data is used to determine whether there are available parking spaces. Specifically, it analyzes camera images to detect the presence or absence of vehicles and analyzes distance data from ultrasonic sensors to determine if a parking space is occupied. Sensor data is the input, and information on available spaces is obtained as the output.

[1385] Step 2:

[1386] The device obtains the user's current location information using GPS and sends that information to the server. When the user launches the app and taps the "Get Current Location" button, the device obtains the user's location information and sends it to the server. GPS data is taken as input, and the current location information is obtained as output.

[1387] Step 3:

[1388] The server integrates information about available spaces with the user's current location to identify the nearest available space. The server compares GPS data with the location information (X, Y coordinates) of the available spaces, calculates the straight-line distance, and identifies the nearest available space. The input is information about available spaces and the user's current location, and the output is the location information of the nearest available space.

[1389] Step 4:

[1390] The server sends location information of the free space it has identified to the terminal. This includes the specific location of the free space (for example, "Section A, Space 35"). The input is the location information of the nearest free space, and the output is the location information of the free space to be sent to the terminal.

[1391] Step 5:

[1392] Based on the location information received by the device, navigation information to an available parking space is displayed to the user. The map display is updated, and voice guidance is also used to guide the user to the designated parking space. The input is the location information of the available parking space, and the output is navigation information.

[1393] Step 6:

[1394] After the user arrives at the designated available space, they tap the "Reserve" button to reserve it in advance. The device then sends the reservation request to the server. The input is the reservation request, and the output is the reservation request data.

[1395] Step 7:

[1396] The server receives a reservation request and changes the specified available space to a reserved state. This makes that space unavailable to other users. The input is reservation request data, and the output is a reservation completion notification.

[1397] Step 8:

[1398] The server sends a reservation completion notification to the terminal, and the terminal displays a confirmation of the reservation completion to the user. The input is the reservation completion notification, and the output is the notification information for the user.

[1399] Guidance to the optimal store flow

[1400] Processing steps

[1401] Step 1:

[1402] The server manages and regularly updates location information and floor map data for all stores within the shopping complex. New store openings and store relocation information are automatically reflected in the database. Input includes location information and floor map data for each store, and output is an updated database.

[1403] Step 2:

[1404] The user opens the app and enters the name of the store they want to visit. The device sends the entered store name to the server. The input is the store name entered by the user, and the output is the store name data sent to the server.

[1405] Step 3:

[1406] The server searches for the location information of the relevant store and calculates the optimal route from the user's current location. The server uses GPS data to confirm the user's current location and generates the optimal route. The input is store name data and current location information, and the output is optimal route information.

[1407] Step 4:

[1408] The server sends optimal route information to the terminal, and the terminal displays the received route information as a map. The input is optimal route information, and the output is map data sent to the terminal.

[1409] Step 5:

[1410] The user follows the map directions to reach their destination store. The terminal provides route guidance using both map data and voice guidance. Map data is the input, and guidance information is output.

[1411] VR customer service and sales at each store

[1412] Processing steps

[1413] Step 1:

[1414] The server collects real-time inventory information from each store and updates the database. The inventory information is automatically reflected in the database. The input is the inventory information from each store, and the output is the updated database.

[1415] Step 2:

[1416] The user selects a store where they wish to receive VR customer service via a mobile app and starts a session. The device sends the selected store information to the server. The input is the name of the store selected by the user, and the output is the session start request sent to the server.

[1417] Step 3:

[1418] The server generates access information for the virtual shop and sends it to the terminal. The terminal displays the entrance to the virtual shop to the user and prompts them to access it. The input is a session start request, and the output is the access information for the terminal.

[1419] Step 4:

[1420] The user accesses a virtual shop and freely explores the VR space. The user checks product information and selects the product they wish to purchase. The input is data from the virtual shop, and the output is information about the selected product.

[1421] Step 5:

[1422] The terminal sends information about the selected product to the server, the server checks the inventory information and sends a list of available products to the terminal. The input is information about the selected product, and the output is a list of available products.

[1423] Step 6:

[1424] The user proceeds with the purchase process, enters payment information, and taps the "Purchase" button. The device sends the purchase request and payment information to the server. The input is the purchase process data, and the output is the payment request.

[1425] Step 7:

[1426] The server completes the payment process and notifies the terminal of the result. The terminal displays a payment completion notification to the user. The input is a payment request, and the output is a payment completion notification.

[1427] Using an Emotion Engine

[1428] Processing steps

[1429] Step 1:

[1430] The device uses the user's camera and microphone to analyze the user's facial expressions and voice tone in real time and acquire emotional information. The input consists of camera images and audio data, and the output is emotional information.

[1431] Step 2:

[1432] The emotion engine analyzes the acquired emotion information and sends the user's emotional state to the server. The input is the analyzed emotion information, and the output is the data sent to the server.

[1433] Step 3:

[1434] The server uses user emotion information to dynamically change the guidance methods and displayed content. For example, for a user experiencing stress, the guidance information is simplified and important information is emphasized. Emotion information is taken as input, and the adjusted guidance information is returned as output.

[1435] (Application Example 2)

[1436] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[1437] In modern shopping facilities and parking lots, there is a need to improve convenience for users to easily find parking spaces and enjoy their shopping. Traditional systems often made searching for available parking spaces and navigating to stores within shopping facilities cumbersome, causing stress to users, especially during peak hours. Furthermore, the time-consuming process of selecting desired products and checking inventory also negatively impacted the user experience. Moreover, providing services that consider user emotions was difficult, making it challenging to offer optimal services tailored to individual needs.

[1438] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for detecting available parking spaces using various sensors, means for acquiring current location information from the user's terminal, means for guiding the user to the nearest available space based on the available space information and current location information, means for reserving a designated available space in advance, means for a camera and microphone that analyzes the user's facial expressions and voice to acquire emotional information, means for dynamically changing the guidance method and display content based on the emotional information, and means for supporting store guidance and product selection within a shopping facility. As a result, users can easily search for parking spaces and have a smooth shopping experience with reduced stress. In addition, since individualized responses that take into account the user's emotions are provided, user satisfaction is improved.

[1439] "Various types of sensors" refers to multiple types of sensors such as cameras, ultrasonic sensors, and pressure sensors, which are devices that sense physical phenomena and acquire them as data.

[1440] "Available parking spaces" refer to unused spaces within a parking lot where vehicles can be parked.

[1441] "User's device" refers to an information device owned by the user, such as a smartphone, tablet, or smart glasses.

[1442] "Current location information" refers to data on the current geographical location of a user's device, obtained using location information systems such as GPS.

[1443] "Available space information" refers to data about available spaces within a parking lot, such as whether or not there are available spaces and their location.

[1444] "Securing in advance" means setting a designated available space to a reserved state so that other users cannot use it.

[1445] "Emotional information" refers to data on emotional states such as stress, joy, and frustration, which are analyzed from the user's facial expressions and voice.

[1446] "Camera and microphone" refers to an imaging device for acquiring images and a sound-collecting device for acquiring sound.

[1447] A "shopping facility" is a commercial complex where many stores are gathered, and it is a place where users purchase goods.

[1448] "Store guide" is a service that provides users with directions and location information to the store they want to visit.

[1449] A "virtual space" is a virtual space that mimics the real world, and it is an interface that allows users to select products visually and interactively.

[1450] "Inventory information" refers to data regarding the quantity and condition of products currently available at each store.

[1451] "Dynamically changing guidance methods and display content based on emotional information" means optimizing the content and expression of screen displays and voice guidance in real time based on the emotional information of the acquired user.

[1452] "Recommending products" means displaying and recommending products that are suitable for the user based on data such as the user's past purchase history and current emotional state.

[1453] This invention provides a system that detects available parking spaces, guides the user to the most suitable available space based on their current location, and reserves that space in advance. It also includes functions to guide the user to the optimal route within a shopping facility and to assist with product selection and purchase using virtual spaces within each store. Furthermore, by employing an emotion engine, the navigation and display content can be dynamically changed according to the user's emotional state.

[1454] Hardware and software to be used

[1455] Hardware:

[1456] Smartphone: GPS, camera, microphone, display

[1457] Various sensors: Cameras, ultrasonic sensors, pressure sensors

[1458] software:

[1459] Android Studio: App Development

[1460] OpenCV: Image processing library

[1461] Google Maps API: Navigation API

[1462] Overview of Program Processing

[1463] 1. Acquisition of sensor data:

[1464] The server uses various sensors (cameras, ultrasonic sensors, etc.) placed in the parking lot to detect the presence or absence of vacant spaces in real time.

[1465] The server generates information about available space based on the acquired data and stores it in the database.

[1466] 2. Obtaining current location information:

[1467] The user's smartphone uses GPS to obtain their current location and sends that information to the server.

[1468] 3. Information on available spaces:

[1469] The server integrates the available space information with the current location information to identify the nearest available space.

[1470] The system sends location information of identified vacant spaces to the user's smartphone and provides guidance via voice and on-screen display.

[1471] 4. Secure available space in advance:

[1472] When a user taps the "Reserve" button in the app, a request is sent to the server.

[1473] The server changes the specified available space to a reserved state and sends a reservation completion notification to the user's terminal.

[1474] 5. Navigation to the store:

[1475] Store location information and floor map data within the shopping facility are managed by a server.

[1476] When a user enters their destination store in the app and that information is sent to the server, the server calculates the optimal route and sends it to the user's device.

[1477] The user's smartphone performs navigation based on the route information it receives.

[1478] 6. Product selection and purchase in virtual space:

[1479] The server collects inventory information from each store in real time and updates the database.

[1480] When a user selects a virtual shop in the mobile app, that information is sent to the server.

[1481] The server generates access information for the virtual shop and sends it to the user's terminal.

[1482] When a user selects an item in a virtual shop and that information is sent to the server, the server checks the inventory and proceeds with the purchase.

[1483] 7. Dynamic guidance adjustments using an emotional engine:

[1484] The system uses the smartphone's camera and microphone to capture the user's facial expressions and voice in real time.

[1485] The emotion engine analyzes this data and sends the user's emotional information to the server.

[1486] The server dynamically changes the guidance methods and displayed content based on emotional information, providing the user with the most optimal service.

[1487] Examples of specific cases and AI prompt sentences

[1488] Specific example

[1489] Imagine a customer in a shopping mall looking for a specific store. The customer uses an app to obtain their current location via GPS and selects the name of the store they want to visit. The app then calculates the optimal route based on this information and displays it to the user. Furthermore, it analyzes the customer's facial expressions and voice through the camera and microphone, and improves navigation by simplifying the directions and providing more detailed information if the customer is experiencing stress.

[1490] Example of AI prompt message

[1491] A customer is lost in a shopping mall and is using the app. When you sense stress from their facial expression, explain how to simplify the navigation and provide more detailed instructions.

[1492] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1493] Step 1:

[1494] The server acquires real-time data on available parking spaces from various sensors (cameras, ultrasonic sensors, etc.) placed in the parking lot. The input data consists of signals representing physical phenomena transmitted from each sensor. The server analyzes these signals, determines whether or not there are available spaces, and stores the information in the database as available space information. The output data is a list of available spaces in the parking lot.

[1495] Step 2:

[1496] The terminal uses GPS to obtain the user's current location information. The input data is location signals received from GPS satellites. The terminal analyzes these signals to determine the current location and transmits this information to the server. The output data is the user's current location information.

[1497] Step 3:

[1498] The server integrates available space information and current location information to identify the available space closest to the user's terminal. The input data consists of available space information and the user's current location information. Based on this data, the server performs route calculations and generates location information for the nearest available space. The output data is the location information for the nearest available space.

[1499] Step 4:

[1500] The server sends the location information of the identified free space to the terminal. The input data is the location information of the nearest free space. The server transfers this to the user terminal via the network. The output data is the location information of the free space displayed on the user terminal.

[1501] Step 5:

[1502] The terminal displays navigation information to the user based on the received location information. The input data is the location information of the available space sent from the server. The terminal generates a map and navigation instructions based on the location information and displays them to the user. The output data is the navigation information displayed on the terminal screen.

[1503] Step 6:

[1504] The user follows the app's navigation to the designated vacant space. The input data is navigation information. The user uses this information to navigate the parking lot and reach the desired vacant space. The output is parking in the designated vacant space.

[1505] Step 7:

[1506] The user taps the "Reserve" button and sends a request from their device to reserve an available space in advance. The input data is the user's action. The device detects this action, generates a reservation request, and sends it to the server. The output data is the reservation request information.

[1507] Step 8:

[1508] The server receives a reservation request and changes the specified free space to a reserved state. The input data is the reservation request information. The server updates the free space information in the database and sets the specified free space to a reserved state. The output data is the updated free space information.

[1509] Step 9:

[1510] The server sends a reservation completion notification to the terminal. The input data is the updated available space information. The server generates a reservation completion notification and sends it to the user terminal via the network. The output data is the reservation completion notification.

[1511] Step 10:

[1512] The terminal displays a confirmation of the reservation completion to the user. The input data is the reservation completion notification sent from the server. The terminal displays this information to the user, informing them that the reservation is complete. The output data is the confirmation message displayed on the terminal screen.

[1513] Step 11:

[1514] The server manages and updates store location information and floor map data within the shopping facility. Input data consists of location and floor map information provided by each store. The server stores this data in a database, maintaining it at all times. Output data consists of the managed store location and floor map data.

[1515] Step 12:

[1516] The user opens the app and enters the name of the store they wish to visit. The input data consists of the user's actions and the store name. The device sends this information to the server. The output data is the transmitted store name information.

[1517] Step 13:

[1518] The server searches for the location information of the relevant store and calculates the optimal route from the current location. The input data is the store name information and the current location information. Based on this data, the server calculates the optimal route and generates route information. The output data is the generated route information.

[1519] Step 14:

[1520] The server sends route information to the user terminal. The input data is the generated route information. The server transmits this information to the terminal via the network. The output data is the route information sent to the user terminal.

[1521] Step 15:

[1522] The terminal displays the received route information as a map and initiates route guidance for the user. The input data is route information transmitted from the server. The terminal generates a map and route instructions and displays them to the user. The output data is the route guidance information displayed on the terminal screen.

[1523] Step 16:

[1524] The user follows the map directions on their device to reach their destination store. The input data is route guidance information. Based on this information, the user navigates within the shopping facility and reaches their destination. The output is arrival at the destination store.

[1525] Step 17:

[1526] The server collects real-time inventory information from each store and updates the database. The input data is the inventory information provided by each store. The server uses this data to keep the inventory information constantly up-to-date. The output data is the updated inventory information.

[1527] Step 18:

[1528] The user selects a virtual shop in the mobile app and starts a session. Input data consists of the user's actions and virtual shop selection information. The device sends this information to the server. Output data is the transmitted virtual shop selection information.

[1529] Step 19:

[1530] The server generates virtual shop access information and sends it to the terminal. The input data is the virtual shop selection information. The server generates access information and sends it to the user terminal. The output data is the transmitted access information.

[1531] Step 20:

[1532] The terminal displays the entrance to the virtual shop to the user and prompts them to access it. The input data is the access information sent from the server. The terminal displays the virtual shop access screen to the user. The output data is the entrance to the virtual shop displayed on the terminal screen.

[1533] Step 21:

[1534] The user enters a virtual shop, freely explores the VR space, and selects products. Input data consists of the user's actions and selections. The user selects products of interest within the VR space, and the terminal sends this information to the server. Output data is the transmitted product selection information.

[1535] Step 22:

[1536] The server checks the inventory information of the selected product and sends a list of available products to the terminal. The input data is the product selection information. The server queries the inventory information and generates a list of available products. The output data is the generated list of available products.

[1537] Step 23:

[1538] The terminal displays a list of available products to the user and shows a screen to initiate the purchase process. The input data is the list of available products sent from the server. The terminal displays this list to the user and prompts them to make a purchase. The output data is the purchase process screen displayed on the terminal screen.

[1539] Step 24:

[1540] The user selects the product they wish to purchase and taps the "Purchase" button. The input data consists of the user's actions and selections. The device collects this information and sends the purchase request and payment information to the server. The output data consists of the transmitted purchase request and payment information.

[1541] Step 25:

[1542] The server completes the payment process and notifies the terminal of the result. The input data consists of the purchase request and payment information. The server processes the payment, generates a completion notification, and sends it to the user's terminal. The output data is the sent payment completion notification.

[1543] Step 26:

[1544] The terminal displays a payment completion notification to the user. The input data is the payment completion notification sent from the server. The terminal displays this information to the user, informing them that the purchase is complete. The output data is the payment completion confirmation message displayed on the terminal screen.

[1545] Step 27:

[1546] The device uses the user's camera and microphone to analyze the user's facial expressions and voice tone in real time and acquire emotional information. The input data consists of the user's facial expression images and audio data. The device analyzes this data and sends the emotional information to the server. The output data is the transmitted emotional information.

[1547] Step 28:

[1548] The emotion engine analyzes emotional information and sends the emotional state to the server. The input data consists of the user's facial expressions and voice data. The emotion engine uses an emotion analysis algorithm to analyze the data and generate an emotional state. The output data is the generated emotional state.

[1549] Step 29:

[1550] The server dynamically changes the guidance method and displayed content based on emotional information to provide the user with the most optimal service. Input data includes emotional state, the user's current location, and destination information. The server automatically adjusts the guidance content based on this data and sends it to the user's terminal. Output data is the dynamically modified guidance information.

[1551] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1552] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1553] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[1554] [Third Embodiment]

[1555] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[1556] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1557] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1558] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1559] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1560] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1561] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1562] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1563] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1564] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1565] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1566] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1567] This invention includes a system that uses various sensors to detect available parking spaces, guides users to the most suitable available space based on their current location, and reserves that space in advance; a system that guides users to the optimal route to a destination store within a shopping facility; and a system that allows users to select and purchase products using the virtual space of each store. The details and specific examples of the overall system's program processing are described below.

[1568] (1) Guiding and securing parking spaces in advance

[1569] Explanation of program processing

[1570] 1. The server acquires real-time data from various sensors in the parking lot (e.g., cameras and ultrasonic sensors). This allows the server to understand the current status of available parking spaces.

[1571] 2. The device obtains the user's current location information using GPS and sends it to the server.

[1572] 3. The server identifies the nearest available parking space based on information about available spaces in the parking lot and the user's current location.

[1573] 4. The terminal navigates the user in real time based on the location information of available spaces received from the server.

[1574] 5. The user taps the "Reserve" button on the app to reserve an available space in advance.

[1575] 6. The server receives the user's reservation information and sets the available space to a reserved state.

[1576] 7. The device displays a notification to the user that the reservation is complete.

[1577] Specific example

[1578] The server collects real-time data on available parking spaces for 150 cars and creates a list of available spaces.

[1579] The user opens a parking search page using a mobile app and finds the nearest available space from their current location.

[1580] The server obtains the user's current location from GPS data and presents the nearest available space (e.g., space number 35) from the list of available spaces.

[1581] The terminal will show the user the optimal route and guide them to space number 35 using voice guidance.

[1582] The user taps "Reserve Space 35" to reserve the space in advance.

[1583] The server checks the reservation information and updates it so that space 35 is not displayed to other users.

[1584] The device displays a reservation completion notification to the user.

[1585] (2) Guiding customers to the optimal store layout

[1586] Explanation of program processing

[1587] 1. The server manages the location information and floor maps of all stores within the shopping facility and stores them in a database.

[1588] 2. The user enters the store they want to visit using the terminal app.

[1589] 3. The device obtains the user's current location information via GPS and sends it to the server.

[1590] 4. The server calculates the optimal route based on the current location and destination information, and sends that route information to the terminal.

[1591] 5. The device displays the optimal route in map format and provides real-time guidance to the user.

[1592] Specific example

[1593] The user launches the smartphone app at the entrance of the shopping mall and searches for "XYZ Shop".

[1594] The server consults the floor map and confirms that the XYZ shop is located at the far end of the third floor.

[1595] The device obtains its current location information and requests the server to provide the shortest route, taking into account the location of the escalator.

[1596] The server calculates the route and generates directions such as, "Take the escalator up to the 3rd floor and turn right."

[1597] The device displays route information as a map and navigates the user.

[1598] (3) VR customer service and sales at each store

[1599] Explanation of program processing

[1600] 1. The server retrieves real-time inventory information from each store and updates the database.

[1601] 2. The user uses a mobile app to select the store where they would like to receive VR customer service.

[1602] 3. The device sends a request to the server to start the VR customer service session.

[1603] 4. The server sends access information to the virtual shop to the terminal and begins generating the VR space.

[1604] 5. Users interactively select products within the VR space and add them to their cart.

[1605] 6. The server receives the user's selection information and checks the inventory status in real time.

[1606] 7. The device displays purchasable items to the user and allows them to proceed with the purchase.

[1607] 8. The user taps the purchase button, and the payment process is completed.

[1608] 9. The server receives payment completion information and begins the process of shipping the goods.

[1609] Specific example

[1610] The server receives the latest inventory data from electronics parts store B and updates product information such as "resistor set".

[1611] The user launches a smartphone app and begins a VR customer service experience at electronics parts store B.

[1612] The server generates a VR customer service session and sends virtual shop access information to the user's device.

[1613] The terminal displays a realistic virtual shop, and the user selects a "resistor set" from the virtual shelf.

[1614] The server checks the inventory status and confirms that the selected product is available for purchase.

[1615] The user taps the "Purchase" button and completes the payment process on their device.

[1616] The server receives notification that payment has been completed and begins the process of shipping the goods.

[1617] Thus, the present invention makes it possible to realize a system that provides an integrated service including guidance on available parking spaces, store guidance within commercial facilities, and an online shopping experience for each store.

[1618] The following describes the processing flow.

[1619] (1) Guiding and securing parking spaces in advance

[1620] Specific steps in program processing

[1621] Step 1:

[1622] The server acquires data from various sensors in the parking lot (cameras, ultrasonic sensors, etc.) and determines whether or not there are available parking spaces.

[1623] Step 2:

[1624] The device obtains the user's current location information using GPS and sends that information to the server.

[1625] Step 3:

[1626] The server integrates information about available space with the user's current location to identify the nearest available space.

[1627] Step 4:

[1628] The server sends location information of the available space it has identified to the terminal.

[1629] Step 5:

[1630] Based on the location information received by the device, navigation information to an available space is displayed to the user.

[1631] Step 6:

[1632] The user follows the navigation in the app and heads to the designated empty space.

[1633] Step 7:

[1634] The user taps the "Reserve" button to send a request from their device to reserve an available space in advance.

[1635] Step 8:

[1636] The server receives the reservation request and changes the specified available space to a reserved state.

[1637] Step 9:

[1638] The server sends a reservation confirmation to the device.

[1639] Step 10:

[1640] The device displays a confirmation to the user that the reservation is complete.

[1641] (2) Guiding customers to the optimal store layout

[1642] Specific steps in program processing

[1643] Step 1:

[1644] The server manages and updates location information and floor map data for all stores within the shopping complex.

[1645] Step 2:

[1646] The user opens the app and enters the name of the store they want to visit.

[1647] Step 3:

[1648] The terminal sends the entered store name to the server.

[1649] Step 4:

[1650] The server searches for the location information of the relevant store and calculates the optimal route from the current location.

[1651] Step 5:

[1652] The device uses GPS to obtain its current location information, which is then sent to the server.

[1653] Step 6:

[1654] The server calculates the most suitable route for the user based on their current location and the location of the store, and sends that information to their device.

[1655] Step 7:

[1656] The terminal displays the route information it has received as a map and begins providing route guidance to the user.

[1657] Step 8:

[1658] The user follows the map directions on their device to reach their destination store.

[1659] (3) VR customer service and sales at each store

[1660] Specific steps in program processing

[1661] Step 1:

[1662] The server collects real-time inventory information from each store and updates the database.

[1663] Step 2:

[1664] The user selects the store where they want to receive VR customer service via a mobile app and starts the session.

[1665] Step 3:

[1666] The device sends a session start request to the server, specifying the selected store.

[1667] Step 4:

[1668] The server generates access information for the virtual shop and sends it to the terminal.

[1669] Step 5:

[1670] The device displays the entrance to the virtual shop to the user and prompts them to access it.

[1671] Step 6:

[1672] When a user enters a virtual shop, they can freely explore the VR space and select products.

[1673] Step 7:

[1674] The device sends information about the product selected by the user to the server.

[1675] Step 8:

[1676] The server checks the inventory information of the selected product and sends a list of available products to the terminal.

[1677] Step 9:

[1678] The device displays a list of purchasable items to the user and shows a screen to begin the purchase process.

[1679] Step 10:

[1680] The user selects the product they want to purchase and taps the "Purchase" button.

[1681] Step 11:

[1682] The device sends the purchase request and payment information to the server.

[1683] Step 12:

[1684] The server completes the payment process and notifies the terminal of the result.

[1685] Step 13:

[1686] The device displays a notification to the user that the payment has been completed.

[1687] This clarifies how each processing step of the system is performed, allowing users to efficiently enjoy parking reservations, store directions, and online shopping experiences.

[1688] (Example 1)

[1689] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1690] Currently, many parking lots present challenges such as difficulty in confirming and securing available parking spaces, resulting in wasted time and effort for users. Furthermore, the time required for navigating stores within shopping facilities and selecting products within each store hinders efficient shopping. Additionally, online shopping presents problems such as low user satisfaction due to the difficulty in checking inventory in real time and selecting products virtually.

[1691] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1692] In this invention, the server includes means for detecting available parking spaces using various sensors, means for acquiring current location information from the user's terminal, means for guiding the user to the nearest available space based on the available space information and current location information, means for reserving a designated available space in advance, means for the server to collect available space information in real time and store it in a database, means for the terminal to acquire the user's current location using GPS and transmit it to the server, means for the server to identify the optimal available space based on the available space information and the user's current location information, and means for the terminal to navigate the user in real time based on the location information of the available space received from the server. This not only enables efficient confirmation and reservation of available parking spaces but also reduces the effort and time required from the user. Furthermore, by including means for managing store location information and floor map information within the shopping facility, and means for receiving destination information entered from the user's terminal, generating the optimal route based on the destination information and current location information, and transmitting the generated route information to the user terminal, store guidance within the shopping facility can be facilitated smoothly. Furthermore, by including means for obtaining inventory information from each store in real time, displaying a virtual store space based on input from the user's terminal, receiving product selections within the virtual space, and processing purchases of selected products, users can select and purchase products online in real time.

[1693] A "sensor" is a device that detects physical or chemical phenomena and converts them into electrical signals.

[1694] A "parking lot" is a space or facility for temporarily parking vehicles.

[1695] "Available space" refers to unused parking spaces where vehicles can be parked.

[1696] A "device" refers to an electronic device used by a user, specifically a smartphone or tablet.

[1697] "Current location information" refers to data that indicates the current geographical location of the user or device.

[1698] A "server" is a computer system that provides services to client terminals over a network.

[1699] A "database" is a system that structures and stores large amounts of data, enabling efficient searching and manipulation.

[1700] GPS is a global positioning system used to obtain location information on Earth.

[1701] An "optimal route" is the route that minimizes both distance and time from the starting point to the destination.

[1702] "Navigate" means to guide someone on a route to their destination.

[1703] A "shopping facility" is a commercial complex that houses a large number of stores.

[1704] "Store location information" refers to data that shows where each store is located within a shopping facility.

[1705] A "floor map" is a map that shows the layout of each floor in a shopping facility.

[1706] A "virtual space" is a virtual reality space created using computer graphics.

[1707] "Inventory information" refers to data that shows the availability status of a product.

[1708] "Purchase procedure" refers to a series of operations or procedures necessary to purchase a product.

[1709] The present invention includes a system for detecting available parking spaces, guiding users to the most suitable available space based on their current location, and reserving that space in advance; a system for guiding users to the optimal route to a destination store within a shopping facility; and a system for selecting and purchasing products using the virtual space of each store. Specific embodiments of each system are shown below.

[1710] Guiding and securing parking spaces in advance

[1711] The server acquires real-time data from various sensors in the parking lot (e.g., cameras and ultrasonic sensors). Cameras use image recognition technology to detect the availability of each parking space, and ultrasonic sensors detect available spaces based on distance data. This data is sent to the server and stored in a database.

[1712] The device obtains the user's current location information using GPS and sends that information to the server. To provide highly accurate location information, the GPS function also utilizes Wi-Fi and mobile network information.

[1713] The server identifies the nearest available parking space based on information about available spaces in the parking lot and the user's current location. This is calculated using algorithms such as Dijkstra's algorithm.

[1714] The system navigates the user in real time based on location information of available spaces received by the terminal from the server. Navigation is provided via map display and voice guidance. This allows the user to intuitively understand the optimal route.

[1715] The user checks the available space on the mobile app and taps the "Reserve" button. This action sends a reservation request to the server.

[1716] The server receives the user's reservation request and updates the available space to a reserved status. The reservation information is immediately saved to the database and reflected in other terminals in real time.

[1717] The device displays a reservation confirmation notification to the user. The notification includes detailed information about the reserved space.

[1718] Specific example

[1719] The server collects real-time data on available parking spaces for 150 cars and creates a list of available spaces.

[1720] The user opens a parking search page using a mobile app and finds the nearest available space from their current location.

[1721] The server obtains the user's current location from GPS data and presents the nearest available space (e.g., space number 35) from the list of available spaces.

[1722] The terminal will show the user the optimal route and guide them to space number 35 using voice guidance.

[1723] The user taps "Reserve Space 35" to reserve the space in advance.

[1724] The server checks the reservation information and updates it so that space 35 is not displayed to other users.

[1725] The device displays a reservation completion notification to the user.

[1726] Guidance to the optimal store flow

[1727] The server manages the location information and floor maps of all stores within the shopping complex and stores them in a database. This includes the name of each store, its location on the floor, and the distance between stores.

[1728] The user enters the name of the store they want to visit using a terminal app, the terminal obtains the user's current location using GPS, and sends that information to the server. To provide highly accurate location information, the terminal also uses location information from Wi-Fi and mobile networks.

[1729] The server calculates the optimal route based on the user's current location and destination. It also considers the location of escalators and elevators, using algorithms such as Dijkstra's to determine the most efficient route for the user to reach their destination.

[1730] The device displays the optimal route information received from the server in map format. It provides real-time navigation, ensuring the user reaches their destination without getting lost.

[1731] Specific example

[1732] The user launches the smartphone app at the entrance of the shopping mall and searches for "XYZ Shop".

[1733] The server consults the floor map and confirms that the XYZ Shop is located on the 3rd floor.

[1734] The device obtains its current location information and requests the server to calculate the shortest route, taking into account the location of the escalator.

[1735] The server calculates the route and generates directions such as, "Take the escalator up to the 3rd floor and turn right."

[1736] The device displays route information as a map and navigates the user.

[1737] VR customer service and sales at each store

[1738] The server retrieves the latest inventory information from each store in real time and updates the database. This includes information such as product name, stock quantity, and price.

[1739] When a user requests a VR customer service experience at a designated store using a mobile app, the device sends the request to the server. The server receives this request, sends access information to the virtual shop, and generates the VR space.

[1740] The user interactively selects products in a VR space, and the server receives this selection information to check inventory status in real time. It instantly checks whether the selected product is in stock.

[1741] The device displays available products to the user, who then proceeds with the purchase. The user taps the "Purchase" button and enters their payment information.

[1742] The server receives payment completion information and begins the shipping process for the product. The shipping status is updated in real time, and the user receives a notification.

[1743] Specific example

[1744] The server retrieves the latest inventory data from the electronics parts store and updates product information such as "resistor sets".

[1745] The user launches a smartphone app and begins a VR customer service experience at an electronics parts store.

[1746] The server generates a VR customer service session and sends virtual shop access information to the user's device.

[1747] The terminal displays a realistic virtual shop, and the user selects a "resistor set" from the virtual shelf.

[1748] The server checks the inventory status and confirms that the selected product is available for purchase.

[1749] The user taps the "Purchase" button and completes the payment process on their device.

[1750] The server receives notification that payment has been completed and begins the process of shipping the goods.

[1751] This makes it possible to efficiently check and secure available parking spaces, guide customers to stores within shopping facilities, and perform real-time inventory checks and virtual product selections in online shopping.

[1752] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1753] Guiding and securing parking spaces in advance

[1754] Step 1:

[1755] The server acquires real-time data from various sensors in the parking lot (cameras and ultrasonic sensors). The sensors collect data from the physical environment and send it to the server. The data acquired here includes the availability of parking spaces. The server analyzes this data, identifies available parking spaces, and stores them in a database.

[1756] Input: Real-time data from sensors

[1757] Data processing: Collection and analysis of sensor data

[1758] Output: Information on available parking spaces (saved in database)

[1759] Specific operation: The camera acquires images and uses image processing techniques to identify available spaces. The ultrasonic sensor measures distance and uses that to identify available spaces.

[1760] Step 2:

[1761] The device acquires the user's current location information using GPS and transmits that information to the server. The GPS module receives signals from satellites and calculates the current location. This location information is processed within the device and transmitted to the server as high-precision location information along with WiFi and mobile network data.

[1762] Input: Location data from GPS

[1763] Data processing: Acquisition and transmission of location data

[1764] Output: Current location information (sent to server)

[1765] Specific operation: The device periodically receives GPS signals and processes the data to determine its exact current location.

[1766] Step 3:

[1767] The server identifies the nearest available parking space based on information about available spaces in the parking lot and the user's current location. The server uses route-finding algorithms such as Dijkstra's algorithm to identify the nearest unused parking space from the user's current location. This calculation result is stored on the server.

[1768] Input: Information on available parking spaces, current location information

[1769] Data processing: Optimal space identification using pathfinding algorithms.

[1770] Output: Optimal free space information (stored on the server)

[1771] Specific operation: The server retrieves available space information and current location information from the database and applies an algorithm to calculate the optimal route.

[1772] Step 4:

[1773] The device navigates the user in real time based on location information of available spaces received from the server. The device uses a navigation app to provide map display and voice guidance. This allows the user to intuitively understand the optimal route.

[1774] Input: Information on the best available space

[1775] Data processing: Generating navigation information

[1776] Output: Navigation information (displayed on the device and voice guidance)

[1777] Specific operation: The device generates visuals using map data and generates guidance voices using speech synthesis technology.

[1778] Step 5:

[1779] The user checks for available spaces on the mobile app and taps the "Reserve" button. The user's action sends a reservation request from the device to the server. Before submitting the reservation request, the user checks the details of the parking space (e.g., space number, location, etc.).

[1780] Input: User reservation request

[1781] Data processing: Generating and sending reservation requests

[1782] Output: Reservation request (sent to server)

[1783] Specific action: The user interacts with the app's interface and taps the reservation button.

[1784] Step 6:

[1785] The server receives a user's reservation request and updates the available space to a reserved status. The reservation information is immediately saved to the database and reflected in other terminals in real time. As a result, other users will no longer be able to reserve that space.

[1786] Input: Reservation Request

[1787] Data processing: Updating reservation information and saving it to the database.

[1788] Output: Updated reservation information (saved in database)

[1789] Specific operation: The server processes the reservation request and changes the corresponding record in the database to a reserved state.

[1790] Step 7:

[1791] The device displays a reservation confirmation notification to the user. The notification includes details of the reserved space (e.g., space number, reservation time, etc.). This allows the user to confirm which space they have reserved.

[1792] Input: Reservation confirmation information

[1793] Data processing: Generating and displaying reservation completion notifications.

[1794] Output: Reservation completion notification (displayed on the device)

[1795] Specific operation: The device's notification function will be used to notify the user of the reservation completion information in the form of a pop-up or alert.

[1796] Guidance to the optimal store flow

[1797] Step 1:

[1798] The server manages the location information and floor maps of all stores within the shopping complex and stores them in a database. This includes the name of each store, its location on the floor, and the distance between stores.

[1799] Input: Store location information and floor map information

[1800] Data processing: Information management and storage in databases

[1801] Output: Management information in the database

[1802] Specific operation: The server periodically updates the database to maintain the latest store location information.

[1803] Step 2:

[1804] The user uses the store search function in the device app to enter the name of the store they want to visit. The search query is sent from the device to the server, which retrieves the store's location information.

[1805] Input: User's search query

[1806] Data processing: Generating and sending search queries

[1807] Output: Search results (sent to server)

[1808] Specific operation: The terminal processes information entered through the user interface and sends it to the server.

[1809] Step 3:

[1810] The device obtains the user's current location information via GPS and sends that information to the server. GPS data is sent to the server along with location information from Wi-Fi or mobile networks.

[1811] Input: GPS data and other location information

[1812] Data processing: Acquisition and transmission of location data

[1813] Output: Current location information (sent to server)

[1814] Specific operation: The device periodically updates its location information and sends it to the server.

[1815] Step 4:

[1816] The server calculates the optimal route based on the user's current location and destination information. Using the Dijkstra algorithm, it calculates the route that will allow the user to reach their destination most efficiently and stores the result on the server.

[1817] Input: Current location information and destination information

[1818] Data processing: Calculation and storage of the optimal route

[1819] Output: Optimal route information (stored on the server)

[1820] Specific operation: The server uses an algorithm to derive the optimal route based on the current location and destination information obtained from the database.

[1821] Step 5:

[1822] The terminal displays the optimal route information received from the server in map format, providing real-time guidance to the user. The map display is done using a GUI, and voice guidance is also used in conjunction.

[1823] Input: Optimal route information

[1824] Data processing: Generation and display of map information

[1825] Output: Navigation information (displayed on the device and voice guidance)

[1826] Specific operation: The terminal generates visual guidance based on map data and provides voice guidance using speech synthesis technology.

[1827] VR customer service and sales at each store

[1828] Step 1:

[1829] The server retrieves the latest inventory information from each store in real time and updates the database. This includes information such as product name, stock quantity, and price.

[1830] Input: Inventory information from the store

[1831] Data processing: Retrieving inventory information and updating the database.

[1832] Output: Updated inventory information (saved in database)

[1833] Specific operation: The server periodically retrieves inventory information from each store and updates the database with the latest information.

[1834] Step 2:

[1835] The user uses a mobile app to select the store where they would like to receive VR customer service. The user selects their desired store from the store list in the app, and this information is sent to the server.

[1836] Input: User's store selection information

[1837] Data processing: Generating and transmitting store selection information.

[1838] Output: Store selection information (sent to server)

[1839] Specific operation: The user interacts with the app's interface to select their desired store.

[1840] Step 3:

[1841] The device sends a request to the server to start a VR customer service session. The server processes the request and sends virtual shop access information to the device.

[1842] Input: Start Request

[1843] Data processing: Generating and sending requests

[1844] Output: Access information (sent to the terminal)

[1845] Specific operation: The terminal sends a request to the server and waits for a response from the server.

[1846] Step 4:

[1847] Users interactively select products in a VR space and add them to their cart. Users choose products from a virtual shelf, and this information is sent from the terminal to the server.

[1848] Input: User's selected information

[1849] Data processing: Generation and transmission of selected information

[1850] Output: Selection information (sent to server)

[1851] Specific actions: The user operates the VR interface to select products and add them to the cart.

[1852] Step 5:

[1853] The server receives the user's selection information and checks the inventory status in real time. It immediately checks whether the selected product is in stock and saves the result on the server.

[1854] Input: User's selected information

[1855] Data processing: Checking inventory status and saving results.

[1856] Output: Inventory check results (save on the server)

[1857] Specific operation: The server retrieves inventory information from the database and checks whether the selected product is in stock.

[1858] Step 6:

[1859] The device displays available products to the user, and the user proceeds with the purchase. The user taps the "Purchase" button within the app and enters their payment information.

[1860] Input: Inventory check results, user purchase request

[1861] Data processing: Generation and transmission of purchase procedure information.

[1862] Output: Purchase procedure information (sent to server)

[1863] Specific action: The device displays the purchase procedure screen, allowing the user to enter payment information.

[1864] Step 7:

[1865] The server receives payment completion information and begins the shipping process for the goods. The shipping status is updated in real time, and a notification is sent to the user.

[1866] Input: Payment completion information

[1867] Data processing: Initiation and status update of delivery procedures.

[1868] Output: Delivery status notification (sent to user)

[1869] Specific operation: The server verifies the payment information and automatically starts the shipping process. The shipping status is updated regularly and notified to the user.

[1870] (Application Example 1)

[1871] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1872] In modern urban areas and commercial facilities, finding available parking spaces is often difficult, resulting in wasted time and effort. Furthermore, locating specific stores within shopping centers can be stressful for customers. With the rise of online shopping, remote shopping from physical stores has increased, but managing inventory and product information remains complex. These challenges need to be efficiently addressed by a single system.

[1873] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1874] In this invention, the server includes means for detecting available parking spaces using various sensors, means for acquiring current location information from the user's terminal, means for guiding the user to the nearest available space based on the available space information and current location information, means for reserving a designated available space in advance, means for acquiring and updating inventory information and 3D model data of products from each store from a remote server, means for acquiring location information and gaze information from the user's smart glasses, means for detecting when the user's gaze is fixed on a specific product model and transmitting detailed information about that product to the user's smart glasses, means for waiting for a voice command from the user based on the product information displayed on the smart glasses, and means for reconfirming product inventory and proceeding with the purchase procedure based on the voice command. This enables efficient detection and navigation of available parking spaces, store guidance within shopping facilities, and product selection and purchase procedures in a virtual space.

[1875] A "sensor" is a device that detects physical phenomena and converts them into electrical signals.

[1876] A "terminal" is a computer or mobile device operated by a user.

[1877] "Current location information" refers to the user's geographical location data obtained using GPS or other location measurement technologies.

[1878] "Available space information" refers to data about parking spaces currently available within the parking lot.

[1879] A "remote server" is a computer system located in a remote location that is accessed via a network.

[1880] "Inventory information" refers to detailed data on the goods and products currently stored in the store.

[1881] "3D model data" refers to digital data that represents the three-dimensional shape of an object or product.

[1882] "Smart glasses" are glasses-type devices that display information from virtual reality and augmented reality, and have the function of tracking the user's gaze and movements.

[1883] "Eye-gaze information" refers to data about the direction and focus of a user's gaze.

[1884] A "voice command" is an input that allows the system to understand and process instructions and commands spoken by the user.

[1885] System Configuration

[1886] The system that realizes this invention uses the following main hardware and software.

[1887] Hardware: Various sensors (cameras, ultrasonic sensors, etc.), smart glasses (glasses-type devices), user terminals (smartphones and tablets), remote servers (cloud servers)

[1888] Software: GPS data acquisition library, eye tracking library, speech recognition API, 3D model display library

[1889] Data acquisition and processing

[1890] The server acquires data in real time from various sensors in the parking lot and updates the information on available parking spaces. The server also acquires inventory information and 3D model data of products from all stores within the shopping facility and updates the database. User terminals acquire their current location information using GPS and send it to the server. This enables real-time guidance on available parking spaces and reservations.

[1891] Operation using smart glasses

[1892] The user wears smart glasses, and their gaze data is acquired. The server detects when the user's gaze is fixed on a 3D model of a specific product and sends the product's details to the smart glasses. The user can then use voice commands to add the product to their cart and proceed with the purchase. During this process, the server recognizes the voice commands, reconfirms product availability, and updates the order information.

[1893] Specific example

[1894] Parking space availability and reservation: Users use their smartphones to search for available parking spaces and are shown the closest available space to their current location. When a user reserves a space through the app, the server updates the listing so that the space is not visible to other users.

[1895] Store guidance within a shopping mall: Users use their smartphones within the mall to search for their destination store. The server calculates the optimal route based on the user's current location and destination information and sends it to the user's device. Users receive real-time guidance as they head to their desired store.

[1896] Virtual Shopping Experience: Users access a virtual store using smart glasses and view 3D models of products on shelves. By fixing their gaze, detailed product information is displayed, and items can be added to the cart and purchased using voice commands. The server checks inventory information and proceeds with the purchase.

[1897] Example of a prompt

[1898] "Please provide a detailed explanation of the system that allows users to fix their gaze on products in a virtual store through smart glasses, view detailed information, add items to their cart using voice commands, and complete the purchase process."

[1899] This invention solves the problem of vacant parking spaces, improves the efficiency of store guidance within shopping facilities, and enhances the virtual shopping experience.

[1900] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1901] Step 1:

[1902] The server acquires real-time data from various sensors in the parking lot (cameras, ultrasonic sensors, etc.). Based on this data, it understands the current status of available parking spaces and updates the database. This ensures that the latest information on available spaces is available.

[1903] Input: Real-time data from various sensors

[1904] Output: Updated free space information

[1905] Step 2:

[1906] The device uses GPS to obtain the user's current location information. This location information is then transmitted to the server via data communication. This ensures the user's current location is accurately determined.

[1907] Input: GPS data

[1908] Output: Current location information

[1909] Step 3:

[1910] The server identifies the nearest available space based on the user's current location and available space information. In this process, it calculates the distance using the coordinate data of the current location and available space, and selects the most suitable available space.

[1911] Input: Current location information, available space information

[1912] Output: Location information for optimal free space

[1913] Step 4:

[1914] The terminal navigates the user to the most suitable available space based on location information received from the server. It uses map displays and voice guidance to direct the user to the available space.

[1915] Input: Location information for the best available space

[1916] Output: Navigation information

[1917] Step 5:

[1918] The user taps the "Reserve" button on the app to reserve an available space in advance. This action sends the reservation information from the device to the server.

[1919] Input: User reservation operation

[1920] Output: Reservation Information

[1921] Step 6:

[1922] The server sets the available space to reserved status based on the received reservation information. It updates the database so that the space is not displayed to other users.

[1923] Input: Reservation Information

[1924] Output: Updated free space information

[1925] Step 7:

[1926] The device displays a reservation completion notification to the user, allowing them to confirm that the reservation was successfully completed.

[1927] Input: Reservation confirmation information

[1928] Output: Booking confirmation

[1929] Step 8:

[1930] The server retrieves inventory information and 3D model data of products from each store within the shopping complex. This information is then updated in a database and used by users when they engage in virtual shopping.

[1931] Input: Store inventory information, 3D model data

[1932] Output: Updated inventory information and 3D model data

[1933] Step 9:

[1934] The user's smart glasses acquire the user's location and gaze information. This information is transmitted to the server in real time.

[1935] Input: User location information, eye-tracking information

[1936] Output: Real-time location information and line-of-sight information

[1937] Step 10:

[1938] The server detects when the user's gaze is fixed on a 3D model of a specific product and sends detailed information about that product to the smart glasses. This information includes the product name, price, and description.

[1939] Input: User eye-tracking information

[1940] Output: Product details

[1941] Step 11:

[1942] The smart glasses wait for the user's voice command (e.g., "Add to cart") based on the displayed product information. A voice recognition API is used to accurately capture the user's instructions.

[1943] Input: Product details

[1944] Output: Voice command

[1945] Step 12:

[1946] The server recognizes the voice command and reconfirms the product's inventory. After confirmation, it updates the order information and sends a notification to the user to proceed with the purchase.

[1947] Input: Voice command

[1948] Output: Updated order information, purchase procedure notification

[1949] The above outlines the specific processing steps for the entire system. This allows users to efficiently access and reserve parking spaces, find store locations, and experience virtual shopping.

[1950] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1951] This invention includes a system that uses various sensors to detect available parking spaces, guides the user to the optimal available space based on their current location, and reserves that space in advance; a system that guides the user to the optimal route to a destination store within a shopping facility; and a system that allows users to select and purchase products using the virtual space of each store. Furthermore, this invention also includes a function to optimize the user experience by incorporating an emotion engine that recognizes the user's emotions. The details and specific examples of the overall system's program processing are described below.

[1952] (1) Guiding and securing parking spaces in advance

[1953] Explanation of program processing

[1954] 1. The server acquires data from various sensors in the parking lot (e.g., cameras and ultrasonic sensors) and determines whether or not there are available parking spaces.

[1955] 2. The device obtains the user's current location information using GPS and sends that information to the server.

[1956] 3. The server integrates information about available space with the user's current location to identify the nearest available space.

[1957] 4. The server sends the location information of the available space it has identified to the terminal.

[1958] 5. Based on the location information received by the device, navigation information to an available space is displayed to the user.

[1959] 6. The user follows the navigation in the app and heads to the designated empty space.

[1960] 7. The user taps the "Reserve" button to send a request from their device to reserve an available space in advance.

[1961] 8. The server receives the reservation request and changes the specified available space to a reserved state.

[1962] 9. The server sends a reservation confirmation to the device.

[1963] 10. The device displays a confirmation to the user that the reservation is complete.

[1964] Specific example

[1965] The server collects real-time data on available parking spaces for 150 cars and creates a list of available spaces.

[1966] The user opens a parking search page using a mobile app and finds the nearest available space from their current location.

[1967] The server obtains the user's current location from GPS data and presents the nearest available space (e.g., space number 35) from the list of available spaces.

[1968] The terminal will show the user the optimal route and guide them to space number 35 using voice guidance.

[1969] The user taps "Reserve Space 35" to reserve the space in advance.

[1970] The server checks the reservation information and updates it so that space 35 is not displayed to other users.

[1971] The device displays a reservation completion notification to the user.

[1972] (2) Guiding customers to the optimal store layout

[1973] Explanation of program processing

[1974] 1. The server manages and updates location information and floor map data for all stores within the shopping facility.

[1975] 2. The user opens the app and enters the name of the store they want to visit.

[1976] 3. The terminal sends the entered store name to the server.

[1977] 4. The server searches for the location information of the relevant store and calculates the optimal route from the current location.

[1978] 5. The device sends its current location information, obtained using GPS, to the server.

[1979] 6. The server calculates the most suitable route for the user based on the user's current location and the store's location, and sends that information to the user's device.

[1980] 7. The terminal displays the received route information as a map and begins providing route guidance to the user.

[1981] 8. The user follows the map directions on their device and proceeds to the desired store.

[1982] (3) VR customer service and sales at each store

[1983] Explanation of program processing

[1984] 1. The server collects real-time inventory information from each store and updates the database.

[1985] 2. The user selects the store where they wish to receive VR customer service via the mobile app and starts the session.

[1986] 3. The terminal sends a session start request to the server, specifying the selected store.

[1987] 4. The server generates access information for the virtual shop and sends it to the terminal.

[1988] 5. The device displays the entrance to the virtual shop to the user and prompts them to access it.

[1989] 6. Once the user enters the virtual shop, they can freely explore the VR space and select products.

[1990] 7. The device sends information about the product selected by the user to the server.

[1991] 8. The server checks the inventory information of the selected product and sends a list of available products to the terminal.

[1992] 9. The device displays a list of purchasable items to the user and shows a screen to begin the purchase process.

[1993] 10. The user selects the product they want to purchase and taps the "Purchase" button.

[1994] 11. The device sends the purchase request and payment information to the server.

[1995] 12. The server completes the payment process and notifies the terminal of the result.

[1996] 13. The terminal displays a notification to the user that the payment has been completed.

[1997] (4) Use of the Emotion Engine

[1998] Explanation of how the emotion engine works

[1999] 1. The device uses the user's camera and microphone to analyze the user's facial expressions and voice tone in real time and acquire emotional information.

[2000] 2. The emotion engine analyzes emotional information and sends the user's emotional state (e.g., stress, joy, frustration) to the server.

[2001] 3. The server uses user sentiment information to dynamically change the guidance methods and displayed content.

[2002] Specific example

[2003] When the device detects stress from the user's facial expression, the server adjusts its settings to provide more concise and faster information about available spaces.

[2004] If a user gets lost in a shopping mall, the emotion engine detects their frustration, and the server adjusts the guidance information to make it easier to understand and view.

[2005] The device detects the user's excitement within the virtual shop, and the server more proactively suggests recommended products.

[2006] Thus, the present invention provides an integrated service combining a parking space availability guide, store guidance within commercial facilities, and online shopping experiences for each store, all in combination with an emotion engine, enabling the delivery of optimal services tailored to the user's emotional state.

[2007] The following describes the processing flow.

[2008] (1) Guiding and securing parking spaces in advance

[2009] Specific steps in program processing

[2010] Step 1:

[2011] The server acquires data from various sensors in the parking lot (such as cameras and ultrasonic sensors) and determines whether or not there are available parking spaces.

[2012] Step 2:

[2013] The device obtains the user's current location information using GPS and sends that information to the server.

[2014] Step 3:

[2015] The server integrates information about available space with the user's current location to identify the nearest available space.

[2016] Step 4:

[2017] The server sends location information of the available space it has identified to the terminal.

[2018] Step 5:

[2019] Based on the location information received by the device, navigation information to an available space is displayed to the user.

[2020] Step 6:

[2021] The user follows the navigation in the app and heads to the designated empty space.

[2022] Step 7:

[2023] The user taps the "Reserve" button to send a request from their device to reserve an available space in advance.

[2024] Step 8:

[2025] The server receives the reservation request and changes the specified available space to a reserved state.

[2026] Step 9:

[2027] The server sends a reservation confirmation to the device.

[2028] Step 10:

[2029] The device displays a confirmation to the user that the reservation is complete.

[2030] (2) Guiding customers to the optimal store layout

[2031] Specific steps in program processing

[2032] Step 1:

[2033] The server manages and updates location information and floor map data for all stores within the shopping complex.

[2034] Step 2:

[2035] The user opens the app and enters the name of the store they want to visit.

[2036] Step 3:

[2037] The terminal sends the entered store name to the server.

[2038] Step 4:

[2039] The server searches for the location information of the relevant store and calculates the optimal route from the current location.

[2040] Step 5:

[2041] The device uses GPS to obtain its current location information, which is then sent to the server.

[2042] Step 6:

[2043] The server calculates the most suitable route for the user based on their current location and the location of the store, and sends that information to their device.

[2044] Step 7:

[2045] The terminal displays the route information it has received as a map and begins providing route guidance to the user.

[2046] Step 8:

[2047] The user follows the map directions on their device to reach their destination store.

[2048] (3) VR customer service and sales at each store

[2049] Specific steps in program processing

[2050] Step 1:

[2051] The server collects real-time inventory information from each store and updates the database.

[2052] Step 2:

[2053] The user selects the store where they want to receive VR customer service via a mobile app and starts the session.

[2054] Step 3:

[2055] The device sends a session start request to the server, specifying the selected store.

[2056] Step 4:

[2057] The server generates access information for the virtual shop and sends it to the terminal.

[2058] Step 5:

[2059] The device displays the entrance to the virtual shop to the user and prompts them to access it.

[2060] Step 6:

[2061] When a user enters a virtual shop, they can freely explore the VR space and select products.

[2062] Step 7:

[2063] The device sends information about the product selected by the user to the server.

[2064] Step 8:

[2065] The server checks the inventory information of the selected product and sends a list of available products to the terminal.

[2066] Step 9:

[2067] The device displays a list of purchasable items to the user and shows a screen to begin the purchase process.

[2068] Step 10:

[2069] The user selects the product they want to purchase and taps the "Purchase" button.

[2070] Step 11:

[2071] The device sends the purchase request and payment information to the server.

[2072] Step 12:

[2073] The server completes the payment process and notifies the terminal of the result.

[2074] Step 13:

[2075] The device displays a notification to the user that the payment has been completed.

[2076] (4) Use of the Emotion Engine

[2077] Explanation of how the emotion engine works

[2078] Step 1:

[2079] The device uses the user's camera and microphone to analyze the user's facial expressions and voice tone in real time and acquire emotional information.

[2080] Step 2:

[2081] The emotion engine analyzes emotional information and sends the user's emotional state (e.g., stress, joy, frustration) to the server.

[2082] Step 3:

[2083] The server receives emotional information and dynamically changes the guidance method and displayed content based on the user's emotional state.

[2084] Specific example

[2085] Parking guidance case

[2086] If the device detects stress from the user's facial expressions, the server adjusts the display of guidance information to be more concise and faster.

[2087] Shopping mall information case

[2088] When the emotion engine detects that a user is lost and frustrated in a store, the server adjusts the guidance information to make it easier to understand and view.

[2089] Cases within a virtual shop

[2090] When the device detects the user's excited facial expression, the server more proactively suggests recommended products, increasing the likelihood of a purchase.

[2091] Thus, the present invention provides an integrated service combining a parking space availability guide, store guidance within commercial facilities, and online shopping experiences for each store, all in combination with an emotion engine, enabling the delivery of optimal services tailored to the user's emotional state.

[2092] (Example 2)

[2093] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[2094] Conventional parking management systems can detect available spaces, acquire user location information, and provide guidance, but they fail to provide efficient guidance and services that take into account the user's emotional state. This can lead to a decline in the quality of the user experience and potentially impair user convenience. Furthermore, providing optimal services that reflect the user's emotional state is also a challenge in store guidance and virtual shopping.

[2095] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[2096] In this invention, the server includes means for detecting available parking spaces using various sensors, means for acquiring current location information from the user's terminal, means for guiding the user to the nearest available parking space based on the available space information and current location information, means for reserving a designated available parking space in advance, means for acquiring emotional information, means for analyzing emotional information, and means for dynamically changing the guidance method and display content based on the emotional information. This makes it possible to provide optimal guidance according to the user's emotional state, thereby improving the quality of the user experience.

[2097] "Various sensors" is a general term for devices such as cameras and ultrasonic sensors used to detect available parking spaces and other conditions.

[2098] "User's device" refers to a mobile device such as a smartphone or tablet used by the user, and is a device used to acquire and transmit current location information and other data.

[2099] "Current location information" refers to the user's real-time location data obtained using location information acquisition technologies such as GPS.

[2100] "Available space information" refers to data obtained from various sensors regarding the availability of parking spaces.

[2101] "Guidance means" refers to methods and means for notifying users of the optimal route to available spaces or stores, and includes map displays and voice guidance.

[2102] "Prior reservation methods" refer to methods or systems that allow users to reserve a specific available space and prevent other users from using that space.

[2103] "Emotional information" refers to data on the user's emotional state obtained by analyzing the user's facial expressions, voice tone, and other information acquired using the user's camera and microphone.

[2104] "Means for analyzing emotional information" refers to analytical algorithms and systems used to determine a user's emotional state based on acquired emotional information.

[2105] "Means of dynamic modification" refers to technologies and systems that change guidance methods and displayed content in real time according to the user's emotional information.

[2106] "Store location information" refers to data that indicates the specific location of each store within a shopping facility.

[2107] "Floor map information" refers to map data that shows the layout of all stores and facilities within a shopping complex.

[2108] "Inventory information" refers to data that shows the inventory status of products held by each store.

[2109] A "virtual space" is a virtual shop space that users can access using virtual reality technology.

[2110] "Product selection" refers to the act of a user choosing a product in a virtual space with the intention of purchasing it.

[2111] "Purchase procedure" refers to a series of steps taken to complete the purchase of selected items, including entering and confirming payment information.

[2112] This invention includes a system that uses various sensors to detect available parking spaces, guides the user to the optimal available space based on their current location, and reserves that space in advance; a system that guides the user to the optimal route to a destination store within a shopping facility; and a system that allows users to select and purchase products using the virtual space of each store. Furthermore, this invention also includes a function that optimizes the user experience by incorporating an emotion engine that recognizes the user's emotions.

[2113] Guiding and securing parking spaces in advance

[2114] The server acquires data in real time from various sensors in the parking lot (cameras, ultrasonic sensors, etc.) and determines whether there are any available spaces. Specifically, it analyzes camera images to check for the presence of vehicles and uses ultrasonic sensor data to measure distances.

[2115] The device uses GPS to obtain the user's current location information and sends that information to the server. For example, a user launches the app and taps the "Get Current Location" button on the parking lot search page.

[2116] The server integrates information on available spaces with the user's current location to identify the nearest available space. The server uses GPS data to calculate distances and selects the most suitable space for the user.

[2117] The server identifies an available space and sends its location information to the terminal. Based on this location information, the terminal displays navigation information to the user to reach the available space. The user uses voice guidance or a map display to navigate to the designated space.

[2118] After the user arrives at the designated available space, they tap the "Reserve" button to reserve it in advance. The server receives the reservation request, changes the designated space to a reserved status, and sends a reservation completion notification to the user's device.

[2119] Guidance to the optimal store flow

[2120] The server manages and regularly updates location information and floor map data for all stores within the shopping complex. This ensures that the most up-to-date store layout information is maintained.

[2121] The user opens the app and enters the name of the store they want to visit. The device sends the entered store name to the server. For example, if the user enters "Starbucks," the server receives it.

[2122] The server searches for the location information of the relevant store and calculates the optimal route from the current location. The server uses GPS data to confirm the user's current location and generates the optimal route.

[2123] The device receives route information and displays it as a map. The user can follow the device's instructions to reach their destination store.

[2124] VR customer service and sales at each store

[2125] The server collects real-time inventory information from each store and updates the database. For example, when an item is sold, the inventory information is updated immediately.

[2126] The user selects a store where they would like VR customer service via the app and starts a session. The device sends the selected information to the server. The user freely explores the products in the virtual space and selects items they like.

[2127] The terminal sends information about the selected product to the server, which checks the inventory and returns a list of available products. When the user selects a product and proceeds with the purchase, payment information is sent to the server, which completes the payment process.

[2128] Using an Emotion Engine

[2129] The device uses the user's camera and microphone to analyze the user's facial expressions and voice tone in real time and acquire emotional information. For example, it might take a picture of the user's face with the camera and perform voice analysis.

[2130] The emotion engine analyzes the acquired emotional information to determine the user's emotional state (stress, joy, frustration, etc.) and sends that information to the server.

[2131] The server uses emotional information to dynamically change the guidance methods and displayed content. For example, it simplifies guidance information and emphasizes important information for users who are stressed.

[2132] This allows the system to provide optimal guidance based on the user's emotional state, integrating information on available parking spaces, store locations within commercial facilities, and even an online shopping experience. Examples of prompt messages are shown below.

[2133] Concrete examples of generative AI model prompts

[2134] Generating instructions for guiding users to available parking spaces.

[2135] Please explain the programming procedure for a system that guides users to and reserves available parking spaces. This includes the roles of the server, terminal, and user, how data is acquired from various sensors in the parking lot, how available spaces are determined, how the user's current location is obtained, how available spaces are displayed, and the reservation process. Please also include specific examples.

[2136] Store Layout Guide Explanation Generation

[2137] Please provide a detailed explanation of the program's processing for a system that guides users along the optimal store routes within a shopping facility. This includes the roles of the server, terminals, and users, the management of location information and floor map data for all stores, the input of store information the user wants to visit, and the calculation of the optimal route based on that information. Please also include specific examples.

[2138] Generating explanations for VR customer service and sales.

[2139] Please provide a detailed explanation of the program processing for each store's VR customer service and sales system. This includes the roles of the server, terminal, and user, as well as details of real-time inventory information collection, initiation of the user's VR customer service session, product selection flow, and purchase procedure. Please also include specific examples.

[2140] Emotion Engine Description Generation

[2141] Please provide a detailed explanation of the program processing for a user experience optimization system that utilizes an emotion engine. This includes the roles of the terminal, emotion engine, and server, as well as the process of analyzing the user's facial expressions and tone of voice, collecting and analyzing emotion information, and dynamically changing guidance methods and displayed content based on that emotion information. Please also include specific examples.

[2142]

[2143] The flow of the specific processing in Example 2 will be explained using Figure 13.

[2144] Guiding and securing parking spaces in advance

[2145] Processing steps

[2146] Step 1:

[2147] The server collects data in real time from various sensors in the parking lot (cameras, ultrasonic sensors, etc.). This data is used to determine whether there are available parking spaces. Specifically, it analyzes camera images to detect the presence or absence of vehicles and analyzes distance data from ultrasonic sensors to determine if a parking space is occupied. Sensor data is the input, and information on available spaces is obtained as the output.

[2148] Step 2:

[2149] The device obtains the user's current location information using GPS and sends that information to the server. When the user launches the app and taps the "Get Current Location" button, the device obtains the user's location information and sends it to the server. GPS data is taken as input, and the current location information is obtained as output.

[2150] Step 3:

[2151] The server integrates information about available spaces with the user's current location to identify the nearest available space. The server compares GPS data with the location information (X, Y coordinates) of the available spaces, calculates the straight-line distance, and identifies the nearest available space. The input is information about available spaces and the user's current location, and the output is the location information of the nearest available space.

[2152] Step 4:

[2153] The server sends location information of the free space it has identified to the terminal. This includes the specific location of the free space (for example, "Section A, Space 35"). The input is the location information of the nearest free space, and the output is the location information of the free space to be sent to the terminal.

[2154] Step 5:

[2155] Based on the location information received by the device, navigation information to an available parking space is displayed to the user. The map display is updated, and voice guidance is also used to guide the user to the designated parking space. The input is the location information of the available parking space, and the output is navigation information.

[2156] Step 6:

[2157] After the user arrives at the designated available space, they tap the "Reserve" button to reserve it in advance. The device then sends the reservation request to the server. The input is the reservation request, and the output is the reservation request data.

[2158] Step 7:

[2159] The server receives a reservation request and changes the specified available space to a reserved state. This makes that space unavailable to other users. The input is reservation request data, and the output is a reservation completion notification.

[2160] Step 8:

[2161] The server sends a reservation completion notification to the terminal, and the terminal displays a confirmation of the reservation completion to the user. The input is the reservation completion notification, and the output is the notification information for the user.

[2162] Guidance to the optimal store flow

[2163] Processing steps

[2164] Step 1:

[2165] The server manages and regularly updates location information and floor map data for all stores within the shopping complex. New store openings and store relocation information are automatically reflected in the database. Input includes location information and floor map data for each store, and output is an updated database.

[2166] Step 2:

[2167] The user opens the app and enters the name of the store they want to visit. The device sends the entered store name to the server. The input is the store name entered by the user, and the output is the store name data sent to the server.

[2168] Step 3:

[2169] The server searches for the location information of the relevant store and calculates the optimal route from the user's current location. The server uses GPS data to confirm the user's current location and generates the optimal route. The input is store name data and current location information, and the output is optimal route information.

[2170] Step 4:

[2171] The server sends optimal route information to the terminal, and the terminal displays the received route information as a map. The input is optimal route information, and the output is map data sent to the terminal.

[2172] Step 5:

[2173] The user follows the map directions to reach their destination store. The terminal provides route guidance using both map data and voice guidance. Map data is the input, and guidance information is output.

[2174] VR customer service and sales at each store

[2175] Processing steps

[2176] Step 1:

[2177] The server collects real-time inventory information from each store and updates the database. The inventory information is automatically reflected in the database. The input is the inventory information from each store, and the output is the updated database.

[2178] Step 2:

[2179] The user selects a store where they wish to receive VR customer service via a mobile app and starts a session. The device sends the selected store information to the server. The input is the name of the store selected by the user, and the output is the session start request sent to the server.

[2180] Step 3:

[2181] The server generates access information for the virtual shop and sends it to the terminal. The terminal displays the entrance to the virtual shop to the user and prompts them to access it. The input is a session start request, and the output is the access information for the terminal.

[2182] Step 4:

[2183] The user accesses a virtual shop and freely explores the VR space. The user checks product information and selects the product they wish to purchase. The input is data from the virtual shop, and the output is information about the selected product.

[2184] Step 5:

[2185] The terminal sends information about the selected product to the server, the server checks the inventory information and sends a list of available products to the terminal. The input is information about the selected product, and the output is a list of available products.

[2186] Step 6:

[2187] The user proceeds with the purchase process, enters payment information, and taps the "Purchase" button. The device sends the purchase request and payment information to the server. The input is the purchase process data, and the output is the payment request.

[2188] Step 7:

[2189] The server completes the payment process and notifies the terminal of the result. The terminal displays a payment completion notification to the user. The input is a payment request, and the output is a payment completion notification.

[2190] Using an Emotion Engine

[2191] Processing steps

[2192] Step 1:

[2193] The device uses the user's camera and microphone to analyze the user's facial expressions and voice tone in real time and acquire emotional information. The input consists of camera images and audio data, and the output is emotional information.

[2194] Step 2:

[2195] The emotion engine analyzes the acquired emotion information and sends the user's emotional state to the server. The input is the analyzed emotion information, and the output is the data sent to the server.

[2196] Step 3:

[2197] The server uses user emotion information to dynamically change the guidance methods and displayed content. For example, for a user experiencing stress, the guidance information is simplified and important information is emphasized. Emotion information is taken as input, and the adjusted guidance information is returned as output.

[2198] (Application Example 2)

[2199] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[2200] In modern shopping facilities and parking lots, there is a need to improve convenience for users to easily find parking spaces and enjoy their shopping. Traditional systems often made searching for available parking spaces and navigating to stores within shopping facilities cumbersome, causing stress to users, especially during peak hours. Furthermore, the time-consuming process of selecting desired products and checking inventory also negatively impacted the user experience. Moreover, providing services that consider user emotions was difficult, making it challenging to offer optimal services tailored to individual needs.

[2201] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for detecting available parking spaces using various sensors, means for acquiring current location information from the user's terminal, means for guiding the user to the nearest available spa...

Claims

1. A means for detecting available parking spaces using various sensors, A means of obtaining the current location information from the user's device, A method for guiding users to the nearest available space based on available space information and current location information, A means of securing the designated vacant space in advance, A system that includes this.

2. In the system described in claim 1, A means for managing store location information and floor map information within a shopping facility, A means for receiving destination information entered from the user's terminal, A means of generating the optimal route based on destination information and current location information, A means of sending generated route information to the user terminal. A system that further includes this.

3. In the system described in claim 1, A means of obtaining real-time inventory information for each store, A means for displaying a virtual store space based on input from the user's terminal, A means of receiving product selections within a virtual space, A method for proceeding with the purchase of selected items A system that further includes this.

Images