System

Abstract

A system is provided.SOLUTION: A system comprising: means for recommending an optimal golf course based on budget and location requirements; means for analyzing video of a swing motion and recommending improvements in real-time; means for tracking a hit location using a golf ball with a built-in Bluetooth chip; and means for recommending golf equipment based on budget and genre requirements.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Currently, many golfers face various challenges related to booking golf courses, improving their swing, checking ball placement, and selecting the right golf equipment. The lack of tools to efficiently solve these challenges limits their golfing experience. The present invention aims to provide an integrated system that solves these challenges all at once, allowing golfers to enjoy a more comfortable and fulfilling golfing life. [Means for solving the problem]

[0005] The present invention is a system including the following means: First, a means for recommending an optimal golf course based on budget and location criteria; Second, a means for analyzing video of a golf swing and recommending areas for improvement in real time; Third, a means for tracking the ball's position using a golf ball with a built-in Bluetooth chip; and Third, a means for recommending golf equipment based on budget and genre criteria. The system of the present invention provides a means for receiving data entered by a user and transmitting it to a server; a means for the server to search a database for golf courses that match the criteria and return the results to the terminal; a means for analyzing video of the swing using an AI model and generating an evaluation score and areas for improvement; a means for visually displaying the analysis results to the user; a means for receiving Bluetooth signals, collecting location data, and transmitting it to the server; a means for the server to process the location data and display the exact location of the ball on a map; a means for searching a database for golf equipment based on budget and genre and presenting the results to the user; and a means for providing a link to purchase the product, thereby integrating various functions to meet the diverse needs of golfers.

[0006] A "budget" is a financial limit set by a user when booking a golf course or purchasing golf equipment.

[0007] "Location" refers to the geographic location or area that a user specifies when selecting a golf course.

[0008] A "golf course" is a facility for playing golf, including a course and a clubhouse.

[0009] The "swing motion" is the series of movements that occur when swinging a golf club, and affects the accuracy and distance of a golf shot.

[0010] "Video" refers to a moving image of a swing motion captured by a user using a terminal.

[0011] "Analysis" is the process of extracting and evaluating information based on data such as video data and Bluetooth signals using AI models and algorithms.

[0012] "Areas for improvement" are areas that are recommended for correction based on the analysis results to help the user achieve better swing and hitting results.

[0013] A "Bluetooth chip" is an electronic component that transmits location data using Bluetooth, a wireless communication technology.

[0014] "Hit position" is information indicating the position where the golf ball stopped after being hit and the trajectory of the golf ball.

[0015] "Golf equipment" refers to products such as clubs, balls, and apparel used in playing and training golf.

[0016] "Recommendation" means that the system presents the most suitable options based on the user's input criteria.

[0017] A "server" is a computer system that receives data from a user, processes it, and returns the results to the terminal.

[0018] A "terminal" is a computer device used by a user, such as a smartphone or tablet.

[0019] The "database" is a data management system for managing golf course information, user swing data, golf equipment information, etc.

[0020] An "AI model" is an algorithm or learning model that uses artificial intelligence technology to analyze data and make evaluations and predictions.

[0021] An "evaluation score" refers to the analysis results of swing movements and ball hit results expressed in numerical or other indicators.

[0022] "Purchase Link" means an associated link to an online store where a user can purchase the recommended golf equipment. [Brief explanation of the drawings]

[0023] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0024] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0025] First, the terms used in the following description will be explained.

[0026] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0027] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0028] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0029] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0030] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0031] [First embodiment]

[0032] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0033] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0034] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0035] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0036] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0037] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0038] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0039] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0040] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0041] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0042] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0043] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0044] The present invention provides an integrated system for enriching your golfing life, and includes the following functions.

[0045] 1. Golf course reservation function

[0046] The user uses a terminal to input budget and location criteria. This information is sent from the terminal to a server, which then searches for matching golf courses in its database. The server returns the search results to the terminal, which displays them to the user. The user can then select the most suitable golf course and make a reservation. For example, a list of the most suitable golf courses within Kyoto City with a budget of 10,000 yen or less is displayed.

[0047] 2. Golf swing analysis function

[0048] The user uses the device's camera to film their swing and sends the video data to the server. The server uses an AI model to evaluate the swing and suggest areas for improvement. The analysis results are sent back to the device and displayed to the user. For example, when a user films their swing, the server analyzes the swing's angle and speed and provides an evaluation along with suggestions for improvement.

[0049] 3. Ball position tracking function

[0050] The user hits the ball using a golf ball equipped with a built-in Bluetooth chip. The device receives the Bluetooth signal from the ball and sends the location data to the server. The server analyzes the data and plots the ball's location on a map. The result is sent back to the device, allowing the user to easily find the ball. For example, when a user hits a golf ball, the ball's current location is displayed on a map.

[0051] 4. Golf equipment recommendation function

[0052] The user uses the device to enter criteria such as budget and genre, and sends that information to the server. The server searches the database for golf equipment that matches the criteria and sends the results back to the device. The device then displays recommended products to the user and provides a purchase link. For example, if a user looking to purchase a new driver searches for items under 30,000 yen, a list of optimal products will be displayed and a purchase link will be provided.

[0053] Program processing explanation

[0054] Golf course reservations

[0055] The server receives the user's input criteria and searches the database for golf courses that match the criteria. The results are sent to the terminal, which displays them to the user. The user selects the desired golf course from the displayed list and completes the reservation.

[0056] Golf Swing Analysis

[0057] The device takes a video of the swing and sends it to the server. The server analyzes the video data using an AI model and generates an evaluation and points for improvement. The results are sent to the device, which displays them to the user. The user can then use the displayed points for improvement to make corrections to their swing.

[0058] Ball position tracking

[0059] The device receives signals from golf balls with built-in Bluetooth chips and transmits location data to a server. The server processes the data and plots the ball's location on a map. The results are sent back to the device, which displays the location information to the user. The user can then use the displayed information to find the ball.

[0060] Golf equipment recommendations

[0061] The user inputs budget and genre criteria on the device and sends them to the server. The server searches the database for golf equipment that matches the criteria and sends the results back to the device. The device then displays recommended products to the user and provides a purchase link. The user can then purchase the displayed products.

[0062] A system that integrates all of the above functions will instantly eliminate all of a golfer's worries and enrich their golfing life.

[0063] The processing flow will be explained below.

[0064] Golf course reservation processing steps

[0065] Example: A user searching for a golf course in Kyoto City with a budget of less than 10,000 yen

[0066] Step 1:

[0067] The user launches the app using their device and enters their budget (within 10,000 yen) and desired location (within Kyoto City).

[0068] Step 2:

[0069] The device sends the user's input data to the server using an HTTP request.

[0070] Step 3:

[0071] The server searches the database for golf course information based on the received criteria. The server executes an SQL query to extract golf courses that match the specified criteria.

[0072] Step 4:

[0073] The server returns the search results to the terminal as an HTTP response.

[0074] Step 5:

[0075] The terminal displays the list of golf courses received to the user, and the user selects the golf course he or she desires.

[0076] Step 6:

[0077] The user enters detailed information (such as date and time and number of players) to reserve the selected golf course, and the device sends this information to the server.

[0078] Step 7:

[0079] The server receives the reservation information, stores it in a database, and returns a message to the terminal indicating that the reservation was successful.

[0080] Step 8:

[0081] The terminal will display a reservation completion message to the user.

[0082] Golf Swing Analysis Processing Steps

[0083] Example: A user who wants to know how to improve their swing.

[0084] Step 1:

[0085] The user activates the camera on the device and records their own swing.

[0086] Step 2:

[0087] The device compresses the captured swing video and transmits the video data to a server using a protocol for efficient video data transfer.

[0088] Step 3:

[0089] The server receives the video data and analyzes the swing using an AI model. The server then uses a deep learning model to extract each element of the swing (speed, angle, etc.) and generates an evaluation score and areas for improvement.

[0090] Step 4:

[0091] The server returns the analysis results to the terminal as an HTTP response.

[0092] Step 5:

[0093] The device displays the analysis results and improvements received to the user.

[0094] Step 6:

[0095] The user will then try to make corrections in their next swing based on the improvements shown.

[0096] Ball position tracking processing steps

[0097] Example: A user who wants to check the ball's position

[0098] Step 1:

[0099] The user hits the ball using a golf ball equipped with a built-in Bluetooth chip.

[0100] Step 2:

[0101] The ball periodically emits a Bluetooth signal along its trajectory.

[0102] Step 3:

[0103] The device receives the Bluetooth signal, analyzes its location data, and sends it to a server, including signal strength and timing.

[0104] Step 4:

[0105] The server receives the position data and runs an algorithm to determine the exact location of the ball.

[0106] Step 5:

[0107] The server returns the processing result to the terminal as an HTTP response.

[0108] Step 6:

[0109] The device plots the ball position information it receives on a map and displays it to the user.

[0110] Step 7:

[0111] The user finds the golf ball based on the displayed location information.

[0112] Processing steps for golf equipment recommendations

[0113] Example: A user who wants to purchase a new driver

[0114] Step 1:

[0115] The user launches the app using their device and enters their budget (e.g., under 30,000 yen) and desired genre (e.g., driver).

[0116] Step 2:

[0117] The device sends the user's input data to the server.

[0118] Step 3:

[0119] The server searches the database for suitable golf equipment based on the received criteria, and uses a filtering algorithm to extract products that match the criteria.

[0120] Step 4:

[0121] The server returns the search results and a list of recommended products to the terminal as an HTTP response.

[0122] Step 5:

[0123] The device displays search results to the user and provides a link to purchase.

[0124] Step 6:

[0125] The user selects from the displayed products and clicks the purchase link to visit the online store.

[0126] Step 7:

[0127] The user completes the purchase process on your online store.

[0128] Example 1

[0129] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0130] Today's golfers face many challenges when it comes to choosing a golf course, improving their swing, tracking their ball position, and purchasing golf equipment. An integrated system is needed to resolve these issues and enrich their golfing life. Specifically, it is necessary to reserve the optimal golf course, analyze their swing motion in real time, accurately grasp their ball position, and recommend the appropriate golf equipment.

[0131] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0132] In this invention, the server includes a means for recommending the most suitable golf course based on budget and location conditions, a means for analyzing video of a swing using a generative AI model to generate an evaluation score and areas for improvement, a means for tracking the ball position using a golf ball with a built-in communication module, and a means for recommending golf equipment based on budget and category conditions. This enables various golf-related activities to be carried out efficiently and effectively, resolving golfers' concerns and enriching their golfing life.

[0133] "Budget" refers to the upper limit of the amount that a user sets when selecting a golf course or golf equipment.

[0134] "Location" means the geographic area or region designated by a User when making a golf course reservation.

[0135] "Swing motion" refers to the series of body movements that occur when swinging a golf club to hit a ball.

[0136] A "generative AI model" refers to an artificial intelligence model that uses machine learning algorithms to analyze data and make evaluations and suggestions.

[0137] "Golf ball with built-in communication module" refers to a golf ball that has built-in Bluetooth or other wireless communication capabilities to track the ball's position.

[0138] "Golf equipment" refers to items related to playing golf, such as clubs, balls, bags, and clothing.

[0139] A "database" refers to a system for systematically managing and storing information.

[0140] "Evaluation score" refers to the result of evaluating swing movements and other performance using a number or grade.

[0141] The present invention is an integrated system for enriching your golfing life, and includes the functions of recommending golf courses based on budget and location, video analysis of swing movements, tracking the position of the ball using a golf ball with a built-in communication module, and recommending golf equipment based on budget and genre.

[0142] Golf course reservation function

[0143] The user uses a terminal to input budget and location requirements. The terminal sends this information to the server, which then accesses a database to search for golf courses that meet the requirements. The search results are sent to the terminal, which displays them to the user. The user can then select the desired facility from the displayed golf courses and make a reservation.

[0144] For example, a user inputs the conditions "budget within 10,000 yen" and "Kyoto city", and the server searches for golf courses that match these conditions. As a result, "Golf courses A, B, and C in Kyoto city" are displayed on the terminal, and the user can select one to complete the reservation.

[0145] Example prompt sentence:

[0146] "Please find a golf course in Kyoto City with a budget of 10,000 yen or less."

[0147] Golf swing analysis function

[0148] Users film their golf swing using the device's camera. The video data is sent from the device to a server, where it is analyzed using a generative AI model. The analysis results, including a swing evaluation score and areas for improvement, are sent back to the device and displayed to the user.

[0149] For example, a user takes a video of their golf swing and sends it to a server, which then analyzes the swing angle and speed. The server generates a result, such as "You need to improve your swing angle by 10 degrees," and sends it to the device. The user can use this result to make improvements.

[0150] Example prompt sentence:

[0151] "Please analyze the video of my golf swing and tell me where I can improve."

[0152] Ball position tracking function

[0153] The user uses a golf ball with a built-in communications module and hits the ball. The device receives the radio signal from the ball and transmits the location data to the server. The server analyzes the data and plots the ball's location on a map. The results are sent back to the device, which displays this information to the user.

[0154] For example, after a user hits a golf ball, the device identifies its location and sends the data to the server. The server generates a result such as "The ball's current location is coordinates X, Y" and sends it to the device. The user can then find the golf ball based on the location information plotted on a map.

[0155] Example prompt sentence:

[0156] "Show me the current location of the golf ball I hit."

[0157] Golf equipment recommendation function

[0158] The user inputs budget and category criteria using the device and sends that information to the server. The server searches the database for golf equipment that matches the criteria and sends the results to the device. The device then displays recommended products to the user and provides a link to purchase them.

[0159] For example, if a user enters the criteria "I want a new screwdriver with a budget of less than 30,000 yen," the server will search for suitable products based on this. The server will create results such as "Product A, Product B, Product C" and send them to the terminal. The user will then make a purchase based on these results.

[0160] Example prompt sentence:

[0161] "Please tell me a recommended screwdriver that can be purchased for under 30,000 yen."

[0162] By integrating these functions into a system, it is possible to provide a comprehensive range of services that meet the diverse needs of golfers, further enriching their golfing life.

[0163] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0164] Golf course reservation function

[0165] Step 1:

[0166] The user enters the budget and location conditions into the device. The user opens the dedicated application and enters "under 10,000 yen" for the budget and "Kyoto city" for the location. The entered data is temporarily saved on the device.

[0167] Input: Budget and location conditions (e.g., within 10,000 yen, within Kyoto City)

[0168] Output: Condition data saved on the device

[0169] Step 2:

[0170] The device sends the entered conditions to the server. The device sends the budget and location condition data to the server via an HTTP request. The software used is a library that sends data in JSON format.

[0171] Input: Condition data (under 10,000 yen, within Kyoto city)

[0172] Output: HTTP request to the server

[0173] Step 3:

[0174] The server searches the database for golf courses that match the criteria. The server searches the database using an SQL query based on the received criteria. Information on golf courses that match the criteria is obtained.

[0175] Input: Condition data received as an HTTP request

[0176] Output: Search results for golf courses that match the criteria

[0177] Step 4:

[0178] The server sends the search results to the terminal. The server returns the search result data in JSON format to the terminal. The software used is a server-side framework (e.g., Django, Flask).

[0179] Input: Search result data

[0180] Output: HTTP response to the device

[0181] Step 5:

[0182] The terminal displays the search results to the user. The received data is analyzed and the search results are displayed to the user via a GUI. The results displayed might be "Golf Courses A, B, and C in Kyoto City," for example.

[0183] Input: Search results received as an HTTP response

[0184] Output: Search results displayed on the GUI

[0185] Step 6:

[0186] The user selects the golf course of their choice and makes a reservation. When the user clicks the reservation button, the terminal sends the reservation information to the server, which then processes the reservation.

[0187] Input: User selection and reservation information

[0188] Output: Reservation confirmation notification

[0189] Golf swing analysis function

[0190] Step 1:

[0191] The user uses the device's camera to record their golf swing. The user launches the application and uses the camera to record their swing.

[0192] Input: Golf swing video

[0193] Output: Recorded video data

[0194] Step 2:

[0195] The device sends video data to the server. The captured video data is transferred to the server using an HTTP POST request. The video data is compressed and a library is used for transfer.

[0196] Input: Captured video data

[0197] Output: HTTP POST request to the server

[0198] Step 3:

[0199] The server analyzes the video data using an AI model (e.g., OpenPose) to generate evaluation data such as swing angle and speed.

[0200] Input: Video data received as an HTTP POST request

[0201] Output: Analysis results including evaluation scores and improvement points

[0202] Step 4:

[0203] The server sends the analysis results to the device, which then returns them to the device in JSON format.

[0204] Input: Analysis result data

[0205] Output: HTTP response to the device

[0206] Step 5:

[0207] The device displays the analysis results to the user. The analysis results are analyzed and displayed to the user through a GUI, including specific feedback such as "You need to improve your swing angle by 10 degrees."

[0208] Input: Analysis results received as an HTTP response

[0209] Output: Display of analysis results and improvements on the GUI

[0210] Ball position tracking function

[0211] Step 1:

[0212] The user hits the ball using a golf ball with a built-in communication module. The user hits the ball with a golf club.

[0213] Input: Ball hitting situation (physical action)

[0214] Output: Signal transmission from the communication module

[0215] Step 2:

[0216] The device receives the wireless signal from the golf ball. The device uses the Bluetooth communication library to receive the signal emitted from the golf ball and obtain the location data.

[0217] Input: Wireless signal

[0218] Output: Position data

[0219] Step 3:

[0220] The device sends location data to the server. The acquired location data is then sent to the server via an HTTP request.

[0221] Input: Location data

[0222] Output: HTTP request to the server

[0223] Step 4:

[0224] The server analyzes the location data. The server analyzes the received location data and generates data that can be plotted as a precise map location.

[0225] Input: Location data received as an HTTP request

[0226] Output: Analysis results (plot data)

[0227] Step 5:

[0228] The server sends the analysis results to the terminal, and then sends the plot data back to the terminal.

[0229] Input: Analysis result data

[0230] Output: HTTP response to the device

[0231] Step 6:

[0232] The terminal plots the ball's position on a map and displays it to the user. The terminal plots the analysis results on a map and displays them to the user through a GUI.

[0233] Input: Plot data received as an HTTP response

[0234] Output: Plot display on map

[0235] Golf equipment recommendation function

[0236] Step 1:

[0237] The user inputs the budget and genre into the device. The user opens the dedicated application and enters "under 30,000 yen" as the budget and "driver" as the genre.

[0238] Input: Budget and genre criteria

[0239] Output: Condition data saved on the device

[0240] Step 2:

[0241] The terminal sends the entered conditions to the server. The terminal sends the condition data to the server via an HTTP request.

[0242] Input: Condition data

[0243] Output: HTTP request to the server

[0244] Step 3:

[0245] The server searches the database for golf equipment that matches the criteria. Based on the received criteria, the server searches the database using an SQL query to retrieve information on golf equipment that matches the criteria.

[0246] Input: Condition data received as an HTTP request

[0247] Output: Search results for golf equipment that matches the criteria

[0248] Step 4:

[0249] The server sends the search results to the device. The server returns the search result data to the device in JSON format.

[0250] Input: Search result data

[0251] Output: HTTP response to the device

[0252] Step 5:

[0253] The device displays recommended products to the user and provides a purchase link. The search results are analyzed and displayed to the user through a GUI. The results displayed include "Driver A (29,999 yen), Driver B (28,000 yen)," and other products, along with a purchase link for each product.

[0254] Input: Search results received as an HTTP response

[0255] Output: Recommended products and purchase links displayed on the GUI

[0256] (Application example 1)

[0257] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0258] In conventional golf-related systems and factory logistics management systems, individual functions are dispersed, making it difficult to manage and optimize them in an integrated manner. Furthermore, integrating functions such as golf course and logistics reservations, swing and route efficiency analysis, item location tracking, and recommendation systems is expected to improve user convenience, but no such system exists. The present invention aims to solve these problems and provide an integrated system that is efficient and convenient for users.

[0259] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0260] In this invention, the server includes a means for recommending the optimal golf course based on budget and location conditions, a means for analyzing video of swing movements and recommending areas for improvement in real time, a means for tracking the location of an item with a built-in Bluetooth device, a means for recommending tools and parts based on budget and category conditions, and a means for analyzing movement path data of an automatic transport robot to analyze efficiency and generate improvement proposals. This enables the realization of integrated golf-related services and in-factory logistics management, and improves the work efficiency of users and operators.

[0261] A "budget" is a set limit on spending for the acquisition of goods and services.

[0262] "Location Conditions" means any constraints or requirements relating to a particular geographic location or environment.

[0263] A "golf course" is a large green area designed for playing golf, including holes, tees, greens, etc.

[0264] A "swing motion" is a series of movements that are performed to swing a golf club and hit a golf ball.

[0265] "Analyzing video" is the process of extracting specific information based on video data captured by a camera or other device.

[0266] "Improvements" are corrections or refinements that are needed to improve current status or performance.

[0267] A "Bluetooth device" is an electronic device capable of exchanging data over short distances using wireless communication technology.

[0268] "Location tracking using an item" is the process of using an identification device attached to a particular item to monitor the current location of that item in real time.

[0269] "Tools" means hand and power tools for use in factories and workshops.

[0270] A "part" is a small component that makes up part of a product or machine.

[0271] "Recommending" is the act of presenting suitable options based on specific criteria.

[0272] An "automated transport robot" is a robotic device designed to autonomously transport items within a factory or warehouse.

[0273] "Analyzing travel route data" is the process of evaluating the efficiency and presence of obstacles based on the travel route data.

[0274] "Efficiency analysis" is an evaluation method for assessing the efficiency of a particular operation or process and identifying areas for improvement.

[0275] "Improvement proposals" are specific means or methods proposed to improve the current situation.

[0276] The present invention relates to an integrated factory logistics optimization system, and has the following functions.

[0277] 1. Logistics reservation function

[0278] The user uses a terminal to specify the items or parts to be transported and sends that information to the server. The server then searches the database for the optimal transport route and returns the results to the terminal. The user can then operate the automated transport robot according to the transport route displayed on the terminal. This allows for efficient management of logistics within the factory.

[0279] 2. Movement path analysis function

[0280] As the automated transport robot moves through the factory, the device captures video data of its movement path and sends it to the server. The server then analyzes the movement path data using a generative AI model to generate efficiency and improvement proposals. The analysis results are sent back to the device and displayed visually to the user. This optimizes the movement path of goods within the factory and improves efficiency.

[0281] 3. Item location tracking function

[0282] Items in the factory are equipped with Bluetooth devices, and the terminal receives this information to obtain the item's location. The location data is sent to a server, which analyzes the location in real time and sends it back to the terminal. Users can immediately find out where items are in the factory, reducing the time it takes to find lost items or search for them.

[0283] 4. Tool and parts recommendation function

[0284] The user uses a terminal to input the requirements for tools and parts (budget, purpose, etc.) and sends the information to the server. The server searches the database for tools and parts that match the requirements and returns the results to the terminal. The user can then select the most suitable product from the displayed recommended list and purchase it.

[0285] To integrate the above functions, the following hardware and software are mainly used.

[0286] Hardware:

[0287] Smartphone or tablet: A device that allows users to input and view information.

[0288] Server: Analyzes and stores data

[0289] Autonomous transport robot: A robot for transporting goods

[0290] Bluetooth devices: devices for tracking the location of items

[0291] software:

[0292] Database management systems (e.g., SQLite)

[0293] Web frameworks (e.g. Flask)

[0294] AI analytical models (e.g., generative AI models)

[0295] As a concrete example, let us consider the case where a user transports a specific part from a warehouse. First, the user inputs the information "bearing, warehouse A, 2023-10-12 14:00" into the terminal and sends it. The server receives this information and searches the database for the optimal transport route. The search results are returned to the terminal, which displays the transport route to the user. The user then operates the automated transport robot according to this route.

[0296] Example prompts used in route analysis by the AI ​​model:

[0297] Travel path data:

[0298] Starting point: Entrance

[0299] Route: Aisle 1 -> Aisle 2 -> Machine A

[0300] Time: 2023-10-11 09:00

[0301] Analysis task: Evaluate the efficiency of this route and suggest improvements.

[0302] These specific examples and integrated systems enable efficient logistics management in factories and work sites, optimize overall processes, and reduce the workload of users.

[0303] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0304] Step 1:

[0305] The user uses a terminal to input and transmit information about the item or part to be transported (e.g., bearing, warehouse A, 2023-10-12 14:00). The input data includes the type of item, the destination location, the desired date and time of transport, etc.

[0306] Step 2:

[0307] The terminal sends the input data to the server. The server receives the data and stores it in a database. The input data is saved as reservation information.

[0308] Step 3:

[0309] The server searches the database for the optimal route for the delivery. It uses a search algorithm to efficiently calculate the route for delivering the goods. For example, the algorithm calculates the shortest route between the goods' storage location and their destination.

[0310] Step 4:

[0311] The server returns the calculated optimal route to the terminal. The output data includes detailed information about the transportation route (e.g., passing through corridor 1 and then through corridor 2 to reach machine A).

[0312] Step 5:

[0313] The terminal displays the optimal route information received from the server to the user, who then operates the automated transport robot based on the displayed information to transport the goods.

[0314] Step 6:

[0315] As the automated transport robot moves through the factory, the device captures and records the path of its movement as video data. The recorded data includes video of the physical path of movement.

[0316] Step 7:

[0317] The device sends video data of the travel route to the server. The server analyzes this video data using a generative AI model. The analysis prompt is, "Travel route data: - Starting point: Entrance - Route: Aisle 1 -> Aisle 2 -> Machine A - Time: 2023-10-11 09:00 Analysis task: Evaluate the efficiency of this route and suggest improvements."

[0318] Step 8:

[0319] The server uses a generative AI model to generate route efficiency and improvement suggestions. The analysis results include a route efficiency score, the presence of obstacles, and suggested improvements.

[0320] Step 9:

[0321] The server sends the analysis results back to the device, and the output data includes an efficiency score and details of improvement suggestions.

[0322] Step 10:

[0323] The terminal visually displays the analysis results to the user, who can then optimize their next delivery route based on the displayed analysis results.

[0324] Step 11:

[0325] Bluetooth devices are attached to items in the factory, and the terminal receives the signals to obtain the item's location information, which is then sent to the server. The location data includes the item's current location.

[0326] Step 12:

[0327] The server analyzes the location data in real time and notifies the user of the item's current location, allowing the user to quickly find the item.

[0328] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0329] The present invention further improves the user experience by incorporating an emotion engine that analyzes the user's emotions in an integrated system for enriching the golfing life. Specific functions and processing flow are explained below.

[0330] 1. Golf course reservation function

[0331] The user uses a terminal to input budget and location criteria. This information is sent from the terminal to the server, which then searches the database for matching golf courses. The results are sent back to the terminal, which displays them to the user. The user can then select the most suitable golf course and make a reservation. For example, a list of the most suitable golf courses within Kyoto City with a budget of 10,000 yen or less is displayed.

[0332] 2. Golf swing analysis function

[0333] The user uses the device's camera to film their swing and sends the video data to the server. The server uses an AI model to evaluate the swing and suggest areas for improvement. The analysis results are sent back to the device and displayed to the user. For example, when a user films their swing, the server analyzes the swing's angle and speed and provides an evaluation along with suggestions for improvement.

[0334] 3. Ball position tracking function

[0335] The user hits the ball using a golf ball equipped with a built-in Bluetooth chip. The device receives the Bluetooth signal from the ball and sends the location data to the server. The server analyzes the data and plots the ball's location on a map. The result is sent back to the device, allowing the user to easily find the ball. For example, when the user hits the golf ball, the ball's current location is displayed on a map.

[0336] 4. Golf equipment recommendation function

[0337] The user uses the device to enter criteria such as budget and genre, and sends that information to the server. The server searches the database for suitable golf equipment and returns the results to the device. The device then displays recommended products to the user and provides a purchase link. For example, if a user looking to purchase a new driver searches for items under 30,000 yen, a list of optimal products will be displayed and a purchase link will be provided.

[0338] 5. Emotion engine integration

[0339] This system incorporates an emotion engine that analyzes the user's emotions. The emotion engine recognizes emotions by analyzing the user's facial expressions and voice, and transmits this emotion data to the server.

[0340] Using emotion engines for golf course reservations

[0341] When a user is checking the results of a golf course search, the emotion engine analyzes the user's facial expressions and voice to obtain emotional data. Based on this emotional data, the server prioritizes recommendations of golf courses that are likely to satisfy the user, providing a more personalized service.

[0342] Using an Emotion Engine in Golf Swing Analysis

[0343] During swing analysis, the system checks the user's emotional state and provides advice tailored to their state, such as whether they are tense or relaxed. For example, if the user is tense, it can suggest simple stretching techniques to help them relax.

[0344] Using an Emotion Engine for Golf Equipment Recommendation

[0345] When displaying search results for golf equipment, if a user is excited or satisfied with a particular product, the app will show more of that type of product, along with promotions and discounts to entice the user to make a purchase.

[0346] Program processing explanation

[0347] Linking emotion engines with golf course reservations

[0348] When a user searches for golf courses, the device uses a camera and microphone to transmit the user's facial expressions and voice to the emotion engine. The emotion engine analyzes this in real time and transmits the emotion data to the server. The server uses the emotion data to generate search results that prioritize the results that will satisfy the user.

[0349] Linking the Emotion Engine and Swing Analysis

[0350] While recording video of the swing, the device simultaneously uses an emotion engine to grasp the user's emotional state. The server combines the swing analysis results with the emotional data to generate advice appropriate to the user's emotional state and sends it to the device.

[0351] Collaboration between emotion engine and golf equipment recommendation

[0352] When a user searches for golf equipment, the device uses an emotion engine to analyze the user's facial expressions and voice. Based on this, the server creates a list of products that the user is likely to be interested in, and also sends promotional information to increase the user's motivation to purchase. The device displays this to the user.

[0353] With the above mechanism, the system of the present invention can provide a more highly personalized service based on the user's emotions, and can significantly improve golfer satisfaction.

[0354] The processing flow will be explained below.

[0355] Processing steps of emotion engine for golf course reservations

[0356] Example: Golf course recommendation using emotion data

[0357] Step 1:

[0358] The user uses a device to open a golf course search screen and enters the budget and location (e.g., Kyoto City, budget within 10,000 yen).

[0359] Step 2:

[0360] Before the device sends input data to the server, it activates the camera and microphone to collect the user's facial expressions and voice.

[0361] Step 3:

[0362] The facial expression and voice data collected by the device is sent to an internal emotion engine, which performs emotion analysis in real time.

[0363] Step 4:

[0364] The emotion engine analyzes the user's emotion data and identifies their emotional state (e.g., happy, excited, nervous, indifferent).

[0365] Step 5:

[0366] The device transmits the emotional state data and search conditions to the server.

[0367] Step 6:

[0368] Based on the emotional state data and search conditions received by the server, a search is made for golf courses that match the conditions from the database.

[0369] Step 7:

[0370] The server prioritizes the search results according to the emotional state and generates a list of golf courses in descending order of priority.

[0371] Step 8:

[0372] The server returns the prioritized list of golf courses to the terminal.

[0373] Step 9:

[0374] The terminal displays the received golf course list to the user, who then checks the list, selects a golf course that satisfies the user, and makes a reservation.

[0375] Processing steps of the emotion engine in golf swing analysis

[0376] Example: Swing improvement advice using emotional data

[0377] Step 1:

[0378] The user starts the swing analysis mode using the terminal and captures the swing motion with the camera.

[0379] Step 2:

[0380] The device collects the user's facial expressions and voice using a camera and microphone at the same time as the swing video data.

[0381] Step 3:

[0382] The terminal transmits the collected swing video data and emotion data to a server.

[0383] Step 4:

[0384] The server analyzes the swing video data using an AI model and generates an evaluation score and areas for improvement in the swing.

[0385] Step 5:

[0386] The server analyzes the emotional data to determine the user's current emotional state (e.g., tense, relaxed, focused).

[0387] Step 6:

[0388] The server combines the swing analysis results with the user's emotional state to generate optimal improvement advice according to the emotional state.

[0389] Step 7:

[0390] The server transmits the generated improvement advice to the terminal.

[0391] Step 8:

[0392] The device displays the received improvement advice to the user. For example, if the user is feeling tense, the device suggests ways to relax.

[0393] Processing step of emotion engine for ball position tracking

[0394] Example: Providing ball position information using emotion data

[0395] Step 1:

[0396] The user hits the ball using a golf ball with a built-in Bluetooth chip.

[0397] Step 2:

[0398] The device receives the Bluetooth ball's signal and collects its location data.

[0399] Step 3:

[0400] Along with the location data collected by the device, the camera and microphone are used to send the user's facial expressions and voice to the emotion engine for emotion analysis.

[0401] Step 4:

[0402] An emotion engine identifies emotional states (e.g., anxiety, excitement).

[0403] Step 5:

[0404] The device transmits emotion data and location data to the server.

[0405] Step 6:

[0406] The server analyzes the location data and plots the ball's location on a map.

[0407] Step 7:

[0408] The server generates appropriate behavioral advice (e.g., breathing techniques to stay calm) based on the plotted ball position and emotional state.

[0409] Step 8:

[0410] The server sends ball position information and action advice to the terminal.

[0411] Step 9:

[0412] The terminal displays the received ball position information and action advice to the user.

[0413] Processing steps of emotion engine for golf equipment recommendation

[0414] Example: Product recommendation using emotional data

[0415] Step 1:

[0416] The user uses a terminal to input search criteria for golf equipment (e.g., driver, budget within 30,000 yen).

[0417] Step 2:

[0418] Before the device sends input data to the server, it activates the camera and microphone to collect the user's facial expressions and voice.

[0419] Step 3:

[0420] The facial expression and voice data collected by the device is sent to an internal emotion engine, which performs emotion analysis in real time.

[0421] Step 4:

[0422] The emotion engine analyzes the user's emotion data and identifies their emotional state (e.g., excitement, satisfaction, hesitation).

[0423] Step 5:

[0424] The device transmits the emotional state data and search conditions to the server.

[0425] Step 6:

[0426] Based on the emotional state data and search conditions received by the server, a search is made for golf equipment that matches the conditions from the database.

[0427] Step 7:

[0428] The server prioritizes the search results according to the emotional state and generates a product list in descending order of priority.

[0429] Step 8:

[0430] The server returns the prioritized product list and promotion information to the terminal.

[0431] Step 9:

[0432] The terminal displays the received product list and promotion information to the user, who then checks the list and purchases any products that interest them.

[0433] Through the above process, highly personalized services can be provided based on the user's emotions, and golfer satisfaction can be significantly improved.

[0434] Example 2

[0435] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0436] Conventional golf-related systems have been limited to providing simple information and advice without considering the user's emotions. This has prevented them from improving user satisfaction and the quality of their experience. Furthermore, the accuracy of ball tracking and real-time swing analysis has been insufficient. This has made it difficult to provide more personalized services for golfers.

[0437] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0438] In this invention, the server includes a means for recommending the most suitable facility based on budget and location conditions, a means for analyzing video of the movement and recommending improvements in real time, a means for tracking the location using an object with a built-in communication device, a means for recommending products based on budget and genre conditions, and a means for analyzing user emotion data and providing optimal recommendations, thereby enabling the provision of more highly personalized services based on the user's emotions.

[0439] "Means for recommending optimal facilities based on budget and location conditions" is a function that searches for relevant facilities from a database based on the budget and geographical conditions entered by the user, and presents the optimal candidates to the user.

[0440] "Means of analyzing video of movements and recommending areas for improvement in real time" refers to a function in which a user sends video footage taken using a device to a server, which then analyzes the video using an AI model and immediately presents areas for improvement to the user.

[0441] "Means for tracking location using an object with a built-in communication device" refers to a function in which a terminal receives signals emitted from a specific object with a built-in communication device (e.g., a golf ball with a built-in Bluetooth chip), transmits the location information to a server for analysis, and displays the current location of the object on a map.

[0442] "Means for recommending products based on budget and genre conditions" is a function that searches for relevant products from a database based on the budget and product genre entered by the user, and presents the most suitable candidates to the user.

[0443] "Means for analyzing user emotional data and providing optimal recommendations" refers to a function that generates emotional data using an emotion engine that analyzes the user's facial expressions and voice, and then the server analyzes that data to provide more personalized recommendations to the user.

[0444] This invention relates to a golf-related system that analyzes a user's emotional data and makes personalized recommendations based on that data. Specifically, the system integrates functions such as recommending golf courses based on budget and location, analyzing video of a swing and providing real-time suggestions for improvement, tracking the ball's position using a golf ball with a built-in communication device, recommending optimal golf equipment based on budget and genre, and analyzing the user's emotional data to provide personalized recommendations.

[0445] Golf course reservation function

[0446] The system begins when a user uses a terminal to input budget and location criteria. The terminal then sends this information to a server. The server then searches the database for relevant golf courses and returns the results to the terminal. For example, if a user searches for golf courses in Kyoto City that cost less than 10,000 yen, a list of golf courses that meet those criteria will be displayed on the terminal.

[0447] Golf swing analysis function

[0448] The user uses the device's camera to record their swing and sends the video data to the server. The server then uses an AI model to analyze the video and generate an evaluation and suggestions for improvement. The results are then sent back to the device and displayed for the user to review. For example, the server can analyze the user's swing angle and speed and suggest areas for improvement.

[0449] Ball position tracking function

[0450] It works by having the user use a golf ball with a built-in Bluetooth chip. The device receives the Bluetooth signal from the golf ball and sends the location data to the server. The server analyzes the location data and plots the ball's location on a map. The results are sent back to the device and displayed so that the user can easily check them. Specifically, when the user hits the ball, the ball's current location is displayed on a map.

[0451] Golf equipment recommendation function

[0452] The user uses the device to input their budget and category (for example, a new driver) and sends that information to the server. The server searches for suitable products from the database and sends the results back to the device. The device then displays recommended products to the user and provides a purchase link. For example, if a user searches for a new driver under 30,000 yen, a list of the most suitable products is displayed and a purchase link is provided.

[0453] Emotion engine integration

[0454] This system uses an emotion engine to provide more personalized services. The camera and microphone collect the user's facial expressions and voice, which are then analyzed in real time. The emotion data is sent to the server, which then generates results based on that data to increase user satisfaction.

[0455] Linking emotion engines with golf course reservations

[0456] While the user is checking the results of their golf course search, the device uses a camera and microphone to transmit the user's facial expressions and voice to the emotion engine. The emotion engine analyzes the data in real time and sends the emotion data to the server. The server then uses the emotion data to prioritize and recommend golf courses that the user is likely to be satisfied with.

[0457] Linking the Emotion Engine and Swing Analysis

[0458] While recording video of the swing, the device simultaneously uses an emotion engine to grasp the user's emotional state. The server combines the swing analysis results with the emotional data to generate advice appropriate to the user's emotional state and sends it to the device.

[0459] Collaboration between emotion engine and golf equipment recommendation

[0460] When a user searches for golf equipment, the device uses an emotion engine to analyze the user's facial expressions and voice. Based on this, the server creates a list of products that the user is likely to be interested in, and also sends promotional information to increase the user's motivation to purchase. The device displays this to the user.

[0461] Examples of prompt statements

[0462] "Describe a system that tracks the location of a golf ball as it is being hit. The system uses a golf ball with a built-in communication device and a terminal to track the location data."

[0463] As described above, the system of the present invention can provide a more highly personalized service based on the user's emotions, thereby significantly improving golfer satisfaction.

[0464] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0465] Golf course reservation function

[0466] Step 1:

[0467] The user inputs budget and location requirements into the device. Specifically, on the application screen, the user selects "Kyoto City" and "Under 10,000 yen" and presses the search button.

[0468] Input: User-entered budget and location criteria.

[0469] Output: The terminal generates the search criteria.

[0470] Step 2:

[0471] The device sends search criteria to the server, and sends data to the server's API endpoint using an HTTP request.

[0472] Input: Terminal-generated search criteria.

[0473] Output: The search criteria data received by the server.

[0474] Step 3:

[0475] The server searches the database for the relevant golf courses, executes an SQL query based on the received criteria, and retrieves a list of golf courses that meet the criteria.

[0476] Input: Search criteria data received by the server.

[0477] Output: Golf course list.

[0478] Step 4:

[0479] The server returns the search results to the terminal as an HTTP response.

[0480] Input: Golf course list.

[0481] Output: Search result data received by the device.

[0482] Step 5:

[0483] The terminal displays the search results to the user, who then browses the list of golf courses on the application screen and selects the most suitable one.

[0484] Input: Search result data received by the device.

[0485] Output: The list of golf courses displayed to the user.

[0486] Golf swing analysis function

[0487] Step 1:

[0488] The user uses the device's camera to record their swing. Open the swing capture screen in the application and press the record button to start recording.

[0489] Input: Video of the user's swing.

[0490] Output: Recorded swing video data.

[0491] Step 2:

[0492] The device sends the captured video data to the server, and the video data is transferred via the Internet.

[0493] Input: Swing video data.

[0494] Output: Video data received by the server.

[0495] Step 3:

[0496] The server analyzes the video data using an AI model, which uses a neural network to evaluate swing angle, speed, and other factors.

[0497] Input: Video data received by the server.

[0498] Output: Analysis results (evaluation score and improvement points).

[0499] Step 4:

[0500] The server sends the analysis results to the terminal, which returns them as an HTTP response.

[0501] Input: Analysis results.

[0502] Output: Analysis result data received by the device.

[0503] Step 5:

[0504] The device displays the analysis results to the user, who then checks the swing evaluation and areas for improvement on the application's analysis results screen.

[0505] Input: Analysis result data received by the device.

[0506] Output: The analysis results displayed to the user.

[0507] Ball position tracking function

[0508] Step 1:

[0509] The user uses a golf ball with a built-in Bluetooth chip, sets the ball, and hits the ball.

[0510] Input: Initial ball position and hitting motion.

[0511] Output: Bluetooth signal emitted from the golf ball.

[0512] Step 2:

[0513] The device receives a Bluetooth signal. The device's Bluetooth module continuously scans for signals.

[0514] Input: Bluetooth signal from the golf ball.

[0515] Output: The location data received by the device.

[0516] Step 3:

[0517] The device sends location data to the server using an HTTP request.

[0518] Input: Received location data.

[0519] Output: The location data received by the server.

[0520] Step 4:

[0521] The server analyzes the location data and plots the ball's location on a map. The server then calculates the ball's coordinates using the map data and location data.

[0522] Input: Location data.

[0523] Output: Map data showing the current position of the ball.

[0524] Step 5:

[0525] The server returns map data to the device as an HTTP response.

[0526] Input: Map data.

[0527] Output: Map data received by the device.

[0528] Step 6:

[0529] The device displays the map data to the user, and the ball's current location is displayed on the map.

[0530] Input: Map data received by the device.

[0531] Output: The ball position displayed to the user.

[0532] Golf equipment recommendation function

[0533] Step 1:

[0534] The user inputs conditions such as budget and genre into the device, selects "under 30,000 yen" and "driver" on the application screen, and presses the search button.

[0535] Input: User-entered budget and genre criteria.

[0536] Output: The search criteria generated by the device.

[0537] Step 2:

[0538] The device sends search criteria to the server, and sends data to the server's API endpoint using an HTTP request.

[0539] Input: Terminal-generated search criteria.

[0540] Output: The search criteria data received by the server.

[0541] Step 3:

[0542] The server searches for products that match the criteria. The server executes an SQL query to retrieve the corresponding products from the database based on the received criteria.

[0543] Input: Search criteria data.

[0544] Output: Product list.

[0545] Step 4:

[0546] The server returns the search results to the terminal as an HTTP response.

[0547] Input: Product list.

[0548] Output: Search result data received by the device.

[0549] Step 5:

[0550] The device displays the search results to the user, and the user checks the product list on the application screen, displaying the most suitable products and purchase links.

[0551] Input: Search result data received by the device.

[0552] Output: The product list shown to the user, along with a link to buy.

[0553] Emotion engine integration

[0554] Step 1:

[0555] The user searches for golf courses. The user uses a terminal to input conditions and search for golf courses.

[0556] Input: Search criteria.

[0557] Output: Search results display screen.

[0558] Step 2:

[0559] The device uses the camera and microphone to collect the user's facial expressions and voice. The camera and microphone are activated with the user's permission.

[0560] Input: User facial and voice data.

[0561] Output: Collected emotion data.

[0562] Step 3:

[0563] The emotion engine analyzes the emotion data in real time and generates an emotional state.

[0564] Input: Collected emotion data.

[0565] Output: Emotional state data.

[0566] Step 4:

[0567] Send emotional state data to the server. Send the data to the server's API endpoint using an HTTP request.

[0568] Input: Emotional state data.

[0569] Output: Emotional state data received by the server.

[0570] Step 5:

[0571] The server generates recommendation results based on the emotional data, and prioritizes the list of golf courses based on the user's emotional state.

[0572] Input: Search result data and emotional state data.

[0573] Output: A prioritized list of golf courses.

[0574] Step 6:

[0575] The server returns the prioritized results to the device, sending the data as an HTTP response.

[0576] Input: A prioritized list of golf courses.

[0577] Output: Prioritized data received by the device.

[0578] Step 7:

[0579] The terminal displays the regenerated results to the user. The user confirms the prioritized list of golf courses on the application screen.

[0580] Input: Prioritized data received by the device.

[0581] Output: A prioritized list of golf courses displayed to the user.

[0582] (Application example 2)

[0583] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0584] In today's world, recreational activities have become an important part of many people's lives. However, users have limited access to the appropriate recreational facilities and to advice on how to improve their skills. It is also difficult to select and purchase the right recreational equipment. Furthermore, existing systems are unable to provide personalized services that take users' emotions into account, resulting in low user satisfaction. A new system is needed to address these issues.

[0585] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for recommending optimal recreation facilities based on budget and location conditions; means for analyzing video of movements and recommending improvements in real time; means for tracking location using an object with a built-in communications chip; means for recommending products based on budget and genre conditions; means for analyzing the user's facial expressions and voice using an emotion analysis engine and personalizing the information provided; and means for being integrated into an autonomous vehicle and providing recreation-related services while traveling. This enables users to find optimal recreation facilities while traveling, receive advice on improving their skills, and receive recommendations based on their emotional state.

[0586] A "budget" refers to the amount of money a user plans to spend for a particular service or product.

[0587] "Recreational facilities" is a general term for facilities that users visit to enjoy their leisure time, including sports facilities and resort areas.

[0588] "Movement" refers to the bodily movements or actions performed by the user, and specifically includes technical movements such as a golf swing.

[0589] "Analysis" is a means of analyzing specific data, video, etc. in detail to understand their content and trends.

[0590] "Real-time" refers to processing and responding to events and data at the exact moment they occur.

[0591] "Recommendation" refers to the act of suggesting the best options or items based on the user's preferences and conditions.

[0592] A "communication chip" is a small electronic component that enables wireless communication and transmits and receives signals.

[0593] "Object" is a general term for any object or device that has a specific purpose or function.

[0594] "Budget and genre conditions" refers to specific criteria such as the user's desired cost range or categories of interest.

[0595] "Product" is a general term for goods and services sold, and refers to the items that users consider purchasing.

[0596] An "emotion analysis engine" refers to a technical means for analyzing a user's emotional state from their facial expressions and voice.

[0597] "Facial expressions" refer to the movements and shapes that appear on a person's face and indicate emotions and intentions.

[0598] "Speech" refers to the sounds produced by a person, including words and intonation.

[0599] "Personalization" refers to the act of optimizing information and services to suit the individual preferences and circumstances of users.

[0600] An "autonomous vehicle" is a vehicle that uses artificial intelligence and sensor technology to drive autonomously.

[0601] "Service" refers to various forms of benefits and assistance provided to users.

[0602] The present invention is a system for supporting reservations at recreational facilities, skill improvement during travel, and the purchase of equipment. Specific embodiments are described below.

[0603] System configuration:

[0604] Hardware Configuration

[0605] Autonomous vehicles: Transport users to their destinations and provide various recreational services.

[0606] Camera and microphone: Captures the user's facial expressions and voice for sentiment analysis.

[0607] Objects with embedded communication chips: Allows tracking of the location of objects such as golf balls.

[0608] Terminals (smartphones, tablets, etc.): Function as a user interface and exchange data.

[0609] Software Configuration

[0610] Sentiment analysis engine: Software for analyzing sentiment data (e.g., Affectiva, Microsoft Azure API).

[0611] Artificial intelligence model: Used for swing motion analysis and recommendation functions.

[0612] Communication library: A library for communicating data between the server and the terminal (e.g., Requests).

[0613] Program flow:

[0614] Emotion analysis

[0615] The server receives the user's facial expression and voice data sent from the device. This data is analyzed in real time using an emotion analysis engine. The analysis results are sent back to the server, and optimal services and information are generated based on the user's emotions.

[0616] Recreational facility recommendations

[0617] Users input their budget and location requirements into the terminal. The server uses this information to search its database for the best recreational facilities that match the requirements. The search results are then sent back to the terminal and displayed to the user.

[0618] Analysis and improvement of behavior

[0619] Users use the device's camera to film their swings and other movements. The video data is sent to a server where it is analyzed using an artificial intelligence model. The resulting evaluation score and points for improvement are sent back to the device and visually displayed to the user.

[0620] Product Recommendations

[0621] Users input their budget and genre requirements into the device. The server uses this information to search for the most suitable products from its database. The search results are sent back to the device and displayed to the user. Furthermore, personalized recommendations are made based on the user's emotional data.

[0622] Specific examples:

[0623] Recreational facility recommendations

[0624] When a user in a car issues a voice command such as "Find recommended golf courses around Tokyo with a budget of 10,000 yen or less," the camera and microphone capture the user's facial expressions and voice, which are then analyzed by an emotion analysis engine. Based on the analysis results, the device displays the best golf courses that match the criteria.

[0625] Analysis and improvement of behavior

[0626] When a user requests, "Please record a video of my swing and give me advice, including my emotions," the device will record the swing video and send it to the server. The analysis results will provide suggestions for improving the swing, and at the same time, advice based on the emotional analysis results will be provided.

[0627] Product Recommendations

[0628] If a user inputs "I'm looking for a new driver for under 30,000 yen," the server will search for the most suitable product and provide personalized recommendations based on emotional data. Product lists and promotional information will be displayed on the device.

[0629] As described above, the embodiments of the invention analyze and personalize various data to provide users with optimal information and services.

[0630] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0631] Step 1:

[0632] The user requests the desired service (e.g., recommendations for recreational facilities, behavior analysis and improvement, product recommendations) via voice or text using the camera and microphone, and enters budget and location requirements.

[0633] Input: User's voice / text data and budget and location requirements.

[0634] Output: User request data.

[0635] Specific operation: The user gives the command "Find recommended golf courses around Tokyo with a budget of 10,000 yen or less."

[0636] Step 2:

[0637] The device uses a camera and microphone to capture the user's facial expressions and voice, and sends the data to an emotion analysis engine.

[0638] Input: User's facial expression data and voice data.

[0639] Output: Parsed emotion data.

[0640] Specific operation: The device captures the user's facial expressions and voice in real time and sends them to an emotion analysis engine.

[0641] Step 3:

[0642] The server uses an emotion analysis engine to analyze the received data and determine the user's emotional state.

[0643] Input: Facial expression data and voice data sent from the device.

[0644] Output: The user's emotional state (e.g., relaxed, excited).

[0645] Specific operation: The emotion analysis engine analyzes facial and vocal characteristics to identify the user's emotional state.

[0646] Step 4:

[0647] The terminal transmits the user's request data and emotion data to the server and requests recommendations for optimal recreational facilities and products.

[0648] Input: User request data, budget and location criteria, and sentiment data.

[0649] Output: The request data to the server.

[0650] Specific operation: The device collects requests from users and sends them to the server along with emotion data.

[0651] Step 5:

[0652] The server searches the database for recreational facilities or products that match the criteria and generates personalized recommendation results based on the emotion data.

[0653] Input: Request data to the server (conditions and emotion data).

[0654] Output: Personalized recommendation results.

[0655] Specific operation: The server searches the database and selects the facilities and products that best suit the user's emotional state.

[0656] Step 6:

[0657] The server sends the recommendation results back to the terminal, which then presents them to the user visually and / or audibly.

[0658] Input: personalized recommendation results.

[0659] Output: Information presented to the user.

[0660] Specific operation: The terminal displays the recommendation results received from the server on the display device or notifies them by voice.

[0661] Step 7:

[0662] The user can make reservations at recommended facilities, check the analysis results of their movements, or purchase recommended products.

[0663] Input: Recommendation results sent from the server.

[0664] Output: Actions such as completing a reservation, checking analysis results, purchasing a product, etc.

[0665] Specific behavior: The user performs an action such as "Book this golf course" or "View detailed analysis results."

[0666] By following these steps, users can have an optimal recreational experience while on the move.

[0667] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0668] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0669] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0670] [Second embodiment]

[0671] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0672] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0673] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0674] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0675] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0676] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0677] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0678] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0679] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0680] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0681] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0682] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0683] The present invention provides an integrated system for enriching your golfing life, and includes the following functions.

[0684] 1. Golf course reservation function

[0685] The user uses a terminal to input budget and location criteria. This information is sent from the terminal to a server, which then searches for matching golf courses in its database. The server returns the search results to the terminal, which displays them to the user. The user can then select the most suitable golf course and make a reservation. For example, a list of the most suitable golf courses within Kyoto City with a budget of 10,000 yen or less is displayed.

[0686] 2. Golf swing analysis function

[0687] The user uses the device's camera to film their swing and sends the video data to the server. The server uses an AI model to evaluate the swing and suggest areas for improvement. The analysis results are sent back to the device and displayed to the user. For example, when a user films their swing, the server analyzes the swing's angle and speed and provides an evaluation along with suggestions for improvement.

[0688] 3. Ball position tracking function

[0689] The user hits the ball using a golf ball equipped with a built-in Bluetooth chip. The device receives the Bluetooth signal from the ball and sends the location data to the server. The server analyzes the data and plots the ball's location on a map. The result is sent back to the device, allowing the user to easily find the ball. For example, when a user hits a golf ball, the ball's current location is displayed on a map.

[0690] 4. Golf equipment recommendation function

[0691] The user uses the device to enter criteria such as budget and genre, and sends that information to the server. The server searches the database for golf equipment that matches the criteria and sends the results back to the device. The device then displays recommended products to the user and provides a purchase link. For example, if a user looking to purchase a new driver searches for items under 30,000 yen, a list of optimal products will be displayed and a purchase link will be provided.

[0692] Program processing explanation

[0693] Golf course reservations

[0694] The server receives the user's input criteria and searches the database for golf courses that match the criteria. The results are sent to the terminal, which displays them to the user. The user selects the desired golf course from the displayed list and completes the reservation.

[0695] Golf Swing Analysis

[0696] The device takes a video of the swing and sends it to the server. The server analyzes the video data using an AI model and generates an evaluation and points for improvement. The results are sent to the device, which displays them to the user. The user can then use the displayed points for improvement to make corrections to their swing.

[0697] Ball position tracking

[0698] The device receives signals from golf balls with built-in Bluetooth chips and transmits location data to a server. The server processes the data and plots the ball's location on a map. The results are sent back to the device, which displays the location information to the user. The user can then use the displayed information to find the ball.

[0699] Golf equipment recommendations

[0700] The user inputs budget and genre criteria on the device and sends them to the server. The server searches the database for golf equipment that matches the criteria and sends the results back to the device. The device then displays recommended products to the user and provides a purchase link. The user can then purchase the displayed products.

[0701] A system that integrates all of the above functions will instantly eliminate all of a golfer's worries and enrich their golfing life.

[0702] The processing flow will be explained below.

[0703] Golf course reservation processing steps

[0704] Example: A user searching for a golf course in Kyoto City with a budget of less than 10,000 yen

[0705] Step 1:

[0706] The user launches the app using their device and enters their budget (within 10,000 yen) and desired location (within Kyoto City).

[0707] Step 2:

[0708] The device sends the user's input data to the server using an HTTP request.

[0709] Step 3:

[0710] The server searches the database for golf course information based on the received criteria. The server executes an SQL query to extract golf courses that match the specified criteria.

[0711] Step 4:

[0712] The server returns the search results to the terminal as an HTTP response.

[0713] Step 5:

[0714] The terminal displays the list of golf courses received to the user, and the user selects the golf course he or she desires.

[0715] Step 6:

[0716] The user enters detailed information (such as date and time and number of players) to reserve the selected golf course, and the device sends this information to the server.

[0717] Step 7:

[0718] The server receives the reservation information, stores it in a database, and returns a message to the terminal indicating that the reservation was successful.

[0719] Step 8:

[0720] The terminal will display a reservation completion message to the user.

[0721] Golf Swing Analysis Processing Steps

[0722] Example: A user who wants to know how to improve their swing.

[0723] Step 1:

[0724] The user activates the camera on the device and records their own swing.

[0725] Step 2:

[0726] The device compresses the captured swing video and transmits the video data to a server using a protocol for efficient video data transfer.

[0727] Step 3:

[0728] The server receives the video data and analyzes the swing using an AI model. The server then uses a deep learning model to extract each element of the swing (speed, angle, etc.) and generates an evaluation score and areas for improvement.

[0729] Step 4:

[0730] The server returns the analysis results to the terminal as an HTTP response.

[0731] Step 5:

[0732] The device displays the analysis results and improvements received to the user.

[0733] Step 6:

[0734] The user will then try to make corrections in their next swing based on the improvements shown.

[0735] Ball position tracking processing steps

[0736] Example: A user who wants to check the ball's position

[0737] Step 1:

[0738] The user hits the ball using a golf ball equipped with a built-in Bluetooth chip.

[0739] Step 2:

[0740] The ball periodically emits a Bluetooth signal along its trajectory.

[0741] Step 3:

[0742] The device receives the Bluetooth signal, analyzes its location data, and sends it to a server, including signal strength and timing.

[0743] Step 4:

[0744] The server receives the position data and runs an algorithm to determine the exact location of the ball.

[0745] Step 5:

[0746] The server returns the processing result to the terminal as an HTTP response.

[0747] Step 6:

[0748] The device plots the ball position information it receives on a map and displays it to the user.

[0749] Step 7:

[0750] The user finds the golf ball based on the displayed location information.

[0751] Processing steps for golf equipment recommendations

[0752] Example: A user who wants to purchase a new driver

[0753] Step 1:

[0754] The user launches the app using their device and enters their budget (e.g., under 30,000 yen) and desired genre (e.g., driver).

[0755] Step 2:

[0756] The device sends the user's input data to the server.

[0757] Step 3:

[0758] The server searches the database for suitable golf equipment based on the received criteria, and uses a filtering algorithm to extract products that match the criteria.

[0759] Step 4:

[0760] The server returns the search results and a list of recommended products to the terminal as an HTTP response.

[0761] Step 5:

[0762] The device displays search results to the user and provides a link to purchase.

[0763] Step 6:

[0764] The user selects from the displayed products and clicks the purchase link to visit the online store.

[0765] Step 7:

[0766] The user completes the purchase process on your online store.

[0767] Example 1

[0768] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0769] Today's golfers face many challenges when it comes to choosing a golf course, improving their swing, tracking their ball position, and purchasing golf equipment. An integrated system is needed to resolve these issues and enrich their golfing life. Specifically, it is necessary to reserve the optimal golf course, analyze their swing motion in real time, accurately grasp their ball position, and recommend the appropriate golf equipment.

[0770] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0771] In this invention, the server includes a means for recommending the most suitable golf course based on budget and location conditions, a means for analyzing video of a swing using a generative AI model to generate an evaluation score and areas for improvement, a means for tracking the ball position using a golf ball with a built-in communication module, and a means for recommending golf equipment based on budget and category conditions. This enables various golf-related activities to be carried out efficiently and effectively, resolving golfers' concerns and enriching their golfing life.

[0772] "Budget" refers to the upper limit of the amount that a user sets when selecting a golf course or golf equipment.

[0773] "Location" means the geographic area or region designated by a User when making a golf course reservation.

[0774] "Swing motion" refers to the series of body movements that occur when swinging a golf club to hit a ball.

[0775] A "generative AI model" refers to an artificial intelligence model that uses machine learning algorithms to analyze data and make evaluations and suggestions.

[0776] "Golf ball with built-in communication module" refers to a golf ball that has built-in Bluetooth or other wireless communication capabilities to track the ball's position.

[0777] "Golf equipment" refers to items related to playing golf, such as clubs, balls, bags, and clothing.

[0778] A "database" refers to a system for systematically managing and storing information.

[0779] "Evaluation score" refers to the result of evaluating swing movements and other performance using a number or grade.

[0780] The present invention is an integrated system for enriching your golfing life, and includes the functions of recommending golf courses based on budget and location, video analysis of swing movements, tracking the position of the ball using a golf ball with a built-in communication module, and recommending golf equipment based on budget and genre.

[0781] Golf course reservation function

[0782] The user uses a terminal to input budget and location requirements. The terminal sends this information to the server, which then accesses a database to search for golf courses that meet the requirements. The search results are sent to the terminal, which displays them to the user. The user can then select the desired facility from the displayed golf courses and make a reservation.

[0783] For example, a user inputs the conditions "budget within 10,000 yen" and "Kyoto city", and the server searches for golf courses that match these conditions. As a result, "Golf courses A, B, and C in Kyoto city" are displayed on the terminal, and the user can select one to complete the reservation.

[0784] Example prompt sentence:

[0785] "Please find a golf course in Kyoto City with a budget of 10,000 yen or less."

[0786] Golf swing analysis function

[0787] Users film their golf swing using the device's camera. The video data is sent from the device to a server, where it is analyzed using a generative AI model. The analysis results, including a swing evaluation score and areas for improvement, are sent back to the device and displayed to the user.

[0788] For example, a user takes a video of their golf swing and sends it to a server, which then analyzes the swing angle and speed. The server generates a result, such as "You need to improve your swing angle by 10 degrees," and sends it to the device. The user can use this result to make improvements.

[0789] Example prompt sentence:

[0790] "Please analyze the video of my golf swing and tell me where I can improve."

[0791] Ball position tracking function

[0792] The user uses a golf ball with a built-in communications module and hits the ball. The device receives the radio signal from the ball and transmits the location data to the server. The server analyzes the data and plots the ball's location on a map. The results are sent back to the device, which displays this information to the user.

[0793] For example, after a user hits a golf ball, the device identifies its location and sends the data to the server. The server generates a result such as "The ball's current location is coordinates X, Y" and sends it to the device. The user can then find the golf ball based on the location information plotted on a map.

[0794] Example prompt sentence:

[0795] "Show me the current location of the golf ball I hit."

[0796] Golf equipment recommendation function

[0797] The user inputs budget and category criteria using the device and sends that information to the server. The server searches the database for golf equipment that matches the criteria and sends the results to the device. The device then displays recommended products to the user and provides a link to purchase them.

[0798] For example, if a user enters the criteria "I want a new screwdriver with a budget of less than 30,000 yen," the server will search for suitable products based on this. The server will create results such as "Product A, Product B, Product C" and send them to the terminal. The user will then make a purchase based on these results.

[0799] Example prompt sentence:

[0800] "Please tell me a recommended screwdriver that can be purchased for under 30,000 yen."

[0801] By integrating these functions into a system, it is possible to provide a comprehensive range of services that meet the diverse needs of golfers, further enriching their golfing life.

[0802] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0803] Golf course reservation function

[0804] Step 1:

[0805] The user enters the budget and location conditions into the device. The user opens the dedicated application and enters "under 10,000 yen" for the budget and "Kyoto city" for the location. The entered data is temporarily saved on the device.

[0806] Input: Budget and location conditions (e.g., within 10,000 yen, within Kyoto City)

[0807] Output: Condition data saved on the device

[0808] Step 2:

[0809] The device sends the entered conditions to the server. The device sends the budget and location condition data to the server via an HTTP request. The software used is a library that sends data in JSON format.

[0810] Input: Condition data (under 10,000 yen, within Kyoto city)

[0811] Output: HTTP request to the server

[0812] Step 3:

[0813] The server searches the database for golf courses that match the criteria. The server searches the database using an SQL query based on the received criteria. Information on golf courses that match the criteria is obtained.

[0814] Input: Condition data received as an HTTP request

[0815] Output: Search results for golf courses that match the criteria

[0816] Step 4:

[0817] The server sends the search results to the terminal. The server returns the search result data in JSON format to the terminal. The software used is a server-side framework (e.g., Django, Flask).

[0818] Input: Search result data

[0819] Output: HTTP response to the device

[0820] Step 5:

[0821] The terminal displays the search results to the user. The received data is analyzed and the search results are displayed to the user via a GUI. The results displayed might be "Golf Courses A, B, and C in Kyoto City," for example.

[0822] Input: Search results received as an HTTP response

[0823] Output: Search results displayed on the GUI

[0824] Step 6:

[0825] The user selects the golf course of their choice and makes a reservation. When the user clicks the reservation button, the terminal sends the reservation information to the server, which then processes the reservation.

[0826] Input: User selection and reservation information

[0827] Output: Reservation confirmation notification

[0828] Golf swing analysis function

[0829] Step 1:

[0830] The user uses the device's camera to record their golf swing. The user launches the application and uses the camera to record their swing.

[0831] Input: Golf swing video

[0832] Output: Recorded video data

[0833] Step 2:

[0834] The device sends video data to the server. The captured video data is transferred to the server using an HTTP POST request. The video data is compressed and a library is used for transfer.

[0835] Input: Captured video data

[0836] Output: HTTP POST request to the server

[0837] Step 3:

[0838] The server analyzes the video data using an AI model (e.g., OpenPose) to generate evaluation data such as swing angle and speed.

[0839] Input: Video data received as an HTTP POST request

[0840] Output: Analysis results including evaluation scores and improvement points

[0841] Step 4:

[0842] The server sends the analysis results to the device, which then returns them to the device in JSON format.

[0843] Input: Analysis result data

[0844] Output: HTTP response to the device

[0845] Step 5:

[0846] The device displays the analysis results to the user. The analysis results are analyzed and displayed to the user through a GUI, including specific feedback such as "You need to improve your swing angle by 10 degrees."

[0847] Input: Analysis results received as an HTTP response

[0848] Output: Display of analysis results and improvements on the GUI

[0849] Ball position tracking function

[0850] Step 1:

[0851] The user hits the ball using a golf ball with a built-in communication module. The user hits the ball with a golf club.

[0852] Input: Ball hitting situation (physical action)

[0853] Output: Signal transmission from the communication module

[0854] Step 2:

[0855] The device receives the wireless signal from the golf ball. The device uses the Bluetooth communication library to receive the signal emitted from the golf ball and obtain the location data.

[0856] Input: Wireless signal

[0857] Output: Position data

[0858] Step 3:

[0859] The device sends location data to the server. The acquired location data is then sent to the server via an HTTP request.

[0860] Input: Location data

[0861] Output: HTTP request to the server

[0862] Step 4:

[0863] The server analyzes the location data. The server analyzes the received location data and generates data that can be plotted as a precise map location.

[0864] Input: Location data received as an HTTP request

[0865] Output: Analysis results (plot data)

[0866] Step 5:

[0867] The server sends the analysis results to the terminal, and then sends the plot data back to the terminal.

[0868] Input: Analysis result data

[0869] Output: HTTP response to the device

[0870] Step 6:

[0871] The terminal plots the ball's position on a map and displays it to the user. The terminal plots the analysis results on a map and displays them to the user through a GUI.

[0872] Input: Plot data received as an HTTP response

[0873] Output: Plot display on map

[0874] Golf equipment recommendation function

[0875] Step 1:

[0876] The user inputs the budget and genre into the device. The user opens the dedicated application and enters "under 30,000 yen" as the budget and "driver" as the genre.

[0877] Input: Budget and genre criteria

[0878] Output: Condition data saved on the device

[0879] Step 2:

[0880] The terminal sends the entered conditions to the server. The terminal sends the condition data to the server via an HTTP request.

[0881] Input: Condition data

[0882] Output: HTTP request to the server

[0883] Step 3:

[0884] The server searches the database for golf equipment that matches the criteria. Based on the received criteria, the server searches the database using an SQL query to retrieve information on golf equipment that matches the criteria.

[0885] Input: Condition data received as an HTTP request

[0886] Output: Search results for golf equipment that matches the criteria

[0887] Step 4:

[0888] The server sends the search results to the device. The server returns the search result data to the device in JSON format.

[0889] Input: Search result data

[0890] Output: HTTP response to the device

[0891] Step 5:

[0892] The device displays recommended products to the user and provides a purchase link. The search results are analyzed and displayed to the user through a GUI. The results displayed include "Driver A (29,999 yen), Driver B (28,000 yen)," and other products, along with a purchase link for each product.

[0893] Input: Search results received as an HTTP response

[0894] Output: Recommended products and purchase links displayed on the GUI

[0895] (Application example 1)

[0896] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0897] In conventional golf-related systems and factory logistics management systems, individual functions are dispersed, making it difficult to manage and optimize them in an integrated manner. Furthermore, integrating functions such as golf course and logistics reservations, swing and route efficiency analysis, item location tracking, and recommendation systems is expected to improve user convenience, but no such system exists. The present invention aims to solve these problems and provide an integrated system that is efficient and convenient for users.

[0898] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0899] In this invention, the server includes a means for recommending the optimal golf course based on budget and location conditions, a means for analyzing video of swing movements and recommending areas for improvement in real time, a means for tracking the location of an item with a built-in Bluetooth device, a means for recommending tools and parts based on budget and category conditions, and a means for analyzing movement path data of an automatic transport robot to analyze efficiency and generate improvement proposals. This enables the realization of integrated golf-related services and in-factory logistics management, and improves the work efficiency of users and operators.

[0900] A "budget" is a set limit on spending for the acquisition of goods and services.

[0901] "Location Conditions" means any constraints or requirements relating to a particular geographic location or environment.

[0902] A "golf course" is a large green area designed for playing golf, including holes, tees, greens, etc.

[0903] A "swing motion" is a series of movements that are performed to swing a golf club and hit a golf ball.

[0904] "Analyzing video" is the process of extracting specific information based on video data captured by a camera or other device.

[0905] "Improvements" are corrections or refinements that are needed to improve current status or performance.

[0906] A "Bluetooth device" is an electronic device capable of exchanging data over short distances using wireless communication technology.

[0907] "Location tracking using an item" is the process of using an identification device attached to a particular item to monitor the current location of that item in real time.

[0908] "Tools" means hand and power tools for use in factories and workshops.

[0909] A "part" is a small component that makes up part of a product or machine.

[0910] "Recommending" is the act of presenting suitable options based on specific criteria.

[0911] An "automated transport robot" is a robotic device designed to autonomously transport items within a factory or warehouse.

[0912] "Analyzing travel route data" is the process of evaluating the efficiency and presence of obstacles based on the travel route data.

[0913] "Efficiency analysis" is an evaluation method for assessing the efficiency of a particular operation or process and identifying areas for improvement.

[0914] "Improvement proposals" are specific means or methods proposed to improve the current situation.

[0915] The present invention relates to an integrated factory logistics optimization system, and has the following functions.

[0916] 1. Logistics reservation function

[0917] The user uses a terminal to specify the items or parts to be transported and sends that information to the server. The server then searches the database for the optimal transport route and returns the results to the terminal. The user can then operate the automated transport robot according to the transport route displayed on the terminal. This allows for efficient management of logistics within the factory.

[0918] 2. Movement path analysis function

[0919] As the automated transport robot moves through the factory, the device captures video data of its movement path and sends it to the server. The server then analyzes the movement path data using a generative AI model to generate efficiency and improvement proposals. The analysis results are sent back to the device and displayed visually to the user. This optimizes the movement path of goods within the factory and improves efficiency.

[0920] 3. Item location tracking function

[0921] Items in the factory are equipped with Bluetooth devices, and the terminal receives this information to obtain the item's location. The location data is sent to a server, which analyzes the location in real time and sends it back to the terminal. Users can immediately find out where items are in the factory, reducing the time it takes to find lost items or search for them.

[0922] 4. Tool and parts recommendation function

[0923] The user uses a terminal to input the requirements for tools and parts (budget, purpose, etc.) and sends the information to the server. The server searches the database for tools and parts that match the requirements and returns the results to the terminal. The user can then select the most suitable product from the displayed recommended list and purchase it.

[0924] To integrate the above functions, the following hardware and software are mainly used.

[0925] Hardware:

[0926] Smartphone or tablet: A device that allows users to input and view information.

[0927] Server: Analyzes and stores data

[0928] Autonomous transport robot: A robot for transporting goods

[0929] Bluetooth devices: devices for tracking the location of items

[0930] software:

[0931] Database management systems (e.g., SQLite)

[0932] Web frameworks (e.g. Flask)

[0933] AI analytical models (e.g., generative AI models)

[0934] As a concrete example, let us consider the case where a user transports a specific part from a warehouse. First, the user inputs the information "bearing, warehouse A, 2023-10-12 14:00" into the terminal and sends it. The server receives this information and searches the database for the optimal transport route. The search results are returned to the terminal, which displays the transport route to the user. The user then operates the automated transport robot according to this route.

[0935] Example prompts used in route analysis by the AI ​​model:

[0936] Travel path data:

[0937] Starting point: Entrance

[0938] Route: Aisle 1 -> Aisle 2 -> Machine A

[0939] Time: 2023-10-11 09:00

[0940] Analysis task: Evaluate the efficiency of this route and suggest improvements.

[0941] These specific examples and integrated systems enable efficient logistics management in factories and work sites, optimize overall processes, and reduce the workload of users.

[0942] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0943] Step 1:

[0944] The user uses a terminal to input and transmit information about the item or part to be transported (e.g., bearing, warehouse A, 2023-10-12 14:00). The input data includes the type of item, the destination location, the desired date and time of transport, etc.

[0945] Step 2:

[0946] The terminal sends the input data to the server. The server receives the data and stores it in a database. The input data is saved as reservation information.

[0947] Step 3:

[0948] The server searches the database for the optimal route for the delivery. It uses a search algorithm to efficiently calculate the route for delivering the goods. For example, the algorithm calculates the shortest route between the goods' storage location and their destination.

[0949] Step 4:

[0950] The server returns the calculated optimal route to the terminal. The output data includes detailed information about the transportation route (e.g., passing through corridor 1 and then through corridor 2 to reach machine A).

[0951] Step 5:

[0952] The terminal displays the optimal route information received from the server to the user, who then operates the automated transport robot based on the displayed information to transport the goods.

[0953] Step 6:

[0954] As the automated transport robot moves through the factory, the device captures and records the path of its movement as video data. The recorded data includes video of the physical path of movement.

[0955] Step 7:

[0956] The device sends video data of the travel route to the server. The server analyzes this video data using a generative AI model. The analysis prompt is, "Travel route data: - Starting point: Entrance - Route: Aisle 1 -> Aisle 2 -> Machine A - Time: 2023-10-11 09:00 Analysis task: Evaluate the efficiency of this route and suggest improvements."

[0957] Step 8:

[0958] The server uses a generative AI model to generate route efficiency and improvement suggestions. The analysis results include a route efficiency score, the presence of obstacles, and suggested improvements.

[0959] Step 9:

[0960] The server sends the analysis results back to the device, and the output data includes an efficiency score and details of improvement suggestions.

[0961] Step 10:

[0962] The terminal visually displays the analysis results to the user, who can then optimize their next delivery route based on the displayed analysis results.

[0963] Step 11:

[0964] Bluetooth devices are attached to items in the factory, and the terminal receives the signals to acquire the item's location information, which is then sent to the server. The location data includes the item's current location.

[0965] Step 12:

[0966] The server analyzes the location data in real time and notifies the user of the item's current location, allowing the user to quickly find the item.

[0967] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0968] The present invention further improves the user experience by incorporating an emotion engine that analyzes the user's emotions in an integrated system for enriching the golfing life. Specific functions and processing flow are explained below.

[0969] 1. Golf course reservation function

[0970] The user uses a terminal to input budget and location criteria. This information is sent from the terminal to the server, which then searches the database for matching golf courses. The results are sent back to the terminal, which displays them to the user. The user can then select the most suitable golf course and make a reservation. For example, a list of the most suitable golf courses within Kyoto City with a budget of 10,000 yen or less is displayed.

[0971] 2. Golf swing analysis function

[0972] The user uses the device's camera to film their swing and sends the video data to the server. The server uses an AI model to evaluate the swing and suggest areas for improvement. The analysis results are sent back to the device and displayed to the user. For example, when a user films their swing, the server analyzes the swing's angle and speed and provides an evaluation along with suggestions for improvement.

[0973] 3. Ball position tracking function

[0974] The user hits the ball using a golf ball equipped with a built-in Bluetooth chip. The device receives the Bluetooth signal from the ball and sends the location data to the server. The server analyzes the data and plots the ball's location on a map. The result is sent back to the device, allowing the user to easily find the ball. For example, when the user hits the golf ball, the ball's current location is displayed on a map.

[0975] 4. Golf equipment recommendation function

[0976] The user uses the device to enter criteria such as budget and genre, and sends that information to the server. The server searches the database for suitable golf equipment and returns the results to the device. The device then displays recommended products to the user and provides a purchase link. For example, if a user looking to purchase a new driver searches for items under 30,000 yen, a list of optimal products will be displayed and a purchase link will be provided.

[0977] 5. Emotion engine integration

[0978] This system incorporates an emotion engine that analyzes the user's emotions. The emotion engine recognizes emotions by analyzing the user's facial expressions and voice, and transmits this emotion data to the server.

[0979] Using emotion engines for golf course reservations

[0980] When a user is checking the results of a golf course search, the emotion engine analyzes the user's facial expressions and voice to obtain emotional data. Based on this emotional data, the server prioritizes recommendations of golf courses that are likely to satisfy the user, providing a more personalized service.

[0981] Using an Emotion Engine in Golf Swing Analysis

[0982] During swing analysis, the system checks the user's emotional state and provides advice tailored to their state, such as whether they are tense or relaxed. For example, if the user is tense, it can suggest simple stretching techniques to help them relax.

[0983] Using an Emotion Engine for Golf Equipment Recommendation

[0984] When displaying search results for golf equipment, if a user is excited or satisfied with a particular product, the app will show more of that type of product, along with promotions and discounts to entice the user to make a purchase.

[0985] Program processing explanation

[0986] Linking emotion engines with golf course reservations

[0987] When a user searches for golf courses, the device uses a camera and microphone to transmit the user's facial expressions and voice to the emotion engine. The emotion engine analyzes this in real time and transmits the emotion data to the server. The server uses the emotion data to generate search results that prioritize the results that will satisfy the user.

[0988] Linking the Emotion Engine and Swing Analysis

[0989] While recording video of the swing, the device simultaneously uses an emotion engine to grasp the user's emotional state. The server combines the swing analysis results with the emotional data to generate advice appropriate to the user's emotional state and sends it to the device.

[0990] Collaboration between emotion engine and golf equipment recommendation

[0991] When a user searches for golf equipment, the device uses an emotion engine to analyze the user's facial expressions and voice. Based on this, the server creates a list of products that the user is likely to be interested in, and also sends promotional information to increase the user's motivation to purchase. The device displays this to the user.

[0992] With the above mechanism, the system of the present invention can provide a more highly personalized service based on the user's emotions, and can significantly improve golfer satisfaction.

[0993] The processing flow will be explained below.

[0994] Processing steps of emotion engine for golf course reservations

[0995] Example: Golf course recommendation using emotion data

[0996] Step 1:

[0997] The user uses a device to open a golf course search screen and enters the budget and location (e.g., Kyoto City, budget within 10,000 yen).

[0998] Step 2:

[0999] Before the device sends input data to the server, it activates the camera and microphone to collect the user's facial expressions and voice.

[1000] Step 3:

[1001] The facial expression and voice data collected by the device is sent to an internal emotion engine, which performs emotion analysis in real time.

[1002] Step 4:

[1003] The emotion engine analyzes the user's emotion data and identifies their emotional state (e.g., happy, excited, nervous, indifferent).

[1004] Step 5:

[1005] The device transmits the emotional state data and search conditions to the server.

[1006] Step 6:

[1007] Based on the emotional state data and search conditions received by the server, a search is made for golf courses that match the conditions from the database.

[1008] Step 7:

[1009] The server prioritizes the search results according to the emotional state and generates a list of golf courses in descending order of priority.

[1010] Step 8:

[1011] The server returns the prioritized list of golf courses to the terminal.

[1012] Step 9:

[1013] The terminal displays the received golf course list to the user, who then checks the list, selects a golf course that satisfies the user, and makes a reservation.

[1014] Processing steps of the emotion engine in golf swing analysis

[1015] Example: Swing improvement advice using emotional data

[1016] Step 1:

[1017] The user starts the swing analysis mode using the terminal and captures the swing motion with the camera.

[1018] Step 2:

[1019] The device collects the user's facial expressions and voice using a camera and microphone at the same time as the swing video data.

[1020] Step 3:

[1021] The terminal transmits the collected swing video data and emotion data to a server.

[1022] Step 4:

[1023] The server analyzes the swing video data using an AI model and generates an evaluation score and areas for improvement in the swing.

[1024] Step 5:

[1025] The server analyzes the emotional data to determine the user's current emotional state (e.g., tense, relaxed, focused).

[1026] Step 6:

[1027] The server combines the swing analysis results with the user's emotional state to generate optimal improvement advice according to the emotional state.

[1028] Step 7:

[1029] The server transmits the generated improvement advice to the terminal.

[1030] Step 8:

[1031] The device displays the received improvement advice to the user. For example, if the user is feeling tense, the device suggests ways to relax.

[1032] Processing step of emotion engine for ball position tracking

[1033] Example: Providing ball position information using emotion data

[1034] Step 1:

[1035] The user hits the ball using a golf ball with a built-in Bluetooth chip.

[1036] Step 2:

[1037] The device receives the Bluetooth ball's signal and collects its location data.

[1038] Step 3:

[1039] Along with the location data collected by the device, the camera and microphone are used to send the user's facial expressions and voice to the emotion engine for emotion analysis.

[1040] Step 4:

[1041] An emotion engine identifies emotional states (e.g., anxiety, excitement).

[1042] Step 5:

[1043] The device transmits emotion data and location data to the server.

[1044] Step 6:

[1045] The server analyzes the location data and plots the ball's location on a map.

[1046] Step 7:

[1047] The server generates appropriate behavioral advice (e.g., breathing techniques to stay calm) based on the plotted ball position and emotional state.

[1048] Step 8:

[1049] The server sends ball position information and action advice to the terminal.

[1050] Step 9:

[1051] The terminal displays the received ball position information and action advice to the user.

[1052] Processing steps of emotion engine for golf equipment recommendation

[1053] Example: Product recommendation using emotional data

[1054] Step 1:

[1055] The user uses a terminal to input search criteria for golf equipment (e.g., driver, budget within 30,000 yen).

[1056] Step 2:

[1057] Before the device sends input data to the server, it activates the camera and microphone to collect the user's facial expressions and voice.

[1058] Step 3:

[1059] The facial expression and voice data collected by the device is sent to an internal emotion engine, which performs emotion analysis in real time.

[1060] Step 4:

[1061] The emotion engine analyzes the user's emotion data and identifies their emotional state (e.g., excitement, satisfaction, hesitation).

[1062] Step 5:

[1063] The device transmits the emotional state data and search conditions to the server.

[1064] Step 6:

[1065] Based on the emotional state data and search conditions received by the server, a search is made for golf equipment that matches the conditions from the database.

[1066] Step 7:

[1067] The server prioritizes the search results according to the emotional state and generates a product list in descending order of priority.

[1068] Step 8:

[1069] The server returns the prioritized product list and promotion information to the terminal.

[1070] Step 9:

[1071] The terminal displays the received product list and promotion information to the user, who then checks the list and purchases any products that interest them.

[1072] Through the above process, highly personalized services can be provided based on the user's emotions, and golfer satisfaction can be significantly improved.

[1073] Example 2

[1074] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1075] Conventional golf-related systems have been limited to providing simple information and advice without considering the user's emotions. This has prevented them from improving user satisfaction and the quality of their experience. Furthermore, the accuracy of ball tracking and real-time swing analysis has been insufficient. This has made it difficult to provide more personalized services for golfers.

[1076] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1077] In this invention, the server includes a means for recommending the most suitable facility based on budget and location conditions, a means for analyzing video of the movement and recommending improvements in real time, a means for tracking the location using an object with a built-in communication device, a means for recommending products based on budget and genre conditions, and a means for analyzing user emotion data and providing optimal recommendations, thereby enabling the provision of more highly personalized services based on the user's emotions.

[1078] "Means for recommending optimal facilities based on budget and location conditions" is a function that searches for relevant facilities from a database based on the budget and geographical conditions entered by the user, and presents the optimal candidates to the user.

[1079] "Means of analyzing video of movements and recommending areas for improvement in real time" refers to a function in which a user sends video footage taken using a device to a server, which then analyzes the video using an AI model and immediately presents areas for improvement to the user.

[1080] "Means for tracking location using an object with a built-in communication device" refers to a function in which a terminal receives signals emitted from a specific object with a built-in communication device (e.g., a golf ball with a built-in Bluetooth chip), transmits the location information to a server for analysis, and displays the current location of the object on a map.

[1081] "Means for recommending products based on budget and genre conditions" is a function that searches for relevant products from a database based on the budget and product genre entered by the user, and presents the most suitable candidates to the user.

[1082] "Means for analyzing user emotional data and providing optimal recommendations" refers to a function that generates emotional data using an emotion engine that analyzes the user's facial expressions and voice, and then the server analyzes that data to provide more personalized recommendations to the user.

[1083] This invention relates to a golf-related system that analyzes a user's emotional data and makes personalized recommendations based on that data. Specifically, the system integrates functions such as recommending golf courses based on budget and location, analyzing video of a swing and providing real-time suggestions for improvement, tracking the ball's position using a golf ball with a built-in communication device, recommending optimal golf equipment based on budget and genre, and analyzing the user's emotional data to provide personalized recommendations.

[1084] Golf course reservation function

[1085] The system begins when a user uses a terminal to input budget and location criteria. The terminal then sends this information to a server. The server then searches the database for relevant golf courses and returns the results to the terminal. For example, if a user searches for golf courses in Kyoto City that cost less than 10,000 yen, a list of golf courses that meet those criteria will be displayed on the terminal.

[1086] Golf swing analysis function

[1087] The user uses the device's camera to record their swing and sends the video data to the server. The server then uses an AI model to analyze the video and generate an evaluation and suggestions for improvement. The results are then sent back to the device and displayed for the user to review. For example, the server can analyze the user's swing angle and speed and suggest areas for improvement.

[1088] Ball position tracking function

[1089] It works by having the user use a golf ball with a built-in Bluetooth chip. The device receives the Bluetooth signal from the golf ball and sends the location data to the server. The server analyzes the location data and plots the ball's location on a map. The results are sent back to the device and displayed so that the user can easily check them. Specifically, when the user hits the ball, the ball's current location is displayed on a map.

[1090] Golf equipment recommendation function

[1091] The user uses the device to input their budget and category (for example, a new driver) and sends that information to the server. The server searches for suitable products from the database and sends the results back to the device. The device then displays recommended products to the user and provides a purchase link. For example, if a user searches for a new driver under 30,000 yen, a list of the most suitable products is displayed and a purchase link is provided.

[1092] Emotion engine integration

[1093] This system uses an emotion engine to provide more personalized services. The camera and microphone collect the user's facial expressions and voice, which are then analyzed in real time. The emotion data is sent to the server, which then generates results based on that data to increase user satisfaction.

[1094] Linking emotion engines with golf course reservations

[1095] While the user is checking the results of their golf course search, the device uses a camera and microphone to transmit the user's facial expressions and voice to the emotion engine. The emotion engine analyzes the data in real time and sends the emotion data to the server. The server then uses the emotion data to prioritize and recommend golf courses that the user is likely to be satisfied with.

[1096] Linking the Emotion Engine and Swing Analysis

[1097] While recording video of the swing, the device simultaneously uses an emotion engine to grasp the user's emotional state. The server combines the swing analysis results with the emotional data to generate advice appropriate to the user's emotional state and sends it to the device.

[1098] Collaboration between emotion engine and golf equipment recommendation

[1099] When a user searches for golf equipment, the device uses an emotion engine to analyze the user's facial expressions and voice. Based on this, the server creates a list of products that the user is likely to be interested in, and also sends promotional information to increase the user's motivation to purchase. The device displays this to the user.

[1100] Examples of prompt statements

[1101] "Describe a system that tracks the location of a golf ball as it is being hit. The system uses a golf ball with a built-in communication device and a terminal to track the location data."

[1102] As described above, the system of the present invention can provide a more highly personalized service based on the user's emotions, and can significantly improve golfer satisfaction.

[1103] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1104] Golf course reservation function

[1105] Step 1:

[1106] The user inputs budget and location requirements into the device. Specifically, on the application screen, the user selects "Kyoto City" and "Under 10,000 yen" and presses the search button.

[1107] Input: User-entered budget and location criteria.

[1108] Output: The terminal generates the search criteria.

[1109] Step 2:

[1110] The device sends search criteria to the server, and sends data to the server's API endpoint using an HTTP request.

[1111] Input: Terminal-generated search criteria.

[1112] Output: The search criteria data received by the server.

[1113] Step 3:

[1114] The server searches the database for the relevant golf courses, executes an SQL query based on the received criteria, and retrieves a list of golf courses that meet the criteria.

[1115] Input: Search criteria data received by the server.

[1116] Output: Golf course list.

[1117] Step 4:

[1118] The server returns the search results to the terminal as an HTTP response.

[1119] Input: Golf course list.

[1120] Output: Search result data received by the device.

[1121] Step 5:

[1122] The terminal displays the search results to the user, who then browses the list of golf courses on the application screen and selects the most suitable one.

[1123] Input: Search result data received by the device.

[1124] Output: The list of golf courses displayed to the user.

[1125] Golf swing analysis function

[1126] Step 1:

[1127] The user uses the device's camera to record their swing. Open the swing capture screen in the application and press the record button to start recording.

[1128] Input: Video of the user's swing.

[1129] Output: Recorded swing video data.

[1130] Step 2:

[1131] The device sends the captured video data to the server, and the video data is transferred via the Internet.

[1132] Input: Swing video data.

[1133] Output: Video data received by the server.

[1134] Step 3:

[1135] The server analyzes the video data using an AI model, which uses a neural network to evaluate swing angle, speed, and other factors.

[1136] Input: Video data received by the server.

[1137] Output: Analysis results (evaluation score and improvement points).

[1138] Step 4:

[1139] The server sends the analysis results to the terminal, which returns them as an HTTP response.

[1140] Input: Analysis results.

[1141] Output: Analysis result data received by the device.

[1142] Step 5:

[1143] The device displays the analysis results to the user, who then checks the swing evaluation and areas for improvement on the application's analysis results screen.

[1144] Input: Analysis result data received by the device.

[1145] Output: The analysis results displayed to the user.

[1146] Ball position tracking function

[1147] Step 1:

[1148] The user uses a golf ball with a built-in Bluetooth chip, sets the ball, and hits the ball.

[1149] Input: Initial ball position and hitting motion.

[1150] Output: Bluetooth signal emitted from the golf ball.

[1151] Step 2:

[1152] The device receives a Bluetooth signal. The device's Bluetooth module continuously scans for signals.

[1153] Input: Bluetooth signal from the golf ball.

[1154] Output: The location data received by the device.

[1155] Step 3:

[1156] The device sends location data to the server using an HTTP request.

[1157] Input: Received location data.

[1158] Output: The location data received by the server.

[1159] Step 4:

[1160] The server analyzes the location data and plots the ball's location on a map. The server then calculates the ball's coordinates using the map data and location data.

[1161] Input: Location data.

[1162] Output: Map data showing the current position of the ball.

[1163] Step 5:

[1164] The server returns map data to the device as an HTTP response.

[1165] Input: Map data.

[1166] Output: Map data received by the device.

[1167] Step 6:

[1168] The device displays the map data to the user, and the ball's current location is displayed on the map.

[1169] Input: Map data received by the device.

[1170] Output: The ball position displayed to the user.

[1171] Golf equipment recommendation function

[1172] Step 1:

[1173] The user inputs conditions such as budget and genre into the device, selects "under 30,000 yen" and "driver" on the application screen, and presses the search button.

[1174] Input: User-entered budget and genre criteria.

[1175] Output: The search criteria generated by the device.

[1176] Step 2:

[1177] The device sends search criteria to the server, and sends data to the server's API endpoint using an HTTP request.

[1178] Input: Terminal-generated search criteria.

[1179] Output: The search criteria data received by the server.

[1180] Step 3:

[1181] The server searches for products that match the criteria. The server executes an SQL query to retrieve the corresponding products from the database based on the received criteria.

[1182] Input: Search criteria data.

[1183] Output: Product list.

[1184] Step 4:

[1185] The server returns the search results to the terminal as an HTTP response.

[1186] Input: Product list.

[1187] Output: Search result data received by the device.

[1188] Step 5:

[1189] The device displays the search results to the user, and the user checks the product list on the application screen, displaying the most suitable products and purchase links.

[1190] Input: Search result data received by the device.

[1191] Output: The product list shown to the user, along with a link to buy.

[1192] Emotion engine integration

[1193] Step 1:

[1194] The user searches for golf courses. The user uses a terminal to input conditions and search for golf courses.

[1195] Input: Search criteria.

[1196] Output: Search results display screen.

[1197] Step 2:

[1198] The device uses the camera and microphone to collect the user's facial expressions and voice. The camera and microphone are activated with the user's permission.

[1199] Input: User facial and voice data.

[1200] Output: Collected emotion data.

[1201] Step 3:

[1202] The emotion engine analyzes the emotion data in real time and generates an emotional state.

[1203] Input: Collected emotion data.

[1204] Output: Emotional state data.

[1205] Step 4:

[1206] Send emotional state data to the server. Send the data to the server's API endpoint using an HTTP request.

[1207] Input: Emotional state data.

[1208] Output: Emotional state data received by the server.

[1209] Step 5:

[1210] The server generates recommendation results based on the emotional data, and prioritizes the list of golf courses based on the user's emotional state.

[1211] Input: Search result data and emotional state data.

[1212] Output: A prioritized list of golf courses.

[1213] Step 6:

[1214] The server returns the prioritized results to the device, sending the data as an HTTP response.

[1215] Input: A prioritized list of golf courses.

[1216] Output: Prioritized data received by the device.

[1217] Step 7:

[1218] The terminal displays the regenerated results to the user. The user confirms the prioritized list of golf courses on the application screen.

[1219] Input: Prioritized data received by the device.

[1220] Output: A prioritized list of golf courses displayed to the user.

[1221] (Application example 2)

[1222] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1223] In today's world, recreational activities have become an important part of many people's lives. However, users have limited access to the appropriate recreational facilities and to advice on how to improve their skills. It is also difficult to select and purchase the right recreational equipment. Furthermore, existing systems are unable to provide personalized services that take users' emotions into account, resulting in low user satisfaction. A new system is needed to address these issues.

[1224] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for recommending optimal recreation facilities based on budget and location conditions; means for analyzing video of movements and recommending improvements in real time; means for tracking location using an object with a built-in communications chip; means for recommending products based on budget and genre conditions; means for analyzing the user's facial expressions and voice using an emotion analysis engine and personalizing the information provided; and means for being integrated into an autonomous vehicle and providing recreation-related services while traveling. This enables users to find optimal recreation facilities while traveling, receive advice on improving their skills, and receive recommendations based on their emotional state.

[1225] A "budget" refers to the amount of money a user plans to spend for a particular service or product.

[1226] "Recreational facilities" is a general term for facilities that users visit to enjoy their leisure time, including sports facilities and resort areas.

[1227] "Movement" refers to the bodily movements or actions performed by the user, and specifically includes technical movements such as a golf swing.

[1228] "Analysis" is a means of analyzing specific data, video, etc. in detail to understand their content and trends.

[1229] "Real-time" refers to processing and responding to events and data at the exact moment they occur.

[1230] "Recommendation" refers to the act of suggesting the best options or items based on the user's preferences and conditions.

[1231] A "communication chip" is a small electronic component that enables wireless communication and transmits and receives signals.

[1232] "Object" is a general term for any object or device that has a specific purpose or function.

[1233] "Budget and genre conditions" refers to specific criteria such as the user's desired cost range or categories of interest.

[1234] "Product" is a general term for goods and services sold, and refers to the items that users consider purchasing.

[1235] An "emotion analysis engine" refers to a technical means for analyzing a user's emotional state from their facial expressions and voice.

[1236] "Facial expressions" refer to the movements and shapes that appear on a person's face and indicate emotions and intentions.

[1237] "Speech" refers to the sounds produced by a person, including words and intonation.

[1238] "Personalization" refers to the act of optimizing information and services to suit the individual preferences and circumstances of users.

[1239] An "autonomous vehicle" is a vehicle that uses artificial intelligence and sensor technology to drive autonomously.

[1240] "Service" refers to various forms of benefits and assistance provided to users.

[1241] The present invention is a system for supporting reservations at recreational facilities, skill improvement during travel, and the purchase of equipment. Specific embodiments are described below.

[1242] System configuration:

[1243] Hardware Configuration

[1244] Autonomous vehicles: Transport users to their destinations and provide various recreational services.

[1245] Camera and microphone: Captures the user's facial expressions and voice for sentiment analysis.

[1246] Objects with embedded communication chips: Allows tracking of the location of objects such as golf balls.

[1247] Terminals (smartphones, tablets, etc.): Function as a user interface and exchange data.

[1248] Software Configuration

[1249] Sentiment analysis engine: Software for analyzing sentiment data (e.g., Affectiva, Microsoft Azure API).

[1250] Artificial intelligence model: Used for swing motion analysis and recommendation functions.

[1251] Communication library: A library for communicating data between the server and the terminal (e.g., Requests).

[1252] Program flow:

[1253] Emotion analysis

[1254] The server receives the user's facial expression and voice data sent from the device. This data is analyzed in real time using an emotion analysis engine. The analysis results are sent back to the server, and optimal services and information are generated based on the user's emotions.

[1255] Recreational facility recommendations

[1256] Users input their budget and location requirements into the terminal. The server uses this information to search its database for the best recreational facilities that match the requirements. The search results are then sent back to the terminal and displayed to the user.

[1257] Analysis and improvement of behavior

[1258] Users use the device's camera to film their swings and other movements. The video data is sent to a server where it is analyzed using an artificial intelligence model. The resulting evaluation score and points for improvement are sent back to the device and visually displayed to the user.

[1259] Product Recommendations

[1260] Users input their budget and genre requirements into the device. The server uses this information to search for the most suitable products from its database. The search results are sent back to the device and displayed to the user. Furthermore, personalized recommendations are made based on the user's emotional data.

[1261] Specific examples:

[1262] Recreational facility recommendations

[1263] When a user in a car issues a voice command such as "Find recommended golf courses around Tokyo with a budget of 10,000 yen or less," the camera and microphone capture the user's facial expressions and voice, which are then analyzed by an emotion analysis engine. Based on the analysis results, the device displays the best golf courses that match the criteria.

[1264] Analysis and improvement of behavior

[1265] When a user requests, "Please record a video of my swing and give me advice, including my emotions," the device will record the swing video and send it to the server. The analysis results will provide suggestions for improving the swing, and at the same time, advice based on the emotional analysis results will be provided.

[1266] Product Recommendations

[1267] If a user inputs "I'm looking for a new driver for under 30,000 yen," the server will search for the most suitable product and make personalized recommendations based on emotional data. Product lists and promotion information will be displayed on the device.

[1268] As described above, the embodiments of the invention analyze and personalize various data to provide users with optimal information and services.

[1269] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1270] Step 1:

[1271] The user requests the desired service (e.g., recommendations for recreational facilities, behavior analysis and improvement, product recommendations) via voice or text using the camera and microphone, and enters budget and location requirements.

[1272] Input: User's voice / text data and budget and location requirements.

[1273] Output: User request data.

[1274] Specific operation: The user gives the command "Find recommended golf courses around Tokyo with a budget of 10,000 yen or less."

[1275] Step 2:

[1276] The device uses a camera and microphone to capture the user's facial expressions and voice, and sends the data to an emotion analysis engine.

[1277] Input: User's facial expression data and voice data.

[1278] Output: Parsed emotion data.

[1279] Specific operation: The device captures the user's facial expressions and voice in real time and sends them to an emotion analysis engine.

[1280] Step 3:

[1281] The server uses an emotion analysis engine to analyze the received data and determine the user's emotional state.

[1282] Input: Facial expression data and voice data sent from the device.

[1283] Output: The user's emotional state (e.g., relaxed, excited).

[1284] Specific operation: The emotion analysis engine analyzes facial and vocal characteristics to identify the user's emotional state.

[1285] Step 4:

[1286] The terminal transmits the user's request data and emotion data to the server and requests recommendations for optimal recreational facilities and products.

[1287] Input: User request data, budget and location criteria, and sentiment data.

[1288] Output: The request data to the server.

[1289] Specific operation: The device collects requests from users and sends them to the server along with emotion data.

[1290] Step 5:

[1291] The server searches the database for recreational facilities or products that match the criteria and generates personalized recommendation results based on the emotion data.

[1292] Input: Request data to the server (conditions and emotion data).

[1293] Output: Personalized recommendation results.

[1294] Specific operation: The server searches the database and selects the facilities and products that best suit the user's emotional state.

[1295] Step 6:

[1296] The server sends the recommendation results back to the terminal, which then presents them to the user visually and / or audibly.

[1297] Input: personalized recommendation results.

[1298] Output: Information presented to the user.

[1299] Specific operation: The terminal displays the recommendation results received from the server on the display device or notifies them by voice.

[1300] Step 7:

[1301] The user can make reservations at recommended facilities, check the analysis results of their movements, or purchase recommended products.

[1302] Input: Recommendation results sent from the server.

[1303] Output: Actions such as completing a reservation, checking analysis results, purchasing a product, etc.

[1304] Specific behavior: The user performs an action such as "Book this golf course" or "View detailed analysis results."

[1305] By following these steps, users can have an optimal recreational experience while on the move.

[1306] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1307] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1308] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1309] [Third embodiment]

[1310] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1311] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1312] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1313] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1314] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1315] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1316] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1317] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1318] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1319] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1320] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1321] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1322] The present invention provides an integrated system for enriching your golfing life, and includes the following functions.

[1323] 1. Golf course reservation function

[1324] The user uses a terminal to input budget and location criteria. This information is sent from the terminal to a server, which then searches for matching golf courses in its database. The server returns the search results to the terminal, which displays them to the user. The user can then select the most suitable golf course and make a reservation. For example, a list of the most suitable golf courses within Kyoto City with a budget of 10,000 yen or less is displayed.

[1325] 2. Golf swing analysis function

[1326] The user uses the device's camera to film their swing and sends the video data to the server. The server uses an AI model to evaluate the swing and suggest areas for improvement. The analysis results are sent back to the device and displayed to the user. For example, when a user films their swing, the server analyzes the swing's angle and speed and provides an evaluation along with suggestions for improvement.

[1327] 3. Ball position tracking function

[1328] The user hits the ball using a golf ball equipped with a built-in Bluetooth chip. The device receives the Bluetooth signal from the ball and sends the location data to the server. The server analyzes the data and plots the ball's location on a map. The result is sent back to the device, allowing the user to easily find the ball. For example, when a user hits a golf ball, the ball's current location is displayed on a map.

[1329] 4. Golf equipment recommendation function

[1330] The user uses the device to enter criteria such as budget and genre, and sends that information to the server. The server searches the database for golf equipment that matches the criteria and sends the results back to the device. The device then displays recommended products to the user and provides a purchase link. For example, if a user looking to purchase a new driver searches for items under 30,000 yen, a list of optimal products will be displayed and a purchase link will be provided.

[1331] Program processing explanation

[1332] Golf course reservations

[1333] The server receives the user's input criteria and searches the database for golf courses that match the criteria. The results are sent to the terminal, which displays them to the user. The user selects the desired golf course from the displayed list and completes the reservation.

[1334] Golf Swing Analysis

[1335] The device takes a video of the swing and sends it to the server. The server analyzes the video data using an AI model and generates an evaluation and points for improvement. The results are sent to the device, which displays them to the user. The user can then use the displayed points for improvement to make corrections to their swing.

[1336] Ball position tracking

[1337] The device receives signals from golf balls with built-in Bluetooth chips and transmits location data to a server. The server processes the data and plots the ball's location on a map. The results are sent back to the device, which displays the location information to the user. The user can then use the displayed information to find the ball.

[1338] Golf equipment recommendations

[1339] The user inputs budget and genre criteria on the device and sends them to the server. The server searches the database for golf equipment that matches the criteria and sends the results back to the device. The device then displays recommended products to the user and provides a purchase link. The user can then purchase the displayed products.

[1340] A system that integrates all of the above functions will instantly eliminate all of a golfer's worries and enrich their golfing life.

[1341] The processing flow will be explained below.

[1342] Golf course reservation processing steps

[1343] Example: A user searching for a golf course in Kyoto City with a budget of less than 10,000 yen

[1344] Step 1:

[1345] The user launches the app using their device and enters their budget (within 10,000 yen) and desired location (within Kyoto City).

[1346] Step 2:

[1347] The device sends the user's input data to the server using an HTTP request.

[1348] Step 3:

[1349] The server searches the database for golf course information based on the received criteria. The server executes an SQL query to extract golf courses that match the specified criteria.

[1350] Step 4:

[1351] The server returns the search results to the terminal as an HTTP response.

[1352] Step 5:

[1353] The terminal displays the list of golf courses received to the user, and the user selects the golf course he or she desires.

[1354] Step 6:

[1355] The user enters detailed information (such as date and time and number of players) to reserve the selected golf course, and the device sends this information to the server.

[1356] Step 7:

[1357] The server receives the reservation information, stores it in a database, and returns a message to the terminal indicating that the reservation was successful.

[1358] Step 8:

[1359] The terminal will display a reservation completion message to the user.

[1360] Golf Swing Analysis Processing Steps

[1361] Example: A user who wants to know how to improve their swing.

[1362] Step 1:

[1363] The user activates the camera on the device and records their own swing.

[1364] Step 2:

[1365] The device compresses the captured swing video and transmits the video data to a server using a protocol for efficient video data transfer.

[1366] Step 3:

[1367] The server receives the video data and analyzes the swing using an AI model. The server then uses a deep learning model to extract each element of the swing (speed, angle, etc.) and generates an evaluation score and areas for improvement.

[1368] Step 4:

[1369] The server returns the analysis results to the terminal as an HTTP response.

[1370] Step 5:

[1371] The device displays the analysis results and improvements received to the user.

[1372] Step 6:

[1373] The user will then try to make corrections in their next swing based on the improvements shown.

[1374] Ball position tracking processing steps

[1375] Example: A user who wants to check the ball's position

[1376] Step 1:

[1377] The user hits the ball using a golf ball equipped with a built-in Bluetooth chip.

[1378] Step 2:

[1379] The ball periodically emits a Bluetooth signal along its trajectory.

[1380] Step 3:

[1381] The device receives the Bluetooth signal, analyzes its location data, and sends it to a server, including signal strength and timing.

[1382] Step 4:

[1383] The server receives the position data and runs an algorithm to determine the exact location of the ball.

[1384] Step 5:

[1385] The server returns the processing result to the terminal as an HTTP response.

[1386] Step 6:

[1387] The device plots the ball position information it receives on a map and displays it to the user.

[1388] Step 7:

[1389] The user finds the golf ball based on the displayed location information.

[1390] Processing steps for golf equipment recommendations

[1391] Example: A user who wants to purchase a new driver

[1392] Step 1:

[1393] The user launches the app using their device and enters their budget (e.g., under 30,000 yen) and desired genre (e.g., driver).

[1394] Step 2:

[1395] The device sends the user's input data to the server.

[1396] Step 3:

[1397] The server searches the database for suitable golf equipment based on the received criteria, and uses a filtering algorithm to extract products that match the criteria.

[1398] Step 4:

[1399] The server returns the search results and a list of recommended products to the terminal as an HTTP response.

[1400] Step 5:

[1401] The device displays search results to the user and provides a link to purchase.

[1402] Step 6:

[1403] The user selects from the displayed products and clicks the purchase link to visit the online store.

[1404] Step 7:

[1405] The user completes the purchase process on your online store.

[1406] Example 1

[1407] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1408] Today's golfers face many challenges when it comes to choosing a golf course, improving their swing, tracking their ball position, and purchasing golf equipment. An integrated system is needed to resolve these issues and enrich their golfing life. Specifically, it is necessary to reserve the optimal golf course, analyze their swing motion in real time, accurately grasp their ball position, and recommend the appropriate golf equipment.

[1409] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1410] In this invention, the server includes a means for recommending the most suitable golf course based on budget and location conditions, a means for analyzing video of a swing using a generative AI model to generate an evaluation score and areas for improvement, a means for tracking the ball position using a golf ball with a built-in communication module, and a means for recommending golf equipment based on budget and category conditions. This enables various golf-related activities to be carried out efficiently and effectively, resolving golfers' concerns and enriching their golfing life.

[1411] "Budget" refers to the upper limit of the amount that a user sets when selecting a golf course or golf equipment.

[1412] "Location" means the geographic area or region designated by a User when making a golf course reservation.

[1413] "Swing motion" refers to the series of body movements that occur when swinging a golf club to hit a ball.

[1414] A "generative AI model" refers to an artificial intelligence model that uses machine learning algorithms to analyze data and make evaluations and suggestions.

[1415] "Golf ball with built-in communication module" refers to a golf ball that has built-in Bluetooth or other wireless communication capabilities to track the ball's position.

[1416] "Golf equipment" refers to items related to playing golf, such as clubs, balls, bags, and clothing.

[1417] A "database" refers to a system for systematically managing and storing information.

[1418] "Evaluation score" refers to the result of evaluating swing movements and other performance using a number or grade.

[1419] The present invention is an integrated system for enriching your golfing life, and includes the functions of recommending golf courses based on budget and location, video analysis of swing movements, tracking the position of the ball using a golf ball with a built-in communication module, and recommending golf equipment based on budget and genre.

[1420] Golf course reservation function

[1421] The user uses a terminal to input budget and location requirements. The terminal sends this information to the server, which then accesses a database to search for golf courses that meet the requirements. The search results are sent to the terminal, which displays them to the user. The user can then select the desired facility from the displayed golf courses and make a reservation.

[1422] For example, a user inputs the conditions "budget within 10,000 yen" and "Kyoto city", and the server searches for golf courses that match these conditions. As a result, "Golf courses A, B, and C in Kyoto city" are displayed on the terminal, and the user can select one to complete the reservation.

[1423] Example prompt sentence:

[1424] "Please find a golf course in Kyoto City with a budget of 10,000 yen or less."

[1425] Golf swing analysis function

[1426] Users film their golf swing using the device's camera. The video data is sent from the device to a server, where it is analyzed using a generative AI model. The analysis results, including a swing evaluation score and areas for improvement, are sent back to the device and displayed to the user.

[1427] For example, a user takes a video of their golf swing and sends it to a server, which then analyzes the swing angle and speed. The server generates a result, such as "You need to improve your swing angle by 10 degrees," and sends it to the device. The user can use this result to make improvements.

[1428] Example prompt sentence:

[1429] "Please analyze the video of my golf swing and tell me where I can improve."

[1430] Ball position tracking function

[1431] The user uses a golf ball with a built-in communications module and hits the ball. The device receives the radio signal from the ball and transmits the location data to the server. The server analyzes the data and plots the ball's location on a map. The results are sent back to the device, which displays this information to the user.

[1432] For example, after a user hits a golf ball, the device identifies its location and sends the data to the server. The server generates a result such as "The ball's current location is coordinates X, Y" and sends it to the device. The user can then find the golf ball based on the location information plotted on a map.

[1433] Example prompt sentence:

[1434] "Show me the current location of the golf ball I hit."

[1435] Golf equipment recommendation function

[1436] The user inputs budget and category criteria using the device and sends that information to the server. The server searches the database for golf equipment that matches the criteria and sends the results to the device. The device then displays recommended products to the user and provides a link to purchase them.

[1437] For example, if a user enters the criteria "I want a new screwdriver with a budget of less than 30,000 yen," the server will search for suitable products based on this. The server will create results such as "Product A, Product B, Product C" and send them to the terminal. The user will then make a purchase based on these results.

[1438] Example prompt sentence:

[1439] "Please tell me a recommended screwdriver that can be purchased for under 30,000 yen."

[1440] By integrating these functions into a system, it is possible to provide a comprehensive range of services that meet the diverse needs of golfers, further enriching their golfing life.

[1441] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1442] Golf course reservation function

[1443] Step 1:

[1444] The user enters the budget and location conditions into the device. The user opens the dedicated application and enters "under 10,000 yen" for the budget and "Kyoto city" for the location. The entered data is temporarily saved on the device.

[1445] Input: Budget and location conditions (e.g., within 10,000 yen, within Kyoto City)

[1446] Output: Condition data saved on the device

[1447] Step 2:

[1448] The device sends the entered conditions to the server. The device sends the budget and location condition data to the server via an HTTP request. The software used is a library that sends data in JSON format.

[1449] Input: Condition data (under 10,000 yen, within Kyoto city)

[1450] Output: HTTP request to the server

[1451] Step 3:

[1452] The server searches the database for golf courses that match the criteria. The server searches the database using an SQL query based on the received criteria. Information on golf courses that match the criteria is obtained.

[1453] Input: Condition data received as an HTTP request

[1454] Output: Search results for golf courses that match the criteria

[1455] Step 4:

[1456] The server sends the search results to the terminal. The server returns the search result data in JSON format to the terminal. The software used is a server-side framework (e.g., Django, Flask).

[1457] Input: Search result data

[1458] Output: HTTP response to the device

[1459] Step 5:

[1460] The terminal displays the search results to the user. The received data is analyzed and the search results are displayed to the user via a GUI. The results displayed might be "Golf Courses A, B, and C in Kyoto City," for example.

[1461] Input: Search results received as an HTTP response

[1462] Output: Search results displayed on the GUI

[1463] Step 6:

[1464] The user selects the golf course of their choice and makes a reservation. When the user clicks the reservation button, the terminal sends the reservation information to the server, which then processes the reservation.

[1465] Input: User selection and reservation information

[1466] Output: Reservation confirmation notification

[1467] Golf swing analysis function

[1468] Step 1:

[1469] The user uses the device's camera to record their golf swing. The user launches the application and uses the camera to record their swing.

[1470] Input: Golf swing video

[1471] Output: Recorded video data

[1472] Step 2:

[1473] The device sends video data to the server. The captured video data is transferred to the server using an HTTP POST request. The video data is compressed and a library is used for transfer.

[1474] Input: Captured video data

[1475] Output: HTTP POST request to the server

[1476] Step 3:

[1477] The server analyzes the video data using an AI model (e.g., OpenPose) to generate evaluation data such as swing angle and speed.

[1478] Input: Video data received as an HTTP POST request

[1479] Output: Analysis results including evaluation scores and improvement points

[1480] Step 4:

[1481] The server sends the analysis results to the device, which then returns them to the device in JSON format.

[1482] Input: Analysis result data

[1483] Output: HTTP response to the device

[1484] Step 5:

[1485] The device displays the analysis results to the user. The analysis results are analyzed and displayed to the user through a GUI, including specific feedback such as "You need to improve your swing angle by 10 degrees."

[1486] Input: Analysis results received as an HTTP response

[1487] Output: Display of analysis results and improvements on the GUI

[1488] Ball position tracking function

[1489] Step 1:

[1490] The user hits the ball using a golf ball with a built-in communication module. The user hits the ball with a golf club.

[1491] Input: Ball hitting situation (physical action)

[1492] Output: Signal transmission from the communication module

[1493] Step 2:

[1494] The device receives the wireless signal from the golf ball. The device uses the Bluetooth communication library to receive the signal emitted from the golf ball and obtain the location data.

[1495] Input: Wireless signal

[1496] Output: Position data

[1497] Step 3:

[1498] The device sends location data to the server. The acquired location data is then sent to the server via an HTTP request.

[1499] Input: Location data

[1500] Output: HTTP request to the server

[1501] Step 4:

[1502] The server analyzes the location data. The server analyzes the received location data and generates data that can be plotted as a precise map location.

[1503] Input: Location data received as an HTTP request

[1504] Output: Analysis results (plot data)

[1505] Step 5:

[1506] The server sends the analysis results to the terminal, and then sends the plot data back to the terminal.

[1507] Input: Analysis result data

[1508] Output: HTTP response to the device

[1509] Step 6:

[1510] The terminal plots the ball's position on a map and displays it to the user. The terminal plots the analysis results on a map and displays them to the user through a GUI.

[1511] Input: Plot data received as an HTTP response

[1512] Output: Plot display on map

[1513] Golf equipment recommendation function

[1514] Step 1:

[1515] The user inputs the budget and genre into the device. The user opens the dedicated application and enters "under 30,000 yen" as the budget and "driver" as the genre.

[1516] Input: Budget and genre criteria

[1517] Output: Condition data saved on the device

[1518] Step 2:

[1519] The terminal sends the entered conditions to the server. The terminal sends the condition data to the server via an HTTP request.

[1520] Input: Condition data

[1521] Output: HTTP request to the server

[1522] Step 3:

[1523] The server searches the database for golf equipment that matches the criteria. Based on the received criteria, the server searches the database using an SQL query to retrieve information on golf equipment that matches the criteria.

[1524] Input: Condition data received as an HTTP request

[1525] Output: Search results for golf equipment that matches the criteria

[1526] Step 4:

[1527] The server sends the search results to the device. The server returns the search result data to the device in JSON format.

[1528] Input: Search result data

[1529] Output: HTTP response to the device

[1530] Step 5:

[1531] The device displays recommended products to the user and provides a purchase link. The search results are analyzed and displayed to the user through a GUI. The results displayed include "Driver A (29,999 yen), Driver B (28,000 yen)," and other products, along with a purchase link for each product.

[1532] Input: Search results received as an HTTP response

[1533] Output: Recommended products and purchase links displayed on the GUI

[1534] (Application example 1)

[1535] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1536] In conventional golf-related systems and factory logistics management systems, individual functions are dispersed, making it difficult to manage and optimize them in an integrated manner. Furthermore, integrating functions such as golf course and logistics reservations, swing and route efficiency analysis, item location tracking, and recommendation systems is expected to improve user convenience, but no such system exists. The present invention aims to solve these problems and provide an integrated system that is efficient and convenient for users.

[1537] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1538] In this invention, the server includes a means for recommending the optimal golf course based on budget and location conditions, a means for analyzing video of swing movements and recommending areas for improvement in real time, a means for tracking the location of an item with a built-in Bluetooth device, a means for recommending tools and parts based on budget and category conditions, and a means for analyzing movement path data of an automatic transport robot to analyze efficiency and generate improvement proposals. This enables the realization of integrated golf-related services and in-factory logistics management, and improves the work efficiency of users and operators.

[1539] A "budget" is a set limit on spending for the acquisition of goods and services.

[1540] "Location Conditions" means any constraints or requirements relating to a particular geographic location or environment.

[1541] A "golf course" is a large green area designed for playing golf, including holes, tees, greens, etc.

[1542] A "swing motion" is a series of movements that are performed to swing a golf club and hit a golf ball.

[1543] "Analyzing video" is the process of extracting specific information based on video data captured by a camera or other device.

[1544] "Improvements" are corrections or refinements that are needed to improve current status or performance.

[1545] A "Bluetooth device" is an electronic device capable of exchanging data over short distances using wireless communication technology.

[1546] "Location tracking using an item" is the process of using an identification device attached to a particular item to monitor the current location of that item in real time.

[1547] "Tools" means hand and power tools for use in factories and workshops.

[1548] A "part" is a small component that makes up part of a product or machine.

[1549] "Recommending" is the act of presenting suitable options based on specific criteria.

[1550] An "automated transport robot" is a robotic device designed to autonomously transport items within a factory or warehouse.

[1551] "Analyzing travel route data" is the process of evaluating the efficiency and presence of obstacles based on the travel route data.

[1552] "Efficiency analysis" is an evaluation method for assessing the efficiency of a particular operation or process and identifying areas for improvement.

[1553] "Improvement proposals" are specific means or methods proposed to improve the current situation.

[1554] The present invention relates to an integrated factory logistics optimization system, and has the following functions.

[1555] 1. Logistics reservation function

[1556] The user uses a terminal to specify the items or parts to be transported and sends that information to the server. The server then searches the database for the optimal transport route and returns the results to the terminal. The user can then operate the automated transport robot according to the transport route displayed on the terminal. This allows for efficient management of logistics within the factory.

[1557] 2. Movement path analysis function

[1558] As the automated transport robot moves through the factory, the device captures video data of its movement path and sends it to the server. The server then analyzes the movement path data using a generative AI model to generate efficiency and improvement proposals. The analysis results are sent back to the device and displayed visually to the user. This optimizes the movement path of goods within the factory and improves efficiency.

[1559] 3. Item location tracking function

[1560] Items in the factory are equipped with Bluetooth devices, and the terminal receives this information to obtain the item's location. The location data is sent to a server, which analyzes the location in real time and sends it back to the terminal. Users can immediately find out where items are in the factory, reducing the time it takes to find lost items or search for them.

[1561] 4. Tool and parts recommendation function

[1562] The user uses a terminal to input the requirements for tools and parts (budget, purpose, etc.) and sends the information to the server. The server searches the database for tools and parts that match the requirements and returns the results to the terminal. The user can then select the most suitable product from the displayed recommended list and purchase it.

[1563] To integrate the above functions, the following hardware and software are mainly used.

[1564] Hardware:

[1565] Smartphone or tablet: A device that allows users to input and view information.

[1566] Server: Analyzes and stores data

[1567] Autonomous transport robot: A robot for transporting goods

[1568] Bluetooth devices: devices for tracking the location of items

[1569] software:

[1570] Database management systems (e.g., SQLite)

[1571] Web frameworks (e.g. Flask)

[1572] AI analytical models (e.g., generative AI models)

[1573] As a concrete example, let us consider the case where a user transports a specific part from a warehouse. First, the user inputs the information "bearing, warehouse A, 2023-10-12 14:00" into the terminal and sends it. The server receives this information and searches the database for the optimal transport route. The search results are returned to the terminal, which displays the transport route to the user. The user then operates the automated transport robot according to this route.

[1574] Example prompts used in route analysis by the AI ​​model:

[1575] Travel path data:

[1576] Starting point: Entrance

[1577] Route: Aisle 1 -> Aisle 2 -> Machine A

[1578] Time: 2023-10-11 09:00

[1579] Analysis task: Evaluate the efficiency of this route and suggest improvements.

[1580] These specific examples and integrated systems enable efficient logistics management in factories and work sites, optimize overall processes, and reduce the workload of users.

[1581] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1582] Step 1:

[1583] The user uses a terminal to input and transmit information about the item or part to be transported (e.g., bearing, warehouse A, 2023-10-12 14:00). The input data includes the type of item, the destination location, the desired date and time of transport, etc.

[1584] Step 2:

[1585] The terminal sends the input data to the server. The server receives the data and stores it in a database. The input data is saved as reservation information.

[1586] Step 3:

[1587] The server searches the database for the optimal route for the delivery. It uses a search algorithm to efficiently calculate the route for delivering the goods. For example, the algorithm calculates the shortest route between the goods' storage location and their destination.

[1588] Step 4:

[1589] The server returns the calculated optimal route to the terminal. The output data includes detailed information about the transportation route (e.g., passing through corridor 1 and then through corridor 2 to reach machine A).

[1590] Step 5:

[1591] The terminal displays the optimal route information received from the server to the user, who then operates the automated transport robot based on the displayed information to transport the goods.

[1592] Step 6:

[1593] As the automated transport robot moves through the factory, the device captures and records the path of its movement as video data. The recorded data includes video of the physical path of movement.

[1594] Step 7:

[1595] The device sends video data of the travel route to the server. The server analyzes this video data using a generative AI model. The analysis prompt is, "Travel route data: - Starting point: Entrance - Route: Aisle 1 -> Aisle 2 -> Machine A - Time: 2023-10-11 09:00 Analysis task: Evaluate the efficiency of this route and suggest improvements."

[1596] Step 8:

[1597] The server uses a generative AI model to generate route efficiency and improvement suggestions. The analysis results include a route efficiency score, the presence of obstacles, and suggested improvements.

[1598] Step 9:

[1599] The server sends the analysis results back to the device, and the output data includes an efficiency score and details of improvement suggestions.

[1600] Step 10:

[1601] The terminal visually displays the analysis results to the user, who can then optimize their next delivery route based on the displayed analysis results.

[1602] Step 11:

[1603] Bluetooth devices are attached to items in the factory, and the terminal receives the signals to obtain the item's location information, which is then sent to the server. The location data includes the item's current location.

[1604] Step 12:

[1605] The server analyzes the location data in real time and notifies the user of the item's current location, allowing the user to quickly find the item.

[1606] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1607] The present invention further improves the user experience by incorporating an emotion engine that analyzes the user's emotions in an integrated system for enriching the golfing life. Specific functions and processing flow are explained below.

[1608] 1. Golf course reservation function

[1609] The user uses a terminal to input budget and location criteria. This information is sent from the terminal to the server, which then searches the database for matching golf courses. The results are sent back to the terminal, which displays them to the user. The user can then select the most suitable golf course and make a reservation. For example, a list of the most suitable golf courses within Kyoto City with a budget of 10,000 yen or less is displayed.

[1610] 2. Golf swing analysis function

[1611] The user uses the device's camera to film their swing and sends the video data to the server. The server uses an AI model to evaluate the swing and suggest areas for improvement. The analysis results are sent back to the device and displayed to the user. For example, when a user films their swing, the server analyzes the swing's angle and speed and provides an evaluation along with suggestions for improvement.

[1612] 3. Ball position tracking function

[1613] The user hits the ball using a golf ball equipped with a built-in Bluetooth chip. The device receives the Bluetooth signal from the ball and sends the location data to the server. The server analyzes the data and plots the ball's location on a map. The result is sent back to the device, allowing the user to easily find the ball. For example, when the user hits the golf ball, the ball's current location is displayed on a map.

[1614] 4. Golf equipment recommendation function

[1615] The user uses the device to enter criteria such as budget and genre, and sends that information to the server. The server searches the database for suitable golf equipment and returns the results to the device. The device then displays recommended products to the user and provides a purchase link. For example, if a user looking to purchase a new driver searches for items under 30,000 yen, a list of optimal products will be displayed and a purchase link will be provided.

[1616] 5. Emotion engine integration

[1617] This system incorporates an emotion engine that analyzes the user's emotions. The emotion engine recognizes emotions by analyzing the user's facial expressions and voice, and transmits this emotion data to the server.

[1618] Using emotion engines for golf course reservations

[1619] When a user is checking the results of a golf course search, the emotion engine analyzes the user's facial expressions and voice to obtain emotional data. Based on this emotional data, the server prioritizes recommendations of golf courses that are likely to satisfy the user, providing a more personalized service.

[1620] Using an Emotion Engine in Golf Swing Analysis

[1621] During swing analysis, the system checks the user's emotional state and provides advice tailored to their state, such as whether they are tense or relaxed. For example, if the user is tense, it can suggest simple stretching techniques to help them relax.

[1622] Using an Emotion Engine for Golf Equipment Recommendation

[1623] When displaying search results for golf equipment, if a user is excited or satisfied with a particular product, the app will show more of that type of product, along with promotions and discounts to entice the user to make a purchase.

[1624] Program processing explanation

[1625] Linking emotion engines with golf course reservations

[1626] When a user searches for golf courses, the device uses a camera and microphone to transmit the user's facial expressions and voice to the emotion engine. The emotion engine analyzes this in real time and transmits the emotion data to the server. The server uses the emotion data to generate search results that prioritize the results that will satisfy the user.

[1627] Linking the Emotion Engine and Swing Analysis

[1628] While recording video of the swing, the device simultaneously uses an emotion engine to grasp the user's emotional state. The server combines the swing analysis results with the emotional data to generate advice appropriate to the user's emotional state and sends it to the device.

[1629] Collaboration between emotion engine and golf equipment recommendation

[1630] When a user searches for golf equipment, the device uses an emotion engine to analyze the user's facial expressions and voice. Based on this, the server creates a list of products that the user is likely to be interested in, and also sends promotional information to increase the user's motivation to purchase. The device displays this to the user.

[1631] With the above mechanism, the system of the present invention can provide a more highly personalized service based on the user's emotions, and can significantly improve golfer satisfaction.

[1632] The processing flow will be explained below.

[1633] Processing steps of emotion engine for golf course reservations

[1634] Example: Golf course recommendation using emotion data

[1635] Step 1:

[1636] The user uses a device to open a golf course search screen and enters the budget and location (e.g., Kyoto City, budget within 10,000 yen).

[1637] Step 2:

[1638] Before the device sends input data to the server, it activates the camera and microphone to collect the user's facial expressions and voice.

[1639] Step 3:

[1640] The facial expression and voice data collected by the device is sent to an internal emotion engine, which performs emotion analysis in real time.

[1641] Step 4:

[1642] The emotion engine analyzes the user's emotion data and identifies their emotional state (e.g., happy, excited, nervous, indifferent).

[1643] Step 5:

[1644] The device transmits the emotional state data and search conditions to the server.

[1645] Step 6:

[1646] Based on the emotional state data and search conditions received by the server, a search is made for golf courses that match the conditions from the database.

[1647] Step 7:

[1648] The server prioritizes the search results according to the emotional state and generates a list of golf courses in descending order of priority.

[1649] Step 8:

[1650] The server returns the prioritized list of golf courses to the terminal.

[1651] Step 9:

[1652] The terminal displays the received golf course list to the user, who then checks the list, selects a golf course that satisfies the user, and makes a reservation.

[1653] Processing steps of the emotion engine in golf swing analysis

[1654] Example: Swing improvement advice using emotional data

[1655] Step 1:

[1656] The user starts the swing analysis mode using the terminal and captures the swing motion with the camera.

[1657] Step 2:

[1658] The device collects the user's facial expressions and voice using a camera and microphone at the same time as the swing video data.

[1659] Step 3:

[1660] The terminal transmits the collected swing video data and emotion data to a server.

[1661] Step 4:

[1662] The server analyzes the swing video data using an AI model and generates an evaluation score and areas for improvement in the swing.

[1663] Step 5:

[1664] The server analyzes the emotional data to determine the user's current emotional state (e.g., tense, relaxed, focused).

[1665] Step 6:

[1666] The server combines the swing analysis results with the user's emotional state to generate optimal improvement advice according to the emotional state.

[1667] Step 7:

[1668] The server transmits the generated improvement advice to the terminal.

[1669] Step 8:

[1670] The device displays the received improvement advice to the user. For example, if the user is feeling tense, the device suggests ways to relax.

[1671] Processing step of emotion engine for ball position tracking

[1672] Example: Providing ball position information using emotion data

[1673] Step 1:

[1674] The user hits the ball using a golf ball with a built-in Bluetooth chip.

[1675] Step 2:

[1676] The device receives the Bluetooth ball's signal and collects its location data.

[1677] Step 3:

[1678] Along with the location data collected by the device, the camera and microphone are used to send the user's facial expressions and voice to the emotion engine for emotion analysis.

[1679] Step 4:

[1680] An emotion engine identifies emotional states (e.g., anxiety, excitement).

[1681] Step 5:

[1682] The device transmits emotion data and location data to the server.

[1683] Step 6:

[1684] The server analyzes the location data and plots the ball's location on a map.

[1685] Step 7:

[1686] The server generates appropriate behavioral advice (e.g., breathing techniques to stay calm) based on the plotted ball position and emotional state.

[1687] Step 8:

[1688] The server sends ball position information and action advice to the terminal.

[1689] Step 9:

[1690] The terminal displays the received ball position information and action advice to the user.

[1691] Processing steps of emotion engine for golf equipment recommendation

[1692] Example: Product recommendation using emotional data

[1693] Step 1:

[1694] The user uses a terminal to input search criteria for golf equipment (e.g., driver, budget within 30,000 yen).

[1695] Step 2:

[1696] Before the device sends input data to the server, it activates the camera and microphone to collect the user's facial expressions and voice.

[1697] Step 3:

[1698] The facial expression and voice data collected by the device is sent to an internal emotion engine, which performs emotion analysis in real time.

[1699] Step 4:

[1700] The emotion engine analyzes the user's emotion data and identifies their emotional state (e.g., excitement, satisfaction, hesitation).

[1701] Step 5:

[1702] The device transmits the emotional state data and search conditions to the server.

[1703] Step 6:

[1704] Based on the emotional state data and search conditions received by the server, a search is made for golf equipment that matches the conditions from the database.

[1705] Step 7:

[1706] The server prioritizes the search results according to the emotional state and generates a product list in descending order of priority.

[1707] Step 8:

[1708] The server returns the prioritized product list and promotion information to the terminal.

[1709] Step 9:

[1710] The terminal displays the received product list and promotion information to the user, who then checks the list and purchases any products that interest them.

[1711] Through the above process, highly personalized services can be provided based on the user's emotions, and golfer satisfaction can be significantly improved.

[1712] Example 2

[1713] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1714] Conventional golf-related systems have been limited to providing simple information and advice without considering the user's emotions. This has prevented them from improving user satisfaction and the quality of their experience. Furthermore, the accuracy of ball tracking and real-time swing analysis has been insufficient. This has made it difficult to provide more personalized services for golfers.

[1715] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1716] In this invention, the server includes a means for recommending the most suitable facility based on budget and location conditions, a means for analyzing video of the movement and recommending improvements in real time, a means for tracking the location using an object with a built-in communication device, a means for recommending products based on budget and genre conditions, and a means for analyzing user emotion data and providing optimal recommendations, thereby enabling the provision of more highly personalized services based on the user's emotions.

[1717] "Means for recommending optimal facilities based on budget and location conditions" is a function that searches for relevant facilities from a database based on the budget and geographical conditions entered by the user, and presents the optimal candidates to the user.

[1718] "Means of analyzing video of movements and recommending areas for improvement in real time" refers to a function in which a user sends video footage taken using a device to a server, which then analyzes the video using an AI model and immediately presents areas for improvement to the user.

[1719] "Means for tracking location using an object with a built-in communication device" refers to a function in which a terminal receives signals emitted from a specific object with a built-in communication device (e.g., a golf ball with a built-in Bluetooth chip), transmits the location information to a server for analysis, and displays the current location of the object on a map.

[1720] "Means for recommending products based on budget and genre conditions" is a function that searches for relevant products from a database based on the budget and product genre entered by the user, and presents the most suitable candidates to the user.

[1721] "Means for analyzing user emotional data and providing optimal recommendations" refers to a function that generates emotional data using an emotion engine that analyzes the user's facial expressions and voice, and then the server analyzes that data to provide more personalized recommendations to the user.

[1722] This invention relates to a golf-related system that analyzes a user's emotional data and makes personalized recommendations based on that data. Specifically, the system integrates functions such as recommending golf courses based on budget and location, analyzing video of a swing and providing real-time suggestions for improvement, tracking the ball's position using a golf ball with a built-in communication device, recommending optimal golf equipment based on budget and genre, and analyzing the user's emotional data to provide personalized recommendations.

[1723] Golf course reservation function

[1724] The system begins when a user uses a terminal to input budget and location criteria. The terminal then sends this information to a server. The server then searches the database for relevant golf courses and returns the results to the terminal. For example, if a user searches for golf courses in Kyoto City that cost less than 10,000 yen, a list of golf courses that meet those criteria will be displayed on the terminal.

[1725] Golf swing analysis function

[1726] The user uses the device's camera to record their swing and sends the video data to the server. The server then uses an AI model to analyze the video and generate an evaluation and suggestions for improvement. The results are then sent back to the device and displayed for the user to review. For example, the server can analyze the user's swing angle and speed and suggest areas for improvement.

[1727] Ball position tracking function

[1728] It works by having the user use a golf ball with a built-in Bluetooth chip. The device receives the Bluetooth signal from the golf ball and sends the location data to the server. The server analyzes the location data and plots the ball's location on a map. The results are sent back to the device and displayed so that the user can easily check them. Specifically, when the user hits the ball, the ball's current location is displayed on a map.

[1729] Golf equipment recommendation function

[1730] The user uses the device to input their budget and category (for example, a new driver) and sends that information to the server. The server searches for suitable products from the database and sends the results back to the device. The device then displays recommended products to the user and provides a purchase link. For example, if a user searches for a new driver under 30,000 yen, a list of the most suitable products is displayed and a purchase link is provided.

[1731] Emotion engine integration

[1732] This system uses an emotion engine to provide more personalized services. The camera and microphone collect the user's facial expressions and voice, which are then analyzed in real time. The emotion data is sent to the server, which then generates results based on that data to increase user satisfaction.

[1733] Linking emotion engines with golf course reservations

[1734] While the user is checking the results of their golf course search, the device uses a camera and microphone to transmit the user's facial expressions and voice to the emotion engine. The emotion engine analyzes the data in real time and sends the emotion data to the server. The server then uses the emotion data to prioritize and recommend golf courses that the user is likely to be satisfied with.

[1735] Linking the Emotion Engine and Swing Analysis

[1736] While recording video of the swing, the device simultaneously uses an emotion engine to grasp the user's emotional state. The server combines the swing analysis results with the emotional data to generate advice appropriate to the user's emotional state and sends it to the device.

[1737] Collaboration between emotion engine and golf equipment recommendation

[1738] When a user searches for golf equipment, the device uses an emotion engine to analyze the user's facial expressions and voice. Based on this, the server creates a list of products that the user is likely to be interested in, and also sends promotional information to increase the user's motivation to purchase. The device displays this to the user.

[1739] Examples of prompt statements

[1740] "Describe a system that tracks the location of a golf ball as it is being hit. The system uses a golf ball with a built-in communication device and a terminal to track the location data."

[1741] As described above, the system of the present invention can provide a more highly personalized service based on the user's emotions, thereby significantly improving golfer satisfaction.

[1742] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1743] Golf course reservation function

[1744] Step 1:

[1745] The user inputs budget and location requirements into the device. Specifically, on the application screen, the user selects "Kyoto City" and "Under 10,000 yen" and presses the search button.

[1746] Input: User-entered budget and location criteria.

[1747] Output: The terminal generates the search criteria.

[1748] Step 2:

[1749] The device sends search criteria to the server, and sends data to the server's API endpoint using an HTTP request.

[1750] Input: Terminal-generated search criteria.

[1751] Output: The search criteria data received by the server.

[1752] Step 3:

[1753] The server searches the database for the relevant golf courses, executes an SQL query based on the received criteria, and retrieves a list of golf courses that meet the criteria.

[1754] Input: Search criteria data received by the server.

[1755] Output: Golf course list.

[1756] Step 4:

[1757] The server returns the search results to the terminal as an HTTP response.

[1758] Input: Golf course list.

[1759] Output: Search result data received by the device.

[1760] Step 5:

[1761] The terminal displays the search results to the user, who then browses the list of golf courses on the application screen and selects the most suitable one.

[1762] Input: Search result data received by the device.

[1763] Output: The list of golf courses displayed to the user.

[1764] Golf swing analysis function

[1765] Step 1:

[1766] The user uses the device's camera to record their swing. Open the swing capture screen in the application and press the record button to start recording.

[1767] Input: Video of the user's swing.

[1768] Output: Recorded swing video data.

[1769] Step 2:

[1770] The device sends the captured video data to the server, and the video data is transferred via the Internet.

[1771] Input: Swing video data.

[1772] Output: Video data received by the server.

[1773] Step 3:

[1774] The server analyzes the video data using an AI model, which uses a neural network to evaluate swing angle, speed, and other factors.

[1775] Input: Video data received by the server.

[1776] Output: Analysis results (evaluation score and improvement points).

[1777] Step 4:

[1778] The server sends the analysis results to the terminal, which returns them as an HTTP response.

[1779] Input: Analysis results.

[1780] Output: Analysis result data received by the device.

[1781] Step 5:

[1782] The device displays the analysis results to the user, who then checks the swing evaluation and areas for improvement on the application's analysis results screen.

[1783] Input: Analysis result data received by the device.

[1784] Output: The analysis results displayed to the user.

[1785] Ball position tracking function

[1786] Step 1:

[1787] The user uses a golf ball with a built-in Bluetooth chip, sets the ball, and hits the ball.

[1788] Input: Initial ball position and hitting motion.

[1789] Output: Bluetooth signal emitted from the golf ball.

[1790] Step 2:

[1791] The device receives a Bluetooth signal. The device's Bluetooth module continuously scans for signals.

[1792] Input: Bluetooth signal from the golf ball.

[1793] Output: The location data received by the device.

[1794] Step 3:

[1795] The device sends location data to the server using an HTTP request.

[1796] Input: Received location data.

[1797] Output: The location data received by the server.

[1798] Step 4:

[1799] The server analyzes the location data and plots the ball's location on a map. The server then calculates the ball's coordinates using the map data and location data.

[1800] Input: Location data.

[1801] Output: Map data showing the current position of the ball.

[1802] Step 5:

[1803] The server returns map data to the device as an HTTP response.

[1804] Input: Map data.

[1805] Output: Map data received by the device.

[1806] Step 6:

[1807] The device displays the map data to the user, and the ball's current location is displayed on the map.

[1808] Input: Map data received by the device.

[1809] Output: The ball position displayed to the user.

[1810] Golf equipment recommendation function

[1811] Step 1:

[1812] The user inputs conditions such as budget and genre into the device, selects "under 30,000 yen" and "driver" on the application screen, and presses the search button.

[1813] Input: User-entered budget and genre criteria.

[1814] Output: The search criteria generated by the device.

[1815] Step 2:

[1816] The device sends search criteria to the server, and sends data to the server's API endpoint using an HTTP request.

[1817] Input: Terminal-generated search criteria.

[1818] Output: The search criteria data received by the server.

[1819] Step 3:

[1820] The server searches for products that match the criteria. The server executes an SQL query to retrieve the corresponding products from the database based on the received criteria.

[1821] Input: Search criteria data.

[1822] Output: Product list.

[1823] Step 4:

[1824] The server returns the search results to the terminal as an HTTP response.

[1825] Input: Product list.

[1826] Output: Search result data received by the device.

[1827] Step 5:

[1828] The device displays the search results to the user, and the user checks the product list on the application screen, displaying the most suitable products and purchase links.

[1829] Input: Search result data received by the device.

[1830] Output: The product list shown to the user, along with a link to buy.

[1831] Emotion engine integration

[1832] Step 1:

[1833] The user searches for golf courses. The user uses a terminal to input conditions and search for golf courses.

[1834] Input: Search criteria.

[1835] Output: Search results display screen.

[1836] Step 2:

[1837] The device uses the camera and microphone to collect the user's facial expressions and voice. The camera and microphone are activated with the user's permission.

[1838] Input: User facial and voice data.

[1839] Output: Collected emotion data.

[1840] Step 3:

[1841] The emotion engine analyzes the emotion data in real time and generates an emotional state.

[1842] Input: Collected emotion data.

[1843] Output: Emotional state data.

[1844] Step 4:

[1845] Send emotional state data to the server. Send the data to the server's API endpoint using an HTTP request.

[1846] Input: Emotional state data.

[1847] Output: Emotional state data received by the server.

[1848] Step 5:

[1849] The server generates recommendation results based on the emotional data, and prioritizes the list of golf courses based on the user's emotional state.

[1850] Input: Search result data and emotional state data.

[1851] Output: A prioritized list of golf courses.

[1852] Step 6:

[1853] The server returns the prioritized results to the device, sending the data as an HTTP response.

[1854] Input: A prioritized list of golf courses.

[1855] Output: Prioritized data received by the device.

[1856] Step 7:

[1857] The terminal displays the regenerated results to the user. The user confirms the prioritized list of golf courses on the application screen.

[1858] Input: Prioritized data received by the device.

[1859] Output: A prioritized list of golf courses displayed to the user.

[1860] (Application example 2)

[1861] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1862] In today's world, recreational activities have become an important part of many people's lives. However, users have limited access to the appropriate recreational facilities and to advice on how to improve their skills. It is also difficult to select and purchase the right recreational equipment. Furthermore, existing systems are unable to provide personalized services that take users' emotions into account, resulting in low user satisfaction. A new system is needed to address these issues.

[1863] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for recommending optimal recreation facilities based on budget and location conditions; means for analyzing video of movements and recommending improvements in real time; means for tracking location using an object with a built-in communications chip; means for recommending products based on budget and genre conditions; means for analyzing the user's facial expressions and voice using an emotion analysis engine and personalizing the information provided; and means for being integrated into an autonomous vehicle and providing recreation-related services while traveling. This enables users to find optimal recreation facilities while traveling, receive advice on improving their skills, and receive recommendations based on their emotional state.

[1864] A "budget" refers to the amount of money a user plans to spend for a particular service or product.

[1865] "Recreational facilities" is a general term for facilities that users visit to enjoy their leisure time, including sports facilities and resort areas.

[1866] "Movement" refers to the bodily movements or actions performed by the user, and specifically includes technical movements such as a golf swing.

[1867] "Analysis" is a means of analyzing specific data, video, etc. in detail to understand their content and trends.

[1868] "Real-time" refers to processing and responding to events and data at the exact moment they occur.

[1869] "Recommendation" refers to the act of suggesting the best options or items based on the user's preferences and conditions.

[1870] A "communication chip" is a small electronic component that enables wireless communication and transmits and receives signals.

[1871] "Object" is a general term for any object or device that has a specific purpose or function.

[1872] "Budget and genre conditions" refers to specific criteria such as the user's desired cost range or categories of interest.

[1873] "Product" is a general term for goods and services sold, and refers to the items that users consider purchasing.

[1874] An "emotion analysis engine" refers to a technical means for analyzing a user's emotional state from their facial expressions and voice.

[1875] "Facial expressions" refer to the movements and shapes that appear on a person's face and indicate emotions and intentions.

[1876] "Speech" refers to the sounds produced by a person, including words and intonation.

[1877] "Personalization" refers to the act of optimizing information and services to suit the individual preferences and circumstances of users.

[1878] An "autonomous vehicle" is a vehicle that uses artificial intelligence and sensor technology to drive autonomously.

[1879] "Service" refers to various forms of benefits and assistance provided to users.

[1880] The present invention is a system for supporting reservations at recreational facilities, skill improvement during travel, and the purchase of equipment. Specific embodiments are described below.

[1881] System configuration:

[1882] Hardware Configuration

[1883] Autonomous vehicles: Transport users to their destinations and provide various recreational services.

[1884] Camera and microphone: Captures the user's facial expressions and voice for sentiment analysis.

[1885] Objects with embedded communication chips: Allows tracking of the location of objects such as golf balls.

[1886] Terminals (smartphones, tablets, etc.): Function as a user interface and exchange data.

[1887] Software Configuration

[1888] Sentiment analysis engine: Software for analyzing sentiment data (e.g., Affectiva, Microsoft Azure API).

[1889] Artificial intelligence model: Used for swing motion analysis and recommendation functions.

[1890] Communication library: A library for communicating data between the server and the terminal (e.g., Requests).

[1891] Program flow:

[1892] Emotion analysis

[1893] The server receives the user's facial expression and voice data sent from the device. This data is analyzed in real time using an emotion analysis engine. The analysis results are sent back to the server, and optimal services and information are generated based on the user's emotions.

[1894] Recreational facility recommendations

[1895] Users input their budget and location requirements into the terminal. The server uses this information to search its database for the best recreational facilities that match the requirements. The search results are then sent back to the terminal and displayed to the user.

[1896] Analysis and improvement of behavior

[1897] Users use the device's camera to film their swings and other movements. The video data is sent to a server where it is analyzed using an artificial intelligence model. The resulting evaluation score and points for improvement are sent back to the device and visually displayed to the user.

[1898] Product Recommendations

[1899] Users input their budget and genre requirements into the device. The server uses this information to search for the most suitable products from its database. The search results are sent back to the device and displayed to the user. Furthermore, personalized recommendations are made based on the user's emotional data.

[1900] Specific examples:

[1901] Recreational facility recommendations

[1902] When a user in a car issues a voice command such as "Find recommended golf courses around Tokyo with a budget of 10,000 yen or less," the camera and microphone capture the user's facial expressions and voice, which are then analyzed by an emotion analysis engine. Based on the analysis results, the device displays the best golf courses that match the criteria.

[1903] Analysis and improvement of behavior

[1904] When a user requests, "Please record a video of my swing and give me advice, including my emotions," the device will record the swing video and send it to the server. The analysis results will provide suggestions for improving the swing, and at the same time, advice based on the emotional analysis results will be provided.

[1905] Product Recommendations

[1906] If a user inputs "I'm looking for a new driver for under 30,000 yen," the server will search for the most suitable product and provide personalized recommendations based on emotional data. Product lists and promotional information will be displayed on the device.

[1907] As described above, the embodiments of the invention analyze and personalize various data to provide users with optimal information and services.

[1908] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1909] Step 1:

[1910] The user requests the desired service (e.g., recommendations for recreational facilities, behavior analysis and improvement, product recommendations) via voice or text using the camera and microphone, and enters budget and location requirements.

[1911] Input: User's voice / text data and budget and location requirements.

[1912] Output: User request data.

[1913] Specific operation: The user gives the command "Find recommended golf courses around Tokyo with a budget of 10,000 yen or less."

[1914] Step 2:

[1915] The device uses a camera and microphone to capture the user's facial expressions and voice, and sends the data to an emotion analysis engine.

[1916] Input: User's facial expression data and voice data.

[1917] Output: Parsed emotion data.

[1918] Specific operation: The device captures the user's facial expressions and voice in real time and sends them to an emotion analysis engine.

[1919] Step 3:

[1920] The server uses an emotion analysis engine to analyze the received data and determine the user's emotional state.

[1921] Input: Facial expression data and voice data sent from the device.

[1922] Output: The user's emotional state (e.g., relaxed, excited).

[1923] Specific operation: The emotion analysis engine analyzes facial and vocal characteristics to identify the user's emotional state.

[1924] Step 4:

[1925] The terminal transmits the user's request data and emotion data to the server and requests recommendations for optimal recreational facilities and products.

[1926] Input: User request data, budget and location criteria, and sentiment data.

[1927] Output: The request data to the server.

[1928] Specific operation: The device collects requests from users and sends them to the server along with emotion data.

[1929] Step 5:

[1930] The server searches the database for recreational facilities or products that match the criteria and generates personalized recommendation results based on the emotion data.

[1931] Input: Request data to the server (conditions and emotion data).

[1932] Output: Personalized recommendation results.

[1933] Specific operation: The server searches the database and selects the facilities and products that best suit the user's emotional state.

[1934] Step 6:

[1935] The server sends the recommendation results back to the terminal, which then presents them to the user visually and / or audibly.

[1936] Input: personalized recommendation results.

[1937] Output: Information presented to the user.

[1938] Specific operation: The terminal displays the recommendation results received from the server on the display device or notifies them by voice.

[1939] Step 7:

[1940] The user can make reservations at recommended facilities, check the analysis results of their movements, or purchase recommended products.

[1941] Input: Recommendation results sent from the server.

[1942] Output: Actions such as completing a reservation, checking analysis results, purchasing a product, etc.

[1943] Specific behavior: The user performs an action such as "Book this golf course" or "View detailed analysis results."

[1944] By following these steps, users can have an optimal recreational experience while on the move.

[1945] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1946] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1947] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1948] [Fourth embodiment]

[1949] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1950] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1951] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1952] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1953] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1954] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1955] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1956] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1957] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1958] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1959] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1960] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1961] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1962] The present invention provides an integrated system for enriching your golfing life, and includes the following functions.

[1963] 1. Golf course reservation function

[1964] The user uses a terminal to input budget and location criteria. This information is sent from the terminal to a server, which then searches for matching golf courses in its database. The server returns the search results to the terminal, which displays them to the user. The user can then select the most suitable golf course and make a reservation. For example, a list of the most suitable golf courses within Kyoto City with a budget of 10,000 yen or less is displayed.

[1965] 2. Golf swing analysis function

[1966] The user uses the device's camera to film their swing and sends the video data to the server. The server uses an AI model to evaluate the swing and suggest areas for improvement. The analysis results are sent back to the device and displayed to the user. For example, when a user films their swing, the server analyzes the swing's angle and speed and provides an evaluation along with suggestions for improvement.

[1967] 3. Ball position tracking function

[1968] The user hits the ball using a golf ball equipped with a built-in Bluetooth chip. The device receives the Bluetooth signal from the ball and sends the location data to the server. The server analyzes the data and plots the ball's location on a map. The result is sent back to the device, allowing the user to easily find the ball. For example, when a user hits a golf ball, the ball's current location is displayed on a map.

[1969] 4. Golf equipment recommendation function

[1970] The user uses the device to enter criteria such as budget and genre, and sends that information to the server. The server searches the database for golf equipment that matches the criteria and sends the results back to the device. The device then displays recommended products to the user and provides a purchase link. For example, if a user looking to purchase a new driver searches for items under 30,000 yen, a list of optimal products will be displayed and a purchase link will be provided.

[1971] Program processing explanation

[1972] Golf course reservations

[1973] The server receives the user's input criteria and searches the database for golf courses that match the criteria. The results are sent to the terminal, which displays them to the user. The user selects the desired golf course from the displayed list and completes the reservation.

[1974] Golf Swing Analysis

[1975] The device takes a video of the swing and sends it to the server. The server analyzes the video data using an AI model and generates an evaluation and points for improvement. The results are sent to the device, which displays them to the user. The user can then use the displayed points for improvement to make corrections to their swing.

[1976] Ball position tracking

[1977] The device receives signals from golf balls with built-in Bluetooth chips and transmits location data to a server. The server processes the data and plots the ball's location on a map. The results are sent back to the device, which displays the location information to the user. The user can then use the displayed information to find the ball.

[1978] Golf equipment recommendations

[1979] The user inputs budget and genre criteria on the device and sends them to the server. The server searches the database for golf equipment that matches the criteria and sends the results back to the device. The device then displays recommended products to the user and provides a purchase link. The user can then purchase the displayed products.

[1980] A system that integrates all of the above functions will instantly eliminate all of a golfer's worries and enrich their golfing life.

[1981] The processing flow will be explained below.

[1982] Golf course reservation processing steps

[1983] Example: A user searching for a golf course in Kyoto City with a budget of less than 10,000 yen

[1984] Step 1:

[1985] The user launches the app using their device and enters their budget (within 10,000 yen) and desired location (within Kyoto City).

[1986] Step 2:

[1987] The device sends the user's input data to the server using an HTTP request.

[1988] Step 3:

[1989] The server searches the database for golf course information based on the received criteria. The server executes an SQL query to extract golf courses that match the specified criteria.

[1990] Step 4:

[1991] The server returns the search results to the terminal as an HTTP response.

[1992] Step 5:

[1993] The terminal displays the list of golf courses received to the user, and the user selects the golf course he or she desires.

[1994] Step 6:

[1995] The user enters detailed information (such as date and time and number of players) to reserve the selected golf course, and the device sends this information to the server.

[1996] Step 7:

[1997] The server receives the reservation information, stores it in a database, and returns a message to the terminal indicating that the reservation was successful.

[1998] Step 8:

[1999] The terminal will display a reservation completion message to the user.

[2000] Golf Swing Analysis Processing Steps

[2001] Example: A user who wants to know how to improve their swing.

[2002] Step 1:

[2003] The user activates the camera on the device and records their own swing.

[2004] Step 2:

[2005] The device compresses the captured swing video and transmits the video data to a server using a protocol for efficient video data transfer.

[2006] Step 3:

[2007] The server receives the video data and analyzes the swing using an AI model. The server then uses a deep learning model to extract each element of the swing (speed, angle, etc.) and generates an evaluation score and areas for improvement.

[2008] Step 4:

[2009] The server returns the analysis results to the terminal as an HTTP response.

[2010] Step 5:

[2011] The device displays the analysis results and improvements received to the user.

[2012] Step 6:

[2013] The user will then try to make corrections in their next swing based on the improvements shown.

[2014] Ball position tracking processing steps

[2015] Example: A user who wants to check the ball's position

[2016] Step 1:

[2017] The user hits the ball using a golf ball equipped with a built-in Bluetooth chip.

[2018] Step 2:

[2019] The ball periodically emits a Bluetooth signal along its trajectory.

[2020] Step 3:

[2021] The device receives the Bluetooth signal, analyzes its location data, and sends it to a server, including signal strength and timing.

[2022] Step 4:

[2023] The server receives the position data and runs an algorithm to determine the exact location of the ball.

[2024] Step 5:

[2025] The server returns the processing result to the terminal as an HTTP response.

[2026] Step 6:

[2027] The device plots the ball position information it receives on a map and displays it to the user.

[2028] Step 7:

[2029] The user finds the golf ball based on the displayed location information.

[2030] Processing steps for golf equipment recommendations

[2031] Example: A user who wants to purchase a new driver

[2032] Step 1:

[2033] The user launches the app using their device and enters their budget (e.g., under 30,000 yen) and desired genre (e.g., driver).

[2034] Step 2:

[2035] The device sends the user's input data to the server.

[2036] Step 3:

[2037] The server searches the database for suitable golf equipment based on the received criteria, and uses a filtering algorithm to extract products that match the criteria.

[2038] Step 4:

[2039] The server returns the search results and a list of recommended products to the terminal as an HTTP response.

[2040] Step 5:

[2041] The device displays search results to the user and provides a link to purchase.

[2042] Step 6:

[2043] The user selects from the displayed products and clicks the purchase link to visit the online store.

[2044] Step 7:

[2045] The user completes the purchase process on your online store.

[2046] Example 1

[2047] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2048] Today's golfers face many challenges when it comes to choosing a golf course, improving their swing, tracking their ball position, and purchasing golf equipment. An integrated system is needed to resolve these issues and enrich their golfing life. Specifically, it is necessary to reserve the optimal golf course, analyze their swing motion in real time, accurately grasp their ball position, and recommend the appropriate golf equipment.

[2049] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2050] In this invention, the server includes a means for recommending the most suitable golf course based on budget and location conditions, a means for analyzing video of a swing using a generative AI model to generate an evaluation score and areas for improvement, a means for tracking the ball position using a golf ball with a built-in communication module, and a means for recommending golf equipment based on budget and category conditions. This enables various golf-related activities to be carried out efficiently and effectively, resolving golfers' concerns and enriching their golfing life.

[2051] "Budget" refers to the upper limit of the amount that a user sets when selecting a golf course or golf equipment.

[2052] "Location" means the geographic area or region designated by a User when making a golf course reservation.

[2053] "Swing motion" refers to the series of body movements that occur when swinging a golf club to hit a ball.

[2054] A "generative AI model" refers to an artificial intelligence model that uses machine learning algorithms to analyze data and make evaluations and suggestions.

[2055] "Golf ball with built-in communication module" refers to a golf ball that has built-in Bluetooth or other wireless communication capabilities to track the ball's position.

[2056] "Golf equipment" refers to items related to playing golf, such as clubs, balls, bags, and clothing.

[2057] A "database" refers to a system for systematically managing and storing information.

[2058] "Evaluation score" refers to the result of evaluating swing movements and other performance using a number or grade.

[2059] The present invention is an integrated system for enriching your golfing life, and includes the functions of recommending golf courses based on budget and location, video analysis of swing movements, tracking the position of the ball using a golf ball with a built-in communication module, and recommending golf equipment based on budget and genre.

[2060] Golf course reservation function

[2061] The user uses a terminal to input budget and location requirements. The terminal sends this information to the server, which then accesses a database to search for golf courses that meet the requirements. The search results are sent to the terminal, which displays them to the user. The user can then select the desired facility from the displayed golf courses and make a reservation.

[2062] For example, a user inputs the conditions "budget within 10,000 yen" and "Kyoto city", and the server searches for golf courses that match these conditions. As a result, "Golf courses A, B, and C in Kyoto city" are displayed on the terminal, and the user can select one to complete the reservation.

[2063] Example prompt sentence:

[2064] "Please find a golf course in Kyoto City with a budget of 10,000 yen or less."

[2065] Golf swing analysis function

[2066] Users film their golf swing using the device's camera. The video data is sent from the device to a server, where it is analyzed using a generative AI model. The analysis results, including a swing evaluation score and areas for improvement, are sent back to the device and displayed to the user.

[2067] For example, a user takes a video of their golf swing and sends it to a server, which then analyzes the swing angle and speed. The server generates a result, such as "You need to improve your swing angle by 10 degrees," and sends it to the device. The user can use this result to make improvements.

[2068] Example prompt sentence:

[2069] "Please analyze the video of my golf swing and tell me where I can improve."

[2070] Ball position tracking function

[2071] The user uses a golf ball with a built-in communications module and hits the ball. The device receives the radio signal from the ball and transmits the location data to the server. The server analyzes the data and plots the ball's location on a map. The results are sent back to the device, which displays this information to the user.

[2072] For example, after a user hits a golf ball, the device identifies its location and sends the data to the server. The server generates a result such as "The ball's current location is coordinates X, Y" and sends it to the device. The user can then find the golf ball based on the location information plotted on a map.

[2073] Example prompt sentence:

[2074] "Show me the current location of the golf ball I hit."

[2075] Golf equipment recommendation function

[2076] The user inputs budget and category criteria using the device and sends that information to the server. The server searches the database for golf equipment that matches the criteria and sends the results to the device. The device then displays recommended products to the user and provides a link to purchase them.

[2077] For example, if a user enters the criteria "I want a new screwdriver with a budget of less than 30,000 yen," the server will search for suitable products based on this. The server will create results such as "Product A, Product B, Product C" and send them to the terminal. The user will then make a purchase based on these results.

[2078] Example prompt sentence:

[2079] "Please tell me a recommended screwdriver that can be purchased for under 30,000 yen."

[2080] By integrating these functions into a system, it is possible to provide a comprehensive range of services that meet the diverse needs of golfers, further enriching their golfing life.

[2081] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2082] Golf course reservation function

[2083] Step 1:

[2084] The user enters the budget and location conditions into the device. The user opens the dedicated application and enters "under 10,000 yen" for the budget and "Kyoto city" for the location. The entered data is temporarily saved on the device.

[2085] Input: Budget and location conditions (e.g., within 10,000 yen, within Kyoto City)

[2086] Output: Condition data saved on the device

[2087] Step 2:

[2088] The device sends the entered conditions to the server. The device sends the budget and location condition data to the server via an HTTP request. The software used is a library that sends data in JSON format.

[2089] Input: Condition data (under 10,000 yen, within Kyoto city)

[2090] Output: HTTP request to the server

[2091] Step 3:

[2092] The server searches the database for golf courses that match the criteria. The server searches the database using an SQL query based on the received criteria. Information on golf courses that match the criteria is obtained.

[2093] Input: Condition data received as an HTTP request

[2094] Output: Search results for golf courses that match the criteria

[2095] Step 4:

[2096] The server sends the search results to the terminal. The server returns the search result data in JSON format to the terminal. The software used is a server-side framework (e.g., Django, Flask).

[2097] Input: Search result data

[2098] Output: HTTP response to the device

[2099] Step 5:

[2100] The terminal displays the search results to the user. The received data is analyzed and the search results are displayed to the user via a GUI. The results displayed might be "Golf Courses A, B, and C in Kyoto City," for example.

[2101] Input: Search results received as an HTTP response

[2102] Output: Search results displayed on the GUI

[2103] Step 6:

[2104] The user selects the golf course of their choice and makes a reservation. When the user clicks the reservation button, the terminal sends the reservation information to the server, which then processes the reservation.

[2105] Input: User selection and reservation information

[2106] Output: Reservation confirmation notification

[2107] Golf swing analysis function

[2108] Step 1:

[2109] The user uses the device's camera to record their golf swing. The user launches the application and uses the camera to record their swing.

[2110] Input: Golf swing video

[2111] Output: Recorded video data

[2112] Step 2:

[2113] The device sends video data to the server. The captured video data is transferred to the server using an HTTP POST request. The video data is compressed and a library is used for transfer.

[2114] Input: Captured video data

[2115] Output: HTTP POST request to the server

[2116] Step 3:

[2117] The server analyzes the video data using an AI model (e.g., OpenPose) to generate evaluation data such as swing angle and speed.

[2118] Input: Video data received as an HTTP POST request

[2119] Output: Analysis results including evaluation scores and improvement points

[2120] Step 4:

[2121] The server sends the analysis results to the device, which then returns them to the device in JSON format.

[2122] Input: Analysis result data

[2123] Output: HTTP response to the device

[2124] Step 5:

[2125] The device displays the analysis results to the user. The analysis results are analyzed and displayed to the user through a GUI, including specific feedback such as "You need to improve your swing angle by 10 degrees."

[2126] Input: Analysis results received as an HTTP response

[2127] Output: Display of analysis results and improvements on the GUI

[2128] Ball position tracking function

[2129] Step 1:

[2130] The user hits the ball using a golf ball with a built-in communication module. The user hits the ball with a golf club.

[2131] Input: Ball hitting situation (physical action)

[2132] Output: Signal transmission from the communication module

[2133] Step 2:

[2134] The device receives the wireless signal from the golf ball. The device uses the Bluetooth communication library to receive the signal emitted from the golf ball and obtain the location data.

[2135] Input: Wireless signal

[2136] Output: Position data

[2137] Step 3:

[2138] The device sends location data to the server. The acquired location data is then sent to the server via an HTTP request.

[2139] Input: Location data

[2140] Output: HTTP request to the server

[2141] Step 4:

[2142] The server analyzes the location data. The server analyzes the received location data and generates data that can be plotted as a precise map location.

[2143] Input: Location data received as an HTTP request

[2144] Output: Analysis results (plot data)

[2145] Step 5:

[2146] The server sends the analysis results to the terminal, and then sends the plot data back to the terminal.

[2147] Input: Analysis result data

[2148] Output: HTTP response to the device

[2149] Step 6:

[2150] The terminal plots the ball's position on a map and displays it to the user. The terminal plots the analysis results on a map and displays them to the user through a GUI.

[2151] Input: Plot data received as an HTTP response

[2152] Output: Plot display on map

[2153] Golf equipment recommendation function

[2154] Step 1:

[2155] The user inputs the budget and genre into the device. The user opens the dedicated application and enters "under 30,000 yen" as the budget and "driver" as the genre.

[2156] Input: Budget and genre criteria

[2157] Output: Condition data saved on the device

[2158] Step 2:

[2159] The terminal sends the entered conditions to the server. The terminal sends the condition data to the server via an HTTP request.

[2160] Input: Condition data

[2161] Output: HTTP request to the server

[2162] Step 3:

[2163] The server searches the database for golf equipment that matches the criteria. Based on the received criteria, the server searches the database using an SQL query to retrieve information on golf equipment that matches the criteria.

[2164] Input: Condition data received as an HTTP request

[2165] Output: Search results for golf equipment that matches the criteria

[2166] Step 4:

[2167] The server sends the search results to the device. The server returns the search result data to the device in JSON format.

[2168] Input: Search result data

[2169] Output: HTTP response to the device

[2170] Step 5:

[2171] The device displays recommended products to the user and provides a purchase link. The search results are analyzed and displayed to the user through a GUI. The results displayed include "Driver A (29,999 yen), Driver B (28,000 yen)," and other products, along with a purchase link for each product.

[2172] Input: Search results received as an HTTP response

[2173] Output: Recommended products and purchase links displayed on the GUI

[2174] (Application example 1)

[2175] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2176] In conventional golf-related systems and factory logistics management systems, individual functions are dispersed, making it difficult to manage and optimize them in an integrated manner. Furthermore, integrating functions such as golf course and logistics reservations, swing and route efficiency analysis, item location tracking, and recommendation systems is expected to improve user convenience, but no such system exists. The present invention aims to solve these problems and provide an integrated system that is efficient and convenient for users.

[2177] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2178] In this invention, the server includes a means for recommending the optimal golf course based on budget and location conditions, a means for analyzing video of swing movements and recommending areas for improvement in real time, a means for tracking the location of an item with a built-in Bluetooth device, a means for recommending tools and parts based on budget and category conditions, and a means for analyzing movement path data of an automatic transport robot to analyze efficiency and generate improvement proposals. This enables the realization of integrated golf-related services and in-factory logistics management, and improves the work efficiency of users and operators.

[2179] A "budget" is a set limit on spending for the acquisition of goods and services.

[2180] "Location Conditions" means any constraints or requirements relating to a particular geographic location or environment.

[2181] A "golf course" is a large green area designed for playing golf, including holes, tees, greens, etc.

[2182] A "swing motion" is a series of movements that are performed to swing a golf club and hit a golf ball.

[2183] "Analyzing video" is the process of extracting specific information based on video data captured by a camera or other device.

[2184] "Improvements" are corrections or refinements that are needed to improve current status or performance.

[2185] A "Bluetooth device" is an electronic device capable of exchanging data over short distances using wireless communication technology.

[2186] "Location tracking using an item" is the process of using an identification device attached to a particular item to monitor the current location of that item in real time.

[2187] "Tools" means hand and power tools for use in factories and workshops.

[2188] A "part" is a small component that makes up part of a product or machine.

[2189] "Recommending" is the act of presenting suitable options based on specific criteria.

[2190] An "automated transport robot" is a robotic device designed to autonomously transport items within a factory or warehouse.

[2191] "Analyzing travel route data" is the process of evaluating the efficiency and presence of obstacles based on the travel route data.

[2192] "Efficiency analysis" is an evaluation method for assessing the efficiency of a particular operation or process and identifying areas for improvement.

[2193] "Improvement proposals" are specific means or methods proposed to improve the current situation.

[2194] The present invention relates to an integrated factory logistics optimization system, and has the following functions.

[2195] 1. Logistics reservation function

[2196] The user uses a terminal to specify the items or parts to be transported and sends that information to the server. The server then searches the database for the optimal transport route and returns the results to the terminal. The user can then operate the automated transport robot according to the transport route displayed on the terminal. This allows for efficient management of logistics within the factory.

[2197] 2. Movement path analysis function

[2198] As the automated transport robot moves through the factory, the device captures video data of its movement path and sends it to the server. The server then analyzes the movement path data using a generative AI model to generate efficiency and improvement proposals. The analysis results are sent back to the device and displayed visually to the user. This optimizes the movement path of goods within the factory and improves efficiency.

[2199] 3. Item location tracking function

[2200] Items in the factory are equipped with Bluetooth devices, and the terminal receives this information to obtain the item's location. The location data is sent to a server, which analyzes the location in real time and sends it back to the terminal. Users can immediately find out where items are in the factory, reducing the time it takes to find lost items or search for them.

[2201] 4. Tool and parts recommendation function

[2202] The user uses a terminal to input the requirements for tools and parts (budget, purpose, etc.) and sends the information to the server. The server searches the database for tools and parts that match the requirements and returns the results to the terminal. The user can then select the most suitable product from the displayed recommended list and purchase it.

[2203] To integrate the above functions, the following hardware and software are mainly used.

[2204] Hardware:

[2205] Smartphone or tablet: A device that allows users to input and view information.

[2206] Server: Analyzes and stores data

[2207] Autonomous transport robot: A robot for transporting goods

[2208] Bluetooth devices: devices for tracking the location of items

[2209] software:

[2210] Database management systems (e.g., SQLite)

[2211] Web frameworks (e.g. Flask)

[2212] AI analytical models (e.g., generative AI models)

[2213] As a concrete example, let us consider the case where a user transports a specific part from a warehouse. First, the user inputs the information "bearing, warehouse A, 2023-10-12 14:00" into the terminal and sends it. The server receives this information and searches the database for the optimal transport route. The search results are returned to the terminal, which displays the transport route to the user. The user then operates the automated transport robot according to this route.

[2214] Example prompts used in route analysis by the AI ​​model:

[2215] Travel path data:

[2216] Starting point: Entrance

[2217] Route: Aisle 1 -> Aisle 2 -> Machine A

[2218] Time: 2023-10-11 09:00

[2219] Analysis task: Evaluate the efficiency of this route and suggest improvements.

[2220] These specific examples and integrated systems enable efficient logistics management in factories and work sites, optimize overall processes, and reduce the workload of users.

[2221] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2222] Step 1:

[2223] The user uses a terminal to input and transmit information about the item or part to be transported (e.g., bearing, warehouse A, 2023-10-12 14:00). The input data includes the type of item, the destination location, the desired date and time of transport, etc.

[2224] Step 2:

[2225] The terminal sends the input data to the server. The server receives the data and stores it in a database. The input data is saved as reservation information.

[2226] Step 3:

[2227] The server searches the database for the optimal route for the delivery. It uses a search algorithm to efficiently calculate the route for delivering the goods. For example, the algorithm calculates the shortest route between the goods' storage location and their destination.

[2228] Step 4:

[2229] The server returns the calculated optimal route to the terminal. The output data includes detailed information about the transportation route (e.g., passing through corridor 1 and then through corridor 2 to reach machine A).

[2230] Step 5:

[2231] The terminal displays the optimal route information received from the server to the user, who then operates the automated transport robot based on the displayed information to transport the goods.

[2232] Step 6:

[2233] As the automated transport robot moves through the factory, the device captures and records the path of its movement as video data. The recorded data includes video of the physical path of movement.

[2234] Step 7:

[2235] The device sends video data of the travel route to the server. The server analyzes this video data using a generative AI model. The analysis prompt is, "Travel route data: - Starting point: Entrance - Route: Aisle 1 -> Aisle 2 -> Machine A - Time: 2023-10-11 09:00 Analysis task: Evaluate the efficiency of this route and suggest improvements."

[2236] Step 8:

[2237] The server uses a generative AI model to generate route efficiency and improvement suggestions. The analysis results include a route efficiency score, the presence of obstacles, and suggested improvements.

[2238] Step 9:

[2239] The server sends the analysis results back to the device, and the output data includes an efficiency score and details of improvement suggestions.

[2240] Step 10:

[2241] The terminal visually displays the analysis results to the user, who can then optimize their next delivery route based on the displayed analysis results.

[2242] Step 11:

[2243] Bluetooth devices are attached to items in the factory, and the terminal receives the signals to acquire the item's location information, which is then sent to the server. The location data includes the item's current location.

[2244] Step 12:

[2245] The server analyzes the location data in real time and notifies the user of the item's current location, allowing the user to quickly find the item.

[2246] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2247] The present invention further improves the user experience by incorporating an emotion engine that analyzes the user's emotions in an integrated system for enriching the golfing life. Specific functions and processing flow are explained below.

[2248] 1. Golf course reservation function

[2249] The user uses a terminal to input budget and location criteria. This information is sent from the terminal to the server, which then searches the database for matching golf courses. The results are sent back to the terminal, which displays them to the user. The user can then select the most suitable golf course and make a reservation. For example, a list of the most suitable golf courses within Kyoto City with a budget of 10,000 yen or less is displayed.

[2250] 2. Golf swing analysis function

[2251] The user uses the device's camera to film their swing and sends the video data to the server. The server uses an AI model to evaluate the swing and suggest areas for improvement. The analysis results are sent back to the device and displayed to the user. For example, when a user films their swing, the server analyzes the swing's angle and speed and provides an evaluation along with suggestions for improvement.

[2252] 3. Ball position tracking function

[2253] The user hits the ball using a golf ball equipped with a built-in Bluetooth chip. The device receives the Bluetooth signal from the ball and sends the location data to the server. The server analyzes the data and plots the ball's location on a map. The result is sent back to the device, allowing the user to easily find the ball. For example, when the user hits the golf ball, the ball's current location is displayed on a map.

[2254] 4. Golf equipment recommendation function

[2255] The user uses the device to enter criteria such as budget and genre, and sends that information to the server. The server searches the database for suitable golf equipment and returns the results to the device. The device then displays recommended products to the user and provides a purchase link. For example, if a user looking to purchase a new driver searches for items under 30,000 yen, a list of optimal products will be displayed and a purchase link will be provided.

[2256] 5. Emotion engine integration

[2257] This system incorporates an emotion engine that analyzes the user's emotions. The emotion engine recognizes emotions by analyzing the user's facial expressions and voice, and transmits this emotion data to the server.

[2258] Using emotion engines for golf course reservations

[2259] When a user is checking the results of a golf course search, the emotion engine analyzes the user's facial expressions and voice to obtain emotional data. Based on this emotional data, the server prioritizes recommendations of golf courses that are likely to satisfy the user, providing a more personalized service.

[2260] Using an Emotion Engine in Golf Swing Analysis

[2261] During swing analysis, the system checks the user's emotional state and provides advice tailored to their state, such as whether they are tense or relaxed. For example, if the user is tense, it can suggest simple stretching techniques to help them relax.

[2262] Using an Emotion Engine for Golf Equipment Recommendation

[2263] When displaying search results for golf equipment, if a user is excited or satisfied with a particular product, the app will show more of that type of product, along with promotions and discounts to entice the user to make a purchase.

[2264] Program processing explanation

[2265] Linking emotion engines with golf course reservations

[2266] When a user searches for golf courses, the device uses a camera and microphone to transmit the user's facial expressions and voice to the emotion engine. The emotion engine analyzes this in real time and transmits the emotion data to the server. The server uses the emotion data to generate search results that prioritize the results that will satisfy the user.

[2267] Linking the Emotion Engine and Swing Analysis

[2268] While recording video of the swing, the device simultaneously uses an emotion engine to grasp the user's emotional state. The server combines the swing analysis results with the emotional data to generate advice appropriate to the user's emotional state and sends it to the device.

[2269] Collaboration between emotion engine and golf equipment recommendation

[2270] When a user searches for golf equipment, the device uses an emotion engine to analyze the user's facial expressions and voice. Based on this, the server creates a list of products that the user is likely to be interested in, and also sends promotional information to increase the user's motivation to purchase. The device displays this to the user.

[2271] With the above mechanism, the system of the present invention can provide a more highly personalized service based on the user's emotions, and can significantly improve golfer satisfaction.

[2272] The processing flow will be explained below.

[2273] Processing steps of emotion engine for golf course reservations

[2274] Example: Golf course recommendation using emotion data

[2275] Step 1:

[2276] The user uses a device to open a golf course search screen and enters the budget and location (e.g., Kyoto City, budget within 10,000 yen).

[2277] Step 2:

[2278] Before the device sends input data to the server, it activates the camera and microphone to collect the user's facial expressions and voice.

[2279] Step 3:

[2280] The facial expression and voice data collected by the device is sent to an internal emotion engine, which performs emotion analysis in real time.

[2281] Step 4:

[2282] The emotion engine analyzes the user's emotion data and identifies their emotional state (e.g., happy, excited, nervous, indifferent).

[2283] Step 5:

[2284] The device transmits the emotional state data and search conditions to the server.

[2285] Step 6:

[2286] Based on the emotional state data and search conditions received by the server, a search is made for golf courses that match the conditions from the database.

[2287] Step 7:

[2288] The server prioritizes the search results according to the emotional state and generates a list of golf courses in descending order of priority.

[2289] Step 8:

[2290] The server returns the prioritized list of golf courses to the terminal.

[2291] Step 9:

[2292] The terminal displays the received golf course list to the user, who then checks the list, selects a golf course that satisfies the user, and makes a reservation.

[2293] Processing steps of the emotion engine in golf swing analysis

[2294] Example: Swing improvement advice using emotional data

[2295] Step 1:

[2296] The user starts the swing analysis mode using the terminal and captures the swing motion with the camera.

[2297] Step 2:

[2298] The device collects the user's facial expressions and voice using a camera and microphone at the same time as the swing video data.

[2299] Step 3:

[2300] The terminal transmits the collected swing video data and emotion data to a server.

[2301] Step 4:

[2302] The server analyzes the swing video data using an AI model and generates an evaluation score and areas for improvement in the swing.

[2303] Step 5:

[2304] The server analyzes the emotional data to determine the user's current emotional state (e.g., tense, relaxed, focused).

[2305] Step 6:

[2306] The server combines the swing analysis results with the user's emotional state to generate optimal improvement advice according to the emotional state.

[2307] Step 7:

[2308] The server transmits the generated improvement advice to the terminal.

[2309] Step 8:

[2310] The device displays the received improvement advice to the user. For example, if the user is feeling tense, the device suggests ways to relax.

[2311] Processing step of emotion engine for ball position tracking

[2312] Example: Providing ball position information using emotion data

[2313] Step 1:

[2314] The user hits the ball using a golf ball with a built-in Bluetooth chip.

[2315] Step 2:

[2316] The device receives the Bluetooth ball's signal and collects its location data.

[2317] Step 3:

[2318] Along with the location data collected by the device, the camera and microphone are used to send the user's facial expressions and voice to the emotion engine for emotion analysis.

[2319] Step 4:

[2320] An emotion engine identifies emotional states (e.g., anxiety, excitement).

[2321] Step 5:

[2322] The device transmits emotion data and location data to the server.

[2323] Step 6:

[2324] The server analyzes the location data and plots the ball's location on a map.

[2325] Step 7:

[2326] The server generates appropriate behavioral advice (e.g., breathing techniques to stay calm) based on the plotted ball position and emotional state.

[2327] Step 8:

[2328] The server sends ball position information and action advice to the terminal.

[2329] Step 9:

[2330] The terminal displays the received ball position information and action advice to the user.

[2331] Processing steps of emotion engine for golf equipment recommendation

[2332] Example: Product recommendation using emotional data

[2333] Step 1:

[2334] The user uses a terminal to input search criteria for golf equipment (e.g., driver, budget within 30,000 yen).

[2335] Step 2:

[2336] Before the device sends input data to the server, it activates the camera and microphone to collect the user's facial expressions and voice.

[2337] Step 3:

[2338] The facial expression and voice data collected by the device is sent to an internal emotion engine, which performs emotion analysis in real time.

[2339] Step 4:

[2340] The emotion engine analyzes the user's emotion data and identifies their emotional state (e.g., excitement, satisfaction, hesitation).

[2341] Step 5:

[2342] The device transmits the emotional state data and search conditions to the server.

[2343] Step 6:

[2344] Based on the emotional state data and search conditions received by the server, a search is made for golf equipment that matches the conditions from the database.

[2345] Step 7:

[2346] The server prioritizes the search results according to the emotional state and generates a product list in descending order of priority.

[2347] Step 8:

[2348] The server returns the prioritized product list and promotion information to the terminal.

[2349] Step 9:

[2350] The terminal displays the received product list and promotion information to the user, who then checks the list and purchases any products that interest them.

[2351] Through the above process, highly personalized services can be provided based on the user's emotions, and golfer satisfaction can be significantly improved.

[2352] Example 2

[2353] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2354] Conventional golf-related systems have been limited to providing simple information and advice without considering the user's emotions. This has prevented them from improving user satisfaction and the quality of their experience. Furthermore, the accuracy of ball tracking and real-time swing analysis has been insufficient. This has made it difficult to provide more personalized services for golfers.

[2355] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2356] In this invention, the server includes a means for recommending the most suitable facility based on budget and location conditions, a means for analyzing video of the movement and recommending improvements in real time, a means for tracking the location using an object with a built-in communication device, a means for recommending products based on budget and genre conditions, and a means for analyzing user emotion data and providing optimal recommendations, thereby enabling the provision of more highly personalized services based on the user's emotions.

[2357] "Means for recommending optimal facilities based on budget and location conditions" is a function that searches for relevant facilities from a database based on the budget and geographical conditions entered by the user, and presents the optimal candidates to the user.

[2358] "Means of analyzing video of movements and recommending areas for improvement in real time" refers to a function in which a user sends video footage taken using a device to a server, which then analyzes the video using an AI model and immediately presents areas for improvement to the user.

[2359] "Means for tracking location using an object with a built-in communication device" refers to a function in which a terminal receives signals emitted from a specific object with a built-in communication device (e.g., a golf ball with a built-in Bluetooth chip), transmits the location information to a server for analysis, and displays the current location of the object on a map.

[2360] "Means for recommending products based on budget and genre conditions" is a function that searches for relevant products from a database based on the budget and product genre entered by the user, and presents the most suitable candidates to the user.

[2361] "Means for analyzing user emotional data and providing optimal recommendations" refers to a function that generates emotional data using an emotion engine that analyzes the user's facial expressions and voice, and then the server analyzes that data to provide more personalized recommendations to the user.

[2362] This invention relates to a golf-related system that analyzes a user's emotional data and makes personalized recommendations based on that data. Specifically, the system integrates functions such as recommending golf courses based on budget and location, analyzing video of a swing and providing real-time suggestions for improvement, tracking the ball's position using a golf ball with a built-in communication device, recommending optimal golf equipment based on budget and genre, and analyzing the user's emotional data to provide personalized recommendations.

[2363] Golf course reservation function

[2364] The system begins when a user uses a terminal to input budget and location criteria. The terminal then sends this information to a server. The server then searches the database for relevant golf courses and returns the results to the terminal. For example, if a user searches for golf courses in Kyoto City that cost less than 10,000 yen, a list of golf courses that meet those criteria will be displayed on the terminal.

[2365] Golf swing analysis function

[2366] The user uses the device's camera to record their swing and sends the video data to the server. The server then uses an AI model to analyze the video and generate an evaluation and suggestions for improvement. The results are then sent back to the device and displayed for the user to review. For example, the server can analyze the user's swing angle and speed and suggest areas for improvement.

[2367] Ball position tracking function

[2368] It works by having the user use a golf ball with a built-in Bluetooth chip. The device receives the Bluetooth signal from the golf ball and sends the location data to the server. The server analyzes the location data and plots the ball's location on a map. The results are sent back to the device and displayed so that the user can easily check them. Specifically, when the user hits the ball, the ball's current location is displayed on a map.

[2369] Golf equipment recommendation function

[2370] The user uses the device to input their budget and category (for example, a new driver) and sends that information to the server. The server searches for suitable products from the database and sends the results back to the device. The device then displays recommended products to the user and provides a purchase link. For example, if a user searches for a new driver under 30,000 yen, a list of the most suitable products is displayed and a purchase link is provided.

[2371] Emotion engine integration

[2372] This system uses an emotion engine to provide more personalized services. The camera and microphone collect the user's facial expressions and voice, which are then analyzed in real time. The emotion data is sent to the server, which then generates results based on that data to increase user satisfaction.

[2373] Linking emotion engines with golf course reservations

[2374] While the user is checking the results of their golf course search, the device uses a camera and microphone to transmit the user's facial expressions and voice to the emotion engine. The emotion engine analyzes the data in real time and sends the emotion data to the server. The server then uses the emotion data to prioritize and recommend golf courses that the user is likely to be satisfied with.

[2375] Linking the Emotion Engine and Swing Analysis

[2376] While recording video of the swing, the device simultaneously uses an emotion engine to grasp the user's emotional state. The server combines the swing analysis results with the emotional data to generate advice appropriate to the user's emotional state and sends it to the device.

[2377] Collaboration between emotion engine and golf equipment recommendation

[2378] When a user searches for golf equipment, the device uses an emotion engine to analyze the user's facial expressions and voice. Based on this, the server creates a list of products that the user is likely to be interested in, and also sends promotional information to increase the user's motivation to purchase. The device displays this to the user.

[2379] Examples of prompt statements

[2380] "Describe a system that tracks the location of a golf ball as it is being hit. The system uses a golf ball with a built-in communication device and a terminal to track the location data."

[2381] As described above, the system of the present invention can provide a more highly personalized service based on the user's emotions, thereby significantly improving golfer satisfaction.

[2382] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2383] Golf course reservation function

[2384] Step 1:

[2385] The user inputs budget and location requirements into the device. Specifically, on the application screen, the user selects "Kyoto City" and "Under 10,000 yen" and presses the search button.

[2386] Input: User-entered budget and location criteria.

[2387] Output: The terminal generates the search criteria.

[2388] Step 2:

[2389] The device sends search criteria to the server, and sends data to the server's API endpoint using an HTTP request.

[2390] Input: Terminal-generated search criteria.

[2391] Output: The search criteria data received by the server.

[2392] Step 3: 【2...

Claims

1. A means of recommending the best golf courses based on budget and location criteria; A method to analyze video of swing movements and recommend areas for improvement in real time, a means for tracking ball location using a golf ball with a built-in Bluetooth chip; A means of recommending golf equipment based on budget and genre criteria, A system including:

2. means for receiving data entered by a user and transmitting it to a server; The server includes a means for searching the database for golf courses that match the conditions and returning the results to the terminal. The system of claim 1 .

3. A method for analyzing video of swing movements using an AI model to generate an evaluation score and areas for improvement; including a means for visually displaying the results of the analysis to the user; The system of claim 1 .

4. means for receiving Bluetooth signals to collect location data and transmit the data to a server; means for the server to process the location data and display the exact location of the ball on a map; The system of claim 1 .

5. A way to search for golf equipment from a database based on budget and genre and present the results to users. including a means to provide a link to purchase the product; The system of claim 1 .

Images