system

Abstract

Provide a system. A method for acquiring course information from a golf course database; A means for obtaining real-time weather data from a weather information API; a means for acquiring user location information and generating optimal shot advice based on course information and weather data; means for displaying the shot advice to a user; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Golf players need a way to easily obtain information about the course, weather, and turf conditions to develop appropriate strategies while playing. Furthermore, there is a lack of a way to obtain appropriate feedback on the swing techniques of professional golfers during practice. Currently, these types of information must be handled separately, and there is no system that can efficiently obtain and analyze the information and provide real-time advice. [Means for solving the problem]

[0005] The present invention solves the above-mentioned problems by providing a system including: means for acquiring course information from a golf course database; means for acquiring real-time weather data from a weather information API; means for acquiring a user's location information and generating optimal shot advice based on the course information and weather data; and means for displaying the shot advice to the user. The system also includes means for referencing swing data from professional golfers and comparing it with the user's swing data, means for generating swing improvement advice based on the comparison results, and means for displaying the swing improvement advice to the user. The system also includes means for recording and analyzing the user's score data, generating strategy advice for specific holes, and means for displaying the strategy advice to the user. This configuration allows users to enjoy golf while receiving appropriate advice in real time, thereby efficiently improving their skills.

[0006] A "golf course database" is an electronic data storage device that stores various information about golf courses.

[0007] "Course information" refers to detailed information about a golf course, such as its layout, distances, par threes, bunker locations, and designer.

[0008] A "weather information API" is an application programming interface that provides real-time weather data over the Internet.

[0009] "Real-time weather data" refers to the latest information about current weather conditions (wind speed, wind direction, temperature, probability of precipitation, etc.).

[0010] "User location information" is data for identifying the user's current location, and is usually obtained using GPS.

[0011] "Shot advice" refers to specific advice that instructs a golf player on which club to use next and how to execute the shot.

[0012] "Professional golfer swing data" refers to technical data about a professional golfer's swing (swing speed, angle, direction, etc.).

[0013] "Swing improvement advice" refers to specific advice provided to a user to improve their swing.

[0014] "User score data" refers to a record of a golf player's past scores and performance.

[0015] "Strategic advice" means planned advice that indicates how to play a particular hole. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8]FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram illustrating a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] The present invention is a system for providing advanced caddie services to golf players. Specific embodiments of the system will be described below.

[0038] Collection and display of golf course information

[0039] Obtaining golf course information

[0040] The user selects a golf course on a device (smartphone, tablet, etc.).

[0041] The terminal transmits the identification information of the selected golf course to the server.

[0042] The server retrieves detailed course information (distance, par three, bunker location, designer information, etc.) from the database.

[0043] The server transmits the acquired course information to the terminal.

[0044] The terminal displays the received course information to the user.

[0045] Acquire and display weather conditions and turf conditions

[0046] Obtaining weather data

[0047] The server calls the weather information API to obtain real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.) around the golf course.

[0048] The server transmits the weather data to the terminal.

[0049] The terminal displays this weather data to the user.

[0050] Get the grass condition

[0051] The server collects information about the length and condition of the grass provided by the golf course superintendent.

[0052] The server transmits the grass condition data to the terminal.

[0053] The terminal displays this grass condition data to the user.

[0054] Providing shot advice

[0055] Shot advice generation

[0056] The device obtains the user's location information via GPS and identifies the hole where the shot is planned to be taken.

[0057] The server generates optimal shot advice based on the acquired weather data and the user's location information. For example, it provides advice on the appropriate club selection and shot direction based on wind speed and direction.

[0058] The server transmits the generated shot advice to the terminal.

[0059] The terminal displays shot advice to the user.

[0060] Providing mental support

[0061] Mental support generation

[0062] The device monitors the user's playing status and evaluates past score data and current score.

[0063] Based on this, the server automatically generates messages of encouragement and comfort.

[0064] The server transmits the generated mental support message to the terminal.

[0065] The terminal displays these messages to the user.

[0066] Providing feedback during practice

[0067] Swing data acquisition and analysis

[0068] The user selects the practice mode.

[0069] The device collects the user's swing data (swing speed, angle, direction) in real time using a sensor (such as a smart swing analyzer).

[0070] The terminal transmits the acquired swing data to the server.

[0071] Feedback Generation

[0072] The server compares the swing data of the professional golfer with the swing data of the user.

[0073] The server generates swing improvement advice based on the comparison results. For example, if the swing speed is slow, the server will give specific advice such as "Turn your hips more to increase your swing speed."

[0074] The server transmits the generated swing improvement advice to the terminal.

[0075] The terminal displays swing improvement advice to the user.

[0076] Specific examples

[0077] For example, if a user wants to play at a golf course, he or she first selects the golf course. The terminal then requests information about the course from the server, which then retrieves detailed course information from the database and sends it to the terminal, which then displays it to the user.

[0078] The server also retrieves real-time weather data from a weather information API and collects information about the condition of the turf from the golf course manager, which is also sent to the device and displayed for the user to review.

[0079] After that, when the user takes a shot, the device generates and provides optimal shot advice based on the user's location information. The system also automatically provides psychological support to the user while they play.

[0080] During practice, the device captures swing data every time the user takes a swing and compares it with data from professional golfers to provide feedback, allowing the user to efficiently improve their swing technique.

[0081] The processing flow will be explained below.

[0082] Collection and display of golf course information

[0083] Step 1:

[0084] The user operates the terminal and selects the course to play from the golf course selection menu.

[0085] Step 2:

[0086] The terminal transmits the identification information (such as an ID) of the selected golf course to the server.

[0087] Step 3:

[0088] The server uses the received course ID to retrieve detailed information about the course from the database.

[0089] Step 4:

[0090] The server sends the detailed course information (distance, par three, bunker location, designer information, etc.) to the terminal.

[0091] Step 5:

[0092] The device analyzes the course information it receives and displays it on the screen.

[0093] Acquire and display weather conditions and turf conditions

[0094] Step 1:

[0095] The server calls a specific weather information API to obtain real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.) around the golf course.

[0096] Step 2:

[0097] The server also sends a request to the golf course superintendent's system to collect turf length and condition information provided by the superintendent.

[0098] Step 3:

[0099] The server integrates the weather data and grass information it has acquired and sends it to the terminal.

[0100] Step 4:

[0101] The terminal displays weather data and turf information to the user in real time.

[0102] Providing shot advice

[0103] Step 1:

[0104] The device uses its GPS function to obtain the user's current location and, based on this, identifies the hole on which the shot is to be taken.

[0105] Step 2:

[0106] The server generates optimal shot advice based on the user's location and weather data, such as calculating club selection and shot direction taking into account the effects of wind.

[0107] Step 3:

[0108] The server transmits the generated shot advice to the terminal.

[0109] Step 4:

[0110] The terminal displays shot advice to the user.

[0111] Providing mental support

[0112] Step 1:

[0113] The device monitors the user's playing status (score and success of shots).

[0114] Step 2:

[0115] The server receives the user's playing data and analyzes their current performance in comparison with past score data.

[0116] Step 3:

[0117] Based on the analysis, the server generates encouraging or comforting messages as needed, such as "You can recover on your next shot."

[0118] Step 4:

[0119] The server generates a message and sends it to the terminal.

[0120] Step 5:

[0121] The terminal displays a mental support message to the user.

[0122] Providing feedback during practice

[0123] Step 1:

[0124] The user selects practice mode on the device.

[0125] Step 2:

[0126] The device uses sensors to collect the user's swing data (swing speed, angle, direction, etc.) in real time.

[0127] Step 3:

[0128] The swing data acquired by the terminal is transmitted to the server.

[0129] Step 4:

[0130] The server analyzes the user's swing by comparing it with a database of swings from professional golfers.

[0131] Step 5:

[0132] Based on the comparison results, the server generates swing improvement advice for the user, such as "make your backswing a little higher."

[0133] Step 6:

[0134] The server transmits the generated swing improvement advice to the terminal.

[0135] Step 7:

[0136] The terminal displays swing improvement advice to the user.

[0137] Example 1

[0138] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0139] For golf players, obtaining course information and weather data in real time and receiving optimal shot advice while playing is essential to improving their scores. However, with current technology, players must individually check course information, weather data, and turf conditions, which takes time and effort to receive appropriate shot advice. Furthermore, there is a lack of ways to compare one's own swing data with that of professional golfers, making efficient practice difficult. Furthermore, there is a lack of mental support during play, making it difficult for players to maintain motivation. There is a need for an advanced caddie service that can solve these issues and provide consistent support to golf players.

[0140] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0141] In this invention, the server includes means for acquiring course information from a golf course database, means for acquiring real-time weather data from a weather information API, means for acquiring user location information and generating optimal shot advice based on the course information and weather data, means for collecting turf condition data from golf course managers, means for evaluating past score data and current score data and generating mental support messages, and means for referencing swing data of professional golfers and comparing it with the user's swing data. This makes it possible to provide the user with optimal shot advice, turf condition information, and mental support messages in real time, as well as swing improvement advice during practice based on comparison with professional golfer data.

[0142] A "golf course database" is a structured data store that stores detailed information about golf courses (distances, par threes, bunker locations, designer information, etc.).

[0143] The "Weather Information API" is an application programming interface for obtaining real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.).

[0144] "User location information" is GPS data that indicates the user's current location.

[0145] "Optimal shot advice" refers to instructions on the best shot and club selection that a user should take based on golf course information, weather data, and the like.

[0146] "Turf condition data" is information about the length and health of the grass on a golf course.

[0147] "Mental support messages" are words of encouragement and comfort provided to keep users motivated.

[0148] "Professional golfer swing data" refers to motion data (swing speed, angle, direction, etc.) of a professional golfer when swinging.

[0149] "User swing data" refers to motion data (swing speed, angle, direction, etc.) when the user swings.

[0150] The "comparison result" is an evaluation when comparing the swing data of a professional golfer with the swing data of the user.

[0151] "Swing improvement advice" is specific instructions for the user to improve their swing based on the results of comparing the user's swing data with swing data of a professional golfer.

[0152] "Strategic advice" is an instruction that suggests an effective strategy for a particular hole based on the user's score data.

[0153] This invention is a system that provides advanced caddie services to golf players. Specifically, it includes functions such as collecting and displaying golf course information, acquiring and displaying weather conditions and turf conditions, providing shot advice, providing mental support, and providing feedback during practice. Each process in this system is performed in real time between the server, the terminal, and the user.

[0154] First, a user selects a golf course using a device such as a smartphone or tablet. The device sends identification information for the selected golf course to a server, which then retrieves the course information from a database. In terms of specific hardware, in the first processing step, the device communicates with the server using an HTTP request, and the server retrieves the information using a relational database management system (RDBMS). The retrieved information is then sent to the device, which displays it to the user.

[0155] The server then calls a weather information API to obtain real-time weather data for the area around the golf course. The server then queries the weather information API, again using the HTTP protocol, and transmits the obtained data back to the terminal. In this invention, existing weather information APIs, such as the OpenWeatherMap API, can be used. The terminal analyzes this weather data and visually displays it to the user. The server also collects turf condition data from the golf course manager. This data is also transmitted to the terminal, where it can be viewed by the user.

[0156] When a user takes a shot, the device uses its GPS function to obtain the user's location. Based on this location information and previously obtained weather and course information, the server generates optimal shot advice. Using a generative AI model, data such as wind speed, direction, and distance is analyzed to generate specific advice on club selection and shot direction. For example, advice such as "The wind speed is 5 m / s blowing from east to west. Aim 8 yards to the right with a 7 iron" is displayed.

[0157] Furthermore, the system automatically generates mental support messages by monitoring the user's playing status and evaluating past and current score data. The server uses a generative AI model to generate encouraging and comforting messages and sends them to the device. For example, a message such as "You're doing well in the first half, so keep it up and do your best in the second half" is displayed.

[0158] When practicing, if the user selects practice mode, the device will use a sensor (e.g., a smart swing analyzer) to collect the user's swing data in real time. This data will be sent to a server and compared with swing data from professional golfers. Based on the comparison results, the server will generate swing improvement advice for the user. For example, specific advice such as "Your swing speed is slow, so try rotating your hips more to increase your swing speed" will be displayed on the device.

[0159] Specific examples

[0160] For example, if a user wants to play at a golf course, they first launch the app and select the golf course. The device sends the selection to the server, which then retrieves detailed course information from a database and sends it to the device. The device then displays this information to the user. At the same time, the server retrieves real-time weather data from a weather information API and collects information about the turf condition from the golf course manager. This information is also sent to the device and displayed for the user to review. Then, when the user takes a shot, the device generates optimal shot advice based on the user's location and provides this advice to the user. The system also automatically generates support messages based on the user's mental state during play and displays them to the user. During practice, the device collects swing data every time the user takes a swing and compares it with data from professional golfers to provide feedback. This allows users to efficiently improve their swing technique.

[0161] Prompt Sentence Examples

[0162] "Please explain the system that allows users to select golf practice mode, acquire and analyze swing data, and provide swing improvement advice."

[0163] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0164] Step 1:

[0165] The user selects a golf course on a device (smartphone, tablet, etc.).

[0166] Input: The user interacts with the app's interface and selects the golf course they want to play.

[0167] Action: The user interacts with a drop-down menu, search bar, or selection feature on a map.

[0168] Output: Identification information (ID, name, etc.) of the selected golf course.

[0169] Step 2:

[0170] The terminal transmits the identification information of the selected golf course to the server.

[0171] Input: The identification of the selected golf course.

[0172] How it works: The device sends the identification information of the selected golf course to the server using an HTTP request.

[0173] Output: The request data sent to the server.

[0174] Step 3:

[0175] The server retrieves detailed course information (distance, par three, bunker location, designer information, etc.) from the database.

[0176] Input: Golf course identification.

[0177] How it works: The server queries the RDBMS to extract detailed course information.

[0178] Output: Golf course details are retrieved on the server.

[0179] Step 4:

[0180] The server transmits the acquired course information to the terminal.

[0181] Input: Golf course details.

[0182] Operation: The server converts the acquired course information into JSON format and sends it to the device as an HTTP response.

[0183] Output: JSON data of the course information sent to the device.

[0184] Step 5:

[0185] The terminal displays the received course information to the user.

[0186] Input: JSON data with golf course details.

[0187] How it works: The device parses the JSON data and displays it to the user in a visually friendly format.

[0188] Output: Detailed golf course information displayed to the user (layout diagram, hole-by-hole information, etc.).

[0189] Step 6:

[0190] The server calls the weather information API to obtain real-time weather data around the golf course.

[0191] Input: Latitude and longitude information of the golf course.

[0192] How it works: The server queries the weather API endpoint to retrieve weather data.

[0193] Output: Real-time weather data retrieved from the API.

[0194] Step 7:

[0195] The server sends the weather data to the device.

[0196] Input: Weather data.

[0197] How it works: The server sends weather data in JSON format to the device.

[0198] Output: JSON data of the weather data sent to the device.

[0199] Step 8:

[0200] The terminal displays this weather data to the user.

[0201] Input: Weather data in JSON format.

[0202] How it works: The device parses the JSON data and displays it to the user in a visually friendly format.

[0203] Output: Weather information displayed to the user (wind speed, direction, temperature, chance of precipitation, etc.).

[0204] Step 9:

[0205] A server collects turf condition data from golf course managers.

[0206] Input: Information about the condition of the grass.

[0207] How it works: The server collects information through an upload interface for golf course managers.

[0208] Output: Grass condition data stored on the server.

[0209] Step 10:

[0210] The server sends the grass condition data to the terminal.

[0211] Input: Turf condition data.

[0212] How it works: The server sends grass status data in JSON format to the device.

[0213] Output: JSON data of the grass condition data sent to the terminal.

[0214] Step 11:

[0215] The terminal displays this grass condition data to the user.

[0216] Input: JSON data of grass condition data.

[0217] How it works: The device parses the JSON data and displays it to the user in a visually friendly format.

[0218] Output: Grass condition information (length, health, etc.) displayed to the user.

[0219] Step 12:

[0220] The device obtains the user's location information via GPS and identifies the hole where the shot is planned to be taken.

[0221] Input: User location (GPS data).

[0222] How it works: The device uses GPS to determine the user's current location and runs an algorithm to identify the specific hole.

[0223] Output: User's current location and identified hole information.

[0224] Step 13:

[0225] The server generates optimal shot advice based on weather data and the user's location information.

[0226] Input: Weather data, user location, course information.

[0227] How it works: The server uses a generative AI model to generate optimal shot advice based on input data.

[0228] Output: Shot advice generated.

[0229] Step 14:

[0230] The server transmits the generated shot advice to the terminal.

[0231] Input: Shot advice generation results.

[0232] How it works: The server converts the advice data into JSON format and sends it to the device.

[0233] Output: Shot advice data sent to the device.

[0234] Step 15:

[0235] The terminal displays shot advice to the user.

[0236] Input: Shot advice data.

[0237] How it works: The device parses the advice data and displays it to the user in a visually friendly format.

[0238] Output: Shot advice (club selection, shot direction, etc.) displayed to the user.

[0239] Step 16:

[0240] The device monitors the user's playing status and evaluates past score data and current score.

[0241] Input: User score data, playing status data.

[0242] Operation: The device records data locally and runs the evaluation algorithm.

[0243] Output: Evaluation result.

[0244] Step 17:

[0245] The server automatically generates a mental support message based on the evaluation results.

[0246] Input: Evaluation results, past score data.

[0247] How it works: The server uses a generative AI model to generate optimal mental support messages for each individual user.

[0248] Output: Mental support message.

[0249] Step 18:

[0250] A mental support message generated by the server is sent to the terminal.

[0251] Input: Mental support message.

[0252] Behavior: The server sends a mental support message in JSON format to the device.

[0253] Output: The emotional support message sent to the device.

[0254] Step 19:

[0255] The terminal displays these messages to the user.

[0256] Input: Mental support message.

[0257] What it does: The device parses the message and displays it in the form of a notification or a popup window.

[0258] Output: The emotional support message that will be displayed to the user.

[0259] Step 20:

[0260] The user selects the practice mode.

[0261] Input: User selection.

[0262] Action: The user selects Practice mode from the menu.

[0263] Output: Practice mode selection status.

[0264] Step 21:

[0265] The device uses sensors to collect the user's swing data (swing speed, angle, direction) in real time.

[0266] Input: The user's swing motion.

[0267] How it works: The sensor captures swing information and sends the data to your device.

[0268] Output: Swing data.

[0269] Step 22:

[0270] The swing data acquired by the terminal is transmitted to the server.

[0271] Input: Swing data.

[0272] Operation: The device sends swing data to the server.

[0273] Output: Swing data sent to the server.

[0274] Step 23:

[0275] The server compares the swing data of the professional golfer with the swing data of the user.

[0276] Input: User swing data, professional golfer swing data.

[0277] How it works: The server compares the user's data with the professional golfer data in its database.

[0278] Output: The comparison result.

[0279] Step 24:

[0280] The server generates swing improvement advice based on the comparison result.

[0281] Input: The comparison result.

[0282] How it works: The server uses a generative AI model to generate specific swing improvement advice.

[0283] Output: Swing improvement advice.

[0284] Step 25:

[0285] The server transmits the generated swing improvement advice to the terminal.

[0286] Enter: swing improvement advice.

[0287] How it works: The server sends advice in JSON format to the device.

[0288] Output: Swing improvement advice sent to the device.

[0289] Step 26:

[0290] The terminal displays swing improvement advice to the user.

[0291] Enter: swing improvement advice.

[0292] How it works: The device parses the advice and displays it in a visually friendly format.

[0293] Output: Swing improvement advice displayed to the user.

[0294] (Application example 1)

[0295] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0296] Conventional factory production line management has not been able to fully utilize environmental data and operator performance data, limiting its ability to improve work efficiency or provide psychological support. Another issue is the inability to provide optimal work advice in real time when the production environment fluctuates. A new system is needed to solve these problems, increase production line efficiency, and improve operator performance.

[0297] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0298] In this invention, the server includes a means for acquiring production line information from an industrial line database, a means for acquiring real-time environmental data from an industrial temperature sensor, and a means for generating work advice based on the operator's production efficiency data and environmental data. This makes it possible to provide optimal work advice based on the environmental data and performance data in real time, and also provide psychological support to the operator.

[0299] An "industrial line database" is a digital database for collectively recording and managing information about production lines within a factory.

[0300] "Production line information" is detailed data on the production processes within the factory, the operating status of production equipment, work procedures, work progress, etc.

[0301] An "industrial temperature sensor" is a sensor device that measures the temperature in a factory's working environment in real time and provides that data in digital format.

[0302] "Environmental data" refers to real-time data on the working environment within the factory, such as temperature, humidity, light intensity, and noise level.

[0303] "Operator" refers to workers and engineers who work directly on the production line.

[0304] "Production efficiency data" refers to data related to an operator's work efficiency and performance, such as information on work speed and production volume.

[0305] "Work advice" is advice that suggests optimal work methods and improvement measures to operators based on acquired environmental data and production efficiency data.

[0306] "Psychological support messages" are messages of psychological support and encouragement that are generated based on the operator's performance data.

[0307] The present invention is a production line assistant system that provides optimal work assistance and psychological support to operators working on production lines in a factory. Specific embodiments for realizing this system are described below.

[0308] Acquisition and display of production line information

[0309] The server retrieves production line information from the industrial line database. This information includes the production process, the operating status of production equipment, work procedures, work progress, etc. The server then sends this information to the terminal, which then displays it to the operator.

[0310] Acquiring and displaying environmental data

[0311] The server acquires real-time environmental data (temperature, humidity, illuminance, etc.) from environmental monitoring devices such as industrial temperature sensors. This data is also sent from the server to the terminal and displayed on the terminal for the operator to check.

[0312] Generation and display of work advice

[0313] The server generates optimal work advice based on the acquired production line information and environmental data. For example, if the temperature inside the factory is high, it generates advice to ask the operator to check the cooling system. The server sends this work advice to the terminal, which then displays it to the operator. This allows the operator to take appropriate action based on the current work environment.

[0314] Providing mental support

[0315] The server records and analyzes the operator's performance data (work efficiency, work speed, production volume, etc.) and automatically generates mental support messages. For example, for an operator whose work efficiency is declining, it generates a message such as "Take a short break and refresh yourself. You're doing a great job!" The server sends the generated mental support message to the terminal, which displays it to the operator.

[0316] Hardware and Software

[0317] To implement this system, the following hardware and software are used:

[0318] Hardware:

[0319] Industrial Temperature Sensors

[0320] Environmental Monitoring Devices

[0321] Terminals with human-machine interface (HMI)

[0322] software:

[0323] Database Management System (DBMS)

[0324] Software for making API calls

[0325] AI models for data analysis and advice generation

[0326] Specific examples

[0327] For example, if the temperature in a factory is rising, the server will receive real-time data from industrial temperature sensors and generate advice to the operator to check the cooling system. If work efficiency is declining, the server will generate a mental support message to the operator to take a break.

[0328] Example prompt sentence:

[0329] "The temperature in the factory is getting high, so please ask the operators to check the cooling system. Also, please send a message to operators whose work efficiency is declining, encouraging them to take a break."

[0330] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0331] Step 1:

[0332] The server retrieves production line information from the industrial line database. The input is a request to the database, and the output is production line information such as the production process, work procedures, and equipment operating status. The server sends this information to the terminal, which displays it to the operator.

[0333] Step 2:

[0334] The server acquires real-time environmental data (temperature, humidity, illuminance, etc.) from industrial temperature sensors. The input is the data acquired from the environmental sensors, and the output is real-time environmental information. The server sends this environmental data to the terminal, which displays it to the operator.

[0335] Step 3:

[0336] The server generates optimal work advice based on production line information and environmental data. The inputs are production line information and environmental data, and the output is work advice. For example, if the temperature is high, advice such as "Check the cooling system" is generated. The server sends this work advice to the terminal, which then displays it to the operator.

[0337] Step 4:

[0338] The server records and analyzes the operator's production efficiency data and generates mental support messages. The input is the operator's work efficiency data, and the output is a mental support message. For example, if work efficiency is declining, a message such as "Please take a short break and refresh yourself" is generated. The server sends this mental support message to the terminal, which then displays it to the operator.

[0339] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0340] The present invention is a system for providing advanced caddie services to golf players, and in particular, is combined with an emotion engine that recognizes the user's emotions. Specific embodiments of this system will be described below.

[0341] Collection and display of golf course information

[0342] Obtaining golf course information

[0343] The user operates the terminal and selects the course to play from the golf course selection menu.

[0344] The terminal transmits the identification information (such as an ID) of the selected golf course to the server.

[0345] The server uses the received course ID to retrieve detailed information about the course from the database.

[0346] The server sends the detailed course information (distance, par three, bunker location, designer information, etc.) to the terminal.

[0347] The device analyzes the course information it receives and displays it on the screen.

[0348] Acquire and display weather conditions and turf conditions

[0349] Obtaining weather data

[0350] The server calls a specific weather information API to obtain real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.) around the golf course.

[0351] The weather data acquired by the server is sent to the terminal.

[0352] The terminal displays weather data to the user in real time.

[0353] Get the grass condition

[0354] The server collects information on the length and condition of the grass provided by the golf course manager.

[0355] The server sends the grass information to the terminal.

[0356] The terminal displays the grass condition data to the user.

[0357] Providing shot advice

[0358] Shot advice generation

[0359] The device uses its GPS function to obtain the user's current location and, based on this, identifies the hole on which the shot is to be taken.

[0360] The server generates optimal shot advice based on the user's location and weather data, such as calculating club selection and shot direction taking into account the effects of wind.

[0361] The server transmits the generated shot advice to the terminal.

[0362] The terminal displays shot advice to the user.

[0363] Providing mental support using an emotion engine

[0364] Emotion Engine Operation

[0365] The device uses the user's facial recognition camera and voice analysis functions to analyze the user's facial expressions and tone of voice in real time to determine their emotional state.

[0366] The server analyzes the user's emotional data and generates mental support messages as needed. For example, if the user is nervous, it generates a message such as "Relax and take the shot with confidence."

[0367] A mental support message generated by the server is sent to the terminal.

[0368] The terminal displays a mental support message to the user.

[0369] Providing feedback during practice

[0370] Swing data acquisition and analysis

[0371] The user selects practice mode on the device.

[0372] The device uses sensors to collect the user's swing data (swing speed, angle, direction, etc.) in real time.

[0373] The swing data acquired by the terminal is transmitted to the server.

[0374] Feedback Generation

[0375] The server analyzes the user's swing by comparing it with a database of swings from professional golfers.

[0376] Based on the comparison results, the server generates swing improvement advice for the user, such as "make your backswing a little higher."

[0377] The server transmits the generated swing improvement advice to the terminal.

[0378] The terminal displays swing improvement advice to the user.

[0379] Specific examples

[0380] For example, if a user wants to play at a golf course, he or she first selects the golf course. The terminal then requests information about the course from the server, which then retrieves detailed course information from the database and sends it to the terminal, which then displays it to the user.

[0381] The server also retrieves real-time weather data from a weather information API and collects information about the condition of the turf from the golf course manager, which is also sent to the device and displayed for the user to review.

[0382] When the user takes a shot, the device generates and provides optimal shot advice based on the user's location information. It also uses a facial recognition camera and voice analysis functions to recognize the user's emotions and provide mental support according to their feelings.

[0383] During practice, the device collects swing data every time the user takes a swing and compares it with that of professional golfers to provide feedback. This allows users to efficiently improve their swing technique. Through this process, users can enjoy golf while receiving appropriate advice and mental support in real time.

[0384] The processing flow will be explained below.

[0385] Collection and display of golf course information

[0386] Step 1:

[0387] The user operates the terminal and selects the course to play from the golf course selection menu.

[0388] Step 2:

[0389] The terminal transmits the identification information (such as an ID) of the selected golf course to the server.

[0390] Step 3:

[0391] The server uses the received course ID to retrieve detailed information about the course from the database.

[0392] Step 4:

[0393] The server sends the detailed course information (distance, par three, bunker location, designer information, etc.) to the terminal.

[0394] Step 5:

[0395] The device analyzes the course information it receives and displays it on the screen.

[0396] Acquire and display weather conditions and turf conditions

[0397] Step 1:

[0398] The server calls a specific weather information API to obtain real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.) around the golf course.

[0399] Step 2:

[0400] The server sends the weather data to the device.

[0401] Step 3:

[0402] The terminal displays weather data to the user in real time.

[0403] Step 4:

[0404] The server collects information on the length and condition of the grass provided by the golf course manager.

[0405] Step 5:

[0406] The server sends the grass information to the terminal.

[0407] Step 6:

[0408] The terminal displays the grass condition data to the user.

[0409] Providing shot advice

[0410] Step 1:

[0411] The device uses its GPS function to obtain the user's current location and, based on this, identifies the hole on which the shot is to be taken.

[0412] Step 2:

[0413] The server generates optimal shot advice based on the user's location and weather data, for example, calculating club selection and shot direction taking into account the effects of wind.

[0414] Step 3:

[0415] The server transmits the generated shot advice to the terminal.

[0416] Step 4:

[0417] The terminal displays shot advice to the user.

[0418] Providing mental support using an emotion engine

[0419] Step 1:

[0420] The device uses the user's facial recognition camera and voice analysis functions to analyze the user's facial expressions and tone of voice in real time to determine their emotional state.

[0421] Step 2:

[0422] The terminal transmits the acquired user emotion data to the server.

[0423] Step 3:

[0424] The server analyzes the user's emotional data and generates mental support messages as needed. For example, if the user is nervous, it generates a message such as "Relax and take the shot with confidence."

[0425] Step 4:

[0426] A mental support message generated by the server is sent to the terminal.

[0427] Step 5:

[0428] The terminal displays a mental support message to the user.

[0429] Providing feedback during practice

[0430] Step 1:

[0431] The user selects practice mode on the device.

[0432] Step 2:

[0433] The device uses sensors to collect the user's swing data (swing speed, angle, direction, etc.) in real time.

[0434] Step 3:

[0435] The swing data acquired by the terminal is transmitted to the server.

[0436] Step 4:

[0437] The server analyzes the user's swing by comparing it with a database of swings from professional golfers.

[0438] Step 5:

[0439] Based on the comparison results, the server generates swing improvement advice for the user, such as "make your backswing a little higher."

[0440] Step 6:

[0441] The server transmits the generated swing improvement advice to the terminal.

[0442] Step 7:

[0443] The terminal displays swing improvement advice to the user.

[0444] Example 2

[0445] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0446] Golf players have difficulty quickly obtaining accurate course and weather information while playing. Furthermore, there are limited ways to effectively receive mental support tailored to the player's emotions and feedback on swing improvement. Conventional caddie services have difficulty providing this information and support in real time, and this invention aims to solve this problem.

[0447] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for the user to select a course to play from a golf course selection menu and the terminal to transmit identification information of the course to the server; means for the server to obtain detailed information about the selected golf course from a database and transmit it to the terminal; means for the server to obtain real-time weather data using a weather information API and transmit it to the terminal; means for the terminal to obtain the user's current location using a GPS and for the server to generate optimal shot advice based on the location information and weather data and transmit it to the terminal; means for the terminal to analyze the obtained detailed information about the golf course, weather data, and shot advice and display them on the screen; means for the server to determine the user's emotions in real time using a face recognition camera or a voice analysis function and generate a mental support message as needed; means for the terminal to display the mental support message to the user; means for the user to select a practice mode on the terminal and for the terminal to obtain swing data through a sensor and transmit it to the server; means for the server to compare the user's swing data with a database of professional golfers and generate swing improvement advice; and means for the terminal to display the swing improvement advice to the user. This will enable golf players to receive accurate course information, weather information, shot advice, emotional support, and feedback on swing improvement in real time.

[0448] "User" refers to a golf player who operates the system and receives various information and services.

[0449] A "terminal" is a device that is operated by a user and displays various information, and includes smartphones, tablet PCs, etc.

[0450] "Server" refers to a computer system that processes various data and transmits information to terminals.

[0451] "Golf course selection menu" refers to an interface that allows a user to select a golf course to play.

[0452] "Identification information" is information that uniquely identifies a particular golf course, and includes the course ID, name, etc.

[0453] "Database" refers to the data structure that stores detailed golf course information and is accessed by the server.

[0454] "Weather Information API" means an application programming interface that provides real-time weather data for a specific location.

[0455] "GPS" refers to a satellite system for obtaining geographic location information.

[0456] "Shot advice" refers to information that suggests the optimal club selection and shot direction when the user hits a golf ball.

[0457] A "face recognition camera" refers to a camera system that analyzes a user's facial expressions.

[0458] "Voice analysis function" refers to technology that analyzes the tone of a user's voice and determines their emotional state.

[0459] "Mental support messages" refer to messages containing encouragement or advice that are generated according to the user's emotional state.

[0460] "Practice mode" refers to the operating mode of the system used by a user to practice their golf swing.

[0461] "Sensor" refers to a device for acquiring user swing data in real time.

[0462] "Swing data" refers to data such as the speed, angle, and direction of a user's golf swing.

[0463] "Professional golfer database" refers to a database that stores swing data of professional golfers and compares it with the user's swing data.

[0464] "Swing improvement advice" refers to specific suggestions for improving the user's swing.

[0465] The present invention is a system for providing advanced caddie services to golf players, including golf course information, real-time weather data, turf conditions, shot advice, emotional support, and swing improvement feedback. Specific embodiments of the system are described below.

[0466] Collection and display of golf course information

[0467] First, the user operates the device to select the course to play from the golf course selection menu. The device then sends the identification information (such as ID) of that course to the server. The server then retrieves detailed information about the corresponding course from a database based on the received course ID. This information includes distance, par three, bunker location, and designer information. The retrieved course information is then sent from the server to the device, which then displays it. The device then uses HTML5 and JavaScript (registered trademark) to display the information on a user interface.

[0468] Acquire and display weather conditions and turf conditions

[0469] The server calls a specific weather information API (e.g., OpenWeatherMap API) to obtain real-time weather data around the golf course. This data includes wind speed, wind direction, temperature, and chance of precipitation. The server sends the obtained weather data to the terminal, which then displays the weather data to the user in real time. A graphical UI component (e.g., Chart.js) is used for display. In addition, the server collects information about the length and condition of the grass from the golf course manager and sends it to the terminal. The terminal displays this information to the user.

[0470] Providing shot advice

[0471] When a user takes a shot, the device uses its GPS to obtain the user's current location. The server generates optimal shot advice based on the location information and weather data. This advice is generated using a machine learning model (e.g., TENSORFLOW (registered trademark)) to calculate club selection and shot direction taking into account the effects of wind. The generated shot advice is sent from the server to the device and displayed on the device.

[0472] Providing mental support using an emotion engine

[0473] The device uses the user's facial recognition camera and voice analysis functions (e.g., OpenCV and Google® Speech-to-Text API) to analyze the user's facial expressions and tone of voice in real time to determine their emotional state. The server analyzes this emotional data and generates mental support messages as needed. For example, if the user is nervous, it generates a message such as "Relax and take the shot with confidence." The generated mental support message is sent from the server to the device and displayed on the device. It can be displayed in both text and voice.

[0474] Providing feedback during practice

[0475] The user selects practice mode on the device, and the device acquires the user's swing data through a sensor (e.g., a motion capture sensor). The acquired swing data is sent from the device to a server, which compares the user's swing data with a database of professional golfers. Based on the comparison results, the server generates swing improvement advice for the user. For example, it provides specific advice such as "make your backswing a little higher." The generated swing improvement advice is sent from the server to the device and displayed on the device. This display can use 3D animation to demonstrate the correct swing movement.

[0476] Specific examples

[0477] For example, if a user wants to play at a golf course, they first select the golf course. The device requests information about that course from the server, which retrieves detailed course information from a database and sends it to the device. The device then displays this to the user. The server also retrieves real-time weather data from a weather information API (e.g., OpenWeatherMap API) and collects information about the condition of the grass from the golf course manager. This information is also sent to the device and displayed for the user to review.

[0478] When the user takes a shot, the device generates and provides optimal shot advice based on the user's location information. It also uses a facial recognition camera and voice analysis functions to recognize the user's emotions and provides mental support according to their emotions.

[0479] During practice, the device collects swing data every time the user takes a swing and provides feedback by comparing it with data from professional golfers. This allows users to efficiently improve their swing technique. Through this process, users can enjoy golf while receiving appropriate advice and mental support in real time.

[0480] Example of input prompt for generative AI model

[0481] "This system provides advanced caddie services to golf players. Specifically, it includes golf course information, real-time weather data, turf conditions, shot advice, emotional mental support, and swing feedback. Please explain in detail the functions that provide all of the following: the golf course selected by the user and its detailed information, real-time weather data, generation and display of shot advice, emotional recognition and mental support for the user, and collection and analysis of swing data."

[0482] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0483] Step 1:

[0484] The user selects the course to play from the golf course selection menu.

[0485] Input: The user makes a selection on the device, selecting the golf course to play.

[0486] Output: ID and name of selected golf course

[0487] Specific operation: The terminal acquires the identification information of the golf course selected by the user's operation and transmits the selection result to the server.

[0488] Step 2:

[0489] The server retrieves the details of the selected golf course from the database.

[0490] Input: Golf course ID or name

[0491] Output: Detailed golf course information (distance, par three, bunker location, designer information, etc.)

[0492] Specific operation: The server executes a database query to obtain detailed information corresponding to the submitted golf course ID.

[0493] Step 3:

[0494] The server transmits the acquired detailed information about the golf course to the terminal.

[0495] Input: Golf course details

[0496] Output: Sending data to the terminal

[0497] Specific operation: The server converts the acquired data into a certain format (e.g., JSON) and sends it to the terminal.

[0498] Step 4:

[0499] The terminal displays detailed information about the golf course received.

[0500] Input: Golf course details sent from the server

[0501] Output: Course information displayed in the user interface

[0502] Specific operation: The device analyzes the received data using HTML5 and JavaScript and displays it in the user interface in map or text format.

[0503] Step 5:

[0504] The server uses a specific weather information API to obtain real-time weather data.

[0505] Input: Golf course location information

[0506] Output: Real-time weather data (wind speed, wind direction, temperature, precipitation probability, etc.)

[0507] What happens: The server sends a request to a weather information API (e.g., OpenWeatherMap API) to retrieve weather data based on the location of the golf course.

[0508] Step 6:

[0509] The weather data acquired by the server is sent to the terminal.

[0510] Input: Real-time weather data

[0511] Output: Sending data to the terminal

[0512] Specific operation: The server sends the acquired weather data to the terminal in JSON format or similar.

[0513] Step 7:

[0514] The terminal displays the weather data to the user.

[0515] Input: Real-time weather data sent from the server

[0516] Output: Weather information displayed in the user interface

[0517] What it does: The device parses weather data and displays it visually using graphical UI components (e.g., Chart.js).

[0518] Step 8:

[0519] The device obtains the user's current location using the GPS function.

[0520] Input: GPS data of the device

[0521] Output: User's current location

[0522] Specific operation: The device uses the built-in GPS module to obtain the user's current location in real time and transmits the data to the server.

[0523] Step 9:

[0524] The server generates optimal shot advice based on location information and weather data.

[0525] Input: User location, real-time weather data

[0526] Output: Shot advice

[0527] How it works: The server uses machine learning models (e.g., TensorFlow) to calculate optimal club selection and shot direction based on the user's location and weather data.

[0528] Step 10:

[0529] The server transmits the generated shot advice to the terminal.

[0530] Input: Shot Advice

[0531] Output: Sending data to the terminal

[0532] Specific operation: The server sends the generated advice to the terminal in JSON format or similar.

[0533] Step 11:

[0534] The terminal displays shot advice to the user.

[0535] Input: Shot advice sent from the server

[0536] Output: Shot advice displayed in the user interface

[0537] Specific operation: The device analyzes the shot advice and displays it in the user interface as text or graphics.

[0538] Step 12:

[0539] The device uses a facial recognition camera and voice analysis functions to analyze the user's facial expressions and tone of voice in real time.

[0540] Input: User's face image data and voice data

[0541] Output: User's emotional state

[0542] Specific operation: The device analyzes the data using a facial recognition camera (e.g., OpenCV) and voice analysis functions (e.g., Google Speech-to-Text API) and sends the emotional state to the server.

[0543] Step 13:

[0544] The server analyzes the emotional data and generates a mental support message as needed.

[0545] Input: User emotion data

[0546] Output: Mental support message

[0547] Specific operation: The server analyzes the emotional data and generates an appropriate mental support message depending on whether the user is nervous or not.

[0548] Step 14:

[0549] A mental support message generated by the server is sent to the terminal.

[0550] Input: Mental support message

[0551] Output: Sending data to the terminal

[0552] Specific operation: The server sends the generated mental support message to the terminal in JSON format or similar.

[0553] Step 15:

[0554] The terminal displays a mental support message to the user.

[0555] Input: Mental support message sent from the server

[0556] Output: A mental support message displayed in the user interface.

[0557] Specific operation: The terminal displays a mental support message in text or voice on the user interface.

[0558] Step 16:

[0559] The user selects practice mode, and the device uses sensors to acquire swing data.

[0560] Input: User swing motion

[0561] Output: Swing data

[0562] Specific operation: The device uses motion capture sensors to obtain data such as swing speed, angle, and direction in real time, and then transmits this data to a server.

[0563] Step 17:

[0564] The server compares the user's swing data with a database of professional golfers and generates swing improvement advice.

[0565] Input: User swing data, professional golfer data

[0566] Output: Swing improvement advice

[0567] Specific operation: The server uses a comparison algorithm to analyze the user's data and the data of professional golfers and generates advice including areas for improvement.

[0568] Step 18:

[0569] The server transmits the generated swing improvement advice to the terminal.

[0570] Input: Swing improvement advice

[0571] Output: Sending data to the terminal

[0572] Specific operation: The server sends the generated advice to the terminal in JSON format or similar.

[0573] Step 19:

[0574] The terminal displays swing improvement advice to the user.

[0575] Input: Swing improvement advice sent from the server

[0576] Output: Swing improvement advice displayed in the user interface

[0577] Specific operation: The device analyzes swing improvement advice and displays it on the user interface using 3D animation and text.

[0578] (Application example 2)

[0579] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0580] The present invention aims to provide a system that not only provides appropriate shot advice to users, but also grasps the user's emotional state in real time and provides mental support and personalized information based on that.Furthermore, it aims to improve the user experience by providing product suggestions and promotional information that are tailored to the customer's emotions, in addition to swing improvement and strategic advice.

[0581] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring course information from a golf course database, means for acquiring real-time weather data from a weather information API, means for acquiring user location information and generating optimal shot advice based on the course information and weather data, means for displaying the shot advice to the user, means for determining the user's emotions using a face recognition camera or voice analysis function and generating a mental support message as necessary, and means for displaying the mental support message to the user. This makes it possible to provide appropriate advice and support in real time that takes the user's emotional state into consideration.

[0582] A "golf course database" is a database that stores information about specific golf courses and provides detailed information about the courses that users play.

[0583] The "Weather Information API" is an application programming interface for obtaining real-time weather data, providing information such as wind speed, wind direction, temperature, and probability of precipitation.

[0584] "User location information" is data used to identify the user's current location using GPS or other means.

[0585] "Shot advice" suggests the best shot method to the user based on golf course information and weather data.

[0586] A "face recognition camera" is a camera that recognizes and analyzes a user's facial expressions.

[0587] The "voice analysis function" is a function that analyzes the tone and content of the user's voice to determine their emotional state.

[0588] A "mental support message" is a message that encourages the user to relax and feel more confident based on the user's emotional state.

[0589] "Professional golfer swing data" refers to information collected and analyzed from the swings of professional golfers, and serves as a benchmark for improving users' swing techniques.

[0590] "Score data" refers to the user's score data recorded while playing golf, and reflects the playing situation and results.

[0591] "Product Information" means detailed information about a particular product, including price, features, availability, etc.

[0592] "Personalized information" is information that is individualized and generated based on a user's past behavior and current emotional state.

[0593] The present invention is a system for providing advanced services to golf players and customers of brick-and-mortar stores. In particular, it is combined with an emotion engine that recognizes the user's emotions. Specific embodiments of the system are described below.

[0594] System Overview

[0595] This system obtains golf course information and weather data to provide users with optimal shot advice. It also analyzes users' emotions in real time and generates and provides mental support messages as needed. Furthermore, in physical stores, it obtains product information and provides personalized product suggestions and promotional information to customers.

[0596] Collection and display of golf course information

[0597] Obtaining golf course information

[0598] When a user operates a terminal and selects a course to play from a golf course selection menu, the server receives the identification information of the selected golf course. The server then retrieves detailed information about the course from the database and sends it to the terminal. The terminal analyzes the information and displays it to the user.

[0599] Acquire and display weather conditions and turf conditions

[0600] Obtaining weather data

[0601] The server calls a specific weather information API to obtain real-time weather data around the golf course, which is then sent to the device and displayed for the user to view in real time.

[0602] Get the grass condition

[0603] The server collects information on the length and condition of the grass provided by the golf course manager and transmits it to the terminal, which then analyzes the data and displays it to the user.

[0604] Providing shot advice

[0605] Shot advice generation

[0606] The device uses its GPS function to acquire the user's current location and, based on this, identifies the hole on which the user plans to take a shot. The server generates optimal shot advice based on the user's location information and weather data. The generated shot advice is sent to the device and displayed to the user.

[0607] Providing mental support using an emotion engine

[0608] Emotion Engine Operation

[0609] The device uses the user's facial recognition camera and voice analysis function to analyze the user's facial expressions and tone of voice in real time to determine their emotional state. This data is further analyzed on the server, and mental support messages are generated as needed. The generated messages are then sent to the device and displayed to the user.

[0610] Smart customer service in physical stores

[0611] Customer Sentiment Analysis

[0612] The device's built-in facial recognition camera and voice analysis functions are used to analyze the customer's facial expressions and tone of voice in real time to determine their emotional state.

[0613] Obtaining and displaying product information

[0614] When a store staff member selects a specific product, the server retrieves detailed information about that product from the database and sends it to the terminal, which then displays the product information to the staff member.

[0615] Personalized customer service

[0616] The server generates optimal product suggestions and promotional information based on the customer's emotional state, past purchase history, and current in-store conditions. The generated information is sent to the customer's terminal and displayed to them.

[0617] Mental support

[0618] If the device detects that the customer is tired or anxious, it will provide mental support messages such as "Relax and enjoy your shopping."

[0619] Hardware and software used

[0620] Hardware:

[0621] Smart glasses and head-mounted displays

[0622] Facial Recognition Camera

[0623] Microphone (for voice recognition)

[0624] software:

[0625] OpenCV: Used for face recognition processing

[0626] emotion_recognition library: used for emotion analysis

[0627] requests: An HTTP client for making API requests

[0628] text_to_speech library: converts text messages into speech

[0629] Specific examples

[0630] For example, when a golf player wants to play at a certain golf course, the user first selects the golf course. The device requests information about that course from the server, and the server retrieves detailed course information from a database and sends it to the device. The device then displays this to the user. The server also obtains real-time weather data from a weather information API and collects information about the condition of the grass from the golf course manager. This information is also sent to the device and displayed for the user to check. Then, when the user takes a shot, the device generates optimal shot advice based on the user's location information and provides this to the user. Furthermore, the device uses a facial recognition camera and voice analysis functions to recognize the user's emotions and provides mental support according to those emotions.

[0631] Prompt Sentence Examples

[0632] "To provide a new shopping experience, we propose a system that obtains all information in real time and provides personalized advice based on the customer's emotional state."

[0633] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0634] Step 1:

[0635] When a user operates a terminal to select a course to play from the golf course selection menu, the server receives the identification information of that golf course. The server inputs the golf course ID and outputs the course information retrieved from the database. Specifically, the server searches the database for the corresponding course information and retrieves it.

[0636] Step 2:

[0637] The server calls the weather information API to obtain real-time weather data for the area around the golf course. The input is the location of the golf course, and the output is weather data such as wind speed, wind direction, temperature, and precipitation probability. Specifically, the server sends a request to the API endpoint and analyzes the returned weather data.

[0638] Step 3:

[0639] The device obtains the user's location information using its GPS function. The input is coordinate data obtained from the GPS, and the output is location information that identifies the current location. Specifically, the device obtains GPS signals in real time and analyzes them to determine the location information.

[0640] Step 4:

[0641] The server generates optimal shot advice based on the user's location information, course information, and weather data. The input is location information, course information, and weather data, and the output is shot advice. Specifically, the server analyzes this data and calculates the optimal club and shot direction based on the rules of golf and physical principles.

[0642] Step 5:

[0643] The terminal displays the shot advice generated by the server to the user. The input is the shot advice sent from the server, and the output is the advice visually displayed to the user. As a specific operation, the terminal displays the advice on the screen in an appropriate format.

[0644] Step 6:

[0645] The device uses the user's facial recognition camera and voice analysis functions to capture the user's facial expressions and tone of voice in real time and determine their emotional state. The input is real-time data from the camera and microphone, and the output is the analyzed emotional state. Specifically, the device performs image processing and voice analysis, and identifies the emotional state using an emotion engine.

[0646] Step 7:

[0647] The server receives the user's emotional data and generates a mental support message as needed. The input is emotional data, and the output is a mental support message. Specifically, the server analyzes the emotional data and automatically generates a message appropriate to the user's condition.

[0648] Step 8:

[0649] The terminal displays the mental support message sent from the server to the user. The input is the mental support message sent from the server, and the output is the message displayed visually and audibly to the user. In specific operation, the terminal conveys the message to the user using the screen and audio output.

[0650] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0651] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0652] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0653] [Second embodiment]

[0654] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0655] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0656] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0657] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0658] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0659] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0660] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0661] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0662] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0663] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0664] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0665] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0666] The present invention is a system for providing advanced caddie services to golf players. Specific embodiments of the system will be described below.

[0667] Collection and display of golf course information

[0668] Obtaining golf course information

[0669] The user selects a golf course on a device (smartphone, tablet, etc.).

[0670] The terminal transmits the identification information of the selected golf course to the server.

[0671] The server retrieves detailed course information (distance, par three, bunker location, designer information, etc.) from the database.

[0672] The server transmits the acquired course information to the terminal.

[0673] The terminal displays the received course information to the user.

[0674] Acquire and display weather conditions and turf conditions

[0675] Obtaining weather data

[0676] The server calls the weather information API to obtain real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.) around the golf course.

[0677] The server transmits the weather data to the terminal.

[0678] The terminal displays this weather data to the user.

[0679] Get the grass condition

[0680] The server collects information about the length and condition of the grass provided by the golf course superintendent.

[0681] The server transmits the grass condition data to the terminal.

[0682] The terminal displays this grass condition data to the user.

[0683] Providing shot advice

[0684] Shot advice generation

[0685] The device obtains the user's location information via GPS and identifies the hole where the shot is planned to be taken.

[0686] The server generates optimal shot advice based on the acquired weather data and the user's location information. For example, it provides advice on the appropriate club selection and shot direction based on wind speed and direction.

[0687] The server transmits the generated shot advice to the terminal.

[0688] The terminal displays shot advice to the user.

[0689] Providing mental support

[0690] Mental support generation

[0691] The device monitors the user's playing status and evaluates past score data and current score.

[0692] Based on this, the server automatically generates messages of encouragement and comfort.

[0693] The server transmits the generated mental support message to the terminal.

[0694] The terminal displays these messages to the user.

[0695] Providing feedback during practice

[0696] Swing data acquisition and analysis

[0697] The user selects the practice mode.

[0698] The device collects the user's swing data (swing speed, angle, direction) in real time using a sensor (such as a smart swing analyzer).

[0699] The terminal transmits the acquired swing data to the server.

[0700] Feedback Generation

[0701] The server compares the swing data of the professional golfer with the swing data of the user.

[0702] The server generates swing improvement advice based on the comparison results. For example, if the swing speed is slow, the server will give specific advice such as "Turn your hips more to increase your swing speed."

[0703] The server transmits the generated swing improvement advice to the terminal.

[0704] The terminal displays swing improvement advice to the user.

[0705] Specific examples

[0706] For example, if a user wants to play at a golf course, he or she first selects the golf course. The terminal then requests information about the course from the server, which then retrieves detailed course information from the database and sends it to the terminal, which then displays it to the user.

[0707] The server also retrieves real-time weather data from a weather information API and collects information about the condition of the turf from the golf course manager, which is also sent to the device and displayed for the user to review.

[0708] After that, when the user takes a shot, the device generates and provides optimal shot advice based on the user's location information. The system also automatically provides psychological support to the user while they play.

[0709] During practice, the device captures swing data every time the user takes a swing and compares it with data from professional golfers to provide feedback, allowing the user to efficiently improve their swing technique.

[0710] The processing flow will be explained below.

[0711] Collection and display of golf course information

[0712] Step 1:

[0713] The user operates the terminal and selects the course to play from the golf course selection menu.

[0714] Step 2:

[0715] The terminal transmits the identification information (such as an ID) of the selected golf course to the server.

[0716] Step 3:

[0717] The server uses the received course ID to retrieve detailed information about the course from the database.

[0718] Step 4:

[0719] The server sends the detailed course information (distance, par three, bunker location, designer information, etc.) to the terminal.

[0720] Step 5:

[0721] The device analyzes the course information it receives and displays it on the screen.

[0722] Acquire and display weather conditions and turf conditions

[0723] Step 1:

[0724] The server calls a specific weather information API to obtain real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.) around the golf course.

[0725] Step 2:

[0726] The server also sends a request to the golf course superintendent's system to collect turf length and condition information provided by the superintendent.

[0727] Step 3:

[0728] The server integrates the weather data and grass information it has acquired and sends it to the terminal.

[0729] Step 4:

[0730] The terminal displays weather data and turf information to the user in real time.

[0731] Providing shot advice

[0732] Step 1:

[0733] The device uses its GPS function to obtain the user's current location and, based on this, identifies the hole on which the shot is to be taken.

[0734] Step 2:

[0735] The server generates optimal shot advice based on the user's location and weather data, such as calculating club selection and shot direction taking into account the effects of wind.

[0736] Step 3:

[0737] The server transmits the generated shot advice to the terminal.

[0738] Step 4:

[0739] The terminal displays shot advice to the user.

[0740] Providing mental support

[0741] Step 1:

[0742] The device monitors the user's playing status (score and success of shots).

[0743] Step 2:

[0744] The server receives the user's playing data and analyzes their current performance in comparison with past score data.

[0745] Step 3:

[0746] Based on the analysis, the server generates encouraging or comforting messages as needed, such as "You can recover on your next shot."

[0747] Step 4:

[0748] The server generates a message and sends it to the terminal.

[0749] Step 5:

[0750] The terminal displays a mental support message to the user.

[0751] Providing feedback during practice

[0752] Step 1:

[0753] The user selects practice mode on the device.

[0754] Step 2:

[0755] The device uses sensors to collect the user's swing data (swing speed, angle, direction, etc.) in real time.

[0756] Step 3:

[0757] The swing data acquired by the terminal is transmitted to the server.

[0758] Step 4:

[0759] The server analyzes the user's swing by comparing it with a database of swings from professional golfers.

[0760] Step 5:

[0761] Based on the comparison results, the server generates swing improvement advice for the user, such as "make your backswing a little higher."

[0762] Step 6:

[0763] The server transmits the generated swing improvement advice to the terminal.

[0764] Step 7:

[0765] The terminal displays swing improvement advice to the user.

[0766] Example 1

[0767] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0768] For golf players, obtaining course information and weather data in real time and receiving optimal shot advice while playing is essential to improving their scores. However, with current technology, players must individually check course information, weather data, and turf conditions, which takes time and effort to receive appropriate shot advice. Furthermore, there is a lack of ways to compare one's own swing data with that of professional golfers, making efficient practice difficult. Furthermore, there is a lack of mental support during play, making it difficult for players to maintain motivation. There is a need for an advanced caddie service that can solve these issues and provide consistent support to golf players.

[0769] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0770] In this invention, the server includes means for acquiring course information from a golf course database, means for acquiring real-time weather data from a weather information API, means for acquiring user location information and generating optimal shot advice based on the course information and weather data, means for collecting turf condition data from golf course managers, means for evaluating past score data and current score data and generating mental support messages, and means for referencing swing data of professional golfers and comparing it with the user's swing data. This makes it possible to provide the user with optimal shot advice, turf condition information, and mental support messages in real time, as well as swing improvement advice during practice based on comparison with professional golfer data.

[0771] A "golf course database" is a structured data store that stores detailed information about golf courses (distances, par threes, bunker locations, designer information, etc.).

[0772] The "Weather Information API" is an application programming interface for obtaining real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.).

[0773] "User location information" is GPS data that indicates the user's current location.

[0774] "Optimal shot advice" refers to instructions on the best shot and club selection that a user should take based on golf course information, weather data, and the like.

[0775] "Turf condition data" is information about the length and health of the grass on a golf course.

[0776] "Mental support messages" are words of encouragement and comfort provided to keep users motivated.

[0777] "Professional golfer swing data" refers to motion data (swing speed, angle, direction, etc.) of a professional golfer when swinging.

[0778] "User swing data" refers to motion data (swing speed, angle, direction, etc.) when the user swings.

[0779] The "comparison result" is an evaluation when comparing the swing data of a professional golfer with the swing data of the user.

[0780] "Swing improvement advice" is specific instructions for the user to improve their swing based on the results of comparing the user's swing data with swing data of a professional golfer.

[0781] "Strategic advice" is an instruction that suggests an effective strategy for a particular hole based on the user's score data.

[0782] This invention is a system that provides advanced caddie services to golf players. Specifically, it includes functions such as collecting and displaying golf course information, acquiring and displaying weather conditions and turf conditions, providing shot advice, providing mental support, and providing feedback during practice. Each process in this system is performed in real time between the server, the terminal, and the user.

[0783] First, a user selects a golf course using a device such as a smartphone or tablet. The device sends identification information for the selected golf course to a server, which then retrieves the course information from a database. In terms of specific hardware, in the first processing step, the device communicates with the server using an HTTP request, and the server retrieves the information using a relational database management system (RDBMS). The retrieved information is then sent to the device, which displays it to the user.

[0784] The server then calls a weather information API to obtain real-time weather data for the area around the golf course. The server then queries the weather information API, again using the HTTP protocol, and transmits the obtained data back to the terminal. In this invention, existing weather information APIs, such as the OpenWeatherMap API, can be used. The terminal analyzes this weather data and visually displays it to the user. The server also collects turf condition data from the golf course manager. This data is also transmitted to the terminal, where it can be viewed by the user.

[0785] When a user takes a shot, the device uses its GPS function to obtain the user's location. Based on this location information and previously obtained weather and course information, the server generates optimal shot advice. Using a generative AI model, data such as wind speed, direction, and distance is analyzed to generate specific advice on club selection and shot direction. For example, advice such as "The wind speed is 5 m / s blowing from east to west. Aim 8 yards to the right with a 7 iron" is displayed.

[0786] Furthermore, the system automatically generates mental support messages by monitoring the user's playing status and evaluating past and current score data. The server uses a generative AI model to generate encouraging and comforting messages and sends them to the device. For example, a message such as "You're doing well in the first half, so keep it up and do your best in the second half" is displayed.

[0787] When practicing, if the user selects practice mode, the device will use a sensor (e.g., a smart swing analyzer) to collect the user's swing data in real time. This data will be sent to a server and compared with swing data from professional golfers. Based on the comparison results, the server will generate swing improvement advice for the user. For example, specific advice such as "Your swing speed is slow, so try rotating your hips more to increase your swing speed" will be displayed on the device.

[0788] Specific examples

[0789] For example, if a user wants to play at a golf course, they first launch the app and select the golf course. The device sends the selection to the server, which then retrieves detailed course information from a database and sends it to the device. The device then displays this information to the user. At the same time, the server retrieves real-time weather data from a weather information API and collects information about the turf condition from the golf course manager. This information is also sent to the device and displayed for the user to review. Then, when the user takes a shot, the device generates optimal shot advice based on the user's location and provides this advice to the user. The system also automatically generates support messages based on the user's mental state during play and displays them to the user. During practice, the device collects swing data every time the user takes a swing and compares it with data from professional golfers to provide feedback. This allows users to efficiently improve their swing technique.

[0790] Prompt Sentence Examples

[0791] "Please explain the system that allows users to select golf practice mode, acquire and analyze swing data, and provide swing improvement advice."

[0792] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0793] Step 1:

[0794] The user selects a golf course on a device (smartphone, tablet, etc.).

[0795] Input: The user interacts with the app's interface and selects the golf course they want to play.

[0796] Action: The user interacts with a drop-down menu, search bar, or selection feature on a map.

[0797] Output: Identification information (ID, name, etc.) of the selected golf course.

[0798] Step 2:

[0799] The terminal transmits the identification information of the selected golf course to the server.

[0800] Input: The identification of the selected golf course.

[0801] How it works: The device sends the identification information of the selected golf course to the server using an HTTP request.

[0802] Output: The request data sent to the server.

[0803] Step 3:

[0804] The server retrieves detailed course information (distance, par three, bunker location, designer information, etc.) from the database.

[0805] Input: Golf course identification.

[0806] How it works: The server queries the RDBMS to extract detailed course information.

[0807] Output: Golf course details are retrieved on the server.

[0808] Step 4:

[0809] The server transmits the acquired course information to the terminal.

[0810] Input: Golf course details.

[0811] Operation: The server converts the acquired course information into JSON format and sends it to the device as an HTTP response.

[0812] Output: JSON data of the course information sent to the device.

[0813] Step 5:

[0814] The terminal displays the received course information to the user.

[0815] Input: JSON data with golf course details.

[0816] How it works: The device parses the JSON data and displays it to the user in a visually friendly format.

[0817] Output: Detailed golf course information displayed to the user (layout diagram, hole-by-hole information, etc.).

[0818] Step 6:

[0819] The server calls the weather information API to obtain real-time weather data around the golf course.

[0820] Input: Latitude and longitude information of the golf course.

[0821] How it works: The server queries the weather API endpoint to retrieve weather data.

[0822] Output: Real-time weather data retrieved from the API.

[0823] Step 7:

[0824] The server sends the weather data to the device.

[0825] Input: Weather data.

[0826] How it works: The server sends weather data in JSON format to the device.

[0827] Output: JSON data of the weather data sent to the device.

[0828] Step 8:

[0829] The terminal displays this weather data to the user.

[0830] Input: Weather data in JSON format.

[0831] How it works: The device parses the JSON data and displays it to the user in a visually friendly format.

[0832] Output: Weather information displayed to the user (wind speed, direction, temperature, chance of precipitation, etc.).

[0833] Step 9:

[0834] A server collects turf condition data from golf course managers.

[0835] Input: Information about the condition of the grass.

[0836] How it works: The server collects information through an upload interface for golf course managers.

[0837] Output: Grass condition data stored on the server.

[0838] Step 10:

[0839] The server sends the grass condition data to the terminal.

[0840] Input: Turf condition data.

[0841] How it works: The server sends grass status data in JSON format to the device.

[0842] Output: JSON data of the grass condition data sent to the terminal.

[0843] Step 11:

[0844] The terminal displays this grass condition data to the user.

[0845] Input: JSON data of grass condition data.

[0846] How it works: The device parses the JSON data and displays it to the user in a visually friendly format.

[0847] Output: Grass condition information (length, health, etc.) displayed to the user.

[0848] Step 12:

[0849] The device obtains the user's location information via GPS and identifies the hole where the shot is planned to be taken.

[0850] Input: User location (GPS data).

[0851] How it works: The device uses GPS to determine the user's current location and runs an algorithm to identify the specific hole.

[0852] Output: User's current location and identified hole information.

[0853] Step 13:

[0854] The server generates optimal shot advice based on weather data and the user's location information.

[0855] Input: Weather data, user location, course information.

[0856] How it works: The server uses a generative AI model to generate optimal shot advice based on input data.

[0857] Output: Shot advice generated.

[0858] Step 14:

[0859] The server transmits the generated shot advice to the terminal.

[0860] Input: Shot advice generation results.

[0861] How it works: The server converts the advice data into JSON format and sends it to the device.

[0862] Output: Shot advice data sent to the device.

[0863] Step 15:

[0864] The terminal displays shot advice to the user.

[0865] Input: Shot advice data.

[0866] How it works: The device parses the advice data and displays it to the user in a visually friendly format.

[0867] Output: Shot advice (club selection, shot direction, etc.) displayed to the user.

[0868] Step 16:

[0869] The device monitors the user's playing status and evaluates past score data and current score.

[0870] Input: User score data, playing status data.

[0871] Operation: The device records data locally and runs the evaluation algorithm.

[0872] Output: Evaluation result.

[0873] Step 17:

[0874] The server automatically generates a mental support message based on the evaluation results.

[0875] Input: Evaluation results, past score data.

[0876] How it works: The server uses a generative AI model to generate optimal mental support messages for each individual user.

[0877] Output: Mental support message.

[0878] Step 18:

[0879] A mental support message generated by the server is sent to the terminal.

[0880] Input: Mental support message.

[0881] Behavior: The server sends a mental support message in JSON format to the device.

[0882] Output: The emotional support message sent to the device.

[0883] Step 19:

[0884] The terminal displays these messages to the user.

[0885] Input: Mental support message.

[0886] What it does: The device parses the message and displays it in the form of a notification or a popup window.

[0887] Output: The emotional support message that will be displayed to the user.

[0888] Step 20:

[0889] The user selects the practice mode.

[0890] Input: User selection.

[0891] Action: The user selects Practice mode from the menu.

[0892] Output: Practice mode selection status.

[0893] Step 21:

[0894] The device uses sensors to collect the user's swing data (swing speed, angle, direction) in real time.

[0895] Input: The user's swing motion.

[0896] How it works: The sensor captures swing information and sends the data to your device.

[0897] Output: Swing data.

[0898] Step 22:

[0899] The swing data acquired by the terminal is transmitted to the server.

[0900] Input: Swing data.

[0901] Operation: The device sends swing data to the server.

[0902] Output: Swing data sent to the server.

[0903] Step 23:

[0904] The server compares the swing data of the professional golfer with the swing data of the user.

[0905] Input: User swing data, professional golfer swing data.

[0906] How it works: The server compares the user's data with the professional golfer data in its database.

[0907] Output: The comparison result.

[0908] Step 24:

[0909] The server generates swing improvement advice based on the comparison result.

[0910] Input: The comparison result.

[0911] How it works: The server uses a generative AI model to generate specific swing improvement advice.

[0912] Output: Swing improvement advice.

[0913] Step 25:

[0914] The server transmits the generated swing improvement advice to the terminal.

[0915] Enter: swing improvement advice.

[0916] How it works: The server sends advice in JSON format to the device.

[0917] Output: Swing improvement advice sent to the device.

[0918] Step 26:

[0919] The terminal displays swing improvement advice to the user.

[0920] Enter: swing improvement advice.

[0921] How it works: The device parses the advice and displays it in a visually friendly format.

[0922] Output: Swing improvement advice displayed to the user.

[0923] (Application example 1)

[0924] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0925] Conventional factory production line management has not been able to fully utilize environmental data and operator performance data, limiting its ability to improve work efficiency or provide psychological support. Another issue is the inability to provide optimal work advice in real time when the production environment fluctuates. A new system is needed to solve these problems, increase production line efficiency, and improve operator performance.

[0926] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0927] In this invention, the server includes a means for acquiring production line information from an industrial line database, a means for acquiring real-time environmental data from an industrial temperature sensor, and a means for generating work advice based on the operator's production efficiency data and environmental data. This makes it possible to provide optimal work advice based on the environmental data and performance data in real time, and also provide psychological support to the operator.

[0928] An "industrial line database" is a digital database for collectively recording and managing information about production lines within a factory.

[0929] "Production line information" is detailed data on the production processes within the factory, the operating status of production equipment, work procedures, work progress, etc.

[0930] An "industrial temperature sensor" is a sensor device that measures the temperature in a factory's working environment in real time and provides that data in digital format.

[0931] "Environmental data" refers to real-time data on the working environment within the factory, such as temperature, humidity, light intensity, and noise level.

[0932] "Operator" refers to workers and engineers who work directly on the production line.

[0933] "Production efficiency data" refers to data related to an operator's work efficiency and performance, such as information on work speed and production volume.

[0934] "Work advice" is advice that suggests optimal work methods and improvement measures to operators based on acquired environmental data and production efficiency data.

[0935] "Psychological support messages" are messages of psychological support and encouragement that are generated based on the operator's performance data.

[0936] The present invention is a production line assistant system that provides optimal work assistance and psychological support to operators working on production lines in a factory. Specific embodiments for realizing this system are described below.

[0937] Acquisition and display of production line information

[0938] The server retrieves production line information from the industrial line database. This information includes the production process, the operating status of production equipment, work procedures, work progress, etc. The server then sends this information to the terminal, which then displays it to the operator.

[0939] Acquiring and displaying environmental data

[0940] The server acquires real-time environmental data (temperature, humidity, illuminance, etc.) from environmental monitoring devices such as industrial temperature sensors. This data is also sent from the server to the terminal and displayed on the terminal for the operator to check.

[0941] Generation and display of work advice

[0942] The server generates optimal work advice based on the acquired production line information and environmental data. For example, if the temperature inside the factory is high, it generates advice to ask the operator to check the cooling system. The server sends this work advice to the terminal, which then displays it to the operator. This allows the operator to take appropriate action based on the current work environment.

[0943] Providing mental support

[0944] The server records and analyzes the operator's performance data (work efficiency, work speed, production volume, etc.) and automatically generates mental support messages. For example, for an operator whose work efficiency is declining, it generates a message such as "Take a short break and refresh yourself. You're doing a great job!" The server sends the generated mental support message to the terminal, which displays it to the operator.

[0945] Hardware and Software

[0946] To implement this system, the following hardware and software are used:

[0947] Hardware:

[0948] Industrial Temperature Sensors

[0949] Environmental Monitoring Devices

[0950] Terminals with human-machine interface (HMI)

[0951] software:

[0952] Database Management System (DBMS)

[0953] Software for making API calls

[0954] AI models for data analysis and advice generation

[0955] Specific examples

[0956] For example, if the temperature in a factory is rising, the server will receive real-time data from industrial temperature sensors and generate advice to the operator to check the cooling system. If work efficiency is declining, the server will generate a mental support message to the operator to take a break.

[0957] Example prompt sentence:

[0958] "The temperature in the factory is getting high, so please ask the operators to check the cooling system. Also, please send a message to operators whose work efficiency is declining, encouraging them to take a break."

[0959] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0960] Step 1:

[0961] The server retrieves production line information from the industrial line database. The input is a request to the database, and the output is production line information such as the production process, work procedures, and equipment operating status. The server sends this information to the terminal, which displays it to the operator.

[0962] Step 2:

[0963] The server acquires real-time environmental data (temperature, humidity, illuminance, etc.) from industrial temperature sensors. The input is the data acquired from the environmental sensors, and the output is real-time environmental information. The server sends this environmental data to the terminal, which displays it to the operator.

[0964] Step 3:

[0965] The server generates optimal work advice based on production line information and environmental data. The inputs are production line information and environmental data, and the output is work advice. For example, if the temperature is high, advice such as "Check the cooling system" is generated. The server sends this work advice to the terminal, which then displays it to the operator.

[0966] Step 4:

[0967] The server records and analyzes the operator's production efficiency data and generates mental support messages. The input is the operator's work efficiency data, and the output is a mental support message. For example, if work efficiency is declining, a message such as "Please take a short break and refresh yourself" is generated. The server sends this mental support message to the terminal, which then displays it to the operator.

[0968] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0969] The present invention is a system for providing advanced caddie services to golf players, and in particular, is combined with an emotion engine that recognizes the user's emotions. Specific embodiments of this system will be described below.

[0970] Collection and display of golf course information

[0971] Obtaining golf course information

[0972] The user operates the terminal and selects the course to play from the golf course selection menu.

[0973] The terminal transmits the identification information (such as an ID) of the selected golf course to the server.

[0974] The server uses the received course ID to retrieve detailed information about the course from the database.

[0975] The server sends the detailed course information (distance, par three, bunker location, designer information, etc.) to the terminal.

[0976] The device analyzes the course information it receives and displays it on the screen.

[0977] Acquire and display weather conditions and turf conditions

[0978] Obtaining weather data

[0979] The server calls a specific weather information API to obtain real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.) around the golf course.

[0980] The weather data acquired by the server is sent to the terminal.

[0981] The terminal displays weather data to the user in real time.

[0982] Get the grass condition

[0983] The server collects information on the length and condition of the grass provided by the golf course manager.

[0984] The server sends the grass information to the terminal.

[0985] The terminal displays the grass condition data to the user.

[0986] Providing shot advice

[0987] Shot advice generation

[0988] The device uses its GPS function to obtain the user's current location and, based on this, identifies the hole on which the shot is to be taken.

[0989] The server generates optimal shot advice based on the user's location and weather data, such as calculating club selection and shot direction taking into account the effects of wind.

[0990] The server transmits the generated shot advice to the terminal.

[0991] The terminal displays shot advice to the user.

[0992] Providing mental support using an emotion engine

[0993] Emotion Engine Operation

[0994] The device uses the user's facial recognition camera and voice analysis functions to analyze the user's facial expressions and tone of voice in real time to determine their emotional state.

[0995] The server analyzes the user's emotional data and generates mental support messages as needed. For example, if the user is nervous, it generates a message such as "Relax and take the shot with confidence."

[0996] A mental support message generated by the server is sent to the terminal.

[0997] The terminal displays a mental support message to the user.

[0998] Providing feedback during practice

[0999] Swing data acquisition and analysis

[1000] The user selects practice mode on the device.

[1001] The device uses sensors to collect the user's swing data (swing speed, angle, direction, etc.) in real time.

[1002] The swing data acquired by the terminal is transmitted to the server.

[1003] Feedback Generation

[1004] The server analyzes the user's swing by comparing it with a database of swings from professional golfers.

[1005] Based on the comparison results, the server generates swing improvement advice for the user, such as "make your backswing a little higher."

[1006] The server transmits the generated swing improvement advice to the terminal.

[1007] The terminal displays swing improvement advice to the user.

[1008] Specific examples

[1009] For example, if a user wants to play at a golf course, he or she first selects the golf course. The terminal then requests information about the course from the server, which then retrieves detailed course information from the database and sends it to the terminal, which then displays it to the user.

[1010] The server also retrieves real-time weather data from a weather information API and collects information about the condition of the turf from the golf course manager, which is also sent to the device and displayed for the user to review.

[1011] When the user takes a shot, the device generates and provides optimal shot advice based on the user's location information. It also uses a facial recognition camera and voice analysis functions to recognize the user's emotions and provide mental support according to their feelings.

[1012] During practice, the device collects swing data every time the user takes a swing and compares it with that of professional golfers to provide feedback. This allows users to efficiently improve their swing technique. Through this process, users can enjoy golf while receiving appropriate advice and mental support in real time.

[1013] The processing flow will be explained below.

[1014] Collection and display of golf course information

[1015] Step 1:

[1016] The user operates the terminal and selects the course to play from the golf course selection menu.

[1017] Step 2:

[1018] The terminal transmits the identification information (such as an ID) of the selected golf course to the server.

[1019] Step 3:

[1020] The server uses the received course ID to retrieve detailed information about the course from the database.

[1021] Step 4:

[1022] The server sends the detailed course information (distance, par three, bunker location, designer information, etc.) to the terminal.

[1023] Step 5:

[1024] The device analyzes the course information it receives and displays it on the screen.

[1025] Acquire and display weather conditions and turf conditions

[1026] Step 1:

[1027] The server calls a specific weather information API to obtain real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.) around the golf course.

[1028] Step 2:

[1029] The server sends the weather data to the device.

[1030] Step 3:

[1031] The terminal displays weather data to the user in real time.

[1032] Step 4:

[1033] The server collects information on the length and condition of the grass provided by the golf course manager.

[1034] Step 5:

[1035] The server sends the grass information to the terminal.

[1036] Step 6:

[1037] The terminal displays the grass condition data to the user.

[1038] Providing shot advice

[1039] Step 1:

[1040] The device uses its GPS function to obtain the user's current location and, based on this, identifies the hole on which the shot is to be taken.

[1041] Step 2:

[1042] The server generates optimal shot advice based on the user's location and weather data, for example, calculating club selection and shot direction taking into account the effects of wind.

[1043] Step 3:

[1044] The server transmits the generated shot advice to the terminal.

[1045] Step 4:

[1046] The terminal displays shot advice to the user.

[1047] Providing mental support using an emotion engine

[1048] Step 1:

[1049] The device uses the user's facial recognition camera and voice analysis functions to analyze the user's facial expressions and tone of voice in real time to determine their emotional state.

[1050] Step 2:

[1051] The terminal transmits the acquired user emotion data to the server.

[1052] Step 3:

[1053] The server analyzes the user's emotional data and generates mental support messages as needed. For example, if the user is nervous, it generates a message such as "Relax and take the shot with confidence."

[1054] Step 4:

[1055] A mental support message generated by the server is sent to the terminal.

[1056] Step 5:

[1057] The terminal displays a mental support message to the user.

[1058] Providing feedback during practice

[1059] Step 1:

[1060] The user selects practice mode on the device.

[1061] Step 2:

[1062] The device uses sensors to collect the user's swing data (swing speed, angle, direction, etc.) in real time.

[1063] Step 3:

[1064] The swing data acquired by the terminal is transmitted to the server.

[1065] Step 4:

[1066] The server analyzes the user's swing by comparing it with a database of swings from professional golfers.

[1067] Step 5:

[1068] Based on the comparison results, the server generates swing improvement advice for the user, such as "make your backswing a little higher."

[1069] Step 6:

[1070] The server transmits the generated swing improvement advice to the terminal.

[1071] Step 7:

[1072] The terminal displays swing improvement advice to the user.

[1073] Example 2

[1074] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1075] Golf players have difficulty quickly obtaining accurate course and weather information while playing. Furthermore, there are limited ways to effectively receive mental support tailored to the player's emotions and feedback on swing improvement. Conventional caddie services have difficulty providing this information and support in real time, and this invention aims to solve this problem.

[1076] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for the user to select a course to play from a golf course selection menu and the terminal to transmit identification information of the course to the server; means for the server to obtain detailed information about the selected golf course from a database and transmit it to the terminal; means for the server to obtain real-time weather data using a weather information API and transmit it to the terminal; means for the terminal to obtain the user's current location using a GPS and for the server to generate optimal shot advice based on the location information and weather data and transmit it to the terminal; means for the terminal to analyze the obtained detailed information about the golf course, weather data, and shot advice and display them on the screen; means for the server to determine the user's emotions in real time using a face recognition camera or a voice analysis function and generate a mental support message as needed; means for the terminal to display the mental support message to the user; means for the user to select a practice mode on the terminal and for the terminal to obtain swing data through a sensor and transmit it to the server; means for the server to compare the user's swing data with a database of professional golfers and generate swing improvement advice; and means for the terminal to display the swing improvement advice to the user. This will enable golf players to receive accurate course information, weather information, shot advice, emotional support, and feedback on swing improvement in real time.

[1077] "User" refers to a golf player who operates the system and receives various information and services.

[1078] A "terminal" is a device that is operated by a user and displays various information, and includes smartphones, tablet PCs, etc.

[1079] "Server" refers to a computer system that processes various data and transmits information to terminals.

[1080] "Golf course selection menu" refers to an interface that allows a user to select a golf course to play.

[1081] "Identification information" is information that uniquely identifies a particular golf course, and includes the course ID, name, etc.

[1082] "Database" refers to the data structure that stores detailed golf course information and is accessed by the server.

[1083] "Weather Information API" means an application programming interface that provides real-time weather data for a specific location.

[1084] "GPS" refers to a satellite system for obtaining geographic location information.

[1085] "Shot advice" refers to information that suggests the optimal club selection and shot direction when the user hits a golf ball.

[1086] A "face recognition camera" refers to a camera system that analyzes a user's facial expressions.

[1087] "Voice analysis function" refers to technology that analyzes the tone of a user's voice and determines their emotional state.

[1088] "Mental support messages" refer to messages containing encouragement or advice that are generated according to the user's emotional state.

[1089] "Practice mode" refers to the operating mode of the system used by a user to practice their golf swing.

[1090] "Sensor" refers to a device for acquiring user swing data in real time.

[1091] "Swing data" refers to data such as the speed, angle, and direction of a user's golf swing.

[1092] "Professional golfer database" refers to a database that stores swing data of professional golfers and compares it with the user's swing data.

[1093] "Swing improvement advice" refers to specific suggestions for improving the user's swing.

[1094] The present invention is a system for providing advanced caddie services to golf players, including golf course information, real-time weather data, turf conditions, shot advice, emotional support, and swing improvement feedback. Specific embodiments of the system are described below.

[1095] Collection and display of golf course information

[1096] First, the user operates the device to select the course they wish to play from the golf course selection menu. The device then sends the identification information (such as ID) of that course to the server. The server then retrieves detailed information about the corresponding course from its database based on the received course ID. This information includes distance, par three, bunker location, and designer information. The retrieved course information is then sent from the server to the device, which then displays it. The device then uses HTML5 and JavaScript to display the information on the user interface.

[1097] Acquire and display weather conditions and turf conditions

[1098] The server calls a specific weather information API (e.g., OpenWeatherMap API) to obtain real-time weather data around the golf course. This data includes wind speed, wind direction, temperature, and chance of precipitation. The server sends the obtained weather data to the terminal, which then displays the weather data to the user in real time. A graphical UI component (e.g., Chart.js) is used for display. In addition, the server collects information about the length and condition of the grass from the golf course manager and sends it to the terminal. The terminal displays this information to the user.

[1099] Providing shot advice

[1100] When a user takes a shot, the device uses its GPS to obtain the user's current location. The server generates optimal shot advice based on the location information and weather data. This advice is generated using a machine learning model (e.g., TensorFlow) to calculate club selection and shot direction taking into account the effects of wind. The generated shot advice is sent from the server to the device and displayed on the device.

[1101] Providing mental support using an emotion engine

[1102] The device uses the user's facial recognition camera and voice analysis functions (e.g., OpenCV and Google Speech-to-Text API) to analyze the user's facial expressions and tone of voice in real time to determine their emotional state. The server analyzes this emotional data and generates mental support messages as needed. For example, if the user is nervous, it generates a message such as "Relax and take the shot with confidence." The generated mental support message is sent from the server to the device and displayed on the device. It can be displayed in both text and voice.

[1103] Providing feedback during practice

[1104] The user selects practice mode on the device, and the device acquires the user's swing data through a sensor (e.g., a motion capture sensor). The acquired swing data is sent from the device to a server, which compares the user's swing data with a database of professional golfers. Based on the comparison results, the server generates swing improvement advice for the user. For example, it provides specific advice such as "make your backswing a little higher." The generated swing improvement advice is sent from the server to the device and displayed on the device. This display can use 3D animation to demonstrate the correct swing movement.

[1105] Specific examples

[1106] For example, if a user wants to play at a golf course, they first select the golf course. The device requests information about that course from the server, which retrieves detailed course information from a database and sends it to the device. The device then displays this to the user. The server also retrieves real-time weather data from a weather information API (e.g., OpenWeatherMap API) and collects information about the condition of the grass from the golf course manager. This information is also sent to the device and displayed for the user to review.

[1107] When the user takes a shot, the device generates and provides optimal shot advice based on the user's location information. It also uses a facial recognition camera and voice analysis functions to recognize the user's emotions and provides mental support according to their emotions.

[1108] During practice, the device collects swing data every time the user takes a swing and provides feedback by comparing it with data from professional golfers. This allows users to efficiently improve their swing technique. Through this process, users can enjoy golf while receiving appropriate advice and mental support in real time.

[1109] Example of input prompt for generative AI model

[1110] "This system provides advanced caddie services to golf players. Specifically, it includes golf course information, real-time weather data, turf conditions, shot advice, emotional mental support, and swing feedback. Please explain in detail the functions that provide all of the following: the golf course selected by the user and its detailed information, real-time weather data, generation and display of shot advice, emotional recognition and mental support for the user, and collection and analysis of swing data."

[1111] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1112] Step 1:

[1113] The user selects the course to play from the golf course selection menu.

[1114] Input: The user makes a selection on the device, selecting the golf course to play.

[1115] Output: ID and name of selected golf course

[1116] Specific operation: The terminal acquires the identification information of the golf course selected by the user's operation and transmits the selection result to the server.

[1117] Step 2:

[1118] The server retrieves the details of the selected golf course from the database.

[1119] Input: Golf course ID or name

[1120] Output: Detailed golf course information (distance, par three, bunker location, designer information, etc.)

[1121] Specific operation: The server executes a database query to obtain detailed information corresponding to the submitted golf course ID.

[1122] Step 3:

[1123] The server transmits the acquired detailed information about the golf course to the terminal.

[1124] Input: Golf course details

[1125] Output: Sending data to the terminal

[1126] Specific operation: The server converts the acquired data into a certain format (e.g., JSON) and sends it to the terminal.

[1127] Step 4:

[1128] The terminal displays detailed information about the golf course received.

[1129] Input: Golf course details sent from the server

[1130] Output: Course information displayed in the user interface

[1131] Specific operation: The device analyzes the received data using HTML5 and JavaScript and displays it in the user interface in map or text format.

[1132] Step 5:

[1133] The server uses a specific weather information API to obtain real-time weather data.

[1134] Input: Golf course location information

[1135] Output: Real-time weather data (wind speed, wind direction, temperature, precipitation probability, etc.)

[1136] What happens: The server sends a request to a weather information API (e.g., OpenWeatherMap API) to retrieve weather data based on the location of the golf course.

[1137] Step 6:

[1138] The weather data acquired by the server is sent to the terminal.

[1139] Input: Real-time weather data

[1140] Output: Sending data to the terminal

[1141] Specific operation: The server sends the acquired weather data to the terminal in JSON format or similar.

[1142] Step 7:

[1143] The terminal displays the weather data to the user.

[1144] Input: Real-time weather data sent from the server

[1145] Output: Weather information displayed in the user interface

[1146] What it does: The device parses weather data and displays it visually using graphical UI components (e.g., Chart.js).

[1147] Step 8:

[1148] The device obtains the user's current location using the GPS function.

[1149] Input: GPS data of the device

[1150] Output: User's current location

[1151] Specific operation: The device uses the built-in GPS module to obtain the user's current location in real time and transmits the data to the server.

[1152] Step 9:

[1153] The server generates optimal shot advice based on location information and weather data.

[1154] Input: User location, real-time weather data

[1155] Output: Shot advice

[1156] How it works: The server uses machine learning models (e.g., TensorFlow) to calculate optimal club selection and shot direction based on the user's location and weather data.

[1157] Step 10:

[1158] The server transmits the generated shot advice to the terminal.

[1159] Input: Shot Advice

[1160] Output: Sending data to the terminal

[1161] Specific operation: The server sends the generated advice to the terminal in JSON format or similar.

[1162] Step 11:

[1163] The terminal displays shot advice to the user.

[1164] Input: Shot advice sent from the server

[1165] Output: Shot advice displayed in the user interface

[1166] Specific operation: The device analyzes the shot advice and displays it in the user interface as text or graphics.

[1167] Step 12:

[1168] The device uses a facial recognition camera and voice analysis functions to analyze the user's facial expressions and tone of voice in real time.

[1169] Input: User's face image data and voice data

[1170] Output: User's emotional state

[1171] Specific operation: The device analyzes the data using a facial recognition camera (e.g., OpenCV) and voice analysis functions (e.g., Google Speech-to-Text API) and sends the emotional state to the server.

[1172] Step 13:

[1173] The server analyzes the emotional data and generates a mental support message as needed.

[1174] Input: User emotion data

[1175] Output: Mental support message

[1176] Specific operation: The server analyzes the emotional data and generates an appropriate mental support message depending on whether the user is nervous or not.

[1177] Step 14:

[1178] A mental support message generated by the server is sent to the terminal.

[1179] Input: Mental support message

[1180] Output: Sending data to the terminal

[1181] Specific operation: The server sends the generated mental support message to the terminal in JSON format or similar.

[1182] Step 15:

[1183] The terminal displays a mental support message to the user.

[1184] Input: Mental support message sent from the server

[1185] Output: A mental support message displayed in the user interface.

[1186] Specific operation: The terminal displays a mental support message in text or voice on the user interface.

[1187] Step 16:

[1188] The user selects practice mode, and the device uses sensors to acquire swing data.

[1189] Input: User swing motion

[1190] Output: Swing data

[1191] Specific operation: The device uses motion capture sensors to obtain data such as swing speed, angle, and direction in real time, and then transmits this data to a server.

[1192] Step 17:

[1193] The server compares the user's swing data with a database of professional golfers and generates swing improvement advice.

[1194] Input: User swing data, professional golfer data

[1195] Output: Swing improvement advice

[1196] Specific operation: The server uses a comparison algorithm to analyze the user's data and the data of professional golfers and generates advice including areas for improvement.

[1197] Step 18:

[1198] The server transmits the generated swing improvement advice to the terminal.

[1199] Input: Swing improvement advice

[1200] Output: Sending data to the terminal

[1201] Specific operation: The server sends the generated advice to the terminal in JSON format or similar.

[1202] Step 19:

[1203] The terminal displays swing improvement advice to the user.

[1204] Input: Swing improvement advice sent from the server

[1205] Output: Swing improvement advice displayed in the user interface

[1206] Specific operation: The device analyzes swing improvement advice and displays it on the user interface using 3D animation and text.

[1207] (Application example 2)

[1208] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1209] The present invention aims to provide a system that not only provides appropriate shot advice to users, but also grasps the user's emotional state in real time and provides mental support and personalized information based on that.Furthermore, it aims to improve the user experience by providing product suggestions and promotional information that are tailored to the customer's emotions, in addition to swing improvement and strategic advice.

[1210] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring course information from a golf course database, means for acquiring real-time weather data from a weather information API, means for acquiring user location information and generating optimal shot advice based on the course information and weather data, means for displaying the shot advice to the user, means for determining the user's emotions using a face recognition camera or voice analysis function and generating a mental support message as necessary, and means for displaying the mental support message to the user. This makes it possible to provide appropriate advice and support in real time that takes the user's emotional state into consideration.

[1211] A "golf course database" is a database that stores information about specific golf courses and provides detailed information about the courses that users play.

[1212] The "Weather Information API" is an application programming interface for obtaining real-time weather data, providing information such as wind speed, wind direction, temperature, and probability of precipitation.

[1213] "User location information" is data used to identify the user's current location using GPS or other means.

[1214] "Shot advice" suggests the best shot method to the user based on golf course information and weather data.

[1215] A "face recognition camera" is a camera that recognizes and analyzes a user's facial expressions.

[1216] The "voice analysis function" is a function that analyzes the tone and content of the user's voice to determine their emotional state.

[1217] A "mental support message" is a message that encourages the user to relax and feel more confident based on the user's emotional state.

[1218] "Professional golfer swing data" refers to information collected and analyzed from the swings of professional golfers, and serves as a benchmark for improving users' swing techniques.

[1219] "Score data" refers to the user's score data recorded while playing golf, and reflects the playing situation and results.

[1220] "Product Information" means detailed information about a particular product, including price, features, availability, etc.

[1221] "Personalized information" is information that is individualized and generated based on a user's past behavior and current emotional state.

[1222] The present invention is a system for providing advanced services to golf players and customers of brick-and-mortar stores. In particular, it is combined with an emotion engine that recognizes the user's emotions. Specific embodiments of the system are described below.

[1223] System Overview

[1224] This system obtains golf course information and weather data to provide users with optimal shot advice. It also analyzes users' emotions in real time and generates and provides mental support messages as needed. Furthermore, in physical stores, it obtains product information and provides personalized product suggestions and promotional information to customers.

[1225] Collection and display of golf course information

[1226] Obtaining golf course information

[1227] When a user operates a terminal and selects a course to play from a golf course selection menu, the server receives the identification information of the selected golf course. The server then retrieves detailed information about the course from the database and sends it to the terminal. The terminal analyzes the information and displays it to the user.

[1228] Acquire and display weather conditions and turf conditions

[1229] Obtaining weather data

[1230] The server calls a specific weather information API to obtain real-time weather data around the golf course, which is then sent to the device and displayed for the user to view in real time.

[1231] Get the grass condition

[1232] The server collects information on the length and condition of the grass provided by the golf course manager and transmits it to the terminal, which then analyzes the data and displays it to the user.

[1233] Providing shot advice

[1234] Shot advice generation

[1235] The device uses its GPS function to acquire the user's current location and, based on this, identifies the hole on which the user plans to take a shot. The server generates optimal shot advice based on the user's location information and weather data. The generated shot advice is sent to the device and displayed to the user.

[1236] Providing mental support using an emotion engine

[1237] Emotion Engine Operation

[1238] The device uses the user's facial recognition camera and voice analysis function to analyze the user's facial expressions and tone of voice in real time to determine their emotional state. This data is further analyzed on the server, and mental support messages are generated as needed. The generated messages are then sent to the device and displayed to the user.

[1239] Smart customer service in physical stores

[1240] Customer Sentiment Analysis

[1241] The device's built-in facial recognition camera and voice analysis functions are used to analyze the customer's facial expressions and tone of voice in real time to determine their emotional state.

[1242] Obtaining and displaying product information

[1243] When a store staff member selects a specific product, the server retrieves detailed information about that product from the database and sends it to the terminal, which then displays the product information to the staff member.

[1244] Personalized customer service

[1245] The server generates optimal product suggestions and promotional information based on the customer's emotional state, past purchase history, and current in-store conditions. The generated information is sent to the customer's terminal and displayed to them.

[1246] Mental support

[1247] If the device detects that the customer is tired or anxious, it will provide mental support messages such as "Relax and enjoy your shopping."

[1248] Hardware and software used

[1249] Hardware:

[1250] Smart glasses and head-mounted displays

[1251] Facial Recognition Camera

[1252] Microphone (for voice recognition)

[1253] software:

[1254] OpenCV: Used for face recognition processing

[1255] emotion_recognition library: used for emotion analysis

[1256] requests: An HTTP client for making API requests

[1257] text_to_speech library: converts text messages into speech

[1258] Specific examples

[1259] For example, when a golf player wants to play at a certain golf course, the user first selects the golf course. The device requests information about that course from the server, and the server retrieves detailed course information from a database and sends it to the device. The device then displays this to the user. The server also obtains real-time weather data from a weather information API and collects information about the condition of the grass from the golf course manager. This information is also sent to the device and displayed for the user to check. Then, when the user takes a shot, the device generates optimal shot advice based on the user's location information and provides this to the user. Furthermore, the device uses a facial recognition camera and voice analysis functions to recognize the user's emotions and provides mental support according to those emotions.

[1260] Prompt Sentence Examples

[1261] "To provide a new shopping experience, we propose a system that obtains all information in real time and provides personalized advice based on the customer's emotional state."

[1262] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1263] Step 1:

[1264] When a user operates a terminal to select a course to play from the golf course selection menu, the server receives the identification information of that golf course. The server inputs the golf course ID and outputs the course information retrieved from the database. Specifically, the server searches the database for the corresponding course information and retrieves it.

[1265] Step 2:

[1266] The server calls the weather information API to obtain real-time weather data for the area around the golf course. The input is the location of the golf course, and the output is weather data such as wind speed, wind direction, temperature, and precipitation probability. Specifically, the server sends a request to the API endpoint and analyzes the returned weather data.

[1267] Step 3:

[1268] The device obtains the user's location information using its GPS function. The input is coordinate data obtained from the GPS, and the output is location information that identifies the current location. Specifically, the device obtains GPS signals in real time and analyzes them to determine the location information.

[1269] Step 4:

[1270] The server generates optimal shot advice based on the user's location information, course information, and weather data. The input is location information, course information, and weather data, and the output is shot advice. Specifically, the server analyzes this data and calculates the optimal club and shot direction based on the rules of golf and physical principles.

[1271] Step 5:

[1272] The terminal displays the shot advice generated by the server to the user. The input is the shot advice sent from the server, and the output is the advice visually displayed to the user. As a specific operation, the terminal displays the advice on the screen in an appropriate format.

[1273] Step 6:

[1274] The device uses the user's facial recognition camera and voice analysis functions to capture the user's facial expressions and tone of voice in real time and determine their emotional state. The input is real-time data from the camera and microphone, and the output is the analyzed emotional state. Specifically, the device performs image processing and voice analysis, and identifies the emotional state using an emotion engine.

[1275] Step 7:

[1276] The server receives the user's emotional data and generates a mental support message as needed. The input is emotional data, and the output is a mental support message. Specifically, the server analyzes the emotional data and automatically generates a message appropriate to the user's condition.

[1277] Step 8:

[1278] The terminal displays the mental support message sent from the server to the user. The input is the mental support message sent from the server, and the output is the message displayed visually and audibly to the user. In specific operation, the terminal conveys the message to the user using the screen and audio output.

[1279] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1280] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1281] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1282] [Third embodiment]

[1283] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1284] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1285] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1286] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1287] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1288] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1289] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1290] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1291] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1292] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1293] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1294] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1295] The present invention is a system for providing advanced caddie services to golf players. Specific embodiments of the system will be described below.

[1296] Collection and display of golf course information

[1297] Obtaining golf course information

[1298] The user selects a golf course on a device (smartphone, tablet, etc.).

[1299] The terminal transmits the identification information of the selected golf course to the server.

[1300] The server retrieves detailed course information (distance, par three, bunker location, designer information, etc.) from the database.

[1301] The server transmits the acquired course information to the terminal.

[1302] The terminal displays the received course information to the user.

[1303] Acquire and display weather conditions and turf conditions

[1304] Obtaining weather data

[1305] The server calls the weather information API to obtain real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.) around the golf course.

[1306] The server transmits the weather data to the terminal.

[1307] The terminal displays this weather data to the user.

[1308] Get the grass condition

[1309] The server collects information about the length and condition of the grass provided by the golf course superintendent.

[1310] The server transmits the grass condition data to the terminal.

[1311] The terminal displays this grass condition data to the user.

[1312] Providing shot advice

[1313] Shot advice generation

[1314] The device obtains the user's location information via GPS and identifies the hole where the shot is planned to be taken.

[1315] The server generates optimal shot advice based on the acquired weather data and the user's location information. For example, it provides advice on the appropriate club selection and shot direction based on wind speed and direction.

[1316] The server transmits the generated shot advice to the terminal.

[1317] The terminal displays shot advice to the user.

[1318] Providing mental support

[1319] Mental support generation

[1320] The device monitors the user's playing status and evaluates past score data and current score.

[1321] Based on this, the server automatically generates messages of encouragement and comfort.

[1322] The server transmits the generated mental support message to the terminal.

[1323] The terminal displays these messages to the user.

[1324] Providing feedback during practice

[1325] Swing data acquisition and analysis

[1326] The user selects the practice mode.

[1327] The device collects the user's swing data (swing speed, angle, direction) in real time using a sensor (such as a smart swing analyzer).

[1328] The terminal transmits the acquired swing data to the server.

[1329] Feedback Generation

[1330] The server compares the swing data of the professional golfer with the swing data of the user.

[1331] The server generates swing improvement advice based on the comparison results. For example, if the swing speed is slow, the server will give specific advice such as "Turn your hips more to increase your swing speed."

[1332] The server transmits the generated swing improvement advice to the terminal.

[1333] The terminal displays swing improvement advice to the user.

[1334] Specific examples

[1335] For example, if a user wants to play at a golf course, he or she first selects the golf course. The terminal then requests information about the course from the server, which then retrieves detailed course information from the database and sends it to the terminal, which then displays it to the user.

[1336] The server also retrieves real-time weather data from a weather information API and collects information about the condition of the turf from the golf course manager, which is also sent to the device and displayed for the user to review.

[1337] After that, when the user takes a shot, the device generates and provides optimal shot advice based on the user's location information. The system also automatically provides psychological support to the user while they play.

[1338] During practice, the device captures swing data every time the user takes a swing and compares it with data from professional golfers to provide feedback, allowing the user to efficiently improve their swing technique.

[1339] The processing flow will be explained below.

[1340] Collection and display of golf course information

[1341] Step 1:

[1342] The user operates the terminal and selects the course to play from the golf course selection menu.

[1343] Step 2:

[1344] The terminal transmits the identification information (such as an ID) of the selected golf course to the server.

[1345] Step 3:

[1346] The server uses the received course ID to retrieve detailed information about the course from the database.

[1347] Step 4:

[1348] The server sends the detailed course information (distance, par three, bunker location, designer information, etc.) to the terminal.

[1349] Step 5:

[1350] The device analyzes the course information it receives and displays it on the screen.

[1351] Acquire and display weather conditions and turf conditions

[1352] Step 1:

[1353] The server calls a specific weather information API to obtain real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.) around the golf course.

[1354] Step 2:

[1355] The server also sends a request to the golf course superintendent's system to collect turf length and condition information provided by the superintendent.

[1356] Step 3:

[1357] The server integrates the weather data and grass information it has acquired and sends it to the terminal.

[1358] Step 4:

[1359] The terminal displays weather data and turf information to the user in real time.

[1360] Providing shot advice

[1361] Step 1:

[1362] The device uses its GPS function to obtain the user's current location and, based on this, identifies the hole on which the shot is to be taken.

[1363] Step 2:

[1364] The server generates optimal shot advice based on the user's location and weather data, such as calculating club selection and shot direction taking into account the effects of wind.

[1365] Step 3:

[1366] The server transmits the generated shot advice to the terminal.

[1367] Step 4:

[1368] The terminal displays shot advice to the user.

[1369] Providing mental support

[1370] Step 1:

[1371] The device monitors the user's playing status (score and success of shots).

[1372] Step 2:

[1373] The server receives the user's playing data and analyzes their current performance in comparison with past score data.

[1374] Step 3:

[1375] Based on the analysis, the server generates encouraging or comforting messages as needed, such as "You can recover on your next shot."

[1376] Step 4:

[1377] The server generates a message and sends it to the terminal.

[1378] Step 5:

[1379] The terminal displays a mental support message to the user.

[1380] Providing feedback during practice

[1381] Step 1:

[1382] The user selects practice mode on the device.

[1383] Step 2:

[1384] The device uses sensors to collect the user's swing data (swing speed, angle, direction, etc.) in real time.

[1385] Step 3:

[1386] The swing data acquired by the terminal is transmitted to the server.

[1387] Step 4:

[1388] The server analyzes the user's swing by comparing it with a database of swings from professional golfers.

[1389] Step 5:

[1390] Based on the comparison results, the server generates swing improvement advice for the user, such as "make your backswing a little higher."

[1391] Step 6:

[1392] The server transmits the generated swing improvement advice to the terminal.

[1393] Step 7:

[1394] The terminal displays swing improvement advice to the user.

[1395] Example 1

[1396] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1397] For golf players, obtaining course information and weather data in real time and receiving optimal shot advice while playing is essential to improving their scores. However, with current technology, players must individually check course information, weather data, and turf conditions, which takes time and effort to receive appropriate shot advice. Furthermore, there is a lack of ways to compare one's own swing data with that of professional golfers, making efficient practice difficult. Furthermore, there is a lack of mental support during play, making it difficult for players to maintain motivation. There is a need for an advanced caddie service that can solve these issues and provide consistent support to golf players.

[1398] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1399] In this invention, the server includes means for acquiring course information from a golf course database, means for acquiring real-time weather data from a weather information API, means for acquiring user location information and generating optimal shot advice based on the course information and weather data, means for collecting turf condition data from golf course managers, means for evaluating past score data and current score data and generating mental support messages, and means for referencing swing data of professional golfers and comparing it with the user's swing data. This makes it possible to provide the user with optimal shot advice, turf condition information, and mental support messages in real time, as well as swing improvement advice during practice based on comparison with professional golfer data.

[1400] A "golf course database" is a structured data store that stores detailed information about golf courses (distances, par threes, bunker locations, designer information, etc.).

[1401] The "Weather Information API" is an application programming interface for obtaining real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.).

[1402] "User location information" is GPS data that indicates the user's current location.

[1403] "Optimal shot advice" refers to instructions on the best shot and club selection that a user should take based on golf course information, weather data, and the like.

[1404] "Turf condition data" is information about the length and health of the grass on a golf course.

[1405] "Mental support messages" are words of encouragement and comfort provided to keep users motivated.

[1406] "Professional golfer swing data" refers to motion data (swing speed, angle, direction, etc.) of a professional golfer when swinging.

[1407] "User swing data" refers to motion data (swing speed, angle, direction, etc.) when the user swings.

[1408] The "comparison result" is an evaluation when comparing the swing data of a professional golfer with the swing data of the user.

[1409] "Swing improvement advice" is specific instructions for the user to improve their swing based on the results of comparing the user's swing data with swing data of a professional golfer.

[1410] "Strategic advice" is an instruction that suggests an effective strategy for a particular hole based on the user's score data.

[1411] This invention is a system that provides advanced caddie services to golf players. Specifically, it includes functions such as collecting and displaying golf course information, acquiring and displaying weather conditions and turf conditions, providing shot advice, providing mental support, and providing feedback during practice. Each process in this system is performed in real time between the server, the terminal, and the user.

[1412] First, a user selects a golf course using a device such as a smartphone or tablet. The device sends identification information for the selected golf course to a server, which then retrieves the course information from a database. In terms of specific hardware, in the first processing step, the device communicates with the server using an HTTP request, and the server retrieves the information using a relational database management system (RDBMS). The retrieved information is then sent to the device, which displays it to the user.

[1413] The server then calls a weather information API to obtain real-time weather data for the area around the golf course. The server then queries the weather information API, again using the HTTP protocol, and transmits the obtained data back to the terminal. In this invention, existing weather information APIs, such as the OpenWeatherMap API, can be used. The terminal analyzes this weather data and visually displays it to the user. The server also collects turf condition data from the golf course manager. This data is also transmitted to the terminal, where it can be viewed by the user.

[1414] When a user takes a shot, the device uses its GPS function to obtain the user's location. Based on this location information and previously obtained weather and course information, the server generates optimal shot advice. Using a generative AI model, data such as wind speed, direction, and distance is analyzed to generate specific advice on club selection and shot direction. For example, advice such as "The wind speed is 5 m / s blowing from east to west. Aim 8 yards to the right with a 7 iron" is displayed.

[1415] Furthermore, the system automatically generates mental support messages by monitoring the user's playing status and evaluating past and current score data. The server uses a generative AI model to generate encouraging and comforting messages and sends them to the device. For example, a message such as "You're doing well in the first half, so keep it up and do your best in the second half" is displayed.

[1416] When practicing, if the user selects practice mode, the device will use a sensor (e.g., a smart swing analyzer) to collect the user's swing data in real time. This data will be sent to a server and compared with swing data from professional golfers. Based on the comparison results, the server will generate swing improvement advice for the user. For example, specific advice such as "Your swing speed is slow, so try rotating your hips more to increase your swing speed" will be displayed on the device.

[1417] Specific examples

[1418] For example, if a user wants to play at a golf course, they first launch the app and select the golf course. The device sends the selection to the server, which then retrieves detailed course information from a database and sends it to the device. The device then displays this information to the user. At the same time, the server retrieves real-time weather data from a weather information API and collects information about the turf condition from the golf course manager. This information is also sent to the device and displayed for the user to review. Then, when the user takes a shot, the device generates optimal shot advice based on the user's location and provides this advice to the user. The system also automatically generates support messages based on the user's mental state during play and displays them to the user. During practice, the device collects swing data every time the user takes a swing and compares it with data from professional golfers to provide feedback. This allows users to efficiently improve their swing technique.

[1419] Prompt Sentence Examples

[1420] "Please explain the system that allows users to select golf practice mode, acquire and analyze swing data, and provide swing improvement advice."

[1421] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1422] Step 1:

[1423] The user selects a golf course on a device (smartphone, tablet, etc.).

[1424] Input: The user interacts with the app's interface and selects the golf course they want to play.

[1425] Action: The user interacts with a drop-down menu, search bar, or selection feature on a map.

[1426] Output: Identification information (ID, name, etc.) of the selected golf course.

[1427] Step 2:

[1428] The terminal transmits the identification information of the selected golf course to the server.

[1429] Input: The identification of the selected golf course.

[1430] How it works: The device sends the identification information of the selected golf course to the server using an HTTP request.

[1431] Output: The request data sent to the server.

[1432] Step 3:

[1433] The server retrieves detailed course information (distance, par three, bunker location, designer information, etc.) from the database.

[1434] Input: Golf course identification.

[1435] How it works: The server queries the RDBMS to extract detailed course information.

[1436] Output: Golf course details are retrieved on the server.

[1437] Step 4:

[1438] The server transmits the acquired course information to the terminal.

[1439] Input: Golf course details.

[1440] Operation: The server converts the acquired course information into JSON format and sends it to the device as an HTTP response.

[1441] Output: JSON data of the course information sent to the device.

[1442] Step 5:

[1443] The terminal displays the received course information to the user.

[1444] Input: JSON data with golf course details.

[1445] How it works: The device parses the JSON data and displays it to the user in a visually friendly format.

[1446] Output: Detailed golf course information displayed to the user (layout diagram, hole-by-hole information, etc.).

[1447] Step 6:

[1448] The server calls the weather information API to obtain real-time weather data around the golf course.

[1449] Input: Latitude and longitude information of the golf course.

[1450] How it works: The server queries the weather API endpoint to retrieve weather data.

[1451] Output: Real-time weather data retrieved from the API.

[1452] Step 7:

[1453] The server sends the weather data to the device.

[1454] Input: Weather data.

[1455] How it works: The server sends weather data in JSON format to the device.

[1456] Output: JSON data of the weather data sent to the device.

[1457] Step 8:

[1458] The terminal displays this weather data to the user.

[1459] Input: Weather data in JSON format.

[1460] How it works: The device parses the JSON data and displays it to the user in a visually friendly format.

[1461] Output: Weather information displayed to the user (wind speed, direction, temperature, chance of precipitation, etc.).

[1462] Step 9:

[1463] A server collects turf condition data from golf course managers.

[1464] Input: Information about the condition of the grass.

[1465] How it works: The server collects information through an upload interface for golf course managers.

[1466] Output: Grass condition data stored on the server.

[1467] Step 10:

[1468] The server sends the grass condition data to the terminal.

[1469] Input: Turf condition data.

[1470] How it works: The server sends grass status data in JSON format to the device.

[1471] Output: JSON data of the grass condition data sent to the terminal.

[1472] Step 11:

[1473] The terminal displays this grass condition data to the user.

[1474] Input: JSON data of grass condition data.

[1475] How it works: The device parses the JSON data and displays it to the user in a visually friendly format.

[1476] Output: Grass condition information (length, health, etc.) displayed to the user.

[1477] Step 12:

[1478] The device obtains the user's location information via GPS and identifies the hole where the shot is planned to be taken.

[1479] Input: User location (GPS data).

[1480] How it works: The device uses GPS to determine the user's current location and runs an algorithm to identify the specific hole.

[1481] Output: User's current location and identified hole information.

[1482] Step 13:

[1483] The server generates optimal shot advice based on weather data and the user's location information.

[1484] Input: Weather data, user location, course information.

[1485] How it works: The server uses a generative AI model to generate optimal shot advice based on input data.

[1486] Output: Shot advice generated.

[1487] Step 14:

[1488] The server transmits the generated shot advice to the terminal.

[1489] Input: Shot advice generation results.

[1490] How it works: The server converts the advice data into JSON format and sends it to the device.

[1491] Output: Shot advice data sent to the device.

[1492] Step 15:

[1493] The terminal displays shot advice to the user.

[1494] Input: Shot advice data.

[1495] How it works: The device parses the advice data and displays it to the user in a visually friendly format.

[1496] Output: Shot advice (club selection, shot direction, etc.) displayed to the user.

[1497] Step 16:

[1498] The device monitors the user's playing status and evaluates past score data and current score.

[1499] Input: User score data, playing status data.

[1500] Operation: The device records data locally and runs the evaluation algorithm.

[1501] Output: Evaluation result.

[1502] Step 17:

[1503] The server automatically generates a mental support message based on the evaluation results.

[1504] Input: Evaluation results, past score data.

[1505] How it works: The server uses a generative AI model to generate optimal mental support messages for each individual user.

[1506] Output: Mental support message.

[1507] Step 18:

[1508] A mental support message generated by the server is sent to the terminal.

[1509] Input: Mental support message.

[1510] Behavior: The server sends a mental support message in JSON format to the device.

[1511] Output: The emotional support message sent to the device.

[1512] Step 19:

[1513] The terminal displays these messages to the user.

[1514] Input: Mental support message.

[1515] What it does: The device parses the message and displays it in the form of a notification or a popup window.

[1516] Output: The emotional support message that will be displayed to the user.

[1517] Step 20:

[1518] The user selects the practice mode.

[1519] Input: User selection.

[1520] Action: The user selects Practice mode from the menu.

[1521] Output: Practice mode selection status.

[1522] Step 21:

[1523] The device uses sensors to collect the user's swing data (swing speed, angle, direction) in real time.

[1524] Input: The user's swing motion.

[1525] How it works: The sensor captures swing information and sends the data to your device.

[1526] Output: Swing data.

[1527] Step 22:

[1528] The swing data acquired by the terminal is transmitted to the server.

[1529] Input: Swing data.

[1530] Operation: The device sends swing data to the server.

[1531] Output: Swing data sent to the server.

[1532] Step 23:

[1533] The server compares the swing data of the professional golfer with the swing data of the user.

[1534] Input: User swing data, professional golfer swing data.

[1535] How it works: The server compares the user's data with the professional golfer data in its database.

[1536] Output: The comparison result.

[1537] Step 24:

[1538] The server generates swing improvement advice based on the comparison result.

[1539] Input: The comparison result.

[1540] How it works: The server uses a generative AI model to generate specific swing improvement advice.

[1541] Output: Swing improvement advice.

[1542] Step 25:

[1543] The server transmits the generated swing improvement advice to the terminal.

[1544] Enter: swing improvement advice.

[1545] How it works: The server sends advice in JSON format to the device.

[1546] Output: Swing improvement advice sent to the device.

[1547] Step 26:

[1548] The terminal displays swing improvement advice to the user.

[1549] Enter: swing improvement advice.

[1550] How it works: The device parses the advice and displays it in a visually friendly format.

[1551] Output: Swing improvement advice displayed to the user.

[1552] (Application example 1)

[1553] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1554] Conventional factory production line management has not been able to fully utilize environmental data and operator performance data, limiting its ability to improve work efficiency or provide psychological support. Another issue is the inability to provide optimal work advice in real time when the production environment fluctuates. A new system is needed to solve these problems, increase production line efficiency, and improve operator performance.

[1555] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1556] In this invention, the server includes a means for acquiring production line information from an industrial line database, a means for acquiring real-time environmental data from an industrial temperature sensor, and a means for generating work advice based on the operator's production efficiency data and environmental data. This makes it possible to provide optimal work advice based on the environmental data and performance data in real time, and also provide psychological support to the operator.

[1557] An "industrial line database" is a digital database for collectively recording and managing information about production lines within a factory.

[1558] "Production line information" is detailed data on the production processes within the factory, the operating status of production equipment, work procedures, work progress, etc.

[1559] An "industrial temperature sensor" is a sensor device that measures the temperature in a factory's working environment in real time and provides that data in digital format.

[1560] "Environmental data" refers to real-time data on the working environment within the factory, such as temperature, humidity, light intensity, and noise level.

[1561] "Operator" refers to workers and engineers who work directly on the production line.

[1562] "Production efficiency data" refers to data related to an operator's work efficiency and performance, such as information on work speed and production volume.

[1563] "Work advice" is advice that suggests optimal work methods and improvement measures to operators based on acquired environmental data and production efficiency data.

[1564] "Psychological support messages" are messages of psychological support and encouragement that are generated based on the operator's performance data.

[1565] The present invention is a production line assistant system that provides optimal work assistance and psychological support to operators working on production lines in a factory. Specific embodiments for realizing this system are described below.

[1566] Acquisition and display of production line information

[1567] The server retrieves production line information from the industrial line database. This information includes the production process, the operating status of production equipment, work procedures, work progress, etc. The server then sends this information to the terminal, which then displays it to the operator.

[1568] Acquiring and displaying environmental data

[1569] The server acquires real-time environmental data (temperature, humidity, illuminance, etc.) from environmental monitoring devices such as industrial temperature sensors. This data is also sent from the server to the terminal and displayed on the terminal for the operator to check.

[1570] Generation and display of work advice

[1571] The server generates optimal work advice based on the acquired production line information and environmental data. For example, if the temperature inside the factory is high, it generates advice to ask the operator to check the cooling system. The server sends this work advice to the terminal, which then displays it to the operator. This allows the operator to take appropriate action based on the current work environment.

[1572] Providing mental support

[1573] The server records and analyzes the operator's performance data (work efficiency, work speed, production volume, etc.) and automatically generates mental support messages. For example, for an operator whose work efficiency is declining, it generates a message such as "Take a short break and refresh yourself. You're doing a great job!" The server sends the generated mental support message to the terminal, which displays it to the operator.

[1574] Hardware and Software

[1575] To implement this system, the following hardware and software are used:

[1576] Hardware:

[1577] Industrial Temperature Sensors

[1578] Environmental Monitoring Devices

[1579] Terminals with human-machine interface (HMI)

[1580] software:

[1581] Database Management System (DBMS)

[1582] Software for making API calls

[1583] AI models for data analysis and advice generation

[1584] Specific examples

[1585] For example, if the temperature in a factory is rising, the server will receive real-time data from industrial temperature sensors and generate advice to the operator to check the cooling system. If work efficiency is declining, the server will generate a mental support message to the operator to take a break.

[1586] Example prompt sentence:

[1587] "The temperature in the factory is getting high, so please ask the operators to check the cooling system. Also, please send a message to operators whose work efficiency is declining, encouraging them to take a break."

[1588] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1589] Step 1:

[1590] The server retrieves production line information from the industrial line database. The input is a request to the database, and the output is production line information such as the production process, work procedures, and equipment operating status. The server sends this information to the terminal, which displays it to the operator.

[1591] Step 2:

[1592] The server acquires real-time environmental data (temperature, humidity, illuminance, etc.) from industrial temperature sensors. The input is the data acquired from the environmental sensors, and the output is real-time environmental information. The server sends this environmental data to the terminal, which displays it to the operator.

[1593] Step 3:

[1594] The server generates optimal work advice based on production line information and environmental data. The inputs are production line information and environmental data, and the output is work advice. For example, if the temperature is high, advice such as "Check the cooling system" is generated. The server sends this work advice to the terminal, which then displays it to the operator.

[1595] Step 4:

[1596] The server records and analyzes the operator's production efficiency data and generates mental support messages. The input is the operator's work efficiency data, and the output is a mental support message. For example, if work efficiency is declining, a message such as "Please take a short break and refresh yourself" is generated. The server sends this mental support message to the terminal, which then displays it to the operator.

[1597] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1598] The present invention is a system for providing advanced caddie services to golf players, and in particular, is combined with an emotion engine that recognizes the user's emotions. Specific embodiments of this system will be described below.

[1599] Collection and display of golf course information

[1600] Obtaining golf course information

[1601] The user operates the terminal and selects the course to play from the golf course selection menu.

[1602] The terminal transmits the identification information (such as an ID) of the selected golf course to the server.

[1603] The server uses the received course ID to retrieve detailed information about the course from the database.

[1604] The server sends the detailed course information (distance, par three, bunker location, designer information, etc.) to the terminal.

[1605] The device analyzes the course information it receives and displays it on the screen.

[1606] Acquire and display weather conditions and turf conditions

[1607] Obtaining weather data

[1608] The server calls a specific weather information API to obtain real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.) around the golf course.

[1609] The weather data acquired by the server is sent to the terminal.

[1610] The terminal displays weather data to the user in real time.

[1611] Get the grass condition

[1612] The server collects information on the length and condition of the grass provided by the golf course manager.

[1613] The server sends the grass information to the terminal.

[1614] The terminal displays the grass condition data to the user.

[1615] Providing shot advice

[1616] Shot advice generation

[1617] The device uses its GPS function to obtain the user's current location and, based on this, identifies the hole on which the shot is to be taken.

[1618] The server generates optimal shot advice based on the user's location and weather data, such as calculating club selection and shot direction taking into account the effects of wind.

[1619] The server transmits the generated shot advice to the terminal.

[1620] The terminal displays shot advice to the user.

[1621] Providing mental support using an emotion engine

[1622] Emotion Engine Operation

[1623] The device uses the user's facial recognition camera and voice analysis functions to analyze the user's facial expressions and tone of voice in real time to determine their emotional state.

[1624] The server analyzes the user's emotional data and generates mental support messages as needed. For example, if the user is nervous, it generates a message such as "Relax and take the shot with confidence."

[1625] A mental support message generated by the server is sent to the terminal.

[1626] The terminal displays a mental support message to the user.

[1627] Providing feedback during practice

[1628] Swing data acquisition and analysis

[1629] The user selects practice mode on the device.

[1630] The device uses sensors to collect the user's swing data (swing speed, angle, direction, etc.) in real time.

[1631] The swing data acquired by the terminal is transmitted to the server.

[1632] Feedback Generation

[1633] The server analyzes the user's swing by comparing it with a database of swings from professional golfers.

[1634] Based on the comparison results, the server generates swing improvement advice for the user, such as "make your backswing a little higher."

[1635] The server transmits the generated swing improvement advice to the terminal.

[1636] The terminal displays swing improvement advice to the user.

[1637] Specific examples

[1638] For example, if a user wants to play at a golf course, he or she first selects the golf course. The terminal then requests information about the course from the server, which then retrieves detailed course information from the database and sends it to the terminal, which then displays it to the user.

[1639] The server also retrieves real-time weather data from a weather information API and collects information about the condition of the turf from the golf course manager, which is also sent to the device and displayed for the user to review.

[1640] When the user takes a shot, the device generates and provides optimal shot advice based on the user's location information. It also uses a facial recognition camera and voice analysis functions to recognize the user's emotions and provide mental support according to their feelings.

[1641] During practice, the device collects swing data every time the user takes a swing and compares it with that of professional golfers to provide feedback. This allows users to efficiently improve their swing technique. Through this process, users can enjoy golf while receiving appropriate advice and mental support in real time.

[1642] The processing flow will be explained below.

[1643] Collection and display of golf course information

[1644] Step 1:

[1645] The user operates the terminal and selects the course to play from the golf course selection menu.

[1646] Step 2:

[1647] The terminal transmits the identification information (such as an ID) of the selected golf course to the server.

[1648] Step 3:

[1649] The server uses the received course ID to retrieve detailed information about the course from the database.

[1650] Step 4:

[1651] The server sends the detailed course information (distance, par three, bunker location, designer information, etc.) to the terminal.

[1652] Step 5:

[1653] The device analyzes the course information it receives and displays it on the screen.

[1654] Acquire and display weather conditions and turf conditions

[1655] Step 1:

[1656] The server calls a specific weather information API to obtain real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.) around the golf course.

[1657] Step 2:

[1658] The server sends the weather data to the device.

[1659] Step 3:

[1660] The terminal displays weather data to the user in real time.

[1661] Step 4:

[1662] The server collects information on the length and condition of the grass provided by the golf course manager.

[1663] Step 5:

[1664] The server sends the grass information to the terminal.

[1665] Step 6:

[1666] The terminal displays the grass condition data to the user.

[1667] Providing shot advice

[1668] Step 1:

[1669] The device uses its GPS function to obtain the user's current location and, based on this, identifies the hole on which the shot is to be taken.

[1670] Step 2:

[1671] The server generates optimal shot advice based on the user's location and weather data, for example, calculating club selection and shot direction taking into account the effects of wind.

[1672] Step 3:

[1673] The server transmits the generated shot advice to the terminal.

[1674] Step 4:

[1675] The terminal displays shot advice to the user.

[1676] Providing mental support using an emotion engine

[1677] Step 1:

[1678] The device uses the user's facial recognition camera and voice analysis functions to analyze the user's facial expressions and tone of voice in real time to determine their emotional state.

[1679] Step 2:

[1680] The terminal transmits the acquired user emotion data to the server.

[1681] Step 3:

[1682] The server analyzes the user's emotional data and generates mental support messages as needed. For example, if the user is nervous, it generates a message such as "Relax and take the shot with confidence."

[1683] Step 4:

[1684] A mental support message generated by the server is sent to the terminal.

[1685] Step 5:

[1686] The terminal displays a mental support message to the user.

[1687] Providing feedback during practice

[1688] Step 1:

[1689] The user selects practice mode on the device.

[1690] Step 2:

[1691] The device uses sensors to collect the user's swing data (swing speed, angle, direction, etc.) in real time.

[1692] Step 3:

[1693] The swing data acquired by the terminal is transmitted to the server.

[1694] Step 4:

[1695] The server analyzes the user's swing by comparing it with a database of swings from professional golfers.

[1696] Step 5:

[1697] Based on the comparison results, the server generates swing improvement advice for the user, such as "make your backswing a little higher."

[1698] Step 6:

[1699] The server transmits the generated swing improvement advice to the terminal.

[1700] Step 7:

[1701] The terminal displays swing improvement advice to the user.

[1702] Example 2

[1703] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1704] Golf players have difficulty quickly obtaining accurate course and weather information while playing. Furthermore, there are limited ways to effectively receive mental support tailored to the player's emotions and feedback on swing improvement. Conventional caddie services have difficulty providing this information and support in real time, and this invention aims to solve this problem.

[1705] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for the user to select a course to play from a golf course selection menu and the terminal to transmit identification information of the course to the server; means for the server to obtain detailed information about the selected golf course from a database and transmit it to the terminal; means for the server to obtain real-time weather data using a weather information API and transmit it to the terminal; means for the terminal to obtain the user's current location using a GPS and for the server to generate optimal shot advice based on the location information and weather data and transmit it to the terminal; means for the terminal to analyze the obtained detailed information about the golf course, weather data, and shot advice and display them on the screen; means for the server to determine the user's emotions in real time using a face recognition camera or a voice analysis function and generate a mental support message as needed; means for the terminal to display the mental support message to the user; means for the user to select a practice mode on the terminal and for the terminal to obtain swing data through a sensor and transmit it to the server; means for the server to compare the user's swing data with a database of professional golfers and generate swing improvement advice; and means for the terminal to display the swing improvement advice to the user. This will enable golf players to receive accurate course information, weather information, shot advice, emotional support, and feedback on swing improvement in real time.

[1706] "User" refers to a golf player who operates the system and receives various information and services.

[1707] A "terminal" is a device that is operated by a user and displays various information, and includes smartphones, tablet PCs, etc.

[1708] "Server" refers to a computer system that processes various data and transmits information to terminals.

[1709] "Golf course selection menu" refers to an interface that allows a user to select a golf course to play.

[1710] "Identification information" is information that uniquely identifies a particular golf course, and includes the course ID, name, etc.

[1711] "Database" refers to the data structure that stores detailed golf course information and is accessed by the server.

[1712] "Weather Information API" means an application programming interface that provides real-time weather data for a specific location.

[1713] "GPS" refers to a satellite system for obtaining geographic location information.

[1714] "Shot advice" refers to information that suggests the optimal club selection and shot direction when the user hits a golf ball.

[1715] A "face recognition camera" refers to a camera system that analyzes a user's facial expressions.

[1716] "Voice analysis function" refers to technology that analyzes the tone of a user's voice and determines their emotional state.

[1717] "Mental support messages" refer to messages containing encouragement or advice that are generated according to the user's emotional state.

[1718] "Practice mode" refers to the operating mode of the system used by a user to practice their golf swing.

[1719] "Sensor" refers to a device for acquiring user swing data in real time.

[1720] "Swing data" refers to data such as the speed, angle, and direction of a user's golf swing.

[1721] "Professional golfer database" refers to a database that stores swing data of professional golfers and compares it with the user's swing data.

[1722] "Swing improvement advice" refers to specific suggestions for improving the user's swing.

[1723] The present invention is a system for providing advanced caddie services to golf players, including golf course information, real-time weather data, turf conditions, shot advice, emotional support, and swing improvement feedback. Specific embodiments of the system are described below.

[1724] Collection and display of golf course information

[1725] First, the user operates the device to select the course they wish to play from the golf course selection menu. The device then sends the identification information (such as ID) of that course to the server. The server then retrieves detailed information about the corresponding course from its database based on the received course ID. This information includes distance, par three, bunker location, and designer information. The retrieved course information is then sent from the server to the device, which then displays it. The device then uses HTML5 and JavaScript to display the information on the user interface.

[1726] Acquire and display weather conditions and turf conditions

[1727] The server calls a specific weather information API (e.g., OpenWeatherMap API) to obtain real-time weather data around the golf course. This data includes wind speed, wind direction, temperature, and chance of precipitation. The server sends the obtained weather data to the terminal, which then displays the weather data to the user in real time. A graphical UI component (e.g., Chart.js) is used for display. In addition, the server collects information about the length and condition of the grass from the golf course manager and sends it to the terminal. The terminal displays this information to the user.

[1728] Providing shot advice

[1729] When a user takes a shot, the device uses its GPS to obtain the user's current location. The server generates optimal shot advice based on the location information and weather data. This advice is generated using a machine learning model (e.g., TensorFlow) to calculate club selection and shot direction taking into account the effects of wind. The generated shot advice is sent from the server to the device and displayed on the device.

[1730] Providing mental support using an emotion engine

[1731] The device uses the user's facial recognition camera and voice analysis functions (e.g., OpenCV and Google Speech-to-Text API) to analyze the user's facial expressions and tone of voice in real time to determine their emotional state. The server analyzes this emotional data and generates mental support messages as needed. For example, if the user is nervous, it generates a message such as "Relax and take the shot with confidence." The generated mental support message is sent from the server to the device and displayed on the device. It can be displayed in both text and voice.

[1732] Providing feedback during practice

[1733] The user selects practice mode on the device, and the device acquires the user's swing data through a sensor (e.g., a motion capture sensor). The acquired swing data is sent from the device to a server, which compares the user's swing data with a database of professional golfers. Based on the comparison results, the server generates swing improvement advice for the user. For example, it provides specific advice such as "make your backswing a little higher." The generated swing improvement advice is sent from the server to the device and displayed on the device. This display can use 3D animation to demonstrate the correct swing movement.

[1734] Specific examples

[1735] For example, if a user wants to play at a golf course, they first select the golf course. The device requests information about that course from the server, which retrieves detailed course information from a database and sends it to the device. The device then displays this to the user. The server also retrieves real-time weather data from a weather information API (e.g., OpenWeatherMap API) and collects information about the condition of the grass from the golf course manager. This information is also sent to the device and displayed for the user to review.

[1736] When the user takes a shot, the device generates and provides optimal shot advice based on the user's location information. It also uses a facial recognition camera and voice analysis functions to recognize the user's emotions and provides mental support according to their emotions.

[1737] During practice, the device collects swing data every time the user takes a swing and provides feedback by comparing it with data from professional golfers. This allows users to efficiently improve their swing technique. Through this process, users can enjoy golf while receiving appropriate advice and mental support in real time.

[1738] Example of input prompt for generative AI model

[1739] "This system provides advanced caddie services to golf players. Specifically, it includes golf course information, real-time weather data, turf conditions, shot advice, emotional mental support, and swing feedback. Please explain in detail the functions that provide all of the following: the golf course selected by the user and its detailed information, real-time weather data, generation and display of shot advice, emotional recognition and mental support for the user, and collection and analysis of swing data."

[1740] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1741] Step 1:

[1742] The user selects the course to play from the golf course selection menu.

[1743] Input: The user makes a selection on the device, selecting the golf course to play.

[1744] Output: ID and name of selected golf course

[1745] Specific operation: The terminal acquires the identification information of the golf course selected by the user's operation and transmits the selection result to the server.

[1746] Step 2:

[1747] The server retrieves the details of the selected golf course from the database.

[1748] Input: Golf course ID or name

[1749] Output: Detailed golf course information (distance, par three, bunker location, designer information, etc.)

[1750] Specific operation: The server executes a database query to obtain detailed information corresponding to the submitted golf course ID.

[1751] Step 3:

[1752] The server transmits the acquired detailed information about the golf course to the terminal.

[1753] Input: Golf course details

[1754] Output: Sending data to the terminal

[1755] Specific operation: The server converts the acquired data into a certain format (e.g., JSON) and sends it to the terminal.

[1756] Step 4:

[1757] The terminal displays detailed information about the golf course received.

[1758] Input: Golf course details sent from the server

[1759] Output: Course information displayed in the user interface

[1760] Specific operation: The device analyzes the received data using HTML5 and JavaScript and displays it in the user interface in map or text format.

[1761] Step 5:

[1762] The server uses a specific weather information API to obtain real-time weather data.

[1763] Input: Golf course location information

[1764] Output: Real-time weather data (wind speed, wind direction, temperature, precipitation probability, etc.)

[1765] What happens: The server sends a request to a weather information API (e.g., OpenWeatherMap API) to retrieve weather data based on the location of the golf course.

[1766] Step 6:

[1767] The weather data acquired by the server is sent to the terminal.

[1768] Input: Real-time weather data

[1769] Output: Sending data to the terminal

[1770] Specific operation: The server sends the acquired weather data to the terminal in JSON format or similar.

[1771] Step 7:

[1772] The terminal displays the weather data to the user.

[1773] Input: Real-time weather data sent from the server

[1774] Output: Weather information displayed in the user interface

[1775] What it does: The device parses weather data and displays it visually using graphical UI components (e.g., Chart.js).

[1776] Step 8:

[1777] The device obtains the user's current location using the GPS function.

[1778] Input: GPS data of the device

[1779] Output: User's current location

[1780] Specific operation: The device uses the built-in GPS module to obtain the user's current location in real time and transmits the data to the server.

[1781] Step 9:

[1782] The server generates optimal shot advice based on location information and weather data.

[1783] Input: User location, real-time weather data

[1784] Output: Shot advice

[1785] How it works: The server uses machine learning models (e.g., TensorFlow) to calculate optimal club selection and shot direction based on the user's location and weather data.

[1786] Step 10:

[1787] The server transmits the generated shot advice to the terminal.

[1788] Input: Shot Advice

[1789] Output: Sending data to the terminal

[1790] Specific operation: The server sends the generated advice to the terminal in JSON format or similar.

[1791] Step 11:

[1792] The terminal displays shot advice to the user.

[1793] Input: Shot advice sent from the server

[1794] Output: Shot advice displayed in the user interface

[1795] Specific operation: The device analyzes the shot advice and displays it in the user interface as text or graphics.

[1796] Step 12:

[1797] The device uses a facial recognition camera and voice analysis functions to analyze the user's facial expressions and tone of voice in real time.

[1798] Input: User's face image data and voice data

[1799] Output: User's emotional state

[1800] Specific operation: The device analyzes the data using a facial recognition camera (e.g., OpenCV) and voice analysis functions (e.g., Google Speech-to-Text API) and sends the emotional state to the server.

[1801] Step 13:

[1802] The server analyzes the emotional data and generates a mental support message as needed.

[1803] Input: User emotion data

[1804] Output: Mental support message

[1805] Specific operation: The server analyzes the emotional data and generates an appropriate mental support message depending on whether the user is nervous or not.

[1806] Step 14:

[1807] A mental support message generated by the server is sent to the terminal.

[1808] Input: Mental support message

[1809] Output: Sending data to the terminal

[1810] Specific operation: The server sends the generated mental support message to the terminal in JSON format or similar.

[1811] Step 15:

[1812] The terminal displays a mental support message to the user.

[1813] Input: Mental support message sent from the server

[1814] Output: A mental support message displayed in the user interface.

[1815] Specific operation: The terminal displays a mental support message in text or voice on the user interface.

[1816] Step 16:

[1817] The user selects practice mode, and the device uses sensors to acquire swing data.

[1818] Input: User swing motion

[1819] Output: Swing data

[1820] Specific operation: The device uses motion capture sensors to obtain data such as swing speed, angle, and direction in real time, and then transmits this data to a server.

[1821] Step 17:

[1822] The server compares the user's swing data with a database of professional golfers and generates swing improvement advice.

[1823] Input: User swing data, professional golfer data

[1824] Output: Swing improvement advice

[1825] Specific operation: The server uses a comparison algorithm to analyze the user's data and the data of professional golfers and generates advice including areas for improvement.

[1826] Step 18:

[1827] The server transmits the generated swing improvement advice to the terminal.

[1828] Input: Swing improvement advice

[1829] Output: Sending data to the terminal

[1830] Specific operation: The server sends the generated advice to the terminal in JSON format or similar.

[1831] Step 19:

[1832] The terminal displays swing improvement advice to the user.

[1833] Input: Swing improvement advice sent from the server

[1834] Output: Swing improvement advice displayed in the user interface

[1835] Specific operation: The device analyzes swing improvement advice and displays it on the user interface using 3D animation and text.

[1836] (Application example 2)

[1837] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1838] The present invention aims to provide a system that not only provides appropriate shot advice to users, but also grasps the user's emotional state in real time and provides mental support and personalized information based on that.Furthermore, it aims to improve the user experience by providing product suggestions and promotional information that are tailored to the customer's emotions, in addition to swing improvement and strategic advice.

[1839] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring course information from a golf course database, means for acquiring real-time weather data from a weather information API, means for acquiring user location information and generating optimal shot advice based on the course information and weather data, means for displaying the shot advice to the user, means for determining the user's emotions using a face recognition camera or voice analysis function and generating a mental support message as necessary, and means for displaying the mental support message to the user. This makes it possible to provide appropriate advice and support in real time that takes the user's emotional state into consideration.

[1840] A "golf course database" is a database that stores information about specific golf courses and provides detailed information about the courses that users play.

[1841] The "Weather Information API" is an application programming interface for obtaining real-time weather data, providing information such as wind speed, wind direction, temperature, and probability of precipitation.

[1842] "User location information" is data used to identify the user's current location using GPS or other means.

[1843] "Shot advice" suggests the best shot method to the user based on golf course information and weather data.

[1844] A "face recognition camera" is a camera that recognizes and analyzes a user's facial expressions.

[1845] The "voice analysis function" is a function that analyzes the tone and content of the user's voice to determine their emotional state.

[1846] A "mental support message" is a message that encourages the user to relax and feel more confident based on the user's emotional state.

[1847] "Professional golfer swing data" refers to information collected and analyzed from the swings of professional golfers, and serves as a benchmark for improving users' swing techniques.

[1848] "Score data" refers to the user's score data recorded while playing golf, and reflects the playing situation and results.

[1849] "Product Information" means detailed information about a particular product, including price, features, availability, etc.

[1850] "Personalized information" is information that is individualized and generated based on a user's past behavior and current emotional state.

[1851] The present invention is a system for providing advanced services to golf players and customers of brick-and-mortar stores. In particular, it is combined with an emotion engine that recognizes the user's emotions. Specific embodiments of the system are described below.

[1852] System Overview

[1853] This system obtains golf course information and weather data to provide users with optimal shot advice. It also analyzes users' emotions in real time and generates and provides mental support messages as needed. Furthermore, in physical stores, it obtains product information and provides personalized product suggestions and promotional information to customers.

[1854] Collection and display of golf course information

[1855] Obtaining golf course information

[1856] When a user operates a terminal and selects a course to play from a golf course selection menu, the server receives the identification information of the selected golf course. The server then retrieves detailed information about the course from the database and sends it to the terminal. The terminal analyzes the information and displays it to the user.

[1857] Acquire and display weather conditions and turf conditions

[1858] Obtaining weather data

[1859] The server calls a specific weather information API to obtain real-time weather data around the golf course, which is then sent to the device and displayed for the user to view in real time.

[1860] Get the grass condition

[1861] The server collects information on the length and condition of the grass provided by the golf course manager and transmits it to the terminal, which then analyzes the data and displays it to the user.

[1862] Providing shot advice

[1863] Shot advice generation

[1864] The device uses its GPS function to acquire the user's current location and, based on this, identifies the hole on which the user plans to take a shot. The server generates optimal shot advice based on the user's location information and weather data. The generated shot advice is sent to the device and displayed to the user.

[1865] Providing mental support using an emotion engine

[1866] Emotion Engine Operation

[1867] The device uses the user's facial recognition camera and voice analysis function to analyze the user's facial expressions and tone of voice in real time to determine their emotional state. This data is further analyzed on the server, and mental support messages are generated as needed. The generated messages are then sent to the device and displayed to the user.

[1868] Smart customer service in physical stores

[1869] Customer Sentiment Analysis

[1870] The device's built-in facial recognition camera and voice analysis functions are used to analyze the customer's facial expressions and tone of voice in real time to determine their emotional state.

[1871] Obtaining and displaying product information

[1872] When a store staff member selects a specific product, the server retrieves detailed information about that product from the database and sends it to the terminal, which then displays the product information to the staff member.

[1873] Personalized customer service

[1874] The server generates optimal product suggestions and promotional information based on the customer's emotional state, past purchase history, and current in-store conditions. The generated information is sent to the customer's terminal and displayed to them.

[1875] Mental support

[1876] If the device detects that the customer is tired or anxious, it will provide mental support messages such as "Relax and enjoy your shopping."

[1877] Hardware and software used

[1878] Hardware:

[1879] Smart glasses and head-mounted displays

[1880] Facial Recognition Camera

[1881] Microphone (for voice recognition)

[1882] software:

[1883] OpenCV: Used for face recognition processing

[1884] emotion_recognition library: used for emotion analysis

[1885] requests: An HTTP client for making API requests

[1886] text_to_speech library: converts text messages into speech

[1887] Specific examples

[1888] For example, when a golf player wants to play at a certain golf course, the user first selects the golf course. The device requests information about that course from the server, and the server retrieves detailed course information from a database and sends it to the device. The device then displays this to the user. The server also obtains real-time weather data from a weather information API and collects information about the condition of the grass from the golf course manager. This information is also sent to the device and displayed for the user to check. Then, when the user takes a shot, the device generates optimal shot advice based on the user's location information and provides this to the user. Furthermore, the device uses a facial recognition camera and voice analysis functions to recognize the user's emotions and provides mental support according to those emotions.

[1889] Prompt Sentence Examples

[1890] "To provide a new shopping experience, we propose a system that obtains all information in real time and provides personalized advice based on the customer's emotional state."

[1891] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1892] Step 1:

[1893] When a user operates a terminal to select a course to play from the golf course selection menu, the server receives the identification information of that golf course. The server inputs the golf course ID and outputs the course information retrieved from the database. Specifically, the server searches the database for the corresponding course information and retrieves it.

[1894] Step 2:

[1895] The server calls the weather information API to obtain real-time weather data for the area around the golf course. The input is the location of the golf course, and the output is weather data such as wind speed, wind direction, temperature, and precipitation probability. Specifically, the server sends a request to the API endpoint and analyzes the returned weather data.

[1896] Step 3:

[1897] The device obtains the user's location information using its GPS function. The input is coordinate data obtained from the GPS, and the output is location information that identifies the current location. Specifically, the device obtains GPS signals in real time and analyzes them to determine the location information.

[1898] Step 4:

[1899] The server generates optimal shot advice based on the user's location information, course information, and weather data. The input is location information, course information, and weather data, and the output is shot advice. Specifically, the server analyzes this data and calculates the optimal club and shot direction based on the rules of golf and physical principles.

[1900] Step 5:

[1901] The terminal displays the shot advice generated by the server to the user. The input is the shot advice sent from the server, and the output is the advice visually displayed to the user. As a specific operation, the terminal displays the advice on the screen in an appropriate format.

[1902] Step 6:

[1903] The device uses the user's facial recognition camera and voice analysis functions to capture the user's facial expressions and tone of voice in real time and determine their emotional state. The input is real-time data from the camera and microphone, and the output is the analyzed emotional state. Specifically, the device performs image processing and voice analysis, and identifies the emotional state using an emotion engine.

[1904] Step 7:

[1905] The server receives the user's emotional data and generates a mental support message as needed. The input is emotional data, and the output is a mental support message. Specifically, the server analyzes the emotional data and automatically generates a message appropriate to the user's condition.

[1906] Step 8:

[1907] The terminal displays the mental support message sent from the server to the user. The input is the mental support message sent from the server, and the output is the message displayed visually and audibly to the user. In specific operation, the terminal conveys the message to the user using the screen and audio output.

[1908] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1909] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1910] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1911] [Fourth embodiment]

[1912] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1913] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1914] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1915] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1916] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1917] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1918] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1919] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1920] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1921] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1922] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1923] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1924] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1925] The present invention is a system for providing advanced caddie services to golf players. Specific embodiments of the system will be described below.

[1926] Collection and display of golf course information

[1927] Obtaining golf course information

[1928] The user selects a golf course on a device (smartphone, tablet, etc.).

[1929] The terminal transmits the identification information of the selected golf course to the server.

[1930] The server retrieves detailed course information (distance, par three, bunker location, designer information, etc.) from the database.

[1931] The server transmits the acquired course information to the terminal.

[1932] The terminal displays the received course information to the user.

[1933] Acquire and display weather conditions and turf conditions

[1934] Obtaining weather data

[1935] The server calls the weather information API to obtain real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.) around the golf course.

[1936] The server transmits the weather data to the terminal.

[1937] The terminal displays this weather data to the user.

[1938] Get the grass condition

[1939] The server collects information about the length and condition of the grass provided by the golf course superintendent.

[1940] The server transmits the grass condition data to the terminal.

[1941] The terminal displays this grass condition data to the user.

[1942] Providing shot advice

[1943] Shot advice generation

[1944] The device obtains the user's location information via GPS and identifies the hole where the shot is planned to be taken.

[1945] The server generates optimal shot advice based on the acquired weather data and the user's location information. For example, it provides advice on the appropriate club selection and shot direction based on wind speed and direction.

[1946] The server transmits the generated shot advice to the terminal.

[1947] The terminal displays shot advice to the user.

[1948] Providing mental support

[1949] Mental support generation

[1950] The device monitors the user's playing status and evaluates past score data and current score.

[1951] Based on this, the server automatically generates messages of encouragement and comfort.

[1952] The server transmits the generated mental support message to the terminal.

[1953] The terminal displays these messages to the user.

[1954] Providing feedback during practice

[1955] Swing data acquisition and analysis

[1956] The user selects the practice mode.

[1957] The device collects the user's swing data (swing speed, angle, direction) in real time using a sensor (such as a smart swing analyzer).

[1958] The terminal transmits the acquired swing data to the server.

[1959] Feedback Generation

[1960] The server compares the swing data of the professional golfer with the swing data of the user.

[1961] The server generates swing improvement advice based on the comparison results. For example, if the swing speed is slow, the server will give specific advice such as "Turn your hips more to increase your swing speed."

[1962] The server transmits the generated swing improvement advice to the terminal.

[1963] The terminal displays swing improvement advice to the user.

[1964] Specific examples

[1965] For example, if a user wants to play at a golf course, he or she first selects the golf course. The terminal then requests information about the course from the server, which then retrieves detailed course information from the database and sends it to the terminal, which then displays it to the user.

[1966] The server also retrieves real-time weather data from a weather information API and collects information about the condition of the turf from the golf course manager, which is also sent to the device and displayed for the user to review.

[1967] After that, when the user takes a shot, the device generates and provides optimal shot advice based on the user's location information. The system also automatically provides psychological support to the user while they play.

[1968] During practice, the device captures swing data every time the user takes a swing and compares it with data from professional golfers to provide feedback, allowing the user to efficiently improve their swing technique.

[1969] The processing flow will be explained below.

[1970] Collection and display of golf course information

[1971] Step 1:

[1972] The user operates the terminal and selects the course to play from the golf course selection menu.

[1973] Step 2:

[1974] The terminal transmits the identification information (such as an ID) of the selected golf course to the server.

[1975] Step 3:

[1976] The server uses the received course ID to retrieve detailed information about the course from the database.

[1977] Step 4:

[1978] The server sends the detailed course information (distance, par three, bunker location, designer information, etc.) to the terminal.

[1979] Step 5:

[1980] The device analyzes the course information it receives and displays it on the screen.

[1981] Acquire and display weather conditions and turf conditions

[1982] Step 1:

[1983] The server calls a specific weather information API to obtain real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.) around the golf course.

[1984] Step 2:

[1985] The server also sends a request to the golf course superintendent's system to collect turf length and condition information provided by the superintendent.

[1986] Step 3:

[1987] The server integrates the weather data and grass information it has acquired and sends it to the terminal.

[1988] Step 4:

[1989] The terminal displays weather data and turf information to the user in real time.

[1990] Providing shot advice

[1991] Step 1:

[1992] The device uses its GPS function to obtain the user's current location and, based on this, identifies the hole on which the shot is to be taken.

[1993] Step 2:

[1994] The server generates optimal shot advice based on the user's location and weather data, such as calculating club selection and shot direction taking into account the effects of wind.

[1995] Step 3:

[1996] The server transmits the generated shot advice to the terminal.

[1997] Step 4:

[1998] The terminal displays shot advice to the user.

[1999] Providing mental support

[2000] Step 1:

[2001] The device monitors the user's playing status (score and success of shots).

[2002] Step 2:

[2003] The server receives the user's playing data and analyzes their current performance in comparison with past score data.

[2004] Step 3:

[2005] Based on the analysis, the server generates encouraging or comforting messages as needed, such as "You can recover on your next shot."

[2006] Step 4:

[2007] The server generates a message and sends it to the terminal.

[2008] Step 5:

[2009] The terminal displays a mental support message to the user.

[2010] Providing feedback during practice

[2011] Step 1:

[2012] The user selects practice mode on the device.

[2013] Step 2:

[2014] The device uses sensors to collect the user's swing data (swing speed, angle, direction, etc.) in real time.

[2015] Step 3:

[2016] The swing data acquired by the terminal is transmitted to the server.

[2017] Step 4:

[2018] The server analyzes the user's swing by comparing it with a database of swings from professional golfers.

[2019] Step 5:

[2020] Based on the comparison results, the server generates swing improvement advice for the user, such as "make your backswing a little higher."

[2021] Step 6:

[2022] The server transmits the generated swing improvement advice to the terminal.

[2023] Step 7:

[2024] The terminal displays swing improvement advice to the user.

[2025] Example 1

[2026] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2027] For golf players, obtaining course information and weather data in real time and receiving optimal shot advice while playing is essential to improving their scores. However, with current technology, players must individually check course information, weather data, and turf conditions, which takes time and effort to receive appropriate shot advice. Furthermore, there is a lack of ways to compare one's own swing data with that of professional golfers, making efficient practice difficult. Furthermore, there is a lack of mental support during play, making it difficult for players to maintain motivation. There is a need for an advanced caddie service that can solve these issues and provide consistent support to golf players.

[2028] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2029] In this invention, the server includes means for acquiring course information from a golf course database, means for acquiring real-time weather data from a weather information API, means for acquiring user location information and generating optimal shot advice based on the course information and weather data, means for collecting turf condition data from golf course managers, means for evaluating past score data and current score data and generating mental support messages, and means for referencing swing data of professional golfers and comparing it with the user's swing data. This makes it possible to provide the user with optimal shot advice, turf condition information, and mental support messages in real time, as well as swing improvement advice during practice based on comparison with professional golfer data.

[2030] A "golf course database" is a structured data store that stores detailed information about golf courses (distances, par threes, bunker locations, designer information, etc.).

[2031] The "Weather Information API" is an application programming interface for obtaining real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.).

[2032] "User location information" is GPS data that indicates the user's current location.

[2033] "Optimal shot advice" refers to instructions on the best shot and club selection that a user should take based on golf course information, weather data, and the like.

[2034] "Turf condition data" is information about the length and health of the grass on a golf course.

[2035] "Mental support messages" are words of encouragement and comfort provided to keep users motivated.

[2036] "Professional golfer swing data" refers to motion data (swing speed, angle, direction, etc.) of a professional golfer when swinging.

[2037] "User swing data" refers to motion data (swing speed, angle, direction, etc.) when the user swings.

[2038] The "comparison result" is an evaluation when comparing the swing data of a professional golfer with the swing data of the user.

[2039] "Swing improvement advice" is specific instructions for the user to improve their swing based on the results of comparing the user's swing data with swing data of a professional golfer.

[2040] "Strategic advice" is an instruction that suggests an effective strategy for a particular hole based on the user's score data.

[2041] This invention is a system that provides advanced caddie services to golf players. Specifically, it includes functions such as collecting and displaying golf course information, acquiring and displaying weather conditions and turf conditions, providing shot advice, providing mental support, and providing feedback during practice. Each process in this system is performed in real time between the server, the terminal, and the user.

[2042] First, a user selects a golf course using a device such as a smartphone or tablet. The device sends identification information for the selected golf course to a server, which then retrieves the course information from a database. In terms of specific hardware, in the first processing step, the device communicates with the server using an HTTP request, and the server retrieves the information using a relational database management system (RDBMS). The retrieved information is then sent to the device, which displays it to the user.

[2043] The server then calls a weather information API to obtain real-time weather data for the area around the golf course. The server then queries the weather information API, again using the HTTP protocol, and transmits the obtained data back to the terminal. In this invention, existing weather information APIs, such as the OpenWeatherMap API, can be used. The terminal analyzes this weather data and visually displays it to the user. The server also collects turf condition data from the golf course manager. This data is also transmitted to the terminal, where it can be viewed by the user.

[2044] When a user takes a shot, the device uses its GPS function to obtain the user's location. Based on this location information and previously obtained weather and course information, the server generates optimal shot advice. Using a generative AI model, data such as wind speed, direction, and distance is analyzed to generate specific advice on club selection and shot direction. For example, advice such as "The wind speed is 5 m / s blowing from east to west. Aim 8 yards to the right with a 7 iron" is displayed.

[2045] Furthermore, the system automatically generates mental support messages by monitoring the user's playing status and evaluating past and current score data. The server uses a generative AI model to generate encouraging and comforting messages and sends them to the device. For example, a message such as "You're doing well in the first half, so keep it up and do your best in the second half" is displayed.

[2046] When practicing, if the user selects practice mode, the device will use a sensor (e.g., a smart swing analyzer) to collect the user's swing data in real time. This data will be sent to a server and compared with swing data from professional golfers. Based on the comparison results, the server will generate swing improvement advice for the user. For example, specific advice such as "Your swing speed is slow, so try rotating your hips more to increase your swing speed" will be displayed on the device.

[2047] Specific examples

[2048] For example, if a user wants to play at a golf course, they first launch the app and select the golf course. The device sends the selection to the server, which then retrieves detailed course information from a database and sends it to the device. The device then displays this information to the user. At the same time, the server retrieves real-time weather data from a weather information API and collects information about the turf condition from the golf course manager. This information is also sent to the device and displayed for the user to review. Then, when the user takes a shot, the device generates optimal shot advice based on the user's location and provides this advice to the user. The system also automatically generates support messages based on the user's mental state during play and displays them to the user. During practice, the device collects swing data every time the user takes a swing and compares it with data from professional golfers to provide feedback. This allows users to efficiently improve their swing technique.

[2049] Prompt Sentence Examples

[2050] "Please explain the system that allows users to select golf practice mode, acquire and analyze swing data, and provide swing improvement advice."

[2051] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2052] Step 1:

[2053] The user selects a golf course on a device (smartphone, tablet, etc.).

[2054] Input: The user interacts with the app's interface and selects the golf course they want to play.

[2055] Action: The user interacts with a drop-down menu, search bar, or selection feature on a map.

[2056] Output: Identification information (ID, name, etc.) of the selected golf course.

[2057] Step 2:

[2058] The terminal transmits the identification information of the selected golf course to the server.

[2059] Input: The identification of the selected golf course.

[2060] How it works: The device sends the identification information of the selected golf course to the server using an HTTP request.

[2061] Output: The request data sent to the server.

[2062] Step 3:

[2063] The server retrieves detailed course information (distance, par three, bunker location, designer information, etc.) from the database.

[2064] Input: Golf course identification.

[2065] How it works: The server queries the RDBMS to extract detailed course information.

[2066] Output: Golf course details are retrieved on the server.

[2067] Step 4:

[2068] The server transmits the acquired course information to the terminal.

[2069] Input: Golf course details.

[2070] Operation: The server converts the acquired course information into JSON format and sends it to the device as an HTTP response.

[2071] Output: JSON data of the course information sent to the device.

[2072] Step 5:

[2073] The terminal displays the received course information to the user.

[2074] Input: JSON data with golf course details.

[2075] How it works: The device parses the JSON data and displays it to the user in a visually friendly format.

[2076] Output: Detailed golf course information displayed to the user (layout diagram, hole-by-hole information, etc.).

[2077] Step 6:

[2078] The server calls the weather information API to obtain real-time weather data around the golf course.

[2079] Input: Latitude and longitude information of the golf course.

[2080] How it works: The server queries the weather API endpoint to retrieve weather data.

[2081] Output: Real-time weather data retrieved from the API.

[2082] Step 7:

[2083] The server sends the weather data to the device.

[2084] Input: Weather data.

[2085] How it works: The server sends weather data in JSON format to the device.

[2086] Output: JSON data of the weather data sent to the device.

[2087] Step 8:

[2088] The terminal displays this weather data to the user.

[2089] Input: Weather data in JSON format.

[2090] How it works: The device parses the JSON data and displays it to the user in a visually friendly format.

[2091] Output: Weather information displayed to the user (wind speed, direction, temperature, chance of precipitation, etc.).

[2092] Step 9:

[2093] A server collects turf condition data from golf course managers.

[2094] Input: Information about the condition of the grass.

[2095] How it works: The server collects information through an upload interface for golf course managers.

[2096] Output: Grass condition data stored on the server.

[2097] Step 10:

[2098] The server sends the grass condition data to the terminal.

[2099] Input: Turf condition data.

[2100] How it works: The server sends grass status data in JSON format to the device.

[2101] Output: JSON data of the grass condition data sent to the terminal.

[2102] Step 11:

[2103] The terminal displays this grass condition data to the user.

[2104] Input: JSON data of grass condition data.

[2105] How it works: The device parses the JSON data and displays it to the user in a visually friendly format.

[2106] Output: Grass condition information (length, health, etc.) displayed to the user.

[2107] Step 12:

[2108] The device obtains the user's location information via GPS and identifies the hole where the shot is planned to be taken.

[2109] Input: User location (GPS data).

[2110] How it works: The device uses GPS to determine the user's current location and runs an algorithm to identify the specific hole.

[2111] Output: User's current location and identified hole information.

[2112] Step 13:

[2113] The server generates optimal shot advice based on weather data and the user's location information.

[2114] Input: Weather data, user location, course information.

[2115] How it works: The server uses a generative AI model to generate optimal shot advice based on input data.

[2116] Output: Shot advice generated.

[2117] Step 14:

[2118] The server transmits the generated shot advice to the terminal.

[2119] Input: Shot advice generation results.

[2120] How it works: The server converts the advice data into JSON format and sends it to the device.

[2121] Output: Shot advice data sent to the device.

[2122] Step 15:

[2123] The terminal displays shot advice to the user.

[2124] Input: Shot advice data.

[2125] How it works: The device parses the advice data and displays it to the user in a visually friendly format.

[2126] Output: Shot advice (club selection, shot direction, etc.) displayed to the user.

[2127] Step 16:

[2128] The device monitors the user's playing status and evaluates past score data and current score.

[2129] Input: User score data, playing status data.

[2130] Operation: The device records data locally and runs the evaluation algorithm.

[2131] Output: Evaluation result.

[2132] Step 17:

[2133] The server automatically generates a mental support message based on the evaluation results.

[2134] Input: Evaluation results, past score data.

[2135] How it works: The server uses a generative AI model to generate optimal mental support messages for each individual user.

[2136] Output: Mental support message.

[2137] Step 18:

[2138] A mental support message generated by the server is sent to the terminal.

[2139] Input: Mental support message.

[2140] Behavior: The server sends a mental support message in JSON format to the device.

[2141] Output: The emotional support message sent to the device.

[2142] Step 19:

[2143] The terminal displays these messages to the user.

[2144] Input: Mental support message.

[2145] What it does: The device parses the message and displays it in the form of a notification or a popup window.

[2146] Output: The emotional support message that will be displayed to the user.

[2147] Step 20:

[2148] The user selects the practice mode.

[2149] Input: User selection.

[2150] Action: The user selects Practice mode from the menu.

[2151] Output: Practice mode selection status.

[2152] Step 21:

[2153] The device uses sensors to collect the user's swing data (swing speed, angle, direction) in real time.

[2154] Input: The user's swing motion.

[2155] How it works: The sensor captures swing information and sends the data to your device.

[2156] Output: Swing data.

[2157] Step 22:

[2158] The swing data acquired by the terminal is transmitted to the server.

[2159] Input: Swing data.

[2160] Operation: The device sends swing data to the server.

[2161] Output: Swing data sent to the server.

[2162] Step 23:

[2163] The server compares the swing data of the professional golfer with the swing data of the user.

[2164] Input: User swing data, professional golfer swing data.

[2165] How it works: The server compares the user's data with the professional golfer data in its database.

[2166] Output: The comparison result.

[2167] Step 24:

[2168] The server generates swing improvement advice based on the comparison result.

[2169] Input: The comparison result.

[2170] How it works: The server uses a generative AI model to generate specific swing improvement advice.

[2171] Output: Swing improvement advice.

[2172] Step 25:

[2173] The server transmits the generated swing improvement advice to the terminal.

[2174] Enter: swing improvement advice.

[2175] How it works: The server sends advice in JSON format to the device.

[2176] Output: Swing improvement advice sent to the device.

[2177] Step 26:

[2178] The terminal displays swing improvement advice to the user.

[2179] Enter: swing improvement advice.

[2180] How it works: The device parses the advice and displays it in a visually friendly format.

[2181] Output: Swing improvement advice displayed to the user.

[2182] (Application example 1)

[2183] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2184] Conventional factory production line management has not been able to fully utilize environmental data and operator performance data, limiting its ability to improve work efficiency or provide psychological support. Another issue is the inability to provide optimal work advice in real time when the production environment fluctuates. A new system is needed to solve these problems, increase production line efficiency, and improve operator performance.

[2185] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2186] In this invention, the server includes a means for acquiring production line information from an industrial line database, a means for acquiring real-time environmental data from an industrial temperature sensor, and a means for generating work advice based on the operator's production efficiency data and environmental data. This makes it possible to provide optimal work advice based on the environmental data and performance data in real time, and also provide psychological support to the operator.

[2187] An "industrial line database" is a digital database for collectively recording and managing information about production lines within a factory.

[2188] "Production line information" is detailed data on the production processes within the factory, the operating status of production equipment, work procedures, work progress, etc.

[2189] An "industrial temperature sensor" is a sensor device that measures the temperature in a factory's working environment in real time and provides that data in digital format.

[2190] "Environmental data" refers to real-time data on the working environment within the factory, such as temperature, humidity, light intensity, and noise level.

[2191] "Operator" refers to workers and engineers who work directly on the production line.

[2192] "Production efficiency data" refers to data related to an operator's work efficiency and performance, such as information on work speed and production volume.

[2193] "Work advice" is advice that suggests optimal work methods and improvement measures to operators based on acquired environmental data and production efficiency data.

[2194] "Psychological support messages" are messages of psychological support and encouragement that are generated based on the operator's performance data.

[2195] The present invention is a production line assistant system that provides optimal work assistance and psychological support to operators working on production lines in a factory. Specific embodiments for realizing this system are described below.

[2196] Acquisition and display of production line information

[2197] The server retrieves production line information from the industrial line database. This information includes the production process, the operating status of production equipment, work procedures, work progress, etc. The server then sends this information to the terminal, which then displays it to the operator.

[2198] Acquiring and displaying environmental data

[2199] The server acquires real-time environmental data (temperature, humidity, illuminance, etc.) from environmental monitoring devices such as industrial temperature sensors. This data is also sent from the server to the terminal and displayed on the terminal for the operator to check.

[2200] Generation and display of work advice

[2201] The server generates optimal work advice based on the acquired production line information and environmental data. For example, if the temperature inside the factory is high, it generates advice to ask the operator to check the cooling system. The server sends this work advice to the terminal, which then displays it to the operator. This allows the operator to take appropriate action based on the current work environment.

[2202] Providing mental support

[2203] The server records and analyzes the operator's performance data (work efficiency, work speed, production volume, etc.) and automatically generates mental support messages. For example, for an operator whose work efficiency is declining, it generates a message such as "Take a short break and refresh yourself. You're doing a great job!" The server sends the generated mental support message to the terminal, which displays it to the operator.

[2204] Hardware and Software

[2205] To implement this system, the following hardware and software are used:

[2206] Hardware:

[2207] Industrial Temperature Sensors

[2208] Environmental Monitoring Devices

[2209] Terminals with human-machine interface (HMI)

[2210] software:

[2211] Database Management System (DBMS)

[2212] Software for making API calls

[2213] AI models for data analysis and advice generation

[2214] Specific examples

[2215] For example, if the temperature in a factory is rising, the server will receive real-time data from industrial temperature sensors and generate advice to the operator to check the cooling system. If work efficiency is declining, the server will generate a mental support message to the operator to take a break.

[2216] Example prompt sentence:

[2217] "The temperature in the factory is getting high, so please ask the operators to check the cooling system. Also, please send a message to operators whose work efficiency is declining, encouraging them to take a break."

[2218] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2219] Step 1:

[2220] The server retrieves production line information from the industrial line database. The input is a request to the database, and the output is production line information such as the production process, work procedures, and equipment operating status. The server sends this information to the terminal, which displays it to the operator.

[2221] Step 2:

[2222] The server acquires real-time environmental data (temperature, humidity, illuminance, etc.) from industrial temperature sensors. The input is the data acquired from the environmental sensors, and the output is real-time environmental information. The server sends this environmental data to the terminal, which displays it to the operator.

[2223] Step 3:

[2224] The server generates optimal work advice based on production line information and environmental data. The inputs are production line information and environmental data, and the output is work advice. For example, if the temperature is high, advice such as "Check the cooling system" is generated. The server sends this work advice to the terminal, which then displays it to the operator.

[2225] Step 4:

[2226] The server records and analyzes the operator's production efficiency data and generates mental support messages. The input is the operator's work efficiency data, and the output is a mental support message. For example, if work efficiency is declining, a message such as "Please take a short break and refresh yourself" is generated. The server sends this mental support message to the terminal, which then displays it to the operator.

[2227] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2228] The present invention is a system for providing advanced caddie services to golf players, and in particular, is combined with an emotion engine that recognizes the user's emotions. Specific embodiments of this system will be described below.

[2229] Collection and display of golf course information

[2230] Obtaining golf course information

[2231] The user operates the terminal and selects the course to play from the golf course selection menu.

[2232] The terminal transmits the identification information (such as an ID) of the selected golf course to the server.

[2233] The server uses the received course ID to retrieve detailed information about the course from the database.

[2234] The server sends the detailed course information (distance, par three, bunker location, designer information, etc.) to the terminal.

[2235] The device analyzes the course information it receives and displays it on the screen.

[2236] Acquire and display weather conditions and turf conditions

[2237] Obtaining weather data

[2238] The server calls a specific weather information API to obtain real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.) around the golf course.

[2239] The weather data acquired by the server is sent to the terminal.

[2240] The terminal displays weather data to the user in real time.

[2241] Get the grass condition

[2242] The server collects information on the length and condition of the grass provided by the golf course manager.

[2243] The server sends the grass information to the terminal.

[2244] The terminal displays the grass condition data to the user.

[2245] Providing shot advice

[2246] Shot advice generation

[2247] The device uses its GPS function to obtain the user's current location and, based on this, identifies the hole on which the shot is to be taken.

[2248] The server generates optimal shot advice based on the user's location and weather data, such as calculating club selection and shot direction taking into account the effects of wind.

[2249] The server transmits the generated shot advice to the terminal.

[2250] The terminal displays shot advice to the user.

[2251] Providing mental support using an emotion engine

[2252] Emotion Engine Operation

[2253] The device uses the user's facial recognition camera and voice analysis functions to analyze the user's facial expressions and tone of voice in real time to determine their emotional state.

[2254] The server analyzes the user's emotional data and generates mental support messages as needed. For example, if the user is nervous, it generates a message such as "Relax and take the shot with confidence."

[2255] A mental support message generated by the server is sent to the terminal.

[2256] The terminal displays a mental support message to the user.

[2257] Providing feedback during practice

[2258] Swing data acquisition and analysis

[2259] The user selects practice mode on the device.

[2260] The device uses sensors to collect the user's swing data (swing speed, angle, direction, etc.) in real time.

[2261] The swing data acquired by the terminal is transmitted to the server.

[2262] Feedback Generation

[2263] The server analyzes the user's swing by comparing it with a database of swings from professional golfers.

[2264] Based on the comparison results, the server generates swing improvement advice for the user, such as "make your backswing a little higher."

[2265] The server transmits the generated swing improvement advice to the terminal.

[2266] The terminal displays swing improvement advice to the user.

[2267] Specific examples

[2268] For example, if a user wants to play at a golf course, he or she first selects the golf course. The terminal then requests information about the course from the server, which then retrieves detailed course information from the database and sends it to the terminal, which then displays it to the user.

[2269] The server also retrieves real-time weather data from a weather information API and collects information about the condition of the turf from the golf course manager, which is also sent to the device and displayed for the user to review.

[2270] When the user takes a shot, the device generates and provides optimal shot advice based on the user's location information. It also uses a facial recognition camera and voice analysis functions to recognize the user's emotions and provide mental support according to their feelings.

[2271] During practice, the device collects swing data every time the user takes a swing and compares it with that of professional golfers to provide feedback. This allows users to efficiently improve their swing technique. Through this process, users can enjoy golf while receiving appropriate advice and mental support in real time.

[2272] The processing flow will be explained below.

[2273] Collection and display of golf course information

[2274] Step 1:

[2275] The user operates the terminal and selects the course to play from the golf course selection menu.

[2276] Step 2:

[2277] The terminal transmits the identification information (such as an ID) of the selected golf course to the server.

[2278] Step 3:

[2279] The server uses the received course ID to retrieve detailed information about the course from the database.

[2280] Step 4:

[2281] The server sends the detailed course information (distance, par three, bunker location, designer information, etc.) to the terminal.

[2282] Step 5:

[2283] The device analyzes the course information it receives and displays it on the screen.

[2284] Acquire and display weather conditions and turf conditions

[2285] Step 1:

[2286] The server calls a specific weather information API to obtain real-time weather data (wind speed, wind direction, temperature, probability of precipitation, etc.) around the golf course.

[2287] Step 2:

[2288] The server sends the weather data to the device.

[2289] Step 3:

[2290] The terminal displays weather data to the user in real time.

[2291] Step 4:

[2292] The server collects information on the length and condition of the grass provided by the golf course manager.

[2293] Step 5:

[2294] The server sends the grass information to the terminal.

[2295] Step 6:

[2296] The terminal displays the grass condition data to the user.

[2297] Providing shot advice

[2298] Step 1:

[2299] The device uses its GPS function to obtain the user's current location and, based on this, identifies the hole on which the shot is to be taken.

[2300] Step 2:

[2301] The server generates optimal shot advice based on the user's location and weather data, for example, calculating club selection and shot direction taking into account the effects of wind.

[2302] Step 3:

[2303] The server transmits the generated shot advice to the terminal.

[2304] Step 4:

[2305] The terminal displays shot advice to the user.

[2306] Providing mental support using an emotion engine

[2307] Step 1:

[2308] The device uses the user's facial recognition camera and voice analysis functions to analyze the user's facial expressions and tone of voice in real time to determine their emotional state.

[2309] Step 2:

[2310] The terminal transmits the acquired user emotion data to the server.

[2311] Step 3:

[2312] The server analyzes the user's emotional data and generates mental support messages as needed. For example, if the user is nervous, it generates a message such as "Relax and take the shot with confidence."

[2313] Step 4:

[2314] A mental support message generated by the server is sent to the terminal.

[2315] Step 5:

[2316] The terminal displays a mental support message to the user.

[2317] Providing feedback during practice

[2318] Step 1:

[2319] The user selects practice mode on the device.

[2320] Step 2:

[2321] The device uses sensors to collect the user's swing data (swing speed, angle, direction, etc.) in real time.

[2322] Step 3:

[2323] The swing data acquired by the terminal is transmitted to the server.

[2324] Step 4:

[2325] The server analyzes the user's swing by comparing it with a database of swings from professional golfers.

[2326] Step 5:

[2327] Based on the comparison results, the server generates swing improvement advice for the user, such as "make your backswing a little higher."

[2328] Step 6:

[2329] The server transmits the generated swing improvement advice to the terminal.

[2330] Step 7:

[2331] The terminal displays swing improvement advice to the user.

[2332] Example 2

[2333] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2334] Golf players have difficulty quickly obtaining accurate course and weather information while playing. Furthermore, there are limited ways to effectively receive mental support tailored to the player's emotions and feedback on swing improvement. Conventional caddie services have difficulty providing this information and support in real time, and this invention aims to solve this problem.

[2335] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for the user to select a course to play from a golf course selection menu and the terminal to transmit identification information of the course to the server; means for the server to obtain detailed information about the selected golf course from a database and transmit it to the terminal; means for the server to obtain real-time weather data using a weather information API and transmit it to the terminal; means for the terminal to obtain the user's current location using a GPS and for the server to generate optimal shot advice based on the location information and weather data and transmit it to the terminal; means for the terminal to analyze the obtained detailed information about the golf course, weather data, and shot advice and display them on the screen; means for the server to determine the user's emotions in real time using a face recognition camera or a voice analysis function and generate a mental support message as needed; means for the terminal to display the mental support message to the user; means for the user to select a practice mode on the terminal and for the terminal to obtain swing data through a sensor and transmit it to the server; means for the server to compare the user's swing data with a database of professional golfers and generate swing improvement advice; and means for the terminal to display the swing improvement advice to the user. This will enable golf players to receive accurate course information, weather information, shot advice, emotional support, and feedback on swing improvement in real time.

[2336] "User" refers to a golf player who operates the system and receives various information and services.

[2337] A "terminal" is a device that is operated by a user and displays various information, and includes smartphones, tablet PCs, etc.

[2338] "Server" refers to a computer system that processes various data and transmits information to terminals.

[2339] "Golf course selection menu" refers to an interface that allows a user to select a golf course to play.

[2340] "Identification information" is information that uniquely identifies a particular golf course, and includes the course ID, name, etc.

[2341] "Database" refers to the data structure that stores detailed golf course information and is accessed by the server.

[2342] "Weather Information API" means an application programming interface that provides real-time weather data for a specific location.

[2343] "GPS" refers to a satellite system for obtaining geographic location information.

[2344] "Shot advice" refers to information that suggests the optimal club selection and shot direction when the user hits a golf ball.

[2345] A "face recognition camera" refers to a camera system that analyzes a user's facial expressions.

[2346] "Voice analysis function" refers to technology that analyzes the tone of a user's voice and determines their emotional state.

[2347] "Mental support messages" refer to messages containing encouragement or advice that are generated according to the user's emotional state.

[2348] "Practice mode" refers to the operating mode of the system used by a user to practice their golf swing.

[2349] "Sensor" refers to a device for acquiring user swing data in real time.

[2350] "Swing data" refers to data such as the speed, angle, and direction of a user's golf swing.

[2351] "Professional golfer database" refers to a database that stores swing data of professional golfers and compares it with the user's swing data.

[2352] "Swing improvement advice" refers to specific suggestions for improving the user's swing.

[2353] The present invention is a system for providing advanced caddie services to golf players, including golf course information, real-time weather data, turf conditions, shot advice, emotional support, and swing improvement feedback. Specific embodiments of the system are described below.

[2354] Collection and display of golf course information

[2355] First, the user operates the device to select the course they wish to play from the golf course selection menu. The device then sends the identification information (such as ID) of that course to the server. The server then retrieves detailed information about the corresponding course from its database based on the received course ID. This information includes distance, par three, bunker location, and designer information. The retrieved course information is then sent from the server to the device, which then displays it. The device then uses HTML5 and JavaScript to display the information on the user interface.

[2356] Acquire and display weather conditions and turf conditions

[2357] The server calls a specific weather information API (e.g., OpenWeatherMap API) to obtain real-time weather data around the golf course. This data includes wind speed, wind direction, temperature, and chance of precipitation. The server sends the obtained weather data to the terminal, which then displays the weather data to the user in real time. A graphical UI component (e.g., Chart.js) is used for display. In addition, the server collects information about the length and condition of the grass from the golf course manager and sends it to the terminal. The terminal displays this information to the user.

[2358] Providing shot advice

[2359] When a user takes a shot, the device uses its GPS to obtain the user's current location. The server generates optimal shot advice based on the location information and weather data. This advice is generated using a machine learning model (e.g., TensorFlow) to calculate club selection and shot direction taking into account the effects of wind. The generated shot advice is sent from the server to the device and displayed on the device.

[2360] Providing mental support using an emotion engine

[2361] The device uses the user's facial recognition camera and voice analysis functions (e.g., OpenCV and Google Speech-to-Text API) to analyze the user's facial expressions and tone of voice in real time to determine their emotional state. The server analyzes this emotional data and generates mental support messages as needed. For example, if the user is nervous, it generates a message such as "Relax and take the shot with confidence." The generated mental support message is sent from the server to the device and displayed on the device. It can be displayed in both text and voice.

[2362] Providing feedback during practice

[2363] The user selects practice mode on the device, and the device acquires the user's swing data through a sensor (e.g., a motion capture sensor). The acquired swing data is sent from the device to a server, which compares the user's swing data with a database of professional golfers. Based on the comparison results, the server generates swing improvement advice for the user. For example, it provides specific advice such as "make your backswing a little higher." The generated swing improvement advice is sent from the server to the device and displayed on the device. This display can use 3D animation to demonstrate the correct swing movement.

[2364] Specific examples

[2365] For example, if a user wants to play at a golf course, they first select the golf course. The device requests information about that course from the server, which retrieves detailed course information from a database and sends it to the device. The device then displays this to the user. The server also retrieves real-time weather data from a weather information API (e.g., OpenWeatherMap API) and collects information about the condition of the grass from the golf course manager. This information is also sent to the device and displayed for the user to review.

[2366] When the user takes a shot, the device generates and provides optimal shot advice based on the user's location information. It also uses a facial recognition camera and voice analysis functions to recognize the user's emotions and provides mental support according to their emotions.

[2367] During practice, the device collects swing data every time the user takes a swing and provides feedback by comparing it with data from professional golfers. This allows users to efficiently improve their swing technique. Through this process, users can enjoy golf while receiving appropriate advice and mental support in real time.

[2368] Example of input prompt for generative AI model

[2369] "This system provides advanced caddie services to golf players. Specifically, it includes golf course information, real-time weather data, turf conditions, shot advice, emotional mental support, and swing feedback. Please explain in detail the functions that provide all of the following: the golf course selected by the user and its detailed information, real-time weather data, generation and display of shot advice, emotional recognition and mental support for the user, and collection and analysis of swing data."

[2370] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2371] Step 1:

[2372] The user selects the course to play from the golf course selection menu.

[2373] Input: The user makes a selection on the device, selecting the golf course to play.

[2374] Output: ID and name of selected golf course

[2375] Specific operation: The terminal acquires the identification information of the golf course selected by the user's operation and transmits the selection result to the server.

[2376] Step 2:

[2377] The server retrieves the details of the selected golf course from the database.

[2378] Input: Golf course ID or nam...

Claims

1. means for retrieving course information from a golf course database; A means for obtaining real-time weather data from a weather information API; a means for acquiring user location information and generating optimal shot advice based on course information and weather data; means for displaying the shot advice to a user; A system including:

2. A means for referencing swing data of professional golfers and comparing it with the user's swing data; means for generating swing improvement advice based on the comparison result; means for displaying the swing improvement advice to a user; The system of claim 1 further comprising:

3. a means for recording and analyzing a user's score data and generating strategy advice for a particular hole; means for displaying said strategic advice to a user; The system of claim 1 further comprising:

Images