Golf support system, server device, golf support method, and golf support program
The golf support system uses mobile objects with imaging and trajectory prediction to efficiently locate lost golf balls, addressing the challenge of finding them quickly and accurately, thereby enhancing the playing experience and course maintenance.
Patent Information
- Application Number
- JP2024509716
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-03-25
- Publication Date
- 2024-11-11
- Estimated Expiration
- 2042-03-25
AI Technical Summary
Golfers face challenges in quickly and accurately finding lost golf balls on a course, which disrupts the pace of play and can lead to lost time and inconvenience.
A golf support system utilizing a mobile object, such as a course traveling vehicle or drone, equipped with cameras and lidar radar to photograph and predict the trajectory of a golf ball, calculate a predicted falling position, and navigate to that position to assist in locating the ball, supported by a server device that processes and displays the information.
The system efficiently reduces the burden on golfers by quickly and accurately identifying the ball's location, ensuring a smooth and comfortable playing experience by minimizing search time and maintaining course integrity.
Smart Images

Figure 0007580660000001 
Figure 0007580660000002 
Figure 0007580660000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a golf support system, a mobile object, a server device, a golf support method, and a golf support program, and more particularly to a golf support system, a mobile object, a server device, a golf support method, and a golf support program that support a user who is a golfer playing on a golf course. [Background technology]
[0002] Vehicles used on golf courses include golf carts that carry golf bags for all golfers playing and travel along cart paths or within the drivable area of the golf course. In recent years, robot caddies have begun to be introduced, which carry a golf bag for one golfer and follow the golfer around the golf course.
[0003] Patent Document 1 discloses an autonomous vehicle that carries a golfer's golf bag and follows the golfer by receiving signals from a remote transmitter carried by the golfer. Patent Document 1 also discloses technology for safely driving the autonomous vehicle and technology for using the autonomous vehicle to present useful information to the golfer. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent No. 6841835 Summary of the Invention [Problem to be solved by the invention]
[0005] When playing on a golf course, it is considered good manners to play at an appropriate pace. Therefore, if a golfer cannot find the ball they have hit, they may not have enough time to search for it, which may result in the ball being lost. Also, if a golfer is searching for the ball, time may pass unexpectedly, slowing down the overall progress of the game. Thus, for both golfers and golf courses, locating the ball quickly and accurately is a challenge when playing on a golf course. However, although the technology of Patent Document 1 assists the golfer in moving by following the golfer, it does not disclose assistance in finding the ball.
[0006] The present disclosure aims to use various mobile devices operating on golf courses to quickly and accurately search for and identify golf balls, thereby reducing the burden on users of searching for balls and providing a comfortable playing experience. [Means for solving the problem]
[0007] The golf support system according to the present disclosure comprises: A golf support system for supporting a user playing on a golf course, the golf support system including a mobile object operated on the golf course, an image capturing unit that captures a trajectory image of the trajectory of the golf ball hit by the user using a camera mounted on the moving object; a trajectory prediction unit that calculates a trajectory of the golf ball as a predicted trajectory using the trajectory image; The golf ball is then guided to a predetermined landing position by the predicted trajectory. [Effects of the Invention]
[0008] According to the golf support system of the present disclosure, images taken by a mobile object operating on a golf course can be used to quickly and accurately search for and identify golf balls, thereby reducing the burden on users of searching for balls and providing a comfortable playing experience. [Brief explanation of the drawings]
[0009] [Figure 1] 1 is a diagram showing an example of the overall configuration of a golf support system according to a first embodiment. [Figure 2] FIG. 1 is a diagram showing an example of the configuration of a course traveling vehicle according to a first embodiment. [Figure 3] FIG. 2 is a diagram showing an example of the configuration of a server device according to the first embodiment. [Figure 4] FIG. 1 is a diagram showing an example of the configuration of a course traveling vehicle according to a first embodiment. [Figure 5] 3 is a flowchart showing the operation of the golf support system according to the first embodiment. [Figure 6] FIG. 2 is a diagram showing how a user's shot is being taken according to the first embodiment. [Figure 7] 4 is a diagram showing a display example of a predicted trajectory image according to the first embodiment. FIG. [Figure 8] 1 is a diagram showing how photography is performed by a drone 300 according to the first embodiment. FIG. [Figure 9] 10 is a flowchart showing a process of creating a golf ball search result 57 by a ball search unit 230 according to the first embodiment. FIG. [Figure 10] FIG. 10 is a diagram illustrating an example of a configuration of a server device 200 according to a modification of the first embodiment. [Figure 11] FIG. 2 is a diagram showing an example of the configuration of a course traveling vehicle 100 according to a modification of the first embodiment. [Figure 12] FIG. 10 is a diagram illustrating an example of a configuration of a server device 200 according to a second embodiment. [Figure 13] 10 is a diagram showing an example of the configuration of a course traveling vehicle 100 according to a second embodiment. FIG. [Figure 14] FIG. 10 is a diagram showing an example of a shot image 59 according to the second embodiment. [Figure 15]FIG. 10 is a diagram showing another example of a shot image 59 according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0010] The present embodiment will be described below with reference to the drawings. In each drawing, identical or corresponding parts are designated by the same reference numerals. In the description of the embodiment, the description of identical or corresponding parts will be omitted or simplified as appropriate. Arrows in the drawings mainly indicate the flow of data or the flow of processing. Furthermore, the sized relationships between components in the following drawings may differ from the actual relationships. Furthermore, in the description of the embodiment, directions or positions such as up, down, left, right, front, rear, front and back may be indicated. These notations are used for convenience of explanation and do not limit the placement, direction or orientation of devices, instruments, parts, etc.
[0011] Embodiment 1 ***Configuration Description*** FIG. 1 is a diagram showing an example of the overall configuration of a golf support system 500 according to this embodiment. The golf support system 500 is a system that supports a user 20 who plays golf on a golf course 400. The user 20 is also called a golfer or player who plays golf on the golf course 400.
[0012] The golf support system 500 includes a course traveling vehicle 100 and a server device 200. The golf support system 500 may also include a drone 300 that autonomously flies above the golf course. The course traveling vehicle 100 automatically drives around the golf course based on the travel route 50. Automatic driving is also called autonomous traveling or autonomous movement. The course traveling vehicle 100 communicates with the server device 200 via a network. The server device 200 is realized by, for example, a cloud computer. The server device 200 communicates with the course traveling vehicle 100 via a network. The drone 300 autonomously flies above the golf course based on flight information 30 transmitted from the server device 200. Autonomous flight is also called autonomous movement. The drone 300 is an example of an autonomous flying object. The drone 300 communicates with the server device 200 via a network.
[0013] FIG. 2 is a diagram showing an example of the configuration of a course traveling vehicle 100 according to this embodiment. The course traveling vehicle 100 is an example of a mobile object that operates on a golf course. The course traveling vehicle 100 is an autonomous vehicle that carries a golf bag of a user 20 who will play on the golf course and automatically drives around the golf course according to a travel route 50 transmitted from the server device 200.
[0014] The course traveling vehicle 100 is equipped with devices such as a display device 941, a vehicle camera 961, a LIDAR radar 962, and a position sensor 963. Although not shown, the course traveling vehicle 100 is equipped with an automatic driving system for automatically driving the vehicle according to the travel route 50. The travel route 50 is an example of a travel route along which a moving object travels.
[0015] The vehicle camera 961 is a camera that captures images of the surroundings of the course traveling vehicle 100. The vehicle camera 961 is an example of a camera mounted on a moving object. For example, the vehicle camera 961 photographs the trajectory of a golf ball, photographs the user playing, photographs to detect obstacles, photographs to measure the distance to an object, and the like. The vehicle camera 961 may be configured with multiple cameras, such as a camera that captures the trajectory of the golf ball and a camera that captures the user playing the golf course. The vehicle camera 961 may also be configured with multiple types of cameras, such as a normal camera and an omnidirectional camera.
[0016] The LIDAR radar 962 detects the distance to objects around the course traveling vehicle 100. A plurality of LIDAR radars 962 may be installed. By analyzing the distance information from the LIDAR radar 962 together with the images captured by the vehicle camera 961, it becomes possible to more accurately detect the situation around the course traveling vehicle 100. The use of the LIDAR radar 962 has the effect of making it possible to detect information such as the trajectory of a golf ball or the distance to an obstacle on the golf course with high accuracy. Additionally, the LIDAR radar 962 mounted on the course traveling vehicle 100 can also measure data on the course shape, and update the course shape data previously acquired.
[0017] The position sensor 963 acquires position information of the course traveling vehicle 100. More specifically, the position sensor 963 acquires the position and time of the course traveling vehicle 100 during movement as position information. The position sensor 963 is, for example, a GPS. GPS is an abbreviation for Global Positioning System.
[0018] The autonomous driving system is composed of, for example, a communication device, a movement control unit, and a display device. The movement control unit controls the movement of the moving body. Specifically, the movement control unit controls the autonomous driving of the course traveling vehicle 100.
[0019] The course traveling vehicle 100 is, for example, a PMV that can travel with a person on board. PMV is an abbreviation for Personal Mobility Vehicle. In addition, when used without a person on board, the course traveling vehicle 100 may be an AMR. AMR is an abbreviation for Autonomous Mobile Robot.
[0020] The course traveling vehicle 100 according to this embodiment has seats for passengers, like a golf cart on a golf course, and can be automatically driven with a user seated in the vehicle. Since the user can also ride in the vehicle and travel, this has the effect of shortening the playing time compared to walking. The course traveling vehicle 100 can be automatically driven even when the user is not seated. For example, the user may be able to switch between an automatic driving mode when seated and an automatic driving mode when not seated by remote control or the like. If the user wants to play golf by walking on the golf course, the user can simply select the automatic driving mode when not seated.
[0021] Furthermore, the course traveling vehicle 100 can switch between an automatic driving mode and a manual driving mode. The above-mentioned mode switching in the course traveling vehicle 100 may be performed by a switching button on the vehicle body or by a remote control or the like. The course traveling vehicle 100 may also have a function such as voice recognition to recognize the user's voice or gesture recognition to recognize the user's movements. This function allows the course traveling vehicle 100 to operate various functions in response to the user's voice or gestures. This has the effect of reducing the user's workload and enabling a more comfortable game. Furthermore, the course traveling vehicle 100 may have a function to travel forward on the fairway at a minimum speed if it enters the fairway and remains stopped for a certain period of time. Since the rules of golf state that it is permitted to search for the ball for three minutes, the certain period of time can be set arbitrarily as long as the vehicle remains stopped for three minutes or more.
[0022] FIG. 3 is a diagram showing an example of the configuration of the server device 200 according to this embodiment.
[0023] The server device 200 is a computer. The server device 200 includes a processor 910, as well as other hardware such as a memory 921, an auxiliary storage device 922, an input interface 930, an output interface 940, and a communication device 950. The processor 910 is connected to the other hardware via a signal line or a wireless connection and controls the other hardware.
[0024] The server device 200 includes, as functional elements, a trajectory prediction unit 210, a path calculation unit 220, a ball search unit 230, and a storage unit 250. The storage unit 250 stores course map information 251 and a number threshold 252.
[0025] The functions of trajectory prediction unit 210, path calculation unit 220, and ball search unit 230 are realized by software. Storage unit 250 is provided in memory 921. Note that storage unit 250 may be provided in auxiliary storage device 922, or may be provided separately in memory 921 and auxiliary storage device 922.
[0026] The processor 910 is a device that executes a golf support program. The golf support program is a program that realizes the functions of the trajectory prediction unit 210, the path calculation unit 220, and the ball search unit 230. The golf support program also includes a program that is executed when realizing the functions of the course traveling vehicle 100, which will be described later.
[0027] The processor 910 is an IC that performs arithmetic processing. Specific examples of the processor 910 are a CPU, a DSP, and a GPU. IC is an abbreviation for Integrated Circuit. CPU is an abbreviation for Central Processing Unit. DSP is an abbreviation for Digital Signal Processor. GPU is an abbreviation for Graphics Processing Unit.
[0028] The memory 921 is a storage device that temporarily stores data. Specific examples of the memory 921 are SRAM and DRAM. SRAM is an abbreviation for Static Random Access Memory. DRAM is an abbreviation for Dynamic Random Access Memory. The auxiliary storage device 922 is a storage device that stores data. A specific example of the auxiliary storage device 922 is a HDD. The auxiliary storage device 922 may also be a portable storage medium such as an SD (registered trademark) memory card, CF, NAND flash, a flexible disk, an optical disk, a compact disk, a Blu-ray (registered trademark) disk, or a DVD. Note that HDD is an abbreviation for Hard Disk Drive. SD (registered trademark) is an abbreviation for Secure Digital. CF is an abbreviation for CompactFlash (registered trademark). DVD is an abbreviation for Digital Versatile Disk.
[0029] The input interface 930 is a port connected to an input device such as a mouse, keyboard, or touch panel. Specifically, the input interface 930 is a USB terminal. The input interface 930 may be a LAN interface or Bluetooth (registered trademark). USB is an abbreviation for Universal Serial Bus. LAN is an abbreviation for Local Area Network.
[0030] The output interface 940 is a port to which a cable of an output device such as a display is connected. The output interface 940 may also be a LAN interface or Bluetooth (registered trademark). Specifically, the output interface 940 is a USB terminal or an HDMI (registered trademark) terminal. Specifically, the display is an LCD. The output interface 940 is also called a display interface. HDMI (registered trademark) is an abbreviation for High Definition Multimedia Interface. LCD is an abbreviation for Liquid Crystal Display.
[0031] The communication device 950 has a receiver and a transmitter. The communication device 950 is connected to a communication network such as Wi-Fi (registered trademark), a LAN, the Internet, or a telephone line. Specifically, the communication device 950 is a communication chip or NIC. NIC is an abbreviation for Network Interface Card.
[0032] The golf support program is executed in the server device 200. The golf support program is loaded into the processor 910 and executed by the processor 910. In addition to the golf support program, the memory 921 also stores an OS. OS is an abbreviation for Operating System. The processor 910 executes the golf support program while executing the OS. The golf support program and the OS may be stored in an auxiliary storage device 922. The golf support program and the OS stored in the auxiliary storage device 922 are loaded into the memory 921 and executed by the processor 910. Note that part or all of the golf support program may be incorporated into the OS.
[0033] Server device 200 may include multiple processors that replace processor 910. These multiple processors share the task of executing the golf support program. Each processor is a device that executes the golf support program, just like processor 910.
[0034] Data, information, signal values, and variable values used, processed, or output by the golf assistance program are stored in memory 921 , secondary storage device 922 , or registers or cache memory within processor 910 .
[0035] The "parts" of the trajectory prediction unit 210, the path calculation unit 220, and the ball search unit 230 may be interpreted as "circuits," "steps," "procedures," "processing," or "circuitry." The golf support program causes a computer to execute trajectory prediction processing, path calculation processing, and ball search processing. The "processing" of the trajectory prediction processing, path calculation processing, and ball search processing may be interpreted as "program," "program product," "computer-readable storage medium storing a program," or "computer-readable recording medium recording a program." The golf support method is a method performed by the server device 200 executing the golf support program. The golf assistance program may be provided in the form of a program product or stored on a computer-readable recording medium.
[0036] The server device 200 communicates with the drone 300 via the communication device 950. Drone 300 is an autonomous flying object equipped with an aerial camera 301 that photographs the golf course from above. Drone 300 autonomously flies above the golf course using a flight control unit 302 based on flight information 30 transmitted from server device 200.
[0037] The various types of information exchanged in the server device 200 will be described later.
[0038] FIG. 4 is a diagram showing an example of the configuration of a course traveling vehicle 100 according to this embodiment. The course traveling vehicle 100 is equipped with a computer. The course traveling vehicle 100 includes a processor 910, as well as other hardware such as a memory 921, an auxiliary storage device 922, an input interface 930, an output interface 940, and a communication device 950. As described above, the course traveling vehicle 100 also includes other hardware such as a vehicle camera 961, a lidar radar 962, and a position sensor 963. The processor 910 is connected to the other hardware via a signal line or a wireless connection, and controls this other hardware. For ease of explanation, the same reference numerals are used to denote hardware having the same functions as the server device 200. However, it is clear that the course traveling vehicle 100 and the server device 200 each have their own hardware installed.
[0039] The course traveling vehicle 100 includes a movement control unit 110, a photographing unit 120, a display unit 130, and a storage unit 140 as functional elements.
[0040] The functions of the movement control unit 110, the photographing unit 120, and the display unit 130 are realized by software. The storage unit 140 is provided in the memory 921. Note that the storage unit 140 may be provided in the auxiliary storage device 922, or may be provided separately in the memory 921 and the auxiliary storage device 922.
[0041] Processor 910 is a device that executes a golf support program. The golf support program is a program that realizes the functions of movement control unit 110, imaging unit 120, and display unit 130. As described above, the golf support program also includes a program that is executed when realizing the functions of server device 200.
[0042] The description of each piece of hardware is the same as that of the server device 200.
[0043] The "unit" of each of the movement control unit 110, the photographing unit 120, and the display unit 130 may be interpreted as a "circuit," "step," "procedure," "process," or "circuitry." The golf support program causes a computer to execute movement control processing, photographing processing, and display processing. The "processing" of the movement control processing, photographing processing, and display processing may be interpreted as a "program," "program product," "computer-readable storage medium storing a program," or "computer-readable recording medium recording a program."
[0044] The various types of information exchanged in the course traveling vehicle 100 will be described later.
[0045] ***Explanation of Operation*** Next, the operation of the golf support system 500 according to this embodiment will be described. The operation procedure of the golf support system 500 corresponds to a golf support method. Furthermore, the program that realizes the operation of the golf support system 500 corresponds to a golf support program.
[0046] FIG. 5 is a flow diagram showing the operation of the golf support system 500 according to this embodiment. First, before traveling within the course, the photographing unit 120 of the course traveling vehicle 100 registers the user 20. The photographing unit 120 registers information such as the face, voice, clothing (color), gestures, and bone print of the user 20. The registration data of the user 20 is held by both the course traveling vehicle 100 and the server device 200.
[0047] <Photography processing: Step S101> In step S101, the photographing unit 120 of the course traveling vehicle 100 photographs the trajectory of the golf ball hit by the user 20 as a trajectory image 52 using the vehicle camera 961 mounted on the course traveling vehicle 100. The photographing unit 120 then transmits the trajectory image 52 to the server device 200. The photographing unit 120 also assigns LIDAR radar data corresponding to the trajectory image 52 to the trajectory image 52 and transmits the trajectory image 52 to the server device 200.
[0048] FIG. 6 is a diagram showing how a user starts taking a shot according to this embodiment.
[0049] The photographing unit 120 starts photographing in response to a photographing request from the user 20, and ends photographing in response to a photographing end request from the user 20. Alternatively, the photographing unit 120 may automatically determine the start and end of photographing. For example, the photographing unit 120 detects the posture of the user 20 at the start of the shot, and causes the vehicle camera 961 to start photographing the trajectory of the golf ball based on the detected posture at the start of the shot. The photographing unit 120 also causes the vehicle camera 961 to end photographing based on the size of the golf ball in the image being photographed. Specifically, the photographing unit 120 ends photographing when the golf ball can only be seen at the pixel resolution of the vehicle camera 961.
[0050] The image capturing unit 120 automatically detects when the user 20 moves close to the golf ball or when the user 20 assumes a position to hit a shot. This eliminates the need for the user 20 to personally instruct the start of image capturing, reducing the user's workload and enabling more comfortable play.
[0051] More specifically, the image capturing unit 120 determines the timing to start capturing images from the bone print of the user 20. At this time, it is preferable that the image capturing unit 120 uses AI (artificial intelligence) to learn the user's habits, such as pre-shot routines, and optimize the capture timing. By installing AI in the course traveling vehicle 100 and determining the posture at the start of the shot, it is possible to reduce the amount of data transmitted to the server device 200. It is also possible to reduce the image processing load on the server device 200.
[0052] Furthermore, if a practice swing occurs first, the image capture unit 120 may delete the practice swing portion from the image transmitted as the trajectory image 52. This has the effect of further reducing the amount of data transmitted to the server device 200. It also has the effect of further reducing the image processing load on the server device 200. The server device 200 may determine the shot start posture using AI as described above.
[0053] The photographing unit 120 also controls the position of the course-traveling vehicle 100 so that the vehicle camera 961 photographs the trajectory of the golf ball from behind the user 20 along the golf course 400. The photographing unit 120 generates photographing position control information for photographing the trajectory of the golf ball from behind the user 20 along the golf course 400, and transmits the generated photographing position control information to the movement control unit 110. 6, the direction of the shot on the golf course 400 is designated as B. The photographing unit 120 controls the position of the course traveling vehicle 100 and the orientation of the vehicle camera 961 so as to photograph the trajectory of the golf ball from behind the user 20 toward the direction B. This has the effect of enabling more accurate trajectory analysis.
[0054] <Trajectory Prediction Processing: Step S102> In step S102, trajectory prediction unit 210 of server device 200 uses trajectory image 52 to calculate the trajectory of the golf ball as predicted trajectory 61. Specifically, trajectory prediction unit 210 analyzes trajectory image 52 and LIDAR radar data to trace the trajectory of the golf ball and calculates it as predicted trajectory 61.
[0055] FIG. 7 is a diagram showing a display example of a predicted trajectory image 62 according to this embodiment. The trajectory prediction unit 210 generates a predicted trajectory image 62 obtained by superimposing the predicted trajectory 61 on an image of the golf course 400. The trajectory prediction unit 210 then displays the predicted trajectory image 62 on a display device. Here, the display device on which the trajectory prediction unit 210 displays the predicted trajectory image 62 is at least one of the display device 941 mounted on the course running vehicle 100 and a mobile terminal device carried by the user 20. Specifically, the trajectory prediction unit 210 transmits the predicted trajectory image 62 to the course traveling vehicle 100 and devices such as a smartphone, tablet, or smartwatch carried by the user 20. The predicted trajectory image 62 is then displayed on the display of the course traveling vehicle 100 and the display of the device such as a smartphone, tablet, or smartwatch carried by the user 20.
[0056] <Driving route calculation process: Step S103> In step S103, the path calculation unit 220 of the server device 200 calculates a predicted drop position 63, which is the drop position of the golf ball, using the predicted trajectory 61. Then, the path calculation unit 220 calculates the travel path 50 to the predicted drop position 63. The route calculation unit 220 transmits the travel route 50 to the course traveling vehicle 100 .
[0057] The storage unit 250 of the server device 200 stores course map information 251. The course map information 251 is high-precision three-dimensional map data used for automatic driving.
[0058] The course map information 251 records the past driving records of vehicles traveling on the golf course 400. The route calculation unit 220 generates the driving route 50 based on the course map information 251 so that the number of times the same route is driven on the golf course 400 is equal to or less than a predetermined number of times (number of times threshold 252).
[0059] Furthermore, the course map information 251 sets areas on the golf course 400 where vehicles traveling on the course are prohibited from entering, known as geofences. Geofences are also called geofencing. No-entry areas are set in areas such as fairways, rough, and bushes. For example, in addition to normal areas where carts are not allowed to enter, hazard areas that change depending on the day, construction sites, or maintenance areas such as areas where grass is being cultivated are also set as no-entry areas in the course map information 251. The route calculation unit 220 generates the driving route 50 so as to travel outside the no-entry areas based on the course map information 251. As a result, a virtual fence is set within the golf course 400.
[0060] The setting of the drivable area of the course traveling vehicle 100 may be different depending on whether the course traveling vehicle 100 is a PMV (for passengers) or an AMR (for carrying only luggage). The drivable area of an AMR may be set wider than the drivable area of a PMV. This is because AMRs are thought to be less likely to damage grass than PMVs, and because they do not carry passengers, they are thought to be able to travel relatively safely even on slopes. Conversely, when carrying loads heavier than a person or unstable loads, the travelable area of the AMR may be set narrower than the travelable area of the PMV.
[0061] As described above, the course map information 251 contains high-precision three-dimensional map data of the golf course. The route calculation unit 220 generates the travel route 50 based on the course map information 251 so as to avoid routes with steep slopes.
[0062] Calculating the driving route as described above has the effect of reducing damage to the turf caused by vehicles traveling on the course. In addition, since the course is not damaged even when multiple vehicles are traveling on the course, golfers can ultimately enjoy a more comfortable game.
[0063] Additionally, by setting up a geofence, it is possible to prevent vehicles on the course from accidentally entering restricted areas. Furthermore, by referencing high-precision 3D map data of the golf course, it is possible to avoid areas with steep slopes, which is particularly effective in preventing accidents such as vehicle tipping over when crossing sloping areas, providing golfers with a safe and comfortable playing experience on the golf course.
[0064] <Automatic driving process: Steps S104 to S105> In step S104 , the movement control unit 110 of the course traveling vehicle 100 performs automatic driving according to the traveling route 50 transmitted from the server device 200 . In step S105, the movement control unit 110 of the course traveling vehicle 100 acquires the position information 51 of the vehicle itself by the position sensor 963 while the vehicle is automatically driving along the travel route 50, and transmits the acquired position information 51 to the server device 200. The course traveling vehicle 100 also acquires its own vehicle position information 51 when it arrives at the predicted drop position 63 and transmits it to the server device 200.
[0065] <Ball Search Process: Steps S106 to S109> In the ball search process, when course traveling vehicle 100 arrives at predicted drop position 63, ball search unit 230 of server device 200 determines search range 53 in which to search for the golf ball based on predicted drop position 63. Ball search unit 230 transmits search range 53 to course traveling vehicle 100 and searches for the golf ball by photographing search range 53 with vehicle camera 961. Then, ball search unit 230 displays search result 57 obtained by the search on a display device. Specifically, it is as follows:
[0066] In step S106, ball search unit 230 determines search range 53 for searching for the golf ball based on course map information 251 and predicted landing position 63. For example, search range 53 is determined to be within a radius of kilometers (for example, k is in the range of 3 to 5) centered on predicted landing position 63. Radius k can be set arbitrarily. Ball search unit 230 may also refer to a weather database to obtain wind information and set search range 53 broadly in the direction the wind is blowing. Furthermore, if there is a valley or pond within a radius of kilometers, search range 53 may be set to extend up to the valley or pond. The ball search unit 230 transmits the determined search range 53 to the course running vehicle 100.
[0067] FIG. 8 is a diagram showing how the drone 300 according to this embodiment takes an image. The ball search unit 230 determines whether or not there are areas other than the fairway within the search range 53 based on the course map information 251. If the search range 53 includes areas other than the fairway, such as rough or bushes, the golf ball may be hidden by overgrown grass or grass. If the golf ball is hidden, there is a high possibility that it will not be possible to identify it even if the search range 53 is photographed by the vehicle camera. Therefore, if the search range 53 includes an area other than the fairway, the ball search unit 230 may photograph the search range 53 from above using the aerial camera 301 of the drone 300, thereby making it easier to identify the golf ball. Specifically, when ball search unit 230 determines that there is an area other than the fairway in search range 53, it transmits flight information 30 for photographing search range 53 from the sky and a desired photographing range 31 to drone 300. Drone 300 photographs search range 53 from the sky in accordance with flight information 30 and photographing range 31, and transmits search image 54a obtained by photographing to server device 200.
[0068] In step S107, the photographing unit 120 of the course traveling vehicle 100 receives the search range 53 from the server device 200. The photographing unit 120 photographs the search range 53 using the vehicle camera 961. The photographing unit 120 transmits a search image 54 obtained by photographing the search range 53 to the server device 200.
[0069] In step S108, ball search unit 230 searches for the golf ball by performing image recognition processing on search image 54 obtained by photographing search range 53. When search image 54a obtained by photographing search range 53 from above is received from drone 300, ball search unit 230 searches for the golf ball by performing image recognition processing on search image 54 and search image 54a.
[0070] For example, the aerial camera 301 mounted on the drone 300 is an infrared camera, and the search image 54a is an infrared camera image. Because the golf ball is hot after a shot, the ball search unit 230 can identify the golf ball from the search image 54a. Alternatively, a special mark may be marked on the ball, and the golf ball may be identified from the search image 54a using a recognition function that reacts to the special mark.
[0071] In step S109, the ball search unit 230 generates a search result 57. Specifically, it is as follows:
[0072] FIG. 9 is a flow chart showing the process of creating a golf ball search result 57 by the ball search unit 230 according to this embodiment. FIG. 9 is a detailed flowchart of the process in step S109 in FIG.
[0073] In step S91, the ball search unit 230 determines whether or not the golf ball has been identified. If a golf ball is identified, the process proceeds to step S92. If the golf ball is not identified, the process proceeds to step S93.
[0074] In step S92, if the golf ball is identified, the ball search unit 230 identifies the position of the golf ball on the golf course using the course map information 251. The ball search unit 230 generates, as the search result 57, a ball identified image in which the position of the golf ball is superimposed on the image of the golf course.
[0075] In step S92, if the ball search unit 230 is unable to identify the golf ball within a predetermined time, it generates, as the search result 57, an image indicating that the search for the golf ball has timed out.
[0076] In step S93, the ball search unit 230 transmits the search result 57 to the display device.
[0077] In FIG. 5, the ball search unit 230 transmits the search result 57 to the course running vehicle 100. Then, in step S110, the display unit 130 of the course traveling vehicle 100 displays the search result 57 on the display device 941. Like the predicted trajectory image 62, the search result 57 is also transmitted to the course traveling vehicle 100 and a smartphone, tablet, or smartwatch carried by the user 20. The search result 57 is then displayed on the display of the course traveling vehicle 100 and the display of a device such as a smartphone, tablet, or smartwatch carried by the user 20.
[0078] User 20 can search for the ball by following the ball-specific image displayed on the display of course-traveling vehicle 100 or on the display of a device such as a smartphone, tablet, or smartwatch carried by user 20. This reduces the time spent searching for a lost ball and allows for smooth play, providing the golfer with a comfortable playing experience.
[0079] Furthermore, if the golf ball falls into a valley, a pond, or is driven into the woods and goes outside the playable area, it cannot be located. In this case, an image indicating that the search for the golf ball has timed out is displayed on the display device. For example, a notification such as "Ball not found. Continue playing from Play 4!" may be displayed. This eliminates the time wasted searching for the lost ball and allows for smooth play, resulting in a more comfortable playing experience for the golfer.
[0080] This concludes the description of the golf support process according to this embodiment. In the present embodiment, the mobile object operated on the golf course is a course traveling vehicle such as a PMV or an AMR, but the mobile object operated on the golf course may be any other type of mobile object. For example, the moving object operated on the golf course may be an autonomous air vehicle such as a drone. In this case, the image capturing unit captures the trajectory image using a camera mounted on the autonomous air vehicle, and the path calculation unit calculates the movement path of the autonomous air vehicle to the predicted drop position and transmits the calculated path to the autonomous air vehicle.
[0081] ***Other Configurations*** <Variation 1> The course running vehicle may be equipped with a projection device that projects projection mapping. The ball search unit generates a projection mapping that guides the user in the direction of the position of the golf ball on the golf course and transmits it to the vehicle traveling on the course. At this time, the ball search unit generates the projection mapping that guides the user in the direction of the position of the golf ball based on the current position and attitude of the vehicle traveling on the course. When the projection device of the golf course vehicle receives the projection mapping, it projects a projection mapping that guides the user onto the golf course. For example, it projects an arrow pointing from the golf course vehicle to the position of the golf ball onto the grass of the golf course. According to the first modification, the time required to search for a lost ball can be further reduced.
[0082] <Variation 2> The photographing unit of the course traveling vehicle photographs the state of the golf course when autonomously driving to the destination. For example, the photographing unit has a function to determine whether the grass is damaged. The movement control unit of the course traveling vehicle drives while avoiding areas where the grass is damaged and transmits information about the damaged areas to the server device 200. The server device 200 reflects information about areas where the turf is damaged in the course map information. The server device 200 may also use information about areas where the turf is damaged to create a maintenance plan.
[0083] Modification 2 has the effect of enabling efficient maintenance of the golf course. It also has the effect of reducing maintenance costs. While the example described here uses information about areas where the turf is damaged, it is also possible to detect other information about changes in the course, such as daily hazard areas or construction sites.
[0084] <Variation 3> The route calculation unit may also set a driving route near an area in the course map information where there is little updated data. For example, to update map data for points of change such as areas under construction, areas of the golf course where changes have been made, or areas where the turf has been cultivated, it is necessary to measure the areas near these areas. The route calculation unit may set a driving route near an area where such measurement data is required. The course traveling vehicle, while automatically driving along the travel route, takes photographs of the surrounding area for which measurement data is required and transmits the photographs to the server device 200. According to the third modification, there is an advantage that it is possible to acquire update data necessary for updating the map.
[0085] <Variation 4> The server device 200 may collect the following data as detailed information about the golf course: A. Images measured by drones and point cloud data from the images B. Lidar data such as cart road data from vehicles traveling on the course C. 3D point cloud information of the green surface obtained by drones or fixed lidar radar
[0086] <Variation 5> In this embodiment, the landing position of the golf ball is predicted by analyzing the trajectory image. In this case, if the sun is in the direction of the ball's flight, the accuracy of detecting the golf ball decreases. Therefore, when the server device 200 detects that the sun is in the direction in which the ball is flying, it takes the following measures. (1) A drone or AMR is used to photograph the golfer's side from the side where the ball will land, and a trajectory image of the ball's trajectory is obtained. By analyzing this trajectory image, the accuracy of predicting the ball's landing position can be improved, even if the sun is in the direction of the ball's flight. In this case, the drone or AMR is an example of a mobile object operated on a golf course. (2) Photographing is performed in conjunction with other vehicles traveling on the course, and the multiple vehicles traveling on the course photograph the trajectory of the golf ball. The trajectory prediction unit predicts the landing position of the golf ball from the multiple trajectory images. In this case, interlocking control may be performed by vehicle-to-vehicle communication between the multiple vehicles traveling on the course. Alternatively, interlocking instructions may be sent from a server device to the multiple vehicles traveling on the course. (3) The server device or the vehicle traveling on the course may be configured to control a camera installed on the course. The camera may be configured to capture a shot of the golfer from the drop side, and a trajectory image of the golfer from the drop side may be acquired. By analyzing this trajectory image, the accuracy of the drop position prediction can be improved even when the sun is in the direction of the ball's flight.
[0087] <Variation 6> When capturing a trajectory image, the angle of view may be set to include the entire user along with the golf ball so that the trajectory image can also be used for swing analysis. Alternatively, a single course-traveling vehicle may be equipped with multiple cameras, including a camera that photographs the trajectory of the golf ball and a camera that photographs the user's swing.
[0088] <Variation 7> In this embodiment, the functions of each device of the course traveling vehicle 100 and the server device 200 are realized by software. As a variation, the functions of each device of the course traveling vehicle 100 and the server device 200 may be realized by hardware. Specifically, each of the course traveling vehicle 100 and the server device 200 includes an electronic circuit 909 instead of a processor 910 .
[0089] FIG. 10 is a diagram showing an example of the configuration of a server device 200 according to a modification of the present embodiment. FIG. 11 is a diagram showing an example of the configuration of a course traveling vehicle 100 according to a modified example of this embodiment. The following description will be given taking the server device 200 as an example. The same applies to the course traveling vehicle 100.
[0090] The electronic circuit 909 is a dedicated electronic circuit that realizes the functions of the trajectory prediction unit 210, the path calculation unit 220, and the ball search unit 230. Specifically, the electronic circuit 909 is a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, a logic IC, a GA, an ASIC, or an FPGA. GA is an abbreviation for Gate Array. ASIC is an abbreviation for Application Specific Integrated Circuit. FPGA is an abbreviation for Field-Programmable Gate Array.
[0091] The functions of the trajectory prediction unit 210, the path calculation unit 220, and the ball search unit 230 may be realized by a single electronic circuit, or may be realized by distributing them among a plurality of electronic circuits.
[0092] As another variation, some of the functions of the trajectory prediction unit 210, path calculation unit 220, and ball search unit 230 may be implemented by electronic circuits, with the remaining functions being implemented by software. Also, some or all of the functions of the trajectory prediction unit 210, path calculation unit 220, and ball search unit 230 may be implemented by firmware.
[0093] Each of the processor and the electronic circuit is also called processing circuitry. That is, the functions of the trajectory prediction unit 210, the path calculation unit 220, and the ball search unit 230 are realized by the processing circuitry.
[0094] ***Explanation of the effect of this embodiment*** As described above, the golf support system according to the present embodiment can quickly and accurately search for and identify golf balls using images captured by an automatically driven golf course vehicle, thereby reducing the burden on the user of searching for the ball and providing a comfortable playing experience. In addition, the time spent searching for the ball is reduced and play proceeds smoothly, which has the effect of attracting more customers by improving turnover.
[0095] Furthermore, in the golf support system according to this embodiment, the server device manages the locations of multiple vehicles traveling on the course and manages the driving route history of the multiple vehicles traveling on the course. Therefore, the golf support system according to this embodiment uses a threshold value for the number of times the vehicle has traveled at the same location to minimize duplicate travel on the same route or at turning points, thereby improving course maintenance. Furthermore, the golf support system according to the present embodiment can manage information about multiple course-traveling vehicles, such as overlapping trajectories, intersections, frequency, and whether or not the vehicle is in or out of service, as course travel information. By managing this course travel information, the travel status of the course can be visualized and displayed on a map by changing the color, etc. Finally, the course driving information can be utilized as course maintenance information for the fairways. It is said that golf courses require a certain degree of firmness, and the firmness of the course is also said to be the know-how for course construction. The firmness of the course is created by actively driving lawn mowers, riding carts, or caddy back carries. The course driving information can be utilized as course maintenance information for the fairways at that time.
[0096] Embodiment 2 In this embodiment, differences from and additions to the first embodiment will be mainly described. In this embodiment, components having the same functions as those in the first embodiment are given the same reference numerals, and the description thereof will be omitted.
[0097] In this embodiment, the course traveling vehicle 100 transmits to the server device 200 a user image 55 obtained by capturing the situation of the user 20 on the golf course. In the server device 200, the user information providing unit 240 analyzes the user image 55 and provides various services to the user.
[0098] ***Configuration Description*** FIG. 12 is a diagram illustrating an example of the configuration of the server device 200 according to this embodiment. FIG. 13 is a diagram showing an example of the configuration of a course traveling vehicle 100 according to this embodiment.
[0099] The server device 200 includes a user information providing unit 240 in addition to the functional elements of the first embodiment. The user information providing unit 240 acquires the situation of the user 20 on the golf course as a user image 55. Based on the user image 55, the user information providing unit 240 generates a user video 58 that summarizes the user's play, or a user shot image 59.
[0100] The basic configuration of the course traveling vehicle 100 is the same as that of the first embodiment. The image capturing unit 120 captures the user's appearance while playing and transmits the captured image as a user image 55 to the server device 200. The display unit 130 receives the user video 58 or shot image 59 from the server device 200 and displays it on the display device 941 .
[0101] ***Explanation of Operation*** <Shot image> The user information providing unit 240 captures the situation of the user 20 on the golf course using the vehicle camera 961 as a user image 55. The user information providing unit 240 extracts a shot image of the user 20's shot from the user image 55 and displays it on a display device as a shot image 59 representing the swing of the user 20. The display device here is the display of the course traveling vehicle 100, or the display of a device such as a smartphone, tablet, or smartwatch carried by the user 20.
[0102] FIG. 14 is a diagram showing an example of a shot image 59 according to this embodiment. FIG. 15 is a diagram showing another example of a shot image 59 according to the present embodiment.
[0103] In response to a user request, the user information providing unit 240 provides shot images 59 in a continuous format from the take-back to the follow-through swing as shown in FIG. The user information providing unit 240 may also provide a shot image 59 of the swing at the user's request, as shown in Fig. 15. The user information providing unit 240 may also capture the user's swing from a different angle in cooperation with other devices such as other vehicles traveling on the course, drones, other AMRs, or cameras on the course.
[0104] The user information providing unit 240 uses AI to learn various golf swings, appropriately judges the state of the golf swing, and provides the shot image 59 to the user.
[0105] <User video> Furthermore, the user information providing unit 240 generates a user video 58 that summarizes the play of the user 20 on the golf course based on the user image 55. The user information providing unit 240 displays the user video 58 on a display device.
[0106] For example, the user information providing unit 240 extracts a topic for each hole from the user image 55 and generates a user video 58 of the play of all holes. For example, the user information providing unit 240 may generate the user video 58 by selecting the tee shot and the putt as the topic for each hole.
[0107] The user information providing unit 240 uses AI to learn various play situations on one hole as well as the user's preferences, appropriately judges the play situation, and provides a user video 58 that is preferred by the user.
[0108] ***Other Configurations*** <Variation 8> In this embodiment, a user image capturing the user's situation on the golf course is transmitted to the server device 200. In the server device 200, a user information providing unit analyzes the user image to provide various services to the user.
[0109] As the user video, not only a video of the game (play movie) but also a video compiling the golf competition may be created. Also, instead of a video, an album extracted from user images may be created.
[0110] <Variation 9> In addition, the shot video may be enhanced with added value such as an AI caddy or remote lessons.
[0111] The user information providing unit detects the start of a shot from the user image and generates lesson information for the shot. The user information providing unit generates the following lesson information using three-dimensional information about the course and information such as undulation and swing comparison, and transmits it to the vehicle traveling on the course. Golf lessons (also known as round lessons) (AI-based automatic commenting and remote lessons) For example, "Left foot down. Position the ball to the right, and keep your swing compact and follow the slope..." Example: "Last time, something happened. Please be considerate." Example: "The cup is XX yards away, and there is a guard bunker △△ yards to the right. There is a deep bunker on the left around the green..."
[0112] The user information providing unit may also use a facial information confirmation function on a smartphone or tablet device installed in the vehicle traveling on the course to read the user's facial expression based on the lesson information provided, and grasp the user's "pleasant / unpleasant" level, thereby evaluating the provided lesson information.
[0113] With the user's permission, the user's video can be posted on the homepage and users can rate it. For example, users can rate it in a simple questionnaire format so that it is not a burden on them. These ratings can be collected and used to improve the quality of the user's video.
[0114] <Modification 10> An online golf competition system may be provided in which multiple players (for example, four players) play on different physical golf courses. The online golf competition system may provide, for example, the following functions: · Holding a 4-person meeting (web conference), holding a competition member meeting (web conference) · Player face recognition (performs comfort / discomfort checks and is used to improve quality) - Playback of your most recent shot form -Score sharing
[0115] <Variation 11> The course map information includes high-precision 3D map data of the greens within the golf course. Using this high-precision 3D map data of the greens, putting information can be provided to the user, suggesting the optimal putting direction and strength based on the position of the golf ball on the green.
[0116] Furthermore, instead of using the high-precision 3D map data of the golf support system, a high-precision satellite positioning terminal, such as a GPS positioning terminal, can be used to measure the position of the cup on the green in advance, and that position can be registered as a private reference point in the course map information 251.The user can then take an image of the ball and cup on the green surface on the same screen, and by generating and utilizing high-precision 3D information about the green surface from the image and the high-precision 3D position information of the cup, putting information can be provided to the user. For example, putting information is provided to the user as follows: (1) Launch the application on your mobile device (2) Photographing the green surface including the golf ball (3) Enter the rolling speed of the ball on the green in advance. On golf courses, a stimpmeter measures the rolling speed of the ball (8-13 ft). (4) Provides ideal putting line and strength (flatness conversion, etc.)
[0117] In addition, new high-precision 3D point cloud information that can be generated using images taken with a smartphone or other device and information from private reference points may be used for the automatic update of already registered high-precision 3D point cloud information for the green surface.
[0118] ***Explanation of the effect of this embodiment*** As described above, the golf support system according to the present embodiment has the effect of being able to provide various services to the user by analyzing the user image.
[0119] In the above first and second embodiments, each unit of each device of the golf support system has been described as an independent functional block. However, the configuration of each device of the golf support system does not have to be the same as that of the above-described embodiments. The functional blocks of each device of the golf support system may have any configuration as long as they can realize the functions described in the above-described embodiments. Furthermore, each device of the golf support system may not be a single device, but may be a system composed of multiple devices.
[0120] For example, some of the functions of the server device 200 may be provided in the course traveling vehicle 100. Alternatively, some of the functions of the course traveling vehicle 100 may be provided in the server device 200.
[0121] Furthermore, it is possible to combine multiple parts of the first and second embodiments. Alternatively, it is possible to implement only one part of these embodiments. In addition, it is possible to implement any combination of these embodiments, either as a whole or in part. That is, in the first and second embodiments, the respective embodiments can be freely combined, or any of the components in the respective embodiments can be modified, or any of the components in the respective embodiments can be omitted.
[0122] The above-described embodiments are essentially preferred examples and are not intended to limit the scope of the present disclosure, the scope of application of the present disclosure, or the scope of use of the present disclosure. The above-described embodiments can be modified in various ways as needed. For example, the procedures described using flow charts or sequence diagrams may be modified as appropriate. [Explanation of symbols]
[0123] 20 User, 30 Flight information, 31 Shooting range, 50 Driving route, 51 Location information, 52 Trajectory image, 53 Search range, 54, 54a Search image, 55 User image, 57 Search result, 58 User video, 59 Shot image, 61 Predicted trajectory, 62 Predicted trajectory image, 63 Predicted landing position, 100 Course traveling vehicle, 110 Movement control unit, 120 Photography unit, 130 Display unit, 200 Server device, 210 Trajectory prediction unit, 220 Path calculation unit, 230 Ball search unit, 240 User information providing unit, 140, 250 Memory unit, 251 Course map information, 252 Number threshold, 300 Drone, 301 Aerial camera, 302 Flight control unit, 400 Golf course, 500 Golf support system, 909 Electronic circuit, 910 Processor, 921 Memory, 922 auxiliary storage device, 930 input interface, 940 output interface, 941 display device, 950 communication device, 961 vehicle camera, 962 lidar radar, 963 position sensor.
Claims
1. A golf support system for supporting a user playing on a golf course, the golf support system including a mobile object operated on the golf course, an image capturing unit that captures a trajectory of a golf ball hit by the user as a trajectory image using a camera mounted on the moving object; a trajectory prediction unit that calculates a trajectory of the golf ball as a predicted trajectory using the trajectory image; a path calculation unit that calculates a predicted landing position, which is a landing position of the golf ball, using the predicted trajectory, and calculates a moving path of the moving object to the predicted landing position; a ball search unit that, when the moving object arrives at the predicted drop position, determines a search range for searching for the golf ball based on the predicted drop position, searches for the golf ball by photographing the search range with the camera, and displays the search results obtained by the search on a display device; A golf support system comprising:
2. 2. The golf support system according to claim 1, wherein the moving body is an autonomous transport robot, a PMV (Personal Mobility Vehicle) capable of carrying a person and traveling, or an autonomous flying object.
3. The golf support system includes: an autonomous flying object that autonomously flies in the air above the golf course, the autonomous flying object having an aerial camera that photographs the golf course from above; The ball search unit 3. A golf support system as described in claim 1 or claim 2, which determines whether the search range includes an area other than the fairway, and if the search range includes an area other than the fairway, searches for the golf ball in the search range by photographing the search range with the aerial camera.
4. The ball search unit A golf support system as described in any one of claims 1 to 3, wherein the golf ball is searched for by performing image recognition processing on an image taken of the search range, and when the golf ball is identified, the position of the golf ball on the golf course is identified, the search result is generated in which the position of the golf ball is superimposed on the image of the golf course, and the search result is displayed on the display device.
5. The moving body includes a projection device that projects projection mapping, The ball search unit generating a projection mapping that guides the user in the direction of a position of the golf ball on the golf course; The projection device is The golf support system according to claim 4 , further comprising: a projection mapping device that projects onto the golf course to guide the user.
6. The ball search unit 6. The golf support system according to claim 4 or claim 5, further comprising: a search result indicating that the search for the golf ball has timed out if the golf ball cannot be identified within a predetermined time; and displaying the search result on the display device.
7. The golf support system includes: a memory unit for storing course map information that records past travel records of a mobile object on the golf course; The path calculation unit is 7. The golf support system according to claim 1, wherein the travel route is generated based on the course map information so that the number of times the same route is traveled on the golf course is less than a predetermined number.
8. The course map information includes areas on the golf course where no moving objects can enter, The path calculation unit is The golf support system according to claim 7 , wherein the travel route is generated based on the course map information so as to travel outside the no-entry areas.
9. The course map information includes three-dimensional map data of the golf course, The path calculation unit is 9. The golf support system according to claim 7, wherein the travel route is generated based on the course map information so as to avoid steeply inclined routes.
10. The golf support system includes: A movement control unit that controls the autonomous movement of the moving object, The imaging unit includes: A golf support system as described in any one of claims 1 to 8, which generates shooting position control information that controls the position of the moving body so that the camera photographs the trajectory of the golf ball from behind the user along the golf course, and transmits the shooting position control information to the mobile control unit.
11. The imaging unit includes: A golf support system as described in any one of claims 1 to 10, which detects the user's posture at the start of a shot, causes the camera to start photographing the trajectory of the golf ball based on the detection of the posture at the start of the shot, and causes the camera to stop photographing based on the size of the golf ball in the image being photographed.
12. The golf support system further comprises: The golf support system according to any one of claims 1 to 10, further comprising a user information providing unit that captures the user's situation on the golf course as a user image using the camera, extracts a shot image capturing the user's shot from the user image, and displays the shot image on the display device.
13. The user information providing unit, The golf support system according to claim 12 , further comprising: a video summarizing the user's play on the golf course based on the user image; and displaying the video on the display device.
14. The display device includes:
14. The golf support system according to claim 1, wherein the system is at least one of a display mounted on the moving object and a portable terminal device carried by the user.
15. The trajectory prediction unit:
15. The golf support system according to claim 1, wherein a predicted trajectory image obtained by superimposing the predicted trajectory on the image of the golf course is displayed on the display device.
16. The golf support system includes: A server device that communicates with the mobile object, The moving object includes the photographing unit, The imaging unit includes: Transmitting the ballistic image to the server device; the server device includes the trajectory prediction unit, the path calculation unit, and the ball search unit; The path calculation unit is The golf support system according to claim 1 , further comprising: a step of transmitting the travel route to the mobile object.
17. 1. A golf support system comprising: a mobile object operated on a golf course; and a server device that transmits a moving route to the mobile object, the server device being provided to the system for supporting a user playing on the golf course, A camera mounted on the moving body and configured to capture an image of a surrounding environment of the moving body; an image capturing unit that captures a trajectory of the golf ball hit by the user as a trajectory image using a camera mounted on the moving object; a trajectory prediction unit that calculates a trajectory of the golf ball as a predicted trajectory using the trajectory image; a path calculation unit that calculates a predicted landing position, which is a landing position of the golf ball, using the predicted trajectory, and calculates the movement path to the predicted landing position; a ball search process for determining a search range for searching for the golf ball based on the predicted drop position when the moving object arrives at the predicted drop position, searching for the golf ball by photographing the search range with the camera, and displaying the search results obtained by the search on a display device; A server device comprising:
18. A golf support method for use in a golf support system for supporting a user playing on a golf course, the golf support system including a mobile object operated on the golf course, comprising: The computer captures a trajectory of the golf ball hit by the user as a trajectory image using a camera mounted on the moving object, A computer calculates a trajectory of the golf ball as a predicted trajectory using the trajectory image, a computer calculates a predicted landing position, which is a landing position of the golf ball, using the predicted trajectory, and calculates a moving path of the moving object to the predicted landing position; A golf support method in which, when the moving object arrives at the predicted drop position, a computer determines a search range in which to search for the golf ball based on the predicted drop position, searches for the golf ball by photographing the search range with the camera, and displays the search results obtained by the search on a display device.
19. A golf support system for supporting a user playing on a golf course, the golf support system including a mobile object operated on the golf course, comprising: an imaging process for capturing a trajectory image of a trajectory of a golf ball hit by the user using a camera mounted on the moving object; a trajectory prediction process for calculating a trajectory of the golf ball as a predicted trajectory using the trajectory image; a path calculation process for calculating a predicted landing position, which is a landing position of the golf ball, using the predicted trajectory, and calculating a moving path of the moving object to the predicted landing position; a ball search process for determining a search range for searching for the golf ball based on the predicted drop position when the moving object arrives at the predicted drop position, searching for the golf ball by photographing the search range with the camera, and displaying the search results obtained by the search on a display device; A golf support program that causes a computer to execute the above.
20. A golf support system that supports a user playing on a golf course, the golf support system including a course traveling vehicle that is operated on the golf course and transports people or luggage, an image capturing unit that captures a trajectory of the golf ball hit by the user as a trajectory image using a camera mounted on the golf course traveling vehicle; a trajectory prediction unit that calculates a trajectory of the golf ball as a predicted trajectory using the trajectory image; a path calculation unit that calculates a predicted drop position, which is a drop position of the golf ball, using the predicted trajectory, and calculates a movement path of the course traveling vehicle to the predicted drop position; A golf support system comprising:
21. The golf support system according to claim 20, wherein the course running vehicle is a one-person PMV (Personal Mobility Vehicle).
22. The photographing unit photographs the condition of the golf course when the course traveling vehicle travels on the golf course, and judges whether the grass of the golf course is damaged.
22. The golf support system according to claim 20 or 21.
23. The golf support system comprises: A movement control unit that controls the autonomous movement of the course traveling vehicle, The movement control unit controls the course traveling vehicle to travel while avoiding areas where the grass is damaged.
23. The golf assistance system according to claim 22.
24. The golf support system comprises: a server device that stores course map information that is map data of the golf course; The server device reflects information about the areas where the photographing unit judges that the grass is damaged in the course map information.
23. The golf assistance system according to claim 22.
Citation Information
Patent Citations
Systems and methods for monitoring objects at sporting events
CN109069903A
System and method for storing and analyzing golf data
JP2014512220A
Robot Golf Caddy
JP6841835B2
No caddy system
KR101872465B1
Apparatus for tracking object
KR1020180050589A
