Golf support system, golf support method, golf support program, server device, and client device

The golf support system simplifies user operations and enhances accuracy by using a client device with a camera and lidar radar to photograph the green, and a server device with database and calculation units to determine putting lines, facilitating efficient putting on a green.

JP7580665B2Active Publication Date: 2024-11-11MITSUBISHI ELECTRIC CORP
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2024520201
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-05-13
Publication Date
2024-11-11
Estimated Expiration
2042-05-13

AI Technical Summary

Technical Problem

Existing golf support technologies require complex user operations and lack accuracy in detecting the cup and ball positions, leading to delays and errors during putting on a green.

Method used

A golf support system that includes a client device with a camera and lidar radar to photograph the green, a server device with a database and calculation units to determine the cup and ball positions, and a line calculation unit to provide a putting line, simplifying user operations and enhancing accuracy.

Benefits of technology

Enables quick and accurate determination of cup and ball positions, allowing for efficient and precise putting support on a green.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007580665000001
    Figure 0007580665000001
  • Figure 0007580665000002
    Figure 0007580665000002
  • Figure 0007580665000003
    Figure 0007580665000003
Patent Text Reader

Abstract

This golf assistance system (500) assists a user on a green. A course map database (251) stores green surface information (511), green speed information (512), and reference point position information (513) that is the position of a feature reference point of a reference feature. An image capturing unit captures, by means of a camera, a green captured image (51) that includes the feature reference point, a cup provided in the green, and a golf ball on the green. A position calculating unit (210) uses the green captured image (51), the green surface information (511), and the reference point position information (513) to calculate a ball position (62). A line calculating unit (220) uses the green surface information (511) and the green speed information (512) to calculate a putting line (22) from the ball position (62) to the cup position (61).
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a golf support system, a golf support method, and a golf support program, and more particularly to a golf support system, a golf support method, and a golf support program that support a user putting on a green of a golf course. [Background technology]

[0002] In recent years, applications have been developed to assist users in putting on the green. For example, there is an application in which a user scans the green with a smartphone, aligns the markers on the screen with the positions of the cup and the ball, and taps to display the putting line. In this application, the user's operation may become complicated, which may cause a delay in the progress of the game. In addition, the shape of the green, the position of the cup, and the position of the ball may be inaccurate depending on the skill of the user's operation.

[0003] Patent Document 1 discloses an electronic device that predicts a putting line and displays the predicted putting line. Patent Document 2 discloses a position detection device that is attached to a cup on the green to detect the position of the cup with high accuracy. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6714799 [Patent Document 2] Patent No. 6744663 Summary of the Invention [Problem to be solved by the invention]

[0005] The technology of Patent Document 1 requires the user to input the cup position and the ball position, which makes the user's operation complicated and reduces the accuracy of the cup position and the ball position. The position detection device of Patent Document 2 is attached to a cup on the green when used. In this way, the position detection device of Patent Document 2 is a device that is used when a golfer detects the cup position with high accuracy in advance when planning a playing strategy, and is not used while playing golf. Therefore, there is a problem that it cannot support a user putting on the green. In addition, the position detection device of Patent Document 2 does not mention the detection of the ball position.

[0006] The present disclosure aims to quickly and accurately assist users putting on the green by obtaining the cup position and ball position with high accuracy through simple operations near the green. [Means for solving the problem]

[0007] The present disclosure relates to a golf support system that supports a user on a green of a golf course, comprising: a course map database that stores green surface information including the position and surface shape of the green, green speed information that indicates the rolling speed of a golf ball on the green, and reference point position information that is the position of a feature reference point on a reference feature fixed on the green or in the vicinity of the green; an image capturing unit that captures a green image including the feature reference point, a cup provided on the green, and the golf ball on the green using a camera; a position calculation unit that calculates a ball position, which is the position of the golf ball, using the green photographed image, the green surface information, and the reference point position information; a line calculation unit that calculates a putting line from the ball position to a cup position that is the position of the cup on the green, using the green surface information and the green speed information; Equipped with. Effect of the Invention

[0008] According to the golf support system of the present disclosure, the cup position and the ball position can be obtained with high accuracy by simple operations near the green. Therefore, the golf support system of the present disclosure aims to quickly and accurately support a user putting on the green. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram showing an example of the overall configuration of a golf support system according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of the configuration of a client device according to the first embodiment. [Diagram 3] FIG. 2 is a diagram showing a configuration example of a server device according to the first embodiment. [Figure 4] 3 is a flowchart showing the operation of the golf support system according to the first embodiment. [Diagram 5] FIG. 2 is a diagram showing an example of a client device according to the first embodiment. [Figure 6] FIG. 2 is a diagram showing an example of a green photographed image according to the first embodiment. [Figure 7] FIG. 4 is a diagram showing an example of a putting line image according to the first embodiment. [Figure 8] FIG. 4 is a diagram showing an example of a partially enlarged view of a putting line image according to the first embodiment. [Figure 9] FIG. 11 is a flowchart showing the operation of the golf support system according to the first modification of the first embodiment. [Figure 10] FIG. 13 is a diagram showing an example of the configuration of a client device according to a fourth modification of the first embodiment. [Figure 11] FIG. 13 is a diagram showing an example of a configuration of a server device according to a fourth modification of the first embodiment. [Figure 12] FIG. 11 is a diagram showing an example of the configuration of a course traveling vehicle which is a client device according to the second embodiment. [Figure 13] 10 is a flowchart showing the operation of the golf support system according to the second embodiment. [Figure 14]FIG. 11 is a diagram showing an example of a putting line image according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the present embodiment will be described with reference to the drawings. In each drawing, the same or corresponding parts are given the same reference numerals. In the description of the embodiment, the description of the same or corresponding parts will be omitted or simplified as appropriate. The arrows in the drawing mainly indicate the flow of data or the flow of processing. In addition, the relationship of the size of each component in the following drawings may differ from the actual one. In addition, in the description of the embodiment, directions or positions such as up, down, left, right, front, back, front, and back may be indicated. These notations are for convenience of explanation and do not limit the arrangement, direction, or orientation of devices, instruments, parts, etc.

[0011] Embodiment 1 ***Configuration Description*** FIG. 1 is a diagram showing an example of the overall configuration of a golf support system 500 according to the present embodiment. The golf support system 500 is a system that supports a user 20 who plays golf on a golf course 40. The user 20 is also called a golfer or a player who plays golf on the golf course 40. In particular, the golf support system 500 according to this embodiment supports the user 20 who is putting on the green 41 of the golf course 40.

[0012] The golf support system 500 includes a client device 100 and a server device 200 . The client device 100 is, for example, a mobile terminal device such as a smartphone, a mobile phone, or a tablet terminal. Alternatively, the client device 100 may be a course traveling vehicle that automatically drives the golf course 40 based on a driving route. Note that the case where the client device 100 is a course traveling vehicle will be described in the second embodiment. The server device 200 is realized by, for example, a cloud computer. The server device 200 communicates with the client device 100 via a network.

[0013] FIG. 2 is a diagram showing an example of a configuration of the client device 100 according to the present embodiment. The client device 100 is a computer. The client device 100 includes a processor 910, as well as other hardware such as a memory 921, an auxiliary storage device 922, an input interface 930, an output interface 940, a communication device 950, a camera 961, a lidar radar 962, and a position sensor 963. The processor 910 is connected to the other hardware via a signal line or a wireless connection, and controls the other hardware.

[0014] The client device 100 includes, as functional elements, an image capturing unit 110, an information collecting unit 120, a display unit 130, and a storage unit 140. The client device 100 is a mobile terminal device such as a smartphone, a mobile phone, or a tablet terminal. Therefore, the client device 100 has various other functions for realizing the functions as a mobile terminal device, but only the functions used in this embodiment are illustrated here.

[0015] The camera 961 is an image capturing device built into a mobile terminal device such as a smartphone, a mobile phone, or a tablet terminal. The camera 961 captures an image of the surroundings of the client device 100 by operation of the user 20. The LIDAR radar 962 detects the distance to objects around the client device 100. The LIDAR radar 962 generates a point cloud image.

[0016] The position sensor 963 acquires the position information 53 of the client device 100. More specifically, the position sensor 963 acquires the position and time of the client device 100 as the position information 53. The position sensor 963 is, for example, a GPS. GPS is an abbreviation for Global Positioning System. The location information 53 acquired by the location sensor 963 is transmitted to the server device 200 by the information collecting unit 120 .

[0017] FIG. 3 is a diagram showing an example of a configuration of the server device 200 according to the present embodiment. The server device 200 is a computer. The server device 200 includes a processor 910, as well as other hardware such as a memory 921, an auxiliary storage device 922, an input interface 930, an output interface 940, and a communication device 950. The processor 910 is connected to the other hardware via a signal line or a wireless connection, and controls the other hardware. For ease of explanation, the same reference numerals are used for hardware having the same functions as those of the client device 100. However, it is self-evident that the client device 100 and the server device 200 each have their own hardware.

[0018] The server device 200 includes, as functional elements, a position calculation unit 210, a line calculation unit 220, an image generation unit 230, a database update unit 240, and a storage unit 250. A course map database 251 is stored in the storage unit 250. The course map database 251 includes green surface information 511, green speed information 512, and reference point position information 513.

[0019] The functions of the position calculation unit 210, the line calculation unit 220, the image generation unit 230, and the database update unit 240 are realized by software. The storage unit 250 is provided in the memory 921. Note that the storage unit 250 may be provided in the auxiliary storage device 922, or may be provided in a distributed manner in the memory 921 and the auxiliary storage device 922.

[0020] The processor 910 is a device that executes a golf support program. The golf support program is a program that realizes the functions of each device of the client device 100 and the server device 200. In the server device 200, the golf support program is a program that realizes the functions of the position calculation unit 210, the line calculation unit 220, the image generation unit 230, and the database update unit 240.

[0021] The processor 910 is an IC that performs arithmetic processing. Specific examples of the processor 910 are a CPU, a DSP, and a GPU. IC is an abbreviation for Integrated Circuit. CPU is an abbreviation for Central Processing Unit. DSP is an abbreviation for Digital Signal Processor. GPU is an abbreviation for Graphics Processing Unit.

[0022] The memory 921 is a storage device that temporarily stores data. Specific examples of the memory 921 are SRAM and DRAM. SRAM is an abbreviation for Static Random Access Memory. DRAM is an abbreviation for Dynamic Random Access Memory. The auxiliary storage device 922 is a storage device that stores data. A specific example of the auxiliary storage device 922 is a HDD. The auxiliary storage device 922 may also be a portable storage medium such as an SD (registered trademark) memory card, CF, NAND flash, a flexible disk, an optical disk, a compact disk, a Blu-ray (registered trademark) disk, or a DVD. Note that HDD is an abbreviation for Hard Disk Drive. SD (registered trademark) is an abbreviation for Secure Digital. CF is an abbreviation for CompactFlash (registered trademark). DVD is an abbreviation for Digital Versatile Disk.

[0023] The input interface 930 is a port connected to an input device such as a mouse, a keyboard, or a touch panel. Specifically, the input interface 930 is a USB terminal. The input interface 930 may be a LAN interface or Bluetooth (registered trademark). USB is an abbreviation for Universal Serial Bus. LAN is an abbreviation for Local Area Network.

[0024] The output interface 940 is a port to which a cable of an output device such as a display is connected. The output interface 940 may be a LAN interface or Bluetooth (registered trademark). Specifically, the output interface 940 is a USB terminal or an HDMI (registered trademark) terminal. Specifically, the display is an LCD. The output interface 940 is also called a display interface. HDMI (registered trademark) is an abbreviation for High Definition Multimedia Interface. LCD is an abbreviation for Liquid Crystal Display.

[0025] The communication device 950 has a receiver and a transmitter. The communication device 950 is connected to a communication network such as Wi-Fi (registered trademark), a LAN, the Internet, or a telephone line. Specifically, the communication device 950 is a communication chip or a NIC. NIC is an abbreviation for Network Interface Card.

[0026] The golf support program is executed in each device of the golf support system 500. The golf support program is loaded into the processor 910 and executed by the processor 910. Memory 921 stores not only the golf support program but also an OS. OS is an abbreviation for Operating System. The processor 910 executes the golf support program while executing the OS. The golf support program and the OS may be stored in an auxiliary storage device 922. The golf support program and the OS stored in the auxiliary storage device 922 are loaded into the memory 921 and executed by the processor 910. Note that a part or all of the golf support program may be incorporated into the OS.

[0027] Server device 200 may include a plurality of processors that replace processor 910. These plurality of processors share the task of executing the golf support program. Each of the processors is a device that executes the golf support program, similar to processor 910.

[0028] Data, information, signal values ​​and variable values ​​used, processed or output by the golf assistance program are stored in memory 921 , secondary storage device 922 , or in registers or cache memory within processor 910 .

[0029] In the server device 200, the "parts" of the position calculation unit 210, the line calculation unit 220, the image generation unit 230, and the database update unit 240 may be interpreted as "circuits," "steps," "procedures," "processing," or "circuitry." The golf support program causes a computer to execute a position calculation process, a line calculation process, an image generation process, and a database update process. The "processing" of the position calculation process, the line calculation process, the image generation process, and the database update process may be interpreted as a "program," "program product," "a computer-readable storage medium storing a program," or a "computer-readable recording medium recording a program." The golf support method is a method performed by each device of the golf support system 500 executing the golf support program. The golf support program may be provided in a form stored in a computer-readable recording medium, or as a program product.

[0030] ***Explanation of Operation*** Next, an operation of the golf support system 500 according to this embodiment will be described. The operation procedure of the golf support system 500 corresponds to a golf support method. Moreover, a program for realizing the operation of the golf support system 500 corresponds to a golf support program.

[0031] FIG. 4 is a flow diagram showing the operation of the golf support system 500 according to the present embodiment. The golf support system 500 according to this embodiment is a system that supports a user 20 who is about to putt on a green 41 of a golf course 40. The golf support system 500 is downloaded to a client device 100 as an application, for example, and used by the user 20.

[0032] <Photography process: Step S101> In step S101, the photographing section 110 photographs the green photographed image 51 with the camera 961. The green photographed image 51 includes the feature reference point 403, the cup 42 provided on the green 41, and the golf ball 21 on the green 41.

[0033] FIG. 5 is a diagram illustrating an example of a client device 100 according to the present embodiment. The client device 100 is, for example, a smartphone as shown in FIG. The user 20 starts the application downloaded to the client device 100. The client device 100 goes into a shooting mode for the green photographed image 51, and the user 20 photographs the green photographed image 51 with the camera 961 in accordance with the instructions of the application. At this time, the display unit 130 of the client device 100 may display a warning notice 55 that alerts the user 20 to take an image including the feature reference point 403, the cup 42, and the golf ball 21.

[0034] Additionally, the camera 961 may obtain information regarding the wetness or dryness of the grass on the green 41. Furthermore, surrounding weather information may be obtained from self-position information obtained by the position sensor 963.

[0035] FIG. 6 is a diagram showing an example of a green photographed image 51 according to the present embodiment. 6, a cup 42 into which the user 20 puts the golf ball 21 is provided on the green 41. The golf ball 21 that the user 20 is about to putt is placed on the green 41.

[0036] The user 20 uses the camera 961 to capture a green photographed image 51 of the green 41 including the feature reference point 403 , the cup 42 provided on the green 41 , and the golf ball 21 on the green 41 . A smartphone can be carried by user 20 while playing, allowing user 20 to quickly capture green photographed image 51.

[0037] The reference feature 43 is a feature that is fixed on the green 41 or in the vicinity of the green 41, and a predetermined position whose accurate position has been measured in advance is set as the feature reference point 403. In other words, the feature reference point 403 refers to a predetermined position on the reference feature 43. The precise positions of the feature reference points 403 are measured in advance by high-precision positioning, and these positions are set in the reference point position information 513 of the course map database 251 .

[0038] Specific examples of the reference feature 43 include plants planted near the green 41, features such as sprinklers or drainage ditches installed near the green 41, and bunkers near the green 41. The reference feature 43 may also be a cup 42 installed on the green 41. On the other hand, movable objects such as pins or flags on the green are not suitable as the reference feature 43. The reference feature 43 is a fixed feature on the green 41 or near the green 41.

[0039] The feature reference point 403 is a predetermined position on the reference feature 43. For example, the bottom part of a plant closest to the green, the center part of an installation such as a sprinkler or a drainage ditch, or the part of the edge of a bunker closest to the green may be set as the feature reference point 403. In addition, when the reference feature 43 is a cup 42, the center of the cup 42 may be set as the feature reference point 403. Since the accurate position of the feature reference point 403 is measured in advance by high-precision positioning, the feature reference point 403 may be marked on the reference feature 43 during the high-precision positioning.

[0040] The position of the cup 42 on the green 41 usually changes periodically or irregularly. Therefore, when the reference feature 43 is the cup 42, high-precision positioning is performed on the feature reference point 403 (for example, the center of the cup 42) each time the cup position changes. Then, each time the cup position changes, the position of the feature reference point 403 as a result of the high-precision positioning is re-registered in the course map database 251.

[0041] The reference feature 43 may be different for each hole. For example, a sprinkler may be the reference feature 43 for the first hole, and a plant may be the reference feature 43 for the third hole. Alternatively, a cup 42 may be the reference feature 43 for all holes. When the user 20 takes the green photographed image 51, the display unit 130 notifies the user 20 of the location of the feature reference point 403 of the reference feature 43 on the hole in the attention notification 55. For example, the display unit 130 displays a warning notice 55 such as "Please take a picture including the feature reference point, the cup, and the golf ball. The feature reference point for the first hole is the center of the sprinkler in the back left."

[0042] The warning notification 55 may be transmitted from the server device 200 when the user 20 is in a shooting mode taking a green shot image 51. At this time, information on which hole's green the user 20 is on is determined based on the position information 53 transmitted from the client device 100. Alternatively, the warning notification 55 may be generated and displayed by the display unit 130 during a shooting mode in which the user 20 shoots the green shot image 51.

[0043] When the user 20 photographs the green photographed image 51 in accordance with the notice 55 displayed on the client device 100 , the photographing section 110 transmits the photographed green photographed image 51 to the server device 200 .

[0044] <Position calculation process: step S102> In step S102, the position calculation unit 210 calculates the position of the cup 42 and the golf ball 21 on the green 41 using the green photographed image 51, the green surface information 511, and the reference point position information 513. The position of the cup 42 calculated by the position calculation unit 210 is set as a cup position 61, and the position of the golf ball 21 is set as a ball position 62. Note that, for example, when the feature reference point 403 is in the center of the cup 42, the cup position 61 can be acquired from the reference point position information 513. Therefore, when the feature reference point 403 is other than the cup position 61, the position calculation unit 210 may calculate the cup position 61 and the ball position 62.

[0045] As shown in FIG. 3, the course map database 251 stores green surface information 511, green speed information 512, and reference point position information 513. The green surface information 511 includes the position of the green 41 and the surface shape of the green 41. The green surface information 511 is high-precision three-dimensional spatial information. For example, the course map database 251 stores high-precision three-dimensional map information of the entire golf course, and the green surface portion of the green surface information 511 may be used.

[0046] The green speed information 512 includes the rolling speed of the ball on the green 41. On the golf course, the rolling speed of the ball on the green 41 is measured in advance by a stimpmeter.

[0047] The reference point position information 513 includes the position of the feature reference point 403 on the green 41 or on a reference feature 43 fixed in the vicinity of the green 41. As described above, the position of the feature reference point 403 is assumed to have been accurately measured in advance by high-precision positioning.

[0048] The position calculation unit 210 matches the shape of the green 41 and the cup 42 in the green photographed image 51 with the green shape and the cup in the green surface information 511, and calculates the cup position 61. Furthermore, the position calculation unit 210 extracts position information of the feature reference point 403 in the green photographed image 51 from the reference point position information 513. The position calculation unit 210 corrects the cup position 61 using the position information of the feature reference point 403. Similarly, the position calculation unit 210 matches the shape of the green 41 and the cup 42 in the green photographed image 51 with the green shape and the cup in the green surface information 511, and calculates the ball position 62 in the green photographed image 51. Furthermore, the position calculation unit 210 corrects the ball position 62 using the position information of the feature reference point 403.

[0049] <Putting line calculation process: Step S103> In step S103 , the line calculation unit 220 calculates the putting line 22 from the ball position 62 to the cup position 61 using the green surface information 511 and the green speed information 512 .

[0050] Specifically, the line calculation unit 220 inputs the green surface information 511, the green speed information 512, the ball position 62, and the cup position 61 into a prediction algorithm, and calculates the putting line 22 from the ball position 62 to the cup position 61. The putting line prediction algorithm uses, for example, the prediction program described in Patent Document 1. The line calculation section 220 may also calculate the putting line taking into account information on the wetness of the grass or weather information.

[0051] <Image generation process: Step S104> In step S104, the image generating section 230 generates a putting line image 54 by superimposing the putting line 22 on the photographed image 51 of the green.

[0052] FIG. 7 is a diagram showing an example of a putting line image 54 according to the present embodiment. FIG. 7 shows a putting line image 54 in which the putting line 22 is superimposed on a photographed image 51 of the green. As shown in FIG. 7, the image generating section 230 may superimpose an exact target point 22a and an exact hitting direction 22b for realizing the putting line 22 on a putting line image . 7, the image generating section 230 may superimpose on the putting line image 54 a putting line (strong) 22c when the ball is hit strongly and a putting line (weak) 22d when the ball is hit weakly.

[0053] The image generating unit 230 calculates the just target 22a and the just launch direction 22b based on the green surface information 511 and the putting line 22 predicted by the line calculating unit 220. Alternatively, the line calculating unit 220 may calculate the just target 22a and the just launch direction 22b.

[0054] The image generating unit 230 adds a plurality of hitting directions to the putting line image 54. In Fig. 7, three stages of hitting directions are shown: hitting with just the right distance, hitting strongly, and hitting weakly. Specifically, the image generation unit 230 calculates the putting line (strong) 22c and the putting line (weak) 22d based on the green surface information 511 and the putting line 22 predicted by the line calculation unit 220. Alternatively, the line calculation unit 220 may calculate the putting line (strong) 22c and the putting line (weak) 22d.

[0055] FIG. 8 is a diagram showing an example of a partially enlarged view of the putting line image 54 according to the present embodiment. 8, the launch direction when hitting with the exact distance, the launch direction when hitting with a stronger shot, and the launch direction when hitting with a weaker shot may be indicated by arrows and superimposed on the putting line image 54. In this case, the length of the arrow may indicate the ratio of the stronger or weaker shot to the exact distance.

[0056] The image generating unit 230 may also display a specific numerical value of the launch angle on the putting line image 54. For example, a display such as "For a strong shot, α degrees to the right from the exact launch direction" may be used. It is difficult for the user 20 to measure the numerical value when putting, but the user can intuitively determine the direction to putt based on the numerical value.

[0057] When displaying the strength of a putt, the image generating unit 230 may display the strength of the putt using an index such as 70% of the strength when it is flat if it is a downward slope, and 20% more if it is an upward slope. Also, information such as the restitution coefficient of the putter of the user 20 may be registered in the client device 100, and the line calculation unit 220 may calculate the putting line taking into account the restitution coefficient of the putter. Also, the image generation unit 230 may display on the putting line image 54 an indication giving advice on the strength of putting taking into account the restitution coefficient of the putter. Furthermore, the image generating section 230 may display advice on putting strength that takes into account the moisture information of the grass on that day.

[0058] The image generating unit 230 transmits the generated putting line image 54 to the client device 100. Note that the image generating unit 230 may generate the putting line image 54 as a simulation image of the golf ball 21 entering the cup 42.

[0059] <Display process: Step S105> The display unit 130 of the client device 100 displays the putting line image 54 on the display device 941 . The display unit 130 may display the putting line image 54 in an AR format. AR is an abbreviation for Augmented Reality. Furthermore, if the putting line image 54 is a moving image, the display unit 130 plays the moving image on the display device 941 .

[0060] ***Other configurations*** <Variation 1> FIG. 9 is a flow chart showing the operation of the golf support system 500 according to the first modification of the present embodiment. In step S101a, the photographing unit 110 photographs a green point cloud image 52 including the feature reference point 403, a cup 42 provided on the green 41, and a golf ball 21 on the green 41, using the LIDAR radar 962. The photographing unit 110 transmits the green point cloud image 52 to the server device 200. The position calculation section 210 uses the green point cloud image 52 in addition to the green photographed image 51 to correct the cup position 61 and the ball position 62. By using the green point cloud image 52, the accuracy of the cup position 61 and the ball position 62 is improved.

[0061] In step S101 b, the information collection unit 120 acquires the location information 53 of the client device 100 by the location sensor 963 and transmits it to the server device 200. The position calculation unit 210 corrects the cup position 61 and the ball position 62 using position information 53 of the device equipped with the camera 961 and the LIDAR radar 962, that is, the client device 100. By using the position information 53 of the client device 100, the accuracy of the cup position 61 and the ball position 62 can be further improved.

[0062] In step S102 a, the database update unit 240 updates the surface shape of the green 41 included in the green surface information 511 based on the green point cloud image 52. The database update unit 240 uses the green photographed image 51 , the green point cloud image 52 , and the positions of the feature reference points 403 to create the latest green surface relief information as three-dimensional spatial information, and updates the green surface information 511 .

[0063] <Variation 2> In this embodiment, it is assumed that the position information of the feature reference point 403 is accurately measured in advance by high-precision positioning and stored in the reference point position information 513 . In the second modification, a device such as a Bluetooth (registered trademark) pendant may be installed at the feature reference point 403, and reference point position information previously measured with high accuracy may be transmitted as data in the form of a position beacon. In this case, for example, the information collection unit 120 receives the reference point position information contained in the position beacon transmitted from the feature reference point 403, and transmits it to the server device 200. Then, the server device 200 calculates the cup position 61 and the ball position 62 using the reference point position information transmitted from the information collection unit 120, instead of the reference point position information 513 stored in the course map database 251.

[0064] <Modification 3> The functions of the golf support system 500 according to the present embodiment may be provided as an application downloaded to the client device 100, such as a smartphone, a mobile phone, or a tablet terminal, as described above. Alternatively, the functions of the golf support system 500 may be provided on a web-based basis. Furthermore, in the golf support system 500, the client device 100 may be provided with a course map database 251 including green surface information 511, green speed information 512, and reference point position information 513. By providing the course map database 251 to the client device 100, it becomes possible for the client device 100 alone to realize the functions of the golf support system 500.

[0065] <Modification 4> In this embodiment, the functions of each of the client device 100 and the server device 200 are realized by software. As a modification, the functions of each of the client device 100 and the server device 200 may be realized by hardware. Specifically, each of the client device 100 and the server device 200 includes an electronic circuit 909 instead of a processor 910 .

[0066] FIG. 10 is a diagram showing an example of a configuration of a client device 100 according to a modification of the present embodiment. FIG. 11 is a diagram showing an example of a configuration of a server device 200 according to a modification of the present embodiment. In the following, an example will be described for the server device 200. The same applies to the client device 100.

[0067] The electronic circuit 909 is a dedicated electronic circuit that realizes the functions of the position calculation unit 210, the line calculation unit 220, the image generation unit 230, and the database update unit 240. Specifically, the electronic circuit 909 is a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, a logic IC, a GA, an ASIC, or an FPGA. GA is an abbreviation for Gate Array. ASIC is an abbreviation for Application Specific Integrated Circuit. FPGA is an abbreviation for Field-Programmable Gate Array.

[0068] The functions of the position calculation section 210, the line calculation section 220, the image generation section 230, and the database update section 240 may be realized by one electronic circuit, or may be realized by distributing them among a plurality of electronic circuits.

[0069] As another modified example, some functions of the position calculation unit 210, line calculation unit 220, image generation unit 230, and database update unit 240 may be realized by electronic circuits, and the remaining functions may be realized by software. Also, some or all of the functions of the position calculation unit 210, line calculation unit 220, image generation unit 230, and database update unit 240 may be realized by firmware.

[0070] Each of the processor and the electronic circuit is also called processing circuitry. That is, the functions of the position calculation unit 210, the line calculation unit 220, the image generation unit 230, and the database update unit 240 are realized by the processing circuitry.

[0071] ***Explanation of the Effects of the Present Embodiment*** As described above, the golf support system according to the present embodiment can obtain the cup position and the ball position with high accuracy by simple operations near the green. In other words, the user only needs to take an image of the ball, the cup, and the feature reference point, and the accuracy of the cup position and the ball position can be improved while simplifying the user operation. Therefore, the golf support system according to the present embodiment can quickly and accurately support the user putting on the green.

[0072] Embodiment 2 In this embodiment, differences from and additions to the first embodiment will be mainly described. In this embodiment, components having the same functions as those in the first embodiment are given the same reference numerals, and the description thereof will be omitted.

[0073] In the first embodiment, the case has been described in which the client device 100 is a mobile terminal device such as a smartphone, a mobile phone, or a tablet terminal. In this embodiment, a case will be described in which the client device 100 is a course traveling vehicle that is a mobile body operated on a golf course.

[0074] ***Configuration Description*** FIG. 12 is a diagram showing an example of the configuration of a course traveling vehicle which is the client device 100 according to this embodiment. The course traveling vehicle, which is the client device 100, is an autonomous vehicle that loads a golf bag of a user 20 who will play on a golf course and automatically drives around the golf course according to a driving route transmitted from the server device 200. The course traveling vehicle is equipped with devices such as a display device 941, a vehicle camera 961, a LIDAR radar 962, and a position sensor 963. In this embodiment, the course traveling vehicle is the client device 100, and therefore the course traveling vehicle has the functions described in the first embodiment. Although not shown, the course traveling vehicle is equipped with an automatic driving system for automatically driving the vehicle along a travel route. The travel route is an example of a travel route along which a moving object travels.

[0075] The course traveling vehicle is, for example, a PMV that can carry a person on board and travel on the course. PMV is an abbreviation for Personal Mobility Vehicle. In addition, when the vehicle is used without carrying a person on board, the course traveling vehicle may be an AMR. AMR is an abbreviation for Autonomous Mobile Robot.

[0076] The course traveling vehicle according to the present embodiment has seats for carrying people, like a golf cart on a golf course, and can be automatically driven with a user seated in it. Since the user can also ride in the vehicle and travel, there is an advantage in that the playing time can be shortened compared to walking.

[0077] The course traveling vehicle according to this embodiment also has a function of capturing an image of the trajectory of the golf ball hit by the user 20 using the camera 961, and predicting the trajectory of the golf ball using the trajectory image. The course traveling vehicle also has a function of calculating a predicted drop position where the golf ball will fall using the predicted trajectory, and calculating a travel route to the predicted drop position. Furthermore, the course traveling vehicle has a function of automatically traveling to the predicted drop position according to the travel route.

[0078] Even when the client device 100 is a course traveling vehicle, the functional configuration diagram of the client device 100 according to this embodiment is the same as that of the first embodiment.

[0079] ***Explanation of Operation*** FIG. 13 is a flow chart showing the operation of the golf support system 500 according to the present embodiment. In step S100, the client device 100, which is a vehicle traveling on a golf course, determines whether or not the golf ball of the user 20 has landed on the green. For example, the course traveling vehicle may determine whether the golf ball has landed on the green by determining whether the predicted landing position is on the green or not. Alternatively, the course traveling vehicle may determine whether the golf ball has landed on the green in cooperation with an autonomous flying object such as a drone.

[0080] If the golf ball is on the green, the process proceeds to step S101. The process from step S101 onwards is the same as the process described with reference to Fig. 4 or Fig. 9. In Fig. 13, the process from step S101 onwards is the same as that in Fig. 9.

[0081] The course traveling vehicle, which is the client device 100, may take the green photographed image 51 in response to an operation by the user 20. Alternatively, the course traveling vehicle may automatically calculate an appropriate position for photographing the user's putting, move to the appropriate position by automatic driving, and automatically take the green photographed image 51. The course traveling vehicle takes the green photographed image 51 before the user's putting and transmits it to the server device 200.

[0082] In step S104, the server device 200 transmits the generated putting line image 54 to the client device 100, which is the vehicle traveling on the course. Then, in step S105, the display unit 130 of the vehicle traveling on the course displays the putting line image 54 on the display device. At this time, the server device 200 may transmit the generated putting line image 54 to a mobile terminal device of the user 20 who has been registered in advance. This allows the user 20 to putt by referring to the putting line image 54 displayed on his / her own mobile terminal device, and eliminates the need to go to the display device 941 of the vehicle traveling on the course to view the putting line image 54. This contributes to a quicker progress of the game.

[0083] FIG. 14 is a diagram showing an example of a putting line image 54 according to the present embodiment. In this embodiment as well, the putting line image 54 shown in Fig. 7 is displayed. Moreover, in this embodiment, in addition to the putting line image 54 shown in Fig. 7, an image in which the putting line actually hit by the user 20 is superimposed on the putting line image 54 can be provided to the user 20. This allows the user 20 to review his or her own putting.

[0084] Also in this embodiment, the course traveling vehicle may be provided with the course map database 251 including the green surface information 511, the green speed information 512, and the reference point position information 513. By providing the course traveling vehicle with the course map database 251, it becomes possible for the client device 100 alone to realize the functions of the golf support system 500.

[0085] ***Other configurations*** <Variation 5> The golf support system 500 according to this embodiment may have the following functions. - Footage of actual shots is used as training data, and the putting line is calculated using a learning model rather than physical calculations. -Provide a video simulation of the ball entering the cup. A simulation video of the ball entering the cup is displayed on the green using lighting such as projection mapping. This makes it easier for the user 20 to understand how fast they should hit the ball. - Works in conjunction with a drone to send images of the green, point cloud images of the green, and drone position information to a server device. Also, the drone is used to display images of the putting line on the green using a method such as projection mapping. -Update the green surface relief information using drone-captured green images and green point cloud images. The actual putting trajectory is superimposed on the image, providing a video that allows the user 20 to look back on how far they were off the putting line.

[0086] <Variation 6> The client device 100, which is a vehicle traveling on a course, may film the shot and putting scenes of the user 20, and support the creation of a user video such as a play movie. This makes it possible to create a user video such as a play movie without the need for a film crew.

[0087] ***Explanation of the Effects of the Present Embodiment*** As described above, according to the golf support system of the present embodiment, the user operation can be further simplified.

[0088] In the above first and second embodiments, each unit of each device of the golf support system has been described as an independent functional block. However, the configuration of each device of the golf support system does not have to be as in the above-mentioned embodiments. The functional blocks of each device of the golf support system may have any configuration as long as they can realize the functions described in the above-mentioned embodiments. Furthermore, each device of the golf support system may not be a single device, but may be a system composed of multiple devices.

[0089] For example, some of the functions of the server device 200 may be provided in the client device 100. Alternatively, some of the functions of the client device 100 may be provided in the server device 200.

[0090] In addition, it is acceptable to combine multiple parts of the first and second embodiments. Alternatively, it is acceptable to implement only one part of these embodiments. In addition, it is acceptable to combine these embodiments in any way, either as a whole or in part. That is, in the first and second embodiments, the respective embodiments can be freely combined, or any of the components in each embodiment can be modified, or any of the components in each embodiment can be omitted.

[0091] The above-described embodiment is essentially a preferred example, and is not intended to limit the scope of the present disclosure, the scope of application of the present disclosure, and the scope of use of the present disclosure. The above-described embodiment can be modified in various ways as necessary. For example, the procedure described using a flow chart or sequence chart may be modified as appropriate. [Explanation of symbols]

[0092] 20 user, 21 golf ball, 22 putting line, 22a exact target, 22b exact launch direction, 22c putting line (strong), 22d putting line (weak), 40 golf course, 41 green, 42 cup, 43 reference feature, 403 feature reference point, 51 green photographed image, 52 green point cloud image, 53 position information, 54 putting line image, 55 caution notice, 61 cup position, 62 ball position, 100 client device, 110 photographing unit, 120 information collecting unit, 130 display unit, 200 server device, 210 position calculation unit, 220 line calculation unit, 230 image generation unit, 240 database update unit, 140, 250 storage unit, 251 course map database, 511 green surface information, 512 green speed information, 513 Reference point position information, 500 golf support system, 909 electronic circuit, 910 processor, 921 memory, 922 auxiliary storage device, 930 input interface, 940 output interface, 941 display device, 950 communication device, 961 camera, 962 lidar radar, 963 position sensor.

Claims

1. A golf support system for supporting a user on a golf course green, a course map database that stores green surface information including the position and surface shape of the green, green speed information that indicates the rolling speed of a golf ball on the green, and reference point position information that is the position of a feature reference point on a reference feature fixed on the green or in the vicinity of the green; an image capturing unit that captures a green image including the feature reference point, a cup provided on the green, and the golf ball on the green using a camera; a position calculation unit that calculates a ball position, which is the position of the golf ball, using the green photographed image, the green surface information, and the reference point position information; a line calculation unit that calculates a putting line from the ball position to a cup position that is the position of the cup on the green, using the green surface information and the green speed information; A golf support system comprising:

2. The position calculation unit is 2. The golf support system according to claim 1, wherein when the feature reference point is other than the cup position, the cup position is calculated using the green photographed image, the green surface information, and the reference point position information.

3. The golf support system includes: an image generating unit that generates a putting line image by superimposing the putting line on the photographed image of the green; a display unit that displays the putting line image on a display device; 3. The golf support system according to claim 1, further comprising:

4. The image generating unit includes: The golf support system according to claim 3 , wherein a plurality of launch directions are added to the putting line image.

5. The imaging unit includes: A green point cloud image including the feature reference points, a cup provided on the green, and the golf ball on the green is captured by a lidar radar; The position calculation unit is The golf support system according to claim 1 or 2, wherein the cup position and the ball position are corrected using the green point cloud image.

6. The golf support system includes: The golf support system according to claim 5 , further comprising a database update unit that updates the surface shape of the green included in the green surface information based on the green point cloud image.

7. The golf support system includes: a position sensor for detecting a position of a device on which the camera is mounted; The position calculation unit is 3. The golf support system according to claim 1, wherein the cup position and the ball position are corrected using a position of a device equipped with the camera.

8. The imaging unit includes:

3. The golf support system according to claim 1, further comprising a notice displaying a notice to call attention to the inclusion of the feature reference point, the cup, and the golf ball when taking the green photograph image.

9. The golf support system includes: The system includes a client device carried by the user and a server device that communicates with the client device, the server device includes the course map database, the position calculation unit, and the line calculation unit; 3. The golf support system according to claim 1, wherein the client device includes the camera and transmits the green image taken by the user to the server device.

10. The golf support system includes: a client device that is a mobile object mounted with the camera and operated on the golf course; and a server device that communicates with the client device; the server device includes the course map database, the position calculation unit, and the line calculation unit; 3. The golf support system according to claim 1, wherein the client device transmits the green image captured by the camera to the server device.

11. 1. A golf support method for use in a golf support system that supports a user on a green of a golf course, comprising: a course map database storing green surface information including the position of the green and the surface shape of the green, green speed information representing the rolling speed of a golf ball on the green, and reference point position information which is the position of a feature reference point on a reference feature fixed on the green or in the vicinity of the green; A computer uses a camera to take a green image including the feature reference point, a cup provided on the green, and the golf ball on the green; a computer calculates a ball position, which is the position of the golf ball, using the green photographed image, the green surface information, and the reference point position information; A golf support method in which a computer uses the green surface information and the green speed information to calculate a putting line from the ball position to a cup position, which is the position of the cup on the green.

12. A golf support program for use in a golf support system that supports a user on a green of a golf course, the golf support system includes a course map database that stores green surface information including the position of the green and the surface shape of the green, green speed information representing the rolling speed of a golf ball on the green, and reference point position information that is the position of a feature reference point on a reference feature fixed on the green or in the vicinity of the green; a photographing process for photographing a green photographed image including the feature reference point, a cup provided on the green, and the golf ball on the green by a camera; a position calculation process for calculating a ball position, which is the position of the golf ball, using the green photographed image, the green surface information, and the reference point position information; a line calculation process for calculating a putting line from the ball position to a cup position, which is the position of the cup on the green, using the green surface information and the green speed information; A golf support program that causes a computer to execute the above.

13. A server device that communicates with a client device carried by a user on a green of a golf course, comprising: a course map database that stores green surface information including the position and surface shape of the green, green speed information that indicates the rolling speed of a golf ball on the green, and reference point position information that is the position of a feature reference point on a reference feature fixed on the green or in the vicinity of the green; a position calculation unit that acquires a green photographed image including the feature reference point, a cup provided on the green, and the golf ball on the green from the client device, and calculates a ball position that is the position of the golf ball using the green photographed image, the green surface information, and the reference point position information; a line calculation unit that calculates a putting line from the ball position to a cup position that is the position of the cup on the green, using the green surface information and the green speed information; A server device comprising:

14. A client device carried by a user on a green of a golf course, the client device communicating with a server device, comprising: A server device that is provided with a course map database that stores green surface information including the position of the green and the surface shape of the green, green speed information that indicates the rolling speed of a golf ball on the green, and reference point position information that is the position of a feature reference point on a reference feature fixed on the green or in the vicinity of the green, and that takes a green photographic image including the feature reference point, a cup provided on the green, and the golf ball on the green with a camera, and calculates a ball position that is the position of the golf ball using the green photographic image, the green surface information, and the reference point position information, and a client device that is provided with a photographing unit that transmits the green photographic image to the server device that calculates a putting line from the ball position to a cup position that is the position of the cup on the green using the green surface information and the green speed information.

Citation Information

Patent Citations

  • Systems and methods for monitoring objects at sporting events

    CN109069903A

  • System and method for storing and analyzing golf data

    JP2014512220A

  • Putting line prediction program and device using the program

    JP6714799B2

  • Golf pin position detector

    JP6744663B2

  • Apparatus for tracking object

    KR1020180050589A