Terminal device, display method, computer program, and information provision system

Abstract

To clearly display inclined conditions of a golf course.SOLUTION: A processor of a user terminal acquires inclined conditions (undulations) of a ground surface of a green on the basis of a ground surface image which is an image of the ground surface of the green in the golf course on a touch panel 33, and displays the ground surface image and inclination symbols (arrow symbol M1 and circular symbol M2) indicating the inclined conditions of ground surface of the green on the touch panel 33 in a superimposed manner. With this, a user of the user terminal can clearly understand the inclined conditions of the green. Consequently, the user can execute putting excellently since the user can easily predict the rolling direction of a golf ball hit by the user on the green.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present disclosure relates to a terminal device, a display method, a computer program, and an information providing system. [Background technology]

[0002] Patent Document 1 discloses a technique for displaying golf course information on a terminal device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2020-18439 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with the technology of Patent Document 1, it is difficult to clearly display the slope condition (undulation) of a golf course to a user. [Means for solving the problem]

[0005] A terminal device (this terminal device) according to one embodiment of the present disclosure has an imaging unit that images the ground of a golf course and generates a ground image, and a control unit that acquires the slope condition of the ground based on the ground image and superimposes the ground image and a slope symbol indicating the slope condition of the ground on a display screen.

[0006] This terminal device is carried by a user of a golf course. In this terminal device, a control unit displays on a display screen a ground image, which is an image of the ground (e.g., the green) of the golf course, along with a slope symbol indicating the slope (undulations) of the ground. This allows the user of this terminal device to clearly grasp the undulations of the ground of the golf course.

[0007] This makes it easier for a user of the terminal device to predict in which direction a hit golf ball will roll on the golf course, enabling the user to make a good next hit (putt or shot).

[0008] Here, the inclination symbol may include an arrow indicating the direction of the inclination, and may also include a symbol indicating that the ground is substantially flat.

[0009] In addition, in this terminal device, the control unit may be configured to divide the ground image into a specified number of small areas, obtain the slope status for each small area, and superimpose the slope symbol for each small area on the ground image.

[0010] In this case, the terminal device may further include an input unit that receives a user instruction, and the control unit may be configured to change at least one of the size or the number of the small regions based on the user instruction via the input unit. This allows the user of the terminal device to adjust the size and number of small regions so as to easily grasp the slope of the ground of the golf course.

[0011] In this case, the control unit may also superimpose the inclination symbol for each of the small regions on the ground image by forming an AR space including the ground image, setting a plurality of panel partitions in the AR space centered on a reference point, setting the height of the center of each panel partition in the AR space to a position higher than the reference point by a first predetermined value, obtaining ground coordinates that are the three-dimensional coordinates of a portion of the ground image located below the center of each panel partition, obtaining panel coordinates that are coordinates higher than the ground coordinates corresponding to each panel partition by a second predetermined value, forming a panel centered on the panel coordinates in the AR space, dropping the panel toward the ground image to give the panel an inclination corresponding to the inclination of the ground image, and attaching an inclination symbol corresponding to the inclination to the panel that has fallen on the ground image, and superimposing the inclination symbol for each of the small regions on the ground image. This makes it easy to determine the slope of the ground.

[0012] In addition, in the terminal device, the control unit may be configured to superimpose a color corresponding to the height of the captured ground on the ground image, thereby enabling a user of the terminal device to more clearly grasp the undulations (especially the elevation difference) of the golf course.

[0013] In addition, the terminal device may further include an input unit that accepts user instructions, and the control unit may be configured to display a virtual golf ball and a virtual cup on the ground image displayed on the display screen based on instructions from the user via the input unit.

[0014] This configuration is particularly effective when the ground image is an image of a green, making it easier for the user of the terminal device to consider how to aim when hitting (putting) a virtual golf ball toward a virtual cup.

[0015] In this case, the control unit may be configured to acquire the slope condition of the ground based on the ground image, generate advice information which is information for causing the virtual golf ball to go into the virtual cup, and superimpose this advice information on the ground image.

[0016] Furthermore, the control unit may be configured to display, as the advice information, a first arrow indicating a target position for hitting the virtual golf ball from above, a second arrow pointing from the virtual golf ball to the target position, and a distance from the virtual cup to the target position.

[0017] In this configuration, the user can know information (e.g., the hitting direction of the golf ball (putting direction)) that is effective for landing the virtual golf ball in the virtual cup based on the advice information (e.g., the first arrow, the distance from the virtual cup to the target position, and the second arrow).

[0018] In addition, the terminal device may further include an input unit that accepts user instructions, and the control unit may be configured to superimpose a virtual golf ball and a movement trajectory of the virtual golf ball when the virtual golf ball is hit on the ground image displayed on the display screen based on instructions from the user via the input unit. This configuration is particularly effective when the ground image is a green image. This allows the user to understand how the virtual golf ball will roll when putting, based on the movement trajectory.

[0019] In addition, in this terminal device, the control unit may be configured to obtain the inclination state of the ground, the position of the golf ball, and the position of a cup based on the ground image, create advice information for the next shot, and display the advice information superimposed on the ground image. Note that the golf ball and the cup may be real, or may be a virtual golf ball and a virtual cup. This allows the user to carry out an actual hit while referring to the displayed advice information.

[0020] A display method according to one aspect of the present disclosure (the present display method) is a display method implemented in the terminal device. That is, the present display method includes capturing an image of the ground of a golf course to generate a ground image, acquiring a slope condition of the ground based on the ground image, and superimposing the ground image and a slope symbol indicating the slope of the ground on a display screen. This display method allows golf course users to clearly grasp the undulations of the ground of the golf course.

[0021] In addition, a computer program according to one aspect of the present disclosure causes a computer to obtain the slope condition of the ground based on a ground image obtained by imaging the ground of a golf course, and to superimpose the ground image and a slope symbol indicating the slope condition of the ground on a display screen.

[0022] This computer program is a program for making a general-purpose user terminal function as the present terminal device, thereby enabling a user to use a user terminal such as a smartphone that he or she owns as the present terminal device instead of a dedicated terminal device.

[0023] Also, an information providing system (the present system) according to one aspect of the present disclosure includes the present terminal device and a management unit, the present terminal device includes a terminal communication unit for communicating with the management unit, the control unit is configured to transmit the ground image to the management unit via the terminal communication unit and receive information transmitted from the management unit, and the management unit includes a management communication unit for communicating with the present terminal device and a management control unit that receives the ground image via the management communication unit, acquires the inclination state of the ground based on the ground image, recognizes the position of the golf ball and the position of a cup in the ground image, generates advice information for the next shot, and transmits the advice information to the present terminal device via the management communication unit. In this configuration, the golf ball and the cup may be real, or may be a virtual golf ball and a virtual cup set by the terminal device. Also, the advice information may be information for cupping the virtual golf ball into the virtual cup.

[0024] The management unit of this system functions as a device that generates advice information and transmits it to this terminal device. The management unit is capable of communicating with this terminal device and is provided, for example, at a golf course or on the cloud. In this system, the management unit generates advice information instead of the terminal device, so that the load on the terminal device can be reduced. Effect of the Invention

[0025] According to one aspect of the present disclosure, a user can clearly grasp the undulations of the ground of a golf course, which makes it easier for the user to predict in which direction a golf ball hit on the golf course will roll, thereby enabling the user to perform the next shot (such as a putt) in a good manner. [Brief description of the drawings]

[0026] [Figure 1] FIG. 2 is an explanatory diagram showing a golf course, a user terminal, and a management unit. [Diagram 2] FIG. 2 is a block diagram showing the configuration of a user terminal and a management unit. [Diagram 3] FIG. 10 is an explanatory diagram showing a touch panel displaying a ground image acquired by a camera. [Figure 4] 11 is an explanatory diagram showing a touch panel on which a ground image and a gradient symbol indicating the gradient of the ground are superimposed. FIG. [Diagram 5] 1 is an explanatory diagram showing a correspondence relationship between ground height and color. [Figure 6] 1 is an explanatory diagram showing a touch panel on which a ground image, a gradient symbol indicating the gradient of the ground, and a color according to the height of the ground are superimposed. FIG. [Figure 7] 11 is an explanatory diagram showing a touch panel on which an image of the ground including a virtual golf ball and a virtual cup is displayed; FIG. [Figure 8] FIG. 11 is an explanatory diagram showing a method for generating advice information. [Figure 9] FIG. 11 is an explanatory diagram showing advice information. [Figure 10] FIG. 13 is an explanatory diagram showing a putting simulation. [Figure 11] FIG. 13 is an explanatory diagram showing a putting simulation. [Figure 12] FIG. 13 is an explanatory diagram showing a touch panel on which a screen for setting the size and number of small areas corresponding to one tilt symbol is displayed. [Figure 13] 13(a) and 13(b) are explanatory diagrams showing examples of the size of a small area corresponding to one tilt symbol. [Figure 14] FIG. 4 is an explanatory diagram showing a touch panel on which a setting screen is displayed. [Figure 15] FIG. 2 is an explanatory diagram showing a ground image. [Figure 16] FIG. 2 is an explanatory diagram showing a panel section. [Figure 17] FIG. 2 is an explanatory diagram showing a panel section that is higher than a reference point by a first predetermined value. [Figure 18] FIG. 13 is an explanatory diagram showing a materialized panel. [Figure 19] FIG. 13 is an explanatory diagram showing a panel that is inclined along the ground. [Figure 20] FIG. 13 is an explanatory diagram showing a panel with inclined symbols. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] 1, a golf course 1 according to an embodiment of the present disclosure has a plurality of holes including a hole 10, and a user who is a golfer carries a user terminal 20. The user terminal 20 is also connected to a management unit 60 via a computer network N such as the Internet or an intranet.

[0028] A hole 10 includes, for example, a teeing ground 13, a fairway 14, rough 15 surrounding the fairway 14, a pond 16, a bunker 17, and a green 18, as shown in FIG.

[0029] In this embodiment, the user terminal 20 carried by a user of the golf course 1 is a smartphone owned by the user. As shown in Fig. 2, the user terminal 20 includes a terminal communication unit 21 for communicating with the management unit 60, a processor 23 for controlling each component of the user terminal 20, a memory 25 as a storage unit, and an input / output device 30 including a camera 31 and the like.

[0030] The terminal communication unit 21 is configured to be able to transmit and receive various data to and from the management unit 60 via the computer network N.

[0031] The input / output device 30 includes, for example, a camera 31 for taking still or moving images, a touch panel 33 capable of displaying images, and a speaker 35 for providing audio display to the user.

[0032] The camera 31 functions as an imaging unit that captures an image of the ground of the golf course 1 to generate a ground image. Here, the ground of the golf course 1 means, for example, the ground surfaces of the teeing ground 13, the fairway 14, the rough 15, the bunker 17, and the green 18. The ground image is an image of the ground of the golf course 1 obtained by the camera 31. The touch panel 33 functions as a display screen for displaying images, and also functions as an input unit for receiving instructions from the user.

[0033] The memory 25 is a non-transient and tangible recording medium including a RAM, a flash memory, an SSD, a hard disk drive, an SD card, etc. The memory 25 stores programs used in the processing of the processor 23, such as an application program AP downloaded via the computer network N.

[0034] The processor 23 acquires various functions mainly in accordance with the application program AP (instructions included in the application program AP). For example, the processor 23 acquires a function as a control unit that controls the operation of the user terminal 20 described below by reading the application program AP. For example, the processor 23 acquires a function of acquiring the ground slope (undulations) based on a ground image acquired by the camera 31 of the input / output device 30, and superimposing and displaying the ground image and a slope symbol indicating the ground slope.

[0035] Here, as an example of the operation of the user terminal 20, a display method according to this embodiment will be described. First, the user activates the application program AP on the user terminal 20 using the touch panel 33 of the input / output device 30. In response to this, the processor 23 reads the application program AP from the memory 25 and obtains the function of the control unit described above.

[0036] Then, the user captures an image of the ground of the golf course 1 using the camera 31 of the input / output device 30. That is, the camera 31 captures an image of the ground of the golf course 1 based on the user's instructions and generates a ground image that is an image of this ground. In the following, it is assumed that the camera 31 captures an image of the ground of the green 18 of the golf course 1 based on the user's instructions and obtains a ground image of the green 18 (a ground image of the ground including the grass of the green 18).

[0037] In response, the processor 23 displays a ground image of the green 18 captured by the camera 31 on the touch panel 33, as shown in FIG.

[0038] At this time, an arrow setting tab 101, a caddy button 102, a cup setting button 103, a ball setting button 104, a navigation button 106, a hint button 107, a reset button 108 and a setting button 109 are displayed at the bottom of the touch panel 33.

[0039] When the user touches any part of the ground image displayed on the touch panel 33 while selecting (touching) the ball setting button 104 on the left end, the processor 23 displays a virtual golf ball 110 at the touched portion, as shown in Fig. 4. Furthermore, the processor 23 acquires the slope condition (undulations) of the ground of the green 18, which is the captured ground, based on the ground image acquired by the camera 31, and displays the ground image and a slope symbol indicating the slope condition of the ground superimposed on the touch panel 33 of the user terminal 20 in AR (Augmented Reality). In other words, the processor 23 displays an AR space including the ground image and the slope symbol on the touch panel 33.

[0040] In the example shown in Fig. 4, the inclination symbols are an arrow symbol M1, which indicates the direction of inclination, and a circle symbol M2. The arrow symbol M1 indicates the inclination of the part to which the arrow symbol M1 is attached by the direction of the arrow, and indicates that the ground slopes downward in the direction indicated by the arrow. On the other hand, the circle symbol M2 indicates that the part to which the circle symbol M2 is attached is flat (having a small inclination and being substantially flat).

[0041] In this display example, the processor 23 divides the ground image into predetermined small regions (panels), acquires the inclination state for each small region, and superimposes the inclination symbol for each small region on the ground image. That is, the processor 23 divides the ground image into small regions corresponding to one inclination symbol (arrow symbol M1 or circle symbol M2). The processor 23 then acquires the inclination state (inclination direction) for each small region, and superimposes the inclination symbol of the arrow symbol M1 or the circle symbol M2 on the image of each small region.

[0042] When the ground image obtained by the camera 31 is a video, the processor 23 continuously acquires the inclination state of the ground and superimposes the ground image and the inclination symbol at a predetermined rate.

[0043] Furthermore, the processor 23 as a control unit superimposes a color corresponding to the height of the captured ground on the ground image displayed on the touch panel 33 together with the arrow symbol M1 and the circle symbol M2. That is, the processor 23 sets the height of the position of the virtual golf ball 110 to the zero point of height (a point of substantially zero height; a point corresponding to ±2 cm), for example. Then, as shown in Fig. 5, the processor 23 obtains the height of the ground in the ground image, and divides the ground image into areas of, for example, nine different colors at intervals of approximately ±5 cm. In Fig. 5, the nine different colors are indicated by gray brightness and hatching.

[0044] Then, the processor 23 superimposes a color area corresponding to the height of the ground on the ground image as shown in Fig. 6. That is, the processor 23 displays the ground image by dividing it into nine color areas (meshes) (six color areas are displayed in the example of Fig. 6).

[0045] Furthermore, when the user touches any part of the ground image displayed on the touch panel 33 while selecting the cup setting button 103 displayed on the touch panel 33, the processor 23 displays a virtual cup 112, which is a virtual cup (hole), and a virtual pin flag 113 indicating the virtual cup 112, at the touched portion, as shown in Fig. 7. In the example of Fig. 7, the virtual cup 112 and the virtual pin flag 113 are displayed at a position corresponding to the real pin flag 51.

[0046] Furthermore, after displaying the virtual cup 112, the processor 23 displays the distance between the virtual golf ball 110 and the virtual cup 112 (4.1 m in the example of FIG. 7) superimposed on the ground image on the touch panel 33. In the example shown in FIG. 7, this distance is displayed in the center of the touch panel 33. When the position of either the virtual golf ball 110 or the virtual cup 112 is changed by the user, the processor 23 sequentially calculates the distances corresponding to the virtual golf ball 110 and the virtual cup 112 after the position change, and displays them on the touch panel 33.

[0047] As described above, in this embodiment, the processor 23 of the user terminal 20 acquires the slope of the ground of the green 18 based on a ground image, which is an image of the ground of the green 18, which is the ground of the golf course 1, on the touch panel 33, and superimposes the ground image and slope symbols (arrow symbol M1 and circle symbol M2) indicating the slope of the ground of the green 18 on the touch panel 33 using AR. This allows the user of the user terminal 20 to clearly grasp the slope (undulation) of the green 18. This makes it easy for the user to predict in which direction the golf ball will roll when hit on the green 18, allowing for good putting.

[0048] Furthermore, in this embodiment, processor 23 superimposes a color corresponding to the height of the ground of green 18 onto the ground image of green 18 displayed along with arrow symbol M1 and circle symbol M2 on touch panel 33. This allows the user of user terminal 20 to more clearly grasp the undulations (especially the elevation difference) of green 18.

[0049] Furthermore, in this embodiment, the processor 23 is configured to display the virtual golf ball 110 and the virtual cup 112 on the ground image displayed on the touch panel 33 based on an instruction from the user via the touch panel 33. This allows the user to easily consider how to aim the virtual golf ball 110 when putting toward the virtual cup 112.

[0050] The user may also display a virtual golf ball 110 and a virtual cup 112 at positions on the ground image that correspond to the real golf ball and the cup, allowing the user to easily grasp the slope of the green 18, which is useful when putting the real golf ball toward the cup.

[0051] The processor 23 is also configured to display the distance between the virtual golf ball 110 and the virtual cup 112 on the touch panel 33. This allows the user to consider in more detail how to aim the virtual golf ball 110 when putting toward the virtual cup 112.

[0052] In this embodiment, advice information regarding putting can also be displayed on the touch panel 33 for the user.

[0053] Specifically, when the user selects the caddie button 102 displayed in the center below the touch panel 33, the processor 23 generates and displays advice information (navigation information). The advice information is, for example, information for causing the virtual golf ball 110 to go into the virtual cup 112. That is, in this embodiment, the processor 23 obtains the slope condition of the green 18 based on the ground image of the green 18, generates advice information, and displays the advice information superimposed on the ground image.

[0054] The following describes in more detail how the advice information is generated and displayed. When the user presses the caddie button 102, the processor 23 generates a movement trajectory (rough prediction) 120 of the virtual golf ball 110 when the virtual golf ball 110 is hit straight toward the virtual cup 112 with a predetermined strength, as shown in FIG.

[0055] At this time, the processor 23 generates the movement trajectory 120 of the virtual golf ball 110, for example, taking into consideration the slope of the green 18, the weight, rolling resistance, elasticity, etc. of the virtual golf ball 110. Note that in order to generate the movement trajectory 120 of the virtual golf ball 110, the processor 23 may read out existing software for generating the movement trajectory 120 from the memory 25. In the example shown in FIG. 8, the movement trajectory 120 of the virtual golf ball 110 deviates to the left in accordance with the slope of the green 18 .

[0056] In addition, the processor 23 sets, in the ground image, a first straight line L11 that is a straight line passing through the virtual golf ball 110 and the virtual cup 112, and a second straight line L12 that is perpendicular to the first straight line L11 and passes through the virtual cup 112, as shown in FIG. 8.

[0057] Next, the processor 23 obtains a first position P11 which is the position of the intersection between the movement trajectory 120 of the virtual golf ball 110 and the second line L12. Furthermore, the processor 23 obtains a second position P12 which is a position on the opposite side of the virtual cup 112 from the first position P11 on the second line L12. Then, the processor 23 determines that this second position is the target position for hitting the virtual golf ball 110. This second position P12 (target position) is a position where, by hitting the virtual golf ball 110 toward this position, the user is highly likely to be able to put the virtual golf ball 110 into the virtual cup 112. In this embodiment, the processor 23 sets the second position P12 according to the amount of deviation from the virtual cup 112 on the movement trajectory 120.

[0058] Thereafter, processor 23 superimposes, as advice information, a first arrow 121 indicating second position P12 from above and a distance (distance along second straight line L12) 122 from virtual cup 112 to second position P12 on the ground image of green 18, as shown in Fig. 9. In this embodiment, processor 23 displays, as distance 122, information indicating a multiple of the diameter of virtual cup 112 (i.e., "how many cups does the distance correspond to").

[0059] Furthermore, the processor 23 superimposes on the ground image near the virtual golf ball 110 a second arrow 123 pointing from the virtual golf ball 110 to the second position P12 as advice information.

[0060] 9, the user can know an effective putting direction for putting the virtual golf ball 110 into the virtual cup 112. That is, the user can recognize that in order to put the virtual golf ball 110 into the virtual cup 112, it is preferable to putt the virtual golf ball 110 in the direction indicated by the second arrow 123 toward the second position P12 (target position) indicated by the first arrow 121.

[0061] The user may display the virtual golf ball 110 and the virtual cup 112 at positions on the ground image corresponding to the real golf ball and the cup. This allows the user to easily grasp advice information that is useful when putting the real golf ball toward the cup.

[0062] In addition, in this configuration, it is preferable that the processor 23 performs the calculation shown in FIG. 8 each time the caddy button 102 is pressed by the user, and updates the display mode of the first arrow 121, the distance 122, and the second arrow 123 shown in FIG. 9.

[0063] Furthermore, in this embodiment, the user can turn off the navigation button 106 to erase the advice information (the first arrow 121, the distance 122, and the second arrow 123) and the distance between the virtual golf ball 110 and the virtual cup 112 from the touch panel 33. This advice information and the like are displayed again on the touch panel 33 when the user turns the navigation button 106 back on.

[0064] In this embodiment, the moving trajectory of the virtual golf ball 110 may be displayed on the touch panel 33 as advice information. In this case, when the user selects the caddie button 102 displayed in the center of the lower part of the touch panel 33, the processor 23 executes a putting simulation (a test shot, a putting trajectory simulation). In the putting simulation, the moving trajectory (orbit) of the virtual golf ball 110 is predicted when the virtual golf ball 110 is putted toward the virtual cup 112.

[0065] Specifically, when the user presses and holds the caddie button 102, the processor 23 displays the putting strength (a numerical value; "17" in the example of FIG. 10) below the center of the touch panel 33, as shown in FIG. 10. When the user moves the finger that is pressing and holding the caddie button 102 on the touch panel 33, the processor 23 detects the movement of the user's finger and changes the strength.

[0066] Then, after the user sets the putting strength in this way, when the user releases the finger that has been pressing and holding the caddie button 102, the processor 23 generates a movement trajectory (rough prediction) 135 of the virtual golf ball 110 when the virtual golf ball 110 is hit straight toward the virtual cup 112 with the set strength, and displays it superimposed on the ground image, as shown in Fig. 11. At this time, the processor 23 generates such movement trajectory 135 of the virtual golf ball 110 taking into consideration the inclination state of the green 18, the weight, rolling resistance, elasticity, etc. of the virtual golf ball 110. Note that the processor 23 may read existing software for generating a movement trajectory from the memory 25 in order to generate the movement trajectory 135 of the virtual golf ball 110.

[0067] 11 shows a movement trajectory 135 in which the virtual golf ball 110 deviates to the left in accordance with the slope of the green 18. When the user presses the caddie button 102 again, the hit and moved virtual golf ball 110 returns to its original position.

[0068] In this configuration, the processor 23 is configured to superimpose and display, on the ground image displayed on the touch panel 33, a movement trajectory of the virtual golf ball 110 when the virtual golf ball 110 is hit toward the virtual cup 112, based on an instruction from the user via the touch panel 33. This allows the user to easily understand how the virtual golf ball 110 rolls when the virtual golf ball 110 is putted toward the virtual cup 112. The location where the virtual cup 112 is displayed is not limited to the position of the real cup on the ground image, and may be a position shifted from the real cup. The processor 23 may be configured to allow an arbitrary hitting direction to be specified on the ground image without displaying the virtual cup 112, and to allow the virtual golf ball 110 to be hit in that direction to perform a putting simulation.

[0069] Furthermore, the processor 23 may obtain the slope (undulations) of the ground of the green 18, the position of the golf ball, and the position of the cup based on a ground image that is an image of the ground of the green 18, which is the ground of the golf course 1, and based on these, create an example of an ideal putting line (the movement path of the golf ball to the cup) as advice information for the next shot (putt), and display it superimposed on the ground image. This allows the user to actually putt by referring to the displayed putting line. The golf ball and the cup may be real, or may be a virtual golf ball 110 and a virtual cup 112.

[0070] The advice information regarding putting as described above may be created by the management unit 60 shown in Figures 1 and 2. As shown in Figure 2, the management unit 60 has a management communication unit 61 for communicating with the user terminal 20, and a management control unit 63.

[0071] In this configuration, the processor 23 of the user terminal 20 transmits a ground image of the green 18 to the management unit 60 via the terminal communication unit 21. In the management unit 60, the management control unit 63 receives the ground image via the management communication unit 61. The management control unit 63 then obtains the slope of the green 18 based on the ground image, which is an image of the ground of the green 18, and recognizes the positions of the golf ball and the cup in the ground image to generate advice information for the next shot. In other words, the management control unit 63 creates advice information based on the slope of the green 18, the position of the golf ball, and the position of the cup, and transmits it to the user terminal 20 via the management communication unit 61.

[0072] Then, in the user terminal 20, the processor 23 displays the advice information transmitted from the management unit 60 in a superimposed manner on the ground image displayed on the touch panel 33. In this configuration, the golf ball and the cup may be real ones, or may be virtual golf ball 110 and virtual cup 112. The advice information may be, for example, first arrow 121, distance 122, and second arrow 123 shown in Fig. 9, movement trajectory 135 shown in Fig. 11, or the ideal putting line described above.

[0073] Thus, in this configuration, the user terminal 20 and the management unit 60 constitute an information provision system that provides advice information to the user terminal 20. In this system as well, the user of the user terminal 20 can obtain advice information. Furthermore, in this configuration, the advice information is generated by the management unit 60 instead of the user terminal 20, which makes it possible to reduce the load on the user terminal 20. The management unit 60 may be provided at the golf course 1 or on the cloud. Furthermore, the advice information may be created by an administrator (advisor) of the management unit 60.

[0074] In this embodiment, as shown in FIG. 12, the user can set the size and number of small regions (panels) corresponding to one inclination symbol (arrow symbol M1 or circle symbol M2) by touching an arrow setting tab 101 at the bottom right of the ground image displayed on the touch panel 33. That is, the processor 23 is configured to change at least one of the size or number of small regions based on an instruction from the user via the touch panel 33. Specifically, when the user touches the arrow setting tab 101, the processor 23 displays a small region setting field 140 on the touch panel 33 as shown in FIG. 12. The small region setting field 140 includes a panel size setting slider 141 and a panel number setting slider 142.

[0075] The user can change the size of one small area using the panel size setting slider 141, and can change the number of small areas lined up in one direction using the panel number setting slider 142. In the example shown in Fig. 12, the size of the small area is set to 17 cm, and the number of small areas lined up in one direction is set to 100. Therefore, 10,000 small areas can be displayed in an area of ​​1700 cm square.

[0076] For example, when the user reduces the size of the small area using the panel size setting slider 141, the size of the small area M corresponding to one slope symbol becomes smaller, so that the slope of the green 18, which is the ground to be imaged, is displayed in more detail, as shown in Fig. 13(a). On the other hand, when the user expands the size of the small area, the slope of the green 18 is displayed more vaguely (roughly), as shown in Fig. 13(b).

[0077] Furthermore, when the user increases or decreases the number of small areas using the panel number setting slider 142, the number of small areas superimposed on the touch panel 33 increases or decreases, and therefore the number of displayed inclined symbols (arrow symbol M1 or circle symbol M2) increases or decreases. In this way, the user can use the panel size setting slider 141 and the panel number setting slider 142 to adjust the size and number of small areas so as to easily grasp the slope of the green 18 .

[0078] When virtual golf ball 110 and virtual cup 112 are displayed on touch panel 33, processor 23 arranges multiple small regions centered on the midpoint between virtual golf ball 110 and virtual cup 112. That is, in this case, processor 23 sets the reference point (center of the multiple small regions) of the multiple small regions (panels) to the midpoint between virtual golf ball 110 and virtual cup 112.

[0079] Furthermore, when virtual golf ball 110 is displayed on touch panel 33 but virtual cup 112 is not displayed, processor 23 arranges multiple small regions around virtual golf ball 110. That is, in this case, processor 23 sets the reference point of the multiple small regions (panels) to the position of virtual golf ball 110.

[0080] 3 and the like is a button for displaying an operation explanation on the touch panel 33. That is, in this embodiment, the processor 23 is configured to display an operation explanation of the display method according to this embodiment on the touch panel 33 when the hint button 107 is pressed by the user. Note that the processor 23 may also be set to display an operation explanation of the display method according to this embodiment on the touch panel 33 when the application program AP is started up for the first time in the user terminal 20.

[0081] 3 and the like is a button for resetting the display contents of the touch panel 33. That is, when the reset button 108 is pressed by the user, the processor 23 erases the virtual golf ball 110, the virtual cup 112, the virtual pin flag 113, the distance between the virtual golf ball 110 and the virtual cup 112, the inclination symbol (arrow symbol M1 and circle symbol M2), the color region (mesh), and the advice information (first arrow 121, distance 122, second arrow 123, etc.) that are superimposed on the ground image on the touch panel 33, and displays only the ground image on the touch panel 33. The user can again superimpose the virtual golf ball 110 and the virtual cup 112 on the ground image by operating the cup setting button 103, the ball setting button 104, etc.

[0082] The user can also implement other detailed settings regarding the display of the inclination symbol and the color region. In this case, the user touches the setting button 109 displayed in the lower right of the touch panel 33 shown in Fig. 3 etc. In response to this, the processor 23 displays a setting screen as shown in Fig. 14 on the touch panel 33.

[0083] In the example shown in this figure, when the top row "Non-LiDAR model support" is checked, the processor 23 functions to support a user terminal 20 that is not equipped with a LiDAR.

[0084] Additionally, "Distance display position" and "Distance display character size" are settings related to the display of the distance from virtual golf ball 110 to virtual cup 112 shown in Fig. 7 etc. "Distance display position" is an item for setting whether this distance is to be displayed in the center or at the top of touch panel 33. Additionally, "Distance display character size" is an item for setting the size of the characters that display this distance.

[0085] Furthermore, "ball mass (kg)", "ball rolling resistance" and "ball elasticity" are settings for generating advice information as described above with reference to Figures 8 to 11. That is, "ball mass (kg)", "ball rolling resistance" and "ball elasticity" are values ​​of the mass, rolling resistance and elasticity of virtual golf ball 110 at the time of generating advice information, and are used by processor 23 to generate movement trajectory 120 or movement trajectory 135.

[0086] 6 is displayed on the ground image on the touch panel 33. That is, when "Mesh display" is checked, the processor 23 displays a color area on the ground image on the touch panel 33. And, "Mesh transparency" is used to set the transparency (depth) of the color area displayed on the touch panel 33.

[0087] Also, the "mesh display mode" is for setting the display mode in the color region. In this embodiment, for example, gradation display or step display can be selected as the mesh display mode. In the gradation display, the color region is formed using the nine colors shown in FIG. 5. In the step display, the color region is formed using a color different from that in the gradation display.

[0088] Furthermore, "mesh rolling resistance" and "mesh elasticity" are settings for generating the advice information described above with reference to Figures 8 to 11. That is, "mesh rolling resistance" and "mesh elasticity" are values ​​of the rolling resistance and elasticity of the ground of green 18, and are used by processor 23 to generate movement trajectory 120 or movement trajectory 135.

[0089] 4 (arrow symbol M1 or circle symbol M2) on the ground image on the touch panel 33. That is, when "gradient arrow display" is checked, the processor 23 displays the gradient symbol on the ground image on the touch panel 33. And the "arrow transparency" is used to set the transparency (thickness) of the gradient symbol displayed on the touch panel 33.

[0090] Also, the "arrow display inclination threshold" is a threshold for setting "whether to attach an arrow symbol M1 or a circle symbol M2 to a small area of ​​the ground image." In other words, if this threshold is small, the arrow symbol M1 is attached to a small area with a small inclination, and the amount of the arrow symbol M1 displayed increases. On the other hand, if this threshold is large, the circle symbol M2 is attached to a small area with a small inclination, and the amount of the circle symbol M2 displayed increases. For example, if the threshold is 0.7, an inclination of 0.7 degrees or less is considered to be flat. The "arrow center update interval" is a field for setting, for example, the time to update the center (reference point) of a small area including an inclination symbol.

[0091] Furthermore, "maximum size" and "maximum number displayed" are for setting the size and number of small regions M described with reference to Fig. 12 and Fig. 13. That is, in this embodiment, the user can set the size and number of small regions M via the arrow setting tab 101, or via the setting button 109.

[0092] In this manner, in this embodiment, the user can set in detail the display mode of touch panel 33. For example, if the user checks "mesh display" and unchecks "slope symbol display," processor 23 will superimpose a color (color area) corresponding to the ground height on the ground image without displaying a slope symbol on touch panel 33. Even with this configuration, the user can easily grasp the slope condition of green 18.

[0093] Alternatively, if the user unchecks "Show mesh" but checks "Show inclination symbol," processor 23 will superimpose inclination symbols (arrow symbol M1 and circle symbol M2) on the ground image without displaying color regions on touch panel 33. Even with this configuration, the user can easily grasp the inclination condition of green 18.

[0094] In this embodiment, when the user touches any part of the ground image on the touch panel 33 with the ball setting button 104 shown in Fig. 3 selected, the processor 23 superimposes on the ground image the inclination symbol (arrow symbol M1 and circle symbol M2) and a color area corresponding to the height of the ground together with the virtual golf ball 110 (see Figs. 4 and 6). However, the timing of displaying the inclination symbol and the color area is not limited to this.

[0095] For example, when a user touches any part of the ground image on the touch panel 33 with the cup setting button 103 selected, the processor 23 may superimpose a tilt symbol and a color area on the ground image together with the virtual cup 112. In this case, the processor 23 may display the tilt symbol and color area only in the area between the virtual golf ball 110 and the virtual cup 112 in the ground image. This increases the visibility of the ground image for the user, as the tilt symbol and color area are displayed only in the area required for putting.

[0096] In the present embodiment, the processor 23 may recognize the actual golf ball and cup in the ground image acquired by the camera 31. The processor 23 may then superimpose a slope symbol and a color area between the golf ball and the cup in the ground image. In this configuration, the user can easily grasp the slope condition of the green 18 that is useful for putting, without setting the virtual golf ball 110 and the virtual cup 112.

[0097] In this case, when a real golf ball is hit by a user, the processor 23 may obtain the trajectory of the golf ball from the ground image showing the hit golf ball, and superimpose it on the ground image displayed on the touch panel 33.

[0098] Furthermore, in this embodiment, the camera 31 captures an image of the ground of the green 18 in the golf course 1 to obtain a ground image of the green 18, and the processor 23 superimposes a slope symbol and a color area on the ground image of the green 18. In this regard, the ground image displayed on the touch panel 33 in this embodiment is not limited to the ground image of the green 18, but may be an image of ground other than the green 18 in the golf course 1, such as the teeing ground 13, the fairway 14, the rough 15, and the bunker 17. For example, by using the ground image of the fairway 14, the user can clearly grasp the slope condition (undulations) of the fairway 14.

[0099] In the user terminal 20 of this embodiment, the memory 25 includes an application program AP. The processor 23 reads out this application program AP to obtain the above-mentioned functions of the processor 23 (i.e., the function as a control unit). That is, the application program AP is a computer program for causing the processor 23 as a computer to acquire the inclination state of the ground based on a ground image obtained by imaging the ground of the golf course 1, and to superimpose the ground image and an inclination symbol indicating the inclination state of the ground on the display screen (touch panel 33).

[0100] This application program AP is a program for causing a general-purpose user terminal 20, such as a smartphone, to function as a terminal device that functions at the golf course 1. This allows a user to use a user terminal 20, such as a smartphone, that the user owns as a terminal device that functions at the golf course 1, instead of a dedicated terminal device.

[0101] Furthermore, the user terminal 20 may be a dedicated terminal device or the like loaned to the user by the golf course 1. In this case, the user terminal 20 may include a control unit configured by hardware instead of the processor 23 that functions by reading the application program AP.

[0102] Here, a method for forming the inclined symbols (arrow symbol M1 and circle symbol M2) formed for each small region M will be described.

[0103] The processor 23 first forms an AR space including a ground image 70, as shown in Fig. 15. The ground image 70 is an image of a three-dimensional ground (e.g., the ground of green 18) including a slope. The ground image 70 is recognized as, for example, a collection of polygonal meshes that are constituent units of a color region.

[0104] Next, the processor 23 sets (internally generates) a plurality of rectangular panel sections 80 in this AR space, with the reference point 72 as the center, as shown in FIG.

[0105] As described above, the reference point 72 is the position of the virtual golf ball 110 or the midpoint between the virtual golf ball 110 and the virtual cup 112, and in the example shown in Fig. 16, it is the position of the virtual golf ball 110. With this reference point 72 as the center, a plurality of N x N (e.g., 3 x 3) panel sections 80 are set at the same height.

[0106] This panel section 80 is a frame (a virtual frame) of a panel (described later) corresponding to a small region M, and is, for example, a square. The number N and size (length of one side) of the panel sections 80 can be set as the number and size of the small regions M, as described with reference to Fig. 12. Note that since it is preferable to provide one panel section 80 that serves as the center of the multiple panel sections 80, it is preferable that the number N of the panel sections 80 is an odd number. The processor 23 then determines the coordinates of the center of each panel section 80 thus set.

[0107] 17, the processor 23 raises the panel sections 80 in the AR space, and sets the height of the center of each panel section 80 in the AR space (the Y coordinate of the coordinates of the center of each panel section 80) to a position that is a first predetermined value L1 (1 m in this embodiment) higher than the reference point 72. Then, the processor 23 sets the coordinate of the center of each panel section 80 at this position as center coordinates P1.

[0108] It is preferable that the first predetermined value is set to a relatively large value (for example, 1 m) so as to be larger than the maximum height (height of the undulations; height from the reference point 72) of the ground image 70. This makes it possible to prevent the panel section 80 from being buried in the ground image 70.

[0109] 17, the processor 23 performs a raycast (projects a virtual light beam) downward (in the negative vertical direction, downward in the vertical direction) from the center coordinate P1 of each panel section 80, and obtains ground coordinate P2, which is the coordinate of the position where the light collides in the ground image 70 (the mesh that forms the ground image 70). In this way, the processor 23 obtains the ground coordinate P2, which is the three-dimensional coordinate of the portion of the ground image 70 that is located below the center of each panel section 80.

[0110] Then, the processor 23 acquires a panel coordinate P3 that is a coordinate higher than the ground coordinate P2 corresponding to each panel section 80 by a second predetermined value L2 (1 cm in this embodiment). Then, the processor 23 materializes all of the N×N (3×3) panel sections 80 so that each panel coordinate P3 is the center. As a result, the processor 23 forms a plurality of panels 82 in the AR space, centered on the panel coordinate P3 that is higher than the ground coordinate P2 by the second predetermined value L2 (1 cm), as shown in FIG. 18. This panel 82 corresponds to a small area M to which one inclination symbol (arrow symbol M1 and circle symbol M2) is added, and is a square plate-like object in the AR space.

[0111] Next, the processor 23 causes the panel 82 to freely fall toward the ground image 70 in the AR space, as shown in FIG. 19. As a result, the panel 82 falls by 1 cm and collides with the ground image 70. The panel 82 that has collided with the ground image 70 comes to rest at the collision point of the ground image 70 in a state inclined along the slope of this point. Specifically, the panel 82 that has collided with the ground image 70 comes to rest in a state inclined so that the normal (a line extending perpendicularly from the collision point) of the collision point of the ground image 70 (for example, the point of the ground coordinate P2) is its own normal. In this way, the processor 23 causes the panel 82 to fall toward the ground image 70, and gives the panel 82 a slope according to the slope of the ground image 70.

[0112] 20, the processor 23 assigns an inclination symbol (arrow symbol M1 or circle symbol M2) corresponding to the inclination of the panel 82 that has fallen onto the ground image 70, and displays it as a small region M superimposed on the ground image 70. In this way, the processor 23 can superimpose the inclination symbol for each small region M on the ground image 70.

[0113] In this method of forming the inclination symbol, the inclination of the ground is calculated based on the inclination of the panel 82 that fell onto the ground image 70, and the inclination symbol is attached to the panel 82. Therefore, the inclination of the ground can be calculated more easily than in a method of calculating the inclination of the ground by sampling the heights of multiple points on the ground. Furthermore, with this method, by reducing the size of the panel 82 (the size of the panel section 80), the detailed inclination state (undulations) of the ground image 70 can be obtained. [Explanation of symbols]

[0114] 1: Golf course, 10: Hole, 13: Teeing ground, 14: Fairway, 15: Rough, 16: Pond, 17: Bunker, 18: Green, 20: User terminal, 21: Terminal communication unit, 23: Processor, 25: Memory, 30: Input / output device, 31: Camera, 33: Touch panel, 35: Speaker, 51: pin flag, 60: management unit, 61: management communication unit, 63: management control unit, 70: Ground image, 72: Reference point, 80: Panel section, 82: Panel, 101: Arrow setting tab, 102: Caddy button, 103: Cup setting button, 104: Ball setting button, 106: Navigation button, 107: Hint button, 108: Reset button, 109: Setting button, 110: virtual golf ball, 112: virtual cup, 113: virtual pin flag, 120: movement trajectory, 121: first arrow, 122: distance, 123: second arrow, 135: Movement trajectory, 140: Small area setting field, 141: Panel size setting slider, 142: Slider for setting the number of panels, AP: Application program, N: Computer network, L11: 1st straight line, L12: 2nd straight line, P11: 1st position, P12: 2nd position, L1: first predetermined value, L2: second predetermined value, P1: center coordinates, P2: ground coordinates, P3: panel coordinates M: Small area, M1: Arrow symbol, M2: Circle symbol

Claims

1. an imaging unit that captures an image of the ground of a golf course to generate a ground image; and a control unit that acquires a slope condition of the ground based on the ground image and superimposes the ground image and a slope symbol indicating the slope condition of the ground on a display screen. Terminal device.

2. The tilt symbol includes an arrow indicating the tilt direction. The terminal device according to claim 1 .

3. the control unit is configured to divide the ground image into predetermined small regions, acquire a slope status for each of the small regions, and superimpose the slope symbol for each of the small regions on the ground image. The terminal device according to claim 1 .

4. Further comprising an input unit for receiving an instruction from a user, The control unit is configured to change at least one of a size or a number of the small regions based on an instruction from a user via the input unit. The terminal device according to claim 3.

5. The control unit is forming an AR space including the ground image; Setting a plurality of panel sections in the AR space with a reference point as a center; Setting the height of the center of each panel section in the AR space to a position higher than the reference point by a first predetermined value; obtaining ground coordinates, which are the three-dimensional coordinates of a portion of the ground image located below the center of each panel section; acquiring panel coordinates that are higher than the ground coordinates corresponding to each panel section by a second predetermined value; forming a panel centered on the panel coordinates in the AR space; dropping the panel toward the ground image to give the panel an inclination corresponding to an inclination of the ground image; and displaying the panel that has fallen onto the ground image as the small area superimposed on the ground image with a tilt symbol corresponding to the tilt of the panel; and displaying the inclination symbol for each of the small regions superimposed on the ground image by the above-mentioned. The terminal device according to claim 3.

6. The control unit is configured to superimpose a color corresponding to the height of the captured ground on the ground image. The terminal device according to claim 1 .

7. Further comprising an input unit for receiving an instruction from a user, the control unit is configured to display a virtual golf ball and a virtual cup on the ground image displayed on the display screen based on an instruction from a user via the input unit. The terminal device according to claim 1 .

8. the control unit is configured to acquire a slope state of the ground based on the ground image, generate advice information which is information for causing the virtual golf ball to go into the virtual cup, and display the advice information in a superimposed manner on the ground image. The terminal device according to claim 7.

9. the control unit is configured to display, as the advice information, a first arrow indicating a target position of a hit of the virtual golf ball from above, a second arrow pointing from the virtual golf ball to the target position, and a distance from the virtual cup to the target position. The terminal device according to claim 8.

10. Further comprising an input unit for receiving an instruction from a user, the control unit is configured to superimpose and display a virtual golf ball and a movement trajectory of the virtual golf ball when the virtual golf ball is hit on the ground image displayed on the display screen based on an instruction from a user via the input unit. The terminal device according to claim 1 .

11. capturing an image of the ground of a golf course to generate a ground image; acquiring a slope condition of the ground based on the ground image; and and superimposing the ground image and a slope symbol indicating a slope condition of the ground on a display screen. Display method.

12. acquiring a slope condition of the ground based on a ground image obtained by imaging the ground of the golf course; and A computer program for causing a computer to superimpose the ground image and a slope symbol indicating the slope of the ground on a display screen.

13. A system including the terminal device according to claim 1 and a management unit, the terminal device includes a terminal communication unit for communicating with the management unit, and the control unit is configured to transmit the ground image to the management unit and receive information transmitted from the management unit via the terminal communication unit, The management unit includes: A management communication unit for communicating with the terminal device; a management control unit that receives the ground image via the management communication unit, acquires the inclination state of the ground based on the ground image, recognizes the position of the golf ball and the position of a cup in the ground image, generates advice information for the next shot, and transmits the advice information to the terminal device via the management communication unit. Information provision system.

Images