Method, system and non-transitory computer readable medium for assisting in virtual golf simulation - Patents.com
By synchronizing the trajectory of golf balls in virtual golf systems using imaging modules and reference patterns, the method addresses the issue of mismatched real and simulated trajectories, enhancing user immersion and realism.
Patent Information
- Application Number
- JP2023526137
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-10-30
- Filing Date
- 2021-11-01
- Publication Date
- 2025-04-15
- Estimated Expiration
- 2041-11-01
AI Technical Summary
Existing virtual golf systems fail to synchronize the trajectory of golf balls in the real world with their simulated counterparts, leading to a loss of reality and immersion for users.
A method and system that determine the positional relationship between coordinates identified by imaging modules and those in the display area, using reference patterns to synchronize the motion trajectory of golf balls in both the real and simulated environments.
This solution enhances the sense of reality, presence, and immersion for golfers by ensuring that the actual and simulated trajectories of golf balls are synchronized, thereby improving the overall virtual golf experience.
Smart Images

Figure 0007662776000001 
Figure 0007662776000002 
Figure 0007662776000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a method, system and non-transitory computer readable medium for facilitating a virtual golf simulation. [Background technology]
[0002] Virtual golf systems that allow golfers to enjoy playing golf virtually at low cost even in urban areas have become widespread. The basic concept of such virtual golf systems is to perform a simulation when a golfer hits a golf ball and display the results of the simulation of the shot on a screen.
[0003] However, with the above-mentioned conventional technologies and other technologies introduced so far, when a golfer hits a golf ball, the trajectory of the ball in the real world seen by the golfer and the trajectory of the ball in the area where information related to the ball is displayed through the simulation do not match each other, which has caused problems such as a decrease in realism in terms of the user experience.
[0004] Therefore, the inventors propose a new and advanced technology that can synchronize the trajectory of a golf ball's movement in the real world with the trajectory of a golf ball's movement in an area where information related to the golf ball is displayed through simulation. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Korean Patent Publication No. 10-1986-0004642 (1986.07.11) [Patent Document 2] Korean Patent Registration No. 10-0185841 (2000.04.04) Summary of the Invention [Problem to be solved by the invention]
[0006] An object of the present invention is to solve all of the problems of the prior art described above.
[0007] It is another object of the present invention to increase the realism, presence and immersion of a golfer's virtual golf experience.
[0008] Another object of the present invention is to enable the trajectory of the actual ball movement when a golfer hits a golf ball to be synchronized with the trajectory of the ball movement in an area where information related to the ball is displayed through simulation. [Means for solving the problem]
[0009] A representative configuration of the present invention for achieving the above object is as follows.
[0010] According to one aspect of the present invention, there is provided a method for supporting a virtual golf simulation, the method including: determining a positional relationship between coordinates identified by a first photographing module and coordinates identified in a display area by referring to information regarding a first reference pattern identified in an image captured by a first photographing module arranged to photograph a moving subject and information regarding a second reference pattern identified in an image captured by a second photographing module arranged to photograph a display area in which information related to the subject is displayed; and determining information regarding a motion trajectory of the subject in the display area by referring to the positional relationship.
[0011] According to another aspect of the present invention, there is provided a system for supporting a virtual golf simulation, the system including: a positional relationship determination unit that determines a positional relationship between coordinates identified by a first photographing module and coordinates identified in a display area by referring to information regarding a first reference pattern identified in an image captured by a first photographing module arranged to photograph a moving subject and information regarding a second reference pattern identified in an image captured by a second photographing module arranged to photograph a display area in which information related to the subject is displayed; and a motion trajectory information determination unit that determines information regarding a motion trajectory of the subject in the display area by referring to the positional relationship.
[0012] In addition, other methods for embodying the present invention, other systems, and a non-transitory computer readable recording medium having a computer program for carrying out the methods are also provided. Effect of the Invention
[0013] The present invention provides the golfer with an increased sense of realism, presence and immersion in a virtual golf experience.
[0014] In addition, according to the present invention, when a golfer hits a golf ball, the actual trajectory of the ball's movement and the trajectory of the ball's movement in an area where information related to the ball is displayed through simulation can be synchronized with each other. [Brief description of the drawings]
[0015] [Figure 1] 1 is a diagram illustrating an overall configuration of a virtual golf simulation system according to an embodiment of the present invention; [Diagram 2] 1 is a diagram illustrating another exemplary configuration of a virtual golf simulation system according to an embodiment of the present invention. [Diagram 3]1 is a diagram illustrating another exemplary configuration of a virtual golf simulation system according to an embodiment of the present invention. [Figure 4] 2 is a diagram illustrating in detail the internal configuration of a simulator according to an embodiment of the present invention; [Diagram 5] 1 is a diagram illustrating an example of a situation in which a virtual golf simulation is performed according to an embodiment of the present invention; [Figure 6] 1 is a diagram illustrating an example of a situation in which a virtual golf simulation is performed according to an embodiment of the present invention; [Figure 7] 4 is a diagram illustrating an example of a virtual golf simulation performed when there are multiple areas in which information related to a golf ball is displayed, according to an embodiment of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0016] The following detailed description of the present invention refers to the accompanying drawings, which show, by way of example, specific embodiments in which the present invention may be practiced. Such embodiments are described in sufficient detail to enable one skilled in the art to practice the present invention. It should be understood that the various embodiments of the present invention are different from one another, but are not necessarily mutually exclusive. For example, specific shapes, structures, and characteristics described herein may be embodied in one embodiment without departing from the spirit and scope of the present invention. It should also be understood that the location or arrangement of individual components within each embodiment may be changed without departing from the spirit and scope of the present invention. Therefore, the following detailed description is not to be taken in a limiting sense, and the scope of the present invention should be understood to include the scope of the claims and all equivalents thereto. In the drawings, like reference numerals indicate the same or similar components throughout the various aspects.
[0017] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, various preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings in order to enable those skilled in the art to which the present invention pertains to easily practice the present invention.
[0018] Overall system configuration
[0019] FIG. 1 is a diagram illustrating an overall configuration of a virtual golf simulation system according to an embodiment of the present invention.
[0020] As shown in FIG. 1, the virtual golf simulation system may include a hitting unit 10 , a shooting unit 200 , a simulator 300 , a display unit 400 and a reference pattern unit 500 .
[0021] First, the hitting unit 10 according to an embodiment of the present invention may be a part that a golfer steps on, stands on, and places a golf ball to hit when using a virtual golf simulation system. Such a hitting unit 10 may include a known swing plate whose inclination angle is adjustable. In addition, when the present invention is applied to other types of virtual sports simulator systems, those skilled in the art may appropriately modify the configuration of the hitting unit 10, together with the configuration of other components linked therewith, if necessary, according to the characteristics of the corresponding sports.
[0022] Next, the photographing unit 200 according to an embodiment of the present invention may include a first photographing module 210 arranged to photograph an object and a second photographing module 220 arranged to photograph a display area (specifically, a predetermined area of the display unit 400) on which information related to the object is displayed. For example, the photographing modules 210 and 220 of the photographing unit 200 may include at least one camera, and more specifically, may be a high-speed camera, an infrared camera, a stereo camera, or the like.
[0023] For example, as shown in FIG. 1, the first imaging module 210 may be disposed at a position (e.g., fixedly disposed at a position to view the ground) to look down on an object (e.g., a golf ball, a golf club, etc.), and the second imaging module 220 may be disposed at a position to view the display unit 400 from the front or side. Meanwhile, it should be made clear that the positions of the imaging modules 210 and 220 according to the present invention are not necessarily limited to the above-mentioned embodiments, and may be variously changed within a scope that can achieve the object of the present invention. In addition, the imaging modules 210 and 220 according to an embodiment of the present invention may realize a performance similar to that of a stereo camera by taking pictures while quickly moving one camera left and right, or may realize a performance similar to that of a high-speed camera by taking pictures sequentially using at least two cameras with different shooting speeds.
[0024] Next, the simulator 300 according to an embodiment of the present invention can communicate with the image capture unit 200, the display unit 400, or the reference pattern unit 500, and can include a dedicated processor (not shown) for the virtual golf simulation system. Such a dedicated processor may have a memory means and may have numerical calculation capabilities and graphic processing capabilities. Such a simulator 300 may be partially similar to a device that performs a conventional virtual golf simulation.
[0025] Specifically, the simulator 300 acquires images captured by a first photographing module 210 arranged to photograph a subject and a second photographing module 220 arranged to photograph a display area in which information related to the subject is displayed, and performs a function of determining a positional relationship between coordinates identified by the first photographing module 210 and coordinates identified in the display area by referring to information regarding a first reference pattern identified in the image photographed by the first photographing module 210 and information regarding a second reference pattern identified in the image photographed by the second photographing module 220, and determining information regarding the movement trajectory of the subject in the display area by referring to the positional relationship.
[0026] The configuration of simulator 300 as described above will be described in further detail below with reference to FIG.
[0027] Next, the display unit 400 according to an embodiment of the present invention can perform a function of displaying information related to the subject of the simulator 300 (e.g., the moving direction, moving speed, moving acceleration, moving angular velocity, position, moving trajectory of the golf ball, or simulation values or graphics related thereto, etc.) The display unit 400 can display a predetermined image through a known display means, and can be composed of, for example, a screen that absorbs the impact of the hit golf ball but does not directly emit light, and a projector that outputs an image to the screen.
[0028] Finally, the reference pattern unit 500 according to an embodiment of the present invention is disposed to face the photographing modules 210 and 220 of the photographing unit 200 and performs a function of providing a predetermined pattern. Specifically, the reference pattern unit 500 may include a first reference pattern unit 510 disposed to face the first photographing module 210 of the photographing unit 200 and provide a predetermined pattern (i.e., a first reference pattern) and a second reference pattern unit 520 disposed to face the second photographing module 220 of the photographing unit 200 and provide a predetermined pattern (i.e., a second reference pattern). For example, the reference pattern unit 500 may be a printed board or a programmed electronic display that displays a predetermined pattern, and may provide a checkerboard pattern, a square grid pattern, or the like for camera calibration. However, the method of providing the reference pattern unit 500 according to the present invention and the pattern form may be variously changed within the scope of achieving the object of the present invention, and it is to be clarified that a ground or other background pattern may be used instead of the reference pattern unit 500 according to an embodiment of the present invention.
[0029] For example, the first reference pattern unit 510 may be disposed to face the first imaging module 210 such that a predetermined pattern (i.e., a first reference pattern) is printed, projected, or attached on the ground, and the second reference pattern unit 520 may be disposed to face the second imaging module 220 such that a predetermined pattern (i.e., a second reference pattern) is printed, projected, or attached on the display area. The first and second reference patterns may be displayed temporarily (e.g., when the virtual golf simulation system is first executed or when requested by the virtual golf simulation system) or may be displayed only for a predetermined time.
[0030] Meanwhile, referring to Fig. 2, the reference pattern unit 500 according to an embodiment of the present invention may further include a third reference pattern unit 530 disposed between the second photographing module 220 and the display area to face the second photographing module 220 and provide a predetermined pattern (i.e., a third reference pattern). Like the first and second reference patterns discussed above, the third reference pattern may be displayed temporarily (e.g., when the virtual golf simulation system is first executed or when requested by the virtual golf simulation system) or may be displayed only for a predetermined time.
[0031] More specifically, the third reference pattern part 530 may be formed to be rotatable around a predetermined rotation axis, and may be positioned to rotate around the rotation axis and face the second imaging module 220 only while providing the third reference pattern.
[0032] Meanwhile, referring to FIG. 3, the first reference pattern portion 510 and the third reference pattern portion 530 may be configured to be included in one assembly (eg, an appliance).
[0033] For example, the first and third reference pattern portions 510 and 530 may be formed at different angles in one assembly, and the first and third reference patterns may be provided through the respective pattern portions 510 and 530. By using such an integrated assembly, the relative distance between the first and third reference patterns may be preset.
[0034] Simulator configuration
[0035] The internal configuration of the simulator 300 according to an embodiment of the present invention and the functions of each component will be described in detail below.
[0036] As shown in FIG. 4, the simulator 300 may include an image acquiring unit 310, a positional relationship determining unit 320, a movement trajectory information determining unit 330, a communication unit 340, and a control unit 350. According to an embodiment of the present invention, the image acquiring unit 310, the positional relationship determining unit 320, the movement trajectory information determining unit 330, the communication unit 340, and the control unit 350 may be program modules, at least some of which communicate with an external system (not shown). Such program modules may be included in the simulator 300 in the form of an operating system, application module, or other program modules, and may be physically stored in various known storage devices. Also, such program modules may be stored in a remote storage device that can communicate with the simulator 300. Meanwhile, such program modules include, but are not limited to, routines, subroutines, programs, objects, components, data structures, etc. that perform specific tasks or execute specific abstract data types according to the present invention, which will be described later.
[0037] First, the image acquiring unit 310 according to an embodiment of the present invention can perform a function of acquiring respective images captured by the first photographing module 210 arranged to photograph a subject and the second photographing module 220 arranged to photograph a display area on which information related to the subject is displayed.
[0038] Next, the positional relationship determining unit 320 according to an embodiment of the present invention may perform a function of determining a positional relationship between coordinates specified by the first photographing module 210 and coordinates specified in the display area by referring to information on a first reference pattern specified in an image photographed by the first photographing module 210 and information on a second reference pattern specified in an image photographed by the second photographing module 220. The information on the reference pattern according to an embodiment of the present invention may be a concept including information on a specific shape appearing on each pattern, a position, a layout relationship, coordinates (e.g., coordinates defined in a predetermined reference space system defined in the photographing modules 210, 220 or the virtual golf simulation system), etc.
[0039] For example, the positional relationship determination unit 320 may determine the location information of the first photographing module 210 based on information on a first reference pattern identified in an image photographed by the first photographing module 210, and may determine the location information of the second photographing module 220 based on information on a third reference pattern (specifically, a reference pattern disposed between the second photographing module 220 and the display area so as to face the second photographing module 220) identified in an image photographed by the second photographing module 220. More specifically, according to an embodiment of the present invention, the positional relationship determination unit 320 may determine the position, direction, and orientation of the first photographing module 210 and the position, direction, and orientation of the second photographing module 220 in a predetermined reference space coordinate system related to the first photographing module 210 or the virtual golf simulation system (or simulator 300) based on the coordinates (or positions) of each pattern in the first reference pattern identified in the image photographed by the first photographing module 210 and the coordinates (or positions) of each pattern in the third reference pattern identified in the image photographed by the second photographing module 220, respectively. For this purpose, an imaging module parameter calculation algorithm such as a DLT (Direct Linear Transformation) algorithm, a Zhang algorithm, a Tsai algorithm, or a Selby algorithm may be used.
[0040] Meanwhile, in order to determine the position information of the first and second imaging modules 210 and 220 as described above, known techniques related to camera resectioning or camera calibration may be used, and for example, the technique disclosed in the Wikipedia webpage on camera resectioning (https: / / en.wikipedia.org / wiki / camera_resectioning) may be referred to (this webpage is to be considered incorporated herein in its entirety). However, it should be made clear that the method of determining the position information of the imaging modules 210 and 220 according to the present invention is not limited to and embodied in the above-disclosed content, and may be variously modified within the scope of achieving the object of the present invention.
[0041] Meanwhile, when the second photographing module 220 is placed at a preset position or the position of the second photographing module 220 can be identified by the first photographing module 210, the positional relationship determination unit 320 may immediately acquire the placement information of the second photographing module 220 without using information about the third reference pattern as described above.
[0042] In addition, the positional relationship determination unit 320 can determine the positional relationship between the coordinates determined by the second photographing module 220 and the coordinates determined in the display area by referring to information regarding a second reference pattern (specifically, a reference pattern arranged in the display area) determined in an image captured by the second photographing module 220.
[0043] For example, the positional relationship determination unit 320 can determine the three-dimensional coordinates of each pattern in the second reference pattern identified based on the second photographing module 220 by analyzing an image (e.g., a stereo image) captured by the second photographing module 220 with respect to the second reference pattern arranged in the display area, and can determine the positional relationship between the coordinates identified by the second photographing module 220 and the coordinates identified in the display area by analyzing the correspondence between the two-dimensional coordinates of each pattern in the second reference pattern identified based on the display area and the three-dimensional coordinates of each pattern in the second reference pattern identified based on the second photographing module 220 as described above.
[0044] Meanwhile, according to an embodiment of the present invention, a stereo vision method (e.g., Structured Light Vision (SLV), Active Stereo Vision (ASV), Structured-Light Stereo (SLS), etc.) may be used to obtain 3D coordinates from an image captured by the second imaging module 220 as described above. For example, see the technology disclosed in the Wikipedia webpage on stereo vision (https: / / en.wikipedia.org / wiki / computer_stereo_vision) and the technology disclosed in Korean Patent Publication No. 10-2014-0086938 (this webpage and this patent publication shall be deemed to be incorporated herein in their entirety). However, it should be made clear that the coordinate identification method according to the present invention is not limited to the above disclosure and may be modified in various ways within the scope of achieving the object of the present invention.
[0045] In addition, the positional relationship determination unit 320 can determine the positional relationship between the coordinates determined by the first photographing module 210 and the coordinates determined in the display area by referring to the positional relationship between the first photographing module 210 and the second photographing module 220 (or the coordinates determined by the first photographing module 210 and the coordinates determined by the second photographing module 220) (such a positional relationship may be determined by comparing and analyzing the placement information of the first photographing module 210 and the placement information of the second photographing module 220 as discussed in detail above).
[0046] In addition, the positional relationship determining unit 320 can dynamically determine attributes of the second reference pattern provided in the corresponding area by further referring to the information regarding the resolution of the display area described above.
[0047] For example, the positional relationship determining unit 320 may adaptively adjust at least one of the size, shape, and number of the second reference patterns according to information regarding the resolution set for the display area.
[0048] Next, the motion trajectory information determining unit 330 according to an embodiment of the present invention may perform a function of determining information about the motion trajectory of the subject in the display area by referring to the positional relationship determined by the positional relationship determining unit 320.
[0049] For example, the motion trajectory information determination unit 330 can determine two-dimensional coordinates in the display area corresponding to the three-dimensional spatial coordinates of the subject photographed by the first photographing module 210 based on the positional relationship between the coordinates determined by the first photographing module 210 and the coordinates determined in the display area, and can determine information regarding the subject's motion trajectory in the display area as well as information regarding the physical quantities of the subject, such as the motion direction, position, motion speed, etc., by referring to the determined two-dimensional coordinates.
[0050] Next, the communication unit 340 according to an embodiment of the present invention may perform a function of enabling data transmission / reception to / from the image acquiring unit 310, the positional relationship determining unit 320, and the movement trajectory information determining unit 330.
[0051] Finally, the control unit 350 according to an embodiment of the present invention may perform a function of controlling data flow between the image acquiring unit 310, the positional relationship determining unit 320, the movement trajectory information determining unit 330, and the communication unit 340. That is, the control unit 350 may control the image acquiring unit 310, the positional relationship determining unit 320, the movement trajectory information determining unit 330, and the communication unit 340 to perform their respective unique functions by controlling the data flow from / to the outside of the simulator 300 or the data flow between each component of the simulator 300.
[0052] 5 and 6 are diagrams illustrating an example of a situation in which a virtual golf simulation is performed according to an embodiment of the present invention.
[0053] According to an embodiment of the present invention, it may be assumed that the first and second imaging modules 210, 220 are configured with a plurality of cameras 211, 212, 221, 222 (e.g., stereo cameras). Here, the first imaging module 210 may be fixedly disposed at a position viewing the ground so as to capture an image of a golf ball, and the second imaging module 220 may be fixedly disposed at the front or side of the display unit 400 so as to capture an image of a display area on the display unit 400 where information related to the golf ball is displayed.
[0054] Referring to FIG. 5, first, a predetermined pattern (i.e., a first reference pattern) is provided through the first reference pattern unit 510, and information about the first reference pattern (specifically, the coordinates of each pattern in the first reference pattern) can be identified in an image captured by the first imaging module 210.
[0055] Then, based on the information about the first reference pattern, position information of the first photographing module 210 in a predetermined reference space coordinate system associated with the first photographing module 210 or the virtual golf simulation system (or simulator 300) may be determined.
[0056] Next, by analyzing the position and orientation of the second photographing module 220 based on the image captured by the first photographing module 210, the position information of the second photographing module 220 in a predetermined reference space coordinate system related to the first photographing module 210 or the virtual golf simulation system (or simulator 300) can be determined.
[0057] Meanwhile, the position of a third reference pattern (specifically, a pattern provided by a third reference pattern unit (not shown) arranged between the second photographing module 220 and the display area facing the second photographing module 220) (not shown) in a reference space coordinate system may be identified based on the image photographed by the first photographing module 210, and placement information of the second photographing module 220 may be identified based on information regarding the position of the third reference pattern and information regarding the third reference pattern identified in the image photographed by the second photographing module 220 (e.g., coordinates of each pattern in the third reference pattern).
[0058] Next, a predetermined pattern (ie, a second reference pattern) is provided in the second reference pattern unit 520, and information about the second reference pattern can be identified in an image captured by the second imaging module 220.
[0059] Then, based on information about the second reference pattern (eg, coordinates of each pattern in the second reference pattern), a positional relationship between the coordinates determined by the second imaging module 220 and the coordinates determined in the display area can be determined.
[0060] Next, by referring to the positional relationship between the position information of the first photographing module 210 and the position information of the second photographing module 220 and the coordinates identified by the second photographing module 220 and the coordinates identified in the display area, the positional relationship between the coordinates identified by the first photographing module 210 and the coordinates identified in the display area can be determined.
[0061] Then, when the golfer hits the ball, information regarding the subject's motion trajectory in the display area of the display unit 400 can be determined based on the positional relationship between the coordinates identified by the first photographing module 210 and the coordinates identified in the display area.
[0062] For example, referring to FIG. 6, according to one embodiment of the present invention, the height and position 610, 620 at which the ball moves in the real world and the height and position 611, 621 at which the ball moves in the display area may be provided in a synchronized manner.
[0063] FIG. 7 is a diagram illustrating an example of a virtual golf simulation performed when there are multiple areas in which information related to a golf ball is displayed, according to an embodiment of the present invention.
[0064] According to one embodiment of the present invention, when there are multiple display areas (e.g., a multi-sided screen) on which information related to a golf ball is displayed, a second reference pattern may be arranged for each display area (or the entire display area) (e.g., the same or different second reference patterns may be arranged for each display), and a positional relationship between coordinates identified by the first photographing module and coordinates identified in the display area may be determined by referring to information regarding each second reference pattern identified in an image captured by the second photographing module 220.
[0065] Meanwhile, when the multiple display areas are curved, the positional relationship between the coordinates determined by the first imaging module and the coordinates determined by the display areas can be determined more precisely by interpolating the respective coordinates corresponding to the curved surface with a curve.
[0066] The above-described embodiments of the present invention may be embodied in the form of program instructions that can be executed by various computer components and recorded on a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the computer-readable recording medium may be those specially designed and constructed for the present invention, or may be those that are known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions, such as ROMs, RAMs, flash memories, and the like. Examples of program instructions include not only machine language codes, such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, and the like. The hardware devices may be replaced by one or more software modules to perform the processes of the present invention, and vice versa.
[0067] Although the present invention has been described above using specific details such as specific components and limited embodiments and drawings, this is merely provided to assist in a more general understanding of the present invention, and the present invention is not limited to the above embodiments. Those skilled in the art to which the present invention pertains may make various modifications and changes from such descriptions.
[0068] Therefore, the concept of the present invention should not be limited to the above described embodiments, and all scopes equivalent to or modified equivalently to the scope of the claims below as well as the claims themselves are within the scope of the concept of the present invention. [Explanation of symbols]
[0069] 10: Striking section 200: Photography Department 210: First imaging module 220: Second imaging module 300: Simulator 310: Image Acquisition Section 320: Positional relationship determination unit 330: Motion trajectory information determination unit 340: Communications Department 350: Control unit 400: Display section 500: Reference pattern section 510: First reference pattern section 520: Second reference pattern section 530: Third reference pattern section
Claims
1. 1. A method for facilitating a virtual golf simulation, comprising: determining a positional relationship between coordinates specified by a first photographing module and coordinates specified in a display area by referring to information on a first reference pattern specified in an image photographed by a first photographing module arranged to photograph a moving subject and information on a second reference pattern specified in an image photographed by a second photographing module arranged to photograph a display area on which information related to the subject is displayed; and determining information about a motion trajectory of the object in the display area by referring to the positional relationship; The display area is different from the real world in which the subject is photographed, A virtual golf simulation support method, in which, in the step of determining the positional relationship, a positional relationship between coordinates identified by the second photographing module and coordinates identified in the display area is determined based on a correspondence between three-dimensional coordinates of each pattern in the second reference pattern identified based on the second photographing module and two-dimensional coordinates of each pattern in the second reference pattern identified based on the display area.
2. 2. The virtual golf simulation support method according to claim 1, wherein the first photographing module is fixed and looks at the ground.
3. the first reference pattern is a pattern disposed on the ground, 2. The virtual golf simulation support method according to claim 1, wherein the second reference pattern is a pattern arranged in the display area.
4. The step of determining the positional relationship includes: (a) determining layout information of the first photographing module by referring to information about the first reference pattern, and determining layout information of the second photographing module by referring to information about a third reference pattern identified in an image photographed by the second photographing module; (b) determining a positional relationship between the first and second photographing modules by referring to layout information of the first photographing module and layout information of the second photographing module; and (c) determining a positional relationship between a coordinate specified by the first photographing module and a coordinate specified in the display area by referring to a positional relationship between the first photographing module and the second photographing module; The virtual golf simulation support method according to claim 1 , wherein the third reference pattern is a pattern disposed between the second photographing module and the display area.
5. The method of claim 4, wherein step (a) comprises the step of identifying a position of the third reference pattern by referring to an image captured by the first imaging module.
6. The method for supporting a virtual golf simulation according to claim 4 , wherein the first reference pattern and the third reference pattern are arranged in a single assembly.
7. 2. The method according to claim 1, wherein in the step of determining the positional relationship, attributes of the second reference pattern are dynamically determined by referring to information regarding a resolution of the display area.
8. A non-transitory computer-readable recording medium having a computer program recorded thereon for carrying out the method according to claim 1.
9. 1. A system for assisting in a virtual golf simulation, comprising: a positional relationship determining unit that determines a positional relationship between coordinates specified by a first photographing module and coordinates specified in a display area by referring to information on a first reference pattern specified in an image photographed by a first photographing module arranged to photograph a moving subject and information on a second reference pattern specified in an image photographed by a second photographing module arranged to photograph a display area on which information related to the subject is displayed; and a motion trajectory information determination unit that determines information about a motion trajectory of the subject in the display area by referring to the positional relationship; The display area is different from the real world in which the subject is photographed, A virtual golf simulation support system, wherein the positional relationship determination unit determines the positional relationship between the coordinates identified by the second photographing module and the coordinates identified in the display area based on the correspondence between the three-dimensional coordinates of each pattern in the second reference pattern identified based on the second photographing module and the two-dimensional coordinates of each pattern in the second reference pattern identified based on the display area.
10. The virtual golf simulation support system according to claim 9 , wherein the first photographing module is fixed and looks at the ground.
11. the first reference pattern is a pattern disposed on the ground, 10. The virtual golf simulation support system according to claim 9, wherein the second reference pattern is a pattern arranged in the display area.
12. the positional relationship determination unit determines placement information of the first photographing module by referring to information on the first reference pattern, determines placement information of the second photographing module by referring to information on a third reference pattern determined in an image photographed by the second photographing module, determines a positional relationship between the first photographing module and the second photographing module by referring to the placement information of the first photographing module and the placement information of the second photographing module, and determines a positional relationship between a coordinate determined by the first photographing module and a coordinate determined in the display area by referring to the positional relationship between the first photographing module and the second photographing module; The virtual golf simulation support system according to claim 9 , wherein the third reference pattern is a pattern disposed between the second photographing module and the display area.
13. The virtual golf simulation support system of claim 12 , wherein the positional relationship determination unit is configured to determine a position of the third reference pattern by referring to an image captured by the first photographing module.
14. The virtual golf simulation support system according to claim 12 , wherein the first reference pattern and the third reference pattern are arranged in one assembly.
15. 10. The virtual golf simulation support system according to claim 9, wherein the positional relationship determining unit dynamically determines the attribute of the second reference pattern by referring to information related to a resolution of the display area.
Citation Information
Patent Citations
Position detection device, method, and program
JP2008171280A
Equipment and method for matching flat panel display device and image sensor, electronic equipment having flat panel display device and image sensor matched using the method
JP2015088193A
Program and game system
JP2015181770A
A motion estimator for a video coder
KR100185841B1
golf simulator
KR1019860004642A