Method, system and non-transitory computer readable recording medium for supporting virtual golf simulation

Abstract

According to one embodiment of the present invention, there is provided a method for supporting a virtual golf simulation, the method comprising the steps of: determining a positional relationship between coordinates determined in a first photographing module configured to photograph a subject in motion and coordinates determined in a display region, with reference to information about a first reference pattern determined in an image photographed by the first photographing module and information about a second reference pattern determined in an image photographed by a second photographing module configured to photograph the display region displaying information about the subject; and determining information about a movement track of the subject in the display region, with reference to the positional relationship.

Description

Technical Field

[0001] This invention relates to a method, system, and non-transitory computer-readable recording medium for supporting virtual golf simulation. Background Technology

[0002] Virtual golf systems, which allow golfers to virtually enjoy golf in locations such as city centers at low cost, have become widely available. The basic concept of such systems is to simulate a golfer hitting a golf ball and display the simulated swing on a screen.

[0003] However, according to the technologies described so far, including the previous technologies mentioned above, when a golfer hits a golf ball, the trajectory of the ball in the real world that the golfer sees is inconsistent with the trajectory of the ball in the area that displays information related to the ball through simulation. Therefore, there are problems such as a lack of realism in the user's experience.

[0004] Therefore, the inventors have proposed a novel and advanced technique that enables the trajectory of a golf ball in the real world to be synchronized with the trajectory of a golf ball in an area where information related to the golf ball is displayed through simulation.

[0005] Existing technical documents

[0006] Patent documents

[0007] Patent Document 1: Korean Patent Publication No. 10-1986-0004642 (July 11, 1986)

[0008] Patent Document 2: Korean Patent Registration Publication No. 10-0185841 (April 4, 2000) Summary of the Invention

[0009] The technical problem to be solved by the invention

[0010] The purpose of this invention is to solve all the problems of the aforementioned prior art.

[0011] Furthermore, the purpose of this invention is to increase the realism, immediacy, and immersion of golfers experiencing virtual golf.

[0012] Furthermore, the purpose of this invention is to enable the actual trajectory of a golf ball when a golfer hits it to be synchronized with the trajectory of the ball in an area where information related to the ball is displayed through simulation.

[0013] means for solving technical problems

[0014] The representative structure of the present invention for achieving the above objectives is as follows.

[0015] According to one aspect of the present invention, a method for supporting virtual golf simulation is provided, the method comprising the steps of: determining a positional relationship between coordinates determined in the first camera module and coordinates determined in a display area, with reference to information relating to a first reference pattern determined in an image captured by a first camera module and information relating to a second reference pattern determined in an image captured by a second camera module, the first camera module being configured to capture a moving subject, and the second camera module being configured to capture the display area displaying information relating to the subject; and determining information relating to the movement trajectory of the subject in the display area with reference to the positional relationship.

[0016] According to another aspect of the present invention, a system for supporting virtual golf simulation is provided, the system comprising: a positional relationship determination unit, which determines a positional relationship between coordinates determined in the first camera module and coordinates determined in a display area by referring to information related to a first reference pattern determined in an image captured by a first camera module and information related to a second reference pattern determined in an image captured by a second camera module, the first camera module being configured to capture a moving subject and the second camera module being configured to capture the display area displaying information related to the subject; and a motion trajectory information determination unit, which determines information related to the motion trajectory of the subject in the display area by referring to the positional relationship.

[0017] In addition, other methods, other systems for implementing the present invention, and non-transitory computer-readable recording media for recording computer programs for performing said methods are also provided.

[0018] Invention Effects

[0019] According to the present invention, it is possible to increase the realism, presence, and immersion of golfers experiencing virtual golf.

[0020] Furthermore, according to the present invention, it is possible to synchronize the actual trajectory of the ball when a golfer hits the ball with the trajectory of the ball in an area where ball-related information is displayed through simulation. Attached Figure Description

[0021] Figure 1 This is a diagram that schematically illustrates the overall structure of a virtual golf simulation system based on an embodiment of the present invention.

[0022] Figure 2 and Figure 3 This is a diagram illustrating other exemplary structures of a virtual golf simulation system based on an embodiment of the present invention.

[0023] Figure 4This is a diagram showing in detail the internal structure of a simulator based on an embodiment of the present invention.

[0024] Figure 5 and Figure 6 This is a diagram illustrating, as an example, the execution of a virtual golf simulation based on an embodiment of the present invention.

[0025] Figure 7 This diagram illustrates, exemplarily, a scenario where a virtual golf simulation is performed when multiple areas displaying golf ball-related information are present, according to an embodiment of the present invention.

[0026] Symbol explanation:

[0027] 10-Striking section

[0028] 200-Photography Department

[0029] 210-First Photography Module

[0030] 220 - Second Photography Module

[0031] 300-Simulator

[0032] 310-Image Acquisition Department

[0033] 320-Position Relationship Determination Department

[0034] 330-Motion Trajectory Information Decision Department

[0035] 340-Department of Communications

[0036] 350-Control Section

[0037] 400-Display Unit

[0038] 500-Base Pattern Section

[0039] 510-First Reference Pattern Section

[0040] 520-Second Reference Pattern Section

[0041] 530-3rd Reference Pattern Section Detailed Implementation

[0042] The detailed description of the invention described below refers to the accompanying drawings, which illustrate specific embodiments through which the invention can be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. Various embodiments of the invention differ from one another, but it should be understood that these various embodiments are not necessarily mutually exclusive. For example, specific shapes, structures, and characteristics described herein may be implemented by changing one embodiment to another without departing from the spirit and scope of the invention. Furthermore, it should be understood that the position or arrangement of individual constituent elements in various embodiments may also be changed without departing from the spirit and scope of the invention. Therefore, the detailed description described below is not intended to be limiting, but should be accepted as encompassing the scope claimed by the claims and all equivalents thereof. Similar reference numerals in the drawings denote the same or similar constituent elements on various sides.

[0043] Hereinafter, several preferred embodiments of the invention will be described in detail with reference to the accompanying drawings, so that those skilled in the art can readily implement the invention.

[0044] Overall system structure

[0045] Figure 1 This is a diagram that schematically illustrates the overall structure of a virtual golf simulation system based on an embodiment of the present invention.

[0046] like Figure 1 As shown, the virtual golf simulation system may be composed of a hitting unit 10, a camera unit 200, a simulator 300, a display unit 400, and a reference pattern unit 500.

[0047] First, according to one embodiment of the present invention, the striking part 10 can be a part in which a golfer stands with his feet on the ground to place the golf ball for hitting when using a virtual golf simulation system. Such a striking part 10 may include a known swing plate capable of adjusting its tilt angle. For reference, when the present invention is applied to other types of virtual sports simulator systems, those skilled in the art can appropriately modify the structure of the striking part 10, along with the structure of other components linked thereto, to conform to the characteristics of the corresponding sport.

[0048] Next, the camera unit 200 according to an embodiment of the present invention may be configured to include a first camera module 210 configured to photograph a subject and a second camera module 220 configured to photograph a display area (specifically, a predetermined area of ​​the display unit 400) displaying information related to the subject. For example, the camera modules 210 and 220 of the camera unit 200 may be configured to include at least one camera, and more specifically, may be configured as a high-speed camera, an infrared camera, a stereo camera, etc.

[0049] For example, as shown in Figure 1, the first camera module 210 can be configured to view the subject (e.g., a golf ball, golf club, etc.) from above (e.g., it can be fixedly configured facing the ground), and the second camera module 220 can be configured to face the display unit 400 from the front or side. On the other hand, it should be understood that the positions of the camera modules 210 and 220 according to the present invention are not necessarily limited to the embodiments described above, and can be varied in many ways within the scope of achieving the objectives of the present invention. Furthermore, the camera modules 210 and 220 according to one embodiment of the present invention can achieve performance similar to a stereo camera by rapidly moving one camera left and right while shooting, or achieve performance similar to a high-speed camera by using at least two cameras with different shooting speeds to shoot sequentially.

[0050] Next, the simulator 300 based on an embodiment of the present invention can communicate with the camera unit 200, the display unit 400, or the reference pattern unit 500, and may include a dedicated processor (not shown) for a virtual golf simulation system. This dedicated processor may have a memory unit and numerical computation and graphics processing capabilities. This simulator 300 may be partially similar to a device that performs a conventional virtual golf simulation.

[0051] Specifically, the simulator 300 can perform the following functions: obtain images captured by a first imaging module 210 configured to capture a subject and a second imaging module 220 configured to capture a display area displaying information related to the subject; determine the positional relationship between the coordinates determined in the first imaging module 210 and the coordinates determined in the display area by referring to the information related to the first reference pattern determined in the image captured by the first imaging module 210 and the information related to the second reference pattern determined in the image captured by the second imaging module 220; and determine the information related to the motion trajectory of the subject in the display area by referring to the positional relationship.

[0052] Regarding the structure of simulator 300 as described above, please refer to... Figure 4 Further explanation follows.

[0053] Next, the display unit 400 based on an embodiment of the present invention can perform the function of displaying information related to the subject (e.g., the direction of motion, speed, acceleration, angular velocity, position, trajectory, or related analog values ​​or graphics of a golf ball) of the simulator 300. This display unit 400 can display predetermined images using a known display unit, for example, it can be composed of a screen that absorbs the impact of the struck golf ball and does not directly emit light, and a projector that outputs images to such a screen.

[0054] Finally, the reference pattern unit 500 according to an embodiment of the present invention is configured opposite to the photography modules 210 and 220 of the photography unit 200 and performs the function of providing a predetermined pattern. Specifically, it may be configured to include a first reference pattern unit 510 which is configured opposite to the first photography module 210 of the photography unit 200 and provides a predetermined pattern (i.e., a first reference pattern) and a second reference pattern unit 520 which is configured opposite to the second photography module 220 of the photography unit 200 and provides a predetermined pattern (i.e., a second reference pattern). For example, such a reference pattern unit 500 may be a printed circuit board displaying a predetermined pattern or a programmed electronic display, and may provide a chessboard pattern, a square grid pattern, etc., for calibrating a camera. However, the provision method and pattern form of the reference pattern unit 500 according to the present invention are not necessarily limited to the embodiments described above, and various modifications can be made within the scope of achieving the purpose of the present invention. Furthermore, it should be understood that according to an embodiment of the present invention, the reference pattern unit 500 described above may be replaced by a ground or other background pattern.

[0055] For example, the first reference pattern section 510 can be configured to print, project, or affix a predetermined pattern (i.e., the first reference pattern) opposite to the first camera module 210, and the second reference pattern section 520 can be configured to print, project, or affix a predetermined pattern (i.e., the second reference pattern) opposite to the second camera module 220 on the display area. These first and second reference patterns can be displayed temporarily (e.g., when the virtual golf simulation system is first run or when requested by the virtual golf simulation system) or only for a predetermined period.

[0056] On the other hand, reference Figure 2According to an embodiment of the present invention, the reference pattern section 500 may further include a third reference pattern section 530, which is disposed opposite to the second camera module 220 between the second camera module 220 and the aforementioned display area and provides a predetermined pattern (i.e., the third reference pattern). Similar to the first and second reference patterns described above, this third reference pattern may be displayed temporarily (e.g., when the virtual golf simulation system is first run or when the virtual golf simulation system requests it) or only for a predetermined time.

[0057] More specifically, the third reference pattern section 530 can be configured to rotate around a predetermined rotation axis and can be configured to rotate around the rotation axis only during the provision of the third reference pattern and be opposite to the second imaging module 220.

[0058] On the other hand, reference Figure 3 Alternatively, the first reference pattern portion 510 and the third reference pattern portion 530, as described above, can be included in a single component (e.g., an appliance).

[0059] For example, a first reference pattern portion 510 and a third reference pattern portion 530 are formed at different angles in a single component, through which the pattern portions 510 and 530 can respectively provide a first reference pattern and a third reference pattern. By utilizing this integrated component, the relative distance between the first reference pattern and the third reference pattern can be set.

[0060] Simulator Structure

[0061] The internal structure of a simulator 300 based on an embodiment of the present invention and the functions of each component are described below.

[0062] like Figure 4As shown, the simulator 300 may be configured to include an image acquisition unit 310, a position relationship determination unit 320, a motion trajectory information determination unit 330, a communication unit 340, and a control unit 350. According to one embodiment of the present invention, at least a portion of the image acquisition unit 310, the position relationship determination unit 320, the motion trajectory information determination unit 330, the communication unit 340, and the control unit 350 may be a program module that communicates with an external system (not shown). Such a program module may be included in the simulator 300 in the form of an operating system, an application module, or other program modules, and may be physically stored in various known storage devices. Furthermore, such a program module may also be stored in a remote storage device capable of communicating with the simulator 300. On the other hand, such a program module includes, but is not limited to, routines, subroutines, programs, objects, components, data structures, etc., that execute specific tasks or specific abstract data types according to the present invention.

[0063] First, the image acquisition unit 310 based on an embodiment of the present invention can perform the following function: acquire each image captured by the first photography module 210 configured to capture a subject and the second photography module 220 configured to capture a display area displaying information related to the subject.

[0064] Next, the positional relationship determination unit 320 according to an embodiment of the present invention can perform the following function: determining the positional relationship between the coordinates determined in the first photography module 210 and the coordinates determined in the display area by referring to information related to the first reference pattern determined in the image captured by the first photography module 210 and information related to the second reference pattern determined in the image captured by the second photography module 220. The information related to the reference pattern according to an embodiment of the present invention may be a concept including information related to the position, configuration relationship, and coordinates (e.g., coordinates defined in a predetermined reference space system defined in the photography modules 210, 220, or the virtual golf simulation system) of specific shapes or specific areas appearing on each pattern.

[0065] For example, the position relationship determination unit 320 can determine the configuration information of the first camera module 210 based on information related to the first reference pattern determined in the image captured by the first camera module 210, and determine the configuration information of the second camera module 220 based on information related to the third reference pattern (specifically, a reference pattern arranged opposite to the second camera module 220 between the second camera module 220 and the display area) determined in the image captured by the second camera module 220. More specifically, according to an embodiment of the present invention, the position relationship determination unit 320 can determine the position, orientation, and orientation of the first camera module 210 and the second camera module 220 respectively in a predetermined reference space coordinate system related to the first camera module 210 or the virtual golf simulation system (or simulator 300) based on the coordinates (or positions) of each pattern in the first reference pattern determined in the image captured by the first camera module 210 and the coordinates (or positions) of each pattern in the third reference pattern determined in the image captured by the second camera module 220. Therefore, algorithms for calculating parameters of the photography module, such as DLT (Direct Linear Transformation), Zhang algorithm, Tsai algorithm, and Selby algorithm, can be used.

[0066] On the other hand, in order to determine the configuration information of the first camera module 210 and the second camera module 220 as described above, known techniques related to camera resection or camera calibration can be applied. For example, techniques related to camera calibration disclosed on the Wikipedia webpage ("https: / / en.wikipedia.org / wiki / camera_resectioning") can be referenced (this webpage should be considered as incorporated herein by reference in its entirety). However, it should be clear that the method for determining the configuration information of camera modules 210 and 220 based on the present invention is not limited to the content disclosed above, and various modifications can be made within the scope of achieving the objectives of the present invention.

[0067] On the other hand, when the second imaging module 220 is configured in a set position or the position of the second imaging module 220 can be determined by the first imaging module 210, the position relationship determination unit 320 can also directly obtain the configuration information of the second imaging module 220, instead of using information related to the third reference pattern as described above.

[0068] Furthermore, the positional relationship determination unit 320 can determine the positional relationship between the coordinates determined in the second imaging module 220 and the coordinates determined in the display area by referring to information related to the second reference pattern (specifically, the reference pattern disposed in the display area) determined in the image captured by the second imaging module 220.

[0069] For example, the position relationship determination unit 320 determines the three-dimensional coordinates of each pattern in the second reference pattern determined with reference to the second imaging module 220 by analyzing the image (e.g., a stereoscopic image) captured by the second imaging module 220 for the second reference pattern disposed in the display area, and determines the position relationship between the coordinates determined in the second imaging module 220 and the coordinates determined in the display area by analyzing the correspondence between the two-dimensional coordinates of each pattern in the second reference pattern determined with reference to the display area and the three-dimensional coordinates of each pattern in the second reference pattern determined with reference to the second imaging module 220 as described above.

[0070] On the other hand, according to one embodiment of the present invention, in order to obtain three-dimensional coordinates from the image captured by the second imaging module 220 as described above, a stereo vision method (e.g., structured light vision (SLV), active stereo vision (ASV), structured-light stereo (SLS), etc.) can be used. For example, reference can be made to the technology disclosed on the Wikipedia webpage ("https: / / en.wikipedia.org / wiki / computer_stereo_vision") and the technology disclosed in Korean Patent Publication No. 10-2014-0086938 (this webpage and this patent publication should be considered as part of this specification). However, it should be clear that the coordinate determination method based on the present invention is not limited to the content disclosed above, and various modifications can be made within the scope of achieving the purpose of the present invention.

[0071] Furthermore, the position relationship determination unit 320 can refer to the position relationship between the first camera module 210 and the second camera module 220 (or the coordinates determined in the first camera module 210 and the coordinates determined in the second camera module 220) (this position relationship can also be determined by comparing and analyzing the configuration information of the first camera module 210 and the configuration information of the second camera module 220 described above) to determine the position relationship between the coordinates determined in the first camera module 210 and the coordinates determined in the display area.

[0072] Furthermore, the position relationship determination unit 320 can further refer to information related to the resolution of the display area described above to dynamically determine the attributes of the second reference pattern provided in that area.

[0073] For example, the position relationship determination unit 320 can adaptively adjust at least one of the size, shape, and number of the second reference pattern based on resolution-related information set for the display area.

[0074] Next, the motion trajectory information determination unit 330 based on an embodiment of the present invention can perform the following function: determine information related to the motion trajectory of the subject in the display area by referring to the positional relationship determined by the positional relationship determination unit 320.

[0075] For example, the motion trajectory information determination unit 330 can determine the two-dimensional coordinates of the subject captured by the first photography module 210 in the display area corresponding to the three-dimensional spatial coordinates based on the positional relationship between the coordinates determined in the first photography module 210 and the coordinates determined in the display area. By referring to the determined two-dimensional coordinates, it can determine not only the information related to the motion trajectory of the subject in the display area, but also the information related to the physical quantities of the subject such as motion direction, position, and motion speed.

[0076] Next, the communication unit 340 based on an embodiment of the present invention can perform the function of transmitting and receiving data from the image acquisition unit 310, the position relationship determination unit 320 and the motion trajectory information determination unit 330 to the image acquisition unit 310, the position relationship determination unit 320 and the motion trajectory information determination unit 330.

[0077] Finally, based on an embodiment of the present invention, the control unit 350 is capable of controlling the data flow between the image acquisition unit 310, the position relationship determination unit 320, the motion trajectory information determination unit 330, and the communication unit 340. That is, the control unit 350 can control the data flow from / to the outside of the simulator 300 or between the various components of the simulator 300 to perform their respective inherent functions in the image acquisition unit 310, the position relationship determination unit 320, the motion trajectory information determination unit 330, and the communication unit 340.

[0078] Figure 5 and Figure 6 This is a diagram illustrating, as an example, a scenario of performing a virtual golf simulation based on an embodiment of the present invention.

[0079] According to one embodiment of the present invention, it can be assumed that the first camera module 210 and the second camera module 220 are composed of a plurality of cameras 211, 212, 221, 222 (e.g., stereo cameras). Here, the first camera module 210 can be fixedly configured in a position facing the ground to photograph a golf ball, and the second camera module 220 can be fixedly configured on the front or side of the display unit 400 to photograph the display area of ​​the display unit 400 that displays information related to the golf ball.

[0080] refer to Figure 5 First, the first reference pattern section 510 can provide a predetermined pattern (i.e., the first reference pattern) and determine information related to the first reference pattern (specifically, the coordinates of each pattern within the first reference pattern) in the image captured by the first imaging module 210.

[0081] Subsequently, the configuration information of the first photography module 210 in a predetermined reference space coordinate system related to the first photography module 210 or the virtual golf simulation system (or simulator 300) can be determined based on the information related to the first reference pattern mentioned above.

[0082] Subsequently, the configuration information of the second camera module 220 in a predetermined reference space coordinate system related to the first camera module 210 or the virtual golf simulation system (or simulator 300) can be determined by analyzing the position and orientation of the second camera module 220 based on the image captured by the first camera module 210.

[0083] On the other hand, the position of the third reference pattern (specifically, the pattern provided by the third reference pattern section (not shown) arranged opposite to the second camera module 220 between the second camera module 220 and the display area) in the reference space coordinate system can be determined based on the image captured by the first camera module 210. The configuration information of the second camera module 220 can also be determined based on information related to the position of the third reference pattern and information related to the third reference pattern determined in the image captured by the second camera module 220 (e.g., the coordinates of each pattern in the third reference pattern).

[0084] Subsequently, a predetermined pattern (i.e., the second reference pattern) can be provided in the second reference pattern section 520, and information related to the second reference pattern can be determined in the image captured by the second imaging module 220.

[0085] Subsequently, the positional relationship between the coordinates determined in the second imaging module 220 and the coordinates determined in the display area can be determined based on information related to the second reference pattern (e.g., the coordinates of each pattern within the second reference pattern).

[0086] Subsequently, the positional relationship between the coordinates determined in the first camera module 210 and the coordinates determined in the display area can be determined by referring to the configuration information of the first camera module 210 and the configuration information of the second camera module 220, and the positional relationship between the coordinates determined in the second camera module 220 and the coordinates determined in the display area.

[0087] Subsequently, information related to the motion trajectory of the subject in the display area of ​​the display unit 400 can be determined based on the positional relationship between the coordinates determined in the first photography module 210 when the golfer hits the ball and the coordinates determined in the display area.

[0088] For example, refer to Figure 6 According to an embodiment of the present invention, the height and position 610, 620 of the ball's movement in the real world and the height and position 611, 621 of the ball's movement in the display area can be provided in a synchronized manner.

[0089] Figure 7 This diagram illustrates, exemplarily, a scenario where a virtual golf simulation is performed when multiple areas displaying golf ball-related information are present, according to an embodiment of the present invention.

[0090] When multiple areas displaying information related to golf balls are present according to an embodiment of the present invention (e.g., a multi-screen), a second reference pattern can be configured for each display area (or the entire display area) respectively (e.g., the same or different second reference patterns can be configured for each display), and the positional relationship between the coordinates determined in the first imaging module and the coordinates determined in the display area can be determined by referring to the various information related to the second reference pattern determined in the image captured by the second imaging module 220.

[0091] On the other hand, when the multiple display areas described above are curved, by interpolating the corresponding coordinates into curves on the curved surface, the positional relationship between the coordinates determined in the first imaging module and the coordinates determined in the display area can be determined more accurately.

[0092] The embodiments of the present invention described above can be implemented in the form of program instructions executable by various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may contain program instructions, data files, data structures, etc., individually or in combination. The program instructions recorded in the computer-readable recording medium may be program instructions specifically designed and configured for the present invention, or program instructions known to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floppy disks; and hardware devices specifically configured for storing and executing program instructions, such as ROMs, RAMs, and flash memory. Examples of program instructions may include not only machine language code produced by a compiler, but also high-level language code executable by a computer using an interpreter. The hardware device may be modified to perform processing based on the present invention by one or more software modules, and vice versa.

[0093] The present invention has been described above using specific constituent elements and other specific matters, as well as limited embodiments and accompanying drawings. However, this is only provided to help to understand the present invention more fully. The present invention is not limited to the described embodiments. Anyone skilled in the art to which the present invention pertains can make various modifications and changes based on such description.

[0094] Therefore, the concept of the present invention should not be limited to the embodiments described above, but should encompass not only the scope of the claims described below, but also all scopes that are equivalent to or modified by the equivalent claims.

Claims

1. A virtual golf simulation support method, which is a method for supporting a virtual golf simulation, the virtual golf simulation support method comprising the steps of: determining a positional relationship between coordinates determined in a first photographing module and coordinates determined in a display area, with reference to information about a first reference pattern determined in an image photographed by the first photographing module and information about a second reference pattern determined in an image photographed by a second photographing module, the first photographing module being configured to photograph a subject in motion, the second photographing module being configured to photograph the display area in which information about the subject is displayed; and determining information about a motion track of the subject in the display area, with reference to the positional relationship, wherein the display area being different from a real world area in which the subject is photographed, and wherein, in the positional relationship determining step, the positional relationship between the coordinates determined in the second photographing module and the coordinates determined in the display area is determined based on a correspondence relationship between a three-dimensional coordinate of each pattern within the second reference pattern determined with respect to the second photographing module and a two-dimensional coordinate of each pattern within the second reference pattern determined with respect to the display area.

2. The virtual golf simulation support method according to claim 1, wherein the first photographing module is fixed in a manner facing a ground.

3. The virtual golf simulation support method according to claim 1, wherein the first reference pattern is a pattern disposed on a ground, the second reference pattern is a pattern disposed on the display area.

4. The virtual golf simulation support method according to claim 1, wherein the positional relationship determining step includes the steps of: (a) a step of determining configuration information of the first photographing module with reference to the information about the first reference pattern and determining configuration information of the second photographing module with reference to information about a third reference pattern determined in the image photographed by the second photographing module; (b) a step of determining a positional relationship between the first photographing module and the second photographing module with reference to the configuration information of the first photographing module and the configuration information of the second photographing module; and (c) a step of determining a positional relationship between the coordinates determined in the first photographing module and the coordinates determined in the display area with reference to the positional relationship between the first photographing module and the second photographing module, the third reference pattern being a pattern disposed between the second photographing module and the display area.

5. The virtual golf simulation support method according to claim 4, wherein the (a) step includes a step of determining a position of the third reference pattern with reference to the image photographed by the first photographing module.

6. The virtual golf simulation support method according to claim 4, wherein the first reference pattern and the third reference pattern are disposed in one component.

7. The virtual golf simulation support method according to claim 1, wherein In the position relationship determining step, the attribute of the second reference pattern is dynamically determined with reference to information about the resolution of the display area.

8. A non-transitory computer-readable recording medium recording a computer program for executing the method according to claim 1.

9. A virtual golf simulation support system, which is a system for supporting a virtual golf simulation, the virtual golf simulation support system comprising: a position relationship determining section that determines a position relationship between coordinates determined in a first photographing module and coordinates determined in a display area with reference to information about a first reference pattern determined in an image captured by the first photographing module and information about a second reference pattern determined in an image captured by a second photographing module, the first photographing module being configured to capture a subject in motion, the second photographing module being configured to capture the display area that displays information about the subject; and a motion trajectory information determining section that determines information about a motion trajectory of the subject in the display area with reference to the position relationship, wherein the display area is different from a real-world area in which the subject is captured, and wherein the position relationship determining section is configured to determine the position relationship between the coordinates determined in the second photographing module and the coordinates determined in the display area based on a correspondence relationship between a three-dimensional coordinate of each pattern within the second reference pattern determined with respect to the second photographing module and a two-dimensional coordinate of each pattern within the second reference pattern determined with respect to the display area.

10. The virtual golf simulation support system according to claim 9, wherein the first photographing module is fixed in a manner facing the ground.

11. The virtual golf simulation support system according to claim 9, wherein the first reference pattern is a pattern disposed on the ground, the second reference pattern is a pattern disposed on the display area.

12. The virtual golf simulation support system according to claim 9, wherein the position relationship determining section determines configuration information of the first photographing module with reference to the information about the first reference pattern, determines configuration information of the second photographing module with reference to information about a third reference pattern determined in the image captured by the second photographing module, determines a position relationship between the first photographing module and the second photographing module with reference to the configuration information of the first photographing module and the configuration information of the second photographing module, and determines the position relationship between the coordinates determined in the first photographing module and the coordinates determined in the display area with reference to the position relationship between the first photographing module and the second photographing module, the third reference pattern is a pattern disposed between the second photographing module and the display area.

13. The virtual golf simulation support system according to claim 12, wherein the position relationship determining section determines the position of the third reference pattern with reference to the image captured by the first photographing module.

14. The virtual golf simulation support system according to claim 12, wherein the first reference pattern and the third reference pattern are arranged in one component.

15. The virtual golf simulation support system according to claim 9, wherein the positional relationship determining section dynamically determines the attribute of the second reference pattern with reference to information about the resolution of the display area.

Images