Information processing system, information processing device, information processing method
The system addresses the lack of richness in captured images during movements by using a dual-camera setup on a mobile object, adjusting capture based on position and action, resulting in clearer representations of players and their actions.
Patent Information
- Application Number
- JP2023122813
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-07-27
- Publication Date
- 2025-02-06
AI Technical Summary
Existing technologies, such as those described in Patent Document 1, fail to enhance the richness of captured images during movements, particularly in golf rounds and other actions involving movement, as they primarily focus on capturing images containing individuals without adequately representing the context of the action.
An information processing system with a first and second camera mounted on a mobile object, such as a golf cart, controlled by a device that adjusts image capture based on the position of the moving object and individual, using variable direction and zoom capabilities to capture richer images of the player and the action.
The system significantly enhances the fullness of captured images by ensuring that both the player and the action are clearly represented, improving the overall quality of recorded golf rounds and similar movements.
Smart Images

Figure 2025018804000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an information processing system, an information processing device, and an information processing method. [Background technology]
[0002] Patent Document 1 describes a method of filming a player's play during a golf round and creating a digest video of the play. Specifically, Patent Document 1 describes a method of mounting a 360-degree camera and a zoom camera on a golf cart, and creating a digest video by cutting out images from each video data shot by each camera. In particular, Patent Document 1 describes a method of creating a digest video by cutting out images from each video data so that people are included. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent Publication No. 2022-110177 Summary of the Invention [Problem to be solved by the invention]
[0004] However, in the technology described in the above-mentioned Patent Document 1, the images cut out from the images taken by the cameras mounted on the golf cart contain people, so it is not possible to record images that adequately depict the content of the golf play. This causes a problem that it is not possible to improve the quality of the captured images of the play during a golf round. In addition, it is not possible to improve the quality of the captured images of actions involving movement, not limited to the play during a golf round.
[0005] Therefore, an object of the present disclosure is to solve the above-mentioned problem of being unable to improve the quality of captured images of actions involving movement. [Means for solving the problem]
[0006] An information processing system according to an embodiment of the present disclosure includes: A first camera and a second camera mounted on a moving body that can move in response to a person moving and performing a predetermined action; a position detection device for detecting a position of the moving object; a control device for controlling image capture by the first camera and the second camera, The control device controls image capture by each of the first camera and the second camera based on a position of the moving object. The structure is as follows. In addition, an information processing device according to an embodiment of the present disclosure includes: An information processing device that controls image capture by a first camera and a second camera mounted on a moving body that can move in response to a person moving and performing a predetermined action, A position acquisition unit that acquires a position of the moving object; an imaging control unit that controls image capturing by each of the first camera and the second camera based on a position of the moving object; Equipped with The structure is as follows. In addition, an information processing method according to an embodiment of the present disclosure includes: Acquire the position of a moving body equipped with a first camera and a second camera, the moving body being capable of moving in response to a person moving and performing a predetermined action; controlling image capture by each of the first camera and the second camera based on a position of the moving object; The structure is as follows. In addition, a program according to an embodiment of the present disclosure includes: Acquire the position of a moving body equipped with a first camera and a second camera, the moving body being capable of moving in response to a person moving and performing a predetermined action; controlling image capture by each of the first camera and the second camera based on a position of the moving object; Have a computer carry out the process, The structure is as follows. Effect of the Invention
[0007] By being configured as described above, the present disclosure can improve the quality of captured images of actions involving movement. [Brief description of the drawings]
[0008] [Figure 1] FIG. 2 is a diagram showing a usage status of a first information processing system according to the present disclosure. [Diagram 2] 1 is a block diagram showing a configuration of a first information processing system according to the present disclosure. [Diagram 3] FIG. 2 is a diagram showing a process performed by a first information processing device according to the present disclosure. [Figure 4] FIG. 2 is a diagram showing a process performed by a first information processing device according to the present disclosure. [Diagram 5] FIG. 2 is a diagram showing a process performed by a first information processing device according to the present disclosure. [Figure 6] FIG. 2 is a diagram showing a process performed by a first information processing device according to the present disclosure. [Figure 7] 5 is a flowchart showing a processing operation of the first information processing device according to the present disclosure. [Figure 8] FIG. 2 is a block diagram showing a hardware configuration of a second information processing device according to the present disclosure. [Figure 9] FIG. 2 is a block diagram showing a configuration of a second information processing device according to the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] <Embodiment 1> The present disclosure will be described with reference to the drawings, which may be relevant to any of the embodiments.
[0010] [composition] The information processing system in this embodiment is a system used to capture images of a person playing golf. As shown in Fig. 1 and Fig. 2, the information processing system includes a first camera 21 and a second camera 22 installed on a golf cart C used on a golf course, and an information processing device 10 which is a control device that controls image capture by the first camera 21 and the second camera 22. Although the information processing device 10 is not shown in Fig. 1, the information processing device 10 is mounted at an arbitrary location on the golf cart C. However, the information processing device 10 is not necessarily limited to being mounted on the golf cart C, and may be connected to the golf cart C via a wireless network and installed at another location.
[0011] Here, the golf cart C is an electric cart used by a player P (person) playing golf on the golf course to move on the golf course. Therefore, the golf cart C moves along with the movement of the player P. However, the golf cart C is not necessarily required, and instead of the golf cart C, a moving body that can move according to the play of the player P, such as a hand cart or a caddy bag, may be used, and the first camera 21 and the second camera 22 described above may be mounted on such a moving body.
[0012] The first camera 21 and the second camera 22 mounted on the golf cart C are installed so that the shooting direction can be changed. For example, the first camera 21 and the second camera 22 are mounted on the golf cart C via a driving device that changes the shooting direction. The driving device is configured to rotate the first camera 21 and the second camera 22 by 360 degrees in the horizontal direction, and the shooting direction can be set to any direction. The driving device is also configured to rotate the first camera 21 and the second camera 22 to a predetermined angle in the vertical direction, that is, to change the elevation and depression angles of the first camera 21 and the second camera 22. For example, the driving device is configured to change the elevation and depression angles in the range from -90 degrees to +90 degrees based on the horizontal direction. The driving device is driven and controlled by the information processing device 10 described later, and the shooting directions of the first camera 21 and the second camera 22 are controlled accordingly.
[0013] The first camera 21 and the second camera 22 are installed so that the zoom magnification can be changed. At this time, the first camera 21 is equipped with a lens for close-up photography, and is further configured so that the zoom magnification can be changed to a range set for close-up photography. For example, the first camera 21 is configured so that the main photography range is from the golf cart C to the player P, and the zoom magnification can be changed to a range suitable for photography in a range of several meters to several tens of meters. On the other hand, the second camera 22 is equipped with a lens for long-distance photography so that it can photograph distances longer than the first camera 21, and is further configured so that the zoom magnification can be changed to a range set for long-distance photography. For example, the second camera 22 is configured so that the main photography range is from the golf cart C to the direction of the ball hit by the player P, as described later, and is further configured so that the zoom magnification can be changed to a range suitable for photography in a range of several tens of meters to one hundred or two hundred meters. The zoom magnifications of the first camera 21 and the second camera 22 are controlled by the information processing device 10, which will be described later.
[0014] The first camera 21 and the second camera 22 are configured so that image capture is controlled by the information processing device 10 described later, and the captured images are output to the information processing device 10. For example, the first camera 21 and the second camera 22 are configured so as to capture moving images, but may also be configured so as to capture still images. The first camera 21 and the second camera 22 are also equipped with microphones, and may record sound together with the images and output the sound to the information processing device 10.
[0015] Although not shown in Fig. 1, the golf cart C is equipped with a cart-side GPS device 23 such as a GPS (Global Positioning System) receiver shown in Fig. 2. The cart-side GPS device 23 receives signals from GPS satellites to determine the position of the cart itself, and notifies the information processing device 10 of the position information. However, the cart-side GPS device 23 may be composed of any device (position detection device) as long as it can detect its own position information.
[0016] Although not shown in Fig. 1, as shown in Fig. 2, the player P has a user terminal 30 such as a portable information processing terminal. The user terminal 30 is equipped with a user-side GPS device 31 such as a GPS (Global Positioning System) receiver. The user-side GPS device 31 receives signals from GPS satellites to measure the player's own position, and notifies the information processing device 10 of the position information by wireless communication. However, the user-side GPS device 31 may be composed of any device as long as it is capable of measuring its own position information.
[0017] Here, the above-mentioned information processing device 10 will be described in detail. The information processing device 10 is composed of one or more information processing devices each having a calculation device and a storage device. As shown in FIG. 2, the information processing device 10 includes a movement detection unit 11, a position acquisition unit 12, a shooting setting unit 13, and a shooting control unit 14. The functions of the movement detection unit 11, the position acquisition unit 12, the shooting setting unit 13, and the shooting control unit 14 can be realized by the calculation device executing a program for realizing each function stored in the storage device. The information processing device 10 also includes a course information storage unit 16 and an image storage unit 17. The course information storage unit 16 and the image storage unit 17 are composed of a storage device. Each component will be described in detail below.
[0018] The movement detection unit 11 has a function of detecting whether the golf cart C is moving or stopped. For example, the movement detection unit 11 detects the speed of the golf cart C, and when a non-zero speed equal to or greater than a certain value is continuously detected for a certain period of time or more, it detects that the golf cart C is moving, and when a zero speed is continuously detected for a certain period of time or more, it detects that the golf cart C is stopped. However, the movement detection unit 11 may detect the movement and stop of the golf cart C by any method, and may detect the movement and stop from a change in the drive state of the drive device of the golf cart C, or may detect the movement and stop from a change in the position information of the golf cart C, for example.
[0019] The position acquisition unit 12 has a function of acquiring position information of the golf cart C. For example, the position acquisition unit 12 acquires the position information of the golf cart C by acquiring position information measured by a cart-side GPS device 23 mounted on the golf cart C. In particular, the position acquisition unit 12 acquires the current position information of the golf cart C at the timing when the above-mentioned movement detection unit 11 detects that the golf cart C has stopped from a moving state, and passes it to the shooting setting unit 13. However, the position acquisition unit 12 may always acquire the position information of the golf cart C.
[0020] The position acquisition unit 12 also has a function of acquiring the position information of the player P described above. For example, the position acquisition unit 12 acquires the position information of the player P by acquiring the position information measured by the user side GPS device 31 mounted on the user terminal 30 carried by the player P. In particular, the position acquisition unit 12 acquires the current position information of the player P at the timing when the movement detection unit 11 detects that the golf cart C has stopped from a moving state, and passes it to the shooting setting unit 13. At this time, the position acquisition unit 12 may constantly acquire the position information of the player P for a certain period of time after the golf cart C has stopped, or until the golf cart C starts moving.
[0021] The photography setting unit 13 (photography control unit) performs photography control setting of the first camera 21 and the second camera 22 based on the position information of the golf cart C. Specifically, the photography setting unit 13 first checks whether the position information of the golf cart C acquired by the position acquisition unit 12 when the golf cart C stops as described above is a specific point that is a pre-registered position. In this embodiment, the specific point is the position of the tee ground 41 (teeing ground) and the position of the green 42 as shown in FIG. 1, and the position information of the tee ground set for each golf course and the position information representing the position of the green are stored and registered in advance in the course information storage unit 16 as the position information of the specific point. At this time, the registered position information is, for example, position information consisting of latitude and longitude corresponding to the cart stop position set around the tee ground and the green, but position information representing a predetermined range around the tee ground and the green may be registered.
[0022] Then, as described above, when the position information of the golf cart C matches the position information of the registered specific point, the photography setting unit 13 determines that the golf cart C is located at the specific point such as a tee ground or green. At this time, the photography setting unit 13 may determine that the golf cart C is located at the specific point not only when the position information of the golf cart C completely matches the position information of the specific point, but also when the position information is within a preset range of the position information of the specific point.
[0023] When the photography setting unit 13 determines that the golf cart C is located at a registered specific point, the photography control setting for the first camera 21 and the second camera 22 is set to a photography control setting that is preset corresponding to the specific point. At this time, the photography control setting is generated in advance based on the shape of the golf course and the specific point, and is stored in the course information storage unit 16 in association with the specific point for each golf course. As the photography control setting, a first photography control setting for the first camera 21 and a second photography control setting for the second camera 22 are prepared, and include setting values such as the photography direction and zoom magnification for each of the first camera 21 and the second camera 22. At this time, the photography direction includes an angle direction in the horizontal direction and an angle direction in the vertical direction. Note that a plurality of the above-mentioned specific points may be set. For example, a plurality of specific points may be set for the tee ground, and a plurality of specific points may be set for the green. In this case, a photography control setting may be prepared for each specific point. Then, at any time, such as at the start, one of the multiple specific locations is selected by player P or someone on the golf course, and the shooting control settings corresponding to the selected specific location are used.
[0024] Here, an example of a pre-registered photographing control setting will be described. When the specific point is a teeing ground, the first photographing control setting for the first camera 21 is set to a photographing direction and a zoom magnification that can photograph an image including the player P located on the teeing ground 41, as in the area between the dotted lines indicated by the symbol R1 in FIG. 3. In other words, when the golf cart C is located on the teeing ground, which is a specific point, the position and orientation of the teeing ground 41 relative to the position and orientation of the golf cart C are considered to be almost constant depending on the specific point, so in the first photographing control setting, the photographing direction is set in the direction from the golf cart C to the teeing ground 41, and the zoom magnification is set so that the player P located on the teeing ground 41 is in focus. Note that the photographing direction in the first photographing control setting is also set to a vertical angle that takes into account the height of the position of the golf cart C and the height of the position of the teeing ground.
[0025] In addition, as the second photography control setting for the second camera 22, a photography direction and a zoom magnification are set that enable the capture of an image of the ball hitting direction predicted by hitting the ball from the tee ground, that is, the green 42 and the pin 43 direction, as shown in the area between the dotted lines indicated by the symbol R2 in Fig. 3. In other words, when the golf cart C is located at the tee ground, which is a specific point, the position and orientation of the green 42 and the pin 43 relative to the position and orientation of the golf cart C are considered to be almost constant depending on the specific point, so in the second photography control setting, the photography direction is set to the predicted ball hitting direction, which is the direction from the golf cart C to the green 42, and the zoom magnification is set to a distance farther than the first camera so that the focus is on the green 42. Note that the photography direction in the second photography control setting also has a vertical angle set in consideration of the height of the position of the golf cart C and the height of the position in the direction of the green 42.
[0026] As an example of the preregistered photographing control settings, when the specific point is a green, the first photographing control setting for the first camera 21 is set to a photographing direction and zoom magnification that can photograph an image including the player P located on the green 42, as shown in the area between the dotted lines indicated by the reference symbol R1 in FIG. 5. The second photographing control setting for the second camera 22 is set to a photographing direction and zoom magnification that can photograph an image of the entire green 42 including the ball hitting direction expected by hitting the ball on the green 42, that is, the pin 43, as shown in the area between the dotted lines indicated by the reference symbol R2 in FIG. 5. Note that, when the golf cart C is located on the green, which is the specific point, the position and orientation of the green 42 relative to the position and orientation of the golf cart C are considered to be almost constant depending on the specific point. For this reason, in the first photographing control setting, the photographing direction is set in the direction from the golf cart C located on the green 42 toward the green 42, and the zoom magnification is set so that the player P located on the green 42 is in focus. In the second photography control setting, the photography direction is set in the direction facing the green 42 from the golf cart C, and the zoom magnification is set at a distance farther than the first camera so as to be able to photograph the entire green 42. Note that the photography directions in the first photography control setting and the second photography control setting are also set with a vertical angle taking into consideration the height of the position of the golf cart C and the height of the position of the green 42.
[0027] The photography control unit 14 controls the first camera 21 and the second camera 22 to take images based on the photography control settings that are preset according to specific points such as the tee ground 41 and the green 42 as described above. As a result, the first camera 21 can take images that mainly show the player P, and the second camera 22 can take images mainly in the direction of the hit ball. Note that the second camera 22 may also take an image of the player P. The photography control unit 14 then acquires the images taken by the first camera 21 and the second camera 22, and stores them in the image storage unit 17.
[0028] In the above, the specific points are the tee ground 41 and the green 42, but other points on the golf course may be the specific points. For example, a bunker or a special tee may be the specific point, and position information and photography control settings corresponding to such points may be registered in advance, as described above.
[0029] Here, the photography control setting by the photography setting unit 13 will be described when the position where the golf cart C stops is not a specific point that is a pre-registered position, that is, in this embodiment, when it is not a tee ground or green. In this case, the photography setting unit 13 first acquires the position information of the player P acquired by the position acquisition unit 12 as described above, in addition to the position information of the golf cart C. The photography setting unit 13 also acquires the position information of the pin 43 of the current golf course that is stored in the course information storage unit 16 and registered in advance.
[0030] Then, the photographing setting unit 13 performs a first photographing control setting for the first camera 21 based on the position information of the golf cart C and the position information of the player P. Specifically, the photographing setting unit 13 calculates the direction and distance from the golf cart C to the player P from the position information of two points, the golf cart C and the player P, sets the calculated direction as the photographing direction, and sets the zoom magnification based on the calculated distance. As a result, as the first photographing control setting for the first camera 21, a photographing direction and a zoom magnification that can photograph an image including the player P are set, as in the area sandwiched between the dotted lines indicated by the symbol R1 in FIG. 4. At this time, the photographing direction is set with a vertical angle taking into account the height of the position of the golf cart C and the height of the position of the player P. For example, the information processing device 10 stores three-dimensional map data of the golf course, so that the photographing setting unit 13 can specify the height of each position of the golf cart C and the player P and can set the vertical angle.
[0031] Further, the photographing setting unit 13 performs a second photographing control setting for the second camera 22 based on the position information of the golf cart C and the position information of the pin 43. Specifically, the photographing setting unit 13 calculates the direction and distance from the golf cart C to the pin 43 from the position information of two points, the golf cart C and the pin 43, sets the calculated direction as the photographing direction, and sets the zoom magnification based on the calculated distance. As a result, as the second photographing control setting for the second camera 22, a photographing direction and a zoom magnification that can photograph an image of the ball hitting direction expected by the player P when hitting the ball, that is, the green 42 and the pin 43 direction, are set, as in the area sandwiched between the dotted lines indicated by the symbol R2 in FIG. 4. At this time, the photographing direction is set with a vertical angle considering the height of the position of the golf cart C and the height of the position of the pin 43. For example, the information processing device 10 stores three-dimensional map data of the golf course, so that the photographing setting unit 13 can specify the height of each position of the golf cart C and the pin 43 and can set the vertical angle.
[0032] In addition, for the second photography control setting for the second camera 22, the photography setting unit 13 may first calculate the position of an intermediate point, such as a midpoint between the golf cart C and the pin 43, from the position information of two points, the golf cart C and the pin 43, calculate the direction and distance from the golf cart C to the intermediate point, set the calculated direction as the photography direction, and set the zoom magnification based on the calculated distance. At this time, the calculation of the intermediate point may be performed using the overall shape and position information of the golf course. In other words, the photography setting unit 13 may calculate an intermediate point along the shape of the fairway, rather than a intermediate point on a straight line distance from the position of the golf cart C to the position of the pin 43.
[0033] In addition, in the above description, the photography setting unit 13 uses the position information of two points, the golf cart C and the pin 43, when performing the second photography control setting for the second camera 22, but instead of the position information of the pin 43, position information of other pre-registered positions on the golf course may be used. For example, when position information of specific positions such as stakes for indicating distances, bunkers, and ponds located in the direction of travel of the player P is pre-stored in the course information storage unit 16, the second photography control setting may be performed using such position information.
[0034] Here, another example of the photography control setting by the photography setting unit 13 will be described when the position where the golf cart C stops is not a specific point that is a pre-registered position, that is, in this embodiment, is not a tee ground or green. Even if the position information of the golf cart C does not match the position information of the specific point, if the difference is within a pre-set range, the photography setting unit 13 determines that the golf cart C is located near the specific point, that is, near the tee ground 41 or the green 42. Then, the photography setting unit 13 acquires an image of the surroundings of the golf cart C taken from at least one of the first camera 21 and the second camera 22 via the photography control unit 14, and detects the specific position, which is the tee ground or the green, from the image. At this time, the photography setting unit 13 detects the position of the tee ground 41, the green 42, or the pin 43, for example, by detecting a tee marker of the tee ground 41 from the image or detecting the pin 43 of the green 42 from the image. As an example, the photography setting unit 13 detects the shapes of tee markers and pins from an image taken by any of the cameras 21, 22 by using template matching against data in which the shapes of tee markers and pins are registered in advance, or a method using a model in which the positions of tee markers and pins in an image are learned. However, the photography setting unit 13 is not necessarily limited to detecting the positions of tee markers and pins from an image, and may detect the tee ground itself or the green itself from the characteristics of its shape.
[0035] Then, based on the position of the golf cart C and the detected position of the tee ground 41, the photography setting unit 13 performs photography control setting so that the first camera 21 photographs the tee ground 41 from the golf cart C, and performs photography control setting so that the second camera 22 photographs the direction of the pin 43. Also, based on the position of the golf cart C and the detected position of the pin 43, the photography setting unit 13 performs photography control setting so that the first camera 21 photographs the green 42 from the golf cart C, and performs photography setting so that the second camera 22 photographs the entire green 42. In the above case, the photography setting unit 13 may detect the position of the player P, and perform photography control setting so that the first camera 21 photographs the direction and distance of the player P based on the position of the golf cart C and the position of the player P.
[0036] Here, an example of the photography control setting using the position of the golf cart C and the position of the player P by the photography setting unit 13 described above will be described with reference to Fig. 6. The photography setting unit 13 periodically acquires position information (GPS information) of the golf cart in order to confirm the traveling direction of the golf cart. Here, it is known that the position changes as the golf cart moves, and the angle of the traveling direction with respect to the north can be confirmed from the changes in the position information of two points (points A and B) in the past and present, using the following formula 1. Note that point A is (longitude x1, latitude y1) and point B is (longitude x2, latitude y2).
number
[0037] In Figure 6, players Px (x=a, b) are at angles (Δφ_cart+Δφ_Pa) and (Δφ_cart+Δφ_Pb) with respect to the direction of travel of the golf cart, and are separated by distances Dis_a and Dis_b. It is known that the distance can be confirmed by the following formula 2.
number
[0038] The angles Δφ_Pa and Δφ_Pb from the north direction can be calculated using the position information of the golf cart and the position information (GPS information) of the information processing terminals carried by each of the players Pa and Pb in the above-mentioned formula 1. Then, by adjusting the direction of the first camera 21 mounted on the golf cart C according to the above-mentioned angles (Δφ_cart+Δφ_Pa) and (Δφ_cart+Δφ_Pb) and adjusting the zoom magnification according to the above-mentioned distances Dis_a and Dis_b, the players Pa and Pb can be captured in the captured image.
[0039] [Operation] Next, a description will be given of the operation of the above-mentioned information processing device 10. In the following, for example, a case where a player P plays on a golf course set to par 4 or par 5 will be described.
[0040] First, a case where the player P takes a tee shot will be described. The information processing device 10 acquires the position information of the golf cart C, and when it detects that the golf cart C is not yet located at the tee ground of the golf course, it detects the speed of the golf cart C and detects that the golf cart C has stopped from a moving state (step S1 in FIG. 7). Then, the information processing device 10 acquires the position information of the golf cart C and checks whether it is a registered position (step S2 in FIG. 7). At this time, when the position information of the golf cart C is the position of the tee ground, which is a registered position (Yes in step S2 in FIG. 7), the shooting control setting that is preset corresponding to the tee ground is set as the shooting control setting of the first camera 21 and the second camera 22 (step S3 in FIG. 7). For example, as the shooting control setting for the first camera 21, a shooting direction and a zoom magnification that can shoot an image including the player P located at the tee ground 41, such as the area sandwiched between the dotted lines indicated by the symbol R1 in FIG. 3, are set. In addition, the shooting control settings for the second camera 22 are set to a shooting direction and zoom magnification that enables capture of an image of the predicted ball hitting direction, i.e., the direction of the green 42 and the pin 43, when hitting the ball from the tee, as in the area enclosed by the dotted lines indicated by symbol R2 in Figure 3.
[0041] Then, the information processing device 10 controls the first camera 21 and the second camera 22 to capture images based on the photography control settings preset according to the above-mentioned tee ground 41 (step S7 in FIG. 7). This allows the first camera 21 to capture an image of the player P, and the second camera 22 to capture an image in the direction of the hit ball. The information processing device 10 stores the captured images in the image storage unit 17.
[0042] Thereafter, the information processing device 10 detects the speed of the golf cart C and continues to capture images until it starts moving from a stopped state (No in step S8 in FIG. 7). Then, when the information processing device 10 detects the speed of the golf cart C and detects that it has started moving from a stopped state (Yes in step S8 in FIG. 7), it stops capturing images (step S9 in FIG. 7). This ends the capturing of images of the tee shot of player P by the first camera 21 and the second camera 22.
[0043] Here, a case will be described where the golf cart C is not stopped at the teeing ground, which is the registered position, when the player P takes a tee shot (No in step S2). When the position information of the golf cart C is within a preset range from the position of the teeing ground, the information processing device 10 determines that the golf cart C is located near the teeing ground 41. Then, the information processing device 10 acquires an image of the surroundings of the golf cart C taken from at least one of the first camera 21 and the second camera 22, and detects the teeing ground from within the image (Yes in step S4 of FIG. 7). For example, the information processing device 10 detects the tee marker of the teeing ground 41 from within the image, and detects the position of the teeing ground 41. Then, based on the position of the golf cart C and the detected position of the teeing ground 41, the information processing device 10 performs shooting control setting so that the first camera 21 shoots the teeing ground 41 from the golf cart C, and performs shooting control setting so that the second camera 22 shoots the direction of the pin 43 (step S5 in FIG. 7). At this time, the information processing device 10 may set the shooting control of the first camera 21 based on the position of the golf cart C and the detected position of the player P. Then, the information processing device 10 controls the first camera 21 and the second camera 22 to shoot images based on the set shooting control setting (step S7 in FIG. 7). This allows the first camera 21 to shoot an image of the player P, and the second camera 22 to shoot an image in the direction of the ball. The information processing device 10 stores the captured images in the image storage unit 17. Note that the detection of the position of the tee ground 41 described above may be performed by other methods without using images. As an example, the information processing device 10 may receive radio waves from a transmitting device installed at the tee marker and detect the receiving direction of the radio waves as the position of the tee marker.
[0044] Next, a case where player P takes a second shot after a tee shot will be described. The information processing device 10 detects the speed of golf cart C, which is in a moving state after player P's tee shot, and detects that it has stopped from a moving state (step S1 in FIG. 7). Then, the information processing device 10 acquires the position information of golf cart C, and if it is not a registered position (No in step S2 in FIG. 7), unlike the above, the tee ground cannot be detected from the image, and it is determined that golf cart C is not located around the tee ground (No in step S4 in FIG. 7), the information processing device 10 performs the shooting control setting of first camera 21 and second camera 22 as follows (step S6 in FIG. 7).
[0045] Specifically, the information processing device 10 first acquires the position information of the player P from the user terminal 30 in addition to the position information of the golf cart C, and further acquires the position information of the pins 43 of the golf course stored in the course information storage unit 16. Then, the information processing device 10 performs shooting control setting for the first camera 21 based on the position information of the golf cart C and the position information of the player P. For example, the information processing device 10 calculates the direction and distance from the golf cart C to the player P from the position information of two points, the golf cart C and the player P, sets the calculated direction as the shooting direction, and sets the zoom magnification based on the calculated distance. As a result, as the first shooting control setting for the first camera 21, a shooting direction and a zoom magnification that can shoot an image including the player P are set, as in the area sandwiched between the dotted lines indicated by the symbol R1 in FIG. 4. Also, the information processing device 10 performs shooting control setting for the second camera 22 based on the position information of the golf cart C and the position information of the pins 43. For example, the information processing device 10 calculates the direction and distance from the golf cart C to the pin 43 from the position information of two points, the golf cart C and the pin 43, sets the calculated direction as the shooting direction, and sets the zoom magnification based on the calculated distance. As a result, as the shooting control setting for the second camera 22, a shooting direction and zoom magnification that can capture an image of the ball hitting direction expected by the player P when hitting the ball, that is, the green 42 and the pin 43 direction, as shown in the area between the dotted lines indicated by the symbol R2 in Fig. 4, are set. Note that in the case of a par 5 golf course, as the shooting control setting for the second camera 22, the position of an intermediate point such as a midpoint between the golf cart C and the pin 43 may be calculated, the direction and distance from the golf cart C to the intermediate point may be calculated, the calculated direction may be set as the shooting direction, and the zoom magnification may be set based on the calculated distance.
[0046] Then, based on the shooting control settings set as described above, the information processing device 10 controls the first camera 21 and the second camera 22 to capture images (step S7 in FIG. 7). As a result, the first camera 21 can capture an image of the player P, and the second camera 22 can capture an image in the direction of the hit ball. The information processing device 10 stores the captured images in the image storage unit 17.
[0047] Thereafter, the information processing device 10 detects the speed of the golf cart C and continues to capture images until it starts moving from a stopped state (No in step S8 in FIG. 7). Then, when the information processing device 10 detects the speed of the golf cart C and detects that it has started moving from a stopped state (Yes in step S8 in FIG. 7), it stops capturing images (step S9 in FIG. 7). This ends the capturing of images of the second shot of player P by the first camera 21 and the second camera 22.
[0048] The above-mentioned process for the player P taking the second shot is repeated until the golf cart C is positioned on the green. In other words, until the golf cart C is positioned on the green, an image of the player P taking the shot is taken every time the golf cart C stops.
[0049] Next, a case where the player P performs an approach shot around the green or putts on the green will be described. The information processing device 10 detects the speed of the golf cart C in a moving state and detects that it has stopped from a moving state (step S1 in FIG. 7). Then, the information processing device 10 acquires the position information of the golf cart C, and if it is a registered position such as the green (Yes in step S2 in FIG. 7), the shooting control setting that is preset corresponding to the green is set as the shooting control setting of the first camera 21 and the second camera 22 (step S3 in FIG. 7). For example, as the shooting control setting for the first camera 21, a shooting direction and a zoom magnification that can capture an image including the player P located on the green 42, as in the area sandwiched between the dotted lines indicated by the reference symbol R1 in FIG. 5, are set. Also, as the shooting control setting for the second camera 22, a shooting direction and a zoom magnification that can capture an image of the entire green 42 including the ball hitting direction expected by hitting the ball on the green 42, that is, the pin 43, are set as in the area sandwiched between the dotted lines indicated by the reference symbol R2 in FIG. 5.
[0050] Then, the information processing device 10 controls the first camera 21 and the second camera 22 to capture images based on the photography control settings that have been preset according to the above-mentioned green 42 (step S7 in FIG. 7). This allows the first camera 21 to capture an image showing the player P, and the second camera 22 to capture an image including the entire green in the direction of the ball. The information processing device 10 stores the captured images in the image storage unit 17.
[0051] Thereafter, the information processing device 10 detects the speed of the golf cart C and continues to capture images until it starts moving from a stopped state (No in step S8 in FIG. 7). Then, when the information processing device 10 detects the speed of the golf cart C and detects that it has started moving from a stopped state (Yes in step S8 in FIG. 7), it stops capturing images (step S9 in FIG. 7). This ends the capturing of images around or on the green by the first camera 21 and the second camera 22.
[0052] Here, a case will be described where the position where the golf cart C stops when the player P approaches or putts is not the green, which is the registered position (No in step S2). When the position information of the golf cart C is within a preset range from the position of the green, the information processing device 10 determines that the golf cart C is located near the green. Then, the information processing device 10 acquires an image of the surroundings of the golf cart C taken from at least one of the first camera 21 and the second camera 22, and detects the pin on the green from the image (Yes in step S4 in FIG. 7). For example, the information processing device 10 detects the pin from the image and detects the position of the green or the pin 43. Then, based on the position of the golf cart C, the detected position of the green or the pin, and the position of the player P, the information processing device 10 performs shooting control setting so that the first camera 21 shoots the player P from the golf cart C, and performs shooting control setting so that the second camera 22 shoots the green (step S5 in FIG. 7). Then, the information processing device 10 controls the first camera 21 and the second camera 22 to capture images based on the set shooting control settings (step S7 in FIG. 7). As a result, the first camera 21 can capture an image of the player P, and the second camera 22 can capture an image of the ball hitting direction, such as on the green, and the information processing device 10 stores the captured images in the image storage unit 17. Note that this image capture ends when the golf cart C starts moving (Yes in step S8, step S9 in FIG. 7).
[0053] As described above, in this embodiment, the shooting control settings are automatically made so that the first camera 21 takes an image of the player P and the second camera 22 takes an image of the ball hitting direction according to the position of the golf cart C. In this way, since not only an image of the player P but also an image of the ball hitting direction are taken, the quality of the captured images of the play during the golf round can be improved.
[0054] Although the above describes taking images of play during a golf round, the above information processing system can be applied not only to golf but also to image taking for actions involving movement. For example, in an activity in which a player P moves and stops to perform an action such as playing, the above-mentioned first camera 21 and second camera 22 can be mounted on a moving object that moves with the player P, and further, the above-mentioned information processing device 10 can detect the position of the moving object and the position of the player P and control image taking by the first camera 21 and the second camera 22 according to the position.
[0055] <Embodiment 2> Next, a second embodiment of the present disclosure will be described with reference to the drawings. In this embodiment, the outline of the configuration of the information processing device described in the above embodiment is shown. Note that Figs. 8 to 9 are diagrams for explaining the configuration, and these drawings may be related to any of the embodiments.
[0056] First, the hardware configuration of the information processing device 100 will be described with reference to Fig. 8. The information processing device 100 is configured as a general information processing device, and is equipped with the following hardware configuration, as an example. ·CPU(Central Processing Unit)101(Arithmetic unit) ROM (Read Only Memory) 102 (storage device) RAM (Random Access Memory) 103 (storage device) · Programs 104 loaded into RAM 103 A storage device 105 for storing a program group 104 A drive device 106 that reads and writes data from a storage medium 110 external to the information processing device A communication interface 107 for connecting to a communication network 111 outside the information processing device Input / output interface 108 for inputting and outputting data Bus 109 connecting each component
[0057] 8 shows an example of the hardware configuration of the information processing device which is the information processing device 100, and the hardware configuration of the information processing device is not limited to the above-mentioned case. For example, the information processing device may be configured with a part of the above-mentioned configuration, such as not having the drive device 106. Furthermore, the information processing device may use a GPU (Graphic Processing Unit), a DSP (Digital Signal Processor), an MPU (Micro Processing Unit), an FPU (Floating point number Processing Unit), a PPU (Physics Processing Unit), a TPU (Tensor Processing Unit), a quantum processor, a microcontroller, or a combination thereof, instead of the above-mentioned CPU.
[0058] The information processing device 100 can be equipped with a position acquisition unit 121 and an imaging control unit 122 shown in Fig. 9 by the CPU 101 acquiring the program group 104 and executing it. The program group 104 is stored in the storage device 105 or the ROM 102 in advance, for example, and the CPU 101 loads the program group 104 into the RAM 103 and executes it as necessary. The program group 104 may be supplied to the CPU 101 via the communication network 111, or may be stored in the storage medium 110 in advance, and the drive device 106 may read out the program and supply it to the CPU 101. However, the position acquisition unit 121 and the imaging control unit 122 described above may be constructed of dedicated electronic circuits for realizing such means.
[0059] The position acquisition unit 121 acquires the position of a moving object equipped with a first camera and a second camera and capable of moving in response to a person moving and performing a predetermined action. The photographing control unit 122 controls image photographing by the first camera and the second camera, respectively, based on the position of the moving object.
[0060] With the above-described configuration, the present disclosure controls image capture by the first camera and the second camera based on the position of the moving object. This allows the first camera and the second camera to capture various images according to the position of the moving object, thereby improving the quality of captured images for actions involving movement.
[0061] At least one or more of the functions of the above-mentioned position acquisition unit 121 and shooting control unit 122 may be executed by an information processing device installed and connected anywhere on the network, that is, they may be executed by so-called cloud computing.
[0062] The above-mentioned program can be stored and provided to a computer using various types of non-transitory computer readable media. The non-transitory computer readable medium includes various types of tangible storage media. Examples of the non-transitory computer readable medium include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROM (Read Only Memory), CD-R, CD-R / W, and semiconductor memory (e.g., mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). The program may be provided to a computer by various types of transitory computer readable media. Examples of the transitory computer readable medium include electric signals, optical signals, and electromagnetic waves. The transitory computer readable medium can provide the program to a computer via a wired communication path such as an electric wire and an optical fiber, or via a wireless communication path.
[0063] Although the present disclosure has been described above with reference to the above-mentioned embodiments, the present disclosure is not limited to the above-mentioned embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each of the above-mentioned embodiments can be appropriately combined with other embodiments.
[0064] <Additional Notes> A part or all of the above-described embodiments may be described as follows: Below, an overview of the configurations of an information processing device, an information processing method, and a program according to the present disclosure will be described. However, the present disclosure is not limited to the following configurations. (Appendix 1) A first camera and a second camera mounted on a moving body that can move in response to a person moving and performing a predetermined action; a position detection device for detecting a position of the moving object; a control device for controlling image capture by the first camera and the second camera, The control device controls image capture by each of the first camera and the second camera based on a position of the moving object. Information processing system. (Appendix 2) 2. An information processing system according to claim 1, The control device performs a shooting control setting including a shooting direction and a zoom magnification of each of the first camera and the second camera based on a position of the moving body, and controls image shooting by each of the first camera and the second camera based on the shooting control setting. Information processing system. (Appendix 3) 3. An information processing system according to claim 2, The control device controls the first camera to capture an image including the person, and controls the second camera to capture an image in a direction expected in accordance with the movement of the person, based on a position of the moving object. Information processing system. (Appendix 4) 3. An information processing system according to claim 2, The control device controls the first camera to capture an image including the person playing golf on the golf course based on a position of the moving object moving on the golf course, and controls the second camera to capture an image of an expected direction of a ball hit associated with the person playing golf. Information processing system. (Appendix 5) 5. The information processing system according to claim 4, When the moving object is located at a predetermined specific point, the control device controls the first camera to capture an image including the person based on a first photography control setting set corresponding to the specific point, and controls the second camera to capture an image in the direction of the ball based on a second photography control setting set corresponding to the specific point. Information processing system. (Appendix 6) 5. The information processing system according to claim 4, The control device acquires a position of the person, and controls the first camera to capture an image including the person based on the position of the moving object and the position of the person. Information processing system. (Appendix 7) 5. The information processing system according to claim 4, The control device controls the second camera to capture an image of the ball hitting direction based on a position of the moving object and a specific position registered in advance on the golf course. Information processing system. (Appendix 8) 5. The information processing system according to claim 4, the control device detects a predetermined specific position on the golf course based on an image captured by at least one of the first camera and the second camera, performs the image capture control setting for each of the first camera and the second camera based on the position of the moving object and the specific position, and controls image capture by each of the first camera and the second camera based on the image capture control setting. Information processing system. (Appendix 8.1) 3. An information processing system according to claim 2, The imaging direction includes an angular direction in a horizontal direction and an angular direction in a vertical direction. Information processing system. (Appendix 8.2) 2. An information processing system according to claim 1, the first camera is a close-up camera, The second camera is a long-distance camera. Information processing system. (Appendix 9) An information processing device that controls image capture by a first camera and a second camera mounted on a moving body that can move in response to a person moving and performing a predetermined action, A position acquisition unit that acquires a position of the moving object; an imaging control unit that controls image capturing by each of the first camera and the second camera based on a position of the moving object; An information processing device comprising: (Appendix 10) Acquire the position of a moving body equipped with a first camera and a second camera, the moving body being capable of moving in response to a person moving and performing a predetermined action; controlling image capture by each of the first camera and the second camera based on a position of the moving object; Information processing methods. (Appendix 11) Acquire the position of a moving body equipped with a first camera and a second camera, the moving body being capable of moving in response to a person moving and performing a predetermined action; controlling image capture by each of the first camera and the second camera based on a position of the moving object; A program that causes a computer to carry out processing. [Explanation of symbols]
[0065] 10. Information processing device 11 Movement detection unit 12 Position acquisition part 13 Shooting Settings 14. Shooting control section 16 Course information storage section 17 Image storage section 21 First Camera 22 Second Camera 23 Cart GPS device 30 User terminals 31 User GPS device 100 Information processing device 101 CPU 102 ROM 103 RAM 104 Programs 105 Storage device 106 Drive device 107 Communication Interface 108 Input / Output Interface 109 Bus 110 Storage medium 111 Communication Network 121 Position acquisition part 122 Shooting control section
Claims
1. A first camera and a second camera mounted on a moving body that can move in response to a person moving and performing a predetermined action; a position detection device for detecting the position of the moving object; a control device for controlling image capture by the first camera and the second camera, The control device controls image capture by each of the first camera and the second camera based on a position of the moving object. Information processing system.
2. 2. The information processing system according to claim 1, The control device performs a shooting control setting including a shooting direction and a zoom magnification of each of the first camera and the second camera based on a position of the moving body, and controls image shooting by each of the first camera and the second camera based on the shooting control setting. Information processing system.
3. 3. The information processing system according to claim 2, The control device controls the first camera to capture an image including the person, and controls the second camera to capture an image in a direction expected in accordance with the movement of the person, based on a position of the moving object. Information processing system.
4. 3. The information processing system according to claim 2, The control device controls the first camera to capture an image including the person playing golf on the golf course based on a position of the moving object moving on the golf course, and controls the second camera to capture an image of an expected direction of a ball hit associated with the person playing golf. Information processing system.
5. 5. The information processing system according to claim 4, When the moving object is located at a predetermined specific point, the control device controls the first camera to capture an image including the person based on a first photography control setting set corresponding to the specific point, and controls the second camera to capture an image in the direction of the ball based on a second photography control setting set corresponding to the specific point. Information processing system.
6. 5. The information processing system according to claim 4, The control device acquires a position of the person, and controls the first camera to capture an image including the person based on the position of the moving object and the position of the person. Information processing system.
7. 5. The information processing system according to claim 4, The control device controls the second camera to capture an image of the ball hitting direction based on a position of the moving object and a specific position registered in advance on the golf course. Information processing system.
8. 5. The information processing system according to claim 4, the control device detects a predetermined specific position on the golf course based on an image captured by at least one of the first camera and the second camera, performs the image capture control setting for each of the first camera and the second camera based on the position of the moving object and the specific position, and controls image capture by each of the first camera and the second camera based on the image capture control setting. Information processing system.
9. An information processing device that controls image capture by a first camera and a second camera mounted on a moving body that can move in response to a person moving and performing a predetermined action, A position acquisition unit that acquires a position of the moving object; an imaging control unit that controls image capturing by each of the first camera and the second camera based on a position of the moving object; An information processing device comprising:
10. Acquire the position of a moving body equipped with a first camera and a second camera, the moving body being capable of moving in response to a person moving and performing a predetermined action; controlling image capture by each of the first camera and the second camera based on a position of the moving object; Information processing methods.
Citation Information
Patent Citations
Golf digest creation system, mobile photography unit, and digest creation device
JP2022110177A