Display method, imaging device, and program

Abstract

To provide a technique capable of adjusting the positional relationship between a person or a golf ball as a subject on a photographed image and a target for hitting the golf ball to an appropriate state when photographing a golf swing motion.SOLUTION: A camera 100 according to an embodiment of the present disclosure includes a display unit 120 that displays a live view image 31 and also superimposes an auxiliary image 33 on the live view image 31 to guide the camera 100, at least one of the subject person and the golf ball, and the target for hitting the golf ball to a predetermined state.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present disclosure relates to a display method and the like. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is known a technique for imaging devices that displays an auxiliary image for assisting in shooting by superimposing it on a live view image of an imaging range that allows shooting while viewing the screen.

[0003] For example, Patent Document 1 discloses displaying guidelines on a live view image to assist in determining the composition of a subject. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Application No. 2022-006256 Summary of the Invention [Problem to be solved by the invention]

[0005] By the way, there are cases where a golf swing of a person is photographed and the golf swing is analyzed or diagnosed. In this case, if the positional relationship between the person or golf ball on the photographed image and the target position of the golf ball varies each time, the golf swing is seen differently, and it may not be possible to appropriately analyze or diagnose the golf swing.

[0006] In view of the above problems, an object of the present invention is to provide a technology that, when photographing a golf swing, can appropriately adjust the positional relationship between the subject person or golf ball in the photographed image and the target for the golf ball to be hit. [Means for solving the problem]

[0007] In order to achieve the above object, in one embodiment of the present disclosure, a live view image is displayed on a display unit of an imaging device, and an auxiliary image is displayed on the display unit, the auxiliary image superimposed on the live view image, the auxiliary image guiding a user to adjust a relative positional relationship between the imaging device, at least one of the person and the golf ball as a subject, and a target for hitting the golf ball to a predetermined state; A display method is provided.

[0008] In another embodiment of the present disclosure, a display unit that displays a live view image and also displays an auxiliary image superimposed on the live view image, the auxiliary image providing guidance for adjusting the relative positional relationship between the imaging device, at least one of the person and the golf ball as a subject, and a target for hitting the golf ball to a predetermined state; An imaging device is provided.

[0009] In still another embodiment of the present disclosure, In the information processing device, a step of displaying a live view image on a display unit of an imaging device and superimposing an auxiliary image on the live view image, the auxiliary image guiding a user to adjust a relative positional relationship between the imaging device, at least one of a person as a subject and a golf ball, and a target for hitting the golf ball to a predetermined state, on the display unit; The program is provided. Effect of the Invention

[0010] According to the above-described embodiment, when a golf swing motion is photographed, the positional relationship between the subject person or golf ball and the target for hitting the golf ball in the photographed image can be adjusted to an appropriate state. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 illustrates an example of a swing diagnosis system. [Diagram 2] FIG. 2 is a diagram showing an example of an image captured by a camera. [Diagram 3] FIG. 2 is a diagram showing a first example of a screen of a display unit of the camera. [Figure 4] FIG. 2 is a diagram showing an example of the relationship between a golf swing trajectory and a target position for hitting a golf ball. [Diagram 5] FIG. 11 is a diagram showing another example of the relationship between a golf swing trajectory and a target position for hitting a golf ball. [Figure 6] FIG. 11 is a diagram showing yet another example of the relationship between a golf swing trajectory and a target position for hitting a golf ball. [Figure 7] FIG. 13 is a diagram showing a second example of the screen of the display unit of the camera. [Figure 8] FIG. 13 is a diagram showing a third example of the screen of the display unit of the camera. [Figure 9] FIG. 13 is a diagram showing a fourth example of the screen of the display unit of the camera. [Figure 10] FIG. 13 is a diagram showing a fifth example of the screen of the display unit of the camera. [Figure 11] FIG. 13 is a diagram showing a sixth example of the screen of the display unit of the camera. [Figure 12] FIG. 13 is a diagram showing a seventh example of the screen of the display unit of the camera. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an embodiment will be described with reference to the drawings.

[0013] [Swing diagnosis system overview] An overview of a swing diagnosis system 1 according to the present embodiment will be described with reference to FIGS.

[0014] Fig. 1 is a diagram showing an example of a swing diagnosis system 1. Fig. 2 is a diagram showing an example of an image captured by the camera 100 (captured image 20).

[0015] As shown in FIG. 1, the swing diagnosis system 1 includes a camera 100, a user terminal 200, and an information processing device 300.

[0016] The swing diagnosis system 1 performs a diagnosis of a user's golf swing motion (hereinafter, "swing diagnosis") in the information processing device 300 based on video data captured by the camera 100, which captures the user's golf swing motion. The swing diagnosis is performed automatically, for example, according to a predetermined evaluation index acquired from the video data. Alternatively, the swing diagnosis may be performed manually by a predetermined evaluator (for example, a golf lesson pro) viewing the video data and operating the information processing device 300 based on the predetermined evaluation index. The swing diagnosis system 1 then provides the user with the results of the swing diagnosis via the user terminal 200.

[0017] Camera 100 captures an image of a golf swing by a user and acquires a video showing the swing motion. Camera 100 may acquire the video of the user's golf swing in response to the operation of a photographer different from the user who performs the golf swing, or may acquire the video of the user's golf swing in response to the operation of the user using a self-timer function or the like.

[0018] In this specification, "imaging" refers to obtaining an image showing the surroundings of the camera 100, and "photographing" refers to recording the image obtained by imaging.

[0019] 1, the camera 100 and the user terminal 200 are depicted separately, but the camera 100 may be built into the user terminal 200, or may be provided separately from the user terminal 200. In the latter case, the output of the camera 100 (video image data) may be imported into the user terminal 200 by communication, or may be imported into the user terminal 200 via a predetermined recording medium (for example, an SD card).

[0020] For example, as shown in Fig. 2, camera 100 captures an image of a golf swing from behind the user. "Behind the user" means behind the user when the direction of the ball flight line imagined by the user (hereinafter, "virtual ball flight line") is defined as "forward." Captured image 20 shows a user 21 as a subject, a golf club 22 moving together with user 21, and a teed-up golf ball 23. Captured image 20 captures a state at a point during the take-back or downswing in a golf swing.

[0021] The camera 100 may capture the golf swing motion from the front of the user, facing the user directly. The camera 100 may also capture both a video image representing the golf swing motion from the front of the user and a video image representing the golf swing motion from behind the user. In this case, for example, a plurality of cameras 100 capture both a video image representing the golf swing motion from the front of the user and a video image representing the golf swing motion from behind the user at the same timing. The position of one camera 100 may be changed to sequentially capture both a video image representing the golf swing motion from the front of the user and a video image representing the golf swing motion from behind the user.

[0022] The user terminal 200 is a terminal device used by a user who receives a swing diagnosis. The user terminal 200 may be, for example, a terminal device installed in a golf lesson facility or shop, or may be a terminal device owned by a user.

[0023] The user terminal 200 is, for example, a portable terminal device, that is, a mobile terminal. The mobile terminal is, for example, a smartphone, a tablet terminal, a laptop type PC (Personal Computer), etc. The user terminal 200 may also be a stationary terminal device. The stationary terminal device is, for example, a desktop PC.

[0024] The user terminal 200 is communicatively connected to the information processing device 300 through a predetermined communication line. The predetermined communication line includes, for example, a local area network (LAN). The predetermined communication line may also include a wide area network (WAN). The wide area network includes, for example, the Internet. The wide area network may also include a mobile communication network terminated in a base station or a satellite communication network using a communication satellite. The predetermined communication line may also include, for example, WiFi, Bluetooth (registered trademark), local 5G (5G), etc. th Alternatively, the communication line may be a short-distance communication line using a predetermined wireless communication standard such as a standard for wireless communication using a wireless communication protocol ...

[0025] The user terminal 200 captures a video showing the state of a golf swing motion by the user from the camera 100, and transmits it to the information processing device 300. Then, the user terminal 200 presents the result of the swing diagnosis returned from the information processing device 300 to the user through its own display device, such as a liquid crystal display or an organic EL (Electroluminescence) display.

[0026] The information processing device 300 performs swing diagnosis based on the video image showing the state of the golf swing motion of the user received from the user terminal 200, and returns the result of the swing diagnosis to the user terminal 200.

[0027] The information processing device 300 is, for example, a server device with a relatively high processing capacity. The server device may be a cloud server, an on-premise server, or an edge server. The information processing device may be a terminal device with a lower processing capacity than the server device, depending on the processing capacity required for swing diagnosis. The terminal device may be a stationary terminal device or a portable terminal device (mobile terminal).

[0028] The functions of the user terminal 200 and the information processing device 300 may be realized by one information processing device (for example, one smartphone or tablet terminal), or may be distributed and realized by three or more information processing devices.

[0029] [Camera hardware configuration] Next, still with reference to FIG. 1, the hardware configuration of the camera will be described.

[0030] As shown in FIG. 1, the camera 100 includes an imaging unit 110, a display unit 120, and a control unit .

[0031] The imaging unit 110 captures and outputs a moving image of a predetermined external imaging range based on the camera 100. The imaging unit 110 includes an image sensor (imaging element) such as a Complementary Metal Oxide Semiconductor (CMOS) sensor.

[0032] Display unit 120 displays various screens related to the operation of camera 100. The display unit is, for example, a liquid crystal display or an organic EL display.

[0033] The control unit 130 controls the operation of the camera 100. For example, the control unit 130 controls the imaging unit 110 and the display unit 120.

[0034] The functions of the control unit 130 are realized by any hardware or any combination of hardware and software. For example, the control unit 130 is mainly configured with a computer including a central processing unit (CPU), a memory device, an auxiliary storage device, and an interface device. The memory device is, for example, a static random access memory (SRAM) or a dynamic random access memory (DRAM). The auxiliary storage device is, for example, a hard disc drive (HDD), a solid state disc (SSD), an electrically erasable programmable read only memory (EEPROM), or a flash memory. The interface device includes, for example, an interface for internal communication for communicatively connecting with the imaging unit 110 and the display unit 120, and an interface for external communication for communicatively connecting with an external device such as the user terminal 200. This allows the camera 100 to transmit video data to the outside through the interface for external communication, and to download various data and programs used in processing from the outside and install them in the auxiliary storage device. The interface device also includes, for example, an external interface for reading data from a recording medium and writing data to the recording medium. The recording medium is, for example, an SD memory card, which enables the camera 100 to write video data externally through the recording medium, read various data and programs used in processing, and install them in the auxiliary storage device.

[0035] [First example of display screen] Next, a first example of the screen of the display unit 120 will be described with reference to FIGS.

[0036] FIG. 3 is a diagram showing a first example (screen 30) of the screen of the display unit 120 of the camera 100. In FIG. 3, the auxiliary images 33, 35, and 36 are drawn with dashed lines for convenience in order to express the points where the live view image 31 is superimposed so as to be transparent. FIGS. 4 to 6 are diagrams showing an example, another example, and still another example of the relationship between the golf swing trajectory and the position of the target for launching the golf ball. FIG. 4 includes FIG. 4A showing one frame of an example of a moving image of a golf swing motion by a user captured by the camera 100, and FIG. 4B showing a relationship between the golf swing trajectory HT and the position of the target for launching the golf ball GB in the moving image corresponding to FIG. 4A in a plan view. Similarly, FIG. 5 includes FIG. 4A showing one frame of another example of a moving image of a golf swing motion by a user captured by the camera 100, and FIG. 5B showing a relationship between the golf swing trajectory HT and the position of the target for launching the golf ball GB in the moving image corresponding to FIG. 5A in a plan view. Similarly, Figure 6 includes Figure 6A showing one frame of yet another example of a video of a golf swing motion by a user captured by camera 100, and Figure 6B showing in a planar view the relationship between the golf swing trajectory HT and the position of the launch target TG3 of the golf ball GB in the video corresponding to Figure 6A.

[0037] 3, in this example, the display unit 120 displays a screen 30 for operating the camera 100 under the control of the control unit 130. Specifically, the control unit 130 may load a program installed in an auxiliary storage device into a memory device and execute the program on a CPU, thereby causing the display unit 120 to display the screen 30. In this example, the camera 100 is integrated into a smartphone serving as the user terminal 200.

[0038] The operation screen 30 of the display unit 120 includes a live view image 31, a shooting button image 32, and auxiliary images 33, 35, and .

[0039] The live view image 31 is a real-time captured image of the imaging range output from the imaging unit 110. This allows the photographer to capture a moving image of the user's golf swing motion after determining whether a predetermined range including the subject person is included in the live view image 31. Therefore, the camera 100 can obtain a moving image that appropriately includes the user's golf swing motion. In this example, the live view image 31 is the same as the captured image 20 in FIG. 2.

[0040] The shooting button image 32 is disposed below the live view image 31 on the screen 30. For example, when the shooting button image 32 on the screen 30 is operated via a touch panel or the like, the camera 100 starts and stops shooting a moving image. Specifically, when the shooting button image 32 is operated while a moving image is not being shot, the control unit 130 starts recording the output (captured image) of the imaging unit 110 in an auxiliary storage device or the like, thereby starting shooting of the moving image. Also, when the shooting button image 32 is operated while a moving image is being shot, the camera 100 stops recording the output of the imaging unit 110, thereby stopping shooting of the moving image.

[0041] The auxiliary images 33, 35, and 36 are images for assisting in capturing an appropriate moving image of the user's golf swing motion, and are displayed on the screen 30 so as to be superimposed on the live view image 31 and to allow the live view image 31 to be seen through.

[0042] The auxiliary image 33 defines the relative positional relationship between the camera 100, the subject, and the target of the golf ball in the live view image 31. The auxiliary image 33 is an isosceles triangle with the lower end of the live view image 31 as its base. Specifically, a vertex 33A corresponding to the intersection of the isosceles of the isosceles triangle represents the target of the golf ball in the live view image 31. For example, the target of the golf ball is a predetermined position on the fairway or a predetermined position on the green. In addition, a left side 33B of the isosceles of the isosceles triangle is a straight line passing through the target of the golf ball and the position of the subject's feet. The side 33B represents the relative positional relationship between the target of the golf ball and the subject's feet in the live view image 31. In addition, a right side 33C of the isosceles of the isosceles triangle is a straight line passing through the target of the golf ball and the position of the golf ball. One side 33C represents the relative positional relationship between the target of the golf ball launch and the golf ball in the live view image 31. This allows the photographer to align the relative positional relationship between the target of the launch of the golf ball 23 by the user 21, the position of the feet of the user 21, and the golf ball 23 in the live view image 31 to a predetermined state, using the auxiliary image 33 as a reference. Therefore, the camera 100 can acquire a moving image in which the positional relationship between the target of the launch of the golf ball, the user as a subject, and the golf ball is in a predetermined state. Therefore, the information processing device 300 can perform more appropriate swing diagnosis by using the moving image captured by the camera 100.

[0043] Instead of the auxiliary image 33, only the two line segments corresponding to the sides 33B and 33C may be displayed as an auxiliary image superimposed on the live view image 31. Also, only one of the two line segments corresponding to the sides 33B and 33C may be displayed superimposed on the live view image 31.

[0044] Auxiliary image 35 is a silhouette image simulating the subject (golfer) at address. Auxiliary image 35 is displayed so that the feet of the silhouette are aligned with one side 33B of the isosceles triangle of auxiliary image 33. This makes it easier for the photographer to align the relative positional relationship between the target for launching golf ball 23 and the position of the feet of user 21 in live view image 31 with auxiliary images 33 and 35 as references. Therefore, camera 100 can more reliably capture a moving image in which the positional relationship between the target for launching golf ball, the user as the subject, and the golf ball is in a predetermined state.

[0045] Auxiliary image 36 is a silhouette image simulating a golf club at address. Auxiliary image 36 is displayed so that the head of the silhouette is aligned with one side 33C of the right side of the isosceles triangle of auxiliary image 33. This makes it easier for the photographer to align the target of the golf ball 23 and the relative positional relationship between the golf ball 23 and the target in the live view image 31 using auxiliary images 33 and 36 as references. Therefore, camera 100 can more reliably capture a moving image in which the target of the golf ball, the user as a subject, and the golf ball are in a predetermined positional relationship.

[0046] The auxiliary images 33, 35, and 36 in Fig. 3 correspond to the case where the subject is a right-handed hitter, and similar auxiliary images may be prepared to correspond to the case where the subject is a left-handed hitter (left-handed). For example, in the case of a left-handed hitter, auxiliary images that are the left-right inverted versions of the auxiliary images 33, 35, and 36 are displayed in the live view image 31. Whether the auxiliary images 33, 35, and 36 corresponding to right-handed hits or the auxiliary images corresponding to left-handed hits are displayed may be switched by the control unit 130 in response to a predetermined operation on the camera 100. The same may be true for the auxiliary images 33, 34, 34a to 34c, 35, 36, 37, and 38 in the second to seventh examples (Figs. 7 to 12) described below.

[0047] In addition to the auxiliary images 33, 35, and 36, other auxiliary images may be displayed superimposed on the live view image 31. For example, an auxiliary image corresponding to a predetermined grid (e.g., auxiliary image 39 described below) composed of a plurality of vertical lines and a plurality of horizontal lines or a spirit level showing the tilt state of the camera 100 may be displayed superimposed on the live view image 31. The same may be true for the second to sixth examples (FIGS. 7 to 11) described below. Furthermore, the auxiliary images 35 and 36 may be omitted. The same may be true for the second to sixth examples (FIGS. 7 to 11) described below.

[0048] For example, in all of Figs. 4 to 6, the swing motion is performed along the same swing trajectory HT, and the incident direction ID to the golf ball GB at the time of impact in a plan view is the same in all cases. 4 to 6, the targets for launching the golf ball GB are different from one another (targets TG1 to TG3). Specifically, the targets TG1 to TG3 have different launch directions as seen from the golf ball GB, i.e., different imaginary flight lines (flight lines FL1 to FL3). Therefore, the angle θ h is different in each of Figs.

[0049] In Figs. 4 to 6, the angle θ h is expressed as an angle in a direction away from the subject with respect to the ball flight lines FL1 to FL3, and the swing trajectory of the subject tends to be inside-out. In the case of FIG. 6, the angle θ h is relatively large, and it can be seen that the tendency for inside-out swing motion is relatively strong. On the other hand, in the case of Figure 5, the angle θ h is relatively small, and the tendency of inside-out swing motion is relatively weak. Also, in the case of Figure 4, the angle θ h This is intermediate between the cases of FIG. 5 and FIG. 6, and shows a moderate tendency toward an inside-out swing motion.

[0050] In this way, even if the swing motion (swing trajectory) is the same, if the target for hitting the golf ball is different, the tendency of the swing motion based on the virtual ball flight line will differ. Therefore, in order to properly evaluate and diagnose the swing motion of the person in question, it is necessary to properly grasp the positional relationship between the person in question and the golf ball and the target for hitting the golf ball.

[0051] Here, the relative positional relationships between the person or golf ball as the subject and the targets TG1 to TG3 for launching the golf ball are different from one another in the images of Figures 4A, 5A, and 6A. Therefore, if a swing diagnosis is performed using the images of Figures 4A, 5A, and 6A in a state where the targets TG1 to TG3 are unclear, for example, the targets for launching the golf ball may be assumed to be in the same state, and as a result, an appropriate swing diagnosis may not be performed.

[0052] In contrast to this, in this example, the photographer can use the auxiliary images 33, 35, and 36 to align the relative positional relationship between the subject person or golf ball and the target for hitting the golf ball to a predetermined state on the live view image 31. Therefore, the information processing device 300 can perform appropriate swing diagnosis under the premise that the relative positional relationship between the subject person or golf ball and the target for hitting the golf ball is in a predetermined state in the moving image acquired by the camera 100.

[0053] [Second example of display screen] Next, a second example of the screen of the display unit 120 of the camera 100 will be described with reference to FIG.

[0054] In the following, the same components as in the first example described above are given the same symbols, and the explanation will focus on the parts that are different from the first example described above, and explanations of content that is the same as or corresponds to the first example described above may be omitted.

[0055] Fig. 7 is a diagram showing a second example (screen 30a) of the screen of display unit 120 of camera 100. In Fig. 7, auxiliary images 33 to 36 are drawn with dashed lines for the sake of convenience in order to represent points where live view image 31 is superimposed so as to be transparent.

[0056] 7, in this example, the display unit 120 displays a screen 30a for operating the camera 100 under the control of the control unit 130. Specifically, the control unit 130 may load a program installed in an auxiliary storage device into a memory device and execute the program on a CPU to cause the display unit 120 to display the screen 30a. In this example, similar to the first example described above, the camera 100 is integrated into a smartphone serving as the user terminal 200.

[0057] The operation screen 30a of the display unit 120 includes, similarly to the first example (screen 30) described above, a live view image 31, a shooting button image 32, and auxiliary images 33, 35, and 36. Moreover, unlike the first example described above, the screen 30a includes an auxiliary image 34.

[0058] Auxiliary image 34 is an image that simulates a target for hitting a golf ball. Auxiliary image 34 is displayed in accordance with vertex 33A of an isosceles triangle in auxiliary image 33. Specifically, auxiliary image 34 is an image that simulates a pin flag extending upward from vertex 33A. This makes it easier for the photographer to recognize that vertex 33A of the isosceles triangle is the target for hitting a golf ball.

[0059] [Third example of display screen] Next, a third example of the screen of the display unit 120 of the camera 100 will be described with reference to FIG.

[0060] In the following, the same components as those in the first and second examples described above will be given the same symbols, and the explanation will focus on the parts that are different from the first and second examples described above, and explanations of content that is the same as or corresponds to the first and second examples described above may be omitted.

[0061] Fig. 8 is a diagram showing a third example (screen 30b) of the screen of display unit 120 of camera 100. In Fig. 8, auxiliary images 33, 34a, 35, and 36 are drawn with dashed lines for the sake of convenience in order to represent points where live view image 31 is superimposed so as to be transparent.

[0062] 8, in this example, the display unit 120 displays a screen 30b for operating the camera 100 under the control of the control unit 130. Specifically, the control unit 130 may load a program installed in an auxiliary storage device into a memory device and execute the program on a CPU, thereby causing the display unit 120 to display the screen 30b. In this example, similar to the first and second examples described above, the camera 100 is integrated into a smartphone serving as the user terminal 200.

[0063] The operation screen 30b of the display unit 120 includes a live view image 31, a shooting button image 32, and auxiliary images 33, 35, and 36, similar to the first and second examples (screens 30 and 30a) described above. Moreover, unlike the first and second examples described above, the screen 30b includes an auxiliary image 34a.

[0064] Similar to the auxiliary image 34 in the second example described above, the auxiliary image 34a is an image that simulates a target for launching a golf ball. The auxiliary image 34a is displayed in accordance with the apex 33A of the isosceles triangle in the auxiliary image 33. Specifically, the auxiliary image 34a is a very thin strip-like image that is arranged to extend upward from the apex 33A. This makes it easier for the photographer to recognize that the apex 33A of the isosceles triangle is the target for launching a golf ball, similar to the second example described above.

[0065] [Fourth example of display screen] Next, a fourth example of the screen of the display unit 120 of the camera 100 will be described with reference to FIG.

[0066] In the following, the same components as in the first to third examples described above are given the same symbols, and the explanation will focus on the parts that are different from the first to third examples described above, and explanations of content that is the same as or corresponds to the first to third examples described above may be omitted.

[0067] Fig. 9 is a diagram showing a fourth example (screen 30c) of the screen of display unit 120 of camera 100. In Fig. 9, auxiliary images 33, 34b, 35, and 36 are drawn with dashed lines for the sake of convenience in order to represent points where live view image 31 is superimposed so as to be transparent.

[0068] 9, in this example, the display unit 120 displays a screen 30c for operating the camera 100 under the control of the control unit 130. Specifically, the control unit 130 may load a program installed in the auxiliary storage device into a memory device and execute the program on a CPU, thereby causing the display unit 120 to display the screen 30c. In this example, similar to the first to third examples described above, the camera 100 is integrated into a smartphone serving as the user terminal 200.

[0069] Similar to the above-described first to third examples (screens 30, 30a, 30b), the operation screen 30c of the display unit 120 includes a live view image 31, a shooting button image 32, and auxiliary images 33, 35, 36. Moreover, unlike the above-described first to third examples, the screen 30c includes an auxiliary image 34b.

[0070] Similar to the auxiliary images 34 and 34a in the second and third examples, the auxiliary image 34b is an image that simulates a target for launching a golf ball. The auxiliary image 34b is displayed in accordance with the apex 33A of the isosceles triangle in the auxiliary image 33. Specifically, the auxiliary image 34b is an image in the shape of a horizontally long ellipse with the apex 33A at the center. This makes it easier for the photographer to recognize that the apex 33A of the isosceles triangle is the target for launching a golf ball, similar to the second and third examples.

[0071] [Fifth example of display screen] Next, a fifth example of the screen of the display unit 120 of the camera 100 will be described with reference to FIG.

[0072] In the following, the same components as in the first to fourth examples described above are given the same symbols, and the explanation will focus on the parts that are different from the first to fourth examples described above, and explanations of content that is the same as or corresponds to the first to fourth examples described above may be omitted.

[0073] Fig. 10 is a diagram showing a fifth example (screen 30d) of the screen of display unit 120 of camera 100. In Fig. 10, auxiliary images 33 to 37 are drawn with dashed lines for the sake of convenience in order to represent points where live view image 31 is superimposed so as to be transparent.

[0074] 10, in this example, the display unit 120 displays a screen 30d for operating the camera 100 under the control of the control unit 130. Specifically, the control unit 130 may load a program installed in an auxiliary storage device into a memory device and execute the program on a CPU, thereby causing the display unit 120 to display the screen 30d. In this example, similar to the first to fourth examples described above, the camera 100 is integrated into a smartphone serving as the user terminal 200.

[0075] The operation screen 30d of the display unit 120 includes a live view image 31, a shooting button image 32, and auxiliary images 33, 35, and 36, similar to the first to fourth examples (screens 30, 30a, 30b, and 30c) described above. Similarly to the second example, the screen 30d includes an auxiliary image 34. Unlike the first to fourth examples described above, the screen 30d includes an auxiliary image 37.

[0076] The auxiliary image 37 is an image that simulates the swing trajectory plane of the photographed person and is displayed together with the auxiliary images 35 and 36.

[0077] In this example, the auxiliary image 37 is added to the second example (screen 30a) described above, but it may also be added to the first, third, and fourth examples (screens 30, 30b, and 30c) described above, or the sixth example (screen 30e) described below.

[0078] [Example 6 of the display screen] Next, a sixth example of the screen of the display unit 120 of the camera 100 will be described with reference to FIG.

[0079] In the following, the same components as in the first to fifth examples described above are given the same symbols, and the following description will focus on the differences from the first to fifth examples described above, and may omit descriptions of content that is the same as or corresponds to the first to fifth examples described above.

[0080] Fig. 11 is a diagram showing a sixth example (screen 30e) of the screen of the display unit 120 of the camera 100. In Fig. 11, the auxiliary images 33 to 36 are drawn with dashed lines for the sake of convenience in order to represent the points at which the live view image 31 is superimposed so as to be transparent.

[0081] 11, in this example, the display unit 120 displays a screen 30e for operating the camera 100 under the control of the control unit 130. Specifically, the control unit 130 may load a program installed in an auxiliary storage device into a memory device and execute the program on a CPU, thereby causing the display unit 120 to display the screen 30e. In this example, similar to the first to fifth examples described above, the camera 100 is integrated into a smartphone serving as the user terminal 200.

[0082] Similar to the first to fifth examples (screens 30, 30a, 30b, 30c, 30d) described above, the operation screen 30e of the display unit 120 includes a live view image 31, a shooting button image 32, and auxiliary images 33, 35, 36. Also, similar to the second example described above, the screen 30e includes an auxiliary image 34.

[0083] In this example, the positions of the vertex 33A and auxiliary image 34 corresponding to the target of the golf ball's launch are lower in the live view image 31 than in the second example described above, that is, closer to the subject person (user 21). The isosceles triangle as auxiliary image 33 changes to have a smaller vertical dimension than in the second example, in accordance with the downward movement of the position of vertex 33A. The positions of the vertex 33A and auxiliary image 34 corresponding to the target of the golf ball's launch may be higher in the live view image 31 than in the second example described above, that is, farther away from the subject person (user 21).

[0084] For example, in response to a predetermined operation on camera 100 or user terminal 200 incorporating camera 100, control unit 130 changes the position of vertex 33A up and down on the live view image, and changes the shape of auxiliary image 33 to match the position of vertex 33A. This allows the photographer to adjust the up and down position on the live view image of the target for hitting the golf ball, i.e., the position in the perspective direction as seen by the golf ball or the subject person.

[0085] [7th example of display screen] Next, a seventh example of the screen of the display unit 120 of the camera 100 will be described with reference to FIG.

[0086] In the following, the same components as in the above-mentioned first to sixth examples are given the same symbols, and the following description will focus on the differences from the above-mentioned first to sixth examples, and may omit descriptions of content that is the same as or corresponds to the above-mentioned first to sixth examples.

[0087] Fig. 12 is a diagram showing a seventh example (screen 30f) of the screen of the display unit 120 of the camera 100. In Fig. 12, the auxiliary images 35, 36, and 38 are drawn with dashed lines for the sake of convenience in order to represent the points at which the live view image 31 is superimposed so as to be transparent.

[0088] 12, in this example, the display unit 120 displays a screen 30f for operating the camera 100 under the control of the control unit 130. Specifically, the control unit 130 may load a program installed in an auxiliary storage device into a memory device and execute the program on a CPU, thereby causing the display unit 120 to display the screen 30f. In this example, similar to the first to sixth examples described above, the camera 100 is integrated into a smartphone serving as the user terminal 200.

[0089] Similar to the above-described first to sixth examples (screens 30, 30a, 30b, 30c, 30d, and 30e), the operation screen 30e of the display unit 120 includes a live view image 31, a shooting button image 32, and auxiliary images 35 and 36. Moreover, unlike the above-described first to sixth examples, the screen 30e includes auxiliary images 38 and 39.

[0090] The auxiliary image 38 defines the relative positional relationship between the camera 100, the photographed person, and the target for hitting the golf ball in the live view image 31. The auxiliary image 38 includes auxiliary images 38A to 38C.

[0091] The auxiliary image 38A specifies the horizontal (i.e., left-right) position of the target for launching a golf ball in the live view image 31. In this example, the auxiliary image 38A represents a horizontal range in the live view image 31 in which the target for launching a golf ball should be positioned, including the most appropriate position. Specifically, the auxiliary image 38A is a strip-shaped image extending vertically (i.e., up-down) in the live view image 31. In this example, the auxiliary image 38A is provided in the vertical range between an upper horizontal line 39B, which will be described later, and the auxiliary image 38B.

[0092] Auxiliary image 38B specifies the position of the subject's feet in live view image 31. In this example, auxiliary image 38B represents a vertical range in live view image 31 in which the subject's feet should be positioned, including the most appropriate position. Specifically, auxiliary image 38B is a strip-shaped image extending horizontally in live view image 31. In this example, auxiliary image 38B is provided in a horizontal range between two vertical lines 39A, which will be described later. Furthermore, auxiliary image 38B is positioned so that the line at its bottom end coincides with the bottom end of the feet of the silhouette image in auxiliary image 35.

[0093] Thereby, by using the auxiliary images 38A and 38B as references, the photographer can adjust the relative positional relationship in the perspective direction (i.e., the front-back direction as seen by the photographer) between the target of the hit of the golf ball 23 by the user 21, the position of the user 21, and the camera 100 to a predetermined state. Also, by using the auxiliary image 35 as references in addition to the auxiliary images 38A and 38B, the photographer can adjust the relative positional relationship in the left-right direction between the target of the hit of the golf ball 23 by the user 21, the position of the user 21, and the camera 100 to a predetermined state.

[0094] The auxiliary image 38A may be an image representing the most appropriate position in the horizontal direction where the target for hitting the golf ball should be positioned (for example, a vertical line extending vertically in the live view image 31). The auxiliary image 38B may be an image representing the most appropriate position in the vertical direction where the feet of the person being photographed should be positioned (for example, a horizontal line extending horizontally in the live view image 31). Instead of or in addition to the auxiliary image 38B, an auxiliary image representing the position or range of the golf ball may be displayed superimposed on the live view image 31. The auxiliary image 38B may be omitted.

[0095] The auxiliary image 38C is an image that displays text information that explains the meaning of the auxiliary image 38A to the photographer. Specifically, the auxiliary image 38C includes text information that instructs the photographer to place the camera 100 at a predetermined height from the ground in the live view image 31 and to place the target for launching the golf ball within the horizontal (left-right) width of the auxiliary image 38A. In this example, the auxiliary image 38C is provided in a range above an upper horizontal line 39B described later, and includes text information such as "Place the camera at a height of xx m from the ground and take a picture so that the target fits within the width of the vertical line." This allows the photographer to properly understand how to use the auxiliary image 38A by referring to the auxiliary image 38C.

[0096] In addition, supplementary image 38C may include text information that explains the meaning of supplementary image 38B to the photographer, in addition to text information that explains the meaning of supplementary image 38A to the photographer.

[0097] The auxiliary image 39 is an image that represents a range that should include the subject person, the golf ball, and the target for hitting the golf ball in the live view image 31. In this example, the auxiliary image 39 includes two vertical lines 39A and two horizontal lines 39B.

[0098] The two vertical lines 39A are provided over the entire vertical range between the top and bottom ends of the live view image 31. The two vertical lines 39A are arranged symmetrically at positions a predetermined distance away from the left and right ends, respectively, of the live view image 31 so that the auxiliary images 35, 36, and 38 displayed in the center are included between them in the horizontal direction.

[0099] The two horizontal lines 39B are provided across the entire range in the horizontal direction between the top and bottom ends of the live view image 31. The two horizontal lines 39B are arranged symmetrically in the vertical direction at positions spaced a predetermined distance from the top and bottom ends, respectively, so that the auxiliary images 35, 36, and 38 displayed in the center of the live view image 31 are included between them in the vertical direction.

[0100] In this way, in this example, the photographer can use the auxiliary images 35, 36, and 38 to align the relative positional relationship between the subject person or golf ball and the target for hitting the golf ball to a predetermined state on the live view image 31. Therefore, the information processing device 300 can perform appropriate swing diagnosis under the premise that the relative positional relationship between the subject person or golf ball and the target for hitting the golf ball is in a predetermined state in the moving image acquired by the camera 100.

[0101] [Effect] Next, the operation of the display method, the imaging device, and the program according to the present embodiment will be described.

[0102] In this embodiment, the display method involves displaying a live view image on the display unit of the imaging device, and displaying an auxiliary image superimposed on the live view image, which guides the user to adjust the relative positional relationship between the imaging device, at least one of the subject person and the golf ball, and the target for hitting the golf ball to a predetermined state. The imaging device is, for example, the above-mentioned camera 100 or a user terminal 200 incorporating the functions of the camera 100. The display unit is, for example, the above-mentioned display unit 120 or a display device of the user terminal 200 incorporating the functions of the camera 100. The auxiliary image is, for example, the above-mentioned auxiliary images 33, 34, 34a to 34c, 35, 36, 38 (38A to 38C).

[0103] In the present embodiment, the imaging device includes a display unit that displays a live view image and an auxiliary image that guides the user to adjust the relative positional relationship between the imaging device, at least one of the person and the golf ball as a subject, and a target for hitting the golf ball to a predetermined state, superimposed on the live view image.

[0104] In the present embodiment, the program causes the information processing device to execute a procedure of displaying a live view image on the display unit of the imaging device, and displaying an auxiliary image superimposed on the live view image on the display unit, the auxiliary image providing guidance for adjusting the relative positional relationship between the imaging device, at least one of the person and the golf ball as the subject, and the target for the golf ball to a predetermined state. The information processing device is, for example, the above-mentioned control unit 130.

[0105] This allows the photographer, when photographing a golf swing, to appropriately align the positional relationship between the subject person or golf ball and the target for golf hitting on the photographed image.

[0106] In addition, in this embodiment, when photographing a subject performing a golf swing from behind, an auxiliary image may be displayed on the display unit to guide the user to adjust the relative positional relationship between the imaging device, the subject and / or the golf ball, and the target for hitting the golf ball to a specified state.

[0107] This allows the photographer, when photographing a subject person performing a golf swing from behind, to appropriately adjust the positional relationship between the subject person or the golf ball on the photographed image and the target for golf hitting.

[0108] In this embodiment, the auxiliary image may include at least one of a first line segment that guides the position of the subject's feet relative to a target for launching the golf ball on the live view image and a second line segment that guides the position of the golf ball relative to the target on the live view image. The first line segment is, for example, the above-mentioned side 33B. The second line segment is, for example, the above-mentioned side 33C.

[0109] This allows the photographer to appropriately adjust the relative positional relationship between the target for launching the golf ball and the subject by aligning the subject's feet with the first line segment, and allows the photographer to appropriately adjust the relative positional relationship between the target for launching the golf ball and the golf ball by aligning the golf ball with the second line segment.

[0110] In the present embodiment, the auxiliary image may include a vertex corresponding to a target for hitting the golf ball, and a first line segment and a second line segment starting from the vertex. The vertex is, for example, the above-mentioned vertex 33A.

[0111] This allows the photographer to align the target for launching the golf ball with the vertex, and then align the subject's feet and the golf ball with the first line segment and the second line segment, respectively, to appropriately adjust the relative positional relationship between the subject and golf ball and the target for launching the golf ball.

[0112] In the present embodiment, the auxiliary image may include an image of a symmetrical isosceles triangle having a first line segment and a second line segment as one side, and the first line segment and the second line segment have the same length. The image of the isosceles triangle is, for example, the above-mentioned auxiliary image 33.

[0113] This allows the photographer to relatively easily align the golf ball, the subject's feet, and the golf ball on the live view image by using the auxiliary image, which is a relatively easy-to-recognize graphic.

[0114] In this embodiment, the auxiliary image may include a vertical line or strip-like image extending vertically to guide the target of the golf ball launch in the live view image, and a horizontal line or strip-like image extending horizontally to guide the foot position of the person in the live view image. The image guiding the target of the golf ball launch in the live view image is, for example, the above-mentioned auxiliary image 38A. The image guiding the foot position of the person in the live view image is, for example, the above-mentioned auxiliary image 38B.

[0115] This allows the photographer to appropriately adjust the relative positional relationship between the target for launching the golf ball and the subject person.

[0116] In the present embodiment, the auxiliary image may include an image showing a silhouette of a person to guide the position of the person who is the subject. The image showing a silhouette of a person is, for example, the auxiliary image 35 described above.

[0117] This allows the photographer to relatively easily align the subject on the live view image.

[0118] In this embodiment, the auxiliary image may include an image showing the position of a target for launching the golf ball, for example, the above-mentioned auxiliary images 34, 34a, 34b.

[0119] This allows the photographer to relatively easily align the position of the target for hitting the golf ball on the live view image.

[0120] In addition, in the present embodiment, the display method may change the shape of the auxiliary image by moving a portion of the auxiliary image that corresponds to the target for hitting the golf ball in response to a predetermined operation.

[0121] This allows the photographer to customize the auxiliary image according to, for example, the position in the perspective direction of the target for hitting the golf ball on the live view image, thereby improving the convenience for the photographer.

[0122] Although the embodiments have been described in detail above, the present disclosure is not limited to such specific embodiments, and various modifications and variations are possible within the scope of the gist described in the claims. [Explanation of symbols]

[0123] 1 Swing Diagnosis System 30,30a~30e screen 31 Live View Images 32 Shooting button image 33 Auxiliary Images 33A Vertex 33B, 33C one side 34,34a,34b Supplementary images 35 Auxiliary Images 36 Auxiliary Images 37 Auxiliary Images 38,38A~38C Supplementary images 100 Cameras 110 Imaging unit 120 Display section 130 Control section 200 User terminals 300 Information processing device

Claims

1. a live view image is displayed on a display unit of an imaging device, and an auxiliary image is displayed on the display unit, the auxiliary image superimposed on the live view image, the auxiliary image guiding a user to adjust a relative positional relationship between the imaging device, at least one of the person and the golf ball as a subject, and a target for hitting the golf ball to a predetermined state; Display method.

2. and displaying, on the display unit, the auxiliary image that guides the user to adjust the relative positional relationship to the predetermined state when photographing a person who is a subject making a golf swing from behind. The display method according to claim 1 .

3. the auxiliary image includes at least one of a first line segment that guides a foot position of the person as a subject relative to the target on the live view image and a second line segment that guides a position of the golf ball relative to the target on the live view image; The display method according to claim 2.

4. the auxiliary image includes a vertex corresponding to the target, and the first line segment and the second line segment starting from the vertex; The display method according to claim 3.

5. the auxiliary image includes an image of a symmetrical isosceles triangle having sides each including the first line segment and the second line segment, the first line segment and the second line segment having equal lengths, The display method according to claim 4.

6. the auxiliary image includes a vertical line or strip-like image extending in a vertical direction, which guides the user to the target in the live view image, and a horizontal line or strip-like image extending in a horizontal direction, which guides the user to the foot position of the person who is the subject in the live view image; The display method according to claim 2.

7. the auxiliary image includes an image showing a silhouette of a person for guiding the position of the person who is the subject of the image; A display method according to any one of claims 1 to 6.

8. The auxiliary image includes an image representing a position of the target. A display method according to any one of claims 1 to 5.

9. changing a shape of the auxiliary image by moving a portion of the auxiliary image corresponding to the target in response to a predetermined operation; A display method according to any one of claims 1 to 5.

10. a display unit that displays a live view image and also displays an auxiliary image superimposed on the live view image, the auxiliary image providing guidance for adjusting the relative positional relationship between the imaging device, at least one of the person and the golf ball as a subject, and a target for hitting the golf ball to a predetermined state; Imaging device.

11. In the information processing device, a step of displaying a live view image on a display unit of an imaging device and superimposing an auxiliary image on the live view image, the auxiliary image guiding a user to adjust a relative positional relationship between the imaging device, at least one of a person as a subject and a golf ball, and a target for hitting the golf ball to a predetermined state, on the display unit; program.

Images