Imaging system, imaging device, and wearable device

Abstract

To allow users to easily understand the direction of the imaging device that is taking their picture. [Solution] The imaging system of the present invention is an imaging system having an imaging device and a wearable device, characterized in that it has a determination means for determining the camera direction which is the direction from the wearable device toward the imaging device, and a notification means for notifying the user wearing the wearable device of the camera direction by vibration of the wearable device when the wearable device is within the imaging range of the imaging device.

Description

Technical Field

[0001] The present invention relates to an imaging system, an imaging device, and a wearable device, and particularly to a technology for linking an imaging device and a wearable device.

Background Art

[0002] As wearable devices, there are those capable of presenting haptics. By presenting haptics, various information can be presented to the body of the user who has come into contact with the wearable device. As haptic presentation, for example, tactile presentation that presents force and movement by vibration, pressure, etc., and thermosensory presentation are performed.

[0003] Patent Document 1 discloses a technology in which a receiver receives radio waves from a transmitter of a camera and notifies the user of the receiver that shooting is being performed by the camera by vibration, sound, image, etc.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the prior art disclosed in Patent Document 1, it is only notified to the user that shooting is being performed by the camera. Therefore, even when using the prior art disclosed in Patent Document 1, when the user does not know the position of the camera, the user cannot easily grasp from which direction the shooting is being performed. Patent Document 1 also discloses transmitting the position information of the camera and the image information of the location where the camera is provided to the receiver, but even using those information, a user lacking in sense of direction cannot easily grasp the position of the camera.

[0006] The present invention aims to enable users to easily understand the direction of the imaging device that is taking pictures of them. [Means for solving the problem]

[0007] A first aspect of the present invention is an imaging system having an imaging device and a wearable device, characterized in that it includes a determination means for determining a camera direction which is the direction from the wearable device toward the imaging device, and a notification means for notifying a user wearing the wearable device of the camera direction by vibration of the wearable device when the wearable device is within the imaging range of the imaging device.

[0008] A second aspect of the present invention is an imaging system having an imaging device and a wearable device, wherein the imaging system has a determination means for determining a camera direction which is the direction from the wearable device toward the imaging device, and the imaging device has a control means for controlling the wearable device to notify the user wearing the wearable device of the camera direction by vibration of the wearable device when the wearable device is within the imaging range of the imaging device.

[0009] A third aspect of the present invention is an imaging system having an imaging device and a wearable device, wherein the imaging system has a determination means for determining a camera direction which is the direction from the wearable device toward the imaging device, and the wearable device, when the wearable device is within the imaging range of the imaging device, the wearable device The wearable device is characterized by having a notification means that notifies the user wearing the wearable device of the camera direction through vibration of the device.

[0010] A fourth aspect of the present invention is a control method for an imaging system having an imaging device and a wearable device, characterized by comprising the steps of: determining a camera direction which is the direction from the wearable device toward the imaging device; and notifying the user wearing the wearable device of the camera direction by vibration of the wearable device when the wearable device is within the imaging range of the imaging device.

[0011] A fifth aspect of the present invention is a program for causing a computer to function as each of the means of the imaging system. A sixth aspect of the present invention is a computer-readable storage medium that stores a program for causing a computer to function as each of the means of the imaging system. [Effects of the Invention]

[0012] According to the present invention, users will be able to easily determine the direction of the imaging device that is taking pictures of them. [Brief explanation of the drawing]

[0013] [Figure 1] This is a block diagram showing an example configuration of the imaging system according to the first embodiment. [Figure 2] This is an external view of the imaging device according to the first embodiment. [Figure 3] This flowchart shows an example of the operation of the imaging system according to the first embodiment. [Figure 4] This is a schematic diagram showing an example of operation of the imaging system according to the first embodiment. [Figure 5] This is a schematic diagram showing an example of operation of a wearable device according to the first embodiment. [Figure 6] This is a schematic diagram showing an example of operation of the imaging system according to the first embodiment. [Figure 7] This is a schematic diagram illustrating the use of a drone as an imaging device. [Figure 8] This flowchart shows an example of the operation of the imaging system according to the second embodiment. [Figure 9]It is a schematic diagram showing an operation example of an imaging system according to the second embodiment. [Figure 10] It is a block diagram showing a configuration example of an imaging system according to the third embodiment. [Figure 11] It is a flowchart showing an operation example of an imaging system according to the third embodiment.

Mode for Carrying Out the Invention

[0014] <First Embodiment> The first embodiment of the present invention will be described. FIG. 1 is a block diagram showing a configuration example of an imaging system according to the first embodiment. The imaging system of FIG. 1 includes an imaging device 1 and a wearable device 2. FIGS. 2(A) and 2(B) are external views of the imaging device 1. FIG. 2(A) is a front view (front perspective view) of the imaging device 1, and FIG. 2(B) is a rear view of the imaging device 1.

[0015] The imaging device 1 includes a control unit 101, an information processing unit 102, a communication unit 103, a primary storage unit 104, a secondary storage unit 105, an imaging unit 106, a display unit 107, an operation unit 108, and a position acquisition unit 110. These components are connected to a bus 112, and data transmission and reception between the components are performed via the bus 112.

[0016] The control unit 101 is, for example, a CPU, and controls each part of the imaging device 1 (such as the information processing unit 102, the communication unit 103, the primary storage unit 104, the secondary storage unit 105, the imaging unit 106, the display unit 107, the operation unit 108, the position acquisition unit 110, etc.).

[0017] The information processing unit 102 is a processing circuit (arithmetic unit) that performs various information processing (arithmetic processing). For example, the information processing unit 102 performs arithmetic processing on the image data obtained by the imaging unit 1 (such as arithmetic processing for obtaining various evaluation values related to the image data). The information processing unit 102 also performs arithmetic processing on the data obtained by the communication unit 103 and arithmetic processing on the position data obtained by the position acquisition unit 110, etc.

[0018] The communication unit 103 is a communication interface that communicates with external devices.

[0019] The primary storage unit 104 is, for example, a DRAM, and temporarily stores data used by the control unit 101 and the information processing unit 102.

[0020] The secondary storage unit 105 is, for example, a flash memory, and stores data used by the control unit 101 and the information processing unit 102, as well as the processing results of the information processing unit 102 (for example, encoded recorded images).

[0021] The imaging unit 106 includes, for example, an optical lens, an image sensor, and an A / D converter, and converts light from the outside (subject) into digital data (image data).

[0022] The display unit 107 is a display that shows various images. The display unit 107 may also have a touch panel that accepts touch operations from the user's finger or stylus.

[0023] The operation unit 108 has operating members that accept user input, such as buttons and dials. The touch panel mentioned above is also an example of an operating member. When a user input is performed on these operating members, the control unit 101 performs control corresponding to that user input. A signal corresponding to a user input to an external device may be acquired by the communication unit 103, and the control unit 101 may perform control corresponding to that signal.

[0024] The position acquisition unit 110 has, for example, a receiver for the Global Positioning System (GPS) and acquires the current position (position data) of the imaging device 1.

[0025] In the first embodiment, the imaging device 1 is assumed to be a camera (digital camera), but the imaging device 1 may be a smartphone or tablet device, etc. The imaging device 1 may also be an automatic camera. In addition to zooming and driving (changing) the iris, the imaging device 1 may be capable of rotating the angle of view around at least one of the pan axis, tilt axis, and roll axis. Rotation of the angle of view around the pan axis and tilt axis can be achieved by adjusting the angle of the entire optical system, including the optical lens and image sensor. Rotation of the angle of view around the roll axis can be achieved by adjusting the angle of the image sensor. The imaging device 1 may be capable of driving (moving) in at least one of the up and down, left and right, and forward and backward directions. The imaging device 1 itself may be capable of moving and rotating, like a drone. External equipment such as a movable pan / tilt head, such as a gimbal, may be detachable from the imaging device 1.

[0026] The wearable device 2 includes a control unit 201, an information processing unit 202, a communication unit 203, a primary storage unit 204, a secondary storage unit 205, an operation unit 208, a vibration unit 209, and a position acquisition unit 210. These components are connected to a bus 212, and data is transmitted and received between the components via the bus 212.

[0027] The control unit 201 is, for example, a CPU, which controls each part of the wearable device 2 (such as the information processing unit 202, the communication unit 203, the primary storage unit 204, the secondary storage unit 205, the operation unit 208, the vibration unit 209, the position acquisition unit 210, etc.).

[0028] The information processing unit 202 is a processing circuit (arithmetic unit) that performs various information processing (arithmetic processing). For example, the information processing unit 202 performs arithmetic processing on data obtained by the communication unit 203, and position The unit performs calculations and other processing on the position data obtained by the acquisition unit 210.

[0029] The communication unit 203 is a communication interface that communicates with external devices.

[0030] The primary storage unit 204 is, for example, a DRAM, and temporarily stores data used by the control unit 201 and the information processing unit 202.

[0031] The secondary storage unit 205 is, for example, a flash memory, and stores data used by the control unit 201 and the information processing unit 202, as well as the processing results of the information processing unit 202.

[0032] The operation unit 208 has operating members that accept user input, such as buttons and dials. When a user input is performed on these operating members, the control unit 201 performs control corresponding to that user input. A signal corresponding to a user input to an external device may be acquired by the communication unit 203, and the control unit 201 may perform control corresponding to that signal.

[0033] The vibrating unit 209 vibrates the wearable device 2. For example, the vibrating unit 209 can notify the user wearing the wearable device 2 of its direction by vibrating a part of the wearable device 2, and the direction to which the user is notified can be changed by changing the part that is vibrated.

[0034] The position acquisition unit 210 has, for example, a GPS receiver and acquires the current location (location data) of the wearable device 2.

[0035] In the first embodiment, the wearable device 2 is assumed to be a necklace-type device, but the wearable device 2 may be any other device that comes into contact with the user's skin over a relatively wide area. For example, the wearable device 2 may be a glove-type device, a wristband-type device, a belt-type device, etc. The wearable device 2 may also be a smartwatch, a smartphone, a head-mounted display (HMD), etc. The wearable device 2 may be a non-contact device that can notify the user of direction using ultrasound or the like without coming into contact with the user's skin. The wearable device 2 may not be merely a vibration device, but may be a device that can make the user feel a traction force.

[0036] Figure 3 is a flowchart illustrating an example of operation of the imaging system according to the first embodiment. Figure 4 is a schematic diagram showing an example of operation of the imaging system according to the first embodiment.

[0037] The operation of the imaging device 1 begins in response to user input to the control unit 108 of the imaging device 1.

[0038] In step S301 of Figure 3, the control unit 101 of the imaging device 1 acquires shooting conditions such as the shooting angle of view, focus range, and shooting status, and stores them in the primary storage unit 104.

[0039] In S302, the control unit 101 uses the position acquisition unit 110 to acquire the camera position (X1, Y1, Z1), which is the current position of the imaging device 1, and stores it in the primary storage unit 104.

[0040] In S303, the control unit 101 uses the communication unit 103 to transmit the shooting conditions and camera position (X1, Y1, Z1) stored in the primary storage unit 104 to the wearable device 2.

[0041] In S306, the control unit 101 determines whether a termination operation, which is a user operation to terminate the operation of the imaging device 1, has been performed on the operation unit 108. If a termination operation has been performed, The operation of imaging device 1 is terminated, or the process proceeds to S301 if necessary.

[0042] Similar to the imaging device 1, the wearable device 2 starts operating in response to user input on the control unit 208 of the wearable device 2.

[0043] In S312, the control unit 201 of the wearable device 2 uses the position acquisition unit 210 to acquire the necklace position (X2, Y2, Z2), which is the current position of the wearable device 2, and stores it in the primary storage unit 204.

[0044] In S313, the control unit 201 receives the shooting conditions and camera position (X1, Y1, Z1) from the imaging device 1 using the communication unit 203 and stores them in the primary storage unit 204.

[0045] In S314, the control unit 201 uses the information processing unit 202 to determine the camera direction (direction 400 in Figure 4), which is the direction from the wearable device 2 (necklace position, subject 3 in Figure 4) to the imaging device 1 (camera position). The camera direction 400 is determined based on the camera position (X1, Y1, Z1) and necklace position (X2, Y2, Z2) stored in the primary storage unit 204.

[0046] Furthermore, in S314, the control unit 201 uses the information processing unit 202 to determine the imaging range 4 of the imaging device 1 shown in Figure 4 (the range where the centroid 401 (centroid position) is located at position (X3, Y3, Z3)). The imaging range 4 is determined based on the shooting conditions and camera position (X1, Y1, Z1) stored in the primary storage unit 204. In Figure 4, the imaging range 4 is assumed to be the focus range, but the imaging range 4 may be the entire range to be imaged or a part of the range to be imaged. The imaging range 4 may be narrower or wider than the focus range.

[0047] Then, if the wearable device 2 (necklace position, subject 3 in Figure 4) is within the imaging range 4, the control unit 201 stores the camera direction 400 in the primary storage unit 204. On the other hand, if the wearable device 2 is not within the imaging range 4, the control unit 201 stores information indicating that there is no camera direction 400 in the primary storage unit 204 so that the camera direction 400 is not notified (described later). Information indicating that there is no camera direction 400 may also be stored in the primary storage unit 204 when the imaging device 1 is in standby mode (not taking pictures).

[0048] Furthermore, the camera direction 400 may be determined only if the wearable device 2 is within the imaging range 4.

[0049] In S315, the control unit 201 uses the vibration unit 209 to notify the subject 3 wearing the wearable device 2 of the camera direction 400 stored in the primary storage unit 204. Figure 5 is a schematic diagram showing an example of the operation of the wearable device 2 in S315. The vibration unit 209 notifies the subject 3 of the camera direction 400 by vibrating the location 500 corresponding to the camera direction 400. For example, the notification stops when the subject 3 (wearable device 2) faces the camera direction 400.

[0050] The vibration unit 209 may change the vibration pattern of the wearable device 2 (e.g., vibration intensity and vibration period) depending on the distance from the wearable device 2 to the imaging device 1. For example, the vibration unit 209 may vibrate the wearable device 2 with a stronger vibration intensity or a shorter vibration period the closer the wearable device 2 is to the imaging device 1. In this way, the subject 3 can grasp the sense of distance, such as whether it is close or far from the imaging device 1. The control unit 201 may notify the distance from the wearable device 2 to the imaging device 1 using a notification method different from the vibration of the wearable device 2. For example, if the wearable device 2 has a temperature generating unit, The control unit 201 may use a temperature generating unit to change the temperature of the wearable device 2 according to the distance from the wearable device 2 to the imaging device 1.

[0051] In S316, the control unit 201 determines whether a termination operation, which is a user operation to terminate the operation of the wearable device 2, has been performed on the operation unit 208. If a termination operation has been performed, the operation of the wearable device 2 is terminated; otherwise, the process proceeds to S312.

[0052] Figures 6(A) to 6(D) are schematic diagrams showing examples of operation of the imaging system according to the first embodiment.

[0053] Figure 6(A) shows an example where the entire area to be imaged is used as the imaging range 4. In Figure 6(A), subject 3-1, who is wearing the wearable device 2-1, is included in the imaging range 4, but subject 3-2, who is wearing the wearable device 2-2, is not included in the imaging range 4. In this case, subject 3-1 is notified of the camera direction 400-1 from subject 3-1 toward the imaging device 1, but subject 3-2 is not notified of the camera direction 400-2 from subject 3-2 toward the imaging device 1.

[0054] Figure 6(B) shows an example where the focusing range is used as the imaging range 4. In Figure 6(B), subject 3-1, who is wearing the wearable device 2-1, is included in the imaging range 4, but subject 3-2, who is wearing the wearable device 2-2, is not included in the imaging range 4. In this case as well, subject 3-1 is notified of the camera direction 400-1 from subject 3-1 toward the imaging device 1, but subject 3-2 is not notified of the camera direction 400-2 from subject 3-2 toward the imaging device 1.

[0055] As described above, when the imaging device 1 is in standby mode (not currently taking a picture), information indicating that there is no camera direction 400 may be stored in the primary storage unit 204 so that the camera direction 400 is not notified (described later). In Figure 6(C), the subject 3-2 wearing the wearable device 2-2 is included in the imaging range 4 (not shown), but the imaging device 1 is in standby mode. Therefore, the subject 3-2 is not notified of the camera direction 400-2 from the subject 3-2 toward the imaging device 1.

[0056] If the state of subject 3 is in a predetermined state, notification of the camera direction 400 by vibration of the wearable device 2 is not required. The method for detecting the state of subject 3 is not particularly limited, but for example, the information processing unit 202 may detect the state of subject 3 based on the time change of the position of the wearable device 2 obtained by the position acquisition unit 210. The predetermined state is also not particularly limited. For example, the predetermined state is a state in which notification by vibration would be bothersome to subject 3, and includes at least one of the following: subject 3 is moving with an intensity greater than a predetermined threshold, subject 3 is sleeping, and subject 3 is talking. In Figure 6(D), subject 3-2 wearing the wearable device 2-2 is included in the imaging range 4, but subject 3-2 is sleeping. Therefore, subject 3-2 is not notified of the camera direction 400-2 from subject 3-2 toward the imaging device 1.

[0057] As described above, according to the first embodiment, the camera direction 400 from the wearable device 2 toward the imaging device 1 is determined, and the camera direction 400 is notified to the subject 3 by vibration of the wearable device 2. In this way, the subject 3 can easily grasp the direction of the imaging device 1 that is photographing them, and can immediately perform actions such as looking toward the imaging device 1 or striking a pose. The position of the imaging device 1, the position of the wearable device 2, and the shooting conditions (such as the imaging range 4) change moment by moment, but the camera direction 400 is updated in real time, so the part 500 that the vibration unit 209 vibrates also changes moment by moment. As a result, the subject 3 can grasp the camera direction 400 in real time.

[0058] If the camera direction 400 is notified by voice, unintended sounds may be included in the recorded video, or the subject 3 may not be able to perceive the notification of the camera direction 400 due to noise. If the camera direction 400 is notified by image, it may cause unnatural movement of the subject 3's gaze. In the first embodiment, the camera direction 400 is notified by vibration, so these problems do not occur.

[0059] As mentioned above, the imaging device 1 may be a drone. Figure 7 is a schematic diagram showing subject 3 taking a selfie using automatic shooting with drone 7 as the imaging device 1. During automatic shooting with drone 7, the position of drone 7 changes moment by moment, so subject 3 may lose sight of drone 7. However, since the camera direction 400 is notified in real time by the wearable device 2, subject 3 can understand the camera direction 400 in real time.

[0060] The control unit 201 may select one or more notification methods, including vibration of the wearable device 2, to notify the subject 3 of the camera direction 400, etc., using the selected notification method. If the state of the subject 3 is a predetermined state, the control unit 201 may notify the subject 3 of the camera direction 400 using a notification method different from vibration of the wearable device 2. The multiple notification methods include, for example, at least one of sound output, image display, temperature change, and odor generation.

[0061] The camera direction notification 400 may be given when taking still images or when taking videos. The camera direction notification 400 may be given when the user of imaging device 1 and the user of wearable device 2 are taking the same selfie, or when the user of imaging device 1 and the user of wearable device 2 are taking different photos taken by others. The user of imaging device 1 or wearable device 2 may be able to set whether or not to give the camera direction notification 400.

[0062] At least one of the multiple processes (multiple controls) described as being performed by the wearable device 2 may be performed by the imaging device 1 or by other external devices such as a cloud server. Similarly, at least one of the multiple processes (multiple controls) described as being performed by the imaging device 1 may be performed by the wearable device 2 or by other external devices such as a cloud server. For example, the wearable device 2 may transmit necessary information to the imaging device 1, and the information processing unit 102 of the imaging device 1 may determine the camera direction 400.

[0063] <Second Embodiment> A second embodiment of the present invention will now be described. In the following description, configurations and processes similar to those of the first embodiment will be omitted, and configurations and processes different from those of the first embodiment will be described.

[0064] In the first embodiment, the imaging system is assumed to have one imaging device. In the second embodiment, the imaging system is assumed to have multiple imaging devices. In this case, one wearable device may be located within the imaging range of each of the multiple imaging devices. In the second embodiment, when one wearable device is located within the imaging range of each of the multiple imaging devices, the subject wearing the wearable device is notified of at least one of the multiple camera directions corresponding to each of the multiple imaging devices.

[0065] Figure 8 is a flowchart showing an example of operation of the imaging system according to the second embodiment. Figure 9 is a schematic diagram showing an example of operation of the imaging system according to the second embodiment. Imaging devices 1-1 and 1-2 have the same configuration as imaging device 1 of the first embodiment.

[0066] The operation of imaging device 1-1 (S301-1 to S303-1 and S306-1 in Figure 8) is as follows: The operation of imaging device 1 in the first embodiment (S301-S303 and S306 in Figure 3) is the same. The operation of imaging device 1-2 (S301-2-S303-2 and S306-2 in Figure 8) is also the same as the operation of imaging device 1 in the first embodiment (S301-S303 and S306 in Figure 3).

[0067] In the operation of the wearable device 2 shown in Figure 8, similar to the first embodiment (Figure 3), in S312, the control unit 201 acquires the necklace position, which is the current position of the wearable device 2, and stores it in the primary storage unit 204.

[0068] Similar to S313 in the first embodiment (Figure 3), in S313-1, the control unit 201 receives the shooting conditions and camera position of the imaging device 1-1 from the imaging device 1-1 and stores them in the primary storage unit 204. Hereafter, the camera position of the imaging device 1-1 will be referred to as camera position A.

[0069] Similar to S314 in the first embodiment (Figure 3), in S314-1, the control unit 201 determines the camera direction (direction 400-1 in Figure 9), which is the direction from the wearable device 2 (necklace position, subject 3 in Figure 9) toward the imaging device 1-1 (camera position A). Furthermore, in S314-1, the control unit 201 determines the imaging range 4-1 of the imaging device 1-1 shown in Figure 9. If the wearable device 2 (necklace position, subject 3 in Figure 9) is within the imaging range 4-1, the control unit 201 stores the camera direction 400-1 in the primary storage unit 204. On the other hand, if the wearable device 2 is not within the imaging range 4-1, the control unit 201 stores information indicating that there is no camera direction 400-1 in the primary storage unit 204 so that the camera direction 400-1 is not notified.

[0070] Similar to S313 in the first embodiment (Figure 3), in S313-2, the control unit 201 receives the shooting conditions and camera position of the imaging device 1-2 from the imaging device 1-2 and stores them in the primary storage unit 204. Hereafter, the camera position of the imaging device 1-2 will be referred to as camera position B.

[0071] Similar to S314 in the first embodiment (Figure 3), in S314-2, the control unit 201 determines the camera direction (direction 400-2 in Figure 9), which is the direction from the wearable device 2 (necklace position, subject 3 in Figure 9) toward the imaging device 1-2 (camera position B). Furthermore, in S314-2, the control unit 201 determines the imaging range 4-2 of the imaging device 1-2 shown in Figure 9. If the wearable device 2 (necklace position, subject 3 in Figure 9) is within the imaging range 4-2, the control unit 201 stores the camera direction 400-2 in the primary storage unit 204. On the other hand, if the wearable device 2 is not within the imaging range 4-2, the control unit 201 stores information indicating that there is no camera direction 400-2 in the primary storage unit 204 so that the camera direction 400-2 is not notified.

[0072] In S800, the control unit 201 uses the information processing unit 202 to select at least one of the camera directions 400-1 and 400-2 stored in the primary storage unit 204 as the notification direction.

[0073] In S801, the control unit 201 uses the vibration unit 209 to notify the subject 3, who is wearing the wearable device 2, of the notification direction selected in S800.

[0074] Here, as shown in Figure 9, consider the case where the subject 3 wearing the wearable device 2 is included in both the imaging range 4-1 of imaging device 1-1 and the imaging range 4-2 of imaging device 1-2. In this case, the subject 3 may be notified of only one of the camera directions 400-1 and 400-2, or both camera directions 400-1 and 400-2 may be notified to the subject 3. For example, the control unit 201 may pre-set the priority of imaging device 1-1 and the priority of imaging device 1-2. Then, in S800, the control unit 201 controls the camera Of the directions 400-1 and camera direction 400-2, only the camera direction corresponding to the imaging device with a priority greater than a predetermined threshold may be notified to the subject 3.

[0075] The method for setting priorities is not particularly limited. For example, the control unit 201 may set the priority of imaging device 1-1 based on instructions from the user (subject 3 or photographer), the distance from the wearable device 2 to imaging device 1-1, and the composition of the image captured by imaging device 1-1. The priority of imaging device 1-2 may be set in a similar manner. The control unit 201 may also set the priority of imaging device 1-1 and the priority of imaging device 1-2 individually in response to user operations on the operation unit 208. A higher priority may be set for shorter distances from the wearable device 2 to the imaging device. A higher priority may be set for positions of subject 3 in the captured image that are closer to the optimal position in terms of composition. The optimal position in terms of composition is determined for each captured image.

[0076] When both camera direction 400-1 and camera direction 400-2 are to be notified to the subject 3, the vibration pattern for notifying camera direction 400-1 and the vibration pattern for notifying camera direction 400-2 may be different. For example, the control unit 201 vibrates the part of the wearable device 2 corresponding to camera direction 400-1 with a short vibration period, and the part corresponding to camera direction 400-2 with a long vibration period. In this way, the subject 3 can distinguish and understand camera direction 400-1 and camera direction 400-2.

[0077] The control unit 201 may notify the subject 3 of both camera direction 400-1 and camera direction 400-2 by vibrating the portion of the wearable device 2 that corresponds to the intermediate direction (average direction) between camera direction 400-1 and camera direction 400-2.

[0078] Returning to the explanation of Figure 8, in the same manner as in the first embodiment (Figure 3), in S316, the control unit 201 determines whether or not a termination operation, which is a user operation to terminate the operation of the wearable device 2, has been performed on the operation unit 208. If a termination operation has been performed, the operation of the wearable device 2 is terminated; otherwise, the process proceeds to S312.

[0079] As described above, according to the second embodiment, the subject to which the multiple imaging devices are pointed is notified of at least one of the multiple camera directions corresponding to each of the multiple imaging devices. In this way, the subject 3 can easily grasp the direction of at least one of the multiple imaging devices and immediately take actions such as looking towards the grasped imaging device or posing. Although an example using two imaging devices has been described, three or more imaging devices may also be used.

[0080] <Third Embodiment> A third embodiment of the present invention will now be described. In the following description, configurations and processes similar to those of the first embodiment will be omitted, and configurations and processes different from those of the first embodiment will be described.

[0081] In the first embodiment, the positions of the imaging device 1 and the wearable device 2 are obtained using GPS. However, in that case, GPS receivers must be installed on both the imaging device 1 and the wearable device 2. In the third embodiment, the positions of the imaging device 1 and the wearable device 2 are obtained without using GPS.

[0082] Figure 10 is a block diagram showing an example configuration of the imaging system according to the third embodiment. In the third embodiment, the imaging device 1 does not have the position acquisition unit 110 of the first embodiment (Figure 1), and the wearable device 2 does not have the position acquisition unit 210 of the first embodiment (Figure 1). Instead, the imaging device 1 has a 3D spatial recognition unit 111. The 3D spatial recognition unit 111 has a distance sensor and the like, and acquires (recognizes) distance information in the real space.

[0083] Figure 11 is a flowchart showing an example of the operation of the imaging system according to the third embodiment.

[0084] The operation of the imaging device 1 begins in response to user input to the control unit 108 of the imaging device 1.

[0085] In S1101 of Figure 11, the control unit 101 of the imaging device 1 acquires the shooting conditions and stores them in the primary storage unit 104.

[0086] In S1102, the control unit 101 uses the 3D spatial recognition unit 111 to acquire 3D spatial information indicating the arrangement of objects in real space and the distance from the imaging device 1 to the objects, and stores it in the primary storage unit 104.

[0087] In S1103, the control unit 101 uses the information processing unit 102 to acquire the camera position (X1, Y1, Z1), the necklace position (X2, Y2, Z2), and the orientation of the wearable device 2, and stores them in the primary storage unit 104. The camera position (X1, Y1, Z1), the necklace position (X2, Y2, Z2), and the orientation of the wearable device 2 are acquired based on the three-dimensional spatial information stored in the primary storage unit 104.

[0088] In S1104, the control unit 101 uses the information processing unit 102 to determine the camera direction (direction 400 in Figure 4), which is the direction from the wearable device 2 (necklace position, subject 3 in Figure 4) towards the imaging device 1 (camera position). The camera direction 400 is determined based on the camera position (X1, Y1, Z1), the necklace position (X2, Y2, Z2), and the orientation of the wearable device 2 stored in the primary storage unit 104.

[0089] Furthermore, in S1104, the control unit 101 uses the information processing unit 102 to determine the imaging range 4 of the imaging device 1 shown in Figure 4 (the range where the centroid 401 (centroid position) is located at position (X3, Y3, Z3)). The imaging range 4 is determined based on the shooting conditions and camera position (X1, Y1, Z1) stored in the primary storage unit 104.

[0090] Then, if the wearable device 2 (necklace position, subject 3 in Figure 4) is within the imaging range 4, the control unit 101 stores the camera direction 400 in the primary storage unit 104. On the other hand, if the wearable device 2 is not within the imaging range 4, the control unit 101 stores information indicating that there is no camera direction 400 in the primary storage unit 104 so that the camera direction 400 is not notified.

[0091] In S1105, the control unit 101 uses the communication unit 103 to transmit the camera direction 400 stored in the primary storage unit 104 to the wearable device 2.

[0092] In S1107, the control unit 101 determines whether a termination operation, which is a user operation to terminate the operation of the imaging device 1, has been performed on the operation unit 108. If a termination operation has been performed, the operation of the imaging device 1 is terminated; otherwise, the process proceeds to S1101.

[0093] Similar to the imaging device 1, the wearable device 2 starts operating in response to user input on the control unit 208 of the wearable device 2.

[0094] In S1115, the control unit 201 receives the camera direction 400 from the imaging device 1 using the communication unit 203 and stores it in the primary storage unit 204.

[0095] In S1116, the control unit 201 uses the vibration unit 209 to notify the subject 3 wearing the wearable device 2 of the camera direction 400 stored in the primary storage unit 204.

[0096] In S1117, the control unit 201 determines whether a termination operation, which is a user operation to terminate the operation of the wearable device 2, has been performed on the operation unit 208. If a termination operation has been performed, the operation of the wearable device 2 is terminated; otherwise, the process proceeds to S1115.

[0097] As explained above, according to the third embodiment, the camera direction is determined without using GPS, and the subject is notified of the camera direction by vibration of the wearable device. In this way, even when using a wearable device that does not have a GPS receiver, the subject can easily grasp the direction of the imaging device that is taking pictures of them by the vibration of the wearable device. Consequently, the subject can immediately take actions such as looking towards the imaging device or striking a pose.

[0098] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). Multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) may share the processing to control the entire device.

[0099] Furthermore, the above-mentioned processors are processors in a broad sense, including general-purpose processors and specialized processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Specialized processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0100] Furthermore, although embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Moreover, each of the embodiments described above is merely one embodiment of the present invention, and it is possible to combine each embodiment as appropriate.

[0101] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit that implements one or more functions.

[0102] This embodiment includes the following configurations, methods, programs, and media. (Composition 1) An imaging system having an imaging device and a wearable device, A determination means for determining the camera direction, which is the direction from the wearable device toward the imaging device, When the wearable device is within the imaging range of the imaging device, a notification means is provided to notify the user wearing the wearable device of the camera direction by vibration of the wearable device. An imaging system characterized by having the following features. (Configuration 2) The notification means changes the vibration pattern of the wearable device according to the distance from the wearable device to the imaging device. The imaging system according to configuration 1, characterized by the features described above. (Composition 3) Detection means for detecting the user's state It further possesses, If the user's state is in a predetermined state, the notification means will not notify the user of the camera direction by vibration of the wearable device. The imaging system according to configuration 1 or 2, characterized by the above. (Composition 4) The predetermined state includes at least one of the following: the user is moving with an intensity greater than a predetermined threshold, the user is sleeping, and the user is having a conversation. The imaging system according to configuration 3, characterized by the features described above. (Composition 5) The notification means selects one or more notification methods, including vibration of the wearable device, and notifies the user of the camera direction using the selected notification method. An imaging system according to any one of configurations 1 to 4, characterized by the above. (Composition 6) The aforementioned multiple notification methods include at least one of the following: outputting sound, displaying images, changing temperature, and generating odors. The imaging system according to configuration 5, characterized in that... (Composition 7) The imaging system comprises the wearable device and a plurality of imaging devices. When the wearable device is within the imaging range of each of the plurality of imaging devices, the notification means notifies the user of at least one of the plurality of camera directions corresponding to each of the plurality of imaging devices. An imaging system according to any one of configurations 1 to 6, characterized by the above. (Composition 8) The notification means notifies the user of the multiple camera directions by vibrating the wearable device in multiple vibration patterns corresponding to each of the multiple camera directions. The imaging system according to configuration 7, characterized by the features described above. (Composition 9) The system further includes setting means for setting the priority of each of the aforementioned plurality of imaging devices, The notification means notifies the user of the camera direction among the plurality of camera directions that corresponds to an imaging device whose priority is greater than a predetermined threshold. The imaging system according to configuration 7, characterized by the features described above. (Composition 10) The setting means sets the priority of the imaging device based on at least one of the following: instructions from the user, the distance from the wearable device to the imaging device, and the composition of the image captured by the imaging device. The imaging system according to configuration 9, characterized by the features described herein. (Composition 11) The aforementioned imaging range is the focus range. An imaging system according to any one of configurations 1 to 10, characterized by the above. (Composition 12) If the imaging device is not taking a picture, the notification means will not notify the user of the camera direction. An imaging system according to any one of configurations 1 to 11, characterized by the above. (Composition 13) The imaging device in an imaging system having an imaging device and a wearable device, The aforementioned imaging system is: Determination means for determining the camera direction, which is the direction from the wearable device toward the imaging device. It has, The imaging device is Control means for notifying the user wearing the wearable device of the camera direction by vibration of the wearable device when the wearable device is within the imaging range of the imaging device. has An imaging device characterized by the following features. (Composition 14) An imaging system having an imaging device and a wearable device, wherein the wearable device is The aforementioned imaging system is: Determination means for determining the camera direction, which is the direction from the wearable device toward the imaging device. It has, The wearable device is When the wearable device is within the imaging range of the imaging device, a notification means provides the user wearing the wearable device with the camera direction via vibration of the wearable device. has A wearable device characterized by the following. (method) A control method for an imaging system having an imaging device and a wearable device, The steps include determining the camera direction, which is the direction from the wearable device toward the imaging device, When the wearable device is within the imaging range of the imaging device, the wearable device vibrates to notify the user wearing the wearable device of the camera direction. A control method characterized by having the following features. (program) A program for causing a computer to function as one of the means of an imaging system described in any of configurations 1 to 12. (medium) A computer-readable storage medium storing a program for causing the computer to function as one of the means of the imaging system described in any of configurations 1 to 12. [Explanation of Symbols]

[0103] 1: Imaging device 2: Wearable device 101,201: Control unit

Claims

1. An imaging system having an imaging device and a wearable device, A determination means for determining the camera direction, which is the direction from the wearable device toward the imaging device, When the wearable device is within the imaging range of the imaging device, a notification means is provided to notify the user wearing the wearable device of the camera direction by vibration of the wearable device. An imaging system characterized by having the following features.

2. The notification means changes the vibration pattern of the wearable device according to the distance from the wearable device to the imaging device. The imaging system according to feature 1.

3. Detection means for detecting the user's state It further possesses, If the user's state is in a predetermined state, the notification means will not notify the user of the camera direction by vibration of the wearable device. The imaging system according to feature 1.

4. The predetermined state includes at least one of the following: the user is moving with an intensity greater than a predetermined threshold, the user is sleeping, and the user is having a conversation. The imaging system according to claim 3.

5. The notification means selects one or more notification methods, including vibration of the wearable device, and notifies the user of the camera direction using the selected notification method. The imaging system according to feature 1.

6. The aforementioned multiple notification methods include at least one of the following: outputting sound, displaying images, changing temperature, and generating odors. The imaging system according to feature 5.

7. The imaging system comprises the wearable device and a plurality of imaging devices. When the wearable device is within the imaging range of each of the plurality of imaging devices, the notification means notifies the user of at least one of the plurality of camera directions corresponding to each of the plurality of imaging devices. The imaging system according to feature 1.

8. The notification means notifies the user of the multiple camera directions by vibrating the wearable device in multiple vibration patterns corresponding to each of the multiple camera directions. The imaging system according to feature 7.

9. The system further includes setting means for setting the priority of each of the aforementioned plurality of imaging devices, The notification means notifies the user of the camera direction corresponding to the imaging device whose priority is greater than a predetermined threshold among the plurality of camera directions. The imaging system according to feature 7.

10. The setting means is based on at least one of the following: instructions from the user, the distance from the wearable device to the imaging device, and the composition of the image captured by the imaging device. Next, set the priority of the imaging device. The imaging system according to feature 9.

11. The aforementioned imaging range is the focus range. The imaging system according to feature 1.

12. If the imaging device is not taking a picture, the notification means will not notify the user of the camera direction. The imaging system according to feature 1.

13. The imaging device in an imaging system having an imaging device and a wearable device, The aforementioned imaging system is: Determination means for determining the camera direction, which is the direction from the wearable device toward the imaging device. It has, The imaging device is Control means for notifying the user wearing the wearable device of the camera direction by vibration of the wearable device when the wearable device is within the imaging range of the imaging device. has An imaging device characterized by the following features.

14. An imaging system having an imaging device and a wearable device, wherein the wearable device is The aforementioned imaging system is: Determination means for determining the camera direction, which is the direction from the wearable device toward the imaging device. It has, The wearable device is When the wearable device is within the imaging range of the imaging device, a notification means provides the user wearing the wearable device with the camera direction via vibration of the wearable device. has A wearable device characterized by the following.

15. A control method for an imaging system having an imaging device and a wearable device, The steps include determining the camera direction, which is the direction from the wearable device toward the imaging device, When the wearable device is within the imaging range of the imaging device, the wearable device vibrates to notify the user wearing the wearable device of the camera direction. A control method characterized by having the following features.

16. A program for causing a computer to function as one of the means of the imaging system described in any one of claims 1 to 12.

17. A computer-readable storage medium storing a program for causing a computer to function as one of the means of the imaging system described in any one of claims 1 to 12.

Images