Imaging system, imaging device, and wearable device

Abstract

This technology provides a way to effectively inform the subject of the direction of the imaging device. [Solution] The imaging system of the present invention is an imaging system having an imaging device and a wearable device, characterized by comprising: a first determination means for determining a camera direction which is the direction from the wearable device toward the imaging device; an acquisition means for acquiring information relating to the type of subject on which the wearable device is attached; a second determination means for determining a method for notifying the camera direction based on the information acquired by the acquisition means; and a notification means for notifying the subject of the camera direction determined by the first determination means from the wearable device using the notification method determined by the second determination means.

Description

Technical Field

[0001] The present invention relates to an imaging system, an imaging device, and a wearable device, and particularly to a technology for linking an imaging device and a wearable device.

Background Art

[0002] As a wearable device, there is one capable of presenting haptics. By presenting haptics, various information can be presented to the body of the user who has come into contact with the wearable device. As haptic presentation, for example, tactile presentation that presents force or movement by vibration or pressure, or thermosensory presentation is performed.

[0003] Patent Document 1 discloses a technology in which a receiver receives radio waves from a transmitter of a camera and notifies the user (subject) of the receiver that shooting is being performed by the camera by vibration, sound, image, or the like.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the conventional technology disclosed in Patent Document 1, only the fact that shooting is being performed by the camera is notified to the subject, and even if such conventional technology is used, the direction of the camera (imaging device) cannot be effectively notified to the subject.

[0006] An object of the present invention is to provide a technology capable of effectively notifying a subject of the direction of an imaging device.

Means for Solving the Problems

[0007] A first aspect of the present invention is an imaging system having an imaging device and a wearable device, characterized by comprising: a first determination means for determining a camera direction which is the direction from the wearable device toward the imaging device; an acquisition means for acquiring information relating to the type of subject on which the wearable device is attached; a second determination means for determining a method for notifying the camera direction based on the information acquired by the acquisition means; and a notification means for notifying the subject of the camera direction determined by the first determination means from the wearable device using the notification method determined by the second determination means.

[0008] A second aspect of the present invention is an imaging device in an imaging system having an imaging device and a wearable device, wherein the imaging system comprises: a first determination means for determining a camera direction which is the direction from the wearable device toward the imaging device; an acquisition means for acquiring information relating to the type of subject on which the wearable device is attached; a second determination means for determining a method for notifying the camera direction based on the information acquired by the acquisition means; and a notification means for notifying the subject of the camera direction determined by the first determination means from the wearable device by the notification method determined by the second determination means, wherein the imaging device comprises the acquisition means and the second determination means.

[0009] A third aspect of the present invention is an imaging system having an imaging device and a wearable device, wherein the imaging system captures images from the wearable device. A wearable device comprising: a first determination means for determining the camera direction which is the direction toward the device; an acquisition means for acquiring information about the type of subject on which the wearable device is attached; a second determination means for determining a method for notifying the camera direction based on the information acquired by the acquisition means; and a notification means for notifying the subject of the camera direction determined by the first determination means from the wearable device using the notification method determined by the second determination means, wherein the wearable device is characterized by having the notification means.

[0010] A fourth aspect of the present invention is a control method for an imaging system having an imaging device and a wearable device, characterized by comprising: a first determination step of determining a camera direction which is the direction from the wearable device toward the imaging device; an acquisition step of acquiring information relating to the type of subject on which the wearable device is attached; a second determination step of determining a method for notifying the camera direction based on the information acquired in the acquisition step; and a notification step of notifying the subject of the camera direction determined in the first determination step from the wearable device using the notification method determined in the second determination step.

[0011] A fifth aspect of the present invention is a program for causing a computer to function as each of the means of the imaging system described above. A sixth aspect of the present invention is a computer-readable storage medium that stores a program for causing a computer to function as each of the means of the imaging system described above. [Effects of the Invention]

[0012] According to the present invention, the direction of the imaging device can be effectively communicated to the subject. [Brief explanation of the drawing]

[0013] [Figure 1] This is a block diagram showing an example configuration of the imaging system according to the first embodiment. [Figure 2] This is an external view of the imaging device according to the first embodiment. [Figure 3] This flowchart shows an example of the operation of the imaging system according to the first embodiment. [Figure 4] This is a schematic diagram showing an example of a shooting scene according to the first embodiment. [Figure 5] This is a schematic diagram showing an example of a shooting scene according to the second embodiment. [Figure 6] This is a block diagram showing an example configuration of an imaging system according to the third embodiment. [Figure 7] It is a flowchart showing an operation example of an imaging system according to the third embodiment. [Figure 8] It is a schematic diagram showing an example of a shooting scene according to the third embodiment. [Figure 9] It is a schematic diagram showing an example of a shooting scene according to the fourth embodiment. [Figure 10] It is a block diagram showing a configuration example of an imaging system according to the fifth embodiment. [Figure 11] It is a flowchart showing an operation example of an imaging system according to the fifth embodiment.

MODE FOR CARRYING OUT THE INVENTION

[0014] <First Embodiment> The first embodiment of the present invention will be described. FIG. 1 is a block diagram showing a configuration example of an imaging system according to the first embodiment. The imaging system of FIG. 1 includes an imaging device 1 and a wearable device 2. FIGS. 2(A) and 2(B) are external views of the imaging device 1. FIG. 2(A) is a front view (front perspective view) of the imaging device 1, and FIG. 2(B) is a rear view of the imaging device 1.

[0015] The imaging device 1 includes a control unit 101, an information processing unit 102, a communication unit 103, a primary storage unit 104, a secondary storage unit 105, an imaging unit 106, a display unit 107, an operation unit 108, a position acquisition unit 109, a subject determination unit 110, and a notification method selection unit 111. These components are connected to a bus 112, and data transmission and reception between the components are performed via the bus 112.

[0016] The control unit 101 is, for example, a CPU, and controls each part of the imaging device 1. For example, the control unit 101 controls the information processing unit 102, the communication unit 103, the primary storage unit 104, the secondary storage unit 105, the imaging unit 106, the display unit 107, the operation unit 108, the position acquisition unit 109, the subject determination unit 110, the notification method selection unit 111, and the like.

[0017] The information processing unit 102 is a processing circuit (arithmetic unit) that performs various information processing (arithmetic processing). For example, the information processing unit 102 performs arithmetic processing on image data obtained by the imaging unit 106 (such as arithmetic processing to obtain various evaluation values ​​related to the image data). The information processing unit 102 also performs arithmetic processing on data obtained by the communication unit 103 and on position data obtained by the position acquisition unit 109.

[0018] The communication unit 103 is a communication interface that communicates with external devices.

[0019] The primary storage unit 104 is, for example, a DRAM, and temporarily stores data used by the control unit 101 and the information processing unit 102.

[0020] The secondary storage unit 105 is, for example, a flash memory, and stores data used by the control unit 101 and the information processing unit 102, as well as the processing results of the information processing unit 102 (for example, encoded recorded images).

[0021] The imaging unit 106 includes, for example, an optical lens, an image sensor, and an A / D converter, and converts light from the outside (subject) into digital data (image data).

[0022] The display unit 107 is a display that shows various images. The display unit 107 may also have a touch panel that accepts touch operations from the user (photographer) of the imaging device 1 using their finger or stylus.

[0023] The operation unit 108 has operating members that accept user input, such as buttons and dials. The touch panel mentioned above is also an example of an operating member. When a user input is performed on these operating members, the control unit 101 performs control corresponding to that user input. A signal corresponding to a user input to an external device may be acquired by the communication unit 103, and the control unit 101 may perform control corresponding to that signal.

[0024] The position acquisition unit 109 has, for example, a receiver for the Global Positioning System (GPS) and acquires the current position (position data) of the imaging device 1.

[0025] The subject detection unit 110 detects a subject from the image obtained by the imaging unit 106 (an image representing a subject wearing the wearable device 2) and determines the type of the detected subject, thereby acquiring type information regarding the type of subject. The method for detecting the subject and the method for determining the type of subject are not particularly limited, and various existing methods can be used for detecting the subject and determining the type of subject. The type information may also be input to the imaging device 1 by the photographer.

[0026] As will be described in detail later, in the first embodiment, the camera direction, which is the direction from the wearable device 2 toward the imaging device 1, is determined and notified to the subject. The notification method selection unit 111 determines the notification method for the camera direction based on the type information (type of subject) acquired by the subject determination unit 110. For example, a plurality of notification methods are predetermined, each associated with one or more types of subjects, and the notification method selection unit 111 selects a notification method from the plurality of notification methods that corresponds to the type of subject. One notification method may be determined (selected), or two or more notification methods may be determined (selected).

[0027] In the first embodiment, the imaging device 1 is assumed to be a camera (digital camera), but the imaging device 1 may be a smartphone or tablet device, etc. The imaging device 1 may also be an automatic camera. In addition to zooming and driving (changing) the iris, the imaging device 1 may be capable of rotating the angle of view around at least one of the pan axis, tilt axis, and roll axis. Rotation of the angle of view around the pan axis and tilt axis can be achieved by adjusting the angle of the entire optical system, including the optical lens and image sensor. Rotation of the angle of view around the roll axis can be achieved by adjusting the angle of the image sensor. The imaging device 1 may be capable of driving (moving) in at least one of the up and down, left and right, and forward and backward directions. The imaging device 1 itself may be capable of moving and rotating, like a drone. External equipment such as a movable pan / tilt head, such as a gimbal, may be detachable from the imaging device 1.

[0028] The wearable device 2 includes a control unit 201, an information processing unit 202, a communication unit 203, a primary storage unit 204, a secondary storage unit 205, an operation unit 208, a position acquisition unit 209, a first notification unit 210, a second notification unit 211, a third notification unit 212, and a fourth notification unit 213. These components are connected to a bus 214, and data is transmitted and received between the components via the bus 214.

[0029] The control unit 201 is, for example, a CPU and controls various parts of the wearable device 2. For example, the control unit 201 controls the information processing unit 202, the communication unit 203, the primary storage unit 204, the secondary storage unit 205, the operation unit 208, the position acquisition unit 209, the first notification unit 210, the second notification unit 211, the third notification unit 212, the fourth notification unit 213, and so on.

[0030] The information processing unit 202 is a processing circuit (arithmetic unit) that performs various information processing (arithmetic processing). For example, the information processing unit 202 performs arithmetic processing on data obtained by the communication unit 203 and arithmetic processing on position data obtained by the position acquisition unit 209.

[0031] The communication unit 203 is a communication interface that communicates with external devices.

[0032] The primary storage unit 204 is, for example, a DRAM, and temporarily stores data used by the control unit 201 and the information processing unit 202.

[0033] The secondary storage unit 205 is, for example, a flash memory, and stores data used by the control unit 201 and the information processing unit 202, as well as the processing results of the information processing unit 202.

[0034] The operation unit 208 has operating members that accept user input, such as buttons and dials. When a user input is performed on these operating members, the control unit 201 performs control corresponding to that user input. A signal corresponding to a user input to an external device may be acquired by the communication unit 203, and the control unit 201 may perform control corresponding to that signal.

[0035] The position acquisition unit 209 has, for example, a GPS receiver and acquires the current location (location data) of the wearable device 2.

[0036] The first notification unit 210, the second notification unit 211, the third notification unit 212, and the fourth notification unit 213 are notification units that provide notifications to the user (subject) wearing the wearable device 2. The first notification unit 210, the second notification unit 211, the third notification unit 212, and the fourth notification unit 213 correspond to different notification methods.

[0037] The first notification unit 210 is a vibrating unit that vibrates the wearable device 2. For example, the first notification unit 210 vibrates a part of the wearable device 2, thereby alerting the wearable device 2 The device can notify the subject wearing it of its direction, and by changing the part that vibrates, the direction in which the subject is notified can be changed.

[0038] The second notification unit 211 is an audio output unit that outputs sound. For example, the second notification unit 211 can notify a subject wearing the wearable device 2 of the direction by outputting words indicating direction as sound. In addition, the second notification unit 211 can notify a subject who does not understand words of the direction by outputting sound so that it can be heard from a specific direction.

[0039] The third notification unit 212 is a display unit that displays images. For example, the third notification unit 212 can notify a subject wearing the wearable device 2 of the direction by displaying icons or text that indicate the direction.

[0040] The fourth notification unit 213 is an odor generating unit that emits an odor (smell / scent). For example, the fourth notification unit 213 can notify a subject wearing the wearable device 2 of the direction by emitting an odor in a specific direction.

[0041] Notification methods are not limited to vibration, sound output, image display, and odor generation. For example, notification methods may include temperature changes. By changing (raising / lowering) the temperature of a part of the wearable device 2, the direction can be notified to the subject wearing the wearable device 2.

[0042] In the first embodiment, the user (subject) wearing the wearable device 2 is assumed to be an animal (dog), and the wearable device 2 is assumed to be a collar-type device. However, the wearable device 2 may be any other device that makes contact with the user's (subject's) skin over a relatively wide area. For example, the wearable device 2 may be a harness-type device. If the user (subject) is a person, the wearable device 2 may be a necklace-type device, a glove-type device, a wristband-type device, a belt-type device, etc. The wearable device 2 may also be a smartwatch, a smartphone, a head-mounted display (HMD), etc. The wearable device 2 may be a non-contact device that can notify the user's (subject's) direction using ultrasound or the like without making contact with their skin. The wearable device 2 may also be a device that can make the user feel a pulling force.

[0043] Figure 3 is a flowchart illustrating an example of the operation of the imaging system according to the first embodiment. Figures 4(A) and 4(B) are schematic diagrams showing an example of a shooting scene according to the first embodiment. Here, the photographer wants to guide the dog 3, which is the subject, from the state in Figure 4(A) where the dog is not facing the imaging device 1, to face the imaging device 1, and then photograph the dog 3 in the state in Figure 4(B) where the dog 3 is facing the imaging device 1. In Figures 4(A) and 4(B), the wearable device 2 worn by the dog 3 is a collar-type device.

[0044] The operation of the imaging device 1 begins in response to user input to the control unit 108 of the imaging device 1.

[0045] In step S301 of Figure 3, the control unit 101 of the imaging device 1 acquires shooting conditions such as the shooting angle of view, focus range, and shooting status, and stores them in the primary storage unit 104. The shooting status can be standby, still image shooting, or video shooting.

[0046] In S302, the control unit 101 uses the position acquisition unit 109 to acquire the camera position (X1, Y1, Z1), which is the current position of the imaging device 1, and stores it in the primary storage unit 104.

[0047] In S303, the control unit 101 uses the subject determination unit 110 to determine the type of subject and stores the determination result (type information related to the determined type) in the primary storage unit 104. For example, in the state shown in Figures 4(A) and 4(B), the subject is determined to be an animal (dog).

[0048] In S304, the control unit 101 uses the notification method selection unit 111 to determine (select) the notification method to be used when notifying the subject, and stores it in the primary storage unit 104. The notification method is determined (selected) based on the type of subject determined in S303. The wearable device 2 has a first notification unit 210 which is a vibration unit, a second notification unit 211 which is an audio output unit, a third notification unit 212 which is a display unit, and a fourth notification unit 213 which is an odor generation unit, as notification units that notify the user (subject) wearing the wearable device 2. For animals, the effect of notification by displaying an image is considered to be low. Therefore, if it is determined in S303 that the subject is an animal, it is preferable to determine (select) a notification method other than displaying an image. Also, for animals, it is considered that notification by generating vibration or odor is highly effective. Therefore, if it is determined in S303 that the subject is an animal, it is preferable to determine (select) at least one of generating vibration or generating odor as the notification method. Here, it is assumed that both the generation of vibration (first notification unit 210) and the generation of odor (fourth notification unit 213) have been determined (selected). The determination (selection) of the notification method may be interpreted as the determination (selection) of the notification unit.

[0049] In S305, the control unit 101 uses the communication unit 103 to transmit the camera position (X1, Y1, Z1) and notification method stored in the primary storage unit 104 to the wearable device 2.

[0050] In S306, the control unit 101 determines whether a termination operation, which is a user operation to terminate the operation of the imaging device 1, has been performed on the operation unit 108. If a termination operation has been performed, the operation of the imaging device 1 is terminated; otherwise, the process proceeds to S301.

[0051] Similar to the imaging device 1, the wearable device 2 starts operating in response to user input on the control unit 208 of the wearable device 2.

[0052] In S312, the control unit 201 of the wearable device 2 uses the position acquisition unit 209 to acquire the subject position (X2, Y2, Z2), which is the current position of the wearable device 2, and stores it in the primary storage unit 204.

[0053] In S313, the control unit 201 uses the communication unit 203 to receive the camera position (X1, Y1, Z1) and notification method from the imaging device 1 and stores them in the primary storage unit 204.

[0054] In S314, the control unit 201 uses the information processing unit 202 to determine the camera direction (direction 400 in Figures 4(A) and 4(B)), which is the direction from the wearable device 2 (subject position, dog 3 in Figures 4(A) and 4(B)) towards the imaging device 1 (camera position). The camera direction 400 is determined based on the camera position (X1, Y1, Z1) and subject position (X2, Y2, Z2) stored in the primary storage unit 204. The control unit 201 then stores the camera direction in the primary storage unit 204.

[0055] In S315, the control unit 201 uses the information processing unit 202 to check the notification method received in S313. If the notification method includes the generation of vibration, the process in S316-1 is performed. If the notification method includes the output of sound, the process in S316-2 is performed. If the notification method includes the display of an image, the process in S316-3 is performed. If the notification method includes the generation of an odor, the process in S316-4 is performed.

[0056] In S316-1, the control unit 201 uses the first notification unit 210, which is a vibration unit, to notify the user (subject) wearing the wearable device 2 of the camera direction determined in S314.

[0057] In S316-2, the control unit 201 uses the second notification unit 211, which is an audio output unit, to notify the user (subject) wearing the wearable device 2 of the camera direction determined in S314.

[0058] In S316-3, the control unit 201 uses the display unit, the third notification unit 212, to notify the user (subject) wearing the wearable device 2 of the camera direction determined in S314.

[0059] In S316-4, the control unit 201 uses the fourth notification unit 213, which is an odor generating unit, to notify the user (subject) wearing the wearable device 2 of the camera direction determined in S314.

[0060] Here, we assume that the notification method received in S313 includes the generation of vibration and the generation of odor, and that the processes in S316-1 and S316-4 are performed. For example, in the state shown in Figure 4(A), the part of the wearable device 2 corresponding to the camera direction 400 (for example, the part closest to the imaging device 1) vibrates, or an odor that the dog 3 likes is emitted in the camera direction 400. An odor that the dog 3 dislikes may be emitted in all directions other than the camera direction 400. As a result, the camera direction 400 is notified to the dog 3, and as shown in Figure 4(B), the dog 3 turns towards the camera direction 400, allowing the photographer to take the desired image with the imaging device 1.

[0061] In S317, the control unit 201 determines whether a termination operation, which is a user operation to terminate the operation of the wearable device 2, has been performed on the operation unit 208. If a termination operation has been performed, the operation of the wearable device 2 is terminated; otherwise, the process proceeds to S312.

[0062] The camera direction 400 notification may or may not be given at all during the operation shown in Figure 3. For example, the camera direction 400 notification may be stopped when the subject faces the camera or when a predetermined user operation (e.g., a shooting instruction by the photographer) is performed.

[0063] The operation shown in Figure 3 may or may not occur while the camera is waiting to start shooting. For example, the photographer may want to shoot a video of the subject turning towards the imaging device 1. In that case, the operation shown in Figure 3 may be started during video recording, in response to the photographer instructing the imaging device 1 to start the operation shown in Figure 3.

[0064] At least one of the multiple processes (multiple controls) described as being performed by the wearable device 2 may be performed by the imaging device 1 or by other external devices such as a cloud server. Similarly, at least one of the multiple processes (multiple controls) described as being performed by the imaging device 1 may be performed by the wearable device 2 or by other external devices such as a cloud server. For example, the wearable device 2 may transmit necessary information to the imaging device 1, and the information processing unit 102 of the imaging device 1 may determine the camera direction 400.

[0065] <Second Embodiment> A second embodiment of the present invention will now be described. In the following description, configurations and processes similar to those of the first embodiment will be omitted, and configurations and processes different from those of the first embodiment will be described.

[0066] Figure 5 is a schematic diagram showing an example of a shooting scene according to the second embodiment. In this scene, the photographer directs the subject, a visually impaired person 4, to face the direction of the imaging device 1, which is a drone 5. The goal is to guide the subject to take an image. In Figure 5, the wearable device 2 worn by the visually impaired person 4 is a necklace-type device. The operation of the imaging system according to the second embodiment is the same as the operation of the imaging system according to the first embodiment (Figure 3).

[0067] In the state shown in Figure 5, at S303, it is determined that the subject is a visually impaired person. Whether or not someone is visually impaired can be determined, for example, by whether or not they are carrying a white cane. For visually impaired people, notification by displaying an image is considered to be less effective. Therefore, if it is determined at S303 that the subject is a visually impaired person, it is preferable to determine (select) a notification method other than displaying an image at S304. Furthermore, it is considered that notification by generating vibrations or outputting sound is more effective for visually impaired people. Therefore, if it is determined at S303 that the subject is a visually impaired person, it is preferable to determine (select) at least one of generating vibrations or outputting sound as the notification method at S304. Here, we assume that both generating vibrations (first notification unit 210) and outputting sound (second notification unit 211) have been determined (selected).

[0068] In the state shown in Figure 5, the camera direction 500 is determined in S314. The wearable device 2 notifies the visually impaired person 4 of the camera direction 500 using the notification method received in S313. Here, the notification method received in S313 includes the generation of vibration and the output of sound, and the processes in S316-1 and S316-2 are performed. For example, the part of the wearable device 2 corresponding to the camera direction 500 may vibrate, or a word representing the camera direction 500 may be output as sound. The sound may also be output to the visually impaired person 4 so that it can be heard from the camera direction 500. For example, the sound may be output from the part of the wearable device 2 corresponding to the camera direction 500. As a result, the camera direction 500 is notified to the visually impaired person 4, the person 4 faces the camera direction 500, and the photographer can take the desired shot with the imaging device 1 (drone 5).

[0069] Although the example described was for a visually impaired person, if the subject is a hearing-impaired person, it is preferable to determine (select) a notification method other than audio output in S304.

[0070] <Third Embodiment> A third embodiment of the present invention will now be described. In the following description, configurations and processes similar to those of the first embodiment will be omitted, and configurations and processes different from those of the first embodiment will be described.

[0071] Figure 6 is a block diagram showing an example configuration of the imaging system according to the third embodiment. The imaging device 1 according to the third embodiment has the same components as the imaging device 1 according to the first embodiment. Furthermore, the imaging device 1 according to the third embodiment has a notification target selection unit 113. The wearable device 2 according to the third embodiment has the same components as the wearable device 2 according to the first embodiment. When there are multiple subjects, each wearing the wearable device 2, the notification target selection unit 113 selects one or more subjects from the multiple subjects as notification targets in the direction of the camera.

[0072] Figure 7 is a flowchart showing an example of the operation of the imaging system according to the third embodiment. Figure 8 is a schematic diagram showing an example of a shooting scene according to the third embodiment. Here, the photographer wants to take a picture of the baby 6-1 facing the imaging device 1, while not guiding the father 6-2, who are the subjects of the baby 6-1 and the imaging device 1. In Figure 8, the wearable device 2-1 worn by the baby 6-1 is a bib-type device, and the wearable device 2-2 worn by the father 6-2 is a necklace-type device.

[0073] The operation of the imaging device 1 begins in response to user input to the control unit 108 of the imaging device 1.

[0074] In S701 of Figure 7, the control unit 101 of the imaging device 1 acquires the shooting conditions and stores them in the primary storage unit 104.

[0075] In S702, the control unit 101 uses the position acquisition unit 109 to acquire the camera position (X1, Y1, Z1) and stores it in the primary storage unit 104.

[0076] In S703, the control unit 101 uses the subject determination unit 110 to determine the type of subject and stores the determination result in the primary storage unit 104. For example, in the state shown in Figure 8, it is determined that there is a baby and an adult as subjects. The baby 6-1 is determined to be a baby, and the father 6-2 is determined to be an adult.

[0077] In S707, the control unit 101 uses the notification target selection unit 113 to determine (select) the notification target in the camera direction. The notification target may be specified in advance by the photographer, or it may be automatically determined (selected) by the imaging device 1. Here, it is assumed that the baby 6-1 has been determined (selected) as the notification target.

[0078] In S704, the control unit 101 uses the notification method selection unit 111 to determine (select) the notification method and stores it in the primary storage unit 104. For infants, the effectiveness of notifications by displaying images or emitting odors is considered low, while notifications by generating vibrations or outputting sound are considered high. Therefore, if an infant is determined (selected) as the target of notification in S707, it is preferable to determine (select) at least one of the vibration generation and sound output as the notification method. Here, it is assumed that both the vibration generation (first notification unit 210) and sound output (second notification unit 211) have been determined (selected).

[0079] In S705, the control unit 101 uses the communication unit 103 to transmit the camera position (X1, Y1, Z1) and notification method stored in the primary storage unit 104 to the wearable device 2 worn by the subject to be notified. Here, the camera position (X1, Y1, Z1) and notification method are not transmitted to the wearable device 2-2 worn by the father 6-2, who is not the subject to notification, but are transmitted to the wearable device 2-1 worn by the baby 6-1, who is the subject to notification.

[0080] In S706, the control unit 101 determines whether or not a termination operation has been performed on the operation unit 108. If a termination operation has been performed, the operation of the imaging device 1 is terminated; otherwise, the process proceeds to S701.

[0081] Similar to the imaging device 1, the wearable device 2 starts operating in response to user input on the control unit 208 of the wearable device 2.

[0082] In S712, the control unit 201 of the wearable device 2 uses the position acquisition unit 209 to acquire the subject's position (X2, Y2, Z2) and stores it in the primary storage unit 204.

[0083] In S713, the control unit 201 uses the communication unit 203 to receive the camera position (X1, Y1, Z1) and notification method from the imaging device 1 and stores them in the primary storage unit 204. Here, it is assumed that the wearable device 2-2 worn by the father 6-2, who is not the target of notification, does not receive the camera position (X1, Y1, Z1) and notification method. It is assumed that the wearable device 2-1 worn by the baby 6-1, who is the target of notification, does receive the camera position (X1, Y1, Z1) and notification method. If the camera position (X1, Y1, Z1) and notification method are not received, the processing in S714, S715, and S716-1 to S716-4 described later is omitted. It will be abbreviated.

[0084] In S714, the control unit 201 uses the information processing unit 202 to determine the camera direction (direction 800 in Figure 8) and stores it in the primary storage unit 204.

[0085] In S715, the control unit 201 uses the information processing unit 202 to check the notification method received in S713. If the notification method includes the generation of vibration, the process in S716-1 is performed. If the notification method includes the output of sound, the process in S716-2 is performed. If the notification method includes the display of an image, the process in S716-3 is performed. If the notification method includes the generation of an odor, the process in S716-4 is performed.

[0086] In S716-1, the control unit 201 uses the first notification unit 210, which is a vibration unit, to notify the user (subject) wearing the wearable device 2 of the camera direction determined in S714.

[0087] In S716-2, the control unit 201 uses the second notification unit 211, which is an audio output unit, to notify the user (subject) wearing the wearable device 2 of the camera direction determined in S714.

[0088] In S716-3, the control unit 201 uses the third notification unit 212, which is a display unit, to notify the user (subject) wearing the wearable device 2 of the camera direction determined in S714.

[0089] In S716-4, the control unit 201 uses the fourth notification unit 213, which is an odor generating unit, to notify the user (subject) wearing the wearable device 2 of the camera direction determined in S714.

[0090] Here, it is assumed that a notification method including vibration and sound output is received by the wearable device 2-1 worn by the baby 6-1 who is the target of the notification, and the processing of S716-1 and S716-2 is performed. For example, the part of the wearable device 2-2 corresponding to the camera direction 800 vibrates, or a sound that the baby is interested in is output to the baby 6-1 so that it can be heard from the camera direction 800. As a result, the camera direction 800 is notified to the baby 6-1, the baby 6-1 turns towards the camera direction 800, and the photographer can take the desired picture with the imaging device 1.

[0091] In S717, the control unit 201 determines whether a termination operation has been performed on the operation unit 208. If a termination operation has been performed, the wearable device 2 terminates its operation; otherwise, the process proceeds to S712.

[0092] <Fourth Embodiment> A fourth embodiment of the present invention will now be described. Note that in the following description, configurations and processes similar to those of the third embodiment will be omitted, and configurations and processes different from those of the third embodiment will be described.

[0093] Figure 9 is a schematic diagram showing an example of a shooting scene according to the fourth embodiment. Sometimes it is necessary to guide multiple people to different locations. For example, in a disaster area, it is necessary to guide evacuees to evacuation sites and rescue workers to the disaster area where those being rescued are located. Here, it is assumed that the subject, evacuee 7-1, is to be guided toward the imaging device 1, which is drone 5-1, and the subject, rescue worker 7-2, is to be guided toward another imaging device 1, which is drone 5-2. It is assumed that evacuee 7-1 is a visually impaired evacuee. In Figure 9, wearable device 2-1 is worn by evacuee 7-1, and wearable device 2-1 is worn by rescue worker 7-2. The wearable device 2-2 is a necklace-type device. The operation of the imaging system according to the fourth embodiment is the same as the operation of the imaging system according to the third embodiment (Figure 7).

[0094] In the state shown in Figure 9, at S703, it is determined that there are a visually impaired evacuee and a rescue worker as subjects. Evacuee 7-1 is determined to be a visually impaired evacuee, and rescue worker 7-2 is determined to be a rescue worker. Whether or not someone is a rescue worker is determined based on factors such as whether or not they are wearing a helmet or a rescue suit. Whether or not someone is visually impaired is determined by factors such as whether or not they are carrying a white cane.

[0095] In Drone 5-1, in S707, evacuee 7-1 is determined (selected) as the person to be notified, and in Drone 5-2, in S707, rescue worker 7-2 is determined (selected) as the person to be notified.

[0096] As explained in the second embodiment, for visually impaired individuals, notification by displaying images is considered to be less effective, while notification by generating vibrations or outputting sound is considered to be more effective. Therefore, in drone 5-1, at S704, the notification method is determined (selected) as either generating vibrations (first notification unit 210) or outputting sound (second notification unit 211). Then, at S705, the camera position (position of drone 5-1) and the notification method (generation of vibrations and outputting sound) are transmitted to the wearable device 2-1 worn by the evacuee 7-1 who is the target of the notification.

[0097] For healthy individuals, notifications via vibration, sound output, and image display are considered highly effective. Therefore, in drone 5-2, at S704, the notification method is determined (selected) as vibration generation (first notification unit 210), sound output (second notification unit 211), and image display (third notification unit 212). Then, at S705, the camera position (position of drone 5-2) and the notification method (vibration generation, sound output, and image display) are transmitted to the wearable device 2-2 worn by the rescue worker 7-2 who is the target of the notification.

[0098] In the state shown in Figure 9, the wearable device 2-1 worn by evacuee 7-1 determines the camera direction 900-1 toward the drone 5-1 in S714. Then, the wearable device 2-1 notifies evacuee 7-1 of the camera direction 900-1 using the notification method received in S713. Here, it is assumed that the notification method received in S713 includes the generation of vibration and the output of sound, and that the processing in S716-1 and S716-2 takes place. For example, the part of the wearable device 2-1 corresponding to the camera direction 900-1 vibrates, or a word representing the camera direction 900-1 is output as sound. Through these actions, the camera direction 900-1 is notified to evacuee 7-1, and evacuee 7-1 can be guided toward the camera direction 900-1.

[0099] In S714, the wearable device 2-2 worn by rescue worker 7-2 determines the camera direction 900-2 toward the drone 5-2. Then, in S713, the wearable device 2-2 notifies rescue worker 7-2 of the camera direction 900-2 using the notification method received. Here, the notification method received in S713 includes vibration, audio output, and image display, and the processing in S716-1, S716-2, and S716-3 is performed. For example, the part of the wearable device 2-2 corresponding to the camera direction 900-2 may vibrate, a word representing the camera direction 900-2 may be output as audio, or an arrow representing the camera direction 900-2 may be displayed. Through these means, the camera direction 900-2 is notified to rescue worker 7-2, and rescue worker 7-2 can be guided toward the camera direction 900-2.

[0100] <Fifth Embodiment> A fifth embodiment of the present invention will now be described. Note that in the following description, configurations and processes similar to those of the first embodiment will not be explained, and configurations and processes different from those of the first embodiment will be described.

[0101] In the first embodiment, the positions of the imaging device 1 and the wearable device 2 are obtained using GPS. However, in that case, GPS receivers must be installed on both the imaging device 1 and the wearable device 2. In the fifth embodiment, the positions of the imaging device 1 and the wearable device 2 are obtained without using GPS.

[0102] Figure 10 is a block diagram showing an example configuration of an imaging system according to the fifth embodiment. In the fifth embodiment, the imaging device 1 does not have the position acquisition unit 109 of the first embodiment (Figure 1), and the wearable device 2 does not have the position acquisition unit 209 of the first embodiment (Figure 1). Instead, the imaging device 1 has a three-dimensional spatial recognition unit 114. The three-dimensional spatial recognition unit 114 has a distance sensor and the like, and acquires (recognizes) distance information in the real space.

[0103] Figure 11 is a flowchart showing an example of the operation of the imaging system according to the fifth embodiment.

[0104] The operation of the imaging device 1 begins in response to user input to the control unit 108 of the imaging device 1.

[0105] In S1101 of Figure 11, the control unit 101 of the imaging device 1 acquires the shooting conditions and stores them in the primary storage unit 104.

[0106] In S1107, the control unit 101 uses the 3D spatial recognition unit 114 to acquire 3D spatial information indicating the arrangement of objects in real space and the distance from the imaging device 1 to the objects, and stores it in the primary storage unit 104.

[0107] In S1108, the control unit 101 uses the information processing unit 102 to acquire the camera position (X1, Y1, Z1), the subject position (X2, Y2, Z2), and the orientation of the wearable device 2, and stores them in the primary storage unit 104. The camera position (X1, Y1, Z1), the subject position (X2, Y2, Z2), and the orientation of the wearable device 2 are acquired based on the three-dimensional spatial information stored in the primary storage unit 104.

[0108] In S1109, the control unit 101 uses the information processing unit 102 to determine the camera direction and stores it in the primary storage unit 104. The camera direction is determined based on the camera position (X1, Y1, Z1), necklace position (X2, Y2, Z2), and orientation of the wearable device 2 stored in the primary storage unit 104.

[0109] In S1103, the control unit 101 uses the subject determination unit 110 to determine the type of subject and stores the determination result in the primary storage unit 104.

[0110] In S1104, the control unit 101 uses the notification method selection unit 111 to determine (select) the notification method and stores it in the primary storage unit 104.

[0111] In S1105, the control unit 101 uses the communication unit 103 to transmit the camera direction and notification method stored in the primary storage unit 104 to the wearable device 2.

[0112] In S1106, the control unit 101 determines whether or not a termination operation has been performed on the operation unit 108. If a termination operation has been performed, the operation of the imaging device 1 is terminated; otherwise, the process proceeds to S1101.

[0113] Similar to the imaging device 1, the wearable device 2 starts operating in response to user input on the control unit 208 of the wearable device 2.

[0114] In S1113, the control unit 201 receives the camera direction and notification direction from the imaging device 1 using the communication unit 203 and stores them in the primary storage unit 204.

[0115] In S1115, the control unit 201 uses the information processing unit 202 to check the notification method received in S1113. If the notification method includes the generation of vibration, the process in S1116-1 is performed. If the notification method includes the output of sound, the process in S1116-2 is performed. If the notification method includes the display of an image, the process in S1116-3 is performed. If the notification method includes the generation of an odor, the process in S1116-4 is performed.

[0116] In S1116-1, the control unit 201 uses the first notification unit 210, which is a vibration unit, to notify the user (subject) wearing the wearable device 2 of the camera direction received in S1113.

[0117] In S1116-2, the control unit 201 uses the second notification unit 211, which is an audio output unit, to notify the user (subject) wearing the wearable device 2 of the camera direction received in S1113.

[0118] In S1116-3, the control unit 201 uses the third notification unit 212, which is a display unit, to notify the user (subject) wearing the wearable device 2 of the camera direction received in S1113.

[0119] In S1116-4, the control unit 201 uses the fourth notification unit 213, which is an odor generating unit, to notify the user (subject) wearing the wearable device 2 of the camera direction received in S1113.

[0120] In S1117, the control unit 201 determines whether a termination operation has been performed on the operation unit 208. If a termination operation has been performed, the operation of the wearable device 2 is terminated; otherwise, the process proceeds to S1113.

[0121] According to each embodiment described above, the camera direction from the wearable device to the imaging device is determined, type information regarding the type of subject wearing the wearable device is acquired, and the camera direction is notified from the wearable device to the subject using a notification method based on the type information. In this way, the direction of the imaging device can be effectively notified to the subject.

[0122] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). Multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) may share the processing to control the entire device.

[0123] Furthermore, the above-mentioned processors are processors in a broad sense, including general-purpose processors and specialized processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Specialized processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Yes, there are. Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0124] Furthermore, although embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Moreover, each of the embodiments described above is merely one embodiment of the present invention, and it is possible to combine each embodiment as appropriate.

[0125] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit that implements one or more functions.

[0126] This embodiment includes the following configurations, methods, programs, and media. (Composition 1) An imaging system having an imaging device and a wearable device, A first determination means for determining the camera direction, which is the direction from the wearable device toward the imaging device, An acquisition means for acquiring information about the type of subject wearing the wearable device, A second determination means for determining a method for notifying the camera direction based on the information acquired by the acquisition means, The notification method determined by the second determination means includes a notification means for notifying the subject of the camera direction determined by the first determination means from the wearable device. An imaging system characterized by having the following features. (Configuration 2) Multiple notification methods are predetermined, each associated with one or more types of subjects. The second determination means selects a notification method from the plurality of notification methods that corresponds to the type of subject wearing the wearable device. The imaging system according to configuration 1, characterized by the features described above. (Composition 3) A selection means for selecting one or more subjects to be notified when there are multiple subjects, each wearing a wearable device. Furthermore, it has The imaging system according to configuration 1 or 2, characterized by the above. (Composition 4) When the multiple subjects include a baby and an adult, the selection means selects the baby as the subject of notification. The imaging system according to configuration 3, characterized by the features described above. (Composition 5) The second determination means determines, as the notification method, at least one of the following: the generation of vibration, the output of sound, the display of an image, the change in temperature, and the generation of an odor. An imaging system according to any one of configurations 1 to 4, characterized by the above. (Composition 6) If the subject is an animal, the second determination means determines, as the notification method, at least one of the occurrence of vibration and the occurrence of odor. An imaging system according to any one of configurations 1 to 5, characterized by the above. (Composition 7) If the subject is a visually impaired person, the second determination means determines that the notification method is not the display of an image. An imaging system according to any one of configurations 1 to 6, characterized by the above. (Composition 8) If the subject is a person with hearing impairment, the second determination means determines a notification method that does not involve outputting sound. An imaging system according to any one of configurations 1 to 7, characterized by the above. (Composition 9) If the subject is a baby, the second determination means determines, as the notification method, at least one of the occurrence of vibration and the output of sound. An imaging system according to any one of configurations 1 to 8, characterized by the above. (Composition 10) The imaging device in an imaging system having an imaging device and a wearable device, The aforementioned imaging system is: A first determination means for determining the camera direction, which is the direction from the wearable device toward the imaging device, An acquisition means for acquiring information about the type of subject wearing the wearable device, A second determination means for determining a method for notifying the camera direction based on the information acquired by the acquisition means, The notification method determined by the second determination means includes a notification means for notifying the subject of the camera direction determined by the first determination means from the wearable device. It has, The imaging device has the acquisition means and the second determination means. An imaging device characterized by the following features. (Composition 11) An imaging system having an imaging device and a wearable device, wherein the wearable device is The aforementioned imaging system is: A first determination means for determining the camera direction, which is the direction from the wearable device toward the imaging device, An acquisition means for acquiring information about the type of subject wearing the wearable device, A second determination means for determining a method for notifying the camera direction based on the information acquired by the acquisition means, The notification method determined by the second determination means includes a notification means for notifying the subject of the camera direction determined by the first determination means from the wearable device. It has, The wearable device has the notification means A wearable device characterized by the following. (method) A control method for an imaging system having an imaging device and a wearable device, A first determination step of determining the camera direction, which is the direction from the wearable device toward the imaging device, An acquisition step to acquire information regarding the type of subject wearing the wearable device, A second determination step in which a method for notifying the camera direction is determined based on the information obtained in the acquisition step, The notification method determined by the second decision step includes a notification step of notifying the subject of the camera direction determined by the first decision step from the wearable device; A control method characterized by having the following features. (program) A program for causing a computer to function as one of the means of an imaging system described in any of configurations 1 to 9. (medium) A computer-readable storage medium storing a program for causing the computer to function as one of the means of the imaging system described in any of configurations 1 to 9. [Explanation of Symbols]

[0127] 1: Imaging device 101: Control unit 102: Information processing unit 110: Subject judgment section 111: Notification method selection section 2: Wearable device 201: Control unit 202: Information processing unit 210: 1st notification section 211: 2nd notification section 212: 3rd Notification Department 213: 4th Notification Department

Claims

1. An imaging system having an imaging device and a wearable device, A first determination means for determining the camera direction, which is the direction from the wearable device toward the imaging device, An acquisition means for acquiring information about the type of subject wearing the wearable device, A second determination means for determining a method for notifying the camera direction based on the information acquired by the acquisition means, The notification method determined by the second determination means includes a notification means for notifying the subject of the camera direction determined by the first determination means from the wearable device. An imaging system characterized by having the following features.

2. Multiple notification methods are predetermined, each associated with one or more types of subjects. The second determination means selects a notification method from the plurality of notification methods that corresponds to the type of subject wearing the wearable device. The imaging system according to feature 1.

3. A selection means for selecting one or more subjects to be notified when there are multiple subjects, each wearing a wearable device. Furthermore, it has The imaging system according to feature 1.

4. When the multiple subjects include a baby and an adult, the selection means selects the baby as the subject of notification. The imaging system according to claim 3.

5. The second determination means determines, as the notification method, at least one of the following: the generation of vibration, the output of sound, the display of an image, the change in temperature, and the generation of an odor. The imaging system according to feature 1.

6. If the subject is an animal, the second determination means determines, as the notification method, at least one of the occurrence of vibration and the occurrence of odor. The imaging system according to feature 1.

7. If the subject is a visually impaired person, the second determination means determines that the notification method is not the display of an image. The imaging system according to feature 1.

8. If the subject is a person with hearing impairment, the second determination means determines a notification method that does not involve outputting sound. The imaging system according to feature 1.

9. If the subject is a baby, the second determination means determines, as the notification method, at least one of the generation of vibration and the output of sound. The imaging system according to feature 1.

10. The imaging device in an imaging system having an imaging device and a wearable device, The aforementioned imaging system is: The camera direction is determined to be the direction from the wearable device toward the imaging device.

1. Decision-making means, An acquisition means for acquiring information about the type of subject wearing the wearable device, A second determination means for determining a method for notifying the camera direction based on the information acquired by the acquisition means, The notification method determined by the second determination means includes a notification means for notifying the subject of the camera direction determined by the first determination means from the wearable device. It has, The imaging device has the acquisition means and the second determination means. An imaging device characterized by the following features.

11. An imaging system having an imaging device and a wearable device, wherein the wearable device is The aforementioned imaging system is: A first determination means for determining the camera direction, which is the direction from the wearable device toward the imaging device, An acquisition means for acquiring information about the type of subject wearing the wearable device, A second determination means for determining a method for notifying the camera direction based on the information acquired by the acquisition means, The notification method determined by the second determination means includes a notification means for notifying the subject of the camera direction determined by the first determination means from the wearable device. It has, The wearable device has the notification means A wearable device characterized by the following.

12. A control method for an imaging system having an imaging device and a wearable device, A first determination step of determining the camera direction, which is the direction from the wearable device toward the imaging device, An acquisition step to acquire information regarding the type of subject wearing the wearable device, A second determination step in which a method for notifying the camera direction is determined based on the information obtained in the acquisition step, The notification method determined by the second decision step includes a notification step of notifying the subject of the camera direction determined by the first decision step from the wearable device; A control method characterized by having the following features.

13. A program for causing a computer to function as one of the means of the imaging system described in any one of claims 1 to 9.

14. A computer-readable storage medium storing a program for causing the computer to function as each means of the imaging system described in any one of claims 1 to 9.

Images