Imaging system, imaging device, and wearable device
The imaging system guides users into the camera's field of view using a wearable device that determines a guidance position and direction, effectively addressing the challenge of users being out of range by vibrating to provide real-time direction.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- CANON KK
- Filing Date
- 2024-10-16
- Publication Date
- 2026-04-28
AI Technical Summary
Existing imaging systems fail to guide users outside the camera's imaging range to enter the field of view effectively, especially when the user is unaware of the camera's position.
An imaging system comprising an imaging device and a wearable device that determines a guidance position within the imaging range and direction, using the wearable device to notify the user through vibration to guide them into the field of view.
Enables users to immediately enter the imaging range by providing real-time guidance through vibrations, avoiding issues associated with auditory or visual notifications.
Smart Images

Figure 2026071089000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an imaging system, an imaging device, and a wearable device, and particularly to a technology for linking an imaging device and a wearable device.
Background Art
[0002] As wearable devices, there are those capable of haptic presentation. By haptic presentation, various information can be presented to the body of the user who has come into contact with the wearable device. As haptic presentation, for example, tactile presentation that presents force and movement by vibration, pressure, etc., and temperature presentation are performed.
[0003] Patent Document 1 discloses a technology in which a receiver receives radio waves from a transmitter of a camera and notifies the user of the receiver that shooting is being performed by the camera by vibration, sound, image, etc.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0005] However, in the prior art disclosed in Patent Document 1, it is only notified to the user that shooting is being performed by the camera. Therefore, even when using the prior art disclosed in Patent Document 1, when the user of the shooting target is outside the imaging range of the camera (imaging device) and does not know the position of the camera, the user cannot immediately enter the imaging range of the camera.
[0007] A first aspect of the present invention is an imaging system having an imaging device and a wearable device, characterized by comprising: a first determination means for determining a guidance position which is a position within the imaging range of the imaging device; a second determination means for determining a guidance direction which is a direction from the wearable device toward the guidance position; and a notification means for notifying a user wearing the wearable device of the guidance direction by vibration of the wearable device.
[0008] A second aspect of the present invention is an imaging system comprising an imaging device and a wearable device, wherein the imaging system comprises a first determination means for determining a guidance position which is a position within the imaging range of the imaging device, and a second determination means for determining a guidance direction which is a direction from the wearable device toward the guidance position, and the imaging device comprises a control means for controlling the wearable device to notify the user wearing the wearable device of the guidance direction by vibration of the wearable device.
[0009] A third aspect of the present invention is a wearable device in an imaging system having an imaging device and a wearable device, wherein the imaging system has a first determination means for determining a guidance position which is a position within the imaging range of the imaging device, and a second determination means for determining a guidance direction which is a direction from the wearable device toward the guidance position, and the wearable device has a notification means for notifying the user wearing the wearable device of the guidance direction by vibration of the wearable device.
[0010] A fourth aspect of the present invention is a control method for an imaging system having an imaging device and a wearable device, characterized by comprising the steps of: determining a guidance position which is a position within the imaging range of the imaging device; determining a guidance direction which is the direction from the wearable device toward the guidance position; and notifying a user wearing the wearable device of the guidance direction by vibration of the wearable device.
[0011] A fifth aspect of the present invention is a program for causing a computer to function as each of the means of the imaging system. A sixth aspect of the present invention is a computer-readable storage medium that stores a program for causing a computer to function as each of the means of the imaging system. [Effects of the Invention]
[0012] According to the present invention, the user being photographed can immediately enter the imaging range of the imaging device. [Brief explanation of the drawing]
[0013] [Figure 1] This is a block diagram showing an example configuration of the imaging system according to the first embodiment. [Figure 2] This is an external view of the imaging device according to the first embodiment. [Figure 3] This flowchart shows an example of the operation of the imaging system according to the first embodiment. [Figure 4] This is a schematic diagram showing an example of operation of the imaging system according to the first embodiment. [Figure 5] This is a schematic diagram showing an example of operation of a wearable device according to the first embodiment. [Figure 6] This is a schematic diagram showing an example of operation of the imaging system according to the first embodiment. [Figure 7] This is a schematic diagram showing an example of the display of an item according to the first embodiment. [Figure 8] This flowchart shows an example of the operation of the imaging system according to the second embodiment. [Figure 9] This is a schematic diagram showing an example of operation of the imaging system according to the second embodiment. [Figure 10] This flowchart shows an example of the operation of the imaging system according to the third embodiment. [Figure 11] This is a schematic diagram showing an example of the operation of the imaging system according to the third embodiment. [Modes for carrying out the invention]
[0014] <First Embodiment> The first embodiment of the present invention will be described. FIG. 1 is a block diagram showing a configuration example of an imaging system according to the first embodiment. The imaging system of FIG. 1 includes an imaging device 1 and a wearable device 2. FIGS. 2(A) and 2(B) are external views of the imaging device 1. FIG. 2(A) is a front view (front perspective view) of the imaging device 1, and FIG. 2(B) is a rear view of the imaging device 1.
[0015] The imaging device 1 includes a control unit 101, an information processing unit 102, a communication unit 103, a primary storage unit 104, a secondary storage unit 105, an imaging unit 106, a display unit 107, an operation unit 108, and a position acquisition unit 110. These components are connected to a bus 112, and data transmission and reception between the components are performed via the bus 112.
[0016] The control unit 101 is, for example, a CPU, and controls each part of the imaging device 1 (such as the information processing unit 102, the communication unit 103, the primary storage unit 104, the secondary storage unit 105, the imaging unit 106, the display unit 107, the operation unit 108, the position acquisition unit 110, etc.).
[0017] The information processing unit 102 is a processing circuit (arithmetic unit) that performs various information processing (arithmetic processing). For example, the information processing unit 102 performs arithmetic processing on the image data obtained by the imaging unit 1 (such as arithmetic processing for obtaining various evaluation values related to the image data). The information processing unit 102 also performs arithmetic processing on the data obtained by the communication unit 103 and the position data obtained by the position acquisition unit 110.
[0018] The communication unit 103 is a communication interface for communicating with external devices.
[0019] The primary storage unit 104 is, for example, a DRAM, and temporarily stores data used by the control unit 101 and the information processing unit 102.
[0020] The secondary storage unit 105 is, for example, a flash memory, and stores data used by the control unit 101 and the information processing unit 102, as well as the processing results of the information processing unit 102 (for example, encoded recorded images).
[0021] The imaging unit 106 includes, for example, an optical lens, an image sensor, and an A / D converter, and converts light from the outside (subject) into digital data (image data).
[0022] The display unit 107 is a display that shows various images. The display unit 107 may also have a touch panel that accepts touch operations from the user's finger or stylus.
[0023] The operation unit 108 has operating members that accept user input, such as buttons and dials. The touch panel mentioned above is also an example of an operating member. When a user input is performed on these operating members, the control unit 101 performs control corresponding to that user input. A signal corresponding to a user input to an external device may be acquired by the communication unit 103, and the control unit 101 may perform control corresponding to that signal.
[0024] The position acquisition unit 110 has, for example, a receiver for the Global Positioning System (GPS) and acquires the current position (position data) of the imaging device 1.
[0025] In the first embodiment, the imaging device 1 is assumed to be a camera (digital camera), but the imaging device 1 may be a smartphone or tablet device, etc. The imaging device 1 may also be an automatic camera. In addition to zooming and driving (changing) the iris, the imaging device 1 may be capable of rotating the angle of view around at least one of the pan axis, tilt axis, and roll axis. Rotation of the angle of view around the pan axis and tilt axis can be achieved by adjusting the angle of the entire optical system, including the optical lens and image sensor. Rotation of the angle of view around the roll axis can be achieved by adjusting the angle of the image sensor. The imaging device 1 may be capable of driving (moving) in at least one of the up and down, left and right, and forward and backward directions. The imaging device 1 itself may be capable of moving and rotating, like a drone. External equipment such as a movable pan / tilt head, such as a gimbal, may be detachable from the imaging device 1.
[0026] The wearable device 2 includes a control unit 201, an information processing unit 202, a communication unit 203, a primary storage unit 204, a secondary storage unit 205, an operation unit 208, a vibration unit 209, and a position acquisition unit 210. These components are connected to a bus 212, and data is transmitted and received between the components via the bus 212.
[0027] The control unit 201 is, for example, a CPU, which controls each part of the wearable device 2 (such as the information processing unit 202, the communication unit 203, the primary storage unit 204, the secondary storage unit 205, the operation unit 208, the vibration unit 209, the position acquisition unit 210, etc.).
[0028] The information processing unit 202 is a processing circuit (arithmetic unit) that performs various information processing (arithmetic processing). For example, the information processing unit 202 performs arithmetic processing on data obtained by the communication unit 203 and arithmetic processing on position data obtained by the position acquisition unit 210.
[0029] The communication unit 203 is a communication interface that communicates with external devices.
[0030] The primary storage unit 204 is, for example, a DRAM, and temporarily stores data used by the control unit 201 and the information processing unit 202.
[0031] The secondary storage unit 205 is, for example, a flash memory, and stores data used by the control unit 201 and the information processing unit 202, as well as the processing results of the information processing unit 202.
[0032] The operation unit 208 has operating members that accept user input, such as buttons and dials. When a user input is performed on these operating members, the control unit 201 performs control corresponding to that user input. A signal corresponding to a user input to an external device may be acquired by the communication unit 203, and the control unit 201 may perform control corresponding to that signal.
[0033] The vibrating unit 209 vibrates the wearable device 2. For example, the vibrating unit 209 can notify the user wearing the wearable device 2 of its direction by vibrating a part of the wearable device 2, and the direction to which the user is notified can be changed by changing the part that is vibrated.
[0034] The position acquisition unit 210 has, for example, a GPS receiver and acquires the current location (location data) of the wearable device 2.
[0035] In the first embodiment, the wearable device 2 is assumed to be a necklace-type device, but the wearable device 2 may be any other device that comes into contact with the user's skin over a relatively wide area. For example, the wearable device 2 may be a glove-type device, a wristband-type device, a belt-type device, etc. The wearable device 2 may also be a smartwatch, a smartphone, a head-mounted display (HMD), etc. The wearable device 2 may be a non-contact device that can notify the user of direction using ultrasound or the like without coming into contact with the user's skin. The wearable device 2 may not be merely a vibration device, but may be a device that can make the user feel a traction force.
[0036] Figure 3 is a flowchart illustrating an example of operation of the imaging system according to the first embodiment. Figure 4 is a schematic diagram showing an example of operation of the imaging system according to the first embodiment.
[0037] The operation of the imaging device 1 begins in response to user input to the control unit 108 of the imaging device 1.
[0038] In step S301 of Figure 3, the control unit 101 of the imaging device 1 acquires shooting conditions such as the shooting angle of view, focus range, and shooting status, and stores them in the primary storage unit 104.
[0039] In S302, the control unit 101 uses the position acquisition unit 110 to acquire the camera position (X1, Y1, Z1), which is the current position of the imaging device 1, and stores it in the primary storage unit 104.
[0040] In S303, the control unit 101 uses the communication unit 103 to transmit the shooting conditions and camera position (X1, Y1, Z1) stored in the primary storage unit 104 to the wearable device 2.
[0041] In S306, the control unit 101 determines whether a termination operation, which is a user operation to terminate the operation of the imaging device 1, has been performed on the operation unit 108. If a termination operation has been performed, the operation of the imaging device 1 is terminated; otherwise, the process proceeds to S301.
[0042] Similar to the imaging device 1, the wearable device 2 starts operating in response to user input on the control unit 208 of the wearable device 2.
[0043] In S312, the control unit 201 of the wearable device 2 uses the position acquisition unit 210 to acquire the necklace position (X2, Y2, Z2), which is the current position of the wearable device 2, and stores it in the primary storage unit 204.
[0044] In S313, the control unit 201 receives the shooting conditions and camera position (X1, Y1, Z1) from the imaging device 1 using the communication unit 203 and stores them in the primary storage unit 204.
[0045] In S314, the control unit 201 uses the information processing unit 202 to determine the guidance position, which is a position within the imaging range of the imaging device 1, and the guidance direction, which is the direction from the wearable device 2 toward the guidance position. Based on the shooting conditions and camera position (X1, Y1, Z1) stored in the primary storage unit 204, the control unit 201 determines the imaging range 4 of the imaging device 1 shown in Figure 4, and determines the centroid 401 (centroid position (X3, Y3, Z3)) of the imaging range 4 as the guidance position. In Figure 4, the imaging range 4 is assumed to be the focus range, but the imaging range 4 may be the entire range to be imaged or a part of the range to be imaged. The imaging range 4 may be narrower or wider than the focus range. The control unit 201 stores the imaging range 4 and the centroid 401 (centroid position (X3, Y3, Z3)) in the primary storage unit 204. The control unit 201 then determines a guidance direction 400 from the wearable device 2 (subject 3) toward the center of gravity 401 based on the necklace position (X2, Y2, Z2) and the center of gravity position (X3, Y3, Z3) stored in the primary memory unit 204. The control unit 201 also stores the guidance direction 400 in the primary memory unit 204. Subject 3 is the user of the wearable device 2.
[0046] Furthermore, if the necklace position (X2, Y2, Z2) and the center of gravity position (X3, Y3, Z3) coincide, the control unit 201 stores information indicating that there is no guidance direction 400 in the primary storage unit 204 so that the guidance direction 400 is not notified (described later). Information indicating that there is no guidance direction 400 may also be stored in the primary storage unit 204 when the imaging device 1 is in standby mode (not taking a picture).
[0047] In S315, the control unit 201 uses the vibration unit 209 to notify the subject 3 wearing the wearable device 2 of the guidance direction 400 stored in the primary storage unit 204. Figure 5 is a schematic diagram showing an example of the operation of the wearable device 2 in S315. The vibration unit 209 notifies the subject 3 of the guidance direction 400 by vibrating the location 500 corresponding to the guidance direction 400. For example, the notification stops when the subject 3 (wearable device 2) reaches the guidance position.
[0048] The vibration unit 209 may change the vibration pattern of the wearable device 2 (e.g., vibration intensity or vibration period) depending on the distance from the wearable device 2 to the guidance position. For example, the vibration unit 209 may vibrate the wearable device 2 with a stronger vibration intensity or a shorter vibration period the closer the wearable device 2 is to the guidance position. In this way, the subject 3 can grasp the sense of distance, such as whether it is close or far from the guidance position. The control unit 201 may notify the wearable device 2 of the distance from the wearable device 2 to the guidance position using a notification method different from the vibration of the wearable device 2. For example, if the wearable device 2 has a temperature generating unit, the control unit 201 may use the temperature generating unit to change the temperature of the wearable device 2 depending on the distance from the wearable device 2 to the guidance position.
[0049] In S316, the control unit 201 determines whether a termination operation, which is a user operation to terminate the operation of the wearable device 2, has been performed on the operation unit 208. If a termination operation has been performed, the operation of the wearable device 2 is terminated; otherwise, the process proceeds to S312.
[0050] As described above, according to the first embodiment, the guidance position within the imaging range 4 is determined, the guidance direction 400 from the wearable device 2 toward the guidance position is determined, and the guidance direction 400 is notified to the subject 3 by vibration of the wearable device 2. In this way, the subject 3 can immediately enter the imaging range 4. The position of the imaging device 1, the position of the wearable device 2, and the shooting conditions (imaging range 4, etc.) change moment by moment, but the guidance direction 400 is updated in real time, so the location 500 that the vibrating unit 209 vibrates also changes moment by moment. As a result, the subject 3 can grasp the guidance direction 400 (direction toward the guidance position) in real time.
[0051] If the guidance direction 400 is notified by voice, unintended sounds may be included in the recorded video, or the subject 3 may not be able to perceive the guidance direction 400 due to noise. If the guidance direction 400 is notified by image, it may cause unnatural eye movements in the subject 3. In the first embodiment, since the guidance direction 400 is notified by vibration, these problems do not occur.
[0052] As shown in Figure 6, a position 600 different from the centroid 401 of the imaging range 4 may be determined as the guidance position. The guidance position may be determined based on the distance from the wearable device 2, the image captured by the imaging device 1, etc. The position closest to the wearable device 2 in the imaging range 4 may be determined as the guidance position. The position based on the composition of the image captured by the imaging device 1 (for example, the optimal position of subject 3 from a compositional standpoint) may be determined as the guidance position.
[0053] If the subject 3 is in a predetermined state, the wearable device 2 does not need to notify the subject of the guidance direction 400 by vibration. The method for detecting the state of the subject 3 is not particularly limited, but for example, the information processing unit 202 may detect the state of the subject 3 based on the time change of the position of the wearable device 2 obtained by the position acquisition unit 210. The predetermined state is also not particularly limited. For example, the predetermined state is a state in which notification by vibration would be bothersome to the subject 3, and includes at least one of the following: the subject 3 is moving with an intensity greater than a predetermined threshold, the subject 3 is sleeping, and the subject 3 is having a conversation.
[0054] The control unit 201 may select one or more notification methods, including vibration of the wearable device 2, to notify the subject 3 of the guidance direction 400, etc., using the selected notification method. If the state of the subject 3 is in a predetermined state, the control unit 201 may notify the subject 3 of the guidance direction 400 using a notification method different from vibration of the wearable device 2. The multiple notification methods include, for example, at least one of sound output, image display, temperature change, and odor generation.
[0055] The guidance direction 400 may be notified during still image capture or during video capture. The user of the imaging device 1 or wearable device 2 may be able to set whether or not to notify the guidance direction 400.
[0056] If the subject 3 is notified of the guidance direction 400 by vibration of the wearable device 2, and a predetermined amount of time has passed without the subject 3 approaching the guidance position (i.e., remaining motionless), it is highly likely that the subject 3 has not noticed the notification. In that case, the control unit 201 may notify the subject 3 of the guidance direction 400 using a notification method different from that of vibration of the wearable device 2.
[0057] The notification of the guidance direction 400 may be given when the user of imaging device 1 and the user of wearable device 2 are taking the same selfie, or it may be given when the user of imaging device 1 and the user of wearable device 2 are taking different photos taken by others. In the case of photos taken by others, imaging device 1 If the user (photographer) is focused on the live view image on the display unit 107, they cannot determine from which direction the subject 3 will be guided into the field of view. Therefore, as shown in Figure 7, the control unit 101 may display an item 700 indicating the guidance direction 400 on the display unit 107 while notifying the guidance direction 400. The item 700 may include text or an object. The control unit 101 may also notify the photographer of the guidance direction 400 using a different notification method (for example, by voice) than displaying the item 700.
[0058] At least one of the multiple processes (multiple controls) described as being performed by the wearable device 2 may be performed by the imaging device 1 or by other external devices such as a cloud server. Similarly, at least one of the multiple processes (multiple controls) described as being performed by the imaging device 1 may be performed by the wearable device 2 or by other external devices such as a cloud server. For example, the wearable device 2 may transmit necessary information to the imaging device 1, and the information processing unit 102 of the imaging device 1 may determine the guidance direction 400.
[0059] <Second Embodiment> A second embodiment of the present invention will now be described. In the following description, configurations and processes similar to those of the first embodiment will be omitted, and configurations and processes different from those of the first embodiment will be described.
[0060] In the first embodiment, the imaging system is assumed to have one wearable device. In the second embodiment, the imaging system is assumed to have multiple wearable devices. It is difficult to place multiple wearable devices (multiple subjects) in the same position. Therefore, in the second embodiment, multiple different guidance positions are determined, and multiple subjects, each wearing multiple wearable devices, are notified of multiple guidance directions with different guidance positions.
[0061] Figure 8 is a flowchart showing an example of operation of the imaging system according to the second embodiment. Figure 9 is a schematic diagram showing an example of operation of the imaging system according to the second embodiment. Wearable devices 2-1 and 2-2 have the same configuration as wearable device 2 of the first embodiment. In order to distinguish between the components of wearable device 2-1 and the components of wearable device 2-2, the components of wearable device 2-1 are denoted with the suffix "-1", and the components of wearable device 2-2 are denoted with the suffix "-2".
[0062] In the operation of the imaging device 1 shown in Figure 8, similar to the first embodiment (Figure 3), in S301, the control unit 101 acquires the shooting conditions and stores them in the primary storage unit 104.
[0063] Similar to the first embodiment (Figure 3), in S302, the control unit 101 uses the position acquisition unit 110 to acquire the camera position, which is the current position of the imaging device 1, and stores it in the primary storage unit 104.
[0064] In S800, the control unit 101 uses the information processing unit 102 to determine the guidance position of wearable device 2-1 and the guidance position of wearable device 2-2. The guidance position of wearable device 2-1 may be interpreted as the guidance position of subject 3-1 wearing wearable device 2-1, and the guidance position of wearable device 2-2 may be interpreted as the guidance position of subject 3-2 wearing wearable device 2-2. Based on the shooting conditions and camera position stored in the primary storage unit 104, the control unit 101 determines the imaging range 4 of the imaging device 1 shown in Figure 9. Position 401 is the centroid of the imaging range 4 (centroid position (X3, Y3, Z3)). Then, the control unit 101 determines position 600-1 within the imaging range 4 as the guidance position of wearable device 2-1, and position 600-2 within the imaging range 4 as the guidance position of wearable device 2-2. The control unit 101 stores the imaging range 4, the center of gravity 401, position 600-1, position 600-2, etc., in the primary storage unit 104.
[0065] Furthermore, if guidance positions 600-1 and 600-2 are different, the method for determining guidance positions 600-1 and 600-2 is not particularly limited. For example, guidance positions 600-1 and 600-2 may be determined such that the distance from imaging device 1 to guidance position 600-1 is equal to the distance from imaging device 1 to guidance position 600-2. Alternatively, the optimal positions for subject 3-1 and subject 3-2 from a compositional standpoint may be determined as guidance positions 600-1 and 600-2.
[0066] In S801-1, the control unit 101 uses the communication unit 103 to transmit the guidance position 600-1 of the wearable device 2-1, which is stored in the primary storage unit 104, to the wearable device 2-1.
[0067] In S801-2, the control unit 101 uses the communication unit 103 to transmit the guidance position 600-2 of the wearable device 2-2, which is stored in the primary storage unit 104, to the wearable device 2-2.
[0068] Similar to the first embodiment (Figure 3), in S306, the control unit 101 determines whether a termination operation, which is a user operation to terminate the operation of the imaging device 1, has been performed on the operation unit 108. If a termination operation has been performed, the operation of the imaging device 1 is terminated; otherwise, the process proceeds to S301.
[0069] In the operation of the wearable device 2-1 shown in Figure 8, similar to S312 in the first embodiment (Figure 3), in S312-1, the control unit 201-1 uses the position acquisition unit 210-1 to acquire the necklace position A, which is the current position of the wearable device 2-1. Then, the control unit 201-1 stores the necklace position A in the primary storage unit 204-1.
[0070] In S811-1, the wearable device 2-1 receives the guidance position 600-1 from the imaging device 1 using the communication unit 203-1 and stores it in the primary storage unit 204-1.
[0071] In S812-1, the control unit 201-1 uses the information processing unit 202-1 to determine the guidance direction 400-1 from the wearable device 2-1 (subject 3-1) toward the guidance position 600-1. The guidance direction 400-1 is determined based on the necklace position A and the guidance position 600-1 stored in the primary storage unit 204-1. The control unit 201-1 stores the guidance direction 400-1 in the primary storage unit 204-1.
[0072] Similar to S315 in the first embodiment (Figure 3), in S315-1, the control unit 201-1 uses the vibration unit 209-1 to notify the subject 3-1 wearing the wearable device 2-1 of the guidance direction 400-1 stored in the primary storage unit 204-1.
[0073] Similar to S316 in the first embodiment (Figure 3), in S316-1, the control unit 201-1 determines whether a termination operation, which is a user operation to terminate the operation of the wearable device 2-1, has been performed on the operation unit 208-1. If a termination operation has been performed, the operation of the wearable device 2-1 is terminated; otherwise, the process proceeds to S312-1.
[0074] The operation of wearable device 2-2, shown in Figure 8, is the same as the operation of wearable device 2-1.
[0075] In S312-2, the control unit 201-2 uses the position acquisition unit 210-2 to acquire the necklace position B, which is the current position of the wearable device 2-2. The control unit 201-2 then stores the necklace position B in the primary storage unit 204-2.
[0076] In S811-2, the wearable device 2-2 receives the guidance position 600-2 from the imaging device 1 using the communication unit 203-2 and stores it in the primary storage unit 204-2.
[0077] In S812-2, the control unit 201-2 uses the information processing unit 202-2 to determine the guidance direction 400-2 from the wearable device 2-2 (subject 3-2) toward the guidance position 600-2. The guidance direction 400-2 is determined based on the necklace position B and the guidance position 600-2 stored in the primary storage unit 204-2. The control unit 201-2 stores the guidance direction 400-2 in the primary storage unit 204-2.
[0078] In S315-2, the control unit 201-2 uses the vibration unit 209-2 to notify the subject 3-2 wearing the wearable device 2-2 of the guidance direction 400-2 stored in the primary storage unit 204-2.
[0079] In S316-2, the control unit 201-2 determines whether a termination operation, which is a user operation to terminate the operation of the wearable device 2-2, has been performed on the operation unit 208-2. If a termination operation has been performed, the operation of the wearable device 2-2 is terminated; otherwise, the process proceeds to S312-2.
[0080] As described above, according to the second embodiment, multiple subjects, each wearing multiple wearable devices, are notified of multiple guidance directions with different guidance positions. In this way, multiple subjects can be guided to a suitable position without being guided to the same position. Although an example using two wearable devices has been described, three or more wearable devices may also be used.
[0081] <Third Embodiment> A third embodiment of the present invention will now be described. In the following description, configurations and processes similar to those of the first embodiment will be omitted, and configurations and processes different from those of the first embodiment will be described.
[0082] A third embodiment will now be described. In the first embodiment, the position within the imaging range of the imaging device was determined as the guidance position. In the third embodiment, based on the imaging range, a position outside the imaging range may be determined as the guidance position. The imaging range is then changed so that a specific position within the imaging range substantially coincides with the guidance position.
[0083] Figure 10 is a flowchart illustrating an example of operation of the imaging system according to the third embodiment. Figure 11 is a schematic diagram showing an example of operation of the imaging system according to the third embodiment.
[0084] In the operation of the wearable device 2 shown in Figure 10, similar to the first embodiment (Figure 3), in S312, the control unit 201 uses the position acquisition unit 210 to acquire the necklace position, which is the current position of the wearable device 2, and stores it in the primary storage unit 204.
[0085] Similar to the first embodiment (Figure 3), in S313, the control unit 201 receives the shooting conditions and camera position from the imaging device 1 using the communication unit 203 and stores them in the primary storage unit 204.
[0086] Similar to the first embodiment (Figure 3), in S314, the control unit 201 uses the information processing unit 202 to determine the guidance position 1101 and guidance direction 400 shown in Figure 11, and stores them in the primary storage unit 204. In the first embodiment, a position within the imaging range was determined as the guidance position. In the third embodiment, based on the imaging range 4, the guidance position 1101 is determined such that the distance from a specific position within the imaging range 4 to the guidance position 1101 is shorter than the distance from that specific position to the necklace position. For example, the necklace position and a specific position within the imaging range 4 and The intermediate position is determined as the guidance position 1101. Therefore, the guidance position 1101 may be determined to be a position within the imaging range 4, or it may be determined to be a position outside the imaging range 4. A specific position is a position within the imaging range 4, for example, the centroid 401 of the imaging range 4.
[0087] In S1010, the control unit 201 uses the information processing unit 202 to determine whether the centroid 401 (a specific position) of the imaging range 4 approximately coincides with the guidance position 1101. "Approximately coincides" may include "exact coincidence". If the centroid 401 approximately coincides with the guidance position 1101, the process proceeds to S315; otherwise (if the centroid 401 does not approximately coincide with the guidance position 1101), the process proceeds to S1011.
[0088] In S1011, the control unit 201 uses the information processing unit 202 to determine new imaging conditions for changing the imaging range 4 so that the center of gravity 401 substantially coincides with the guidance position 1101, and stores these conditions in the primary storage unit 204.
[0089] In S1012, the control unit 201 uses the communication unit 203 to transmit the new shooting conditions stored in the primary storage unit 204 to the imaging device 1.
[0090] Similar to the first embodiment (Figure 3), in S315, the control unit 201 uses the vibration unit 209 to notify the subject 3 wearing the wearable device 2 of the guidance direction 400 stored in the primary storage unit 204.
[0091] Similar to the first embodiment (Figure 3), in S316, the control unit 201 determines whether a termination operation, which is a user operation to terminate the operation of the wearable device 2, has been performed on the operation unit 208. If a termination operation has been performed, the operation of the wearable device 2 is terminated; otherwise, the process proceeds to S312.
[0092] In the operation of the imaging device 1 shown in Figure 10, similar to the first embodiment (Figure 3), in S301, the control unit 101 acquires the shooting conditions and stores them in the primary storage unit 104.
[0093] Similar to the first embodiment (Figure 3), in S302, the control unit 101 uses the position acquisition unit 110 to acquire the camera position, which is the current position of the imaging device 1, and stores it in the primary storage unit 104.
[0094] Similar to the first embodiment (Figure 3), in S303, the control unit 101 transmits the shooting conditions and camera position stored in the primary storage unit 104 to the wearable device 2 using the communication unit 103.
[0095] In S1002, the control unit 101 uses the communication unit 103 to determine whether or not it has received new shooting conditions from the wearable device 2. If new shooting conditions have been received, the process proceeds to S1004 (by storing the new shooting conditions in the primary storage unit 104); otherwise, the process proceeds to S306.
[0096] In S1004, the control unit 101 updates the imaging conditions set in the imaging device 1 with the new imaging conditions received in S10002. As a result, the imaging range is changed (updated) from imaging range 4 to imaging range 1100, and the centroid of the imaging range approximately coincides with the guidance position 1101.
[0097] As explained above, according to the third embodiment, the imaging range is changed so that a specific position within the imaging range substantially coincides with the guidance position, thereby shortening the distance the subject has to travel to the guidance position. This allows subject 3 to enter the imaging range 4 in a shorter amount of time.
[0098] Furthermore, it may be possible to set a priority between prioritizing the current imaging range or prioritizing the current subject position (necklace position). If the current imaging range is prioritized, a position closer to a specific position within the imaging range will be determined as the guide position so as to minimize the change in the imaging range. Alternatively, a specific position may be determined as the guide position so as to maintain the current imaging range. If the current subject position is prioritized, a position closer to the current subject position will be determined as the guide position so as to minimize the movement of the subject. Alternatively, the current subject position may be determined as the guide position so as to maintain the current subject position.
[0099] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). Multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) may share the processing to control the entire device.
[0100] Furthermore, the above-mentioned processors are processors in a broad sense, including general-purpose processors and specialized processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Specialized processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).
[0101] Furthermore, although embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Moreover, each of the embodiments described above is merely one embodiment of the present invention, and it is possible to combine each embodiment as appropriate.
[0102] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit that implements one or more functions.
[0103] This embodiment includes the following configurations, methods, programs, and media. (Composition 1) An imaging system having an imaging device and a wearable device, A first determination means for determining a guidance position that is within the imaging range of the imaging device, A second determination means for determining the guidance direction, which is the direction from the wearable device toward the guidance position, A notification means that notifies the user wearing the wearable device of the direction of guidance based on the vibration of the wearable device. An imaging system characterized by having the following features. (Configuration 2) The aforementioned guidance position is, The centroid position of the aforementioned imaging range, The position closest to the wearable device within the imaging range, or Position based on the composition of the image captured by the aforementioned imaging device This will be The imaging system according to configuration 1, characterized by the features described above. (Composition 3) The notification means changes the vibration pattern of the wearable device according to the distance from the wearable device to the guidance position. The imaging system according to configuration 1 or 2, characterized by the above. (Composition 4) Detection means for detecting the user's state It further possesses, If the user's state is in a predetermined state, the notification means will not notify the user of the guidance direction by vibration of the wearable device. An imaging system according to any one of configurations 1 to 3, characterized by the above. (Composition 5) The predetermined state includes at least one of the following: the user is moving with an intensity greater than a predetermined threshold, the user is sleeping, and the user is having a conversation. The imaging system according to configuration 4, characterized by the features described above. (Composition 6) The notification means selects one or more notification methods, including vibration of the wearable device, and notifies the user of the guidance direction using the selected notification method. An imaging system according to any one of configurations 1 to 5, characterized by the above. (Composition 7) The aforementioned multiple notification methods include at least one of the following: outputting sound, displaying images, changing temperature, and generating odors. The imaging system according to configuration 6, characterized by the features described above. (Composition 8) If, after the wearable device has notified the user of the guidance direction by vibration, a predetermined time has elapsed without the user approaching the guidance location, the notification means shall notify the user of the guidance direction using a notification method different from the vibration of the wearable device. The imaging system according to configuration 6 or 7, characterized by the above. (Composition 9) Display control means that, during notification of the guidance direction, displays an item indicating the guidance direction on the display unit of the imaging device. Furthermore, it has An imaging system according to any one of configurations 1 to 8, characterized by the above. (Composition 10) The imaging system comprises the imaging device and a plurality of wearable devices. Multiple users, each wearing one of the aforementioned wearable devices, are each notified of multiple guidance directions with different guidance positions. An imaging system according to any one of configurations 1 to 9, characterized by the above. (Composition 11) The first determination means determines the guidance position based on the imaging range, The aforementioned imaging system is: Modification means for changing the imaging range so that a specific position within the imaging range substantially coincides with the guidance position. Furthermore, it has An imaging system according to any one of configurations 1 to 10, characterized by the above. (Composition 12) The first determination means determines a position within the imaging range as the guidance position. An imaging system according to any one of configurations 1 to 11, characterized by the above. (Composition 13) The aforementioned imaging range is the focus range. An imaging system according to any one of configurations 1 to 12, characterized by the above. (Composition 14) If the imaging device is not taking an image, the notification means will not notify the user of the guidance direction. An imaging system according to any one of configurations 1 to 13, characterized by the above. (Composition 15) The imaging device in an imaging system having an imaging device and a wearable device, The aforementioned imaging system is: A first determination means for determining a guidance position that is within the imaging range of the imaging device, A second determination means for determining the guidance direction, which is the direction from the wearable device toward the guidance position. It has, The imaging device is Control means for controlling the wearable device to notify the user wearing the wearable device of the direction of guidance through vibration of the wearable device. has An imaging device characterized by the following features. (Composition 16) An imaging system having an imaging device and a wearable device, wherein the wearable device is The aforementioned imaging system is: A first determination means for determining a guidance position that is within the imaging range of the imaging device, A second determination means for determining the guidance direction, which is the direction from the wearable device toward the guidance position. It has, The wearable device is Notification means for notifying the user wearing the wearable device of the guidance direction through vibration of the wearable device. has A wearable device characterized by the following. (method) A control method for an imaging system having an imaging device and a wearable device, The steps include determining a guidance position that is located within the imaging range of the imaging device, The steps include determining the guidance direction, which is the direction from the wearable device toward the guidance position, The steps include: notifying the user wearing the wearable device of the direction of guidance through vibration of the wearable device; A control method characterized by having the following features. (program) A program for causing a computer to function as one of the means of an imaging system described in any of configurations 1 to 14. (medium) A computer-readable storage medium storing a program for causing the computer to function as one of the means of the imaging system described in any of configurations 1 to 14. [Explanation of Symbols]
[0104] 1: Imaging device 2: Wearable device 101,201: Control unit
Claims
1. An imaging system having an imaging device and a wearable device, A first determination means for determining a guidance position that is within the imaging range of the imaging device, A second determination means for determining the guidance direction, which is the direction from the wearable device toward the guidance position, A notification means that notifies the user wearing the wearable device of the direction of guidance based on the vibration of the wearable device. An imaging system characterized by having the following features.
2. The aforementioned guidance position is, The centroid position of the aforementioned imaging range, The position closest to the wearable device within the imaging range, or Position based on the composition of the image captured by the aforementioned imaging device This will be The imaging system according to feature 1.
3. The notification means changes the vibration pattern of the wearable device according to the distance from the wearable device to the guidance position. The imaging system according to feature 1.
4. Detection means for detecting the user's state It further possesses, If the user's state is in a predetermined state, the notification means will not notify the user of the guidance direction by vibration of the wearable device. The imaging system according to feature 1.
5. The predetermined state includes at least one of the following: the user is moving with an intensity greater than a predetermined threshold, the user is sleeping, and the user is having a conversation. The imaging system according to feature 4.
6. The notification means selects one or more notification methods, including vibration of the wearable device, and notifies the user of the guidance direction using the selected notification method. The imaging system according to feature 1.
7. The aforementioned multiple notification methods include at least one of the following: outputting sound, displaying images, changing temperature, and generating odors. The imaging system according to feature 6.
8. If, after the wearable device has notified the user of the guidance direction by vibration, a predetermined time has elapsed without the user approaching the guidance location, the notification means shall notify the user of the guidance direction using a notification method different from the vibration of the wearable device. The imaging system according to feature 6.
9. Display control means that, during notification of the guidance direction, displays an item indicating the guidance direction on the display unit of the imaging device. It further possesses The imaging system according to feature 1.
10. The imaging system comprises the imaging device and a plurality of wearable devices. Multiple users, each wearing one of the aforementioned wearable devices, are each notified of multiple guidance directions with different guidance positions. The imaging system according to feature 1.
11. The first determination means determines the guidance position based on the imaging range, The aforementioned imaging system is: Modification means for changing the imaging range so that a specific position within the imaging range substantially coincides with the guidance position. It further possesses The imaging system according to feature 1.
12. The first determination means determines a position within the imaging range as the guidance position. The imaging system according to feature 1.
13. The aforementioned imaging range is the focus range. The imaging system according to feature 1.
14. If the imaging device is not taking an image, the notification means will not notify the user of the guidance direction. The imaging system according to feature 1.
15. The imaging device in an imaging system having an imaging device and a wearable device, The aforementioned imaging system is: A first determination means for determining a guidance position that is within the imaging range of the imaging device, A second determination means for determining the guidance direction, which is the direction from the wearable device toward the guidance position. It has, The imaging device is Control means for controlling the wearable device to notify the user wearing the wearable device of the direction of guidance through vibration of the wearable device. has An imaging device characterized by the following features.
16. An imaging system having an imaging device and a wearable device, wherein the wearable device is The aforementioned imaging system is: A first determination means for determining a guidance position that is within the imaging range of the imaging device, A second determination means for determining the guidance direction, which is the direction from the wearable device toward the guidance position. It has, The wearable device is Notification means for notifying the user wearing the wearable device of the guidance direction through vibration of the wearable device. has A wearable device characterized by the following.
17. A control method for an imaging system having an imaging device and a wearable device, The steps include determining a guidance position that is located within the imaging range of the imaging device, The steps include determining the guidance direction, which is the direction from the wearable device toward the guidance position, The steps include: notifying the user wearing the wearable device of the direction of guidance through vibration of the wearable device; A control method characterized by having the following features.
18. A program for causing a computer to function as one of the means of the imaging system described in any one of claims 1 to 14.
19. A computer-readable storage medium storing a program for causing a computer to function as one of the means of the imaging system described in any one of claims 1 to 14.
Citation Information
Patent Citations
Surreptitious photographing detecting system
JP2003163822A