Imaging device and imaging method
The imaging device uses tactile sensors on the grip and shutter button to identify photographers based on holding patterns, ensuring accurate identification during normal use without additional authentication steps, enhancing usability.
Patent Information
- Application Number
- PCT/JP2025/000449
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-01-24
- Filing Date
- 2025-01-09
- Publication Date
- 2025-07-31
AI Technical Summary
Existing imaging devices require additional operations such as fingerprint detection for photographer authentication, degrading usability and complicating the shooting process.
An imaging device equipped with tactile sensors on the grip and shutter button to detect user-specific holding patterns, allowing for photographer identification without additional authentication steps.
Enables accurate photographer identification during normal shooting operations, maintaining authentication without hindering usability and reducing the need for frequent biometric checks.
Smart Images

Figure JP2025000449_31072025_PF_FP_ABST
Abstract
Description
Imaging device and imaging method
[0001] The present technology relates to an imaging device and an imaging method, and in particular to a technology for identifying a photographer.
[0002]
[0003] Techniques for authenticating individuals based on physical characteristics, such as fingerprint authentication and vein authentication, are known. Patent Document 1 listed below discloses a technique for periodically or constantly authenticating individuals using biometric information, continuously authenticating their identity, and permitting or restricting target operations. Patent Document 2 listed below discloses a technique for reducing the impact of environmental changes on authentication, including a storage device that stores registered biometric information of individuals to be authenticated, and a computing device that executes a process for applying matching biometric information obtained from an individual who has been successfully authenticated to the registered biometric information of the individual based on a predetermined restriction criterion, and a process for reducing the restriction criterion based on a predetermined rule for individuals who have failed to be authenticated under a predetermined environment.
[0003] JP 2012-212349 A JP 2020-107057 A
[0004] For example, from the viewpoint of protecting rights to image content, there is a demand to assign photographer identification information (photographer ID) that can identify the photographer to each image content captured by an imaging device.
[0005] Since additional information can be recorded and associated with image data as metadata, it is possible to record, for example, device identification information for the imaging device or registered owner information in association with the image content. However, in order to record the actual photographer in association with each image content, personal authentication is required each time the device is used. For example, fingerprint authentication or iris authentication can be used to record the photographer ID in association with the captured image content. However, such authentication methods require a dedicated authentication device to detect a fingerprint each time authentication is performed, which is an operation unrelated to the user's actual photography, reducing usability.
[0006] Therefore, the present disclosure proposes a technique that can associate photographer identification information with each piece of image content without reducing the usability of the imaging device.
[0007] The imaging device according to the present technology includes a tactile sensor provided on a housing at a position where a user's hand touches the housing when taking a photograph, and a control unit that identifies photographer identification information based on information detected by the tactile sensor and controls the associating of the identified photographer identification information with the captured image content. The tactile sensor detects a state in which the user grips the imaging device when taking a photograph. At this time, the photographer identification information is set according to individual differences in the detection state by the tactile sensor, and is associated with the captured image content.
[0008] 1 is an explanatory diagram of a tactile sensor position of an imaging device according to an embodiment of the present technology; FIG. 1 is an explanatory diagram of a tactile sensor position of an imaging device according to an embodiment; FIG. 2 is an explanatory diagram of another example of a tactile sensor position of an imaging device according to an embodiment; FIG. 3 is an explanatory diagram of another example of a tactile sensor position of an imaging device according to an embodiment; FIG. 4 is a block diagram of an internal configuration of an imaging device according to an embodiment; FIG. 5 is an explanatory diagram of how to hold an imaging device; FIG. 6 is an explanatory diagram of detection by a tactile sensor of a grip section according to an embodiment; FIG. 7 is an explanatory diagram of detection by a tactile sensor of a shutter button according to an embodiment; FIG. 8 is an explanatory diagram of a contact position of a palm; FIG. 9 is an explanatory diagram of how a finger is placed on a shutter button; FIG. 10 is an explanatory diagram of detection pattern information according to an embodiment; FIG. 11 is an explanatory diagram of detection pattern information according to an embodiment; FIG. 12 is an explanatory diagram of detection pattern information according to an embodiment; FIG. 13 is an explanatory diagram of detection pattern information according to an embodiment;
[0009] The embodiments will be described below in the following order: <1. Configuration of imaging device> <2. Personal authentication> <3. Main configuration> <4. Processing example> <5. Summary and modified examples>
[0010] In this disclosure, "image content" refers to each image captured using an imaging device and recorded on a recording medium or transmitted. Specifically, it refers to each still image data file or each video data file.
[0011] 1. Configuration of the Imaging Device Fig. 1 shows a perspective view from the front of an imaging device 1 according to an embodiment, and Fig. 2 shows a perspective view from the back. Here, imaging device 1 is a so-called digital still camera that can capture both still images and moving images by switching the shooting mode, for example. Note that in this embodiment, imaging device 1 is not limited to a digital still camera, and may be a video camera that is primarily used for capturing moving images but can also capture still images.
[0012] In the imaging device 1, a lens barrel 3 is disposed on the front side of a main body 2 that constitutes a camera body, or is detachable.
[0013] A display panel 5, which is a display device such as a liquid crystal display (LCD) or an organic electroluminescence (EL) display, is provided on the rear side (user side) of the imaging device 1. A display unit formed using an LCD, an organic EL display, or the like is also provided as a viewfinder 4. The viewfinder 4 is not limited to an electronic viewfinder (EVF), and may be an optical viewfinder (OVF).
[0014] The user can view images and various information through the display panel 5 and the viewfinder 4. In this example, the imaging device 1 is provided with both the display panel 5 and the viewfinder 4, but this is not limiting, and the imaging device 1 may be configured to have only one of the display panel 5 and the viewfinder 4, or both or either of the display panel 5 and the viewfinder 4 may be detachable.
[0015] Various controls are provided on the main body 2 of the imaging device 1. For example, the controls may be of various types, such as keys, dials, and combined press / rotate controls, to realize various operational functions. For example, power on / off operations, menu operations, playback operations, mode selection operations, focus operations, zoom operations, and parameter selection operations such as shutter speed and F-number (F-number) are possible. Detailed descriptions of each control will be avoided, but the figure specifically shows a shutter button (release button) 8 as one of the controls.
[0016] The shutter button 8 is used for shutter operation (release operation) and for autofocus operation when pressed halfway. The shutter button 8 is located on the upper right surface of the main body 2, and can be pressed with the index finger of the user's right hand when holding the grip portion 6 with the user's right hand, for example.
[0017] The grip section 6 is formed on the right side of the main body section 2 and has a shape that protrudes forward so that the user can grip it with their right hand and stably hold the imaging device 1. A lid section 7 for loading a battery is provided behind the grip section 6.
[0018] 1 and 2, the presence of the tactile sensors 40, 41 is schematically indicated by dots. The tactile sensor 40 is provided, for example, on the surface side of the grip portion 6. That is, the tactile sensor 40 is positioned so that it can detect contact with the palm of the user's hand when the user grips the imaging device 1 with their right hand. The tactile sensor 41 is also provided in an area that includes the top surface of the shutter button 8 and its surrounding area. The surrounding area refers to the area that is mainly touched by the index finger. That is, the tactile sensor 41 is positioned so that it can detect contact when the user places their index finger on the shutter button 8.
[0019] Typically, a user takes a photograph by holding the imaging device 1 with the right hand gripping the grip portion 6 and the left hand supporting the lens barrel 3 from below. In this case, the tactile sensors 40 and 41 detect contact with the palm or index finger of the user's right hand.
[0020] The tactile sensor may be provided in other locations. Fig. 3 shows an example in which the tactile sensor 42 is provided from the front side to the back side of the cover portion 7. By providing the tactile sensor 42 on the back side together with the tactile sensor 40 on the grip portion 6, it is possible to detect contact with the entire palm of the hand.
[0021] 4 shows an example in which a tactile sensor 43 is provided on the bottom side of the lens barrel 3. By providing the tactile sensor 43 on the lens barrel 3, it is possible to detect contact with the user's left hand.
[0022] 5 shows the internal configuration of the imaging device 1, including the lens barrel 3. Note that, although an example in which the imaging device 1 is configured as being separated into the main body 2 and the lens barrel 3 is described here, the portion corresponding to the lens barrel 3 may also be integrated with the main body 2.
[0023] The imaging device 1 has a main body 2 which includes an imaging element (image sensor) 12, a camera signal processing unit 13, a recording control unit 14, a display unit 15, an output unit 16, an operation unit 17, a power supply unit 18, a sensor unit 19, a camera control unit 30, and a memory unit 31. The lens barrel 3 has a lens system 21, a driver unit 22, a lens control unit 23, and an operation unit 24.
[0024] The lens system 21 in the lens barrel 3 includes lenses such as a cover lens, a zoom lens, and a focus lens, as well as an iris mechanism. Light (incident light) from a subject is guided by this lens system 21 and collected on the image sensor 12 in the imaging device 1.
[0025] The image sensor 12 is configured as, for example, a CCD (Charge Coupled Device) type or a CMOS (Complementary Metal Oxide Semiconductor) type. The image sensor 12 performs, for example, CDS (Correlated Double Sampling) processing, AGC (Automatic Gain Control) processing, etc. on the electrical signal obtained by photoelectrically converting the received light, and further performs A / D (Analog / Digital) conversion processing. The image sensor 12 then outputs the imaging signal as digital data to the downstream camera signal processing unit 13 and camera control unit 30.
[0026] The camera signal processing unit 13 is configured as an image processor, for example, using a DSP (Digital Signal Processor). The camera signal processing unit 13 performs various types of signal processing on the digital signal (captured image signal) from the image sensor 12. For example, the camera signal processing unit 13 performs so-called development processing, such as pre-processing, synchronization processing, and YC generation processing. The camera signal processing unit 13 also performs resolution conversion processing, metadata addition processing, codec processing, and other processing depending on the output destination.
[0027] The recording control unit 14 performs processing to record image content such as still image data and video data, and metadata associated with the image content, onto a recording medium such as a non-volatile memory. The actual configuration of the recording control unit 14 can be various. For example, the recording control unit 14 may be a circuit that writes to and reads from a flash memory built into the imaging device 1, or may be in the form of a memory card (e.g., a portable flash memory) that can be attached to and detached from the imaging device 1 and a card recording / playback unit that accesses the memory card for recording / playback.
[0028] The display unit 15 displays various information to the photographer, specifically the display panel 5 and viewfinder 4 shown in FIG. 2 . The display unit 15 displays various information on the display screen based on instructions from the camera control unit 30. For example, the display unit 15 displays a playback image of image data read from a recording medium by the recording control unit 14. The display unit 15 is also supplied with image data of captured images whose resolution has been converted for display by the camera signal processing unit 13. In response to instructions from the camera control unit 30, the display unit 15 displays a so-called through image (a monitoring image of the subject), which is an image captured during release standby, based on the image data of the captured image. The display unit 15 also displays various operation menus, icons, messages, etc., i.e., a graphical user interface (GUI), on the screen based on instructions from the camera control unit 30.
[0029] The output unit 16 performs wired or wireless data communication and network communication with external devices. For example, it transmits and outputs image content to an external display device, recording device, playback device, etc. The output unit 16 may also be a network communication unit that performs communication via various networks such as the Internet, a home network, a LAN (Local Area Network), etc., and transmits and receives various data to and from servers, terminals, etc. on the network.
[0030] The operation unit 17 collectively represents input devices through which the user inputs various operations. Specifically, the operation unit 17 represents various operators (such as the shutter button 8) provided on the main body 2. The operation unit 17 detects user operations, and signals corresponding to the input operations are sent to the camera control unit 30. The operation unit 17 may be implemented not only by physical keys or other operators, but also by a touch panel. For example, a touch panel may be formed on the display panel 5, and various operations may be performed by touch panel operations using icons, menus, etc. displayed on the display panel 5. Alternatively, the operation unit 17 may be configured to detect user tap operations, etc., using a touchpad or the like. Furthermore, the operation unit 17 may be configured as a receiving unit for an external operation device such as a separate remote controller.
[0031] The power supply unit 18 generates the power supply voltage Vcc required for each unit, for example, from an internally mounted battery, and supplies it as operating voltage. When the lens barrel 3 is attached to the imaging device 1, the power supply voltage Vcc from the power supply unit 18 is also supplied to the circuits within the lens barrel 3. The power supply unit 18 turns the power on / off under the control of the camera control unit 30. The camera control unit 30 performs power on / off control in response to operation of the power switch on the operation unit 17, the passage of time, etc. Note that the power supply unit 18 may also be formed with a circuit for charging the battery and a circuit for generating the power supply voltage Vcc, using a DC voltage converted and input by an AC adapter connected to a commercial AC power source as its power source.
[0032] The sensor unit 19 collectively refers to various sensors. For example, it has an acceleration sensor for image stabilization, an angular velocity sensor, or an IMU (Inertial Measurement Unit) including these sensors. The sensor unit 19 also includes the above-mentioned tactile sensors 40 and 41. Detection information from these sensors is transmitted to the camera control unit 30.
[0033] The camera control unit 30 is configured by a microcomputer (arithmetic processing device) equipped with a CPU (Central Processing Unit). The memory unit 31 stores information and the like used for processing by the camera control unit 30. The illustrated memory unit 31 collectively represents, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), a flash memory, and the like. The memory unit 31 may be a memory area built into the microcomputer chip that constitutes the camera control unit 30, or may be configured by a separate memory chip.
[0034] The camera control unit 30 executes programs stored in the ROM, flash memory, etc. of the memory unit 31, thereby controlling the entire imaging device 1 and lens barrel 3. For example, the camera control unit 30 controls the shutter speed of the image sensor 12, instructs the camera signal processing unit 13 to perform various signal processing, controls the imaging and recording operations in response to user operations, plays back recorded image files, and controls the operations of the lens system 21, such as zoom, focus, and aperture adjustment in the lens barrel 3, and controls the user interface operations. With regard to aperture adjustment, the camera control unit 30 controls the F-number variable in response to user operations and instructs the F-number for automatic control (auto iris).
[0035] The RAM in the memory unit 31 is used to temporarily store data, programs, etc. as a working area when the CPU of the camera control unit 30 processes various types of data. The ROM and flash memory (non-volatile memory) in the memory unit 31 are used to store the OS (Operating System) used by the CPU to control each unit, content files such as image files, application programs for various operations, firmware, etc.
[0036] In this embodiment, the camera control unit 30 has a function as an authentication information processing unit 30a implemented by software. The authentication information processing unit 30a authenticates the individual photographer based on the detection information from the tactile sensors 40, 41 in the sensor unit 19, and performs processing to record the photographer ID in association with the image content. An example of processing by this authentication information processing unit 30a will be described later.
[0037] When the lens barrel 3 is attached to the main body 2, the camera control unit 30 communicates with the lens control unit 23 and issues various instructions. The lens barrel 3 is equipped with the lens control unit 23, which is implemented by, for example, a microcomputer, and various data communications are possible between the camera control unit 30. For example, the camera control unit 30 issues drive instructions to the lens control unit 23 to drive the zoom lens, focus lens, aperture mechanism, etc. The lens control unit 23 controls the driver unit 22 in response to these drive instructions, causing the lens system 21 to operate. Note that when the lens barrel 3 is attached to the main body casing 100, wired communication is performed between the camera control unit 30 and the lens control unit 23. However, the camera control unit 30 and the lens control unit 23 may also be configured to communicate wirelessly.
[0038] The driver unit 22 is provided with, for example, a motor driver for a zoom lens drive motor, a motor driver for a focus lens drive motor, a motor driver for a diaphragm mechanism motor, etc. These motor drivers apply drive currents to the corresponding drivers in response to instructions from the lens control unit 23, and execute operations such as moving the focus lens or zoom lens and opening and closing the diaphragm blades of the diaphragm mechanism.
[0039] The operation unit 24 indicates an operator provided on the lens barrel 3 side. Operation information from the operation unit 24 is supplied to the lens control unit 23, and is notified to the camera control unit 30 via the lens control unit 23. This allows the lens control unit 23 to, for example, control the operation of the lens system 21 in response to the operation, and the camera control unit 30 to perform various settings and control operations in response to the operation of the operation unit 24 of the lens barrel 3.
[0040] Although not shown in Figure 5, if a tactile sensor 43 is provided on the lens barrel 3 side as in the example of Figure 4, the detection information of the tactile sensor 43 is transmitted to the camera control unit 30, for example, via the lens control unit 23.
[0041] 2. Personal Authentication In this embodiment, the imaging device 1 includes, for example, tactile sensors 40 and 41, and when a user holds the imaging device 1, personal authentication is performed using information detected by the tactile sensors 40 and 41.
[0042] FIG. 6 shows how four different users hold the imaging device 1. Each user has their own unique way of holding the imaging device 1, specifically, how they hold the grip portion 6 and how they place their fingers on the shutter button 8, and these differences make it possible to identify each individual. For example, in the figure, the distinctive parts of each user are indicated by dashed lines. These differences, particularly the gripping style of the right hand and the position of the fingers, appear as differences in the detection information from the tactile sensors 40 and 41. This allows the camera control unit 30 to identify the individual using the device.
[0043] Figure 7 shows an example of detection information from the tactile sensor 40 in the grip portion 6. The upper part of the figure shows lines L1, L2, and L3 for the tactile sensor 40, and the lower part of the figure shows the pressure distribution when the tactile sensor 40 is unfolded in a plane. The positions of lines L1, L2, and L3 correspond to the upper part. For example, in the pressure distribution, the lightest part is an area where no contact is detected, and the darker the line, the greater the pressure. The pressure distribution is expressed in a stepped contour pattern.
[0044] 8 shows an example of detection information from the tactile sensor 41 around the shutter button 8. The upper part of the figure shows lines L4, L5, and L6 relative to the tactile sensor 41, and the lower part of the figure shows a three-dimensional representation of the pressure distribution of the tactile sensor 41. The positions of lines L4, L5, and L6 correspond to the upper part. The height direction of the three-dimensional representation indicates the magnitude of the pressure.
[0045] 7 and 8 vary depending on the contact of the palm of the hand and the placement of the fingers. Figure 9 shows the palm of the right hand detected by the tactile sensor 40 of the grip portion 6. Due to the sensor arrangement of the grip portion 6, the tactile sensor 40 mainly detects contact in the area enclosed by the dashed line.
[0046] The knuckles 81, 82, 83 and the thenar area 91 of each finger of the palm bulge out relative to the joints 84, 85, 86 and boundary areas 87, 88, and come into contact with the grip portion 6 when the palm is gripped. Conversely, the joints 84, 85, 86 of each finger and the boundary areas 87, 88 indicated by diagonal lines do not come into contact with the grip portion 6. The areas that come into contact with the grip portion 6 and the areas that do not come into contact with the grip portion 6 vary from person to person, and the way in which the grip portion 6 is gripped also differs, so an individual can be identified from the characteristics of the "area where force is applied" and "way in which force is applied" that can be observed by the tactile sensor 40.
[0047] In particular, the contact pattern with the grip part 6 is recognized from the ball of the fingers 91, the center of gravity of the middle finger, ring finger, and little finger (encircled by dashed lines), and the reaction area for each pressure, and the individual can be identified by checking the similarity with registered gripping styles. Furthermore, if a tactile sensor 42 is also provided on the surface of the lid part 7 as shown in Figure 3, so that the entire palm can be observed, further accuracy can be improved.
[0048] FIG. 10 shows an example of how a finger is placed on the shutter button 8. When taking a picture, the user places their index finger on the shutter button 8, but the placement varies from person to person. For example, some people place their finger on the button, while others press it with their fingertip. Finger sizes also vary from person to person, resulting in individual characteristics. In making a judgment using the information detected by the tactile sensor 41, it is conceivable that the contact pressure on a flat surface and the surface distribution of that pressure can be used as judgment data to determine similarities through pattern recognition and identify an individual.
[0049] Examples of detection pattern information by tactile sensors 40 and 41 will now be described. First, Figures 11 and 12 show examples of detection pattern information by tactile sensor 41 in the area of shutter button 8. Examples 1 to 4 each show different ways in which users place their fingers on shutter button 8, and the detection information by tactile sensor 41 in each case is shown in the three-dimensional format described in Figure 8.
[0050] For example, in the first and fourth examples, the user places their fingers relatively flat, and the tactile sensor 41 detects contact over a relatively wide area, obtaining detection information with little pressure difference across the entire contact surface. In the second and third examples, the user places their fingers upright, and the tactile sensor 41 obtains detection information showing a relatively steep pressure peak.
[0051] This detection information itself may be registered as the detection pattern information of the tactile sensor 41 for each user, but the aspect ratio, force point, force point peak, contact area, reaction area shape, etc. may also be determined from the detection information, and all or part of these may be used as the detection pattern information.
[0052] The aspect ratio is the ratio of the length of the X-axis to the Y-axis of the area where contact was detected in the detection information, i.e., the area represented by the lowest contour line. For example, by dividing the X-axis size by the Y-axis size, the value increases as the width increases. This aspect ratio is one of the features that differs between individuals.
[0053] The point of force is the position (position coordinates) on the tactile sensor 41 where the strongest pressure was observed. In the figure, it is the position indicated by the arrow PP. In each example, the position is expressed as a percentage when the X-axis length and Y-axis length of the sensor area are both set to 100%. For example, in the first example, X = 72% and Y = 41%, which means that when the X-axis is scaled from 0% to 100%, the position is 72%, and when the Y-axis is scaled from 0% to 100%, the position is 41%.
[0054] The force peak is information on the presence or absence of a force peak. It indicates whether or not a force peak is observed below a certain area that can be evaluated as a peak. For example, the first and fourth examples are considered to have no force peak, and the second and third examples are considered to have a force peak. For example, the contour lines may be divided into about four levels, and if the third contour line or below is reached, it may be considered that there is no peak, and if the fourth contour line or above is reached, it may be considered that there is a peak.
[0055] The contact area is the area in the detection information where contact was detected, that is, the area of the area represented by the lowest contour line. Here, the contact area is shown as a percentage, with the total area of the XY plane being 100%. For example, in the first example, it is 62%.
[0056] The reaction area shape is the area where contact was detected in the detection information, that is, information on the shape of the lowest contour line. Alternatively, it may be information indicating the shape of each contour line. For example, the contour line shapes can be stored as map data (surface distribution data) or images. This information is shown in the figure as "DF1" to "DF4."
[0057] The above-mentioned detection information itself, or all or part of the aspect ratio, force point, force point peak, contact area, reaction area shape, etc. generated from the detection information, are stored as detection pattern information of the tactile sensor 41 for each individual user.
[0058] 13 and 14 show examples of detection pattern information of the tactile sensor 40 of the grip portion 6. The first to fourth examples show detection information by the tactile sensor 40 corresponding to different ways of holding the grip portion 6 by different users in the planar map format described in FIG.
[0059] Since the balls of the palm, the center of gravity of the middle finger, ring finger, and little finger, and the reaction area for each pressure are different for each user, the tactile sensor 40 obtains pressure detection information that differs for each user, as shown in the first to fourth examples.
[0060] In the case of the grip portion 6, the pressure map becomes more complex than the detection information of the tactile sensor 41 around the shutter button 8, due to the strong contact of four parts: the ball of the foot, middle finger, ring finger, and little finger, and large individual differences in the way the fingers are spread and the contact position.
[0061] Therefore, it is advisable to use the detected pressure map as it is, as shown in the figure, as detection pattern information. For example, the detection range of the tactile sensor 41 is set to the X-Y plane, and the pressure detection values for each coordinate are stored as map data. Alternatively, pressure values may be quantized by contour line levels on the X-Y plane to create map data in which about four pressure levels are mapped. Note that the force point positions, presence or absence of force point peaks, contact areas, etc. of the balls of the limbs, middle finger, ring finger, and little finger may be calculated from the detection information, and these may be used as detection pattern information.
[0062] All or part of the map data based on the above-mentioned detected information or the information generated from the detected information is stored as detection pattern information for the tactile sensor 40 in association with the individual user.
[0063] By registering the detection pattern information of tactile sensor 40 and the detection pattern information of tactile sensor 41 for each individual user, the individual can be authenticated by comparing the detection pattern information of tactile sensor 40 and the detection pattern information of tactile sensor 41 when an actual photograph is taken.
[0064] 3. Main Configuration The following describes the registration of detection pattern information, personal authentication using the detection pattern information, and the process of storing the photographer ID in accordance with the personal authentication.
[0065] 15 shows the configuration of the main parts of the imaging device 1 according to the embodiment, including the sensor unit 19, the authentication information processing unit 30a of the camera control unit 30, the registered data storage unit 31a of the memory unit 31, the imaging element 12, the camera signal processing unit 13, and the recording control unit 14 shown in FIG.
[0066] As described above, detection information is input from the tactile sensors 40 and 41 of the sensor unit 19 to the authentication information processing unit 30a in the camera control unit 30. In the authentication information processing unit 30a, the detection information input unit 51 sequentially inputs the detection information from the tactile sensors 40 and 41. The pattern processing unit 52 then extracts detection pattern information from the input detection information.
[0067] The detection pattern information extracted by the pattern processing unit 52 may be used for personal registration or for personal authentication. When used for personal registration, the detection pattern information extracted by the pattern processing unit 52 is sent to the memory unit 31 together with a photographer ID that is input separately, and is stored in the registration data storage unit 31 a.
[0068] In the figure, registration data #1, #2, etc. are shown in the registration data storage unit 31a. Registration data #1, #2, etc. are information corresponding to individuals who use the imaging device 1, and are associated with detection pattern information and a photographer ID. For example, when a certain user owns the imaging device 1 and obtains detection pattern information, the detection pattern information and the photographer ID entered by the user are stored as registration data #1.
[0069] When the detected pattern information is used for personal authentication, the detected pattern information extracted by the pattern processing unit 52 is sent to the determination unit 53. In addition, each of the registered data #1, #2, .
[0070] The determination unit 53 searches among the registered data #1, #2, etc. for a detection pattern that is identical or similar to the detection pattern information extracted by the pattern processing unit 52, and if it finds registered data that can be assumed to be the same person as the current user, it identifies the corresponding registered photographer ID. The determination unit 53 then transmits this identified photographer ID to the camera signal processing unit 13 so that it is recorded in association with the image content as metadata.
[0071] The captured image data captured by the image sensor 12 undergoes image processing, known as development processing, in the image processing unit 61 of the camera signal processing unit 13, and then undergoes metadata addition and predetermined codec processing in the addition processing unit 62. The addition processing unit 62 performs processing to add the photographer ID identified by the determination unit 53 to the image content as one piece of metadata. The image content with the added metadata is then sent to the recording control unit 14 and recorded on a recording medium.
[0072] This allows a user to register the detection pattern information of the tactile sensors 40, 41 and the photographer ID in advance, and thereafter, when the user holds the imaging device 1 to take a photograph, the detection pattern information is collated to identify the photographer ID, which is then recorded in association with the photographed image content.
[0073] 4. Processing Examples Hereinafter, specific processing examples of the camera control unit 30 including the authentication information processing unit 30a will be described with reference to FIGS. 16 to 19. FIG.
[0074] 16 shows an example of processing by the camera control unit 30 when photographing is performed in the authentication photographing mode. The authentication photographing mode is a mode in which a photographer ID is associated with image content, such as a still image or a video, when the image content is photographed. For example, the imaging device 1 allows a user to select between a normal photographing mode and an authentication photographing mode. If the user wants to assign his or her photographer ID to the image content being photographed, the user selects the authentication photographing mode.
[0075] When the authentication photography mode is selected, the camera control unit 30 resets the time counters T1 and T2 to zero in step S101. The time counter T1 is a counter that counts the time when the power is on, and the time counter T2 is a counter that counts the time when the power is off.
[0076] In step S102, the camera control unit 30 determines whether registration processing has been completed. If a user wishes to add a photographer ID to image content in authentication photography mode, the user must perform registration processing in advance. However, if no registration data is registered in the registration data storage unit 31a, no photographer ID can be added, regardless of who uses the device. Therefore, the camera control unit 30 checks whether at least one registration data item exists, and if registration processing has not been completed, proceeds to step S103 and performs registration processing for the current user.
[0077] For example, if a primary user such as the owner of the imaging device 1 requests authentication photography mode, and there is no registered data, the process may proceed to step S103. Note that the camera control unit 30 may perform a process similar to the pattern matching described below at the time of step S102 to determine whether there is registered data for the current user, and if there is no registered data, the process may proceed to step S103.
[0078] The photographer information registration process in step S103 is shown in Figure 17. In step S120, the camera control unit 30 causes the display unit 15 to display a message requesting the user to input the photographer ID, and requests the user to input the information using the operation unit 17. The input character string is then used as the photographer ID. Note that the photographer ID may be automatically presented to the user, and the user may be asked to enter permission. In either case, the camera control unit 30 sets the photographer ID through an interface with the user.
[0079] In step S121, the camera control unit 30 acquires detection information from the tactile sensors 40 and 41. That is, the camera control unit 30 detects the contact state between the grip portion 6 and the shutter button 8 of the user currently holding the imaging device 1 and performing the registration operation. Note that a guide display or a voice message may be output to encourage the user to grip the grip portion 6 and place their finger on the shutter button 8.
[0080] In step S122, the camera control unit 30 analyzes the sensor data for registration. That is, it analyzes the detection information from the tactile sensors 40 and 41. In step S123, the camera control unit 30 extracts feature data as the analysis results. As described above, this is a process for extracting information characteristic of each individual, that is, detection pattern information, from the detection information. For example, data such as the aspect ratio, force point, force point peak, contact area, reaction area shape, and map data is extracted.
[0081] In step S124, the camera control unit 30 generates registration data using the detection pattern information. For example, the registration data is generated by using one or more pieces of detection pattern information as one data set. In step S125, the camera control unit 30 associates the photographer ID with the registration data (one or more pieces of detection pattern information) and stores the data in the registration data storage unit 31 a of the memory unit 31 as registration data #x.
[0082] By the above processing, the current user is registered and personal authentication of the user becomes possible. Note that the processing in Fig. 17 is performed in the authentication photography mode as step S103 in Fig. 16, but it may also be performed by a pre-set processing by a user operation, for example. For example, the processing in Fig. 17 may be started and registration may be performed by the user selecting photographer information registration from a menu screen.
[0083] 16, if it is determined that the registration process is being performed, or if registration is performed in step S103, the camera control unit 30 proceeds to step S104, where the process branches depending on whether the power is on or off. When the authentication photography mode is started, the power is on, so in that case the process proceeds to step S105. On the other hand, while the imaging device 1 is in use, the power is often temporarily turned off, particularly when the user is moving around looking for a subject to photograph. If the power is off in such a situation, the process proceeds to step S106.
[0084] If the power is on and the process proceeds to step S105, the camera control unit 30 performs authentication-enabled photography processing. An example of authentication-enabled photography processing is shown in FIG. 18. In step S140, the camera control unit 30 checks the sensor output. This is to determine whether or not there is contact detection information from at least one of the tactile sensors 40, 41. If there is no sensor output, i.e., no contact, the camera control unit 30 proceeds to step S151, but if the sensor output indicates contact, the process proceeds to step S141.
[0085] In step S141, the camera control unit 30 sets the time counters T1 = 0 and T2 = 0. In step S142, the camera control unit 30 checks whether pattern matching has already been completed or whether the matching result shows photographer ID = 0. Photographer ID = 0 means that the photographer ID has not been specified.
[0086] If matching has not yet been performed, the camera control unit 30 proceeds to step S143 to perform pattern matching, which is a process of matching the detection pattern information based on the detection information from the tactile sensors 40, 41 obtained when the user is currently touching the grip portion 6 or the shutter button 8 with the registered detection pattern information.
[0087] An example of the pattern matching process is shown in Fig. 19. In step S160, the camera control unit 30 acquires detection information from the tactile sensors 40 and 41. That is, the contact state between the grip portion 6 and the shutter button 8 of the user currently holding the imaging device 1 is detected.
[0088] In step S161, the camera control unit 30 analyzes the detection information from the tactile sensors 40 and 41, respectively, and extracts feature data. For example, detection pattern information such as the aspect ratio, force point, force point peak, contact area, reaction area shape, and map data is extracted.
[0089] In step S162, the camera control unit 30 reads out the registered data #1, #2, etc. stored in the registered data storage unit 31a and uses them as the objects of comparison. In step S161, the camera control unit 30 compares the extracted detection pattern information with registered detection pattern information to determine similarity. In other words, it determines whether there is registered data that can be used to estimate that the extracted detection pattern information is the same person as the person.
[0090] The process of FIG. 19 described above is performed in step S143 of FIG. 18. Then, in step S144, the process branches depending on the result of the comparison. If the detection pattern information of a certain registered data #y is identical or similar to the detection pattern information extracted this time and can be estimated to be the same person, that is, if the comparison is successful, the camera control unit 30 proceeds to step S145 and identifies the photographer ID of that registered data #y as the photographer ID of the current user. In other words, if the comparison is successful, personal authentication has been completed.
[0091] On the other hand, if there is no detection pattern information identical or similar to the detection pattern information extracted this time as registered data and the match is not successful, the camera control unit 30 proceeds to step S146, determines that the current user is not registered and cannot be personally authenticated, and sets the photographer ID to 0.
[0092] In step S147, the camera control unit 30 monitors the user's shooting operation. If it detects that the user has pressed the shutter button 8, the camera control unit 30 proceeds to step S148 and performs image recording processing. That is, the camera control unit 30 instructs the camera signal processing unit 13 to process one frame of captured image data corresponding to the shutter operation timing as one still image data to be recorded. In step S149, the camera control unit 30 instructs the camera signal processing unit 13 to record the photographer ID as metadata. Furthermore, in step S150, the camera control unit 30 causes the recording control unit 14 to perform processing to store the still image data and metadata including the photographer ID in the storage medium. Then, the processing of FIG. 18 ends.
[0093] Although the explanation was given in the case of still image shooting, when a video shooting operation is performed, the camera control unit 30 performs control processing to record a video in response to the video recording start operation, and to record metadata including the photographer ID in the video file.
[0094] If a photographing operation is not detected in step S147, the camera control unit 30 ends the processing of Fig. 18. If a sensor output is not detected in step S140, the camera control unit 30 checks in step S151 whether the time counter T1 is less than the maintenance time Ton. The maintenance time Ton is a preset time during which the photographer ID is kept identified while the power is on, even if no contact is detected. A fixed value may be set for the maintenance time Ton, or the user may be able to select it.
[0095] If T1<Ton, the camera control unit 30 counts (increments) the time counter T1 in step S152 and ends the processing in Fig. 18. If T1<Ton is not true, that is, if the power is on and the maintenance time Ton has elapsed without any contact detection by the tactile sensors 40, 41, the camera control unit 30 sets the photographer ID to 0 in step S153, sets the time counter T1 to 0, and ends the processing in Fig. 18. Setting the photographer ID to 0 means that authentication based on pattern matching is canceled and the state returns to one in which the photographer ID has not been identified.
[0096] The above-described processing in Fig. 18 is performed in step S105 in Fig. 16. This authentication-attached photographing processing in step S105 is repeated while the power is on. As a result, the processing during the power-on period is as follows.
[0097] First, when the user turns on the power while holding the grip portion 6, the process of Fig. 18 is performed in the process of step S105 of Fig. 16, and pattern matching is performed in step S143. At this time, if the user holding the camera is a registered user, the photographer ID is identified, and if not, the photographer ID is set to 0.
[0098] If the photographer ID is identified as a registered user, the process proceeds to step S105 repeatedly thereafter while the user is holding the grip portion 6 with the power on. However, since it is determined in step S142 of Fig. 18 that matching has already been performed, pattern matching is not performed. If the shutter button 8 is pressed at some point, metadata including the image content and the photographer ID is recorded in steps S148, S149, and S150. In other words, the photographer ID is associated with each image content.
[0099] Furthermore, even if the user temporarily stops holding the imaging device 1 while the power is still on, the process repeatedly proceeds to step S105, but the authentication state is maintained and the photographer ID remains identified until the maintenance time Ton has elapsed (steps S151 and S152). For example, even if the imaging device 1 is temporarily placed somewhere or is released from the user's hand while hanging from the strap, the state in which the photographer ID remains identified is maintained.
[0100] However, this period is counted by the time counter T1. If the power remains on and the user continues not holding the imaging device 1, at some point T1<Ton will no longer be satisfied, and authentication will be discarded in step S153, and the photographer ID will be reset to 0.
[0101] In the case of an unregistered user, the first pattern matching results in photographer ID=0, but thereafter, while the grip portion 6 is being held, the photographer ID=0 in step S142, so repeated pattern matching is not performed.
[0102] To avoid a situation where pattern matching is not possible and the photographer ID becomes 0 due to a difference in the way the user holds the camera due to some reason, such as posture, pattern matching may be repeated a predetermined number of times even when the photographer ID is 0. Furthermore, even when the photographer ID is 0, pattern matching may be performed at regular intervals.
[0103] If the photographer ID is 0 and the shutter is operated, in step S149, control is exercised to record metadata with the photographer ID being 0. In other words, recording is performed without the photographer ID being associated with the image content.
[0104] 16 is repeatedly performed while the power is on, but when the power of the imaging device 1 is turned off, the power-off authentication maintenance process of step S106 is performed. The power-off authentication maintenance process is shown in FIG.
[0105] In step S170, the camera control unit 30 checks whether the time counter T2 is less than the maintenance time Toff. The maintenance time Toff is a preset time during which the photographer ID remains identified while the power is off. The maintenance time Toff may be set to a fixed value, or may be selectable by the user.
[0106] If T2<Toff, the camera control unit 30 proceeds to step S171 to check the sensor output, that is, whether or not the tactile sensors 40 and 41 have detected contact.
[0107] If there is a sensor output, the camera control unit 30 sets the time counter T2 to 0 in step S172 and ends the processing in Fig. 20. If there is no sensor output, the camera control unit 30 counts (increments) the time counter T2 in step S172 and ends the processing in Fig. 20.
[0108] If T1<Ton is not satisfied in step S170, that is, if the power is off and the maintenance time Toff has elapsed without any contact detection by the tactile sensors 40, 41, the camera control unit 30 sets the photographer ID to 0 in step S174 and ends the processing in Fig. 20. In other words, authentication by pattern matching is cancelled, and the state returns to one in which the photographer ID has not been specified.
[0109] The above-described processing in Fig. 20 is performed in step S106 in Fig. 16. Then, in step S107, the camera control unit 30 determines whether the photographer ID is 0 or not, and if the photographer ID is not 0, the process returns to step S104, and if the photographer ID is 0, the processing in Fig. 16, i.e., authentication photographing, is terminated.
[0110] For this reason, if the power is turned off with the photographer ID identified, the processing of step S106 is repeated while the power is off, but if there is a sensor output in step S171 of Fig. 20, the time counter T2 does not progress. In other words, if contact can be detected, such as if the user is gripping the grip portion 6 of the imaging device 1, the user is considered to be the same even when the power is off, and the photographer ID is not discarded.
[0111] However, when the power is turned off and no contact is detected by the tactile sensors 40, 41, the time counter T2 begins to count. However, the photographer ID is not discarded for a certain period of time. When the time during which the power is off and no contact is detected by the tactile sensors 40, 41 reaches the maintenance time Toff, the photographer ID is discarded and the processing in FIG. 16 ends.
[0112] Furthermore, in the case of authentication-attached photography, if the photographer ID is 0, even if step S106 is performed due to power-off, the process of FIG. 16 ends immediately from step S107.
[0113] As described above, by the processes of FIGS. 16 to 20, in the case of a registered user, the process of recording the photographer ID in correspondence with each image content taken by the user is executed.
[0114] 5. Summary and Modifications According to the above embodiment, the following effects can be obtained.
[0115] The imaging device 1 of the embodiment includes tactile sensors 40, 41 provided on the housing at positions where the user's hand contacts during the shooting operation, and a camera control unit 30 that identifies a photographer ID (photographer information) based on information detected by the tactile sensors 40, 41 and controls the association of the identified photographer ID with the captured image content. This enables the identification of an individual photographer without using other biometric authentication methods such as fingerprint detection or iris detection. In particular, personal authentication is possible through the user's normal shooting action of grasping the imaging device 1 in a shooting position. Therefore, no authentication action other than the shooting action is required, and an individual can be identified without interfering with the shooting style, and an accurate photographer ID can be assigned to each image content. Furthermore, biometric authentication such as fingerprint authentication can fail depending on the user's condition, such as wet skin or the wearing of clothing or glasses. However, tactile sensors 40, 41, etc., determine the user's grip pressure and distribution, making them less affected by the user's condition. This is particularly suitable for the imaging device 1 used in a variety of outdoor scenes, as it allows for appropriate execution of authentication processing.
[0116] While the example of including the photographer ID in the metadata of the image content was given as a method of associating the photographer ID with the image content, there are also examples where the photographer ID and the image content are recorded as separate files or transmitted to an external device, with information that identifies the relationship between them.
[0117] In the embodiment, the camera control unit 30 compares the detection pattern information for the tactile sensors 40, 41 registered for each individual user with the detection pattern information obtained from the detection information of the tactile sensors 40, 41 during the shooting operation, and identifies the photographer identification information for each individual user based on the comparison results (see FIGS. 18 and 19 ). Each person has their own unique way of holding and touching the imaging device 1, and it is possible to identify an individual based on the way they hold the grip portion 6 or the way their fingers rest on the shutter button 8. These differences in gripping and touching can be detected as differences in the detection patterns of the tactile sensors. Therefore, by registering detection pattern information for each individual in advance and comparing it when the user holds the imaging device 1 for the actual shooting operation, it is possible to identify the individual.
[0118] The imaging device 1 of the embodiment includes a storage unit that stores, for each individual user, detection pattern information for the tactile sensors 40, 41 and a photographer ID associated with the detection pattern information. That is, the memory unit 31 includes a registration data storage unit 31a. By registering detection pattern information for each individual in advance and storing the associated photographer ID in the memory unit 31, the camera control unit 30 can identify the photographer ID when comparing the detection patterns when the user holds the imaging device 1 in their hand for actual photographing.
[0119] In the embodiment, when the camera control unit 30 identifies a photographer ID, the identified photographer ID is maintained until the conditions for discarding the photographer ID are met. Once the camera control unit 30 sets a photographer ID based on detected pattern matching, the camera control unit 30 maintains the photographer ID thereafter. For example, the authenticated photographer ID is maintained as long as the user continues to hold the imaging device 1. This eliminates the need to perform pattern matching multiple times, reducing the processing load.
[0120] In the embodiment, the camera control unit 30, when it identifies a photographer ID, controls the camera control unit 30 to associate the photographer ID with each captured still image or video image content until the state in which the photographer ID was identified is discarded. After setting the photographer ID, the camera control unit 30 subsequently associates and records the photographer ID as metadata with each still image data or each video data file captured until the time the photographer ID is discarded (steps S148 to S150 in FIG. 18 ). This allows the photographer ID to be assigned to each image content without having to perform authentication processing for each shutter operation.
[0121] In the embodiment, one of the conditions for discarding the photographer ID is that the power is on and the tactile sensors 40, 41 do not detect contact for a duration of Ton or more. For example, as described in steps S151 to S153 of FIG. 18 , when contact detection ceases while the power is on and the photographer ID is identified, the camera control unit 30 maintains the authenticated state until the time counter T1 exceeds the photographer ID maintenance time Ton. When the time counter T1 reaches or exceeds the maintenance time Ton, the photographer ID is discarded. This prevents the authenticated state from being canceled even if the user briefly releases the grip unit 6 or the shutter button 8. Therefore, there is no need to redo the detection pattern matching process for authentication after a momentary release. For example, consider a case where the tactile sensors 40, 41 of the grip unit 6 and the shutter button 8 are used for authentication, i.e., contact with the right hand is detected. When taking a photograph, it is common for the user to release their right hand and hold the imaging device 1 with only their left hand. In this way, if the photographer ID is maintained even if the right hand is removed for a short period of time, the camera control unit 30 will not need to perform authentication processing frequently. On the other hand, even if the power is on, if the user keeps the imaging device 1 out of their hand for a certain period of time, there is a high possibility that it will change into a state where another user is using it. Therefore, by discarding the photographer ID after the retention time Ton has elapsed, it is possible to prevent a situation in which an incorrect photographer ID is associated.
[0122] In the embodiment, one of the conditions for discarding the photographer ID is that the power is off and the state in which no contact is detected by the tactile sensors 40, 41 continues for more than the maintenance time Toff. For example, as described in FIG. 20 , when the camera control unit 30 detects no contact while the power is off and the photographer ID is identified, it maintains the authenticated state until the time counter T2 exceeds the photographer ID maintenance time Toff, and discards the photographer ID when the time counter T2 reaches or exceeds the maintenance time Toff. As a result, even if the user turns off the imaging device 1 for a short period of time, the authenticated state is not canceled, for example, as long as the grip portion 6 is held or released for a short time. Therefore, authentication is discarded simply by turning off the power, and there is no need to redo the detection pattern matching for authentication each time the power is turned on. For example, a user may frequently turn off the power even while holding the device by the grip portion 6. However, if the grip portion 6 is touched, the photographer will remain the same even if the power is subsequently turned on. Therefore, there is no need to discard the photographer ID, and not discarding it eliminates the need for extra authentication processing.
[0123] As described above, when contact detection continues even when the power is on or off, or when contact detection is interrupted but for less than the maintenance time Ton or Toff, it can be determined that the user holding the imaging device 1 has not changed to another person. Therefore, appropriate maintenance times Ton and Toff are set so that the photographer ID is discarded in situations where the imaging device 1 is handed over to another person. Furthermore, the tactile sensor 43 on the lens barrel 3, which detects gripping with the left hand, may also be used to determine whether the same person continues to hold the device. For example, if contact detection from all tactile sensors 40, 41, and 43 is lost, it can no longer be determined that the same person is still holding the device, and the photographer ID may be discarded.
[0124] Furthermore, information from an acceleration sensor, angular velocity sensor, etc. mounted on the imaging device 1 may also be used. That is, by detecting a change in the posture of the imaging device 1, the photographer ID may be discarded when it becomes less likely that the same person will continue to hold the device. The acceleration sensor and angular velocity sensor may be sensors for detecting camera shake.
[0125] In the embodiment, when the camera control unit 30 detects a contact detection output from the tactile sensors 40, 41 while the photographer ID has not yet been identified, the camera control unit 30 performs a process of identifying the photographer ID based on the information detected by the tactile sensors 40, 41. For example, as in the process of FIG. 18 , pattern matching in step S143 is performed when a sensor output detecting contact is first generated. In other words, authentication processing is performed when the user performs an action of holding the imaging device 1 (e.g., an action of gripping the grip portion 6). This makes it possible to prepare for recording the photographer ID as metadata for the image content being captured.
[0126] In the imaging device 1 of this embodiment, the tactile sensor 40 is provided on the surface of the grip portion 6 of the main body 2. Because there are individual differences in how the grip portion 6 is held, the detection pattern of contact with the grip portion 6 is effective in identifying the individual photographer. Furthermore, because the grip portion 6 is the place that is held with the right hand during handheld photography, providing the tactile sensor 40 on the grip portion 6 also means that authentication processing can be performed during the user's natural photography operations.
[0127] In the imaging device 1 of the embodiment, the tactile sensor 41 is provided on the pressing surface of the shutter button 8. Since there are individual differences in how a finger is placed on the shutter button 8, the detection pattern of contact with the shutter button 8 is effective in identifying the individual photographer. Furthermore, since the shutter button 8 is a location that is always operated during a photographing operation, providing the tactile sensor 41 on or around the shutter button 8 also means that authentication processing can be performed during the user's natural photographing operation.
[0128] The shutter button 8 has three operational states: finger placed, half-pressed, and pressed down. Detection information from the tactile sensor 41 at any timing may be used for pattern matching. Alternatively, detection pattern information for each state may be registered, and the detection pattern information to be compared may be selected depending on the state of the detection pattern information obtained at the timing of matching.
[0129] In the embodiment, an example has been described in which tactile sensors 40, 41 are used on the grip portion 6 and the shutter button 8, but examples have also been described in which a tactile sensor 43 is provided on the cover portion 7 as shown in FIG. 3 or a tactile sensor 44 is provided on the lens barrel 3 as shown in FIG. 4. These tactile sensors 43, 44 may also be used. Specifically, examples using only one, two, three, or four of the tactile sensors 41, 42, 43, and 44 for authentication processing are conceivable. Alternatively, a tactile sensor may be provided in another location, for example, on the front side of the bottom surface of the main body 2, and used for authentication processing.
[0130] However, the lens barrel 3 and the front bottom surface of the main body 2 are designed to detect contact with the left hand. In the case of a left hand, the contact state changes relatively greatly when the lens barrel 3 is operated. Furthermore, in the case of an interchangeable lens, the contact detection pattern differs depending on the shape of the lens barrel 3 itself. In that sense, to improve the accuracy of the authentication process, it is desirable to provide a tactile sensor in a location that detects contact with the right hand.
[0131] In the embodiment, the detection pattern information of the tactile sensors 40, 41 includes information on the aspect ratio or contact area of the contact surface. For example, the contact surface varies depending on how the finger is placed on the shutter button 8. Therefore, the aspect ratio of the contact surface is used as the detection pattern information. This allows for the acquisition of detection pattern information with a relatively small amount of data. Furthermore, since the area of the contact surface also varies from person to person, it is also preferable to include information on the contact area in the detection pattern information.
[0132] In the embodiment, the detection pattern information of the tactile sensors 40, 41 includes information about the point of force. For example, the position of the point of force on the sensor surface and the presence or absence of a peak at the point of force vary from user to user. Therefore, information about the position of the point of force and the peak of the point of force are used as the detection pattern information. This allows for the acquisition of a relatively small amount of detection pattern information.
[0133] In the embodiment, the detection pattern information of the tactile sensors 40, 41 includes information on pressure distribution. For example, the pressure distribution on the sensor surface varies from user to user. Therefore, information representing the pressure distribution is included in the detection pattern information. For example, this may be the shape of pressure contour lines or a pressure map. For example, a relatively complex pressure distribution appears in the grip portion 6. Therefore, the pressure map and contour line shape are information that is likely to reveal characteristics for each individual, and are suitable for improving the accuracy of personal identification.
[0134] Note that the registration process may be performed multiple times for one user, and the same detection pattern information may be registered multiple times. Furthermore, one registration process may register one set of detection pattern information, such as "contact area, force point position, pressure distribution," and multiple sets of this information may be registered for one user, associated with the same photographer ID. This makes it possible to identify the photographer ID if the detection pattern information at the time of photography corresponds to one of the multiple registered sets. It is also conceivable to use the average value of each detection pattern information from the multiple sets of detection pattern information as the standard for pattern matching, or to set a range for each value and determine that the value matches if it is within that range during pattern matching.
[0135] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.
[0136] The present technology may also be configured as follows: (1) An imaging device comprising: a tactile sensor provided at a position on a housing where a user's hand comes into contact when taking a photograph; and a control unit that identifies photographer identification information based on information detected by the tactile sensor and controls associating the identified photographer identification information with image content to be captured. (2) The imaging device described in (1) above, in which the control unit compares detection pattern information for the tactile sensor registered for each individual user with detection pattern information obtained from the detection information of the tactile sensor during a photographing operation, and identifies photographer identification information corresponding to the individual user based on the comparison result. (3) The imaging device described in (2) above, comprising: a storage unit that stores, for each individual user, detection pattern information for the tactile sensor and photographer identification information associated with the detection pattern information. (4) The imaging device described in any of (1) to (3) above, in which, when the control unit identifies photographer identification information, maintains the identified photographer identification information until a discard condition for the photographer identification information is satisfied. (5) The imaging device according to any one of (1) to (4) above, wherein, when the control unit has identified the photographer identification information, the control unit controls associating the photographer identification information with each of the image content, which is a captured still image or video, for a period until the state in which the photographer identification information has been identified is discarded. (6) The imaging device according to any one of (1) to (5) above, wherein, when the control unit has identified the photographer identification information, the control unit maintains the state in which the photographer identification information has been identified until a discard condition for the photographer identification information is met, the discard condition being a state in which the power is on and no contact is detected by the tactile sensor continuing for a predetermined period of time or more. (7) The imaging device according to any one of (1) to (6) above, wherein, when the control unit has identified the photographer identification information, the control unit maintains the state in which the photographer identification information has been identified until a discard condition for the photographer identification information is met, the discard condition being a state in which the power is off and no contact is detected by the tactile sensor continuing for a predetermined period of time or more.(8) The imaging device according to any one of (1) to (7) above, wherein the control unit, when detecting a contact detection output by the tactile sensor in a state where photographer identification information has not been identified, performs a process of identifying photographer identification information based on information detected by the tactile sensor. (9) The imaging device according to any one of (1) to (8) above, wherein the tactile sensor is provided on a surface of a grip portion of the imaging device body. (10) The imaging device according to any one of (1) to (9) above, wherein the tactile sensor is provided on a pressing surface of a shutter button. (11) The imaging device according to any one of (1) to (10) above, wherein the detection pattern information of the tactile sensor includes information on an aspect ratio of a contact surface or a contact area. (12) The imaging device according to any one of (1) to (11) above, wherein the detection pattern information of the tactile sensor includes information on a point of force. (13) The imaging device according to any one of (1) to (12) above, wherein the detection pattern information of the tactile sensor includes information on a pressure distribution. (14) An imaging method in which an imaging device identifies photographer identification information based on information detected by a tactile sensor provided at a position on the housing where the hand of a user performing a photographing operation comes into contact, and associates the identified photographer identification information with the image content being photographed.
[0137] REFERENCE SIGNS LIST 1 imaging device 2 main body 3 lens barrel 6 grip 7 cover 8 shutter button 12 imaging element 13 camera signal processing unit 14 recording control unit 15 display unit 16 output unit 17 operation unit 18 power supply unit 19 sensor unit 30 camera control unit 30a authentication information processing unit 31 memory unit 31a registration data storage unit 40, 41, 42, 43 tactile sensor
Claims
1. An imaging device comprising: a tactile sensor provided at a position on a housing that is contacted by a user's hand performing a shooting operation; and a control unit that identifies shooter identification information based on information detected by the tactile sensor and performs control to associate the identified shooter identification information with image content to be shot.
2. The imaging device according to claim 1, wherein the control unit compares detection pattern information for the tactile sensor registered for each individual user with detection pattern information obtained from detection information of the tactile sensor in a shooting operation, and identifies shooter identification information corresponding to the individual user based on a comparison result.
3. The imaging device according to claim 2, comprising a storage unit that stores, for each individual user, detection pattern information for the tactile sensor and shooter identification information associated with the detection pattern information.
4. The imaging device according to claim 1, wherein when the control unit identifies shooter identification information, it maintains the state in which the shooter identification information is identified until the discard condition for the shooter identification information is satisfied.
5. The imaging device according to claim 1, wherein when the control unit identifies shooter identification information, it performs control to associate the shooter identification information with each of the image contents as still images or moving images shot during the period until the state in which the shooter identification information is identified is discarded.
6. The imaging device according to claim 1, wherein when the control unit identifies shooter identification information, it maintains the state in which the shooter identification information is identified until the discard condition for the shooter identification information is satisfied, and the discard condition is that, in a power-on state and when no contact detection by the tactile sensor continues for a predetermined time or longer.
7. The imaging device according to claim 1, wherein when the control unit identifies shooter identification information, it maintains the state in which the shooter identification information is identified until the discard condition for the shooter identification information is satisfied, and the discard condition is that, in a power-off state and when no contact detection by the tactile sensor continues for a predetermined time or longer.
8. The imaging device according to claim 1, wherein when the control unit detects an output of contact detection by the tactile sensor in a state where shooter identification information is not identified, it performs a process of identifying shooter identification information based on information detected by the tactile sensor.
9. The imaging device according to claim 1, wherein the tactile sensor is provided on a surface of a grip portion in the imaging device main body.
10. The imaging device according to claim 1, wherein the tactile sensor is provided on a pressing surface of the shutter button.
11. The imaging device according to claim 1, wherein the detection pattern information of the tactile sensor includes information on the aspect ratio or contact area of the contact surface.
12. The imaging device according to claim 1, wherein the detection pattern information of the tactile sensor includes information on the force point.
13. The imaging device according to claim 1, wherein the detection pattern information of the tactile sensor includes information on the pressure distribution.
14. An imaging method, wherein the imaging device performs a process of identifying photographer identification information based on information detected by a tactile sensor provided at a position on a housing that is contacted by a hand of a user who performs a shooting operation, and associating the identified photographer identification information with image content to be shot.
Citation Information
Patent Citations
Pressure sensitive switch
JP1995181574A
Information processing system and camera system
JP2001014277A
Photographing apparatus
JP2007093967A
System and Method for High Dynamic Range Images
JP2017537578A
Information processing device, information processing method, and program
WO2022201948A1