Imaging device, information processing device, control method and program
The imaging device uses machine learning to recommend function assignments based on user operation history and image analysis, enhancing user proficiency in setting appropriate functions for operation members, leading to better image quality.
Patent Information
- Application Number
- JP2020085497
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-05-14
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2040-05-14
AI Technical Summary
Existing imaging devices, such as digital cameras, require users to be familiar with function assignments to operation members, making it difficult for users unaware of the functions to make appropriate settings.
An imaging device with a customization function that assigns predetermined photographing functions to operation members based on user operation history and image analysis, using an estimation process to recommend suitable functions and members through machine learning.
Enables users to appropriately assign functions to operation members, improving the quality of still images and videos even for those unfamiliar with the functions.
Smart Images

Figure 0007577461000001 
Figure 0007577461000002 
Figure 0007577461000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a technique for setting a customization function for assigning a predetermined photographing function to a predetermined operation member. [Background technology]
[0002] In imaging devices such as digital cameras, a customization function is known that allows a user to assign a desired function to an operating member, so that the user can execute the desired function simply by operating the operating member to which the function is assigned. By using the customization function, the user can instantly change shooting settings by simply operating the operating member to which the desired function is assigned, without having to switch settings on a menu screen.
[0003] Patent Document 1 describes a method in which functions can be assigned to multiple release buttons and settings are changed according to the release button operated to take a picture. This allows the user to instantly switch settings and take a picture without having to change settings on a menu screen. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2004-53722 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, in Patent Document 1, it is only possible to assign different functions to a plurality of release buttons, and the user must be fully aware of what functions are useful to assign to each button.
[0006] In light of this background, it may be possible to recommend to the user which functions to assign to the operating members; however, simply recommending functions to be assigned to the operating members based on the number of times settings are changed on the menu screen makes it difficult for the user to make appropriate settings, as they will not know which function to set if they do not know the content of the function.
[0007] The present invention has been made in view of the above problems, and has as its object to realize a technique that enables a user who does not know the contents of a function to assign an appropriate function to an appropriate operating member. [Means for solving the problem]
[0008] In order to solve the above problems and achieve the object, the present invention provides an imaging device having a customization function for assigning a predetermined photographing function to a predetermined operation member, and the image capturing apparatus is configured to perform a photographing operation by a user. Shooting an acquisition means for acquiring shadow image information; and an estimation means for estimating an operation member suitable for a customization function recommended to a user, the operation member being a result of an estimation process performed based on the captured image information; a presentation unit that presents to the user customization functions recommended to the user and operation members suitable for the customization functions; Have The captured image information includes operation history information of a user's capture operation, the operation member is a member that can be physically operated by the user or a member that can detect a touch operation, the result of the estimation process includes a plurality of capture functions that can be assigned to the operation member and a reason for recommending the plurality of capture functions, the presentation means presents a plurality of capture functions that can be assigned to the operation member and a reason for recommending the plurality of capture functions, and the estimation process estimates a customization function to be recommended to the user based on a model obtained by learning using information in which the captured image information, the operation history information, and the capture functions to be assigned to the operation member are associated with each other. . Effect of the Invention
[0009] According to the present invention, even a user who is unfamiliar with the contents of functions can assign appropriate functions to appropriate members, thereby enabling better still images and videos to be taken. [Brief description of the drawings]
[0010] [Figure 1] FIG. 1 is a diagram showing the configuration of a system including an imaging apparatus according to an embodiment of the present invention. [Diagram 2] FIG. 1 is an external view of an imaging apparatus according to an embodiment of the present invention. [Diagram 3] FIG. 1 is a block diagram showing the internal configuration of an imaging apparatus according to an embodiment of the present invention. [Figure 4] FIG. 2 is a diagram showing the software configuration of the imaging apparatus according to the embodiment. [Diagram 5] FIG. 2 is a conceptual diagram showing input and output data for the learning model of the present embodiment. [Figure 6] A conceptual diagram showing the processing procedure of a system using the learning model of this embodiment. [Figure 7] 4 is a flowchart showing processing of the imaging apparatus of the present embodiment. [Figure 8] 6 is a flowchart showing a process of a storage server according to the embodiment. [Figure 9] 6 is a flowchart showing a process of an estimation server according to the present embodiment. [Figure 10] FIG. 4 is a diagram illustrating a customization setting screen according to the embodiment. [Figure 11A] FIG. 4 is a data table showing combinations of input data and teacher data used in the learning process. [Figure 11B] FIG. 4 is a diagram showing a learning data table showing combinations of input data and teacher data used in the learning process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.
[0012] Hereinafter, an embodiment in which an imaging apparatus of the present invention is applied to a digital single-lens reflex camera capable of taking still images and moving images, and an information processing apparatus of the present invention is applied to a server computer will be described in detail with reference to the accompanying drawings.
[0013] <System Configuration> First, the system configuration of this embodiment will be described with reference to FIG.
[0014] The system of this embodiment includes a digital camera 10, a storage server 20, and an estimation server 30. The digital camera 10 transmits operation history information to the storage server 20 via a network 40. The storage server 20 stores the operation history information received from the digital camera 10, and requests estimation processing from the estimation server 30, which has a higher processing performance than the digital camera 10. The estimation server 30 uses operation history information including shooting setting information as input data in addition to the captured image information stored in the storage server 20, and uses customization functions described later in FIG. 11A and FIG. 11B as teacher data to generate a trained model that outputs customization functions recommended to a user for the operation history information. The captured image information includes information such as the presence or absence of whiteout in the captured image, the presence or absence of backlight with a dark face and a bright background, and the presence or absence of a subject such as a bird or a child that switches between static and dynamic states. In addition, the operation history information includes information including shooting setting information such as ISO sensitivity setting, exposure compensation setting, zebra setting, AF (autofocus) mode switching setting, auto lighting optimizer setting, and customization setting.
[0015] The estimation server 30 generates a trained model by linking multiple input data and teacher data and executing a learning process using a neural network. The trained model may be generated before the system is operated, or may be regenerated at a predetermined timing while the system is operating. This allows the trained model to be regenerated while the system is operating, making it possible to perform highly accurate estimation.
[0016] In this embodiment, the storage server 20 stores the operation history information and the estimation server 30 performs the learning process, but the functions of each server may be interchanged or may be configured to be executed within the same device. Also, the present invention is not limited to servers, and may be applied to user terminals such as smartphones.
[0017] <Configuration of Imaging Apparatus> The configuration and functions of the digital camera of this embodiment will be described with reference to FIGS.
[0018] FIG. 2(a) is a front perspective view of the digital camera 10 with the lens unit 200 removed, and FIG. 2(b) is a rear perspective view of the digital camera 10. As shown in FIG.
[0019] 2, the rear display unit 101 is a display unit outside the viewfinder that displays images and various information, and is a display device such as an LCD provided on the rear surface of the camera body. The rear display unit 101 also has a function of playing back still images after capturing still images, displaying moving images during recording, and displaying a live view. The rear display unit 101 is provided with a touch panel 270a. The touch panel 270a is a touch operation member that can detect contact (touch operation) with the display surface of the rear display unit 101 (the touch operation surface of the touch panel 270a).
[0020] The outside viewfinder display unit 243 is a display unit provided on the top surface of the camera, and displays various settings of the camera, including shutter speed and aperture. The shutter button 102 is an operation unit for issuing shooting instructions. The mode change switch 103 is a rotary dial-type operation unit for switching between various modes. The terminal cover 104 is a cover member that protects a connector (not shown) for connecting an external device to the digital camera 10 via a cable such as USB. The main electronic dial 105 is a rotary operation member included in the operation unit 270, which will be described later in FIG. 3, and settings such as shutter speed and aperture can be changed by turning this main electronic dial 105.
[0021] The power switch 106 is an operating member that switches the power of the digital camera 10 on and off. The sub electronic dial 107 is also a rotary operating member included in the operating unit 270, which will be described later in FIG. 3, and is used to move the selection frame, advance images, and the like. The cross key 108 is also a movement instruction member included in the operating unit 270, which will be described later in FIG. 3, and is a four-way operating button that has push buttons that can be pressed in four directions: up, down, left, and right. The operation that corresponds to the part of the cross key 108 that is pressed in the direction that it is pressed can be performed. The SET button 109 is also a push button included in the operating unit 270, which will be described later in FIG. 3, and is mainly used to confirm a selected item, and the like.
[0022] The record button 110 is also included in the operation unit 270, which will be described later in Fig. 3, and is used to instruct the start and stop of video shooting (recording). The AE lock button 112 is also included in the operation unit 270, which will be described later in Fig. 3, and by pressing this button in the shooting standby state, the exposure state can be fixed. The enlarge / reduce button 111 is also included in the operation unit 270, which will be described later in Fig. 3, and is an operation button for turning on and off the enlargement mode in the live view display in the shooting mode. By turning on the enlargement mode and then operating the main electronic dial 105, the live view image can be enlarged or reduced. In the playback mode, it functions as a magnification button for enlarging the playback image and increasing the magnification ratio.
[0023] The playback button 113 is also included in the operation unit 270, which will be described later in Fig. 3, and is an operation button for switching between the shooting mode and the playback mode. By pressing the playback button 113 during the shooting mode, the mode changes to the playback mode, and the latest image among the images recorded on the recording medium 250 can be displayed on the rear display unit 101. The menu button 114 is also included in the operation unit 270, which will be described later in Fig. 3, and by pressing the menu button 114, a menu screen on which various settings can be made is displayed on the rear display unit 101. The user can intuitively make various settings using the menu screen displayed on the rear display unit 101, the cross key 108, the SET button 109, or the multi-controller 115.
[0024] The touch bar 115 (multifunction bar) is also included in the operation unit 270 described later with reference to FIG. 3 and is a line-shaped touch operation member (line touch sensor) capable of receiving a touch operation. The touch bar 115 is disposed at a position where it can be touched (touched) by the thumb of the right hand when the grip unit 116 is held in the right hand (held with the little finger, ring finger, and middle finger of the right hand) so that the shutter button 102 can be pressed by the index finger of the right hand. That is, the touch bar 115 is disposed at a position where it can be operated when the eyepiece unit 216 is placed close to the eyepiece unit 216, the viewfinder is looked into, and the user is in a position where the user can press the shutter button 102 at any time (shooting posture). The touch bar 115 is a reception unit that can receive a tap operation (operation of touching and releasing without moving within a predetermined period) on the touch bar 115, a slide operation to the left and right (operation of touching and then moving the touch position while keeping the touch) and the like. The touch bar 115 is an operation member different from the touch panel 270a, and does not have a display function.
[0025] 3, and is located at a position where it can be operated with the index finger when gripping grip portion 116 with the right hand. In other words, multifunction button 118 is located at a position where it can be operated while placing an eye close to eyepiece portion 216 and looking through the viewfinder.
[0026] Grip section 116 has a shape that allows the user to easily hold digital camera 10 with the right hand. In a state in which digital camera 10 is held by gripping grip section 116 with the little finger, ring finger, and middle finger of the right hand, shutter button 102 and main electronic dial 105 are disposed in positions that can be operated with the index finger of the right hand. In the same state, sub electronic dial 107 and touch bar 115 are disposed in positions that can be operated with the thumb of the right hand. Lid 117 is a member that opens and closes a slot for attaching and detaching recording medium 250 to and from digital camera 10.
[0027] The communication terminal 210 is an electrical contact for digital camera 10 to communicate with lens unit 200. The eyepiece 216 is a peer-type eyepiece finder. A user can view an image displayed on an electronic viewfinder (EVF), which is an in-finder display unit 229, through the eyepiece 216, and can check the focus and composition of a subject image captured through lens unit 200, which will be described later in FIG. 3.
[0028] Eyepiece detection unit 217 is disposed near eyepiece unit 216 and is capable of detecting the approach of an object to eyepiece unit 216. Eyepiece detection unit 217 may be, for example, an infrared proximity sensor.
[0029] Thumb rest section 119 (thumb standby position) is a grip member provided on the rear side of digital camera 10 at a position where it is easy to place the thumb of the right hand when gripping grip section 116 with no operation of any operation members being operated. Thumb rest section 119 is made of a rubber member or the like to enhance holding power (grip feeling).
[0030] The AF frame selection button 120 is included in an operation unit 270, which will be described later with reference to FIG. 3, and allows the user to select an AF position (frame) for focusing by operating the cross key 108 or the like.
[0031] Next, the internal configuration of the digital camera 10 and the lens unit 200 of this embodiment will be described with reference to Fig. 3. In Fig. 3, components common to Fig. 2 are denoted by the same reference numerals.
[0032] 3, the lens unit 200 is equipped with a photographing lens 207 and is detachable from the digital camera 10. The photographing lens 207 is usually composed of multiple lenses, but for simplicity, only one lens is shown here. The communication terminal 206 is an electrical contact for the lens unit 200 to communicate with the digital camera 10. The communication terminal 210 is an electrical contact for the digital camera 10 to communicate with the lens unit 200. The lens unit 200 communicates with the system control unit 201 via the communication terminal 206, and the built-in lens control unit 204 controls the aperture drive circuit 202 to drive the aperture 205, and controls the AF drive circuit 203 to displace the position of the photographing lens 207 to adjust the focus.
[0033] The focal plane shutter 221 can freely control the exposure time of the imaging unit 222 in response to an instruction from the system control unit 201. The imaging unit 222 is an image sensor composed of imaging elements such as CCD or CMOS that convert a subject image into an electrical signal. The A / D converter 223 converts an analog signal output from the imaging unit 222 into a digital signal.
[0034] The image processing unit 224 performs predetermined pixel interpolation, resizing such as reduction, and color conversion processing on the data from the A / D converter 223 or the data from the memory control unit 215. The image processing unit 224 also performs predetermined arithmetic processing using the captured image data, and the system control unit 201 performs exposure control and distance measurement control based on the arithmetic results. This allows TTL (through-the-lens) type AF (autofocus) processing, AE (autoexposure) processing, and EF (flash pre-flash) processing to be performed. The image processing unit 224 also performs predetermined arithmetic processing using the captured image data, and TTL type AWB (auto white balance) processing based on the arithmetic results.
[0035] The memory control unit 215 controls data transmission between the A / D converter 223, the image processing unit 224, and the memory 232. Digital data output from the A / D converter 223 is written to the memory 232 via the image processing unit 224 and the memory control unit 215, or directly via the memory control unit 215. The memory 232 stores image data obtained from the imaging unit 222 and the A / D converter 223, and image display data to be displayed on the rear display unit 101 or the in-finder display unit 229. The memory 232 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of video and audio. The memory 232 also serves as a memory for image display (video memory).
[0036] The D / A converter 219 converts image display data stored in the memory 232 into an analog signal and supplies it to the rear display unit 101 or the in-finder display unit 229. The display image data written to the memory 232 is displayed on the rear display unit 101 or the in-finder display unit 229 via the D / A converter 219. The rear display unit 101 or the in-finder display unit 229 performs display on a display device according to the analog signal from the D / A converter 219. In this way, by converting the digital signal stored in the memory 232 into an analog signal and sequentially transferring and displaying it on the rear display unit 101 or the in-finder display unit 229, it functions as an EVF that performs live view (LV) display (through image display).
[0037] Various pieces of camera information such as the shutter speed and aperture at the time of shooting are displayed on the outside viewfinder display section 243 via an outside viewfinder display section drive circuit 244 .
[0038] Non-volatile memory 256 is an electrically erasable and recordable memory, and may be, for example, a flash ROM. Constants, programs, and the like for the operation of system control unit 201 are stored in non-volatile memory 256. The programs referred to here are programs for executing the flowcharts described below.
[0039] The system control unit 201 is an arithmetic processing unit consisting of at least one processor and / or at least one circuit, and controls the entire digital camera 10. The system control unit 201 executes programs stored in a non-volatile memory 256 to realize each process of a flowchart described later. For example, a RAM is used for the system memory 252, which is also used as a work memory for developing constants and variables for the operation of the system control unit 201, programs read from the non-volatile memory 256, and the like. The system control unit 201 also performs display control by controlling the memory 232, the D / A converter 219, the rear display unit 101, the in-finder display unit 229, and the like. The system timer 253 is a timekeeping unit that measures the time used for various controls and the time of a built-in clock.
[0040] The mode changeover switch 103, the first shutter switch 211, the second shutter switch 212, and the operation unit 270 are operation means for inputting various instructions to the system control unit 201. The mode changeover switch 103 switches the operation mode of the system control unit 201 to one of a still image shooting mode, a video recording mode, and a playback mode. The still image shooting modes include, for example, an auto shooting mode, an auto scene determination mode, a manual mode, an aperture priority mode (Av mode), a shutter speed priority mode (Tv mode), and a program AE mode (P mode). The still image shooting modes also include, for example, various scene modes and custom modes that are shooting settings for different shooting scenes.
[0041] The user can directly switch to one of these shooting modes by operating the mode selector switch 103, or can first switch to a list screen of operation modes with the mode selector switch 103, then select one of the listed shooting modes and use other operating members to switch between them. Similarly, the movie recording mode and the playback mode may each include multiple modes.
[0042] The first shutter switch 211 is turned on by half-pressing (instruction of preparation for shooting) during operation of the shutter button 102 provided on the digital camera 10, and generates a first shutter switch signal SW1. The first shutter switch signal SW1 starts preparation operations for shooting, such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (pre-flash) processing.
[0043] The second shutter switch 212 is turned on when the operation of the shutter button 102 is completed, that is, when the shutter button 102 is fully pressed (shooting instruction), and generates a second shutter switch signal SW2. In response to the second shutter switch signal SW2, the system control unit 201 starts a series of shooting processing operations from reading out a signal from the imaging unit 222 to writing the captured image to the recording medium 250 as an image file.
[0044] The operation unit 270 is made up of operation members such as various switches and buttons that accept various operations from the user and notify the system control unit 201, and includes at least the following operation members: a shutter button 102, a mode change switch 103, a main electronic dial 105, a power switch 106, a sub electronic dial 107, a cross key 108, a SET button 109, a record button 110, a zoom in / out button 111, an AE lock button 112, a playback button 113, a menu button 114, a touch bar 115, a multifunction button 118, and an AF frame selection button 120.
[0045] The power supply control unit 280 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between blocks to be energized, and detects whether a battery is attached, the type of battery, and the remaining battery power. The power supply control unit 280 also controls the DC-DC converter based on the detection results and instructions from the system control unit 201, and supplies the necessary voltage for the necessary period to each unit including the recording medium 250.
[0046] The power supply unit 230 is composed of a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li-ion battery, an AC adapter, etc. The recording medium I / F 218 is an interface with a recording medium 250 such as a memory card or a hard disk. The recording medium 250 is a recording medium such as a memory card for recording captured images, and is composed of a semiconductor memory, a magnetic disk, etc.
[0047] The communication unit 254 is communicably connected to an external device via a wireless antenna or a wired cable, and transmits and receives images and audio. The communication unit 254 can also be connected to a wireless LAN (Local Area Network) or the Internet. The communication unit 254 can transmit image data (including live view images) captured by the imaging unit 222 and image files recorded in the recording medium 250 to an external device, and can also receive image data and various other information from an external device. Note that the communication unit 254 is not limited to wireless LAN, and may use a wireless communication module such as infrared communication, Bluetooth (registered trademark), Bluetooth (registered trademark) Low Energy, or Wireless USB, or a wired connection means such as a USB cable, HDMI (registered trademark), or IEEE1394.
[0048] The attitude detection unit 255 detects the attitude of the digital camera 10 with respect to the direction of gravity. Based on the attitude detected by the attitude detection unit 255, it is possible to determine whether the image captured by the imaging unit 222 was captured with the digital camera 10 held horizontally or vertically. The system control unit 201 can add orientation information corresponding to the attitude detected by the attitude detection unit 255 to the image file of the image captured by the imaging unit 222, or rotate and record the image. An acceleration sensor, a gyro sensor, or the like can be used as the attitude detection unit 255. By using an acceleration sensor or a gyro sensor, the attitude detection unit 255 can also detect the movement of the digital camera 10 (panning, tilting, lifting, standing still, etc.).
[0049] The operation unit 270 includes a touch panel 270a capable of detecting a touch operation on the rear display unit 101. The touch panel 270a and the rear display unit 101 can be configured as one unit. For example, the touch panel 270a is configured so that the light transmittance does not interfere with the display of the rear display unit 101, and is attached to the upper layer of the display surface of the rear display unit 101. Then, input coordinates on the touch panel 270a are associated with display coordinates on the rear display unit 101. This makes it possible to configure a GUI that makes it seem as if the user can directly operate the screen displayed on the rear display unit 101. The system control unit 201 can detect the following operations or states on the touch panel 270a.
[0050] A finger or pen that has not been touching the touch panel 270a touches the touch panel 270a again, that is, the start of touching (hereinafter referred to as touch-down).
[0051] The touch panel 270a is in a state of being touched with a finger or a pen (hereinafter, referred to as Touch-On).
[0052] Touching the touch panel 270a with a finger or a pen and moving it (hereinafter, referred to as Touch-Move).
[0053] The finger or pen that has been touching the touch panel 270a is released, that is, the touch ends (hereinafter, referred to as "touch-up").
[0054] A state in which nothing is being touched on the touch panel 270a (hereinafter referred to as Touch-Off).
[0055] When touch-down is detected, touch-on is also detected at the same time. After touch-down, touch-on will usually continue to be detected unless touch-up is detected. Touch-move is also detected while touch-on is detected. Even if touch-on is detected, touch-move will not be detected if the touch position has not moved. After it is detected that all fingers or pens that were touching have touched up, touch-off occurs.
[0056] These operation states and the position coordinates of the position where a finger or pen touches the touch panel 270a are notified to the system control unit 201 via an internal bus, and the system control unit 201 determines what kind of operation (touch operation) was performed on the touch panel 270a based on the notified information.
[0057] Regarding touch-move, the direction of movement of a finger or pen moving on the touch panel 270a can also be determined for each vertical and horizontal component on the touch panel 270a based on the change in position coordinates. If a touch-move of a predetermined distance or more is detected, it is determined that a slide operation (drag) has been performed. An operation in which a finger is touched on the touch panel, moved quickly for a certain distance, and then released is called a flick. In other words, a flick is an operation in which a finger is quickly traced on the touch panel 270a as if flicking. If a touch-move of a predetermined distance or more at a predetermined speed or more is detected and a touch-up is detected as it is, it can be determined that a flick has been performed (it can be determined that a flick has been performed following a drag). Furthermore, a touch operation in which multiple points (for example, two points) are touched simultaneously and the touch positions are brought closer to each other is called a pinch-in, and a touch operation in which the touch positions are moved away from each other is called a pinch-out. Pinch-out and pinch-in are collectively called pinch operations (or simply pinch).
[0058] The touch panel 270a may be of any of various touch panel types, such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, an optical sensor type, etc. Depending on the type, there are types that detect a touch by contact with the touch panel, and types that detect a touch by the approach of a finger or a pen to the touch panel, but any type may be used.
[0059] The eyepiece detection unit 217 detects the approach (eye approach) and departure (eye departure) of the eye (object) to the eyepiece unit 216 (approach detection). The system control unit 201 switches between display (display state) / non-display (non-display state) of the rear display unit 101 and the in-finder display unit 229 depending on the state detected by the eyepiece detection unit 217. At least in shooting mode and when the display destination switching is automatic, the system control unit 201 sets the display destination to the rear display unit 101 while the eye is not placed near the subject and sets the in-finder display unit 229 to a non-display state. Also, when the eye is placed near the subject, the display destination is set to the in-finder display unit 229 and the rear display unit 101 to a non-display state.
[0060] When an object approaches, infrared light emitted from a light-projecting section (not shown) of the eyepiece detection section 217 is reflected and enters a light-receiving section (not shown) of the infrared proximity sensor. Depending on the amount of incident infrared light received by the infrared proximity sensor, it is possible to detect the approach of an object to the eyepiece section 216 and to determine how close the object is to the eyepiece section 216 (eyepiece distance). When it detects the approach of an object to the eyepiece section 216, the system control section 201 can start displaying the in-finder display section 229. This makes it possible to display the in-finder display section 229 with as little delay as possible when the user looks through the eyepiece section 216.
[0061] In addition, when the eye contact detection unit 217 detects an object approaching within a predetermined distance from the eye contact unit 216 from a non-eye contact state (non-approach state), it determines that the eye contact has been detected, and transmits an eye contact detection notification to the system control unit 201. In addition, when the object that was detected as approaching from the eye contact state (approach state) moves away from the eye contact state by a predetermined distance or more, it determines that the eye contact has been detected, and transmits an eye contact detection notification to the system control unit 201. The threshold value for detecting the eye contact and the threshold value for detecting the eye contact may be different, for example, by providing a hysteresis. In addition, after the eye contact is detected, the eye contact state is assumed to remain until the eye contact is detected. After the eye contact is detected, the non-eye contact state is assumed to remain until the eye contact is detected. In this way, the system control unit 201 performs display control of the rear display unit 101 and the in-finder display unit 229 according to the eye contact state or the eye contact state detected by the eye contact detection unit 217.
[0062] The eye proximity detection unit 217 is not limited to an infrared proximity sensor, and any other sensor may be used as long as it can detect the approach of an eye or an object that can be regarded as an eye.
[0063] <Configuration of Information Processing Apparatus> Next, the configuration and functions of the information processing apparatus 300 of this embodiment will be described with reference to FIGS.
[0064] The information processing device 300 of this embodiment is hardware constituting the storage server 20 and the estimation server 30. The storage server 20 and the estimation server 30 may each be realized by a single information processing device, or may be realized by distributing each function among a plurality of information processing devices as necessary. When the storage server 20 and the estimation server 30 are constituted by a plurality of information processing devices, they are connected to each other so as to be able to communicate with each other.
[0065] In FIG. 3, a system bus 301 connects each unit 302 to 309 so that data can be communicated with each other. The control unit 302 is an arithmetic processing unit such as a CPU or MPU that controls the entire information processing device 300. The non-volatile memory 303 is a ROM that stores programs and parameters. The work memory 304 is a RAM that temporarily stores programs and data supplied from an external storage device or the network 40. The storage device 305 is an auxiliary storage device such as a hard disk or a memory card built into the information processing device 300, or an external storage device such as an optical disk, a magnetic or optical card, or an IC card that is detachable from the information processing device 300. The communication unit 306 is a network interface for connecting to a line such as the network 40. The operation unit 307 is an interface with an input device such as a pointing device or a keyboard that accepts user operations and inputs various data. The display unit 308 is an interface with a display device such as a display that displays data held by the information processing device 300 and supplied data. The calculation unit 309 is a GPU or the like that can perform efficient calculations by processing more data in parallel. When performing learning multiple times using a learning model such as deep learning, it is effective to perform the processing in the calculation unit 309.
[0066] The processing of the information processing device 300 described below is realized by the control unit 302 reading and executing a program acquired from the storage device 305 or the network 40, etc., and controlling various devices.
[0067] FIG. 4 is a diagram showing a software configuration realized by the hardware resources and programs shown in FIG.
[0068] The digital camera 10 has a data transmission / reception unit 401, a UI display control unit 402, an imaging control unit 403, and an image generation unit 404. The data transmission / reception unit 401 transmits operation history information including information on captured images captured by the digital camera 10 and imaging setting information to the information processing device 300, and receives customization functions (recommended customization functions) recommended to the user, which are estimated results, from the information processing device 300. The UI display control unit 402 displays images captured by the digital camera 10 and a customization setting screen. The imaging control unit 403 executes imaging processing for the digital camera 10. The image generation unit 404 performs various image processes on image data that has been subjected to imaging processing by the imaging control unit 403, and generates an image file.
[0069] The storage server 20 includes a data storage unit 451, a data management unit 452, and a data transmission / reception unit 453. The data storage unit 451 stores the operation history information received from the digital camera 10 in the non-volatile memory 303. The data management unit 452 manages the operation history information, such as registration and deletion. teeth The digital camera 10 receives operation history information from the digital camera 10 and transmits estimated results of customized functions to the digital camera 10 .
[0070] The estimation server 30 includes a data storage unit 461, a learning unit 462, and an estimation unit 463. The data storage unit 461 stores the result of the learning process in the learning unit 462 and the result of the estimation process in the estimation unit 463 in the non-volatile memory 303. The learning unit 462 executes a learning program for making a neural network used in the estimation process of the recommended customization function learn teacher data. The estimation unit 463 executes the estimation process of the recommended customization function using a trained model. When executing a learning program including a learning model, the learning unit 462 executes the learning process by the control unit 302 and the calculation unit 309 working together to perform calculations. The processing of the learning unit 462 may be performed by either the control unit 302 or the calculation unit 309. The processing of the estimation unit 463 may also be performed by either the control unit 302 or the calculation unit 309.
[0071] The learning unit 462 may also include an error detection unit and an update unit. The error detection unit obtains an error between the output data output from the output layer of the neural network according to the input data input to the input layer and the teacher data. The error detection unit may use a loss function to calculate the error between the output data from the neural network and the teacher data. The update unit updates the connection weighting coefficients between the nodes of the neural network, etc., based on the error obtained by the error detection unit, so as to reduce the error. The update unit updates the connection weighting coefficients, etc., using, for example, an error backpropagation method. The error backpropagation method is a method of adjusting the connection weighting coefficients between the nodes of each neural network so as to reduce the above-mentioned error.
[0072] 11A and 11B are data tables showing combinations of input data and teacher data used in the learning process.
[0073] Fig. 11A gives examples of input data, such as the number of times that whiteout photography was performed, the number of times that the ISO sensitivity setting was changed to a high ISO sensitivity, the number of times that the zebra setting was changed, the number of times that the exposure compensation setting was changed, and the number of times that the customization setting was changed. Fig. 11A also shows the optimal customization function for each input, and the correlation between the input data and the training data as the basis for the recommendation.
[0074] In FIG. 11A, if the input data indicates that the user has captured a blown-out image once and has changed the settings of the zebra function (a function that prevents blown-out highlights by superimposing a striped pattern corresponding to the brightness on a natural image) zero times, it is determined that the user is not familiar with the zebra function, and it is recommended that the zebra function be assigned to an operating member.
[0075] In addition, if the number of times the zebra function setting has been changed under the above conditions changes from 0 to 1, and the number of times the customization setting has been changed is 0, it is determined that the user is aware of the existence of the zebra function but is unaware that components can be customized with the zebra function, and it is recommended that the zebra function be assigned to an operating component.
[0076] Furthermore, if the number of times the customization settings for the above conditions have been changed changes from 0 to 1, it is determined that the user knows the existence of the zebra function and that it can be instantly switched on and off using the operating members, but does not know how to change the exposure and is therefore taking over-exposed images, and an exposure compensation setting that can adjust the exposure is recommended.
[0077] Figure 11B gives examples of input data, such as the number of times a subject image where the subject switches between static and dynamic states was captured, the number of times a backlit image where the face is dark and the background is bright was captured, the number of times the AF operation switching setting was made, the number of times the Auto Lighting Optimizer setting was made, and the number of times customization setting was made, and shows the optimal customization function for each input, as well as the correlation between the input data and the training data as the basis for the recommendation.
[0078] In Figure 11B, when the subject in the captured image is a person, a person's face, or an animal (e.g., a bird or a child), the AF mode switching function is recommended, which allows quick switching between one-shot AF, which is suitable for still images, and servo AF, which is suitable for dynamic images. Also, for users taking backlit images, the Auto Lighting Optimizer setting is recommended, which processes the image to bring the face to the appropriate brightness.
[0079] FIG. 5 shows input and output data for the learning model of this embodiment.
[0080] The input data 501 is operation history information including a captured image acquired by a user's shooting operation. The output data 502 is a score indicating an optimal customization function. The score is output as a probability between 0 and 1, and if it is estimated that the customization function is optimal for the user, it is output as a number close to 1. In addition, the learning method in the learning phase is to learn a combination of customization functions for operation history information prepared by a highly skilled user as teacher data. The learning unit 462 prepares and learns patterns for tens of thousands of people using the calculation unit 309, and then, for example, prepares and evaluates test operation history information for several thousand people, and repeats this until the accuracy rate is equal to or higher than a predetermined value. This is the same for the output in the estimation phase. In this embodiment, the user's operation history information is not reflected in the processing in the learning unit 462, but the user's operation history information may be reflected in the processing in the learning unit 462.
[0081] FIG. 6 shows a processing procedure of the system of this embodiment that uses the learning model shown in FIG.
[0082] First, the digital camera 10 transmits user operation history information to the storage server 20. The storage server 20 stores the operation history information received from the digital camera 10 in the data storage unit 451, and transmits the operation history information to the estimation server 30. The estimation server 30 calculates an optimal score for the customization function based on the operation history information using the trained model, and transmits the estimation result to the storage server 20. The storage server 20 transmits the estimation result to the digital camera 10.
[0083] By estimating the optimal customization function using this procedure, it becomes possible to calculate the score of a customization function that has a large processing load. If the processing load can be sufficiently handled by the digital camera 10, the estimation calculation can be performed by the digital camera 10. If the digital camera 10 has a sufficient storage capacity, the operation history information can be stored in the digital camera 10.
[0084] FIG. 7 is a flowchart showing the processing of the digital camera 10 in the processing procedure of FIG.
[0085] The processing in FIG. 7 is realized by the system control unit 201 loading a program stored in the non-volatile memory 256 into the system memory 252, executing it, and controlling each unit of the digital camera .
[0086] In S701, the system control unit 201 determines whether or not an instruction to change the shooting settings has been issued. If the control unit 201 determines that an instruction to change the shooting settings has been issued, the process proceeds to S702, and if the control unit 201 determines that an instruction to change the shooting settings has not been issued, the process proceeds to S704. Examples of the shooting settings include ISO sensitivity settings, exposure compensation settings, zebra settings, AF operation switching settings, auto lighting optimizer settings, and customization settings.
[0087] In S702, the system control unit 201 changes shooting settings such as the ISO sensitivity setting, exposure compensation setting, zebra setting, AF operation switching setting, auto lighting optimizer setting, and customization setting, and stores them in the system memory 252.
[0088] In S703, the system control unit 201 stores the shooting setting information indicating the number of times the changed shooting settings have been changed as operation history information in the system memory 252. In this embodiment, in consideration of the fact that the data amount of the operation history information will be large, the operation history information is temporarily stored in the digital camera 10 and then stored long-term in the storage server 20. However, if the memory capacity of the digital camera 10 is sufficiently large, the operation history information may be stored long-term in the digital camera 10. Also, in this embodiment, the number of times the shooting settings have been changed is stored as the operation history information, but instead of the number of times the settings have been changed, the operation history information may also include the time the settings have been used, the number of times images have been taken using the settings, or the like.
[0089] In S704, the system control unit 201 determines whether or not the shutter button 102 has been pressed, that is, whether or not a shooting instruction has been issued. If the system control unit 201 determines that the shutter button 102 has been pressed, the process proceeds to S705, and if the system control unit 201 determines that the shutter button 102 has not been pressed, the process proceeds to S712.
[0090] In S705, the system control unit 201 generates a captured image file from image data captured by the imaging control unit 403 using the image generation unit 404, and stores the captured image file in the recording medium 250.
[0091] In S706, the system control unit 201 determines whether the captured image generated in S705 has whiteout. If the system control unit 201 determines that the captured image has whiteout, the process proceeds to S707. If the system control unit 201 determines that the captured image does not have whiteout, the process proceeds to S708.
[0092] In S707, the system control unit 201 stores the number of times blown-out highlight images were captured as operation history information in the system memory 252. In this embodiment, the number of times blown-out highlight images were captured is stored as operation history information, but the number of times a blown-out highlight image was deleted after capture may also be stored as operation history information.
[0093] In S708, the system control unit 201 determines whether the captured image generated in S705 is a backlit image with a dark face and a bright background. If the system control unit 201 determines that the captured image is a backlit image with a dark face and a bright background, the process proceeds to S709, and if the system control unit 201 determines that the captured image is not a backlit image with a dark face and a bright background, the process proceeds to S710.
[0094] In S709, system control unit 201 stores the number of times a backlit image with a dark face and a bright background has been shot as operation history information in system memory 252. In this embodiment, the number of times a backlit image with a dark face and a bright background has been shot is stored as operation history information, but the number of times a backlit image has been deleted after shooting may also be stored as operation history information.
[0095] In S710, the system control unit 201 determines whether the captured image generated in S705 is of a subject whose state changes between still and moving, such as a child or a bird. If the system control unit 201 determines that the captured image is of a subject whose state changes between still and moving, such as a child or a bird, the process proceeds to S711, and if the system control unit 201 determines that the captured image is not of a subject whose state changes between still and moving, such as a child or a bird, the process proceeds to S712.
[0096] In S711, the system control unit 201 stores the number of times an image of a subject whose state switches between still and moving, such as a child or a bird, has been captured as operation history information in the system memory 252. In this embodiment, the number of times an image of a subject whose state switches between still and moving, such as a child or a bird, has been captured is stored as operation history information, but the number of times an image of a subject whose state switches between still and moving has been deleted after being captured may also be stored as operation history information.
[0097] In S712, the system control unit 201 determines whether or not an estimated instruction for a customization function has been issued by a user operation. If the system control unit 201 determines that an estimated instruction for a customization function has been issued, the process proceeds to S713. If the system control unit 201 determines that an estimated instruction for a customization function has not been issued, the process proceeds to S714.
[0098] In S713, the system control unit 201 transmits the operation history information to the storage server 20 via the data transmission / reception unit 401. The operation history information transmitted here is based on the shooting settings, shot image information, and the like.
[0099] In S714, the system control unit 201 determines whether or not a recommended customization function has been received from the storage server 20 as an estimation result in the estimation server 30 via the data transmission / reception unit 401. If the system control unit 201 determines that a recommended customization function has been received from the storage server 20, the process proceeds to S715, and if the system control unit 201 determines that a recommended customization function has not been received from the storage server 20, the process proceeds to S717.
[0100] In S715, the system control unit 201 estimates an operation member suitable for the recommended customization function received in S714. The estimation process of the operation member suitable for the recommended customization function may use a learned model obtained by machine learning, or may perform rule-based processing such as a look-up table (LUT). When the LUT is used, for example, the relationship between input data and output data may be created in advance as an LUT, and the created LUT may be stored in the non-volatile memory 256 of the digital camera 10. The estimation of the operation member suitable for the recommended customization function can be performed by acquiring the output data with reference to this LUT. In other words, the LUT can operate in cooperation with a CPU or a GPU as a program for performing processing equivalent to the estimation process of the operation member suitable for the recommended customization function.
[0101] Specifically, when an exposure compensation function is received from the information processing device 300 as a recommended customization function related to the shooting function, there is a high possibility that the user will use the function while looking through the viewfinder and checking a live view image. For this reason, user convenience is improved by assigning the function to the multi-function button 118, which is located near the viewfinder and easy to operate even with blinds. It is also possible to determine that an operating member whose customization function has been changed from the initial value has been intentionally changed, and to estimate that a preferential assignment should be given to an operating member whose customization function has not been changed from the initial value.
[0102] Furthermore, the customization function can be assigned not only to components that can be physically operated, but also to components that can detect touch operations, such as a touch panel, and it is also possible to assign functions to each touch operation, such as touch down and touch up, in more detail.
[0103] Furthermore, in this embodiment, estimation of operation members suitable for the recommended customization functions is performed in the digital camera 10, but it may also be performed in the storage server 20 or the estimation server 30.
[0104] In S716, the system control unit 201 causes the UI display control unit 402 to display a customization setting screen as shown in Fig. 10 on the rear display unit 101. In Fig. 10, the customization setting screen 1000 can present multiple recommended candidate functions with high priority based on the score calculated by the trained model in the estimation unit 463 as in 1001, can present the reason for recommendation as in 1002, and can present which function is suitable for allocation to which component as in 1003.
[0105] In S717, the system control unit 201 determines whether or not an instruction has been given to turn off the power in order to end the processing of the digital camera 10. If the system control unit 201 determines that an instruction to turn off the power has been given, it ends the processing, and if it determines that an instruction to turn off the power has not been given, it returns the processing to S701.
[0106] It should be noted that if an abnormal operation such as turning the mode dial is performed during the processing of FIG. 7, the processing may be interrupted midway.
[0107] FIG. 8 is a flowchart showing the processing of the storage server 20 in the processing procedure of FIG.
[0108] The processing in FIG. 8 is realized by the control unit 302 of the information processing device 300 expanding a program stored in the non-volatile memory 303 into the work memory 304, executing the program, and controlling each unit of the storage server 20.
[0109] In S801, the control unit 302 determines whether or not operation history information has been received from the digital camera 10. If the control unit 302 determines that operation history information has been received from the digital camera 10, the process proceeds to S802, and if the control unit 302 determines that operation history information has not been received from the digital camera 10, the process proceeds to S804.
[0110] In S 802 , the control unit 302 causes the data storage unit 451 to store the operation history information received from the digital camera 10 in the work memory 304 .
[0111] In S803, the control unit 302 transmits the operation history information to the estimation server 30 via the data management unit 452.
[0112] In S804, the control unit 302 determines whether or not it has received a recommended customization function that is an estimation result transmitted from the estimation server 30. If the control unit 302 determines that it has received an estimation result from the estimation server 30, it proceeds to S805, and if it determines that it has not received an estimation result from the estimation server 30, it proceeds to S806.
[0113] In S805 , the control unit 302 causes the data transmission / reception unit 453 to transmit the recommended customization functions, which are the estimation results received from the estimation server 30 , to the digital camera 10 .
[0114] In S806, the control unit 302 determines whether or not a power-off command has been issued to end the process. If the control unit 302 determines that a power-off command has been issued, the control unit 302 ends the process. If the control unit 302 determines that a power-off command has not been issued, the control unit 302 returns the process to S801.
[0115] If an abnormal operation is performed during the process of FIG. 8, the process may be interrupted midway.
[0116] FIG. 9 is a flowchart showing the process of the estimation server 30 in the process procedure of FIG.
[0117] The process of FIG. 9 is realized by the control unit 302 of the information processing device 300 expanding a program stored in the non-volatile memory 303 into the work memory 304, executing the program, and controlling each unit of the estimation server 30.
[0118] In S901, the control unit 302 determines whether or not operation history information has been received from the storage server 20. If the control unit 302 determines that the operation history information has been received from the storage server 20, the process proceeds to S902, and if the control unit 302 determines that the operation history information has not been received from the storage server 20, the process proceeds to S904.
[0119] In S902, the control unit 302 executes an estimation process of a recommended customization function by the estimation unit 463 based on the operation history information received in S901. As described above, the estimation unit 463 performs the estimation process using a learned model in which combinations of customization functions for operation history information prepared by a highly skilled user are learned in advance as teacher data by the learning unit 462. This makes it possible to discover issues that a user has from the user's operation history information and present optimal customization functions. This has the same effect as, for example, a highly skilled user proposing a zebra function as a solution to a user who is having trouble with blown-out highlights.
[0120] Further, in the estimation unit 463, the processing is performed using a trained model that has been machine-learned, but rule-based processing such as a look-up table (LUT) may be performed. When the LUT is used, for example, the relationship between the image and the auxiliary information and the improvement effect may be created in advance as an LUT, and the created LUT may be stored in the data storage unit 461. The estimation unit 463 can acquire output data by referring to the LUT stored in the data storage unit 461. That is, the LUT realizes the above-mentioned processing by operating in cooperation with the control unit 302, the calculation unit 309, etc. as a program for performing processing equivalent to that of the estimation unit 463.
[0121] In S903 , the control unit 302 transmits the recommended customization function that is the estimation result by the estimation unit 463 to the storage server 20 .
[0122] In S904, the control unit 302 determines whether or not a power-off command has been issued to end the process. If the control unit 302 determines that a power-off command has been issued, the control unit 302 ends the process. If the control unit 302 determines that a power-off command has not been issued, the control unit 302 returns the process to S901.
[0123] It should be noted that if an abnormal operation such as turning the mode dial or the like is performed during the processing of FIGS. 7 to 9, the processing may be interrupted midway.
[0124] If an abnormal operation is performed during the process of FIG. 9, the process may be interrupted midway.
[0125] As described above, according to this embodiment, a recommended customization function related to the shooting function is estimated based on operation history information including captured image information, and the estimated operation members suitable for the recommended customization function are presented to the user. This allows even a user who does not know the contents of the function to assign an appropriate function to an appropriate member, thereby enabling the user to take better still images and videos.
[0126] In this embodiment, an example has been described in which the digital camera 10, the storage server 20, and the estimation server 30 share and control each of the processes, but all of the processes may be performed by a single piece of hardware, or the entire system may be controlled by multiple pieces of hardware sharing the processes.
[0127] In addition, although the present invention has been described in detail based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, the above-mentioned embodiment is merely one embodiment of the present invention, and each embodiment can be appropriately combined.
[0128] In the above-described embodiment, the present invention is described as being applied to an image capture device such as a digital camera or an information processing device such as a server computer, but the present invention is not limited to this example and can be applied to any device that has a camera function. That is, the present invention can be applied to a personal computer or tablet terminal that has a camera function, a mobile phone, or a smartphone, which is a type of mobile phone.
[0129] [Other embodiments] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.
[0130] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]
[0131] 10 digital camera, 20 storage server, 30 estimation server, 201 system control unit, 300 information processing device, 302 control unit
Claims
1. An imaging device having a customization function for assigning a predetermined photographing function to a predetermined operation member, An acquisition means for acquiring photographed image information through a user's photographing operation; an estimation means for estimating an operation member suitable for a customization function recommended to a user, the operation member being a result of performing an estimation process based on the captured image information; a presentation unit that presents to the user a customization function that is recommended to the user and an operation member that is suitable for the customization function; The captured image information includes operation history information of a user's photographing operation, the operation member is a member that can be physically operated by a user or a member that can detect a touch operation, the result of the estimation process includes a plurality of photographing functions that can be assigned to the operation member and reasons for recommending the plurality of photographing functions; the presenting means presents a plurality of photographing functions that can be assigned to the operation member and reasons why the plurality of photographing functions are recommended; The estimation means estimates customization functions to be recommended to a user based on a model obtained by learning using information that corresponds to the relationship between the captured image information, the operation history information, and the photographing functions to be assigned to the operating members.
2. The imaging device according to claim 1, characterized in that the estimation means estimates an operating member to which the multiple shooting functions can be assigned.
3. 3. The imaging apparatus according to claim 1, wherein the estimation means estimates that a photographing function using a viewfinder is assigned to an operation member that the user can operate while looking through the viewfinder.
4. The imaging apparatus according to claim 1 , wherein the operation history information includes shooting setting information.
5. a transmitting means for transmitting the captured image information to an external device; 5. The imaging apparatus according to claim 1, further comprising a receiving unit configured to receive an estimated result of customization functions recommended to the user from the external device.
6. An imaging device having a customization function for assigning a predetermined photographing function to a predetermined operating member, An acquisition means for acquiring photographed image information through a user's photographing operation; a transmitting means for transmitting the captured image information to an external device; a receiving means for receiving from the external device a result of an estimation process for estimating customization functions to be recommended to a user based on the captured image information; an estimation means for estimating an operation member suitable for a customization function recommended to the user, The captured image information includes operation history information of a user's photographing operation, the operation member is a member that can be physically operated by a user or a member that can detect a touch operation, The imaging device is characterized in that the estimation process estimates customization functions to be recommended to the user based on a model obtained by learning using information that corresponds to the relationship between the captured image information, the operation history information, and the shooting functions to be assigned to the operating members.
7. The acquiring means stores the photographed image information when the photographed image satisfies a predetermined condition, 7. The imaging apparatus according to claim 6, wherein the transmission means transmits the captured image information stored by the acquisition means to the external device.
8. The imaging device according to claim 7, characterized in that the specified condition is at least one of the following: when there is whiteout in the captured image, when a specified subject in the captured image is dark and the background excluding the specified subject is bright, and when a specified subject in the captured image switches between a static and a dynamic state.
9. 9. The imaging apparatus according to claim 8, wherein the predetermined subject is any one of a person, a person's face, and an animal.
10. an acquisition means for acquiring captured image information from an imaging device having a customization function for assigning a predetermined photographing function to a predetermined operation member; an estimation means for estimating a customization function to be recommended to a user based on captured image information acquired from the imaging device, The captured image information includes operation history information of a user's photographing operation, The information processing device is characterized in that the estimation means estimates customization functions to be recommended to the user based on a model obtained by learning using information in which the captured image information, the operation history information, and the photographing functions to be assigned to the operating members are associated with each other.
11. A storage means for storing photographed image information acquired from the imaging device; 11. The information processing apparatus according to claim 10, further comprising a transmission unit that transmits an estimation result of the customization function recommended to the user to the imaging device.
12. The information processing apparatus according to claim 10 , wherein the model is learned with or without reflecting operation history information of a user.
13. 13. The information processing device according to claim 10, wherein the estimation result by the estimation means includes a plurality of photographing functions that can be assigned to the operation member and reasons for recommending the plurality of photographing functions.
14. The information processing apparatus according to claim 10 , wherein the operation history information includes shooting setting information.
15. A control method for an imaging device having a customization function for assigning a predetermined photographing function to a predetermined operation member, comprising: acquiring captured image information through a user's photographing operation; A step of estimating an operation member suitable for a customization function recommended to a user, the operation member being a result of performing an estimation process based on the captured image information; presenting to the user customization functions recommended to the user and operation members suitable for the customization functions; The captured image information includes operation history information of a user's photographing operation, the operation member is a member that can be physically operated by a user or a member that can detect a touch operation, the result of the estimation process includes a plurality of photographing functions that can be assigned to the operation member and reasons for recommending the plurality of photographing functions; the presenting step presents a plurality of photographing functions that can be assigned to the operation member and reasons why the plurality of photographing functions are recommended; The estimation process estimates customization functions to be recommended to the user based on a model obtained by learning using information that corresponds to the relationship between the captured image information, the operation history information, and the photographing functions to be assigned to the operating members.
16. A control method for an imaging device having a customization function for assigning a predetermined photographing function to a predetermined operation member, comprising: acquiring captured image information through a user's photographing operation; transmitting the captured image information to an external device; receiving, from the external device, a result of an estimation process for estimating customization functions recommended to a user based on the captured image information; and estimating an operation member suitable for a customization function recommended to the user, The captured image information includes operation history information of a user's photographing operation, the operation member is a member that can be physically operated by a user or a member that can detect a touch operation, The estimation process estimates customization functions to be recommended to the user based on a model obtained by learning using information that corresponds to the relationship between the captured image information, the operation history information, and the photographing functions to be assigned to the operating members.
17. A control method executed by an information processing device, comprising: acquiring captured image information from an imaging device having a customization function for assigning a predetermined photographing function to a predetermined operation member; and estimating a customization function to be recommended to a user based on captured image information acquired from the imaging device, The captured image information includes operation history information of a user's photographing operation, A control method characterized in that in the estimating step, a customization function to be recommended to the user is estimated based on a model obtained by learning using information that corresponds to the relationship between the captured image information, the operation history information, and the photographing functions to be assigned to the operating members.
18. A program for causing a computer to function as the imaging device according to any one of claims 1 to 9.
19. A program for causing a computer to function as the information processing device according to any one of claims 10 to 14.
Citation Information
Patent Citations
Camera
JP2004053722A
Information processing apparatus, display method, and program
JP2011118769A
