Electronics and imaging systems

Abstract

According to one embodiment of the present disclosure, an electronic device includes: an imaging unit for acquiring imaging data; a data generating unit for generating emotional data from the acquired data; a data processing unit for associating the imaging data with the emotional data in chronological order; and a control unit for changing the setting of the imaging unit over time based on the emotional data.

Description

Technical Field

[0001] The present disclosure relates to an electronic device and an imaging system. Background Art

[0002] Digital cameras or smartphones are recently equipped with a function called "Smile Shutter" (registered trademark) that automatically releases the shutter in response to a determination result of whether a subject is smiling to accurately capture the moment of smiling (see, for example, Patent Document 1).

[0003] Existing patent literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Unexamined Patent Application Publication No. 2018-151660 Summary of the invention

[0006] By the way, the user may want to take a picture not only at the moment of smiling, but also at the moment of natural expression of a child or a precious moment in an activity, for example. However, when the user holds the camera, the natural expression may disappear and the expression may become a fake smile or a nervous expression, making it difficult to take a picture of the natural expression. In addition, the precious moment comes suddenly, so that the user may miss the shot when holding the camera. Therefore, it is desirable to provide an electronic device and an imaging system that enable a user to take a picture without missing the moment he / she wants to take.

[0007] According to an embodiment of the present disclosure, the electronic device includes: an imaging unit for acquiring imaging data; a data generator for generating emotional data based on the acquired data; a data processor for associating the imaging data with the emotional data in chronological order; and a controller for changing the settings of the imaging unit in chronological order based on the emotional data.

[0008] According to an embodiment of the present disclosure, the imaging system includes: an imaging unit that acquires imaging data; a data generator that generates emotional data based on the acquired data; a data processor that correlates the imaging data with the emotional data in chronological order; and a controller that controls the imaging unit based on the emotional data.

[0009] In the electronic device and imaging system according to the embodiment of the present disclosure, imaging data and emotion data are associated with each other in time sequence, and the imaging unit is controlled based on the emotion data. Thus, for example, in the case where the emotion data changes at the moment when the user reacts to the photographed object, the monitoring of the emotion data makes it possible to grasp the moment when the user may want to take a photo. As a result, for example, it becomes possible to obtain imaging data in response to the change of the emotion data without the user manually releasing the shutter. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] [ Figure 1] is a diagram showing an example of functional blocks of an electronic device according to an embodiment of the present disclosure.

[0011] [ Figure 2 ] is a diagram used to describe the delay time.

[0012] [ Figure 3 ] is a diagram showing an example of a process regarding adjustment of a delay time and selection of a sensor.

[0013] [ Figure 4 ] is a diagram showing an example of a display screen for adjustment of delay time and selection of a sensor.

[0014] [ Figure 5 ] is a diagram showing an example of a control process of an imaging device.

[0015] [ Figure 6 ] is a diagram showing an example of a control process of an imaging device.

[0016] [ Figure 7 ] is a diagram showing an example of a control method of an imaging device.

[0017] [ Figure 8 ] is a diagram showing an example of a control process of an imaging device.

[0018] [ Fig. 9 ] is shown Figure 8 Figure 2. Resolution change during the control process.

[0019] [ Fig.10 ] is a diagram showing an example of a control process of an imaging device.

[0020] [ Fig.11 ] is a diagram showing an example of a control process of an imaging device.

[0021] [ Fig.12 ] is shown Fig.11 Figure 2. Resolution change during the control process.

[0022] [ Fig.13 ] is shown Figure 1 A diagram of a modified example of functional blocks of an electronic device.

[0023] [ Fig.14 ] is shown Figure 1 A diagram of a modified example of functional blocks of an electronic device.

[0024] [ Fig.15 ] is shown Figure 1 A diagram of a modified example of functional blocks of an electronic device.

[0025] [ Fig.16 ] is shown Figure 1A diagram of a modified example of functional blocks of an electronic device.

[0026] [ Fig.17 ] is shown Figure 1 A diagram of a modified example of functional blocks of an electronic device.

[0027] [ Fig.18 ] is to show that Figure 1 , Fig.13 , Fig.14 , Fig.15 or Fig.16 A diagram of an example of a state in which an electronic device is attached to a user's body.

[0028] [ Fig.19 ] is to show that Figure 1 , Fig.13 , Fig.14 , Fig.15 or Fig.16 A diagram of an example of a state in which an electronic device is attached to a user's body.

[0029] [ Fig. 20 ] is to show that Figure 1 , Fig.13 , Fig.14 , Fig.15 or Fig.16 A diagram of an example of a state in which an electronic device is attached to a user's body. DETAILED DESCRIPTION

[0030] In the following, specific embodiments for the present disclosure will be described in detail with reference to the accompanying drawings. The following description is a specific example of the present disclosure, and the present disclosure is not limited to the following embodiments. Note that the description is given in the following order.

[0031] 1. Implementation Method

[0032] Example with screen display and audio output

[0033] 2. Modifications

[0034] Modification A: An example in which the functions of screen display and audio output are provided in an external device Modification B: An example in which the storage function is provided in an external device

[0035] Modification C: Example of communicating with an external device via a network

[0036] Modification D: Example of communicating with a display device and a storage device via a network

[0037] Modification E: Example in which the imaging section is provided separately

[0038] Modification F: Example of being configured to be attachable to the body

[0039] Modification G: Example including a plurality of imaging units

[0040] Modification H: Example including a wide-angle lens or a fisheye lens

[0041] <1. Implementation Method>

[0042] [structure]

[0043] An electronic device 1 according to an embodiment of the present disclosure will be described. Figure 1 An example of a schematic configuration of an electronic device 1 according to the present embodiment is shown. The electronic device 1 includes an imaging system that automatically acquires imaging data Dc of a scene meaningful to a user without relying on an operation of a shutter key by the user. For example, the electronic device 1 includes an imaging block 10, a sound block 20, a storage block 30, a system controller 40, an external input block 50, and a communication unit 60. The system controller 40 corresponds to a specific example of a “controller” according to the present disclosure.

[0044] For example, the imaging block 10 includes an imaging section 11, an imaging signal processor 12, an imaging controller 13, an image processor 14, an image signal generator 15, a display driver 16, a display controller 17, and a display section 18. The image processor 14 corresponds to a specific example of a “data generator” and a “data processor” according to the present disclosure. The imaging signal processor 12 and the imaging controller 13 correspond to a specific example of a “controller” according to the present disclosure. For example, the sound block 20 includes a sound input section 21, a sound analyzer 22, a sound processor 23, an audio signal generator 24, and an audio output section 25. For example, the storage block 30 includes a temporary memory 31 and a storage section 32. For example, the external input block 50 includes an operation input section 51, a date / time counter 52, and a sensor 53.

[0045] The imaging section 11 outputs imaging data Da obtained by imaging (moving images, or a plurality of still images obtained by continuous imaging) to the imaging signal processor 12. For example, the imaging section 11 includes a CCD (Charge Coupled Device) image sensor, a CMOS (Complementary Metal Oxide Semiconductor) image sensor, or the like.

[0046] The imaging signal processor 12 performs various types of image signal processing on the imaging data Da output from the imaging section 11, and includes, for example, a DSP (digital signal processing) circuit. For example, the imaging signal processor 12 can detect the amount and direction of camera shake in the imaging data Da, determine a cutout area in the imaging data Da based on the amount and direction of camera shake that has been detected, and generate imaging data Da' in which the camera shake has been corrected based on the determination.

[0047] The imaging data Da or the imaging data Da' processed by the imaging signal processor 12 is output to the image processor 14. Note that in the following description, the imaging data Da may be the imaging data Da'. The imaging controller 13 controls the operation of the imaging section 11 and the imaging signal processor 12 according to the control of the system controller 40.

[0048] The image processor 14 controls the transmission of imaging data Da, imaging data Dc, evaluation data Dd to be described later, etc. according to the control of the system controller 40. That is, the image processor 14 controls the transmission of imaging data Da, imaging data Dc, evaluation data Dd, etc. between the imaging signal processor 12 and the image signal generator 15, the temporary memory 31, and the storage section 32. The evaluation data Dd is generated by the image processor 14 as described below. The image processor 14 inputs the imaging data Da, the evaluation data Dd, etc. to the temporary memory 31. The temporary memory 31 stores the imaging data Da, the evaluation data Dd, etc. The storage section 32 stores the imaging data Dc as a part of the imaging data Da.

[0049] The image processor 14 also extracts imaging data Dc satisfying a predetermined storage condition from the imaging data Da. A method of extracting the imaging data Dc by the image processor 14 and the evaluation data Dd will be described in detail later.

[0050] The image processor 14 also outputs the generated evaluation data Dd to the system controller 40. The system controller 40 controls the imaging section 11 and the imaging signal processor 12 based on the evaluation data Dd input from the image processor 14 (i.e., based on the emotion data Df). Specifically, the system controller 40 outputs a control signal generated based on the evaluation data Dd input from the image processor 14 to the imaging controller 13. The imaging controller 13 controls the imaging section 11 and the imaging signal processor 12 based on the control signal input from the system controller 40. The control of the imaging section 11 and the imaging signal processor 12 by the system controller 40 will be described in detail later.

[0051] The image signal generator 15 generates an image signal based on the imaging data Da, and outputs the image signal to the display driver 16. The display driver 16 drives the display section 18 based on the image signal input from the image signal generator 15. The display controller 17 controls the operations of the image signal generator 15 and the display driver 16 according to the control of the system controller 40. The display section 18 includes, for example, a panel type display device such as a liquid crystal panel or an organic EL (Electro Luminescence) panel, and displays the imaging data Da driven by the display driver 16.

[0052] The sound input unit 21 includes, for example, a microphone, a microphone amplifier, and an AD converter, and outputs digital sound data Sa. The microphone amplifier amplifies the sound signal obtained by the microphone, and the AD converter performs AD conversion on the sound signal amplified by the microphone amplifier. The sound data Sa obtained by the sound input unit 21 is input to the sound processor 23.

[0053] The sound processor 23 controls the transmission of the sound data Sa according to the control of the system controller 40. That is, the sound processor 23 controls the transmission of the sound data Sa between the sound input section 21 and the audio signal generator 24, the temporary memory 31, and the storage section 32. The sound processor 23 inputs the sound data Sa obtained through the sound input section 21 to the temporary memory 31. The temporary memory 31 stores the sound data Sa obtained through the sound input section 21 together with the imaging data Da obtained through the imaging section 11. The sound processor 23 outputs the sound data Sa obtained through the sound input section 21 to the audio signal generator 24.

[0054] The sound processor 23 controls the transfer of the sound data Sa read from the temporary storage 31 according to the control of the system controller 40. That is, the sound processor 23 controls the transfer of the sound data Sa between the temporary storage 31 and the audio signal generator 24. The sound processor 23 outputs the sound data Sa read from the temporary storage 31 to the audio signal generator 24.

[0055] The audio signal generator 24 converts the input sound data Sa into a logical audio signal according to the control of the system controller 40, and outputs the audio signal obtained by the conversion to the audio output section 25. For example, the audio output section 25 includes an amplifier circuit that amplifies the logical audio signal, and a speaker that outputs sound based on the audio signal output from the amplifier circuit.

[0056] The temporary memory 31 is used to buffer the imaging data Da obtained by the imaging section 11, and, for example, temporarily stores the imaging data Da and the sound data Sa in a ring memory format. For example, the image processor 14 deletes data of the portion of the imaging data Da stored in the temporary memory 31 that has been stored in the temporary memory 31 for a period exceeding a predetermined period (for example, a storage period Δt to be described later), or overwrites it with newly stored imaging data Da.

[0057] The storage section 32 stores imaging data Dc satisfying a predetermined storage condition among the imaging data Da obtained by the imaging section 11. When the predetermined storage condition is satisfied, the system controller 40 extracts the imaging data Dc to be stored from the imaging data Da temporarily stored in the temporary storage 31 at that point in time, and transmits the imaging data Dc to the storage section 32.

[0058] Here, the imaging data Dc to be stored in the storage unit 32 is, for example, imaging data of scenes meaningful to the user in the continuously imaged imaging data Da that the system controller 40 has determined to be, such as imaging data of scenes that the user is interested in, imaging data of scenes when the user's emotions change, imaging data of scenes retained in the user's memory, and the like.

[0059] The operation input section 51 includes, for example, an operation object such as a keyboard or a dial. The operation input section 51 receives input from a user through an operation object operated by the user, for example, and outputs the input to the system controller 40. For example, the date / time counter 52 counts date and time (year, month, day, hour, minute, and second), and outputs current date and time information (hereinafter referred to as "time data Dt") to the system controller 40.

[0060] The sensor 53 measures at least one of pulse, heart rate, electrocardiogram, electromyogram, respiration, sweating, GSR, blood pressure, blood oxygen saturation, skin surface temperature, electroencephalogram, blood flow change, body temperature, movement of the body, movement of the head, center of gravity, rhythm of walking or running, eye condition, or surrounding sound, and outputs measurement data obtained by the measurement (hereinafter referred to as "acquisition data Db") to the system controller 40. The system controller 40 outputs the acquisition data Db input from the sensor 53 to the image processor 14 in association with the time data Dt input from the date / time counter 52.

[0061] The communication unit 60 can communicate with an external device via a network. Here, the network is, for example, a network that uses a communication protocol (TCP / IP) commonly used in the Internet for communication. For example, the network may be a secure network that uses its own communication protocol for communication. The network may be, for example, the Internet, an intranet, or a local area network. For example, the connection between the network and the communication unit 60 may be a wired LAN (local area network) such as Ethernet (registered trademark), a wireless LAN such as Wi-Fi, a cellular phone line, etc.

[0062] The communication unit 60 may be able to communicate with an external device through near field communication. For example, the near field communication in the communication unit 60 is performed through ISO / IEC14443 (international standard for short-range RFID), ISO / IEC18092 (international standard for wireless communication called NFC), ISO / IEC15693 (international standard for RFID), Bluetooth (registered trademark), etc.

[0063] Next, description will be given of a method of extracting imaging data Dc performed by the image processor 14. First, the principle of delay time and a method of adjusting the delay time will be described, and thereafter the method of extracting imaging data Dc will be described.

[0064] Figure 2 is a diagram for describing the principle of the delay time td. Figure 2 The imaging data Da stored in the temporary storage 31 is conceptually shown. The temporary storage 31 stores the imaging data Da obtained by imaging by the imaging unit 11 during the storage period Δt. Figure 2 The evaluation data Dd in is a numerical evaluation of the user's emotion generated based on the acquisition data Db. The image processor 14 generates emotion data Df based on the acquisition data Db, and generates evaluation data Dd based on the generated emotion data Df.

[0065] The evaluation data Dd relates to the user's emotions and, therefore, has a predetermined corresponding relationship with the imaging data Da. However, the imaging data Da and the evaluation data Dd at the same time point cannot be correlated with each other. This is because, when the user views several scenes at time point t1, the user's emotions (emotional data Df) change significantly at time point t2 which has a slight time delay from time point t1. Therefore, when the imaging data Da is correlated with the evaluation data Dd and the emotional data Df in chronological order, there is a delay time td. Thus, the electronic device 1 correlates the imaging data Da and the emotional data Df in chronological order taking the delay time into consideration. Specifically, the electronic device 1 correlates the imaging data Da acquired at time point t1 (first time point) with the emotional data Df acquired at time point t2 (second time point) which is later than time point t1 by a delay time td.

[0066] Figure 3 An example of a process for adjusting the delay time td is shown. First, the image processor 14 acquires imaging data Da and acquisition data Db (step S101). Thereafter, the image processor 14 generates emotion data Df based on the acquisition data Db (step S102). The image processor 14 generates emotion data Df for each type of acquisition data Db. Thereafter, the image processor 14 evaluates the imaging data Da based on the emotion data Df (step S103). The image processor 14 calculates intensity data of at least pleasure / discomfort or activity / inactivity based on the emotion data Df, and sets the calculated intensity data as evaluation data Dd.

[0067] The image processor 14 outputs the obtained evaluation data Dd and imaging data Da to the image signal generator 15. The image signal generator 15 generates an image signal for displaying the evaluation data Dd and imaging data Da input from the image processor 14, and outputs the image signal to the display driver 16. The display driver 16 drives the display section 18 based on the image signal input from the image signal generator 15. The display section 18 is driven by the display driver 16, and thereby displays the imaging data Da and the evaluation data Dd (step S104).

[0068] Figure 4 1 shows an example of a display screen for adjusting the delay time td and selecting a sensor. The display section 18 is driven by the display driver 16 and thus displays a display screen 18A, such as Figure 4 The display screen 18A includes, for example, a reproduction window W1, a timeline window W2, an evaluation data window W3, a delay time display window W4, a sensor selection button BT1, and a selection button BT2.

[0069] In the reproduction window W1, for example, the reproduction of imaging data Da (moving image, or multiple still images obtained by continuous imaging) is started by clicking the reproduction window W1, and the reproduction of imaging data Da is stopped by clicking the reproduction window W1 during the reproduction of the imaging data Da.

[0070] In the timeline window W2, for example, a part of the imaging data Da is horizontally arranged in time order, and the reproduction position or reproduction speed of the imaging data Da reproduced in the reproduction window W1 is adjusted by horizontally sliding the timeline window W2. In the timeline window W2, for example, the reproduction line Ls is displayed at a position corresponding to the reproduction time point ts of the imaging data Da reproduced in the reproduction window W1.

[0071] In the evaluation data window W3, for example, the evaluation data Dd is displayed corresponding to the imaging data Da simultaneously displayed in the timeline window W2 in time sequence. In the timeline window W3, for example, the reproduction line Ls is displayed at a position corresponding to the reproduction time point ts of the imaging image Da reproduced in the reproduction window W1. In the evaluation data window W3, for example, the peak line Lp is further displayed at a position corresponding to the peak position (peak time point tp) of the evaluation data Dd.

[0072] In the delay time display window W4, for example, the difference (tp-ts) between the peak time point tp and the reproduction time point ts is displayed as the delay time. In the sensor selection button BT1, for example, by clicking the sensor selection button BT1, a screen for changing the sensor to be used for generating the evaluation data Dd or for mixing the sensors to be used for generating the evaluation data Dd (that is, selecting a plurality of types of sensors) is displayed. The user can change the sensor to be used for generating the evaluation data Dd and mix the sensors to be used for generating the evaluation data Dd (that is, selecting a plurality of types of sensors). In the selection button BT2, for example, clicking the selection button BT2 makes the delay time displayed on the delay time display window W4 at the click time point become the delay time td.

[0073] The image processor 14 receives the delay time td and the type of sensor determined by the user's operation in the display screen 18A (step S105). The image processor 14 stores the received data of the delay time td and the type of sensor in the temporary memory 31. In this way, the adjustment of the delay time td and the selection of the sensor are performed.

[0074] Next, a method of extracting imaging data Dc will be described.

[0075] Figure 5 An example of a process of extracting imaging data Dc is shown. First, the image processor 14 acquires imaging data Da and acquisition data Db (step S201). Thereafter, the image processor 14 generates emotion data Df based on the acquisition data Db (step S202). The image processor 14 generates emotion data Df for each type of acquisition data Db. Thereafter, the image processor 14 associates the emotion data Df with the imaging data Da in consideration of the delay time td (step S203). For example, the image processor 14 stores a table Dg in which the emotion data Df is associated with the imaging data Da in consideration of the delay time td in the temporary memory 31.

[0076] The image processor 14 evaluates the imaging data Da based on the emotion data Df (step S204). In this case, for example, the image processor 14 evaluates the imaging data Da by using the table Dg and taking into account the delay time td of the emotion data Df. The image processor 14 determines whether each individual imaging data included in the imaging data Da needs to be included based on the evaluation data Dd obtained by the evaluation (step S205). In the case where the imaging data Da is a moving image, the image processor 14 determines whether each individual frame needs to be stored. In the case where the imaging data Da is a plurality of still images obtained by continuous imaging, the image processor 14 determines whether each independent still image needs to be stored. The image processor 14 stores the image (imaging data Dc) determined to be stored in the storage unit 32. In this way, the imaging data Dc is extracted from the imaging data Da.

[0077] Next, control of the imaging section 11 and the imaging signal processor 12 by the system controller 40 will be described.

[0078] Figure 6An example of a process of controlling the imaging section 11 and the imaging signal processor 12 by the system controller 40 is shown. First, the image processor 14 acquires imaging data Da and acquisition data Db (step S301). Thereafter, the image processor 14 generates emotion data Df based on the acquisition data Db (step S302). The image processor 14 generates emotion data Df for each type of acquisition data Db. Thereafter, the image processor 14 associates the imaging data Da with the emotion data Df in consideration of the delay time td (step S303). For example, the image processor 14 stores a table Dg in which the imaging data Da and the emotion data Df are associated with each other in consideration of the delay time td in the temporary memory 31.

[0079] The image processor 14 evaluates the imaging data Da based on the emotion data Df (step S304). In this case, for example, the image processor 14 evaluates the imaging data Da by using the table Dg and taking into account the delay time td of the emotion data Df. The image processor 14 outputs an instruction for controlling the imaging section 11 and the imaging signal processor 12 to the system controller 40 based on the evaluation data Dd obtained by the evaluation.

[0080] For example, the instruction includes a change in at least one of the resolution of the imaging section 11, the frame rate of the imaging section 11, the bit length of the data to be output from the imaging section 11, the active pixel area in the pixel array included in the imaging section 11, the influence on the data to be output from the imaging section 11, or the state (standby state / imaging state) of the imaging section 11. In this case, the image processor 14 outputs, based on the emotion data Df, an instruction for controlling, for example, at least one of the resolution of the imaging section 11, the frame rate of the imaging section 11, the bit length of the data to be output from the imaging section 11, the active pixel area in the pixel array included in the imaging section 11, or the influence on the data to be output from the imaging section 11 to the system controller 40. In addition, the image processor 14 also outputs, based on the emotion data Df, an instruction for setting the imaging section 11 to one of the standby state and the imaging state to the system controller 40.

[0081] Upon receiving an instruction for controlling the imaging section 11 and the imaging signal processor 12 from the image processor 14, the system controller 40 outputs a control signal to the imaging controller 13 based on the instruction. The imaging controller 13 controls the imaging section 11 and the imaging signal processor 12 in response to the control of the system controller 40 (step S305). In this way, the imaging section 11 and the imaging signal processor 12 are controlled by the system controller 40.

[0082] Next, a countermeasure for the delay time td will be described. Figure 7 An example of a method of controlling the imaging section 11 and the imaging signal processor 12 is shown.

[0083] Assume that the time when the resolution and the like of the imaging unit 11 are to be controlled is time point t1. In this case, at time point t2, it becomes apparent that the resolution and the like should be controlled at time point t1. Time point t2 is delayed from time point t1 by a delay time td. In order to control the resolution and the like at time point t1, it is preferable to predict that the resolution and the like of the imaging unit 11 should be controlled at time point t3 before time point t1.

[0084] In the case where the effect of the delay time td on the imaging data Da is small, it may be okay to not have such a prediction. However, in the case where the effect of the delay time td on the imaging data Da is large, such a prediction may be necessary. Figure 7 As shown, for example, the image processor 14 can predictively evaluate the imaging data Da acquired after the time point t3-td based on the previously obtained evaluation data Dd (for example, the evaluation data Dd before the time point t3) and the previously obtained imaging data Da (for example, the imaging data Da before the time point t3). In this case, for example, it becomes possible for the image processor 14 to output an instruction for controlling the imaging section 11 and the imaging signal processor 12 to the system controller 40 after the time point t3-td based on the evaluation data Dd obtained in this way (hereinafter, referred to as "predictive evaluation data Ddf").

[0085] Next, a specific example of a method of controlling the imaging section 11 and the imaging signal processor 12 will be described. Figure 8 An example of a process of controlling the imaging section 11 and the imaging signal processor 12 is shown. Note that, in this case, the storage section 32 stores reference data De to be used for face recognition. The reference data De includes, for example, face data of a target of face recognition (reference data related to a photographed subject). The reference data De may include, for example, a plurality of pieces of face data.

[0086] Note that the following describes a case in which the resolution of the imaging section 11 is controlled. However, similar control can be performed even in a case in which at least one of the resolution of the imaging section 11, the frame rate of the imaging section 11, the bit length of data to be output from the imaging section 11, the active pixel area in the pixel array included in the imaging section 11, the influence on the data to be output from the imaging section 11, or the state of the imaging section 11 (standby state / imaging state) is controlled.

[0087] First, the system controller 40 sets the resolution of the imaging section 11 to "low" (step S401). Specifically, the system controller 40 outputs a control signal for setting the resolution of the imaging section 11 to "low" to the imaging controller 13. The imaging controller 13 outputs a control signal for setting the resolution of the imaging section 11 to "low" to the imaging section 11 in response to the control of the system controller 40. As a result, the imaging section 11 performs imaging with the resolution set to "low", and acquires imaging data Da with the resolution "low", for example, Fig. 9 As shown in (A) (step S402).

[0088] Thereafter, the image processor 14 determines whether the imaging data Da with the resolution "low" includes a person (step S403). In the case where the determination result shows that the image data Da includes a person, the imaging unit 11 continues to perform imaging using the resolution set to "low". In contrast, for example, in the case where the imaging data Da includes a person, as in the case of Fig. 9 As shown in (B) in FIG. 4 , the image processor 14 outputs an instruction for setting the resolution to “medium” to the system controller 40. Upon receiving the instruction for setting the resolution to “medium” from the image processor 14, the system controller 40 outputs a control signal to the imaging controller 13 based on the instruction. The imaging controller 13 outputs a control signal for setting the resolution of the imaging section 11 to “medium” to the imaging section 11 in response to the control of the system controller 40 (step S404). As a result, the imaging section 11 performs imaging with the resolution set to “medium”, and acquires imaging data Da with the resolution set to “medium”, for example, as shown in FIG. Fig. 9 As shown in (C) (step S405).

[0089] Thereafter, the image processor 14 performs facial recognition based on the imaging data Da having a resolution of "medium", and reads the reference data De from the storage section 32 (step S406). In this case, the image processor 14 determines whether a person exists in the imaging data Da matching the reference data De (step S407). As a result of the determination, in a case where a person does not exist in the imaging data Da matching the reference data De, imaging is continued with the resolution set to "medium". In contrast, for example, in a case where a person exists in the imaging data Da matching the reference data De, the image processor 14 outputs an instruction for setting the resolution to "high" to the system controller 40. Upon receiving an instruction for setting the resolution to "high" from the image processor 14, the system controller 40 outputs a control signal to the imaging controller 13 based on the instruction. The imaging controller 13 outputs a control signal for setting the resolution of the imaging section 11 to "high" to the imaging section 11 in response to the control of the system controller 40 (step S408). As a result, the imaging section 11 performs imaging with the resolution set to “high”, and acquires imaging data Da with the resolution set to “high”, for example, as Fig. 9 As shown in (D) in .

[0090] Thereafter, the electronic device 1 executes the above-described steps S201 to S205 or the above-described steps S301 to S305 (step S409 ). In this way, setting of the resolution using face recognition is performed.

[0091] Next, another method of setting the resolution using face recognition will be described. Fig.10 An example of a process of controlling the imaging section 11 and the imaging signal processor 12 is shown. Note that, in this case, the storage section 32 also stores reference data De to be used for face recognition.

[0092] Note that the following describes a case in which the resolution of the imaging section 11 is controlled. However, similar control can be performed even in a case in which at least one of the resolution of the imaging section 11, the frame rate of the imaging section 11, the bit length of data to be output from the imaging section 11, the active pixel area in the pixel array included in the imaging section 11, the influence on the data to be output from the imaging section 11, or the state of the imaging section 11 (standby state / imaging state) is controlled.

[0093] First, the system controller 40 sets the resolution of the imaging section 11 to "low" (step S501). Specifically, the system controller 40 outputs a control signal for setting the resolution of the imaging section 11 to "low" to the imaging controller 13. The imaging controller 13 outputs a control signal for setting the resolution of the imaging section 11 to "low" to the imaging section 11 in response to the control of the system controller 40. As a result, the imaging section 11 performs imaging with the resolution set to "low", and acquires imaging data Da with the resolution set to "low", for example, Fig. 9 As shown in (A) in FIG. 1 (step S502 ). In addition, the image processor 14 acquires acquisition data Db from the system controller 40 (step S502 ).

[0094] Thereafter, the image processor 14 generates the emotion data Df based on the acquired data Db (step S503). The image processor 14 generates the emotion data Df for each type of acquired data Db. Thereafter, the image processor 14 evaluates the imaging data Da based on the emotion data Df (step S504). For example, the image processor 14 calculates intensity data of at least pleasure / discomfort or activity / inactivity based on the emotion data Df, and sets the calculated intensity data as the evaluation data Dd.

[0095] In the case where the obtained evaluation data Dd satisfies the predetermined criteria, the image processor 14 outputs an instruction for setting the resolution to "medium" to the system controller 40. Upon receiving the instruction for setting the resolution to "medium" from the image processor 14, the system controller 40 outputs a control signal to the imaging controller 13 based on the instruction. The imaging controller 13 outputs a control signal for setting the resolution of the imaging section 11 to "medium" to the imaging section 11 in response to the control of the system controller 40 (step S505). As a result, the imaging section 11 performs imaging with the resolution set to "medium", and acquires imaging data Da with the resolution set to "medium", for example, as shown in FIG. Fig. 9 As shown in (C) in .

[0096] Thereafter, the image processor 14 performs facial recognition based on the imaging data Da having a resolution of "medium", and reads the reference data De from the storage section 32 (step S506). In this case, the image processor 14 determines whether a person exists in the imaging data Da matching the reference data De (step S507). As a result of the determination, in a case where a person does not exist in the imaging data Da matching the reference data De, imaging is continued with the resolution set to "medium". In contrast, for example, in a case where a person exists in the imaging data Da matching the reference data De, the image processor 14 outputs an instruction for setting the resolution to "high" to the system controller 40. Upon receiving an instruction for setting the resolution to "high" from the image processor 14, the system controller 40 outputs a control signal to the imaging controller 13 based on the instruction. The imaging controller 13 outputs a control signal for setting the resolution of the imaging section 11 to "high" to the imaging section 11 in response to the control of the system controller 40 (step S508). As a result, the imaging section 11 performs imaging with the resolution set to “high”, and acquires imaging data Da with the resolution set to “high”, for example, as Fig. 9 As shown in (D) in .

[0097] Thereafter, the electronic device 1 executes the above-described steps S201 to S205 or the above-described steps S301 to S305 (step S509 ). In this way, setting of the resolution using face recognition is performed.

[0098] Next, a method of setting resolution using emotion will be described. Fig.11 An example of a process of controlling the imaging section 11 and the imaging signal processor 12 is shown. It should be noted that, in this case, the storage section 32 stores reference data De to be used for evaluation of emotion. For example, the reference data De includes reference data related to the user's emotion. For example, the reference data De may include reference data related to the user's emotion in various types of acquired data Db.

[0099] Note that the following describes a case in which the resolution of the imaging section 11 is controlled. However, similar control can be performed even in a case in which at least one of the resolution of the imaging section 11, the frame rate of the imaging section 11, the bit length of data to be output from the imaging section 11, the active pixel area in the pixel array included in the imaging section 11, the influence on the data to be output from the imaging section 11, or the state of the imaging section 11 (standby state / imaging state) is controlled.

[0100] First, the system controller 40 sets the resolution of the imaging section 11 to "low" (step S601). Specifically, the system controller 40 outputs a control signal for setting the resolution of the imaging section 11 to "low" to the imaging controller 13. The imaging controller 13 outputs a control signal for setting the resolution of the imaging section 11 to "low" to the imaging section 11 in response to the control of the system controller 40. As a result, the imaging section 11 performs imaging with the resolution set to "low", and acquires imaging data Da with the resolution "low", for example, Fig.12 As shown in (A) in FIG. 1 (step S602 ). In addition, the image processor 14 acquires acquisition data Db from the system controller 40 (step S602 ).

[0101] Thereafter, the image processor 14 generates the emotion data Df based on the acquired data Db (step S603). The image processor 14 generates the emotion data Df for each type of acquired data Db. Thereafter, the image processor 14 evaluates the imaging data Da based on the emotion data Df (step S604). For example, the image processor 14 calculates intensity data of at least pleasure / discomfort or activity / inactivity based on the emotion data Df and the reference data De, and sets the calculated intensity data as the evaluation data Dd.

[0102] For example, suppose that Fig.12 In the case of the imaging data Da including a person as shown in (B) in FIG, the obtained evaluation data Dd satisfies the predetermined criteria. In this case, the image processor 14 outputs an instruction for setting the resolution to "high" to the system controller 40. When receiving the instruction for setting the resolution to "high" from the image processor 14, the system controller 40 outputs a control signal to the imaging controller 13 based on the instruction. In response to the control of the system controller 40, the imaging controller 13 outputs a control signal for setting the resolution of the imaging unit 11 to "high" to the imaging unit 11 (step S605). As a result, the imaging unit 11 performs imaging with the resolution set to "high", and obtains imaging data Da with the resolution set to "high", for example, as Fig.12 As shown in (C) in .

[0103] Thereafter, the electronic device 1 executes the above-described steps S201 to S205 or the above-described steps S301 to S305 (step S606 ). In this way, the setting of the resolution using the emotion is performed.

[0104] [Effect]

[0105] Next, effects of the electronic device 1 according to the present embodiment will be described.

[0106] Digital cameras or smartphones are recently equipped with a function called "Smile Shutter" (registered trademark) that automatically releases the shutter in response to a determination result of whether a subject is smiling, so as to accurately capture the moment of the smile.

[0107] By the way, the user may want to take a photo not only at a smiling moment, but also at a moment of a natural expression of a child or a precious moment in an activity, for example. However, when the user holds the camera, the natural expression may disappear and the expression may become a fake smile or a nervous expression, making it difficult to photograph the natural expression. In addition, the precious moment comes suddenly, so that the user may miss the shot while holding the camera.

[0108] In contrast, in the electronic device 1 according to the present embodiment, the imaging data Da and the emotion data Df are chronologically correlated with each other, and the imaging unit 11 is controlled based on the emotion data Df. Thus, for example, in a case where the emotion data changes at a moment when the user reacts to a photographed subject, monitoring of the emotion data Df makes it possible to grasp the moment when the user may want to take a photo. As a result, for example, it becomes possible to obtain imaging data Dc of a scene meaningful to the user in response to changes in the emotion data Df and the evaluation data Dd, without the user manually releasing the shutter. In addition, since the user is not required to manually release the shutter, the user does not need to hold the camera, enabling natural expressions to be captured.

[0109] In addition, the present embodiment uses the acquisition data Db including measurement data related to at least one of pulse, heart rate, electrocardiogram, electromyogram, respiration, sweating, GSR, blood pressure, blood oxygen saturation, skin surface temperature, electroencephalogram, blood flow change, body temperature, movement of the body, movement of the head, center of gravity, rhythm of walking or running, eye condition, or surrounding sounds. This enables accurate generation of the emotion data Df.

[0110] Furthermore, in the present embodiment, the imaging data Da is evaluated based on the emotion data Df, and the imaging section 11 and the imaging signal processor 12 are controlled based on the result of the evaluation (evaluation data Dd). This makes it possible to obtain imaging data Dc of a scene meaningful to the user in response to the emotion data Df and the evaluation data Dd without the user manually releasing the shutter.

[0111] Furthermore, in the present embodiment, intensity data of at least pleasure / discomfort or activity / inactivity is calculated based on the emotion data Df, and the imaging unit 11 is controlled based on the intensity data obtained by the calculation. This makes it possible to obtain imaging data Dc of a scene meaningful to the user in response to changes in the emotion data Df and the evaluation data Dd without the user manually releasing the shutter.

[0112] Furthermore, in the present embodiment, at least one of the resolution, frame rate, bit length, influence, or effective pixel area in the imaging section is controlled based on the emotion data Df and the evaluation data Dd. This enables the system controller 40 to, for example, reduce the resolution, reduce the frame rate, reduce the bit length, eliminate the influence, or reduce the effective pixel area in the imaging section, except when acquiring imaging data Dc of a scene that is meaningful to the user. In such a case, the power consumption that causes the electronic device 1 to perform imaging for a long time can be reduced.

[0113] Furthermore, in the present embodiment, the imaging unit 11 is set to one of the standby state and the imaging state based on the emotion data Df. This enables the system controller 40 to set the imaging unit 11 to the standby state except when acquiring imaging data Dc of a scene meaningful to the user. In such a case, the power consumption that causes the electronic device 1 to perform imaging for a long time can be reduced.

[0114] Furthermore, in the present embodiment, it is determined whether the imaging data Da needs to be stored based on the emotion data Df, and based on the determination, the imaging data Dc of the scene meaningful to the user is stored in the storage unit 32. This makes it possible to obtain the imaging data Dc of the scene meaningful to the user in response to changes in the emotion data Df and the evaluation data Dd without the user manually releasing the shutter.

[0115] Furthermore, in the present embodiment, the portion of the imaging data Da stored in the temporary memory 31 that has been stored in the temporary memory for a period exceeding a predetermined period is deleted or overwritten with the newly stored imaging data Da. This enables the electronic device 1 to perform imaging for a long time even when the temporary memory 31 has a small capacity.

[0116] Furthermore, in the present embodiment, imaging data Da' in which camera shake has been corrected is generated. This enables imaging data Dc with less camera shake to be obtained even in a case where the user carries the electronic device 1.

[0117] Furthermore, the imaging data Da acquired at time t1 is associated with the emotion data Df acquired at time t2 later than time t1 by a delay time td. This enables the imaging data Dc to be obtained in consideration of the delay time unique to the emotion data Df.

[0118] Furthermore, in the present embodiment, the imaging section 11 is controlled based on the matching result between the reference data De and the imaging data Da. This allows the imaging section 11 to be controlled using face recognition, so that data desired to be retained can be selected and stored as the imaging data Dc.

[0119] Furthermore, in the present embodiment, the imaging section 11 and the imaging signal processor 12 are controlled based on the reference data De and the emotion data Df. This enables the user to select and store imaging data Dc that the user is particularly moved or impressed by.

[0120] <2. Modifications>

[0121] Next, a modification of the electronic device 1 according to the above embodiment will be described. In the following description, the same reference numerals are used to denote the same components as those in the above embodiment. In addition, the description of the same components as those in the above embodiment will be appropriately omitted.

[0122] [Variation A]

[0123] In the above embodiment, for example, Fig.13 As shown, the image signal generator 15, the display driver 16, the display controller 17, the display unit 18, the audio signal generator 24, and the audio output unit 25 may be omitted. In this case, for example, the electronic device 1 may communicate with the user via the communication unit 60. Figure 4 The display screen 18A shown shows that the required data is transmitted to the electronic device 2, which includes an image signal generator 15, a display driver 16, a display controller 17, a display unit 18, an audio signal generator 24, and an audio output unit 25. In such a case, the delay time td can also be set in the electronic device 2 or the type of sensor can be selected.

[0124] [Variation Example B]

[0125] In the above-mentioned modification A, the storage unit 32 may be omitted, for example, Fig.14 In this case, the electronic device 1 can store the imaging data Dc in the storage device 3 including the storage unit 32 via the communication unit 60 .

[0126] [Variant C]

[0127] For example, in the above-mentioned modification A, the electronic device 1 may be configured to communicate with the display device 2 via the network 4, such as Fig.15 The network 4 is a communication standard capable of communicating with the display device 2 via the communication unit 60 .

[0128] [Variant D]

[0129] For example, in the above-mentioned modification B, the electronic device 1 may be configured to communicate with the display device 2 or the storage device 3 via the network 4, such as Fig.16 shown.

[0130] [Variant E]

[0131] In the above-mentioned embodiments and their variations, for example, the imaging unit 11 may be provided independently of the electronic device 1. Fig.17 In this case, the image obtained by the imaging unit 11 is input to the image block 10 via the communication unit 60 or the like. In such a case, effects similar to those of the above-described embodiment can also be achieved.

[0132] [Variant F]

[0133] In the above-mentioned embodiment and variations A to D, the electronic device 1 may further include an attachment portion 1B capable of attaching the electronic device 1 to the body of the user 100, for example, Fig.18 For example, in this case, the attachment portion 1B is coupled to the main body portion 1A of the electronic device 1. Since the user 100 does not need to hold the electronic device 1, this makes it easier to capture the natural expression of the subject.

[0134] [Variant G]

[0135] In the above-mentioned embodiment and modifications A to D, the imaging section 11 may include imaging elements 1a, 1b, and 1c, in which the directions of the optical axes are different from each other, and imaging data in each specific direction is acquired, for example, Fig.19 In this case, for example, the imaging elements 1a, 1b, and 1c can be fixedly attached to and detached from the hat 110 of the user 100. This enables imaging of a wide range.

[0136] [Variation H]

[0137] In the above-described embodiment and modifications A to D and F, the imaging section 11 may include a lens 1C, for example, as Fig. 20 As shown. For example, lens 1C is a wide-angle lens or a fisheye lens. This enables imaging of a wide range.

[0138] Although the present disclosure is described above with reference to exemplary embodiments and variations, these embodiments and variations should not be construed as limiting the scope of the present disclosure and can be modified in various ways. It should be understood that the effects described here are merely examples. The effects of the exemplary embodiments and variations of the present disclosure are not limited to the effects described here. The present disclosure may also include any effect other than the effects described here.

[0139] Furthermore, the present disclosure may have the following configurations.

[0140] (1) An electronic device comprising:

[0141] An imaging unit, for acquiring imaging data;

[0142] A data generator generates sentiment data based on the acquired data;

[0143] a data processor that correlates the imaging data and the emotion data with each other in chronological order; and

[0144] A controller changes the setting of the imaging unit in a chronological order based on the emotion data.

[0145] (2) An electronic device according to (1), wherein the acquired data includes measurement data related to at least one of pulse, heart rate, electrocardiogram, electromyogram, respiration, sweating, GSR, blood pressure, blood oxygen saturation, skin surface temperature, electroencephalogram, blood flow changes, body temperature, body movement, head movement, center of gravity, walking or running rhythm, eye condition, or surrounding sounds.

[0146] (3) The electronic device according to (1) or (2), wherein the controller evaluates the imaging data in chronological order based on the emotion data, and controls the imaging section based on the evaluation result.

[0147] (4) An electronic device according to any one of (1) to (3), wherein the controller calculates intensity data of at least pleasure / discomfort or activity / inactivity based on the emotion data, and controls the imaging unit based on the intensity data obtained by the calculation.

[0148] (5) An electronic device according to any one of (1) to (4), wherein the controller controls at least one of a resolution, a frame rate, a bit length, an impact, or an effective pixel area in the imaging unit based on the emotion data.

[0149] (6) The electronic device according to any one of (1) to (4), wherein the controller sets the imaging unit to any one of a standby state and an imaging state based on the emotion data.

[0150] (7) The electronic device according to any one of (1) to (6), further comprising a storage unit for storing the imaging data, wherein:

[0151] The controller determines whether the imaging data needs to be stored based on the emotion data, and causes the storage unit to store the imaging data based on the determination.

[0152] (8) The electronic device according to any one of (1) to (6), further comprising a storage unit for storing the imaging data, wherein:

[0153] The controller causes the storage unit to store the imaging data, and deletes data of a portion of the imaging data stored in the storage unit that has been stored in the storage unit for more than a predetermined period of time, or overwrites the portion with newly stored imaging data.

[0154] (9) An electronic device according to any one of (1) to (8), wherein a controller detects the amount and direction of camera shake in imaging data, determines a cutout area in the imaging data based on the amount and direction of camera shake that has been detected, and generates imaging data in which the camera shake has been corrected based on the determination.

[0155] (10) An electronic device according to any one of (1) to (9), wherein the data processor associates imaging data acquired at a first time point with emotion data acquired at a second time point, and the second time point is later than the first time point.

[0156] (11) The electronic device according to any one of (1) to (10), further comprising an attachment portion capable of attaching the electronic device to a body.

[0157] (12) The electronic device according to any one of (1) to (11), wherein:

[0158] The imaging unit includes a plurality of imaging elements, wherein the directions of the optical axes of the plurality of imaging elements are different from each other, and imaging data in each specific direction is acquired, and,

[0159] The data processor associates the imaging data of multiple specific directions obtained by the multiple imaging elements with the emotion data in chronological order as imaging data.

[0160] (13) The electronic device according to any one of (1) to (12), wherein the imaging section includes a wide-angle lens or a fish-eye lens.

[0161] (14) The electronic device according to any one of (1) to (13), further comprising a storage unit for storing reference data related to the object, wherein

[0162] The controller controls the imaging section based on a matching result between the reference data and the imaging data.

[0163] (15) The electronic device according to (14), wherein the setting of the imaging section is performed for at least one of a resolution, a frame rate, a bit length, an influence, or an effective pixel area in the imaging section.

[0164] (16) The electronic device according to any one of (1) to (15), further comprising a storage unit for storing reference data related to emotion, wherein:

[0165] The controller controls the imaging section based on the reference data and the emotion data.

[0166] (17) An imaging system comprising:

[0167] An imaging unit, for acquiring imaging data;

[0168] A data generator generates sentiment data based on the acquired data;

[0169] a data processor that correlates the imaging data and the emotion data with each other in chronological order; and

[0170] A controller controls the imaging unit based on the emotion data.

[0171] (18) The imaging system according to (17), further comprising a storage unit storing reference data related to the object, wherein

[0172] The controller controls the imaging section based on a matching result between the reference data and the imaging data.

[0173] In an electronic device and an imaging system according to an embodiment of the present disclosure, imaging data and emotion data are associated with each other in chronological order, and the imaging unit is controlled based on the emotion data. As a result, it becomes possible to obtain imaging data in response to changes in emotion data without the user manually releasing the shutter. Therefore, it becomes possible for the user to take pictures without missing the moment he / she wants to shoot. It should be noted that the effects described here are not limited and may include any effect described in the present disclosure.

[0174] This application claims the benefit of Japanese Priority Patent Application JP2019-068358 filed in the Japan Patent Office on Mar. 29, 2019, the entire contents of which are incorporated herein by reference.

[0175] Those skilled in the art should understand that various modifications, combinations, sub-combinations and alterations may be made according to design requirements and other factors as long as they are within the scope of the appended claims and their equivalents.

Claims

1. An electronic device, comprising: An imaging unit and an image processor, wherein the image processor includes a data generator and a data processor, and the electronic device further includes a controller. The imaging unit acquires imaging data and transmits the imaging data to the data processor; The data generator generates the emotion data based on the acquired data, wherein the acquired data includes measurement data related to at least one of pulse, heart rate, electrocardiogram, electromyogram, respiration, sweating, GSR, blood pressure, blood oxygen saturation, skin surface temperature, electroencephalogram, blood flow change, body temperature, body movement, head movement, center of gravity, walking or running rhythm, eye condition, or surrounding sounds; The data processor receives the imaging data and the affective data, wherein the image processor generates assessment data as a numerical assessment of the user's affect based on the affective data, wherein the data processor of the image processor further chronologically correlates the imaging data with the affective data; The controller controls the imaging section based on the emotion data, and controls the imaging section based on the evaluation data; and A storage unit for storing the delay time, wherein The data processor correlates the imaging data acquired at a first time point with the emotion data acquired at a second time point, the second time point being later than the first time point by the delay time.

2. The electronic device according to claim 1, wherein: The controller calculates intensity data of at least pleasure / discomfort or activity / inactivity based on the emotion data, and controls the imaging section based on the intensity data obtained by the calculation.

3. The electronic device according to claim 1, wherein: The controller controls at least one of a resolution, a frame rate, a bit length, an influence, or an effective pixel area in the imaging section based on the emotion data.

4. The electronic device according to claim 1, wherein: The controller sets the imaging section to any one of a standby state and an imaging state based on the emotion data.

5. The electronic device according to claim 1, further comprising a storage unit for storing the imaging data, wherein: The controller determines whether the imaging data needs to be stored based on the emotion data, and causes the storage unit to store the imaging data based on the determination.

6. The electronic device according to claim 1, further comprising a storage unit for storing the imaging data, wherein: The controller causes the storage unit to store the imaging data, and deletes data of a portion of the imaging data stored in the storage unit that has been stored in the storage unit for more than a predetermined period, or overwrites the portion with newly stored imaging data.

7. The electronic device according to claim 1, wherein: The controller detects an amount and a direction of camera shake in the imaging data, determines a cutout area in the imaging data according to the amount and direction of the camera shake that has been detected, and generates imaging data in which the camera shake has been corrected based on the determination. 8 . The electronic device according to claim 1 , further comprising an attachment portion capable of attaching the electronic device to a body.

9. The electronic device according to claim 1, wherein: The imaging unit includes a plurality of imaging elements, wherein the directions of the optical axes of the plurality of imaging elements are different from each other, and imaging data in respective specific directions are acquired, and The data processor associates the imaging data of the multiple specific directions obtained by the multiple imaging elements with the emotion data in chronological order as the imaging data.

10. The electronic device according to claim 1, wherein: The imaging unit includes a wide-angle lens or a fisheye lens.

11. The electronic device according to claim 1, further comprising a storage unit for storing reference data related to the object, wherein The controller controls the imaging section based on a matching result between the reference data and the imaging data.

12. The electronic device according to claim 11, wherein: The imaging section is set for at least one of a resolution, a frame rate, a bit length, an influence, or an effective pixel area in the imaging section.

13. The electronic device according to claim 1, further comprising a storage unit for storing reference data related to emotions, wherein The controller controls the imaging section based on the reference data and the emotion data.

14. An imaging system comprising: An imaging unit and an image processor, wherein the image processor includes a data generator and a data processor, and the imaging system further includes a controller, The imaging unit acquires imaging data and transmits the imaging data to the data processor; The data generator generates the emotion data based on the acquired data, wherein the acquired data includes measurement data related to at least one of pulse, heart rate, electrocardiogram, electromyogram, respiration, sweating, GSR, blood pressure, blood oxygen saturation, skin surface temperature, electroencephalogram, blood flow change, body temperature, body movement, head movement, center of gravity, walking or running rhythm, eye condition, or surrounding sounds; The data processor receives the imaging data and the affective data, wherein the image processor generates assessment data as a numerical assessment of the user's affect based on the affective data, wherein the data processor of the image processor further chronologically correlates the imaging data with the affective data; the controller controls the imaging section based on the emotion data and controls the imaging section based on the evaluation data; and A storage unit for storing the delay time, wherein The data processor correlates the imaging data acquired at a first time point with the emotion data acquired at a second time point, the second time point being later than the first time point by the delay time.

15. The imaging system according to claim 14, further comprising a storage unit for storing reference data related to the object, wherein The controller controls the imaging section based on a matching result between the reference data and the imaging data.

Images