Imaging device and image quality adjustment system

Abstract

According to the present invention, a monitoring camera (100) comprises: an imaging processing unit (120); an image processing unit (130); a communication processing unit (140); a storage unit (110) that stores a trained model and relationship information that is information indicating a correspondence relationship between a subject distance and parameters set in the imaging processing unit (120), the image processing unit (130), and the communication processing unit (140); a region extraction unit (151) that extracts a region of a subject present in image data that is an image obtained by image processing or imaging data obtained by imaging; and a distance calculation unit (152) that calculates the subject distance on the basis of the image data or the imaging data, the trained model, and information indicating the region of the subject. The imaging processing unit (120), the image processing unit (130), and the communication processing unit (140) change the parameters using the relationship information and the subject distance.

Description

Imaging device and image quality adjustment system

[0001] The present disclosure relates to an imaging device and an image quality adjustment system.

[0002] Many surveillance cameras are installed in stations, trains, and the like. Surveillance cameras can sometimes produce noise in images. Techniques related to this noise have been proposed (see Patent Document 1). For example, the block noise detection device in Patent Document 1 detects block boundaries where block noise occurs. Parameters are set for the surveillance cameras. Techniques related to the parameters have been proposed (see Patent Document 2).

[0003] JP 2007-028460 A JP 2021-97299 A

[0004] When a surveillance camera is installed, parameters that take into account the distance to the subject (hereinafter referred to as subject distance) are set for the surveillance camera. However, for example, if the position of the surveillance camera changes, the assumed subject distance will change. Also, for example, if a subject appears closer than expected at the time of installation, the assumed subject distance will change. In this way, if the parameters are not changed in a situation where the subject distance changes, the surveillance camera will not be able to properly capture images, etc.

[0005] The purpose of this disclosure is to change the parameters accordingly.

[0006] An imaging device according to one aspect of the present disclosure is provided. The imaging device includes an imaging processing unit that captures images based on set parameters, an image processing unit that performs image processing on imaging data, which is an image obtained by imaging, based on the set parameters, a communication processing unit that transmits data based on the set parameters, a storage unit that stores relationship information, which is information indicating a correspondence between parameters set in the imaging processing unit, the image processing unit, and the communication processing unit, and a subject distance, which is the distance to a subject, and a trained model, a region extraction unit that extracts a subject area present in image data, which is an image obtained by image processing, or the imaging data, and a distance calculation unit that calculates the subject distance based on the image data or the imaging data, the trained model, and the information indicating the subject area. The imaging processing unit identifies, based on the relationship information, parameters that are to be set in the imaging processing unit and that correspond to the subject distance, and sets the identified parameters in the imaging processing unit. The image processing unit identifies, based on the relationship information, parameters that are to be set in the image processing unit and that correspond to the subject distance, and sets the identified parameters in the image processing unit. The communication processing unit specifies a parameter that is to be set in the communication processing unit and that corresponds to the subject distance, based on the relationship information, and sets the specified parameter in the communication processing unit.

[0007] According to the present disclosure, the parameters can be changed as appropriate.

[0008] 1 is a diagram showing an image quality adjustment system according to a first embodiment; 2 is a block diagram showing the functions of a surveillance camera according to the first embodiment; 3 is a block diagram showing the functions of a control device according to the first embodiment; 4 is a flowchart showing an example of parameter change processing based on subject distance according to the first embodiment; 5 is a flowchart showing an example (part 1) of parameter change processing based on control of the control device according to the first embodiment; 6 is a flowchart showing an example (part 2) of parameter change processing based on control of the control device according to the first embodiment; 7 is a sequence diagram showing an example (part 1) of batch change processing according to the first embodiment; 8 is a sequence diagram showing an example (part 2) of batch change processing according to the first embodiment; 9 is a sequence diagram showing an example (part 3) of batch change processing according to the first embodiment; 10 is a diagram showing an image quality adjustment system according to a second embodiment; 11 is a block diagram showing the functions of a surveillance camera according to the second embodiment; 12 is a block diagram showing the functions of a control device according to the second embodiment; 13 is a sequence diagram showing an example of parameter change processing based on subject distance according to the second embodiment; 14 is a sequence diagram showing an example (part 1) of parameter change processing based on control of the control device according to the second embodiment; 15 is a sequence diagram showing an example (part 2) of parameter change processing based on control of the control device according to the second embodiment.

[0009] Hereinafter, embodiments will be described with reference to the drawings. The following embodiments are merely examples, and various modifications are possible within the scope of the present disclosure.

[0010] Embodiment 1. Fig. 1 is a diagram showing an image quality adjustment system according to embodiment 1. The image quality adjustment system includes surveillance cameras 100_1, 100_2, ..., 100_n, and a control device 200. The image quality adjustment system may also include a management device 300, where n is a positive integer. The surveillance cameras 100_1, 100_2, ..., 100_n and the control device 200 communicate via a network. The control device 200 and the management device 300 communicate via a network.

[0011] The surveillance cameras 100_1, 100_2, ..., 100_n are collectively referred to as surveillance cameras 100. The surveillance cameras 100 are also called imaging devices. The surveillance cameras 100 are devices that perform surveillance. The control device 200 can control the surveillance cameras 100. The management device 300 is a device used by an administrator.

[0012] Next, the functions of the surveillance camera 100 and the control device 200 will be described. Fig. 2 is a block diagram showing the functions of the surveillance camera according to embodiment 1. The surveillance camera 100 has a storage unit 110, an imaging processing unit 120, an image processing unit 130, a communication processing unit 140, and an estimation processing unit 150. The estimation processing unit 150 includes a region extraction unit 151, a distance calculation unit 152, and an estimation unit 153.

[0013] The storage unit 110 may be realized as a storage area secured in a volatile storage device or a non-volatile storage device included in the surveillance camera 100. Some or all of the imaging processing unit 120, the image processing unit 130, the communication processing unit 140, and the estimation processing unit 150 may be realized by processing circuits included in the surveillance camera 100. Furthermore, some or all of the imaging processing unit 120, the image processing unit 130, the communication processing unit 140, and the estimation processing unit 150 may be realized as program modules executed by a processor included in the surveillance camera 100.

[0014] The storage unit 110 stores various information. The functions of the imaging processing unit 120, the image processing unit 130, the communication processing unit 140, and the estimation processing unit 150 will be described later.

[0015] 3 is a block diagram showing the functions of the control device according to embodiment 1. The control device 200 includes a storage unit 210, a communication unit 220, an image quality determination unit 230, a group identification unit 240, and a control unit 250. The group identification unit 240 includes a processing unit 241, an analysis unit 242, and a group estimation unit 243.

[0016] The storage unit 210 may be realized as a storage area secured in a volatile storage device or a non-volatile storage device included in the control device 200. Some or all of the communication unit 220, the image quality determination unit 230, the group identification unit 240, and the control unit 250 may be realized by a processing circuit included in the control device 200. Furthermore, some or all of the communication unit 220, the image quality determination unit 230, the group identification unit 240, and the control unit 250 may be realized as program modules executed by a processor included in the control device 200.

[0017] Various information is stored in the storage unit 210. The functions of the communication unit 220, the image quality determination unit 230, the group identification unit 240, and the control unit 250 will be described later.

[0018] The surveillance camera 100 changes parameters. Parameters are setting values ​​used by the surveillance camera 100 in the processing performed from image capture to distribution. For example, parameters set in the imaging processing unit 120 include a focus value, a zoom value, a black level value, and a white balance value. Parameters set in the image processing unit 130 are parameters used for image processing. For example, parameters set in the image processing unit 130 are parameters indicating the encoding format. Furthermore, parameters set in the image processing unit 130 include, for example, a matrix value used in color matrix correction, a gamma value used in gamma correction, and a value based on a curve used in contrast correction. The curve is also called a tone curve. The parameter set in the communication processing unit 140 is a bit rate.

[0019] The monitoring camera 100 can change the parameters based on the subject distance. The monitoring camera 100 can also change the parameters based on parameter information transmitted by the control device 200. The parameter information will be described later.

[0020] First, the process of changing parameters based on the subject distance will be described. <Process of Changing Parameters Based on the Subject Distance> The storage unit 110 stores relationship information. The relationship information is information indicating the correspondence between the subject distance and the parameters set in the imaging processing unit 120, the image processing unit 130, and the communication processing unit 140.

[0021] For example, the relationship information indicates the relationship between the focus value (that is, the parameter set in the image capture processing unit 120) and the subject distance.

[0022] When the distance between the surveillance camera 100 and the subject is short (i.e., when the subject distance is short), the image processing range is large, which increases the amount of calculations performed by the image processing unit 130. As such, the amount of calculations performed by the image processing unit 130 varies depending on the subject distance, so the relationship information indicates, for example, the relationship between the subject distance and a parameter (i.e., a parameter set in the image processing unit 130) corresponding to the amount of calculations performed by the image processing unit 130.

[0023] The closer the subject moves to the surveillance camera 100, the greater the frame difference. The surveillance camera 100 distributes frames (i.e., images) with differences. Therefore, an increase in the frame difference increases the amount of data distributed by the surveillance camera 100. Furthermore, the surveillance camera 100 needs to distribute data within a certain time period. Therefore, if the amount of data distributed increases, the surveillance camera 100 needs to set a higher bit rate. As such, the bit rate varies depending on the subject distance, and the relationship information indicates the relationship between the bit rate (i.e., the parameter set in the communication processing unit 140) and the subject distance.

[0024] The imaging processing unit 120 captures an image based on the set parameters. The image obtained by capturing an image is called imaging data. The image processing unit 130 performs image processing on the imaging data based on the set parameters. For example, the image processing unit 130 performs color matrix correction, gamma correction, contrast correction, etc. on the imaging data. The image obtained by image processing is called image data. The communication processing unit 140 can transmit data to the control device 200 based on the set parameters. The communication processing unit 140 transmits the image data to the area extraction unit 151.

[0025] The region extraction unit 151 extracts a region of a subject present in image data. Specifically, the region extraction unit 151 extracts the region of the subject using image recognition technology. For example, the region extraction unit 151 extracts the region of the subject using a trained model. For example, when image data is input to the trained model, the trained model divides the image data and outputs coordinates indicating the region of the subject from among the regions obtained by the division. The trained model may further output the name of the subject. The trained model is stored in the storage unit 110.

[0026] The distance calculation unit 152 acquires the trained model from the storage unit 110. The distance calculation unit 152 calculates the subject distance based on the trained model, image data, and information indicating the area of ​​the subject (i.e., coordinates indicating the area of ​​the subject). In detail, when the distance calculation unit 152 inputs the image data and the information indicating the area of ​​the subject to the trained model, the trained model outputs the subject distance.

[0027] Note that there may be multiple subjects in the image data. When multiple subjects are present in the image data, the distance calculation unit 152 selects one subject from the multiple subjects and uses information indicating the area of ​​the selected subject. Note that the selected subject may be the largest or smallest subject among the multiple subjects.

[0028] The distance calculation unit 152 transmits the subject distance to the imaging processing unit 120 and the image processing unit 130 via the communication processing unit 140. The distance calculation unit 152 also transmits the subject distance to the communication processing unit 140.

[0029] The image capturing processing unit 120 acquires the related information from the storage unit 110. The image capturing processing unit 120 identifies a parameter to be set in the image capturing processing unit 120 and that corresponds to the subject distance, based on the related information. The image capturing processing unit 120 sets the identified parameter in the image capturing processing unit 120.

[0030] The image processing unit 130 acquires the related information from the storage unit 110. The image processing unit 130 identifies a parameter to be set in the image processing unit 130 and corresponding to the subject distance based on the related information. The image processing unit 130 sets the identified parameter in the image processing unit 130.

[0031] The communication processing unit 140 acquires the related information from the storage unit 110. The communication processing unit 140 identifies a parameter to be set in the communication processing unit 140 and that corresponds to the subject distance, based on the related information. The communication processing unit 140 sets the identified parameter in the communication processing unit 140.

[0032] As a result, the parameters set in the imaging processing unit 120, the image processing unit 130, and the communication processing unit 140 are changed to parameters based on the subject distance. That is, optimal parameters are set in the imaging processing unit 120, the image processing unit 130, and the communication processing unit 140.

[0033] Next, the parameter change process based on the subject distance will be described using a flowchart. FIG. 4 is a flowchart showing an example of the parameter change process based on the subject distance in embodiment 1. (Step S11) The imaging processing unit 120 captures an image based on the set parameters. (Step S12) The image processing unit 130 performs image processing on the imaging data based on the set parameters. (Step S13) The communication processing unit 140 transmits the image data to the area extraction unit 151. (Step S14) The area extraction unit 151 extracts the area of ​​the subject present in the image data.

[0034] (Step S15) The distance calculation unit 152 acquires the trained model from the storage unit 110. (Step S16) The distance calculation unit 152 calculates the subject distance based on the trained model, image data, and information indicating the subject area. (Step S17) The distance calculation unit 152 transmits the subject distance to the image capture processing unit 120, the image processing unit 130, and the communication processing unit 140. (Step S18) The image capture processing unit 120, the image processing unit 130, and the communication processing unit 140 acquire related information from the storage unit 110. (Step S19) The image capture processing unit 120, the image processing unit 130, and the communication processing unit 140 identify parameters based on the related information and the subject distance. (Step S20) The image capture processing unit 120, the image processing unit 130, and the communication processing unit 140 set the identified parameters.

[0035] As described above, the surveillance camera 100 sets optimal parameters according to the subject distance. That is, the surveillance camera 100 can change the parameters as appropriate. This allows the surveillance camera 100 to appropriately capture images and perform other operations.

[0036] Next, the parameter change process based on the control of the control device 200 will be described. <Parameter Change Process Based on the Control of the Control Device 200> The imaging processing unit 120 captures an image based on the set parameters. As a result, imaging data is obtained. Here, these parameters are called imaging parameters. The imaging processing unit 120 transmits the imaging parameters and imaging data to the image processing unit 130.

[0037] The image processing unit 130 performs image processing on the captured image data based on the set parameters. As a result, image data is obtained. Here, the parameters are referred to as image processing parameters. The image processing unit 130 transmits the captured image parameters, the image processing parameters, and the image data to the communication processing unit 140.

[0038] The communication processing unit 140 transmits image data to the control device 200. For example, the communication processing unit 140 transmits the image data to the control device 200 based on set parameters. As a result, the communication unit 220 of the control device 200 receives the image data. Here, the parameters set in the communication processing unit 140 are called communication parameters.

[0039] The image quality determination unit 230 receives image data from the communication unit 220. The image quality determination unit 230 acquires a learned model from the storage unit 210. The image quality determination unit 230 determines the image quality of the image data using the image data and the learned model. In detail, when the image quality determination unit 230 inputs the image data into the learned model, the learned model outputs an image quality determination result. Note that the determination of image quality is a determination of whether or not an abnormality such as block noise has occurred in the image data. The image quality determination unit 230 transmits the image quality determination result to the surveillance camera 100 via the communication unit 220.

[0040] The communication processing unit 140 transmits the image quality determination result, the imaging parameters, the image processing parameters, and the communication parameters to the estimation unit 153. The communication processing unit 140 also transmits the image data to the region extraction unit 151. Note that the image quality determination result, the imaging parameters, the image processing parameters, and the image data are information related to common imaging data.

[0041] The area extraction unit 151 extracts the area of ​​the subject present in the image data. The extraction method is as described above. The distance calculation unit 152 calculates the subject distance based on the trained model, the image data, and information indicating the area of ​​the subject.

[0042] The estimation unit 153 acquires the learned model from the storage unit 110. The estimation unit 153 estimates parameters to be set in the image capture processing unit 120, the image processing unit 130, and the communication processing unit 140 using the learned model, the subject distance, the image quality determination result, the imaging parameters, the image processing parameters, and the communication parameters. In other words, the estimation unit 153 estimates optimal parameters to be set in the image capture processing unit 120, the image processing unit 130, and the communication processing unit 140. In detail, when the estimation unit 153 inputs the subject distance, the image quality determination result, the imaging parameters, the image processing parameters, and the communication parameters into the learned model, the learned model outputs optimal parameters. The estimation unit 153 transmits parameter information, which is the estimated parameters, to the communication processing unit 140. Note that the parameter information may also be referred to as an image quality parameter model.

[0043] The communication processing unit 140 transmits the parameter information to the control device 200. As a result, the parameter information is received by the communication unit 220 of the control device 200.

[0044] The communication unit 220 stores the parameter information in the storage unit 210 .

[0045] The control unit 250 receives a parameter change instruction from the management device 300. The control unit 250 acquires parameter information from the storage unit 210. The control unit 250 transmits the parameter information and the parameter change instruction to the surveillance camera 100 via the communication unit 220.

[0046] The communication processing unit 140 receives the parameter information and the parameter change instruction from the control device 200. The communication processing unit 140 transmits the parameter information and the parameter change instruction to the imaging processing unit 120 and the image processing unit .

[0047] The imaging processing unit 120 identifies parameters to be set in the imaging processing unit 120 from the parameter information. The imaging processing unit 120 sets the identified parameters based on the parameter change instruction. The image processing unit 130 identifies parameters to be set in the image processing unit 130 from the parameter information. The image processing unit 130 sets the identified parameters based on the parameter change instruction. The communication processing unit 140 identifies parameters to be set in the communication processing unit 140 from the parameter information. The communication processing unit 140 sets the identified parameters based on the parameter change instruction.

[0048] The communication processing unit 140 may transmit parameters to be set in the imaging processing unit 120 and the image processing unit 130 to the imaging processing unit 120 and the image processing unit 130. The imaging processing unit 120 and the image processing unit 130 set the parameters transmitted by the communication processing unit 140. This eliminates the need for the imaging processing unit 120 and the image processing unit 130 to perform processing to identify the parameters.

[0049] In this way, the parameters set in the imaging processing unit 120, the image processing unit 130, and the communication processing unit 140 are changed. That is, optimal parameters are set in the imaging processing unit 120, the image processing unit 130, and the communication processing unit 140.

[0050] Next, the parameter change processing based on the control of the control device 200 will be described using a flowchart. Fig. 5 is a flowchart showing an example (part 1) of the parameter change processing based on the control of the control device of embodiment 1. (Step S21) The imaging processing unit 120 performs imaging based on the imaging parameters. (Step S22) The imaging processing unit 120 transmits the imaging parameters and imaging data to the image processing unit 130.

[0051] (Step S23) The image processing unit 130 performs image processing on the captured image data based on the image processing parameters. (Step S24) The image processing unit 130 transmits the captured image parameters, the image processing parameters, and the image data to the communication processing unit 140.

[0052] (Step S25) Based on the communication parameters, the communication processing unit 140 transmits the image data to the control device 200. As a result, the control device 200 performs image quality determination processing. The control device 200 then transmits the image quality determination result to the surveillance camera 100.

[0053] (Step S26) The communication processing unit 140 receives the image quality determination result from the control device 200. (Step S27) The communication processing unit 140 transmits the image quality determination result, the imaging parameters, the image processing parameters, the communication parameters, and the image data to the estimation processing unit 150. Then, the processing proceeds to step S31.

[0054] 6 is a flowchart showing an example (part 2) of a parameter change process based on control by the control device of embodiment 1. (Step S31) The area extraction unit 151 extracts an area of ​​a subject present in image data. (Step S32) The distance calculation unit 152 acquires a trained model from the storage unit 110. (Step S33) The distance calculation unit 152 calculates the subject distance based on the trained model, the image data, and information indicating the area of ​​the subject.

[0055] (Step S34) The estimation unit 153 acquires the trained model from the storage unit 110. (Step S35) The estimation unit 153 uses the trained model, the subject distance, the image quality determination result, the imaging parameters, the image processing parameters, and the communication parameters to estimate parameters (i.e., parameter information) to be set in the imaging processing unit 120, the image processing unit 130, and the communication processing unit 140. (Step S36) The communication processing unit 140 transmits the parameter information to the control device 200.

[0056] In response to this, the control device 200 receives the parameter information. When the control device 200 receives the parameter change instruction from the management device 300, the control device 200 transmits the parameter information and the parameter change instruction to the monitoring camera 100.

[0057] (Step S37) The communication processing unit 140 transmits the parameter information and a parameter change instruction to the imaging processing unit 120 and the image processing unit 130. (Step S38) The imaging processing unit 120 sets the parameters based on the parameter information. (Step S39) The image processing unit 130 sets the parameters based on the parameter information. (Step S40) The communication processing unit 140 sets the parameters based on the parameter information.

[0058] In the parameter change process based on the subject distance, parameters based on the relationship information are set. In the parameter change process based on the control of the control device 200, parameter information output by the trained model is set. The parameter information is a parameter that corresponds to a more detailed situation than the parameters based on the relationship information. Therefore, the surveillance camera 100 can perform more appropriate imaging, etc., by setting the parameter information.

[0059] Next, we will explain how to change the parameters of multiple surveillance cameras all at once. <Bulk change process> The above describes the case where the parameters of one surveillance camera are changed. It is desirable to change the parameters set for multiple surveillance cameras that exist in the same or similar imaging environment all at once. Below, we will explain the bulk change process.

[0060] The communication processing unit 140 of the surveillance camera 100_1 transmits the image data to the control device 200. The communication unit 220 of the control device 200 receives the image data. The communication unit 220 transmits the image data to the group identification unit 240.

[0061] The processing unit 241 processes the image data so that feature quantities can be analyzed. For example, the processing unit 241 performs dimensionality reduction. This makes it easier to analyze feature quantities. The processed data is called processed data. The processing unit 241 transmits the processed data to the analysis unit 242. Furthermore, the control device 200 does not need to perform processing. If processing is not performed, the control device 200 does not have the processing unit 241. If processing is not performed, the image data is input to the analysis unit 242.

[0062] The analysis unit 242 analyzes the feature amount based on the image data or the processed data.

[0063] The group estimation unit 243 acquires the trained model from the storage unit 210. The group estimation unit 243 uses the trained model and the feature amount to estimate the group of the surveillance camera 100_1 that transmitted the image data. In particular, when the group estimation unit 243 inputs the feature amount to the trained model, the trained model outputs the group (e.g., group ID) of the surveillance camera 100_1. The group estimation unit 243 registers the group (e.g., group ID) of the surveillance camera 100_1 in the storage unit 210.

[0064] Similarly, the control device 200 receives image data from each of the surveillance cameras 100_2 to 100_n. Then, the control device 200 estimates the group (e.g., group ID) of each of the surveillance cameras 100_2 to 100_n. The control device 200 registers the group (e.g., group ID) of each of the surveillance cameras 100_2 to 100_n in the storage unit 210.

[0065] This identifies a group of the surveillance cameras 100_1 to 100_n. Then, surveillance cameras that exist in the same or similar imaging environments are grouped. For example, the surveillance cameras 100_1 and 100_2 belong to the same group.

[0066] The control unit 250 receives group information indicating a group and a parameter change instruction from the management device 300. The control unit 250 acquires parameter information related to the group from the storage unit 210. The control unit 250 transmits the group information, parameter information, and parameter change instruction to the communication unit 220. The communication unit 220 transmits the parameter information and parameter change instruction to multiple surveillance cameras that belong to the group indicated by the group information.

[0067] This changes the parameters of multiple surveillance cameras that belong to the same group, i.e., a batch change of parameters is performed.

[0068] Next, the batch change processing will be explained using a sequence diagram. FIG. 7 is a sequence diagram showing an example (part 1) of the batch change processing of embodiment 1. In the following explanation, the monitoring camera 100_1 and the monitoring camera 100_2 will be used. (Step ST101) The imaging processing unit 120 of the monitoring camera 100_1 captures an image. (Step ST102) The image processing unit 130 of the monitoring camera 100_1 performs image processing on the captured image data. (Step ST103) The communication processing unit 140 of the monitoring camera 100_1 transmits the image data to the control device 200.

[0069] (Step ST104) The processing unit 241 of the control device 200 processes the image data so that the features can be analyzed. This results in processed data. (Step ST105) The analysis unit 242 of the control device 200 analyzes the features based on the processed data. (Step ST106) The group estimation unit 243 of the control device 200 estimates the group of the surveillance camera 100_1 using the trained model and the features. (Step ST107) The group estimation unit 243 of the control device 200 registers the group of the surveillance camera 100_1 in the memory unit 210.

[0070] 8 is a sequence diagram showing an example (part 2) of the batch change process according to the first embodiment. (Step ST111) The imaging processing unit 120 of the monitoring camera 100_2 captures an image. (Step ST112) The image processing unit 130 of the monitoring camera 100_2 performs image processing on the captured image data. (Step ST113) The communication processing unit 140 of the monitoring camera 100_2 transmits the image data to the control device 200.

[0071] (Step ST114) The processing unit 241 of the control device 200 processes the image data so that the features can be analyzed. This results in processed data. (Step ST115) The analysis unit 242 of the control device 200 analyzes the features based on the processed data. (Step ST116) The group estimation unit 243 of the control device 200 estimates the group of the surveillance camera 100_2 using the trained model and the features. (Step ST117) The group estimation unit 243 of the control device 200 registers the group of the surveillance camera 100_2 in the memory unit 210. Here, it is assumed that the group of the surveillance camera 100_1 and the group of the surveillance camera 100_2 are the same.

[0072] 9 is a sequence diagram showing an example (part 3) of the batch change processing according to the first embodiment. (Step ST121) The control unit 250 of the control device 200 receives, from the management device 300, group information indicating the group to which the monitoring cameras 100_1 and 100_2 belong, and a parameter change instruction. (Step ST122) The control unit 250 of the control device 200 acquires parameter information related to the group from the storage unit 210, and transmits the group information, parameter information, and parameter change instruction to the communication unit 220. (Step ST123) The communication unit 220 of the control device 200 transmits the parameter information and parameter change instruction to the monitoring cameras 100_1 and 100_2.

[0073] (Step ST124) The imaging processing unit 120, image processing unit 130, and communication processing unit 140 of surveillance camera 100_1 change the parameters based on the parameter information. (Step ST125) The imaging processing unit 120, image processing unit 130, and communication processing unit 140 of surveillance camera 100_2 change the parameters based on the parameter information. In this way, the parameters of multiple surveillance cameras are changed collectively.

[0074] The above describes a case where parameter information is estimated using subject distance. The parameter information may also be estimated using information other than subject distance. The information other than subject distance may be a value that is correlated with a value indicating an element of the imaging environment of the surveillance camera 100. For example, the information other than subject distance is a value that indicates volume or a value that indicates light intensity. The value that indicates volume is correlated with a parameter used in audio encoding. The value that indicates light intensity is correlated with a parameter used in brightness adjustment.

[0075] The area extraction unit 151 extracts an area of ​​a subject present in image data. The area extraction unit 151 may extract an area of ​​a subject present in imaging data. When the area of ​​a subject present in imaging data is extracted, the distance calculation unit 152 calculates the subject distance based on the trained model, the imaging data, and information indicating the area of ​​the subject (i.e., the coordinates of the area of ​​the subject).

[0076] The surveillance camera 100 may have a sensor that measures the subject distance. The imaging processing unit 120 may use the measured subject distance and related information to identify parameters to be set in the imaging processing unit 120, and set the identified parameters in the imaging processing unit 120. The image processing unit 130 may use the measured subject distance and related information to identify parameters to be set in the image processing unit 130, and set the identified parameters in the image processing unit 130. The communication processing unit 140 may use the measured subject distance and related information to identify parameters to be set in the communication processing unit 140, and set the identified parameters in the communication processing unit 140.

[0077] Second Embodiment Next, a second embodiment will be described. In the second embodiment, differences from the first embodiment will be mainly described. Furthermore, in the second embodiment, descriptions of the commonalities between the first embodiment and the second embodiment will be omitted.

[0078] In the first embodiment, the case where the monitoring camera has the estimation processing unit has been described. In the second embodiment, the case where the control device has the estimation processing unit will be described.

[0079] 10 is a diagram showing an image quality adjustment system according to the second embodiment. The image quality adjustment system includes surveillance cameras 100a_1, 100a_2, ..., 100a_n and a control device 200a. n is a positive integer. The surveillance cameras 100a_1, 100a_2, ..., 100a_n communicate with the control device 200a via a network. The control device 200a communicates with the management device 300 via a network.

[0080] The monitoring cameras 100a_1, 100a_2, ..., 100a_n are collectively referred to as the monitoring cameras 100a. The control device 200a can control the monitoring cameras 100a.

[0081] Next, the functions of the surveillance camera 100a and the control device 200a will be described. Fig. 11 is a block diagram showing the functions of the surveillance camera according to the second embodiment. The surveillance camera 100a does not have the estimation processing unit 150.

[0082] 12 is a block diagram showing the functions of the control device according to embodiment 2. The control device 200a has an estimation processing unit 260. The estimation processing unit 260 includes a region extraction unit 261, a distance calculation unit 262, and an estimation unit 263. The functions of the estimation processing unit 260 are the same as the functions of the estimation processing unit 150.

[0083] Next, the parameter change process based on the subject distance will be described using a sequence diagram. FIG. 13 is a sequence diagram showing an example of the parameter change process based on the subject distance in embodiment 2. (Step ST131) The imaging processing unit 120 captures an image based on the set parameters. (Step ST132) The image processing unit 130 performs image processing on the imaging data based on the set parameters. (Step ST133) The communication processing unit 140 transmits the image data to the control device 200a. For example, the communication processing unit 140 transmits the image data to the control device 200a based on the set parameters.

[0084] (Step ST134) The area extraction unit 261 extracts the area of ​​the subject present in the image data. (Step ST135) The distance calculation unit 262 acquires the trained model from the storage unit 210. (Step ST136) The distance calculation unit 262 calculates the subject distance based on the trained model, the image data, and information indicating the subject area. (Step ST137) The communication unit 220 transmits the subject distance to the surveillance camera 100a.

[0085] (Step ST138) The imaging processing unit 120, the image processing unit 130, and the communication processing unit 140 acquire the relationship information from the storage unit 110. (Step ST139) The imaging processing unit 120, the image processing unit 130, and the communication processing unit 140 change the parameters based on the relationship information and the subject distance. In detail, the imaging processing unit 120 identifies a parameter to be set in the imaging processing unit 120 based on the relationship information, and that corresponds to the subject distance. The imaging processing unit 120 sets the identified parameter in the imaging processing unit 120. The image processing unit 130 identifies a parameter to be set in the image processing unit 130 based on the relationship information, and that corresponds to the subject distance. The image processing unit 130 sets the identified parameter in the image processing unit 130. The communication processing unit 140 identifies a parameter to be set in the communication processing unit 140 based on the relationship information, and that corresponds to the subject distance. The communication processing unit 140 sets the identified parameter in the communication processing unit 140.

[0086] As a result, the parameters set in the imaging processing unit 120, the image processing unit 130, and the communication processing unit 140 are changed to parameters based on the subject distance. That is, optimal parameters are set in the imaging processing unit 120, the image processing unit 130, and the communication processing unit 140.

[0087] As described above, the monitoring camera 100a sets optimal parameters according to the subject distance. That is, the monitoring camera 100a can change the parameters as needed. This allows the monitoring camera 100a to capture images appropriately.

[0088] The area extraction unit 261 extracts the area of ​​the subject present in the image data. The area extraction unit 261 may also extract the area of ​​the subject present in the imaging data. For example, the surveillance camera 100a transmits the imaging data to the control device 200a. The area extraction unit 261 then extracts the area of ​​the subject present in the imaging data. When the area of ​​the subject present in the imaging data is extracted, the distance calculation unit 262 calculates the subject distance based on the trained model, the imaging data, and information indicating the area of ​​the subject (i.e., the coordinates of the area of ​​the subject).

[0089] Next, the parameter change processing based on the control of the control device 200a will be described using a sequence diagram. FIG. 14 is a sequence diagram showing an example (part 1) of the parameter change processing based on the control of the control device of embodiment 2. (Step ST141) The imaging processing unit 120 performs imaging based on the imaging parameters. The imaging processing unit 120 transmits the imaging parameters and imaging data to the image processing unit 130. (Step ST142) The image processing unit 130 performs image processing on the imaging data based on the image processing parameters. The image processing unit 130 transmits the imaging parameters, image processing parameters, and image data to the communication processing unit 140. (Step ST143) The communication processing unit 140 transmits the imaging parameters, image processing parameters, communication parameters, and image data to the control device 200a. For example, the communication processing unit 140 transmits the imaging parameters, image processing parameters, communication parameters, and image data to the control device 200a based on the communication parameters.

[0090] (Step ST144) The image quality determination unit 230 acquires the trained model from the storage unit 210. (Step ST145) The image quality determination unit 230 determines the image quality of the image data using the image data and the trained model. (Step ST146) The area extraction unit 261 extracts the area of ​​the subject present in the image data. (Step ST147) The distance calculation unit 262 acquires the trained model from the storage unit 210. (Step ST148) The distance calculation unit 262 calculates the subject distance based on the trained model, the image data, and information indicating the area of ​​the subject.

[0091] 15 is a sequence diagram showing an example (part 2) of a parameter change process based on control by the control device of embodiment 2. (Step ST151) The estimation unit 263 acquires a trained model from the storage unit 210. (Step ST152) The estimation unit 263 estimates parameters (i.e., parameter information) to be set in the imaging processing unit 120, the image processing unit 130, and the communication processing unit 140 using the trained model, the subject distance, the image quality determination result, the imaging parameters, the image processing parameters, and the communication parameters. (Step ST153) The estimation unit 263 stores the parameter information in the storage unit 210.

[0092] (Step ST154) Control unit 250 receives a parameter change instruction from management device 300. Control unit 250 acquires parameter information from storage unit 210. (Step ST155) Communication unit 220 transmits the parameter information and the parameter change instruction to surveillance camera 100a.

[0093] (Step ST156) The imaging processing unit 120, the image processing unit 130, and the communication processing unit 140 change the parameters based on the parameter information. In detail, the imaging processing unit 120 identifies the parameters to be set in the imaging processing unit 120 from the parameter information. The imaging processing unit 120 sets the identified parameters based on the parameter change instruction. The image processing unit 130 identifies the parameters to be set in the image processing unit 130 from the parameter information. The image processing unit 130 sets the identified parameters based on the parameter change instruction. The communication processing unit 140 identifies the parameters to be set in the communication processing unit 140 from the parameter information. The communication processing unit 140 sets the identified parameters based on the parameter change instruction.

[0094] The communication processing unit 140 may transmit parameters to be set in the imaging processing unit 120 and the image processing unit 130 to the imaging processing unit 120 and the image processing unit 130. The imaging processing unit 120 and the image processing unit 130 set the parameters transmitted by the communication processing unit 140. This eliminates the need for the imaging processing unit 120 and the image processing unit 130 to perform processing to identify the parameters.

[0095] In this way, the parameters set in the imaging processing unit 120, the image processing unit 130, and the communication processing unit 140 are changed. That is, optimal parameters are set in the imaging processing unit 120, the image processing unit 130, and the communication processing unit 140.

[0096] As described above, the monitoring camera 100a can change the parameters as needed, thereby enabling the monitoring camera 100a to appropriately capture images and perform other operations.

[0097] In the second embodiment, the estimation processing unit 260 is included in the control device 200a. That is, the surveillance camera 100a does not have an estimation processing unit. Therefore, the surveillance camera 100a does not need to be a high-performance surveillance camera. Therefore, the surveillance camera 100a can be an inexpensive surveillance camera.

[0098] The features of the above-described embodiments can be combined with each other as appropriate.

[0099] 100 Surveillance camera, 100a Surveillance camera, 110 Memory unit, 120 Imaging processing unit, 130 Image processing unit, 140 Communication processing unit, 150 Estimation processing unit, 151 Area extraction unit, 152 Distance calculation unit, 153 Estimation unit, 200 Control device, 200a Control device, 210 Memory unit, 220 Communication unit, 230 Image quality determination unit, 240 Group identification unit, 241 Processing unit, 242 Analysis unit, 243 Group estimation unit, 250 Control unit, 260 Estimation processing unit, 261 Area extraction unit, 262 Distance calculation unit, 263 Estimation unit, 300 Management device.

Claims

1. An imaging device comprising: an imaging processing unit that captures images based on set parameters; an image processing unit that performs image processing on imaging data, which is an image obtained by imaging, based on the set parameters; a communication processing unit that transmits data based on the set parameters; a storage unit that stores relationship information, which is information indicating a correspondence between parameters set in the imaging processing unit, the image processing unit, and the communication processing unit, and a subject distance, which is the distance to a subject, and a trained model; a region extraction unit that extracts a subject region present in image data, which is an image obtained by image processing, or the imaging data; and a distance calculation unit that calculates the subject distance based on the image data or the imaging data, the trained model, and information indicating the subject region, wherein the imaging processing unit identifies, based on the relationship information, parameters that are to be set in the imaging processing unit and that correspond to the subject distance, and sets the identified parameters in the imaging processing unit; and the image processing unit identifies, based on the relationship information, parameters that are to be set in the image processing unit and that correspond to the subject distance, and sets the identified parameters in the image processing unit. the communication processing unit identifies a parameter to be set in the communication processing unit and that corresponds to the subject distance based on the relationship information, and sets the identified parameter in the communication processing unit.

2. An imaging device that communicates with a control device, comprising: an imaging processing unit that captures images based on imaging parameters that are set parameters; an image processing unit that performs image processing on imaging data that is an image obtained by imaging based on image processing parameters that are set parameters; and a communication processing unit that transmits data based on communication parameters that are set parameters, wherein when parameter information and a parameter change instruction are received from the control device, the imaging processing unit sets the parameters in the parameter information to be set in the imaging processing unit to the imaging processing unit; when the parameter information and the parameter change instruction are received from the control device, the image processing unit sets the parameters in the parameter information to be set in the image processing unit to the image processing unit; and when the parameter information and the parameter change instruction are received from the control device, the communication processing unit sets the parameters in the parameter information to be set in the communication processing unit to the communication processing unit, wherein the parameter information is an image quality judgment result that is a judgment result of the image quality of image data that is an image obtained by image processing, a learned model, a subject distance that is the distance to a subject, parameters estimated using the imaging parameters, the image processing parameters, and the communication parameters, and are parameters to be set in the imaging processing unit, the image processing unit, and the communication processing unit. Imaging device.

3. An imaging device comprising: an imaging processing unit that captures images based on set parameters; an image processing unit that performs image processing on imaging data, which is an image obtained by imaging, based on the set parameters; a communication processing unit that transmits data based on the set parameters; a memory unit that stores relationship information, which is information showing a correspondence between parameters that are set in the imaging processing unit, the image processing unit, and the communication processing unit, and a subject distance, which is the distance to a subject; and a sensor that measures the subject distance, wherein the imaging processing unit identifies, based on the relationship information, parameters that are to be set in the imaging processing unit and correspond to the measured subject distance, and sets the identified parameters in the imaging processing unit; the image processing unit, based on the relationship information, parameters that are to be set in the image processing unit and correspond to the measured subject distance, and sets the identified parameters in the image processing unit; and the communication processing unit, based on the relationship information, parameters that are to be set in the communication processing unit and correspond to the measured subject distance, and sets the identified parameters in the communication processing unit.

4. A system including an imaging device and a control device, wherein the imaging device has an imaging processing unit that captures images based on set parameters, an image processing unit that performs image processing on imaging data, which is an image obtained by imaging, based on the set parameters, a communication processing unit that transmits data based on the set parameters, and a storage unit that stores relationship information, which is information indicating a correspondence between parameters set in the imaging processing unit, the image processing unit, and the communication processing unit, and a subject distance, which is a distance to a subject; and the control device has a storage unit that stores a trained model, and a region extraction unit that, when image data, which is an image obtained by image processing, or the imaging data is received from the imaging device, extracts a region of the subject present in the image data or the imaging data, a distance calculation unit that calculates the subject distance based on the image data or the imaging data, the trained model, and the information indicating the subject region, and a communication unit that transmits the subject distance to the imaging device; and when the subject distance is received from the control device, the imaging processing unit identifies a parameter that is to be set in the imaging processing unit and corresponds to the subject distance, based on the relationship information, and sets the identified parameter to the imaging processing unit, an image quality adjustment system, wherein when the subject distance is received from the control device, the image processing unit identifies, based on the relationship information, a parameter to be set in the image processing unit that corresponds to the subject distance, and sets the identified parameter in the image processing unit; and when the subject distance is received from the control device, the communication processing unit identifies, based on the relationship information, a parameter to be set in the communication processing unit that corresponds to the subject distance, and sets the identified parameter in the communication processing unit.

5. An imaging device and a control device, comprising: an imaging processing unit that captures images based on imaging parameters that are set parameters; an image processing unit that performs image processing on imaging data that is an image obtained by imaging based on image processing parameters that are set parameters; and a communication processing unit that transmits data based on communication parameters that are set parameters, wherein the control device comprises: a storage unit that stores parameter information; and a communication unit that transmits the parameter information and a parameter change instruction to the imaging device, wherein, when the parameter information and the parameter change instruction are received from the control device, the imaging processing unit sets the parameters in the parameter information to be set in the imaging processing unit, and when the parameter information and the parameter change instruction are received from the control device, the image processing unit sets the parameters in the parameter information to be set in the image processing unit, and when the parameter information and the parameter change instruction are received from the control device, the communication processing unit sets the parameters in the parameter information to be set in the communication processing unit, The parameter information is a parameter estimated using an image quality judgment result, which is a judgment result of the image quality of image data, which is an image obtained by image processing, a trained model, a subject distance, which is the distance to the subject, the imaging parameters, the image processing parameters, and the communication parameters, and is a parameter to be set in the imaging processing unit, the image processing unit, and the communication processing unit.

6. The image quality adjustment system according to claim 5, comprising a plurality of imaging devices belonging to the same group, each of the plurality of imaging devices having the imaging processing unit, the image processing unit, and the communication processing unit, and the communication unit transmitting the parameter information and the parameter change instruction to the plurality of imaging devices.

Images