Imaging device, image analysis system, encoding method, and encoding program

Abstract

To reduce the amount of transmitted data.SOLUTION: An imaging device 100 includes an acquisition unit 120 that acquires a first image containing an object, and obtains the importance of a second image generated before the first image, the detection position of the second image, and information indicating a second detection area of the second image, a detection unit 130 that detects the object on the basis of the first image, an importance determination unit 140 that determines the importance of the first image to be a value smaller than the importance of the second image when the objects in the first image and the second image are the same, the first detection area in the first image is narrower than the second detection area, or the first detection area and the second detection area are the same, a coding determination unit 150 that determines a frame other than an intra frame as the first image when the importance of the first image is smaller than a second threshold, an encoding unit 160 that encodes the first image as a frame other than the intra frame, and a transmission unit 190 that transmits encoded data.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present disclosure relates to an imaging device, an image analysis system, an encoding method, and an encoding program. [Background technology]

[0002] A user can view in real time images captured by a surveillance camera or the like. In addition, the user can view the images recorded on a recording medium. In recent years, a technology for computers to analyze images has become widespread. By using this technology, a person, a type of an object, an attribute of an object, and the like can be identified.

[0003] When analyzing one image from a video (i.e., multiple images), the analysis is not performed on the entire image. For example, when performing face recognition, a face area is first detected from within an image. After the face area is detected, face recognition is performed on the face area. The load of the face area detection process is small. Therefore, the face area detection process may be performed by an imaging device. On the other hand, the load of face recognition is large. Therefore, face recognition is performed by an analysis device. Here, a technology has been proposed for performing intra-coding on the face area (see Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2017-225068 A Summary of the Invention [Problem to be solved by the invention]

[0005] As with the above technology, a method is conceivable in which images containing face regions are treated as intraframes. When a person barely moves, almost all images become intraframes. More precisely, when an object barely moves, almost all images become intraframes. When almost all images become intraframes, the amount of data transmitted to downstream devices increases.

[0006] An object of the present disclosure is to reduce the amount of data transmitted. [Means for solving the problem]

[0007] An imaging device according to one aspect of the present disclosure is provided. The imaging device captures an image of an object. The imaging device includes an acquisition unit that acquires a first image including the object, and acquires information indicating the importance of a second image that is an image generated before the first image and includes the object, a detection position of the object in the second image, and a second detection area of ​​the object in the second image, and a detection unit that detects the object based on the first image, and compares the detection position of the object in the second image with the detection position of the object in the first image, compares the second detection area with the first detection area of ​​the object in the first image, and detects whether a difference in detection position and a difference in detection area are equal to or smaller than a first threshold value that is determined in advance. and if the first detection area is narrower than the second detection area or the first detection area and the second detection area are the same, the image processing apparatus has an importance determination unit that determines the importance of the first image to be a value smaller than the importance of the second image, if the importance of the first image is smaller than a predetermined second threshold, an encoding determination unit that determines the first image to be a frame other than an intraframe, if the determination indicates a frame other than an intraframe, an encoding unit that encodes the first image as a frame other than an intraframe, and a transmitting unit that transmits the encoded data. Effect of the Invention

[0008] According to the present disclosure, the amount of data transmitted can be reduced. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 illustrates an image analysis system. [Diagram 2] FIG. 2 is a diagram illustrating hardware included in the imaging apparatus. [Diagram 3] FIG. 2 is a block diagram showing functions of the imaging apparatus. [Figure 4] 10 is a flowchart illustrating an example of processing executed by the imaging device. [Diagram 5] FIG. 13 is a diagram illustrating an example of metadata. [Figure 6] 13 is a flowchart (part 1) illustrating an example of an importance determination process. [Figure 7] 13 is a flowchart (part 2) illustrating an example of the importance determination process. [Figure 8] 13A and 13B are diagrams illustrating a specific example of importance determination processing. [Figure 9] FIG. 13 is a flowchart illustrating an example of an intra-coding decision process. [Figure 10] FIG. 2 is a block diagram showing the functions of a recording device and an analysis device. [Figure 11] FIG. 13 is a diagram showing an example of processed metadata. [Figure 12] 4 is a flowchart showing a part of the process of the recording device. [Figure 13] 13 is a flowchart illustrating an example of a metadata transmission process. [Figure 14] 13 is a flowchart illustrating an example of a transmission process of encoded data. [Figure 15] 13 is a flowchart illustrating an example of a process executed by the analysis device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment will be described with reference to the drawings. The following embodiment is merely an example, and various modifications are possible within the scope of the present disclosure.

[0011] Embodiment 1 is a diagram showing an image analysis system. The image analysis system includes an imaging device 100, a recording device 200, and an analysis device 300. The imaging device 100 and the recording device 200 are connected via a network 10. The recording device 200 and the analysis device 300 are connected via a network 20.

[0012] The imaging device 100 captures an image of an object. The object may be a person, an animal, a machine (for example, an automobile), etc. The imaging device 100 is also a device that executes an encoding method. The recording device 200 stores the data received from the imaging device 100 . Analysis device 300 performs analysis using the data stored in recording device 200. For example, analysis device 300 is a PC (Personal Computer).

[0013] Next, the hardware of the imaging device 100 will be described. 2 is a diagram showing hardware included in the imaging device 100. The imaging device 100 includes a processor 101, a volatile storage device 102, and a non-volatile storage device 103.

[0014] The processor 101 controls the entire image capturing apparatus 100. For example, the processor 101 is a central processing unit (CPU) or a field programmable gate array (FPGA). The processor 101 may be a multiprocessor. The image capturing apparatus 100 may also include a processing circuit.

[0015] The volatile storage device 102 is a main storage device of the imaging device 100. For example, the volatile storage device 102 is a random access memory (RAM). The non-volatile storage device 103 is an auxiliary storage device of the imaging device 100. For example, the non-volatile storage device 103 is a hard disk drive (HDD) or a solid state drive (SSD). Similar to the imaging device 100, the recording device 200 and the analysis device 300 each include a processor, a volatile storage device, and a non-volatile storage device.

[0016] Next, functions of the imaging device 100 will be described. 3 is a block diagram showing the functions of the imaging device 100. The imaging device 100 includes an imaging section 110, an acquisition section 120, a detection section 130, an importance determination section 140, an encoding determination section 150, an encoding section 160, a metadata generation section 170, a multiplexing section 180, and a transmission section 190.

[0017] A part or all of the acquiring unit 120, the detecting unit 130, the importance determining unit 140, the encoding determining unit 150, the encoding unit 160, the metadata generating unit 170, the multiplexing unit 180, and the transmitting unit 190 may be realized by a processing circuit. Also, a part or all of the acquiring unit 120, the detecting unit 130, the importance determining unit 140, the encoding determining unit 150, the encoding unit 160, the metadata generating unit 170, the multiplexing unit 180, and the transmitting unit 190 may be realized as a module of a program executed by the processor 101. For example, the program executed by the processor 101 is also called an encoding program. For example, the encoding program is recorded on a recording medium.

[0018] The imaging unit 110 captures an image of an object. The acquisition unit 120 acquires an image. For example, the acquisition unit 120 acquires an image including an object. Also, the acquisition unit 120 acquires a video (i.e., a plurality of images). Therefore, this sentence can be expressed as follows. The acquisition unit 120 sequentially acquires images from the imaging unit 110. Here, an image is also called a frame. As described above, the acquisition unit 120 acquires an image. For example, the acquired image is also referred to as a currently generated image or a first image.

[0019] The acquisition unit 120 acquires information indicating the importance of a second image, which is an image generated before the first image and includes an object. The second image may be an image generated one image before the first image, or may be an image generated two images before the first image. The acquisition unit 120 also acquires information indicating the detection position of the object in the second image and the detection area of ​​the object in the second image. In the following description, the second image is referred to as the previously generated image.

[0020] The functions of the detection unit 130, importance determination unit 140, encoding determination unit 150, and encoding unit 160 will be described later. The metadata generator 170 generates metadata for the acquired images. The multiplexing unit 180 combines the encoded data obtained by the encoding unit 160 and the metadata into one to generate multiplexed data. For example, the multiplexed data may be called first multiplexed data. The transmitting unit 190 transmits the multiplexed data to the recording device 200 .

[0021] Next, the process executed by the imaging device 100 will be described with reference to a flowchart. FIG. 4 is a flowchart showing an example of processing executed by the imaging device. (Step S11) The acquisition unit 120 acquires an image from the imaging unit 110. Note that the image is the currently generated image or the first image. (Step S12) The detection unit 130 executes an object detection process based on the acquired image. For example, the detection unit 130 executes the object detection process using an object recognition technique. If an object is included in the image, the detection unit 130 detects the object.

[0022] (Step S13) The importance determining unit 140 executes an importance determining process. (Step S14) The coding decision unit 150 performs intra-coding decision processing.

[0023] (Step S15) The encoding unit 160 performs encoding according to the determined content. In particular, if the determined content indicates an intra frame, the encoding unit 160 encodes the image acquired in step S11 as an intra frame. On the other hand, if the determined content indicates a frame other than an intra frame, the encoding unit 160 encodes the image acquired in step S11 as a P frame (Predicted Frame) or a B frame (Bi-directional Predicted Frame).

[0024] (Step S16) The metadata generating unit 170 generates metadata based on the detection result by the detecting unit 130 and the importance determined by the importance determining process. Here, an example of the metadata will be given.

[0025] FIG. 5 is a diagram showing an example of metadata. The metadata is used as auxiliary information for image analysis. The metadata includes object information and image information. For example, the object information is information based on a detection result. The image information includes information indicating whether or not it is an intraframe, importance, etc.

[0026] (Step S17) The multiplexing unit 180 generates multiplexed data by combining the encoded data obtained by the encoding unit 160 and the metadata. The multiplexing unit 180 may also generate multiplexed data including the image capture time. (Step S18) The transmitting unit 190 transmits the multiplexed data to the recording device 200. Alternatively, the transmitting unit 190 may transmit only the encoded data to the recording device 200. Furthermore, the transmitting unit 190 may transmit the multiplexed data or the encoded data to a device other than the recording device 200.

[0027] Next, the importance determination process will be described. 6 is a flowchart (part 1) showing an example of the importance determination process. The process in FIGS. 6 and 7 corresponds to step S13.

[0028] Here, the importance will be explained. The importance is represented by a value between 0 and 100. The closer the value is to 0, the lower the importance. The closer the value is to 100, the higher the importance. The initial value is 50. Furthermore, the importance does not have to be represented in the range between 0 and 100. In other words, the expression of the importance is not limited to the expression in that range.

[0029] (Step S21) The importance determination unit 140 determines whether or not an object has been detected in the object detection process. If an object has been detected, the importance determination unit 140 assigns an identification number to the image generated this time (i.e., the image acquired in step S11). Then, the process proceeds to step S22. If an object has not been detected, the importance determination unit 140 determines the importance of the image generated this time to be 0. Then, the process ends.

[0030] (Step S22) The importance determination unit 140 determines whether or not an object has been detected from the previously generated image. If an object has not been detected from the previously generated image, the importance determination unit 140 determines that a new object has been detected. Then, the process proceeds to step S26. If an object has been detected from the previously generated image, the process proceeds to step S23.

[0031] (Step S23) The importance determination unit 140 compares the detection position of the object in the previously generated image with the detection position of the object in the currently generated image. The importance determination unit 140 also compares the detection region of the object in the previously generated image (e.g., also referred to as the second detection region) with the detection region of the object in the currently generated image (e.g., also referred to as the first detection region).

[0032] (Step S24) The importance determination unit 140 judges whether the difference in the detection position and the difference in the detection area are equal to or less than a predetermined threshold. Here, the threshold is also referred to as a first threshold. If the difference in the detection position and the difference in the detection area are equal to or less than the threshold, the importance determination unit 140 judges that the object in the image generated previously and the object in the image generated this time are the same object. Then, the process proceeds to step S25. If the difference in the detection position and the difference in the detection area are not equal to or less than the threshold, the process proceeds to step S32. The threshold value to be compared with the difference in the detection position and the threshold value to be compared with the difference in the detection area may be different.

[0033] (Step S25) The importance determining unit 140 changes the identification number assigned to the image generated this time to the identification number assigned to the image generated last time. Then, the process proceeds to step S31. (Step S26) The importance determining unit 140 determines the importance of the currently generated image to be an initial value, and the process then ends.

[0034] FIG. 7 is a flowchart (part 2) illustrating an example of the importance determination process. (Step S31) The importance determining unit 140 determines whether or not the detection area of ​​the image generated this time (hereinafter, current detection area) is larger than the detection area of ​​the image generated previously (hereinafter, previous detection area). If the current detection area is larger than the previous detection area, the process proceeds to step S32. If the current detection area is smaller than the previous detection area, or if the current detection area and the previous detection area are the same, the process proceeds to step S33.

[0035] (Step S32) The importance determining unit 140 determines the importance of the currently generated image to be a value greater than the importance of the previously generated image, and then the process ends. (Step S33) The importance determining unit 140 determines the importance of the currently generated image to be a value smaller than the importance of the previously generated image, and then the process ends. When step S32 is executed after step S24, the importance determining section 140 may determine the importance of the currently generated image to be an initial value.

[0036] Here, a specific example of the importance determination process will be shown. 8(A) and (B) are diagrams showing a specific example of the importance determination process. Fig. 8(A) shows a case where step S32 is executed after step S31. Fig. 8(B) shows a case where step S33 is executed after step S31.

[0037] An image 400 at time tn shown in Figures 8(A) and (B) is assumed to be a previously generated image. Note that n is a positive integer. Figures 8(A) and (B) also show a previously detected area 401. The importance of the previously generated image is 40. An image 410 at time t shown in Figures 8(A) and (B) is an image generated this time. Also, Figures 8(A) and (B) show a current detection area 411.

[0038] In Fig. 8(A), current detection area 411 is larger than previous detection area 401. Therefore, importance determination section 140 determines the importance of image 410 to be 70. Furthermore, the larger the detection area, the higher the analysis accuracy by analysis device 300. Therefore, when the detection area is large, a large importance value is determined. 8B, the current detection area 411 is narrower than the previous detection area 401. Therefore, the importance determining section 140 determines the importance of the image 410 to be 20.

[0039] As shown in Fig. 7, when the object is almost stationary, the importance of the image gradually decreases. Also, when the object is cut off or when the object is covered by an obstacle and a part of the object is missing, a small importance value is determined.

[0040] The importance may be determined according to the analysis content of the analysis device 300. For example, when the analysis device 300 analyzes the degree of crowding, the importance determination unit 140 determines a large importance value for an image with a large number of faces. The importance determination unit 140 determines a small importance value for an image with a small number of faces. For example, when the analysis device 300 analyzes an image in which a large object is shown, the importance determination unit 140 compares a predetermined reference range with the current detection area. When the current detection area is wider than the reference range, the importance determination unit 140 determines the importance of the image generated this time to a large value. When the current detection area is narrower than the reference range, the importance determination unit 140 determines the importance of the image generated this time to a small value. For example, when the analysis device 300 analyzes an image generated at a specific time, the importance determination unit 140 determines the importance of the image generated at the specific time to a large value. Then, the importance determining section 140 determines the importance of images generated at other times to be smaller values.

[0041] Next, the intra-coding decision process will be described. 9 is a diagram showing a flowchart of an example of the intra-coding decision process, which corresponds to step S14. (Step S41) The encoding decision unit 150 compares the importance of the currently generated image with a predetermined threshold. For example, the threshold is 50, 60, etc., and the threshold may be changed depending on the detected scene and object. The threshold is also called the second threshold.

[0042] (Step S42) The encoding decision unit 150 determines whether the importance of the currently generated image is equal to or greater than the threshold. If the importance of the currently generated image is equal to or greater than the threshold, the process proceeds to step S43. If the importance of the currently generated image is less than the threshold, the encoding decision unit 150 decides not to make the currently generated image an intraframe. That is, the encoding decision unit 150 decides that the currently generated image will be a frame other than an intraframe. In detail, the encoding decision unit 150 decides that the currently generated image will be a P frame or a B frame. Then, the process ends. (Step S43) The encoding decision unit 150 decides that the currently generated image is an intra-frame.

[0043] Here, when the object hardly moves, almost all of the image may be set as intra-frames. When almost all of the image becomes intra-frames, the amount of data to be transmitted to a downstream device (e.g., a recording device) increases.

[0044] According to the embodiment, when the object hardly moves, the importance is reduced. The reduction in importance increases the number of times that the image generated this time is determined to be a P frame or a B frame. In other words, the number of times that the image generated this time is determined to be an intra frame is reduced. Therefore, the amount of transmission data when a few intra frames and many P frames or B frames are determined is less than the amount of transmission data when almost all images are determined to be intra frames. Therefore, the imaging device 100 or the image analysis system can reduce the amount of transmission data.

[0045] Next, the recording device 200 and the analysis device 300 will be described. 10 is a block diagram showing the functions of the recording device and the analysis device. The recording device 200 has a receiving unit 210, a separating unit 220, an encoded data storage unit 230, a processing unit 240, a metadata storage unit 250, a metadata transmission control unit 260, and an encoded data transmission control unit 270.

[0046] The encoded data storage unit 230 and the metadata storage unit 250 may be realized as storage areas secured in a volatile storage device or a non-volatile storage device included in the recording device 200 . Some or all of the receiving unit 210, the separating unit 220, the processing unit 240, the metadata transmission control unit 260, and the encoded data transmission control unit 270 may be realized by a processing circuit included in the recording device 200. Also, some or all of the receiving unit 210, the separating unit 220, the processing unit 240, the metadata transmission control unit 260, and the encoded data transmission control unit 270 may be realized as program modules executed by a processor included in the recording device 200.

[0047] The analysis device 300 includes a metadata communication unit 310 , a storage unit 320 , an encoded data control unit 330 , an encoded data communication unit 340 , a decoding unit 350 , and an analysis unit 360 .

[0048] Storage unit 320 may be realized as a storage area secured in a volatile storage device or a non-volatile storage device included in analysis device 300 . Some or all of the metadata communication unit 310, the encoded data control unit 330, the encoded data communication unit 340, the decoding unit 350, and the analysis unit 360 may be realized by a processing circuit included in the analysis device 300. Some or all of the metadata communication unit 310, the encoded data control unit 330, the encoded data communication unit 340, the decoding unit 350, and the analysis unit 360 may be realized as a program module executed by a processor included in the analysis device 300.

[0049] First, the function of the recording device 200 will be described. The receiving unit 210 receives the multiplexed data. The separating unit 220 separates the multiplexed data into encoded data and metadata. The separating unit 220 stores the encoded data in the encoded data storage unit 230. The processing unit 240 processes the metadata. The processed metadata is shown below as an example.

[0050] 11 is a diagram showing an example of processed metadata, in which time information and encoding information are added. When the multiplexed data includes a shooting time, the processing unit 240 adds the shooting time to the metadata as time information. When the multiplexed data does not include a shooting time, the processing unit 240 adds the time when the multiplexed data was received to the metadata as a shooting time. The processing unit 240 adds, as encoding information, the encoded data number corresponding to the encoded data included in the multiplexed data to the metadata. The processing unit 240 stores the processed metadata in the metadata storage unit 250.

[0051] When the metadata transmission control unit 260 receives a transmission request from the analysis device 300 , it transmits the metadata stored in the metadata storage unit 250 to the analysis device 300 . When the encoded data transmission control unit 270 receives a transmission request from the analysis device 300 , it transmits the encoded data to the analysis device 300 .

[0052] Next, the function of the analysis device 300 will be described. The metadata communication unit 310 transmits a request to transmit metadata to the recording device 200. When the metadata communication unit 310 receives metadata, it stores the metadata in the storage unit 320.

[0053] The encoded data control unit 330 acquires analysis condition information indicating analysis conditions. For example, the encoded data control unit 330 acquires the analysis condition information from the storage unit 320. Also, for example, the encoded data control unit 330 acquires the analysis condition information input by a user. For example, the analysis condition indicates an intraframe with an importance level of 70 or more. Also, the analysis condition may include the imaging time or imaging duration. For example, the imaging duration is 12:00 to 13:00.

[0054] The encoded data control unit 330 identifies the encoded data to be analyzed based on the analysis condition information and the metadata. In particular, the encoded data control unit 330 identifies the encoded data number of the encoded data to be analyzed.

[0055] The encoded data communication unit 340 transmits a transmission request for the identified encoded data (i.e., the encoded data to be analyzed) to the recording device 200. The transmission request includes the identified encoded data number. Then, the encoded data communication unit 340 receives the encoded data to be analyzed.

[0056] The decoding unit 350 decodes the received encoded data. The decoding unit 350 obtains metadata corresponding to the received encoded data from the storage unit 320. The analysis unit 360 performs analysis based on the decoded data (ie, image) and metadata.

[0057] Next, the processing of the recording device 200 will be described with reference to a flowchart. FIG. 12 is a flowchart showing a part of the process of the recording device. (Step S51) The receiving unit 210 receives multiplexed data. (Step S52) The demultiplexer 220 demultiplexes the multiplexed data into encoded data and metadata. (Step S53) The demultiplexer 220 stores the encoded data in the encoded data storage unit 230.

[0058] (Step S54) The processing unit 240 processes the metadata. (Step S55) The processing unit 240 stores the processed metadata in the metadata storage unit 250. Note that step S53 may be performed simultaneously with steps S54 and S55, or step S53 may be performed after steps S54 and S55.

[0059] FIG. 13 is a flowchart illustrating an example of metadata transmission processing. (Step S61) Metadata transmission control unit 260 determines whether or not a metadata transmission request has been received from analysis device 300. If a metadata transmission request has been received, the process proceeds to step S62. If a metadata transmission request has not been received, the process ends. (Step S62) The metadata transmission control unit 260 acquires metadata from the metadata storage unit 250. (Step S63) The metadata transmission control unit 260 transmits the metadata to the analysis device 300.

[0060] FIG. 14 is a flowchart showing an example of a transmission process of encoded data. (Step S71) The encoded data transmission control unit 270 determines whether or not a request to transmit encoded data has been received from the analysis device 300. If a request to transmit encoded data has been received, the process proceeds to step S72. If a request to transmit encoded data has not been received, the process ends. (Step S72) The encoded data transmission control unit 270 acquires the encoded data from the encoded data storage unit 230. (Step S73) The encoded data transmission control unit 270 transmits the encoded data to the analysis device 300.

[0061] Next, the processing of analysis device 300 will be described with reference to a flowchart. FIG. 15 is a flowchart illustrating an example of a process executed by the analysis device. (Step S81) The metadata communication unit 310 transmits a metadata transmission request to the recording device 200. (Step S82) The metadata communication unit 310 determines whether or not metadata has been received. If metadata has been received, the process proceeds to step S83. If metadata has not been received, the metadata communication unit 310 waits until metadata is received. (Step S83) The metadata communication unit 310 stores the metadata in the storage unit 320.

[0062] (Step S84) The encoded data control unit 330 identifies the encoded data to be analyzed from the encoding information of the metadata. (Step S85) The encoded data communication unit 340 transmits a transmission request for the identified encoded data to the recording device 200. (Step S86) The encoded data communication unit 340 determines whether or not encoded data has been received. If encoded data has been received, the process proceeds to step S87. If encoded data has not been received, the encoded data communication unit 340 waits until encoded data is received.

[0063] (Step S87) The decoding unit 350 decodes the received encoded data. (Step S88) The decoding unit 350 obtains, from the storage unit 320, metadata corresponding to the received encoded data. (Step S89) The analysis unit 360 performs analysis based on the decoded data (i.e., image) and metadata.

[0064] As described above, the metadata includes the importance. Therefore, the analysis device 300 can identify images with high importance. Furthermore, the analysis device 300 does not receive all the encoded data stored in the recording device 200. The analysis device 300 receives only the identified encoded data. Therefore, the amount of communication between the recording device 200 and the analysis device 300 is reduced.

[0065] Also, when there are many intra frames, the coded data control unit 330 may specify the intra frame with the highest importance from the metadata. In detail, the image analysis system performs the following process. The imaging device 100 generates multiplexed data every time it generates an image, and transmits the multiplexed data to the recording device 200. Thus, the imaging device 100 transmits a plurality of multiplexed data to the recording device 200. The recording device 200 receives a plurality of multiplexed data. The recording device 200 adds a coded data number corresponding to the coded data to the metadata for each multiplexed data. The recording device 200 transmits the processed plurality of metadata to the analysis device 300. The analysis device 300 receives the plurality of metadata. The analysis device 300 detects that there are more intra frames than a predetermined threshold based on the plurality of metadata. Here, the threshold is also referred to as a third threshold. The analysis device 300 specifies the coded data of the intra frame with the highest importance based on the plurality of metadata. In particular, the analysis device 300 identifies the coded data number of the coded data of the most important intra-frame based on the multiple pieces of metadata.

[0066] Analysis device 300 may adjust the number of frames to be decoded according to the processing load. Analysis device 300 can also detect the distribution of important frames in the entire video by analyzing metadata. [Explanation of symbols]

[0067] 10 network, 20 network, 100 imaging device, 101 processor, 102 volatile storage device, 103 non-volatile storage device, 110 imaging unit, 120 acquisition unit, 130 detection unit, 140 importance determination unit, 150 encoding determination unit, 160 encoding unit, 170 metadata generation unit, 180 multiplexing unit, 190 transmission unit, 200 recording device, 210 reception unit, 220 separation unit, 230 encoded data storage unit, 240 processing unit, 250 metadata storage unit, 260 metadata transmission control unit, 270 encoded data transmission control unit, 300 analysis device, 310 metadata communication unit, 320 storage unit, 330 encoded data control unit, 340 encoded data communication unit, 350 decoding unit, 360 Analysis unit, 400, image, 401, previous detection area, 410, image, 411, current detection area.

Claims

1. An imaging device for imaging an object, comprising: an acquisition unit that acquires a first image including the object, and acquires information indicating the importance of a second image that is an image generated before the first image and includes the object, a detection position of the object in the second image, and a second detection area of ​​the object in the second image; A detection unit that detects the object based on the first image; an importance determination unit that compares a detection position of the object in the second image with a detection position of the object in the first image, compares the second detection area with a first detection area of ​​the object in the first image, and determines the importance of the first image to be a value smaller than the importance of the second image when a difference in detection position and a difference in detection area are equal to or smaller than a first threshold value and the first detection area is narrower than the second detection area or the first detection area and the second detection area are the same; an encoding decision unit that decides that the first image is a frame other than an intra frame when the importance of the first image is smaller than a second predetermined threshold; an encoding unit that encodes the first image as a frame other than an intraframe when the determined content indicates a frame other than an intraframe; A transmitter that transmits the encoded data; An imaging device having the above configuration.

2. The importance determination unit is When the difference between the detection positions and the difference between the detection areas are equal to or less than the first threshold value and the first detection area is larger than the second detection area, determining the importance of the first image to be greater than the importance of the second image; The encoding determination unit If the importance of the first image is equal to or greater than the second threshold, the first image is determined to be an intra-frame; The encoding unit is if the determination indicates an intraframe, encoding the first image as an intraframe; The imaging device according to claim 1 .

3. a metadata generating unit configured to generate metadata for the first image; The transmission unit is transmitting multiplexed data including the encoded data and the metadata; The imaging device according to claim 1 .

4. An imaging device that captures an image of an object; A recording device; An analysis device; Including, The imaging device includes: an acquisition unit that acquires a first image including the object, and acquires information indicating the importance of a second image that is an image generated before the first image and includes the object, a detection position of the object in the second image, and a second detection area of ​​the object in the second image; A detection unit that detects the object based on the first image; an importance determination unit that compares a detection position of the object in the second image with a detection position of the object in the first image, compares the second detection area with a first detection area of ​​the object in the first image, and determines the importance of the first image to be a value smaller than the importance of the second image when a difference in detection position and a difference in detection area are equal to or smaller than a first threshold value and the first detection area is narrower than the second detection area or the first detection area and the second detection area are the same; an encoding decision unit that decides that the first image is a frame other than an intra frame when the importance of the first image is smaller than a second predetermined threshold; an encoding unit that encodes the first image as a frame other than an intraframe when the determined content indicates a frame other than an intraframe; A transmitter that transmits the encoded data; having Image analysis system.

5. The imaging device includes: generating metadata for the first image; Transmitting multiplexed data including the encoded data and the metadata to the recording device; The recording device includes: receiving the multiplexed data; adding an encoded data number corresponding to the encoded data to the metadata; Sending the processed metadata to the analysis device; The analysis device includes: receiving the metadata; Acquires analysis condition information that indicates the analysis conditions. Identifying an encoded data number of the encoded data to be analyzed based on the analysis condition information and the metadata; Transmitting a request to transmit the encoded data to be analyzed to the recording device; receiving the encoded data to be analyzed from the recording device; Decoding the received encoded data; performing an analysis based on the decrypted data and the metadata; The image analysis system according to claim 4.

6. The imaging device includes: generating metadata including an importance of the first image and information indicating whether the first image is an intra-frame; Transmitting a plurality of multiplexed data including first multiplexed data which is a combination of encoded data, which is encoded data, and the metadata to the recording device; The recording device includes: receiving the plurality of multiplexed data; adding an encoded data number corresponding to the encoded data to the metadata for each of the multiplexed data; Transmitting the processed metadata to the analysis device; The analysis device includes: receiving the plurality of metadata; Detecting whether an intraframe is present in an amount equal to or greater than a third predetermined threshold based on the plurality of metadata; Identifying the encoded data of the most important intraframe based on the plurality of metadata; Transmitting a transmission request for the identified encoded data to the recording device; receiving the identified encoded data from the recording device; Decoding the received encoded data; performing an analysis based on the decoded data and metadata corresponding to the identified encoded data; The image analysis system according to claim 4.

7. the analysis device adjusts the number of frames to be decoded according to a processing load. The image analysis system according to any one of claims 4 to 6.

8. An imaging device for imaging an object, acquiring a first image including the object, and acquiring information indicating a level of importance of a second image that is an image generated before the first image and includes the object, a detection position of the object in the second image, and a second detection area of ​​the object in the second image; Detecting the object based on the first image; comparing a detection position of the object in the second image with a detection position of the object in the first image, and comparing the second detection area with a first detection area of ​​the object in the first image; When the difference in the detection positions and the difference in the detection areas are equal to or less than a first threshold value, and the first detection area is narrower than the second detection area, or the first detection area and the second detection area are the same, the importance of the first image is determined to be a value smaller than the importance of the second image; If the importance of the first image is less than a second predetermined threshold, the first image is determined to be a frame other than an intra frame; If the determination indicates a non-intra frame, encoding the first image as a non-intra frame; Transmitting the encoded data; Encoding method.

9. An imaging device for imaging an object, acquiring a first image including the object, and acquiring information indicating a level of importance of a second image that is an image generated before the first image and includes the object, a detection position of the object in the second image, and a second detection area of ​​the object in the second image; Detecting the object based on the first image; comparing a detection position of the object in the second image with a detection position of the object in the first image, and comparing the second detection area with a first detection area of ​​the object in the first image; When the difference in the detection positions and the difference in the detection areas are equal to or less than a first threshold value, and the first detection area is narrower than the second detection area, or the first detection area and the second detection area are the same, the importance of the first image is determined to be a value smaller than the importance of the second image; If the importance of the first image is less than a second predetermined threshold, the first image is determined to be a frame other than an intra frame; If the determination indicates a non-intra frame, encoding the first image as a non-intra frame; Transmitting the encoded data; The coding program that performs the processing.

Images