Video processing apparatus and camera system

The video processing device addresses the inefficiency in conventional systems by adjusting frame rate and resolution based on subject density and movement, reducing video information volume while ensuring evidence quality.

JP2024165757APending Publication Date: 2024-11-28JVC KENWOOD CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023082238
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-18
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Conventional camera systems increase video transmission and recording capacity unnecessarily in facilities with constant human traffic due to high frame rates during periods of low subject movement.

Method used

A video processing device that adjusts frame rate and resolution based on subject density and movement within a facility, reducing video information volume by altering these parameters when necessary.

Benefits of technology

Effectively suppresses the increase in video information transmission and recording capacity while maintaining sufficient evidence quality by dynamically adjusting frame rate and resolution according to subject density and movement.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024165757000001_ABST
    Figure 2024165757000001_ABST
Patent Text Reader

Abstract

To provide a video processing apparatus and a camera system capable of properly suppressing increase in a transmission amount or a recording capacity of video information, in response to a situation of a subject in a facility or out of doors.SOLUTION: A control unit 20 according to an embodiment comprises: a video information acquisition unit 21 which acquires video information of the inside of a predetermined facility or the outside of doors photographed by a camera 11 installed in the facility or out of doors; a motion detection unit 24 which detects a motion of the subject in the facility or out of doors based on the video information; a congestion degree calculation unit 25 which calculates a congestion degree of the subject within a photographing range of the camera 11; a video information control unit 26 which changes a frame rate of the video information in response to the motion and the congestion degree of the subject; a recording control unit 22 which causes a recording device 12 to record the video information whose frame rate is changed; and a communication control unit 23 which causes the video information to be transmitted to an external apparatus via a communication device 13.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a video processing device and a camera system. [Background technology]

[0002] Generally, there is known a camera system that includes a camera device installed inside or outside a specific facility and is used for security purposes such as monitoring and crime prevention of the facility, etc. Patent Document 1 discloses a technology in which the camera device notifies an event when it detects the movement of a subject, and changes the frame rate of video information (video data) captured by the camera device depending on the presence or absence of this event notification, and records or transmits the video information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2006-279464 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in conventional technology, the frame rate is lowered during the time period when the subject's movement is not detected, and when the subject's movement is detected, the frame rate is increased during a certain time period before and after the detection timing and recorded or transmitted. In this configuration in which the frame rate of the video information is changed depending on whether or not the movement of a person (subject) is detected, for example, in a facility where people (subjects) are constantly coming and going, the video information captured even for the movement of a small number of people (one person) is recorded or transmitted at a high frame rate. For this reason, there is room for improvement in terms of suppressing the increase in the amount of video information transmitted or the recording capacity depending on the situation of the subject in the facility.

[0005] The present invention has been made in consideration of the above, and aims to provide a video processing device and a camera system that can appropriately suppress an increase in the amount of video information transmitted or the recording capacity depending on the situation of the subject inside or outdoors a facility. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the objective, the video processing device of the present invention comprises a video information acquisition unit that acquires video information of a facility or outdoors captured by a camera device installed in a specified facility or outdoors, a motion detection unit that detects the movement of a subject within the facility or outdoors based on the video information, a density calculation unit that calculates the density of the subject, a video information control unit that changes at least one of the frame rate and the resolution of the video information depending on the situation of the subject including the movement and density of the subject, and at least one of a recording control unit that records the changed video information in a recording unit and a communication control unit that transmits the changed video information to the outside.

[0007] In addition, the camera system of the present invention includes a camera device installed within a specified facility or outdoors, and a video processing device that processes video information captured by the camera device, and the video processing device includes a video information acquisition unit that acquires video information of the facility or outdoors captured by the camera device, a motion detection unit that detects movement of a subject within the facility or outdoors based on the video information, a density calculation unit that calculates the density of the subject, a video information control unit that changes at least one of the frame rate and the resolution of the video information depending on the situation of the subject including the movement and density of the subject, and at least one of a recording control unit that records the modified video information in a recording unit and a communication control unit that transmits the modified video information to the outside. Effect of the Invention

[0008] According to the present invention, it is possible to appropriately suppress an increase in the amount of video information transmitted or the recording capacity depending on the state of a subject inside or outside a facility. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a camera system according to the first embodiment. [Diagram 2] FIG. 2 is a flowchart showing the procedure of the operation of the video processing device according to the first embodiment. [Diagram 3] FIG. 3 is a diagram showing the relationship between the density and the frame rate and the movement time when a subject moves through a passage. [Figure 4] FIG. 4 is a diagram showing the relationship between the overall density of subjects, the frame rate, and the movement time when a plurality of subjects move through a passage. [Diagram 5] FIG. 5 is a diagram showing another example of the relationship between the density of the entire subjects in FIG. 4 and the movement time. [Figure 6] FIG. 6 is a block diagram showing an example of the configuration of a camera system according to the second embodiment. [Figure 7] FIG. 7 is a diagram showing the relationship between the density of the shooting range of each camera, the frame rate, and the movement time when a subject moves through a passage. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. Note that the present invention is not limited to the embodiment described below.

[0011] [First embodiment] FIG. 1 is a block diagram showing an example of the configuration of a camera system according to a first embodiment. The camera system 10 is a surveillance or crime prevention camera system that is installed in a specific facility such as a train station and captures the flow of people (subjects) within the facility. In this embodiment, the subject to be captured is described as a person (pedestrian) passing through the facility, but may be a car entering or leaving a parking lot, as long as the subject can move within the facility. In this embodiment, the camera system is described as being installed in a specific facility including an outdoor facility such as an amusement park or a zoo, but may be installed outdoors such as a tourist spot or a downtown area.

[0012] As shown in FIG. 1, the camera system 10 includes a camera (camera device) 11, a recording device (recording section) 12, a communication device (communication section) 13, and a control section (video processing device) 20.

[0013] Camera 11 captures video within the facility. In this embodiment, camera 11 is a fixed camera fixedly installed on a ceiling or wall in the passageway within the facility, and constantly captures the passageway. As a result, when a person passes through the passageway, camera 11 captures the person along with the passageway. The captured video is a moving image composed of images captured at a frame rate of, for example, 30 frames / second. Camera 11 outputs the captured video information to video information acquisition unit 21 of control unit 20.

[0014] Under the control of the control unit 20, the recording device 12 records video information obtained by performing a predetermined change process on the video information captured by the camera 11 (hereinafter referred to as changed video information). Specifically, the changed video information includes at least one of video information whose frame rate has been changed by the video information control unit 26 of the control unit 20 to be lower than that at the time of capture, and video information whose amount of information has been compressed by the image compression unit 27 of the control unit 20 compared to that at the time of capture. The recording device 12 is a recording medium such as a hard disk drive (HDD), and may be arranged on a cloud via a network, for example.

[0015] The communication device 13 executes communication with an external device such as a personal computer, a smartphone, or a tablet terminal, via the Internet network or a mobile phone line under the control of the control unit 20. The communication device 13 transmits to the external device at least one of the above-mentioned changed video information, i.e., video information whose frame rate has been changed to a lower value than that at the time of shooting by the video information control unit 26 of the control unit 20, and video information whose amount of information has been compressed by the image compression unit 27 of the control unit 20 compared to that at the time of shooting. The communication device 13 may also transmit the changed video information recorded in the recording device 12 to the external device.

[0016] The control unit 20 is an arithmetic processing device configured with, for example, a CPU (Central Processing Unit) and the like. The control unit 20 includes a video information acquisition unit 21, a recording control unit 22, a communication control unit 23, a motion detection unit 24, a density calculation unit 25, a video information control unit 26, and an image compression unit 27, which are connected to each other via a bus 30. The control unit 20 realizes these configurations and executes these processes by reading and executing a program stored in a storage unit (not shown). The control unit 20 may execute these processes using one CPU, or may include multiple CPUs and execute these processes in parallel using the multiple CPUs.

[0017] The video information acquisition unit 21 acquires video information of the inside of the facility captured by the camera 11. The video information acquisition unit 21 acquires video information captured at the frame rate at the time of shooting. The video information acquisition unit 21 outputs the acquired video information to the video information control unit 26 and the image compression unit 27.

[0018] The recording control unit 22 causes the recording device 12 to record the changed video information. The recording control unit 22 causes the recording device 12 to record, as the changed video information, at least one of the video information whose frame rate has been reduced by the video information control unit 26 and the video information compressed by the image compression unit 27.

[0019] The communication control unit 23 controls the operation of the communication device 13. Specifically, the communication control unit 23 causes the communication device 13 to transmit the above-mentioned changed video information to an external device. In addition, the communication control unit 23 causes the communication device 13 to transmit the changed video information recorded in the recording device 12 to an external device.

[0020] The motion detection unit 24 detects the motion of the subject based on the video information acquired by the video information acquisition unit 21. The motion detection unit 24 analyzes the acquired video information and determines whether or not there is motion of the subject within the shooting range of the camera 11, for example. Specifically, the motion detection unit 24 analyzes changes in the image of the video information and issues an event if there is a change in the position of the subject. Then, if the number of events occurring per unit time is equal to or greater than a predetermined threshold, the motion detection unit 24 determines that there is motion of the subject, and if the number of events occurring per unit time is less than the predetermined threshold, determines that there is no motion of the subject.

[0021] The density calculation unit 25 calculates the density of subjects within the shooting range of the camera 11. Here, the density of subjects refers to the ratio of the area of ​​the subjects to the area of ​​the shooting range of the camera 11. The density calculation unit 25 analyzes the acquired video information, calculates the total area of ​​the subjects within the shooting range, and calculates the ratio (density) of the area of ​​the subjects to the area of ​​the shooting range. The density calculation unit 25 outputs the calculated density to the video information control unit 26 and the image compression unit 27.

[0022] The video information control unit 26 changes the frame rate of the video information according to the situation of the subject, that is, the movement and density of the subject. Specifically, when the density of the subject is equal to or higher than a first predetermined value (e.g., 30%) and the movement of the subject is detected, the video information control unit 26 changes the frame rate of the video information at the time of shooting to a value equal to or higher than a predetermined threshold value from a predetermined time (e.g., 3 seconds) before the detection point. This predetermined threshold value is set to a value that reduces the amount of information of the changed video information after the change while allowing the administrator to distinguish the movement of the subject with a relatively high density even when viewing the changed video information later. In this embodiment, the predetermined threshold value is set to a value lower than the frame rate at the time of shooting, for example, 15 frames / second. This makes it possible to appropriately suppress the amount of information of the video information while sufficiently ensuring the evidential performance of the shot video.

[0023] On the other hand, when the density of the subject is less than a first predetermined value or when the motion of the subject is not detected, the video information control unit 26 changes the frame rate of the video information at the time of shooting to a value less than a predetermined threshold. In this case, the changed video information after the change has a low frame rate, but since the density of the subject in the changed video information is low, even if an accident such as a fall occurs when there are few people moving around in the premises, the cause can be easily investigated because there are few people in the video. Note that the video information control unit 26 may change the frame rate of the changed video information to a different value depending on whether the motion of the subject is not detected or the density of the subject is less than a predetermined value.

[0024] Furthermore, in this embodiment, when the density of subjects is equal to or greater than a second predetermined value (e.g., 80%), the video information control unit 26 changes the frame rate of the video information during shooting to a value equal to or greater than the above-mentioned predetermined threshold value from a predetermined time (e.g., 3 seconds) before the above-mentioned calculation point of the density, regardless of whether or not the movement of the subjects is detected. This second predetermined value is set to a value greater than the above-mentioned first predetermined value. According to this configuration, the video information control unit 26 determines the degree of density of subjects using two thresholds, so that even if, for example, people as subjects are too crowded together and cannot move, it is possible to change the frame rate to an appropriate value, and it is possible to appropriately suppress the amount of information of the video information while sufficiently ensuring the evidential performance of the shot video.

[0025] The image compression unit 27 compresses the video information at the time of shooting according to the situation of the subject, that is, the movement and density of the subject. The image compression unit 27 compresses and reduces the amount of information by reducing the size and color of the video information. When the density of the subject is equal to or greater than a first predetermined value (e.g., 30%) and the movement of the subject is detected, the image compression unit 27 sets the image compression rate of the video information at the time of shooting to be lower than a predetermined threshold value from a predetermined time (e.g., 3 seconds) before the detection point. This predetermined threshold value is set to a value that reduces the amount of information of the changed video information after the change while still allowing the administrator to distinguish the movement of the subject with a relatively high density even when viewing the changed video information later, and is set to, for example, 30% in this embodiment. The higher the image compression rate, the more the original information is compressed and the less the amount of information is. For this reason, in this embodiment, when the density of subjects is equal to or greater than a first predetermined value (e.g., 30%) and subject movement is detected, i.e., when many people are moving, the image compression unit 27 keeps the image compression rate low to appropriately reduce the amount of information in the video information while fully ensuring the evidentiary performance of the captured video.

[0026] On the other hand, when the density of the subject is less than a first predetermined value or when the motion of the subject is not detected, the image compression unit 27 changes the image compression rate of the video information at the time of shooting to a value equal to or greater than a predetermined threshold. Even in this case, the modified video information after the change has a high compression rate, but since the density of the subject in the modified video information is low, even if an accident such as a fall occurs when there are few people moving around on the premises, the cause can be easily investigated because there are few people in the video. Note that the image compression unit 27 may also change the image compression rate of the modified video information to a different value when the motion of the subject is not detected and when the density of the subject is less than a predetermined value.

[0027] Furthermore, in this embodiment, when the density of the subject is equal to or greater than a second predetermined value (e.g., 80%), the image compression unit 27 changes the image compression rate of the video information at the time of shooting to a value equal to or greater than the above-mentioned predetermined threshold value from a predetermined time (e.g., 3 seconds) before the above-mentioned calculation point of the density, regardless of whether or not the movement of the subject is detected. According to this configuration, when the density of the subject is equal to or greater than the second predetermined value, that is, when people are excessively crowded, the image compression unit 27 keeps the image compression rate low regardless of the presence or absence of human movement, thereby appropriately suppressing the amount of information of the video information while sufficiently ensuring the evidential performance of the shot video.

[0028] Next, the operation of the control unit 20 according to the first embodiment will be described. FIG. 2 is a flowchart showing the procedure of the operation of the video processing device according to the first embodiment. FIG. 3 is a diagram showing the relationship between the density and frame rate and the movement time when a subject moves through a passage. In this FIG. 3, the camera 11 is provided in a passage 40 in a facility. A person 50 as a subject enters the passage 40 through a door 41 provided at one end side of the passage 40, and moves through this passage 40 in a direction (one direction) away from the door 41. In FIG. 3, the shooting range 60 is the shooting range of the camera 11. Moreover, in the flowchart of FIG. 2, each process of steps S11 to S21 is periodically and repeatedly executed.

[0029] The control unit 20 acquires video information (step S11). Specifically, the control unit 20 acquires video information of the passage 40 captured by the camera 11 through the video information acquisition unit 21. At this time, the video information acquisition unit 21 acquires video information captured at the frame rate during shooting.

[0030] The control unit 20 detects the motion of the subject (step S12). Specifically, the control unit 20 causes the motion detection unit 24 to analyze the video information acquired by the video information acquisition unit 21 during shooting, and detects whether or not the subject is moving.

[0031] The control unit 20 calculates the density of the subjects (step S13). Specifically, the control unit 20 calculates the density of people 50 as subjects within the shooting range 60 of the camera 11 by the density calculation unit 25. In this case, the density calculation unit 25 analyzes the acquired video information at the time of shooting, calculates the total area of ​​the multiple people 50 within the shooting range 60, and calculates the ratio of the area of ​​the people 50 to the area of ​​the shooting range 60.

[0032] Next, the control unit 20 judges whether or not the density of the subject is equal to or greater than a first predetermined value (step S14). Specifically, the control unit 20 judges whether or not the density of the subject calculated by the density calculation unit 25 is equal to or greater than a first predetermined value (e.g., 30%). In this judgment, if the density of the subject is not equal to or greater than the first predetermined value, that is, is less than the first predetermined value (step S14; No), the control unit 20 shifts the process to step S19.

[0033] On the other hand, if the subject density is equal to or greater than the first predetermined value in this determination (step S14; Yes), the control unit 20 determines whether the subject density is equal to or greater than a second predetermined value (step S15). Specifically, the control unit 20 determines whether the subject density calculated by the density calculation unit 25 is equal to or greater than a second predetermined value (e.g., 80%) that is set to a value greater than the above-mentioned first predetermined value. If the subject density is equal to or greater than the second predetermined value in this determination (step S15; Yes), the control unit 20 transitions the process to step S17.

[0034] On the other hand, in this determination, if the density of the subject is not equal to or greater than the second predetermined value, i.e., is less than the second predetermined value (step S15; No), the control unit 20 determines whether or not the subject is moving (step S16). Specifically, the control unit 20 analyzes the image change of the video information at the time of shooting by the motion detection unit 24, and issues an event if there is a change in the position of the person 50 as the subject. Then, the motion detection unit 24 determines that the subject is moving if the number of events occurring per unit time is equal to or greater than a predetermined threshold, and determines that the subject is not moving if it is less than the predetermined threshold. In this determination, if the subject is not moving (step S16; No), the control unit 20 shifts the process to step S19.

[0035] On the other hand, if the subject is moving in this determination (step S16; Yes), the control unit 20 changes the frame rate of the video information to a value equal to or higher than a predetermined threshold (step S17). Specifically, if the density of the subject is equal to or higher than a first predetermined value (e.g., 30%) and the subject's movement is detected by the video information control unit 26, or if the density of the subject is equal to or higher than a second predetermined value (e.g., 80%), the control unit 20 changes the frame rate of the video information from a predetermined time (e.g., 3 seconds) before the detection or calculation time to a value lower than the frame rate at the time of shooting and equal to or higher than a predetermined threshold, as shown in FIG. 3. In FIG. 3, an example is shown in which the frame rate at the time of recording is increased (changed) in proportion to the movement time (human density), but this is not limited thereto, and the frame rate may be increased (changed) in a stepwise manner.

[0036] Next, the control unit 20 sets the image compression rate of the video information lower than a predetermined threshold value (step S18). Specifically, when the image compression unit 27 detects that the density of the subject is equal to or higher than a first predetermined value (e.g., 30%) and the subject's movement, or when the density of the subject is equal to or higher than a second predetermined value (e.g., 80%), the control unit 20 sets the image compression rate of the video information lower than the predetermined threshold value from a predetermined time (e.g., 3 seconds) before the detection or calculation point. The control unit 20 shifts the process to step S21.

[0037] Next, if the density of the subjects is not equal to or greater than the first predetermined value, i.e., is less than the first predetermined value (step S14; No), or if there is no movement of the subjects (step S16; No), the control unit 20 reduces the frame rate of the video information to less than a predetermined threshold (step S19). Specifically, if the density of the subjects is less than the first predetermined value (e.g., 30%) or no movement of the subjects is detected, the control unit 20 changes the frame rate of the video information to a value less than a predetermined threshold, which is lower than the frame rate at the time of shooting, as shown in FIG. 3, by the video information control unit 26.

[0038] Next, the control unit 20 sets the image compression rate of the video information to be higher than a predetermined threshold value (step S19). Specifically, when the density of the subject is less than a first predetermined value (e.g., 30%) or no subject movement is detected by the image compression unit 27, the control unit 20 changes the image compression rate of the video information to a value equal to or higher than the predetermined threshold value. The control unit 20 shifts the process to step S21.

[0039] Next, the control unit 20 records the changed video information in the recording device 12 (step S21). Specifically, the control unit 20 causes the recording control unit 22 to record the changed video information with the changed frame rate and image compression rate in the recording device 12. In this configuration, the frame rate and image compression rate of the video information are changed according to the density of the subjects in the facility and the presence or absence of movement, so that it is possible to appropriately suppress an increase in the amount of information (recording capacity) of the changed video information recorded in the recording device 12. Here, if the density of the subjects is less than a first predetermined value (e.g., 30%) or no movement of the subjects is detected, the frame rate of the video information is changed to a value less than a predetermined threshold, and the image compression rate is changed to a value equal to or greater than a predetermined threshold. In this case, the changed video information recorded in the recording device 12 becomes a video with a low frame rate and a high compression rate, but since the density of the subjects in this changed video information is low, even if an accident such as a fall occurs when there are few people moving around in the facility, it is sufficiently possible to investigate the cause because there are few people in the video.

[0040] Next, the control unit 20 transmits the changed video information to the external device (step S22). Specifically, the control unit 20 causes the communication control unit 23 to transmit the changed video information with the changed frame rate and image compression rate to the external device via the communication device 13. This completes the series of processes. Even in this configuration, the frame rate and image compression rate of the video information are changed according to the density of subjects in the facility and the presence or absence of motion, so that an increase in the amount of information (transmission amount) of the changed video information transmitted to the external device can be appropriately suppressed. Here, if the density of subjects is less than a first predetermined value (e.g., 30%) or no motion of subjects is detected, the frame rate of the video information is changed to a value less than a predetermined threshold, and the image compression rate is changed to a value equal to or greater than a predetermined threshold. In this case, the changed video information transmitted becomes a video with a low frame rate and a high compression rate, but since the density of subjects in this changed video information is low, even if an accident such as a fall occurs when there are few people moving around in the facility, the cause can be easily traced because there are few people in the video.

[0041] Next, a modified example of this embodiment will be described. In this embodiment, the case where the subject moves in one direction along the passage 40 has been described, but a case where a group of subjects move in opposite directions along the passage may also be used. Fig. 4 is a diagram showing the relationship between the density of all subjects when a plurality of subjects move along a passage, the frame rate, and the movement time. Fig. 5 is a diagram showing another example of the relationship between the density of all subjects in Fig. 4 and the movement time.

[0042] In FIG. 4, there are two groups of people 50A as subject A and people 50B as subject B, and these groups of people 50A and 50B move in opposite directions from both ends of the passage toward the shooting range 60 of the camera 11. In this case, two groups of people 50A and 50B are present within the shooting range 60 of the camera 11. Therefore, the density calculation unit 25 calculates the overall density of the subjects based on the average value of the densities of the groups of people 50A as subject A and people 50B as subject B. Specifically, the density calculation unit 25 calculates the density of the group of subjects A and the density of the group of subjects B, and calculates the overall density of the subjects based on the average value of the densities of each group. With this configuration, the density of the subjects can be easily calculated regardless of the direction of movement of the subjects within the shooting range 60, and the frame rate and image compression rate of the video information can be appropriately changed based on the calculated density.

[0043] Furthermore, according to this configuration, even if the change in density of each of subjects A and B is not symmetrical as shown in Figure 5, it is possible to calculate the density of the entire subject, and therefore the frame rate and image compression rate of the video information can be appropriately changed based on this calculated density.

[0044] [Second embodiment] FIG. 6 is a block diagram showing an example of the configuration of a camera system according to a second embodiment. FIG. 7 is a diagram showing the relationship between the density of the imaging range of each camera and the frame rate and the movement time when a subject moves through a passage. The same components as those in the camera system 10 according to the first embodiment are given the same reference numerals and will not be described. As shown in FIG. 6, the camera system 10A includes a first camera (camera device) 11A, a second camera (camera device) 11B, a recording device (recording unit) 12, a communication device (communication unit) 13, and a control unit (image processing device) 20A. In this second embodiment, the first camera 11A and the second camera 11B are arranged at different positions in the passage 40 as shown in FIG. 7, and each captures the passage 40. For this reason, the first imaging range 60A of the first camera 11A and the second imaging range 60B of the second camera 11B are set at different positions so as not to overlap each other. Note that the first camera 11A and the second camera 11B are examples of multiple cameras, so a configuration in which three or more cameras are arranged may be used.

[0045] The control unit 20A has a configuration similar to that of the control unit 20 described above, and includes a video information acquisition unit 21A, a recording control unit 22, a communication control unit 23, a motion detection unit 24, a density calculation unit 25, a video information control unit 26A, and an image compression unit 27.

[0046] The video information acquisition unit 21A acquires the first video information captured by the first camera 11A and the second video information captured by the second camera 11B. That is, the video information acquisition unit 21A acquires the first video information and the second video information captured from a plurality of different directions of the passage 40. The video information acquisition unit 21A may be configured to acquire the first video information and the second video information in parallel, or may be configured to be physically divided into a plurality of pieces.

[0047] The video information control unit 26A changes the frame rate of the first video information and the second video information, i.e., the frame rate at which the first video information and the second video information captured by the first camera 11A and the second camera 11B, respectively, are recorded in the recording device 13, depending on the situation of the subject, i.e., the movement and density of the person 50 as the subject. In the example of FIG. 7, the person 50 as the subject enters the passage 40 through the door 41 provided at one end side of the passage 40, and moves through the passage 40 in a direction (one direction) away from the door 41. In this case, when the person 50 as the subject enters the passage 40 through the door 41, the density of the first shooting range 60A increases first, and after the density of the first shooting range 60A decreases, the density of the second shooting range 60B increases.

[0048] For this reason, the video information control unit 26A first sets the frame rate of the first video information high and sets the frame rate of the second video information low according to the movement and density of the people 50 as subjects, as shown in Fig. 7. Then, with the movement of the people 50 as subjects, the video information control unit 26A proportionally lowers the frame rate of the first video information and proportionally increases the frame rate of the second video information.

[0049] According to this configuration, the total recording capacity or the total transmission amount of the first video information and the second video information as the changed video information can be kept almost constant, and the recording capacity or the transmission amount can be stabilized. The example in FIG. 7 is an example of the movement of a plurality of groups, and can also be applied to the case where a plurality of groups are continuously moving. In this case, when the video information control unit 26A increases the frame rate of one of the video information with high density in each shooting range 60A, 60B, it may decrease the frame rate of the other video information with relatively low density in conjunction with this.

[0050] As described above, the control unit 20 according to this embodiment includes an image information acquisition unit 21 that acquires image information of the inside of a facility captured by a camera 11 installed in the facility, a motion detection unit 24 that detects the movement of subjects in the facility based on the image information, a density calculation unit 25 that calculates the density of subjects in the shooting range 60 of the camera 11, an image information control unit 26 that changes the frame rate of the image information according to the movement and density of the subjects, a recording control unit 22 that causes the recording device 12 to record the changed image information with the changed frame rate, and a communication control unit 23 that causes the communication device 13 to transmit the changed image information to an external device. With this configuration, it is possible to appropriately suppress an increase in the amount of transmitted image information or the recording capacity according to the situation of the subjects in the facility.

[0051] In the control unit 20 according to the present embodiment, when the density of the subject is equal to or greater than a first predetermined value and the motion of the subject is detected, the image information control unit 26 changes the frame rate of the image information to a value equal to or greater than a predetermined threshold value from a predetermined time before the detection time. With this configuration, it is possible to adequately ensure the evidential performance of the captured image while appropriately suppressing an increase in the amount of information of the image information. Furthermore, when the density of the subject is less than a first predetermined value or the motion of the subject is not detected, the image information control unit 26 changes the frame rate of the image information to a value less than a predetermined threshold value. With this configuration, the changed image information after the change has a low frame rate, but since the density of the subject in the changed image information is low, for example, even if an accident such as a fall occurs when there are few people moving around on the premises, the cause can be easily traced because there are few people in the image.

[0052] The control unit 20 according to the present embodiment further includes an image compression unit 27 that, when the density of subjects is equal to or greater than a first predetermined value and the motion of the subjects is detected, sets the image compression rate of the video information to be lower than a predetermined threshold value from a predetermined time before the detection point. With this configuration, it is possible to adequately ensure the evidential performance of the captured video while appropriately suppressing an increase in the amount of information of the video information.

[0053] In the control unit 20 according to the present embodiment, when the density of subjects is equal to or greater than a second predetermined value set to a value greater than the first predetermined value, regardless of whether or not the motion of the subjects is detected, the video information control unit 26 changes the frame rate of the video information to a value equal to or greater than a predetermined threshold value from a predetermined time before the calculation of the density. According to this configuration, since the video information control unit 26 determines the magnitude of the density of subjects using two thresholds, it is possible to change to an appropriate frame rate even when, for example, subjects are too crowded together to move, and it is possible to appropriately suppress the amount of information of the video information while sufficiently ensuring the evidential performance of the captured video.

[0054] In the control unit 20 according to this embodiment, when a group of subjects exists within the shooting range 60 of the camera 11, the density calculation unit 25 calculates the overall density of the subjects based on the average density of the group of each subject. With this configuration, the density of the subjects can be easily calculated regardless of the direction of movement of the subjects within the shooting range 60, and the frame rate and image compression rate of the video information can be appropriately changed based on this calculated density.

[0055] In the control unit 20A according to the present embodiment, the video information acquisition unit 21A is configured to acquire first video information and second video information captured from a plurality of different directions within the facility, and the video information control unit 26A increases the frame rate of one of the first video information and the second video information and decreases the frame rate of the other of the first video information and the second video information according to the movement and density of the subjects. With this configuration, the total recording capacity or the total transmission amount of the first video information and the second video information can be kept almost constant, and the recording capacity or the transmission amount can be stabilized.

[0056] Although the embodiment of the present invention has been described above, the embodiment is not limited to the contents of this embodiment. The above-mentioned components include those that a person skilled in the art can easily imagine, those that are substantially the same, and those that are within the so-called equivalent range. Furthermore, the above-mentioned components can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the gist of the above-mentioned embodiment.

[0057] In the present embodiment, the configuration for changing the frame rate of the video information has been described, but the present invention is not limited to this, and the resolution of the video information may be changed. The resolution refers to the density of pixels or dots that constitute an image, and the higher the resolution, the larger the amount of information in the video information. For example, the camera 11 outputs video information captured at a high resolution such as full HD (High Definition) or 4K. The video information control unit 26, 26A changes the resolution of the video information according to the movement and density of the subject. Specifically, when there is no movement of the subject or the density is less than a predetermined value, the video information control unit 26, 26A changes the resolution of the video information to a value lower than that at the time of shooting (for example, SD (Standard Definition)), and records the changed video information in the recording device 13 or transmits it to the outside. Also, when there is movement of the subject and the density is equal to or greater than a predetermined value, the video information control unit 26, 26A records or transmits the resolution of the video information at the same resolution as the high resolution at the time of shooting, or at a slightly lower resolution. According to this configuration, the video information control units 26 and 26A change the resolution of the video information in accordance with the movement and density of the subjects, thereby making it possible to appropriately suppress an increase in the amount of video information to be transmitted or the recording capacity.

[0058] Moreover, each component of the control unit (video processing device) 20, 20A according to this embodiment is functionally conceptual, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of each device is not limited to that shown in the figure, and all or part of each device may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device. The configuration of the control unit 20, 20A is realized, for example, as software by a program loaded into a memory. In the above embodiment, these functional blocks have been described as being realized by the cooperation of these hardware or software. That is, these functional blocks can be realized in various forms by only hardware, only software, or a combination thereof.

[0059] In addition, in the present embodiment, a station premises is exemplified as a specific facility in which the camera system is installed, but this facility may include outdoor facilities such as an amusement park, a zoo, etc. Furthermore, the camera system may be installed not only in the above-mentioned facilities, but also outdoors in tourist spots, downtown areas, etc. [Explanation of symbols]

[0060] 10, 10A Camera System 11 Camera (camera equipment) 11A 1st camera (camera device) 11B Second camera (camera device) 12 Recording device (recording section) 13 Communication device (communication section) 20, 20A Control section (image processing device) 21, 21A Video information acquisition section 24. Motion detection unit 25 Density calculation part 26, 26A Video information control section 27 Image Compression Section 50, 50A, 50B People (subject) 60 Shooting range 60A First shooting range (shooting range) 60B Second shooting range (shooting range)

Claims

1. an image information acquisition unit that acquires image information of a predetermined facility or an outdoor area captured by a camera device installed in the facility or an outdoor area; a motion detection unit that detects a motion of a subject inside or outside the facility based on the video information; a density calculation unit for calculating a density of the object; an image information control unit that changes at least one of a frame rate and a resolution of the image information according to a state of the subject including a movement and a density of the subject; At least one of a recording control unit for causing a recording unit to record the changed video information and a communication control unit for causing the changed video information to be transmitted to an external device; A video processing device comprising:

2. 2. The video processing device of claim 1, wherein the video information control unit, when the density of the subject is equal to or greater than a predetermined value and movement of the subject is detected, changes at least one of the frame rate and the resolution of the video information to a value equal to or greater than a predetermined threshold value from a predetermined time before the detection point, and when the density of the subject is less than the predetermined value or movement of the subject is not detected, changes at least one of the frame rate and the resolution of the video information to a value less than the predetermined threshold value.

3. 3. The video processing device according to claim 1, further comprising an image compression unit that, when the density of the subject is equal to or greater than a predetermined value and movement of the subject is detected, sets the image compression rate of the video information to be lower than a predetermined threshold value from a predetermined time before the detection point.

4. 3. The image processing device of claim 2, wherein the image information control unit changes at least one of the frame rate and the resolution of the image information to a value equal to or greater than a predetermined threshold value from a predetermined time before the calculation of the density, regardless of whether or not movement of the subject is detected, when the density of the subject is equal to or greater than a second predetermined value set to a value greater than the first predetermined value.

5. A camera system including a camera device installed in a predetermined facility or outdoors and a video processing device that processes video information captured by the camera device, The image processing device includes an image information acquisition unit that acquires image information of the inside or outside of the facility captured by the camera device; a motion detection unit that detects a motion of a subject inside or outside the facility based on the video information; a density calculation unit for calculating a density of the object; an image information control unit that changes at least one of a frame rate and a resolution of the image information according to a state of the subject including a movement and a density of the subject; At least one of a recording control unit for causing a recording unit to record the changed video information and a communication control unit for causing the changed video information to be transmitted to an external device; A camera system comprising:

Citation Information

Patent Citations

  • Imaging apparatus and network image pick-up system

    JP2006279464A