Video person management device and switcher equipped therewith, video person management method and video person management program

Abstract

This invention provides a video person management device, a video person management method, and a video person management program that can appropriately notify individuals who are being filmed. [Solution] The video person management device 10 is a device connected to a corresponding device that corresponds to a specific person included in video footage of a person being filmed by a camera, and comprises a video acquisition unit 11, a person recognition unit 12, a person determination unit 13, and a signal transmission unit 14. The video acquisition unit 11 acquires video footage captured by cameras C1 to C3. The person recognition unit 12 recognizes people included in the video. The person determination unit 13 determines whether the person recognized by the person recognition unit 12 meets predetermined conditions. The signal transmission unit 14 transmits signals to pin microphones M1 to M3 that correspond to the specific person determined by the person determination unit 13 to meet predetermined conditions.

Description

Technical Field

[0001] The present disclosure relates to, for example, a video person management device that notifies a person included in a captured video, a switcher equipped with the same, a video person management method, and a video person management program.

Background Art

[0002] In recent years, in a photography studio, a conference hall, an event venue, a sports facility, etc., a photographing system that photographs while switching videos photographed using a plurality of cameras using a switcher has been used. For example, Patent Document 1 discloses a plurality of cameras capable of adjusting an imaging direction, an image data extraction unit that extracts and outputs predetermined image data from image data obtained by imaging with the plurality of cameras, and an imaging direction instruction unit that instructs an imaging direction. When imaging in another direction is instructed by the imaging direction instruction unit while the image data obtained by imaging with the first camera facing in one direction is being extracted by the image data extraction unit, the second camera different from the first camera is in a state of facing in another direction. And a control unit that controls so that the image data obtained by imaging with the second camera is extracted by the image data extraction unit.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the above conventional camera device has the following problems. In other words, in the camera device disclosed in the above publication, in order to avoid displaying images captured while the orientation of the camera is changing, if the second camera, which is different from the first camera, is not facing in another direction, the second camera is controlled to face that other direction. Then, with the second camera facing that other direction, the image data retrieval unit is controlled to retrieve the image data captured by the second camera.

[0005] However, with this configuration, it was difficult to inform the person being filmed that they were currently being filmed, that they were scheduled to be selected for filming next, or that they were in a state unsuitable for filming. Furthermore, while it was possible to indicate which camera's footage was selected by illuminating a tally light on each camera, it was difficult for the person being filmed to accurately recognize whether they were currently being filmed. Moreover, in such cases, the person being filmed may not even notice the camera's tally light.

[0006] Therefore, it was difficult to directly inform the person being filmed that they were currently in the video, that they were scheduled to be selected for future video, or that they were unsuitable for selected video. The objective of this disclosure is to provide a video person management device capable of appropriately notifying individuals who are being filmed, a switcher equipped with the same, a video person management method, and a video person management program. [Means for solving the problem]

[0007] The video person management device according to this disclosure is a video person management device connected to a corresponding device that corresponds to a specific person included in video footage of a person being filmed by a camera, and comprises a video acquisition unit, a person recognition unit, a person determination unit, and a signal transmission unit. The video acquisition unit acquires video footage captured by the camera. The person recognition unit recognizes people included in the video. The person determination unit determines whether the person recognized by the person recognition unit meets predetermined conditions. The signal transmission unit transmits a signal to the corresponding device that corresponds to a specific person that the person determination unit has determined to meet predetermined conditions. [Effects of the Invention]

[0008] According to the video person management device disclosed herein, it is possible to appropriately notify the person being filmed. [Brief explanation of the drawing]

[0009] [Figure 1] A schematic diagram showing a state in which a person included in a video managed by a video person management device according to one embodiment of this disclosure is captured by multiple cameras. [Figure 2] A block diagram showing the configuration of a video person management device that manages people included in the video shown in Figure 1. [Figure 3] A block diagram showing a modified example of the video person management device in Figure 1. [Figure 4] A block diagram showing another modified example of the video person management device shown in Figure 1. [Figure 5] A block diagram showing yet another modified example of the video person management device shown in Figure 1. [Figure 6] A flowchart showing the processing flow of a video person management method according to one embodiment of this disclosure. [Figure 7] A block diagram showing the configuration of a switcher including a video person management device according to another embodiment of the present disclosure. [Figure 8] This is a conceptual diagram showing an example of displaying text information in the video information display area of ​​a multiview image that displays multiple videos selected by the switcher in Figure 7. [Figure 9]This is a conceptual diagram showing an example of displaying text information near the person's area in a multiview image that displays multiple videos selected by the switcher in Figure 7. [Figure 10A] This is a conceptual diagram showing an example of a multiview image displaying multiple videos selected by the switcher in Figure 7, where the face portion of the person's area in the video is enclosed in a frame. [Figure 10B] A conceptual diagram showing an example of a multiview image displaying multiple videos selected by the switcher in Figure 7, where the entire area of ​​the person in each video is enclosed in a frame. [Figure 11] This is a conceptual diagram showing an example in a multiview image displaying multiple videos selected by the switcher in Figure 7, where a desired video is superimposed on the face portion of the person's area in the video. [Figure 12] A conceptual diagram showing an example of displaying a desired video overlaid on all or part of a video in a multiview image that displays multiple videos selected by the switcher in Figure 7. [Figure 13A] A schematic diagram showing a state in which a person included in a video managed by a video person management device according to yet another embodiment of this disclosure is captured by a single camera. [Figure 13B] A conceptual diagram illustrating an example of receiving the video displayed in Figure 13A, extracting multiple sections, and acquiring multiple video images. [Modes for carrying out the invention]

[0010] The embodiments will be described in detail below, with reference to the drawings as appropriate. However, unnecessary details may be omitted. For example, detailed explanations of already well-known matters and redundant explanations of substantially identical configurations may be omitted. This is to avoid the following explanation becoming unnecessarily verbose and to facilitate understanding for those skilled in the art. The applicant provides the accompanying drawings and the following description so that a person skilled in the art can fully understand the disclosure, and not intends to limit the subject matter described in the claims.

[0011] (Embodiment 1) The video person management device 10 according to an embodiment of the present disclosure will be described as follows with reference to FIGS. 1 to 6. (1) Configuration of the video person management device 10 The video person management device 10 according to the present embodiment, for example, as shown in FIG. 1, for a person included in a video captured using a plurality of cameras C1, C2, C3, notifies the person that the person is included in the currently selected video by a switcher or the like, will be included in the videos to be selected hereafter, or is in a state (such as a side view) that is not suitable as the selected video.

[0012] Specifically, for example, devices capable of outputting audio information are attached to the lapel microphones M1, M2, M3. To notify a person P1 included in the shooting area AREA1 captured by the camera C1 that the person is included in the currently selected video, the video person management device 10 transmits a signal to output audio information from the lapel microphone M1 held by the person P1.

[0013] At this time, in addition to lighting the tally lamp of the camera C1, or instead of lighting the tally lamp, the audio output from the lapel microphone M1 may be a warning sound such as a beep, or may be audio information such as "You are currently being shown". Also, for example, to notify a person P2 included in the shooting area AREA2 captured by the camera C2 that the person will be included in the videos to be selected hereafter, the video person management device 10 transmits a signal to output audio information from the lapel microphone M1 held by the person P2.

[0014] At this time, since the person P2 is in a state of looking away, the audio output from the lapel microphone M2 may be a warning sound such as a beep, or may be audio information such as "You will be shown next", "Face forward", etc. Also, the specific switching timing may be notified, such as "You will be shown next in 5 seconds", or the switching timing may be audio information that counts down as "5, 4, 3, 2, 1", etc.

[0015] Similarly, for person P3 included in the shooting area AREA2 captured by camera C2, the video person management device 10 transmits a signal to output audio information from the lavalier microphone M1 held by person P3 in order to notify them that they are included in the video to be selected next. At this time, since person P3 is facing forward, the sound output from lavalier microphone M3 may be a warning sound such as a beep, or it may be voice information such as "Next, on screen." Also, at this time, the target to which the voice information is output may not be the lavalier microphones M1, M2, and M3 themselves, but rather an in-ear monitor or similar device worn by person P1, P2, and P3.

[0016] In addition, similarly to the above, at least one of the people P1, P2, and P3 included in the shooting area AREA3 captured by camera C3 may be notified that they are included in the following subsequent video selections. As shown in Figure 2, the video person management device 10 of this embodiment includes a video acquisition unit 11, a person recognition unit 12, a person determination unit 13, and a signal transmission unit 14.

[0017] The video acquisition unit 11 is connected to three cameras C1, C2, and C3 installed at different locations as shown in Figure 1, and acquires video footage captured by each camera C1, C2, and C3, as shown in Figure 2. As shown in Figure 2, the person recognition unit 12 is connected to the video acquisition unit 11 and recognizes people included in the video acquired by the video acquisition unit 11.

[0018] The person recognition unit 12 may, for example, perform facial recognition on people P1, P2, and P3 included in the video to recognize people. As shown in Figure 2, the person determination unit 13 determines whether the person recognized by the person recognition unit 12 meets predetermined conditions. Here, the specified conditions refer to, for example, the person being in the video that is scheduled to be switched to next, when the next video to be switched to is set in PVW (Preview). Alternatively, if a specified rule is set, for example, when switching is done automatically every 30 seconds or in the case of random switching, the person being in the video that is scheduled to be switched to next or later.

[0019] Furthermore, PVW (Preview) allows you to pre-set the video to be output after the switch. To use PVW, for example, you can set the video you want to output now in PGM (Program) (the video output to the main line), set the video you plan to switch to next in PVW, and then set effects such as cross dissolve to gradually blend the videos when switching. Of course, you can also switch to the video you plan to switch to next without any effects.

[0020] Furthermore, the video that is scheduled to be switched to next is, for example, a video that is automatically switched to at predetermined intervals (for example, 30 seconds) according to a predetermined rule. Furthermore, the specified conditions may include, for example, a person who is unsuitable for the currently selected video (e.g., looking away, dozing off). Alternatively, the person may be unsuitable for the video that the switcher is scheduled to switch to next.

[0021] The person recognition unit 13 can, for example, detect each organ (eyes, nose, mouth, etc.) included in a person's face and determine whether the face is facing forward, turned to the side, or whether the person is dozing off (eyes closed). As shown in Figure 2, the signal transmission unit 14 is connected to the person detection unit 13 and the lapel microphones M1, M2, and M3 held by the people P1, P2, and P3 (see Figure 1) included in each video. The signal transmission unit 14 transmits signals to the lapel microphones M1, M2, and M3 corresponding to specific people that the person detection unit 13 has determined to meet predetermined conditions.

[0022] Specifically, when the person detection unit 13 determines that a predetermined condition is met, the signal transmission unit 14 transmits a signal to output audio information from these pin microphones M1, M2, and M3, for example, as shown in Figure 2. At this time, the audio information output from the lavalier microphones M1, M2, and M3 may be, for example, audio information such as "You are on screen now," "You will be on screen next," "Look straight ahead," or "Don't look away," depending on the situation of a specific person in the video, or it may be a warning sound such as a beep.

[0023] This allows individuals P1, P2, and P3, who are wearing lavalier microphones M1, M2, and M3 that output audio information, to easily recognize that they are appearing in the currently selected video, that they will appear in subsequent videos, or that they are looking away and therefore unsuitable for the selected video. Furthermore, for example, if the pin microphones M1a, M2b, and M3c, which are associated with a specific person, are equipped with a device capable of outputting vibration, the signal transmission unit 14 may, when the person detection unit 13 determines that a predetermined condition is met, transmit a signal to vibrate these pin microphones M1a, M2b, and M3c, as shown in Figure 3.

[0024] In this case, the object to be vibrated is not the lavalier microphones M1a, M2b, and M3c themselves, but rather, for example, a microphone controller worn on the waist of person P1, P2, and P3, or the chair on which person P1, P2, and P3 are sitting. As a result, individuals P1, P2, and P3, whose corresponding devices vibrate, can easily recognize that they are appearing in the currently selected video, that they will appear in subsequent videos, or that they are looking away and therefore unsuitable for the selected video.

[0025] Furthermore, if the person detection unit 13 determines that a predetermined condition is met, the signal transmission unit 14 may transmit a signal to cause spotlights L1, L2, and L3, which are positioned to illuminate a specific person, to light up, for example, as shown in Figure 4. Furthermore, the lights that receive the signal to emit light are not limited to the spotlights L1, L2, and L3 positioned to illuminate each person P1, P2, and P3. They may also be devices attached to the lavalier microphones M1, M2, and M3 held by each person P1, P2, and P3, or mobile devices.

[0026] This allows individuals P1, P2, and P3, whose lights are on, to easily recognize that they are in the currently selected video, will be in subsequent videos, or are looking away and unsuitable for the selected video. Alternatively, if the person detection unit 13 determines that a predetermined condition is met, the signal transmission unit 14 may transmit a signal to display predetermined information on the display screens of smartphones SP1, SP2, and SP3 held by a specific person, for example, as shown in Figure 5.

[0027] Furthermore, the device that receives the signal to display predetermined information on the display screen is not limited to a smartphone; it may also be a tablet device, a PC (Personal Computer), or the like, installed at a location corresponding to each person P1, P2, and P3. As a result, individuals P1, P2, and P3, whose information is displayed on the corresponding device's screen, can easily recognize that they are appearing in the currently selected video, that they will appear in subsequent videos, or that they are looking away and therefore unsuitable for the selected video.

[0028] <Video Person Management Methods> The video person management device 10 of this embodiment has the configuration described above, and the video person management method is carried out according to the flowchart shown in Figure 6. In other words, the video person management method of this embodiment is a video person management method using a video person management device 10 connected to a corresponding device that corresponds to a specific person included in the video of people P1, P2, P3, which are the subjects of filming, filmed by cameras C1, C2, C3, and in step S11, the video acquisition unit 11 of the video person management device 10 acquires the video filmed by cameras C1, C2, C3 (video acquisition step).

[0029] Next, in step S12, the person recognition unit 12 of the video person management device 10 recognizes the people P1, P2, and P3 included in the video, for example, using facial recognition or the like (person recognition step). Next, in step S13, the person determination unit 13 of the video person management device 10 determines whether the people P1, P2, and P3 recognized in the person recognition step meet predetermined conditions (person determination step).

[0030] If the person detection unit 13 determines that the people P1, P2, and P3 in the video meet the predetermined conditions, the process proceeds to step S14. On the other hand, if the person detection unit 13 determines that the people P1, P2, and P3 in the video do not meet the predetermined conditions, the process terminates. Next, in step S14, the signal transmission unit 14 of the video person management device 10 transmits a signal to the corresponding device (signal transmission step) that corresponds to the specific person P1, P2, P3 that was determined to meet predetermined conditions in the person determination step, and then terminates the process.

[0031] <Key Features> The video person management device 10 of this embodiment is a device connected to a corresponding device that corresponds to a specific person included in video footage of a person being filmed by a camera, and as shown in Figure 2, comprises a video acquisition unit 11, a person recognition unit 12, a person determination unit 13, and a signal transmission unit 14. The video acquisition unit 11 acquires video footage captured by cameras C1 to C3. The person recognition unit 12 recognizes people included in the video. The person determination unit 13 determines whether the person recognized by the person recognition unit 12 meets predetermined conditions. The signal transmission unit 14 transmits signals to pin microphones M1 to M3 that correspond to the specific person determined by the person determination unit 13 to meet the predetermined conditions.

[0032] This allows, for example, individuals P1, P2, and P3, who are wearing lavalier microphones M1, M2, and M3 that output audio information, to easily recognize that they are appearing in the currently selected video, that they will appear in subsequent videos, or that they are looking away and are not suitable for the selected video. Furthermore, for example, when the corresponding device vibrates, individuals P1, P2, and P3 can easily recognize that they are appearing in the currently selected video, that they will appear in subsequent videos, or that they are looking away and therefore unsuitable for the selected video.

[0033] Furthermore, for example, individuals P1, P2, and P3 corresponding to a lit light can easily recognize that they are appearing in the currently selected video, that they will appear in subsequent videos, or that they are looking away and therefore unsuitable for the selected video. Furthermore, for example, when predetermined information is displayed on the screens of smartphones SP1, SP2, SP3, each person P1, P2, and P3, they can easily recognize that they are appearing in the currently selected video, that they will appear in subsequent videos, or that they are looking away and are not suitable for the selected video.

[0034] As a result, it is possible to appropriately notify individuals who are being filmed, such as individuals currently included in the selected footage or individuals who are scheduled to be included in subsequent footage. (Embodiment 2) A switcher (video and person management device) 110 according to another embodiment of this disclosure will be described below with reference to Figures 7 to 12.

[0035] The switcher (video person management device) 110 of this embodiment differs from Embodiment 1 in that the functions of the video person management device 10 described in Embodiment 1 are incorporated within the switcher 110. Therefore, components having the same function as those described in Embodiment 1 above are denoted by the same reference numerals, and their detailed descriptions are omitted.

[0036] As shown in Figure 7, the switcher 110 of this embodiment includes a video acquisition unit 11, a person recognition unit 12, a person determination unit 13, a signal transmission unit 14, a display control unit 115, a display unit 116, and a video switching unit 117. The video acquisition unit 11 is connected to three cameras C1, C2, and C3 installed at different locations, and acquires video footage captured by each camera C1, C2, and C3, as shown in Figure 7.

[0037] As shown in Figure 7, the person recognition unit 12 is connected to the video acquisition unit 11 and recognizes people included in the video acquired by the video acquisition unit 11. As shown in Figure 7, the person determination unit 13 determines whether the person recognized by the person recognition unit 12 meets predetermined conditions. As shown in Figure 7, the signal transmission unit 14 is connected to the person detection unit 13 and the smartphones SP1, SP2, SP3 held by the people P1, P2, and P3 included in each video. The signal transmission unit 14 transmits a signal to the smartphones SP1, SP2, SP3 corresponding to the specific person determined by the person detection unit 13 to meet predetermined conditions.

[0038] The signals transmitted by the signal transmission unit 14 to the smartphones SP1, SP2, and SP3 may be light emission signals or display signals such as character information, as described in Embodiment 1 above. Furthermore, the corresponding devices for each person P1, P2, and P3 are not limited to smartphones SP1, SP2, and SP3, but may also be pin microphones (audio output section) M1, M2, and M3, pin microphones (vibration application section) M1a, M2b, and M3c, and spotlights (light emission section) L1, L2, and L3 as described in Embodiment 1 above.

[0039] The display control unit 115 controls the display unit 116 to display the video footage captured by the multiple cameras C1, C2, and C3 to the user operating the switcher 110. The display unit 116 displays the images captured by the multiple cameras C1, C2, and C3 on a multi-view screen (see, for example, Figure 8).

[0040] The video switching unit 117, for example, switches which of the multiple videos captured by multiple cameras C1, C2, and C3 is output and displayed, based on the operation of the user of the switcher 110. In the switcher 110 of this embodiment, as shown in Figure 8, the display control unit 115 displays the images captured by cameras C1, C2, and C3 on screens V1, V2, V3, V4, and V3 of the display screen of the display unit 116, which is a multiview screen including screens V1, V2, V3, V4, and V5 of multiple cameras. The display control unit 115 then displays the PVW (Preview) screen (the image to be switched to next) and the PGM (Program) screen (the image to be output to the main line) on screens V4 and V5, respectively.

[0041] Furthermore, in the switcher 110, the display control unit 115 displays video evaluation values ​​(98, 50, 77 in Figure 8) for each video in the information display fields V1a, V2a, V3a located at the bottom of screens V1, V2, V3, for example, the number of people in the video, the degree to which the people's faces are facing forward, and the size of their faces. In addition, the information display fields V2a and V3a on screens V2 and V3, which include multiple people, will display the average of the individual scores of those people.

[0042] This allows, for example, the user of the switcher 110 to use the scores displayed in the information display fields V1a, V2a, and V3a as reference values ​​for selecting the next video to switch to. Note that the locations of the information display areas V1a, V2a, and V3a may be anywhere else on the multi-view screen, and their placement is not restricted. Also, the information to be displayed may be shown on screen V4 (PVW) or screen V5 (PGM), for example (the same applies to the following embodiments).

[0043] Furthermore, as shown in Figure 9, the switcher 110 of this embodiment may display an evaluation value for each person, which takes into account the degree to which the faces of the people displayed on screens V1, V2, and V3 are facing forward, the size of the faces, etc., as a score for each person, near the area of ​​the person on each screen V1, V2, and V3. This allows us to display the scores for each person in the video, such as the score of the person on the left who is looking away (shown on screen V2 in Figure 9) being 3, and the score of the person on the right who is facing forward (shown on screen V2) being 97. Similarly, for the three people in screen V3 in Figure 9, we can display the score of the person on the left being 88, the score of the person in the middle who is looking away (shown on screen V3) being 1, and the score of the person on the right being 87.

[0044] Furthermore, in the switcher 110 of this embodiment, for example, as shown in Figure 10A, if the display control unit 115 determines that a person in screens V2 and V3 is looking away and is unsuitable for the next video to be switched to, the display control unit 115 may display the face of the person looking away in the video surrounded by a frame. The displayed frame may be a dashed line as shown in Figure 10A, or a dotted or solid line. Furthermore, the shape of the displayed frame is not limited to a square; various forms such as rectangles, polygons, circles, or borders can be used.

[0045] Furthermore, the size of the displayed frame may be large enough to include the face of the person looking away, as shown in Figure 10A, or it may be large enough to include the entire person, including their face, as shown in Figure 10B. This allows the user of the switcher 110 to use the frames displayed on screens V1, V2, and V3 as reference displays for selecting the next video to switch to.

[0046] Furthermore, in the switcher 110 of this embodiment, for example, as shown in Figure 11, if the display control unit 115 determines that a person in screens V2 and V3 is looking away and is unsuitable for the next video to be switched to, the display control unit 115 may overlay and display another video (image) on top of the face of the person who is looking away in the video. The area in which the video (image) is overlaid may be a part of the video or the entire video. Furthermore, the color and shape of the overlaid video (image) are not restricted.

[0047] In this way, overlaying another video (image) on a person displayed on the screen can be used, for example, as a reference display for the user of the switcher 110 to select the next video to switch to. Furthermore, by changing the shape and color of the graphic, it is also possible to indicate scores for each person. Furthermore, in the switcher 110 of this embodiment, for example, as shown in Figure 12, if the display control unit 115 determines that a person in screens V2 and V3 is looking away and is unsuitable for subsequent video feeds, it may overlay a semi-transparent color layer onto the entire video containing the person looking away.

[0048] The area in which the video (image) is overlaid may be a part of the video or the entire video. Furthermore, the color and shape of the overlaid video (image) are not restricted. In this way, displaying another image (video) such as a semi-transparent layer over a person displayed on the screen can be used, for example, as a reference display for the user of the switcher 110 to select the next video to switch to. Furthermore, by changing the shape and color of the shapes, it is also possible to indicate scores for each person.

[0049] Furthermore, using the scores mentioned above, it is possible to automatically select and set the video with the highest score as the next video to be switched to. In other words, it is possible to automatically select and display not only the video (image) with another video, such as a semi-transparent layer, overlaid on the person displayed on the screen, but also all of the displays exemplified above. [Other embodiments] Although one embodiment of the present disclosure has been described above, the present disclosure is not limited to the above embodiment, and various modifications are possible without departing from the gist of the disclosure.

[0050] (A) In the above embodiments, examples of the video person management device and video person management method that implement the present disclosure have been described. However, the present disclosure is not limited thereto. For example, this disclosure may be implemented as a video person management program that causes a computer to execute the video person management method described above.

[0051] This video person management program is stored in the memory (storage unit) of the video person management device. The CPU reads the video person management program stored in memory and instructs the hardware to execute each step. More specifically, the same effect as described above can be achieved by the CPU reading the video person management program and executing each step described above.

[0052] Furthermore, this disclosure may be implemented as a recording medium storing a video person management program. (B) In the above embodiment, an example was given of managing people in a video using multiple videos captured by multiple cameras C1, C2, and C3. However, this disclosure is not limited to this.

[0053] For example, a configuration may be used to manage people in a video by capturing the shooting area AREA11 shown in Figure 13A with a single camera C11, then extracting the regions of interest (ROI) 1 and ROI 2 respectively, as shown in Figure 13B, and using them as multiple videos. Alternatively, instead of cropping a portion of the video, the entire video can be used, as in the ROI3 (Region of Interest).

[0054] In this case, the camera used to capture the video should be capable of high-resolution shooting, such as 4K or 8K, and the entire captured video should be acquired. Then, through sensor readout and video processing (upconversion, downconversion, etc.), multiple cropped images of regions of interest, such as ROI1, ROI2, and ROI3, should be simultaneously acquired at the desired size. A switcher allows each video signal to be treated as if it were from a virtual camera, equivalent to multiple video signals captured using multiple cameras.

[0055] Furthermore, if a lower resolution is not a problem, the camera used for shooting can be a commonly used HD (High Definition) camera. Even in this case, multiple extracted images can be simultaneously obtained from the video captured by the HD camera through processing such as sensor readout and image processing. (C) In the above embodiment, an example was given of managing people in a video using multiple videos captured by multiple cameras C1, C2, and C3. However, this disclosure is not limited to this.

[0056] For example, even if the subject in the video is an animal, the same effect can be achieved by using a signal that the animal can recognize to notify it. (D) In Embodiment 2 described above, an example was given in which the video person management device according to the present invention is applied to a switcher 110. However, this disclosure is not limited thereto.

[0057] For example, the video person management device according to the present invention may be applied to other video-related devices. (E) In the above embodiment, an example of applying the video person management device 10 to a switcher or the like was described. However, the present invention is not limited thereto.

[0058] For example, the video person management device described herein may be applied to other video-related devices or combined with a dimming and color adjustment system, etc. <Note> Based on the above description of embodiments, the following technologies are disclosed. (Technology 1) The video person management device related to Technology 1 is A video person management device connected to a corresponding device that corresponds to a specific person included in video footage of a person being filmed by a camera, A video acquisition unit that acquires video footage captured by the aforementioned camera, A person recognition unit that recognizes the person included in the aforementioned video, A person determination unit that determines whether the person recognized by the person recognition unit meets predetermined conditions, A signal transmission unit that transmits a signal to the corresponding device corresponding to the specific person determined by the person determination unit to meet predetermined conditions, It is equipped with.

[0059] (Technology 2) The video person management device relating to Technology 2 is the video person management device relating to Technology 1, The aforementioned specified condition is the person appearing in the video currently selected by the switcher. (Technology 3) The video person management device relating to Technology 3 is a video person management device relating to Technology 1 or 2, The aforementioned specified condition is that the person is shown in the video that is scheduled to be switched to by the switcher in the next or subsequent video.

[0060] (Technology 4) The video person management device relating to Technology 4 is a video person management device relating to any one of Technologies 1 to 3, The aforementioned specified condition is that the person is unsuitable for the video currently selected by the switcher.

[0061] (Technology 5) The video person management device relating to Technology 5 is a video person management device relating to any one of Technologies 1 to 4, The aforementioned specified condition is that the person is unsuitable for the video that will be switched to by the switcher in the next or subsequent video.

[0062] (Technology 6) The video person management device relating to Technology 6 is a video person management device relating to any one of Technologies 1 to 5, The video acquisition unit receives video footage captured by multiple cameras positioned at multiple locations.

[0063] (Technology 7) The video person management device relating to Technology 7 is a video person management device relating to any one of Technologies 1 to 6, The video acquisition unit acquires video footage obtained from at least a portion of the area captured by a single camera.

[0064] (Technology 8) The video person management device relating to Technology 8 is a video person management device relating to any one of Technologies 1 to 7, The person recognition unit performs facial recognition of the person included in the video and recognizes the specific person corresponding to the corresponding device.

[0065] (Technology 9) The video person management device relating to Technology 9 is a video person management device relating to any one of Technologies 1 to 8, When the person determination unit determines that a predetermined condition is met, the signal transmission unit transmits a signal that causes the corresponding device corresponding to the specific person to vibrate.

[0066] (Technology 10) The video person management device relating to technology 10 is a video person management device relating to any one of technologies 1 to 9, When the signal transmission unit determines that a predetermined condition is met, it transmits a signal to cause the corresponding device corresponding to the specific person to emit light.

[0067] (Technology 11) The video person management device relating to Technology 11 is a video person management device relating to any one of Technologies 1 to 10, When the person determination unit determines that a predetermined condition is met, the signal transmission unit transmits a signal that causes the corresponding device corresponding to the specific person to output voice information.

[0068] (Technology 12) The video person management device relating to Technology 12 is a video person management device relating to any one of Technologies 1 to 11, When the person determination unit determines that a predetermined condition is met, the signal transmission unit transmits a signal that causes predetermined information to be displayed on the display screen of the corresponding device corresponding to the specific person.

[0069] (Technology 13) The video person management device relating to Technology 13 is a video person management device relating to any one of Technologies 1 to 12, A display unit that displays the video acquired by the video acquisition unit, A display control unit that controls the display unit, It also has the following features.

[0070] (Technology 14) The video person management device relating to Technology 14 is the video person management device relating to Technology 13, The display control unit controls the display unit to assign information to the video containing the specific person determined by the person determination unit to meet predetermined conditions. (Technology 15) The video person management device relating to Technology 15 is the video person management device relating to Technology 14, The display control unit adds text information to the video, including the person.

[0071] (Technology 16) The video person management device relating to Technology 16 is the video person management device relating to Technology 15, The display control unit controls the display unit so that the character information is displayed near the person. (Technology 17) The video person management device relating to Technology 17 is a video person management device relating to Technology 15 or 16, The display control unit controls the display unit so that the text information is displayed in the information display field of the video showing the person.

[0072] (Technology 18) The video person management device relating to Technology 18 is a video person management device relating to any one of Technologies 14 to 17, The display control unit controls the display unit so that a frame surrounds part or all of the area of ​​the person in the video.

[0073] (Technology 19) The video person management device relating to Technology 19 is a video person management device relating to any one of Technologies 14 to 18, The display control unit controls the display unit to overlay a predetermined image onto part or all of the area of ​​the person in the video.

[0074] (Technology 20) The switcher related to technology 20 is A video person management device relating to any one of technologies 1 to 19, A video switching unit that switches the display of multiple images captured by the aforementioned camera, It is equipped with. [Industrial applicability]

[0075] The video person management device disclosed herein has the effect of appropriately notifying the person being filmed, and is therefore widely applicable to various systems that use multiple cameras for filming. [Explanation of Symbols]

[0076] 10. Video Person Management Device 11. Video Acquisition Unit 12 Person recognition section 13 Person identification section 14 Signal transmission section 110 Switcher (Video and Person Management Device) 115 Display Control Unit 116 Display section 117 Video switching section AREA1, AREA2, AREA3 shooting areas AREA11 Shooting Area C1, C2, C3 Cameras C11 Camera L1, L2, L3 Spotlights (light-emitting parts) M1, M2, M3 lavalier microphones (audio output section) M1a, M2b, M3c Pin microphone (vibration-applying part) P1,P2,P3 People ROI1, ROI2, ROI3: Areas of Interest SP1, SP2, SP3 Smartphones (Mobile Devices) V1,V2,V3,V4,V5 screen V1a,V2a,V3a information display field

Claims

1. A video person management device connected to a corresponding device that corresponds to a specific person included in video footage of a person being filmed by a camera, A video acquisition unit that acquires video footage captured by the aforementioned camera, A person recognition unit that recognizes the person included in the aforementioned video, A person determination unit that determines whether the person recognized by the person recognition unit meets predetermined conditions, A signal transmission unit that transmits a signal to the corresponding device corresponding to the specific person determined by the person determination unit to meet predetermined conditions, A video-based person management device equipped with the following features.

2. The aforementioned predetermined condition is that the person is shown in the video currently selected by the switcher. The video person management device according to claim 1.

3. The aforementioned predetermined condition is that the person is shown in the video that is scheduled to be switched to by the switcher. The video person management device according to claim 1 or 2.

4. The aforementioned predetermined condition is that the person is unsuitable for the video currently selected by the switcher. The video person management device according to claim 1 or 2.

5. The aforementioned predetermined condition is that the person is unsuitable for the video that will be switched to by the switcher in the next or subsequent video. The video person management device according to claim 1 or 2.

6. The video acquisition unit receives video captured by multiple cameras positioned at multiple locations. The video person management device according to claim 1 or 2.

7. The video acquisition unit acquires video footage obtained from at least a portion of the area captured by a single camera. The video person management device according to claim 1 or 2.

8. The person recognition unit performs facial recognition of the person included in the video and recognizes the specific person corresponding to the corresponding device. The video person management device according to claim 1 or 2.

9. When the person determination unit determines that a predetermined condition is met, the signal transmission unit transmits a signal that causes the corresponding device corresponding to the specific person to vibrate. The video person management device according to claim 1 or 2.

10. When the person determination unit determines that a predetermined condition is met, the signal transmission unit transmits a signal to cause the corresponding device corresponding to the specific person to emit light. The video person management device according to claim 1 or 2.

11. When the person determination unit determines that a predetermined condition is met, the signal transmission unit transmits a signal that causes the corresponding device corresponding to the specific person to output voice information. The video person management device according to claim 1 or 2.

12. When the person determination unit determines that a predetermined condition is met, the signal transmission unit transmits a signal that causes predetermined information to be displayed on the display screen of the corresponding device corresponding to the specific person. The video person management device according to claim 1 or 2.

13. A display unit that displays the video acquired by the video acquisition unit, A display control unit that controls the display unit, It also has, The video person management device according to claim 1 or 2.

14. The display control unit controls the display unit to assign information to the video containing the specific person determined by the person determination unit to meet predetermined conditions. The video person management device according to claim 13.

15. The display control unit adds text information to the video including the person. The video person management device according to claim 14.

16. The display control unit controls the display unit so that the character information is displayed near the person. The video person management device according to claim 15.

17. The display control unit controls the display unit so that the text information is displayed in the information display field of the video showing the person. The video person management device according to claim 15.

18. The display control unit controls the display unit so that a frame surrounds part or all of the area of ​​the person in the video. The video person management device according to claim 14.

19. The display control unit controls the display unit to overlay a predetermined image onto part or all of the area of ​​the person in the video. The video person management device according to claim 14.

20. A video person management device according to claim 1 or 2, A video switching unit that switches the display of multiple images captured by the aforementioned camera, A switcher equipped with [a specific feature / feature].

21. A video person management method using a video person management device connected to a corresponding device that corresponds to a specific person included in video footage of a person being filmed by a camera, The video acquisition unit of the video person management device performs a video acquisition step of acquiring video footage captured by the camera, The person recognition unit of the video person management device performs a person recognition step of recognizing the person included in the video, The person determination unit of the video person management device performs a person determination step in which it determines whether or not the person recognized in the person recognition step meets predetermined conditions, A signal transmission step in which the signal transmission unit of the video person management device transmits a signal to the corresponding device corresponding to the specific person that has been determined to meet predetermined conditions in the person determination step, A video person management method that includes the following features.

22. A video person management program that uses a video person management device connected to a corresponding device that corresponds to a specific person included in video footage of a person being filmed by a camera, The video acquisition unit of the video person management device performs a video acquisition step of acquiring video footage captured by the camera, The person recognition unit of the video person management device performs a person recognition step of recognizing the person included in the video, The person determination unit of the video person management device performs a person determination step in which it determines whether or not the person recognized in the person recognition step meets predetermined conditions, A signal transmission step in which the signal transmission unit of the video person management device transmits a signal to the corresponding device corresponding to the specific person that has been determined to meet predetermined conditions in the person determination step, A video person management program that uses a video person management method to have a computer execute it.

Images